2023-08-10T10:02:30.199 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T10:02:30.200 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --verbose --archive /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555 --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/orig.config.yaml 2023-08-10T10:02:30.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:02:30.375 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555 branch: wip-rishabh-2023Aug1-3 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} email: null first_in_suite: false job_id: '7364555' kernel: flavor: default kdb: true sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023Aug1-3 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Aug1-3 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Aug1-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 500 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 7fda95956ac10132c9b74016ba832db907df09fa timestamp: 2023-08-10_09:50:44 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-10T10:02:30.375 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa; will attempt to use it 2023-08-10T10:02:30.376 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks 2023-08-10T10:02:30.377 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-10T10:02:30.379 INFO:teuthology.task.internal:Checking packages... 2023-08-10T10:02:30.416 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a8bf445f2d27d8e12e060dff0fd151d481b5290b' 2023-08-10T10:02:30.416 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-10T10:02:30.417 INFO:teuthology.packaging:ref: None 2023-08-10T10:02:30.418 INFO:teuthology.packaging:tag: None 2023-08-10T10:02:30.418 INFO:teuthology.packaging:branch: wip-rishabh-2023Aug1-3 2023-08-10T10:02:30.419 INFO:teuthology.packaging:sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:02:30.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Aug1-3 2023-08-10T10:02:30.561 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5118.ga8bf445f 2023-08-10T10:02:30.561 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-10T10:02:30.567 INFO:teuthology.task.internal:no buildpackages task found 2023-08-10T10:02:30.568 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-10T10:02:30.587 INFO:teuthology.task.internal:Saving configuration 2023-08-10T10:02:30.615 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-10T10:02:30.620 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:02:30.646 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:03.139600', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T10:02:30.669 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:03.136867', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T10:02:30.693 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:03.138330', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T10:02:30.693 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-10T10:02:30.699 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-08-10T10:02:30.699 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-08-10T10:02:30.700 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-08-10T10:02:30.700 INFO:teuthology.run_tasks:Running task console_log... 2023-08-10T10:02:30.796 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f812facc160>, signals=[15]) 2023-08-10T10:02:30.797 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-10T10:02:30.803 INFO:teuthology.task.internal:Opening connections... 2023-08-10T10:02:30.803 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T10:02:30.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:02:30.874 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2023-08-10T10:02:30.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:02:30.943 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2023-08-10T10:02:30.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:02:31.012 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-10T10:02:31.019 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-08-10T10:02:31.040 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-08-10T10:02:31.040 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-08-10T10:02:31.099 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:02:31.100 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:02:31.100 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-08-10T10:02:31.100 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-08-10T10:02:31.100 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2023-08-10T10:02:31.100 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:02:31.100 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:02:31.101 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-08-10T10:02:31.101 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:02:31.101 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:02:31.101 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:02:31.101 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:02:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:02:31.101 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:02:31.102 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:02:31.102 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:02:31.102 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:02:31.102 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-08-10T10:02:31.128 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-08-10T10:02:31.148 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-08-10T10:02:31.148 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-08-10T10:02:31.208 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:02:31.209 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:02:31.209 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-08-10T10:02:31.209 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-08-10T10:02:31.210 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-08-10T10:02:31.210 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:02:31.210 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:02:31.210 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-08-10T10:02:31.210 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:02:31.210 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:02:31.210 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:02:31.211 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:02:31.211 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:02:31.211 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:02:31.211 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:02:31.211 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:02:31.211 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:02:31.212 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-08-10T10:02:31.236 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-08-10T10:02:31.257 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-08-10T10:02:31.257 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-08-10T10:02:31.316 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:02:31.316 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:02:31.316 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-08-10T10:02:31.317 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-08-10T10:02:31.317 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-08-10T10:02:31.317 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:02:31.317 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:02:31.317 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-08-10T10:02:31.317 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:02:31.317 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:02:31.318 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:02:31.318 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:02:31.318 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:02:31.318 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:02:31.318 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:02:31.318 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:02:31.318 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:02:31.319 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-08-10T10:02:31.336 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-10T10:02:31.346 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-10T10:02:31.351 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-10T10:02:31.351 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2023-08-10T10:02:31.354 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2023-08-10T10:02:31.356 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2023-08-10T10:02:31.374 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-10T10:02:31.380 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-10T10:02:31.380 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2023-08-10T10:02:31.412 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2023-08-10T10:02:31.414 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2023-08-10T10:02:31.446 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-10T10:02:31.512 INFO:teuthology.run_tasks:Running task kernel... 2023-08-10T10:02:31.531 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'} 2023-08-10T10:02:31.532 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}}, timeout 300 2023-08-10T10:02:31.532 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T10:02:31.533 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T10:02:31.534 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T10:02:31.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:02:31.552 DEBUG:teuthology.task.kernel:sha1 for mon.c is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:31.553 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-10T10:02:31.553 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2023-08-10T10:02:31.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:02:31.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:02:31.556 DEBUG:teuthology.task.kernel:sha1 for mon.b is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:31.557 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-10T10:02:31.557 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2023-08-10T10:02:31.558 DEBUG:teuthology.task.kernel:sha1 for mon.a is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:31.558 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-10T10:02:31.558 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2023-08-10T10:02:31.610 INFO:teuthology.orchestra.run.smithi195.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-10T10:02:31.610 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:31.610 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-10T10:02:31.611 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:31.614 INFO:teuthology.orchestra.run.smithi107.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-10T10:02:31.614 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:31.615 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-10T10:02:31.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:31.619 INFO:teuthology.orchestra.run.smithi157.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-10T10:02:31.620 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:31.620 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-10T10:02:31.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:31.751 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum upgrade -y linux-firmware 2023-08-10T10:02:31.762 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum upgrade -y linux-firmware 2023-08-10T10:02:31.962 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum upgrade -y linux-firmware 2023-08-10T10:02:32.920 INFO:teuthology.orchestra.run.smithi107.stdout:Updating Subscription Management repositories. 2023-08-10T10:02:32.920 INFO:teuthology.orchestra.run.smithi107.stdout:Unable to read consumer identity 2023-08-10T10:02:32.932 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-08-10T10:02:32.932 INFO:teuthology.orchestra.run.smithi195.stdout:Unable to read consumer identity 2023-08-10T10:02:33.092 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-08-10T10:02:33.093 INFO:teuthology.orchestra.run.smithi157.stdout:Unable to read consumer identity 2023-08-10T10:02:34.489 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 9.4 kB/s | 3.5 kB 00:00 2023-08-10T10:02:34.579 INFO:teuthology.orchestra.run.smithi107.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-08-10T10:02:34.664 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-08-10T10:02:36.023 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-08-10T10:02:37.647 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 16 MB 00:03 2023-08-10T10:02:39.489 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 477 kB/s | 24 kB 00:00 2023-08-10T10:02:40.195 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-08-10T10:02:40.197 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2023-08-10T10:02:40.197 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-08-10T10:02:40.324 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on mon.b... 2023-08-10T10:02:40.324 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:40.470 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ 2023-08-10T10:02:40.471 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-10T10:02:40.473 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi157.front.sepia.ceph.com to complete... 2023-08-10T10:02:41.130 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 417 kB/s | 24 kB 00:00 2023-08-10T10:02:41.925 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-08-10T10:02:41.926 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2023-08-10T10:02:41.926 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-08-10T10:02:42.062 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on mon.c... 2023-08-10T10:02:42.062 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:42.112 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 2.1 MB/s | 16 MB 00:07 2023-08-10T10:02:42.351 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ 2023-08-10T10:02:42.352 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-10T10:02:42.354 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi195.front.sepia.ceph.com to complete... 2023-08-10T10:02:45.561 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 470 kB/s | 24 kB 00:00 2023-08-10T10:02:46.342 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2023-08-10T10:02:46.343 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2023-08-10T10:02:46.343 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2023-08-10T10:02:46.476 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on mon.a... 2023-08-10T10:02:46.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:02:46.797 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ 2023-08-10T10:02:46.797 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-10T10:02:46.800 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi107.front.sepia.ceph.com to complete... 2023-08-10T10:02:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10 10:02:59 URL:https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [380807140/380807140] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-10T10:02:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:FINISHED --2023-08-10 10:02:59-- 2023-08-10T10:02:59.202 INFO:teuthology.orchestra.run.smithi157.stderr:Total wall clock time: 19s 2023-08-10T10:02:59.203 INFO:teuthology.orchestra.run.smithi157.stderr:Downloaded: 1 files, 363M in 18s (19.7 MB/s) 2023-08-10T10:02:59.204 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on mon.b... 2023-08-10T10:02:59.204 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-10T10:03:00.790 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying... ######################################## 2023-08-10T10:03:00.857 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing... ######################################## 2023-08-10T10:03:00.942 INFO:teuthology.orchestra.run.smithi157.stdout:Updating / installing... 2023-08-10T10:03:18.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10 10:03:18 URL:https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [380807140/380807140] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-10T10:03:18.214 INFO:teuthology.orchestra.run.smithi107.stderr:FINISHED --2023-08-10 10:03:18-- 2023-08-10T10:03:18.214 INFO:teuthology.orchestra.run.smithi107.stderr:Total wall clock time: 32s 2023-08-10T10:03:18.214 INFO:teuthology.orchestra.run.smithi107.stderr:Downloaded: 1 files, 363M in 31s (11.7 MB/s) 2023-08-10T10:03:18.215 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on mon.a... 2023-08-10T10:03:18.215 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-10T10:03:19.812 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying... ######################################## 2023-08-10T10:03:19.924 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing... ######################################## 2023-08-10T10:03:20.545 INFO:teuthology.orchestra.run.smithi107.stdout:Updating / installing... 2023-08-10T10:03:39.145 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-10T10:03:58.630 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-10T10:04:02.837 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-10T10:04:02.838 DEBUG:teuthology.orchestra.run.smithi157:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-10T10:04:02.881 INFO:teuthology.orchestra.run.smithi157.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:02.881 INFO:teuthology.orchestra.run.smithi157.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:02.881 INFO:teuthology.orchestra.run.smithi157.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:02.881 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:02.881 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-10T10:04:02.881 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-10T10:04:02.882 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-10T10:04:02.882 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-10T10:04:02.882 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-10T10:04:02.882 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-10T10:04:02.882 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-10T10:04:02.882 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-10T10:04:02.882 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-10T10:04:02.883 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-10T10:04:02.883 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-10T10:04:02.883 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-10T10:04:02.883 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-10T10:04:02.883 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-10T10:04:02.883 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-10T10:04:02.883 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-10T10:04:02.884 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-10T10:04:02.884 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-10T10:04:02.884 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-10T10:04:02.884 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-10T10:04:02.884 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-10T10:04:02.884 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-10T10:04:02.884 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-10T10:04:02.884 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-10T10:04:02.885 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-10T10:04:02.885 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-10T10:04:02.885 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-10T10:04:02.885 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-10T10:04:02.885 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-10T10:04:02.885 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-10T10:04:02.885 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-10T10:04:02.886 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-10T10:04:02.886 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-10T10:04:02.886 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-10T10:04:02.886 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-10T10:04:02.886 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-10T10:04:02.886 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-10T10:04:02.886 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-10T10:04:02.886 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-10T10:04:02.887 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-10T10:04:02.887 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-10T10:04:02.887 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-10T10:04:02.887 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-10T10:04:02.887 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-10T10:04:02.887 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-10T10:04:02.887 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-10T10:04:02.887 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-10T10:04:02.888 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-10T10:04:02.888 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-10T10:04:02.888 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-10T10:04:02.888 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-10T10:04:02.888 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-10T10:04:02.888 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-10T10:04:02.888 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-10T10:04:02.889 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-10T10:04:02.889 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-10T10:04:02.889 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-10T10:04:02.889 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-10T10:04:02.889 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-10T10:04:02.889 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-10T10:04:02.889 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-10T10:04:02.889 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-10T10:04:02.890 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-10T10:04:02.890 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-10T10:04:02.890 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-10T10:04:02.890 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-10T10:04:02.890 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-10T10:04:02.890 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-10T10:04:02.890 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-10T10:04:02.890 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-10T10:04:02.891 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-10T10:04:02.891 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-10T10:04:02.891 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-10T10:04:02.891 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-10T10:04:02.891 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-10T10:04:02.891 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-10T10:04:02.891 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-10T10:04:02.892 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-10T10:04:02.892 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-10T10:04:02.892 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-10T10:04:02.892 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-10T10:04:02.892 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-10T10:04:02.892 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-10T10:04:02.892 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-10T10:04:02.892 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-10T10:04:02.893 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-10T10:04:02.893 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-10T10:04:02.893 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-10T10:04:02.893 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-10T10:04:02.893 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-10T10:04:02.893 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-10T10:04:02.893 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-10T10:04:02.893 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-10T10:04:02.894 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-10T10:04:02.894 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-10T10:04:02.894 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-10T10:04:02.894 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-10T10:04:02.894 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-10T10:04:02.894 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-10T10:04:02.894 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-10T10:04:02.895 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-10T10:04:02.895 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-10T10:04:02.895 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-10T10:04:02.895 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-10T10:04:02.895 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-10T10:04:02.895 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-10T10:04:02.895 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-10T10:04:02.895 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-10T10:04:02.896 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-10T10:04:02.896 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-10T10:04:02.896 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-10T10:04:02.896 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-10T10:04:02.896 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-10T10:04:02.896 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-10T10:04:02.896 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-10T10:04:02.896 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-10T10:04:02.897 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-10T10:04:02.897 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-10T10:04:02.897 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-10T10:04:02.897 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-10T10:04:02.897 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-10T10:04:02.897 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-10T10:04:02.897 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-10T10:04:02.898 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-10T10:04:02.898 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-10T10:04:02.898 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-10T10:04:02.898 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-10T10:04:02.898 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-10T10:04:02.898 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-10T10:04:02.898 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-10T10:04:02.898 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-10T10:04:02.899 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-10T10:04:02.899 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-10T10:04:02.899 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-10T10:04:02.899 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-10T10:04:02.899 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-10T10:04:02.899 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-10T10:04:02.899 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-10T10:04:02.900 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-10T10:04:02.900 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-10T10:04:02.900 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-10T10:04:02.900 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-10T10:04:02.900 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-10T10:04:02.900 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-10T10:04:02.900 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-10T10:04:02.900 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-10T10:04:02.901 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-10T10:04:02.901 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-10T10:04:02.901 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-10T10:04:02.901 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-10T10:04:02.901 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-10T10:04:02.901 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-10T10:04:02.901 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-10T10:04:02.901 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-10T10:04:02.902 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-10T10:04:02.902 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-10T10:04:02.902 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-10T10:04:02.902 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-10T10:04:02.902 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-10T10:04:02.902 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-10T10:04:02.902 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-10T10:04:02.903 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-10T10:04:02.903 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-10T10:04:02.903 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-10T10:04:02.903 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-10T10:04:02.903 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-10T10:04:02.903 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-10T10:04:02.903 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-10T10:04:02.903 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-10T10:04:02.904 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-10T10:04:02.904 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-10T10:04:02.904 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-10T10:04:02.904 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-10T10:04:02.904 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-10T10:04:02.904 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-10T10:04:02.904 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-10T10:04:02.904 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-10T10:04:02.905 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-10T10:04:02.905 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-10T10:04:02.905 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-10T10:04:02.905 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-10T10:04:02.905 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-10T10:04:02.905 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-10T10:04:02.905 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-10T10:04:02.906 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-10T10:04:02.906 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-10T10:04:02.906 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-10T10:04:02.906 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-10T10:04:02.906 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-10T10:04:02.906 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-10T10:04:02.906 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-10T10:04:02.906 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-10T10:04:02.907 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-10T10:04:02.908 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-10T10:04:02.909 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-10T10:04:02.910 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-10T10:04:02.911 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-10T10:04:02.912 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-10T10:04:02.913 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-10T10:04:02.913 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-10T10:04:02.913 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-10T10:04:02.913 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-10T10:04:02.913 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-10T10:04:02.913 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-10T10:04:02.913 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-10T10:04:02.914 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-10T10:04:02.914 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-10T10:04:02.914 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-10T10:04:02.914 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-10T10:04:02.914 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-10T10:04:02.914 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-10T10:04:02.914 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-10T10:04:02.914 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-10T10:04:02.915 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-10T10:04:02.915 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-10T10:04:02.915 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-10T10:04:02.915 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-10T10:04:02.915 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-10T10:04:02.915 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-10T10:04:02.915 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-10T10:04:02.915 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-10T10:04:02.916 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-10T10:04:02.916 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-10T10:04:02.916 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-10T10:04:02.916 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-10T10:04:02.916 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-10T10:04:02.916 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-10T10:04:02.916 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-10T10:04:02.916 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-10T10:04:02.917 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-10T10:04:02.917 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-10T10:04:02.917 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-10T10:04:02.917 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-10T10:04:02.917 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-10T10:04:02.917 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-10T10:04:02.917 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-10T10:04:02.918 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-10T10:04:02.918 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-10T10:04:02.918 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-10T10:04:02.918 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-10T10:04:02.918 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-10T10:04:02.918 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-10T10:04:02.918 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-10T10:04:02.918 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-10T10:04:02.919 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-10T10:04:02.919 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-10T10:04:02.919 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-10T10:04:02.919 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-10T10:04:02.919 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-10T10:04:02.919 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-10T10:04:02.919 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-10T10:04:02.919 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-10T10:04:02.920 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-10T10:04:02.920 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-10T10:04:02.920 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-10T10:04:02.920 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-10T10:04:02.920 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-10T10:04:02.920 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-10T10:04:02.920 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-10T10:04:02.921 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-10T10:04:02.921 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-10T10:04:02.921 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-10T10:04:02.921 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-10T10:04:02.921 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-10T10:04:02.921 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-10T10:04:02.921 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-10T10:04:02.921 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-10T10:04:02.922 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-10T10:04:02.922 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-10T10:04:02.922 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-10T10:04:02.922 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-10T10:04:02.922 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-10T10:04:02.922 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-10T10:04:02.922 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-10T10:04:02.922 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-10T10:04:02.923 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-10T10:04:02.923 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-10T10:04:02.923 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-10T10:04:02.923 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-10T10:04:02.923 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-10T10:04:02.923 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-10T10:04:02.923 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-10T10:04:02.923 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-10T10:04:02.924 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-10T10:04:02.924 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-10T10:04:02.924 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-10T10:04:02.924 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-10T10:04:02.924 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-10T10:04:02.924 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-10T10:04:02.924 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-10T10:04:02.925 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-10T10:04:02.925 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-10T10:04:02.925 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-10T10:04:02.925 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-10T10:04:02.925 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-10T10:04:02.925 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-10T10:04:02.925 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-10T10:04:02.925 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-10T10:04:02.926 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-10T10:04:02.926 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-10T10:04:02.926 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-10T10:04:02.926 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-10T10:04:02.926 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-10T10:04:02.926 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-10T10:04:02.926 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-10T10:04:02.926 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-10T10:04:02.927 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-10T10:04:02.927 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-10T10:04:02.927 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-10T10:04:02.927 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-10T10:04:02.927 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-10T10:04:02.927 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-10T10:04:02.927 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-10T10:04:02.927 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-10T10:04:02.928 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-10T10:04:02.928 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-10T10:04:02.928 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-10T10:04:02.928 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-10T10:04:02.928 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-10T10:04:02.928 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-10T10:04:02.928 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-10T10:04:02.929 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-10T10:04:02.929 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-10T10:04:02.929 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-10T10:04:02.929 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-10T10:04:02.929 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-10T10:04:02.929 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-10T10:04:02.929 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-10T10:04:02.929 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-10T10:04:02.930 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-10T10:04:02.930 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-10T10:04:02.930 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-10T10:04:02.930 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-10T10:04:02.930 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-10T10:04:02.930 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-10T10:04:02.930 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-10T10:04:02.930 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-10T10:04:02.931 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-10T10:04:02.931 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-10T10:04:02.931 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-10T10:04:02.931 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-10T10:04:02.931 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-10T10:04:02.931 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-10T10:04:02.931 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-10T10:04:02.931 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-10T10:04:02.932 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-10T10:04:02.932 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-10T10:04:02.932 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-10T10:04:02.932 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-10T10:04:02.932 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-10T10:04:02.932 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-10T10:04:02.932 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-10T10:04:02.933 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-10T10:04:02.933 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-10T10:04:02.933 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-10T10:04:02.933 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-10T10:04:02.933 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-10T10:04:02.933 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-10T10:04:02.933 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-10T10:04:02.933 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-10T10:04:02.934 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-10T10:04:02.934 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-10T10:04:02.934 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-10T10:04:02.934 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-10T10:04:02.934 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-10T10:04:02.934 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-10T10:04:02.934 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-10T10:04:02.934 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-10T10:04:02.935 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-10T10:04:02.935 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-10T10:04:02.935 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-10T10:04:02.935 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-10T10:04:02.935 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-10T10:04:02.935 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-10T10:04:02.935 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-10T10:04:02.936 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-10T10:04:02.936 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-10T10:04:02.936 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-10T10:04:02.936 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-10T10:04:02.936 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-10T10:04:02.936 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-10T10:04:02.936 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-10T10:04:02.936 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-10T10:04:02.937 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-10T10:04:02.937 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-10T10:04:02.937 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-10T10:04:02.937 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-10T10:04:02.937 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-10T10:04:02.937 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-10T10:04:02.937 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-10T10:04:02.937 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-10T10:04:02.938 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-10T10:04:02.938 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-10T10:04:02.938 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-10T10:04:02.938 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-10T10:04:02.938 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-10T10:04:02.938 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-10T10:04:02.938 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-10T10:04:02.938 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-10T10:04:02.939 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-10T10:04:02.939 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-10T10:04:02.939 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-10T10:04:02.939 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-10T10:04:02.939 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-10T10:04:02.939 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-10T10:04:02.939 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-10T10:04:02.940 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-10T10:04:02.940 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-10T10:04:02.940 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-10T10:04:02.940 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-10T10:04:02.940 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-10T10:04:02.940 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-10T10:04:02.940 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-10T10:04:02.940 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-10T10:04:02.941 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-10T10:04:02.941 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-10T10:04:02.941 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-10T10:04:02.941 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-10T10:04:02.941 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-10T10:04:02.941 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-10T10:04:02.941 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-10T10:04:02.941 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-10T10:04:02.942 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-10T10:04:02.942 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-10T10:04:02.942 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-10T10:04:02.942 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-10T10:04:02.942 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-10T10:04:02.942 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-10T10:04:02.942 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-10T10:04:02.943 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-10T10:04:02.943 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-10T10:04:02.943 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-10T10:04:02.943 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-10T10:04:02.943 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-10T10:04:02.943 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-10T10:04:02.943 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-10T10:04:02.943 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-10T10:04:02.944 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-10T10:04:02.944 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-10T10:04:02.944 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-10T10:04:02.944 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-10T10:04:02.944 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-10T10:04:02.944 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-10T10:04:02.944 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-10T10:04:02.944 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-10T10:04:02.945 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-10T10:04:02.945 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-10T10:04:02.945 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-10T10:04:02.945 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-10T10:04:02.945 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-10T10:04:02.945 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-10T10:04:02.945 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-10T10:04:02.946 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-10T10:04:02.946 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-10T10:04:02.946 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-10T10:04:02.946 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-10T10:04:02.946 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-10T10:04:02.946 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-10T10:04:02.946 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-10T10:04:02.946 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-10T10:04:02.947 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-10T10:04:02.947 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-10T10:04:02.947 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-10T10:04:02.947 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-10T10:04:02.947 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-10T10:04:02.947 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-10T10:04:02.947 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-10T10:04:02.947 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-10T10:04:02.948 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-10T10:04:02.948 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-10T10:04:02.948 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-10T10:04:02.948 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-10T10:04:02.948 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-10T10:04:02.948 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-10T10:04:02.948 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-10T10:04:02.948 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-10T10:04:02.949 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-10T10:04:02.949 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-10T10:04:02.949 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-10T10:04:02.949 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-10T10:04:02.949 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-10T10:04:02.949 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-10T10:04:02.949 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-10T10:04:02.950 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-10T10:04:02.950 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-10T10:04:02.950 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-10T10:04:02.950 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-10T10:04:02.950 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-10T10:04:02.950 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-10T10:04:02.950 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-10T10:04:02.950 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-10T10:04:02.951 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-10T10:04:02.951 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-10T10:04:02.951 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-10T10:04:02.951 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-10T10:04:02.951 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-10T10:04:02.951 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-10T10:04:02.951 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-10T10:04:02.951 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-10T10:04:02.952 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-10T10:04:02.952 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-10T10:04:02.952 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-10T10:04:02.952 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-10T10:04:02.952 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-10T10:04:02.952 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-10T10:04:02.952 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-10T10:04:02.952 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-10T10:04:02.953 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-10T10:04:02.953 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-10T10:04:02.953 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-10T10:04:02.953 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-10T10:04:02.953 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-10T10:04:02.953 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-10T10:04:02.953 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-10T10:04:02.954 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-10T10:04:02.954 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-10T10:04:02.954 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-10T10:04:02.954 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-10T10:04:02.954 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-10T10:04:02.954 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-10T10:04:02.954 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-10T10:04:02.954 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-10T10:04:02.955 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-10T10:04:02.955 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-10T10:04:02.955 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-10T10:04:02.955 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-10T10:04:02.955 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-10T10:04:02.955 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-10T10:04:02.955 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-10T10:04:02.955 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-10T10:04:02.956 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-10T10:04:02.956 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-10T10:04:02.956 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-10T10:04:02.956 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-10T10:04:02.956 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-10T10:04:02.956 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-10T10:04:02.956 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-10T10:04:02.957 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-10T10:04:02.957 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-10T10:04:02.957 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-10T10:04:02.957 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-10T10:04:02.957 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-10T10:04:02.957 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-10T10:04:02.957 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-10T10:04:02.957 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-10T10:04:02.958 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-10T10:04:02.958 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-10T10:04:02.958 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-10T10:04:02.958 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-10T10:04:02.958 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-10T10:04:02.958 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-10T10:04:02.958 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-10T10:04:02.959 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-10T10:04:02.959 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-10T10:04:02.959 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-10T10:04:02.959 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-10T10:04:02.959 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-10T10:04:02.959 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-10T10:04:02.959 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-10T10:04:02.959 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-10T10:04:02.960 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-10T10:04:02.960 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-10T10:04:02.960 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-10T10:04:02.960 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-10T10:04:02.960 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-10T10:04:02.960 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-10T10:04:02.960 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-10T10:04:02.960 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-10T10:04:02.961 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-10T10:04:02.961 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-10T10:04:02.961 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-10T10:04:02.961 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-10T10:04:02.961 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-10T10:04:02.961 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-10T10:04:02.961 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-10T10:04:02.962 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-10T10:04:02.962 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-10T10:04:02.962 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-10T10:04:02.962 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-10T10:04:02.962 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-10T10:04:02.962 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-10T10:04:02.962 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-10T10:04:02.962 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-10T10:04:02.963 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-10T10:04:02.963 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-10T10:04:02.963 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-10T10:04:02.963 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-10T10:04:02.963 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-10T10:04:02.963 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-10T10:04:02.963 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-10T10:04:02.963 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-10T10:04:02.964 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-10T10:04:02.964 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-10T10:04:02.964 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-10T10:04:02.964 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-10T10:04:02.964 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-10T10:04:02.964 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-10T10:04:02.964 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-10T10:04:02.964 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-10T10:04:02.965 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-10T10:04:02.965 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-10T10:04:02.965 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-10T10:04:02.965 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-10T10:04:02.965 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-10T10:04:02.965 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-10T10:04:02.965 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-10T10:04:02.966 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-10T10:04:02.966 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-10T10:04:02.966 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-10T10:04:02.966 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-10T10:04:02.966 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-10T10:04:02.966 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-10T10:04:02.966 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-10T10:04:02.966 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-10T10:04:02.967 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-10T10:04:02.967 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-10T10:04:02.967 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-10T10:04:02.967 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-10T10:04:02.967 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-10T10:04:02.967 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-10T10:04:02.967 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-10T10:04:02.967 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-10T10:04:02.968 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-10T10:04:02.968 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-10T10:04:02.968 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-10T10:04:02.968 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-10T10:04:02.968 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-10T10:04:02.968 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-10T10:04:02.968 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-10T10:04:02.968 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-10T10:04:02.969 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-10T10:04:02.969 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-10T10:04:02.969 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-10T10:04:02.969 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-10T10:04:02.969 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-10T10:04:02.969 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-10T10:04:02.969 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-10T10:04:02.970 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-10T10:04:02.970 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-10T10:04:02.970 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-10T10:04:02.970 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-10T10:04:02.970 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-10T10:04:02.970 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-10T10:04:02.970 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-10T10:04:02.970 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-10T10:04:02.971 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-10T10:04:02.971 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-10T10:04:02.971 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-10T10:04:02.971 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-10T10:04:02.971 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-10T10:04:02.971 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-10T10:04:02.971 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-10T10:04:02.971 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-10T10:04:02.972 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-10T10:04:02.972 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-10T10:04:02.972 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-10T10:04:02.972 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-10T10:04:02.972 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-10T10:04:02.972 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-10T10:04:02.972 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-10T10:04:02.973 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-10T10:04:02.973 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-10T10:04:02.973 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-10T10:04:02.973 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-10T10:04:02.973 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-10T10:04:02.973 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-10T10:04:02.973 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-10T10:04:02.973 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-10T10:04:02.974 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-10T10:04:02.974 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-10T10:04:02.974 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-10T10:04:02.974 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-10T10:04:02.974 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-10T10:04:02.974 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-10T10:04:02.974 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-10T10:04:02.974 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-10T10:04:02.975 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-10T10:04:02.975 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-10T10:04:02.975 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-10T10:04:02.975 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-10T10:04:02.975 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-10T10:04:02.975 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-10T10:04:02.975 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-10T10:04:02.975 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-10T10:04:02.976 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-10T10:04:02.976 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-10T10:04:02.976 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-10T10:04:02.976 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-10T10:04:02.976 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-10T10:04:02.976 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-10T10:04:02.976 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-10T10:04:02.976 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-10T10:04:02.977 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-10T10:04:02.977 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-10T10:04:02.977 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-10T10:04:02.977 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-10T10:04:02.977 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-10T10:04:02.977 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-10T10:04:02.977 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-10T10:04:02.978 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-10T10:04:02.978 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-10T10:04:02.978 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-10T10:04:02.978 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-10T10:04:02.978 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-10T10:04:02.978 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-10T10:04:02.978 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-10T10:04:02.978 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-10T10:04:02.979 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-10T10:04:02.979 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-10T10:04:02.979 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-10T10:04:02.979 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-10T10:04:02.979 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-10T10:04:02.979 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-10T10:04:02.979 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-10T10:04:02.979 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-10T10:04:02.980 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-10T10:04:02.980 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-10T10:04:02.980 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-10T10:04:02.980 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-10T10:04:02.980 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-10T10:04:02.980 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-10T10:04:02.980 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-10T10:04:02.980 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-10T10:04:02.981 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-10T10:04:02.981 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-10T10:04:02.981 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-10T10:04:02.981 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-10T10:04:02.981 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-10T10:04:02.981 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-10T10:04:02.981 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-10T10:04:02.981 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-10T10:04:02.982 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-10T10:04:02.982 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-10T10:04:02.982 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-10T10:04:02.982 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-10T10:04:02.982 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-10T10:04:02.982 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-10T10:04:02.982 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-10T10:04:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-10T10:04:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-10T10:04:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-10T10:04:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-10T10:04:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-10T10:04:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-10T10:04:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-10T10:04:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-10T10:04:02.984 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-10T10:04:02.984 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-10T10:04:02.984 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-10T10:04:02.984 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-10T10:04:02.984 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-10T10:04:02.984 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-10T10:04:02.984 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-10T10:04:02.984 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-10T10:04:02.985 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-10T10:04:02.985 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-10T10:04:02.985 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-10T10:04:02.985 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-10T10:04:02.985 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-10T10:04:02.985 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-10T10:04:02.985 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-10T10:04:02.986 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-10T10:04:02.986 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-10T10:04:02.986 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-10T10:04:02.986 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-10T10:04:02.986 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-10T10:04:02.986 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-10T10:04:02.986 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-10T10:04:02.986 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-10T10:04:02.987 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-10T10:04:02.987 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-10T10:04:02.987 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-10T10:04:02.987 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-10T10:04:02.987 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-10T10:04:02.987 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-10T10:04:02.987 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-10T10:04:02.988 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-10T10:04:02.988 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-10T10:04:02.988 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-10T10:04:02.988 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-10T10:04:02.988 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-10T10:04:02.988 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-10T10:04:02.988 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-10T10:04:02.988 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-10T10:04:02.989 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-10T10:04:02.989 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-10T10:04:02.989 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-10T10:04:02.989 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-10T10:04:02.989 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-10T10:04:02.989 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-10T10:04:02.989 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-10T10:04:02.990 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-10T10:04:02.990 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-10T10:04:02.990 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-10T10:04:02.990 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-10T10:04:02.990 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-10T10:04:02.990 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-10T10:04:02.990 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-10T10:04:02.990 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-10T10:04:02.991 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-10T10:04:02.991 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-10T10:04:02.991 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-10T10:04:02.991 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-10T10:04:02.991 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-10T10:04:02.991 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-10T10:04:02.991 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-10T10:04:02.991 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-10T10:04:02.992 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-10T10:04:02.992 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-10T10:04:02.992 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-10T10:04:02.992 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-10T10:04:02.992 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-10T10:04:02.992 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-10T10:04:02.992 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-10T10:04:02.992 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-10T10:04:02.993 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-10T10:04:02.993 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-10T10:04:02.993 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-10T10:04:02.993 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-10T10:04:02.993 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-10T10:04:02.993 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-10T10:04:02.993 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-10T10:04:02.994 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-10T10:04:02.994 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-10T10:04:02.994 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-10T10:04:02.994 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-10T10:04:02.994 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-10T10:04:02.994 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-10T10:04:02.994 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-10T10:04:02.994 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-10T10:04:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-10T10:04:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-10T10:04:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-10T10:04:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-10T10:04:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-10T10:04:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-10T10:04:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-10T10:04:02.995 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-10T10:04:02.996 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-10T10:04:02.996 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-10T10:04:02.996 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-10T10:04:02.996 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-10T10:04:02.996 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-10T10:04:02.996 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-10T10:04:02.996 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-10T10:04:02.996 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-10T10:04:02.997 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-10T10:04:02.997 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-10T10:04:02.997 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-10T10:04:02.997 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-10T10:04:02.997 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-10T10:04:02.997 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-10T10:04:02.997 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-10T10:04:02.997 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-10T10:04:02.998 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-10T10:04:02.998 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-10T10:04:02.998 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-10T10:04:02.998 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-10T10:04:02.998 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-10T10:04:02.998 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-10T10:04:02.998 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-10T10:04:02.998 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-10T10:04:02.999 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-10T10:04:02.999 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-10T10:04:02.999 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-10T10:04:02.999 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-10T10:04:02.999 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-10T10:04:02.999 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-10T10:04:02.999 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-10T10:04:03.000 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-10T10:04:03.000 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-10T10:04:03.000 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-10T10:04:03.000 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-10T10:04:03.000 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-10T10:04:03.000 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-10T10:04:03.000 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-10T10:04:03.000 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-10T10:04:03.001 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-10T10:04:03.001 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-10T10:04:03.001 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-10T10:04:03.001 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-10T10:04:03.001 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-10T10:04:03.001 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-10T10:04:03.001 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-10T10:04:03.001 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-10T10:04:03.002 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-10T10:04:03.002 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-10T10:04:03.002 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-10T10:04:03.002 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-10T10:04:03.002 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-10T10:04:03.002 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-10T10:04:03.002 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-10T10:04:03.002 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-10T10:04:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-10T10:04:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-10T10:04:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-10T10:04:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-10T10:04:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-10T10:04:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-10T10:04:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-10T10:04:03.003 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-10T10:04:03.004 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-10T10:04:03.004 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-10T10:04:03.004 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-10T10:04:03.004 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-10T10:04:03.004 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-10T10:04:03.004 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-10T10:04:03.004 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-10T10:04:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-10T10:04:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-10T10:04:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-10T10:04:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-10T10:04:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-10T10:04:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-10T10:04:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-10T10:04:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-10T10:04:03.006 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-10T10:04:03.006 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-10T10:04:03.006 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-10T10:04:03.006 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-10T10:04:03.006 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-10T10:04:03.006 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-10T10:04:03.006 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-10T10:04:03.006 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-10T10:04:03.007 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-10T10:04:03.007 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-10T10:04:03.007 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-10T10:04:03.007 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-10T10:04:03.007 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-10T10:04:03.007 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-10T10:04:03.007 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-10T10:04:03.007 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-10T10:04:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-10T10:04:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-10T10:04:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-10T10:04:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-10T10:04:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-10T10:04:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-10T10:04:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-10T10:04:03.008 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-10T10:04:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-10T10:04:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-10T10:04:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-10T10:04:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-10T10:04:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-10T10:04:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-10T10:04:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-10T10:04:03.009 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-10T10:04:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-10T10:04:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-10T10:04:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-10T10:04:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-10T10:04:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-10T10:04:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-10T10:04:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-10T10:04:03.010 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-10T10:04:03.011 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-10T10:04:03.011 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-10T10:04:03.011 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-10T10:04:03.011 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-10T10:04:03.011 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-10T10:04:03.011 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-10T10:04:03.011 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-10T10:04:03.011 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-10T10:04:03.012 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-10T10:04:03.012 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-10T10:04:03.012 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-10T10:04:03.012 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-10T10:04:03.012 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-10T10:04:03.012 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-10T10:04:03.012 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-10T10:04:03.013 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-10T10:04:03.013 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-10T10:04:03.013 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-10T10:04:03.013 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-10T10:04:03.013 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-10T10:04:03.013 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-10T10:04:03.014 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-10T10:04:03.014 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-10T10:04:03.014 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-10T10:04:03.014 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-10T10:04:03.014 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-10T10:04:03.015 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-10T10:04:03.015 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-10T10:04:03.015 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-10T10:04:03.015 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-10T10:04:03.015 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-10T10:04:03.015 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-10T10:04:03.016 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-10T10:04:03.016 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-10T10:04:03.016 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-10T10:04:03.016 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-10T10:04:03.016 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-10T10:04:03.016 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-10T10:04:03.016 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-10T10:04:03.017 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-10T10:04:03.017 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-10T10:04:03.017 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-10T10:04:03.017 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-10T10:04:03.017 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-10T10:04:03.017 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-10T10:04:03.017 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-10T10:04:03.017 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-10T10:04:03.018 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-10T10:04:03.018 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-10T10:04:03.018 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-10T10:04:03.018 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-10T10:04:03.018 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-10T10:04:03.018 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-10T10:04:03.018 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-10T10:04:03.019 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-10T10:04:03.019 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-10T10:04:03.019 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-10T10:04:03.019 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-10T10:04:03.019 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-10T10:04:03.019 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-10T10:04:03.019 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-10T10:04:03.019 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-10T10:04:03.020 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-10T10:04:03.020 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-10T10:04:03.020 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-10T10:04:03.020 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-10T10:04:03.020 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-10T10:04:03.020 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-10T10:04:03.020 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-10T10:04:03.021 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-10T10:04:03.021 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-10T10:04:03.021 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-10T10:04:03.021 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-10T10:04:03.021 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-10T10:04:03.021 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-10T10:04:03.021 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-10T10:04:03.022 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-10T10:04:03.022 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-10T10:04:03.022 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-10T10:04:03.022 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-10T10:04:03.022 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-10T10:04:03.022 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-10T10:04:03.022 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-10T10:04:03.022 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-10T10:04:03.023 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-10T10:04:03.023 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-10T10:04:03.023 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-10T10:04:03.023 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-10T10:04:03.023 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-10T10:04:03.023 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-10T10:04:03.023 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-10T10:04:03.023 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-10T10:04:03.024 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-10T10:04:03.024 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-10T10:04:03.024 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-10T10:04:03.024 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-10T10:04:03.024 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-10T10:04:03.024 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-10T10:04:03.024 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-10T10:04:03.025 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-10T10:04:03.025 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-10T10:04:03.025 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-10T10:04:03.025 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-10T10:04:03.025 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-10T10:04:03.025 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-10T10:04:03.025 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-10T10:04:03.025 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-10T10:04:03.026 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-10T10:04:03.026 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-10T10:04:03.026 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-10T10:04:03.026 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-10T10:04:03.026 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-10T10:04:03.026 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-10T10:04:03.026 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-10T10:04:03.026 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-10T10:04:03.027 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-10T10:04:03.027 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-10T10:04:03.027 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-10T10:04:03.027 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-10T10:04:03.027 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-10T10:04:03.027 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-10T10:04:03.027 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-10T10:04:03.027 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-10T10:04:03.028 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-10T10:04:03.028 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-10T10:04:03.028 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-10T10:04:03.028 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-10T10:04:03.028 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-10T10:04:03.028 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-10T10:04:03.028 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-10T10:04:03.029 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-10T10:04:03.029 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-10T10:04:03.029 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-10T10:04:03.029 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-10T10:04:03.029 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-10T10:04:03.029 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-10T10:04:03.029 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-10T10:04:03.029 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-10T10:04:03.030 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-10T10:04:03.030 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-10T10:04:03.030 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-10T10:04:03.030 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-10T10:04:03.030 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-10T10:04:03.030 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-10T10:04:03.030 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-10T10:04:03.031 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-10T10:04:03.031 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-10T10:04:03.031 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-10T10:04:03.031 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-10T10:04:03.031 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-10T10:04:03.031 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-10T10:04:03.031 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-10T10:04:03.031 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-10T10:04:03.032 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-10T10:04:03.032 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-10T10:04:03.032 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-10T10:04:03.032 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-10T10:04:03.032 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-10T10:04:03.032 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-10T10:04:03.032 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-10T10:04:03.032 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-10T10:04:03.033 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-10T10:04:03.033 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-10T10:04:03.033 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-10T10:04:03.033 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-10T10:04:03.033 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-10T10:04:03.033 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-10T10:04:03.033 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-10T10:04:03.033 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-10T10:04:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-10T10:04:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-10T10:04:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-10T10:04:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-10T10:04:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-10T10:04:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-10T10:04:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-10T10:04:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-10T10:04:03.035 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-10T10:04:03.035 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-10T10:04:03.035 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-10T10:04:03.035 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-10T10:04:03.035 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-10T10:04:03.035 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-10T10:04:03.035 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-10T10:04:03.035 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-10T10:04:03.036 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-10T10:04:03.036 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-10T10:04:03.036 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-10T10:04:03.036 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-10T10:04:03.036 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-10T10:04:03.036 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-10T10:04:03.036 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-10T10:04:03.037 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-10T10:04:03.037 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-10T10:04:03.037 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-10T10:04:03.037 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-10T10:04:03.037 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-10T10:04:03.037 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-10T10:04:03.037 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-10T10:04:03.037 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-10T10:04:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-10T10:04:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-10T10:04:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-10T10:04:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-10T10:04:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-10T10:04:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-10T10:04:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-10T10:04:03.038 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-10T10:04:03.039 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-10T10:04:03.039 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-10T10:04:03.039 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-10T10:04:03.039 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-10T10:04:03.039 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-10T10:04:03.039 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-10T10:04:03.039 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-10T10:04:03.039 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-10T10:04:03.040 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-10T10:04:03.040 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-10T10:04:03.040 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-10T10:04:03.040 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-10T10:04:03.040 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-10T10:04:03.040 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-10T10:04:03.040 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-10T10:04:03.040 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-10T10:04:03.041 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-10T10:04:03.041 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-10T10:04:03.041 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-10T10:04:03.041 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-10T10:04:03.041 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-10T10:04:03.041 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-10T10:04:03.041 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-10T10:04:03.041 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-10T10:04:03.042 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-10T10:04:03.042 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-10T10:04:03.042 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-10T10:04:03.042 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-10T10:04:03.042 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-10T10:04:03.042 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-10T10:04:03.042 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-10T10:04:03.042 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-10T10:04:03.043 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-10T10:04:03.043 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-10T10:04:03.043 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-10T10:04:03.043 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-10T10:04:03.043 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-10T10:04:03.043 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-10T10:04:03.043 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-10T10:04:03.043 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-10T10:04:03.044 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-10T10:04:03.044 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-10T10:04:03.044 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-10T10:04:03.044 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-10T10:04:03.044 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-10T10:04:03.044 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-10T10:04:03.044 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-10T10:04:03.045 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-10T10:04:03.045 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-10T10:04:03.045 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-10T10:04:03.045 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-10T10:04:03.045 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-10T10:04:03.045 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-10T10:04:03.045 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-10T10:04:03.045 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-10T10:04:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-10T10:04:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-10T10:04:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-10T10:04:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-10T10:04:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-10T10:04:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-10T10:04:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-10T10:04:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-10T10:04:03.047 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-10T10:04:03.047 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-10T10:04:03.047 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-10T10:04:03.047 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-10T10:04:03.047 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-10T10:04:03.047 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-10T10:04:03.047 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-10T10:04:03.047 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-10T10:04:03.048 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-10T10:04:03.048 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-10T10:04:03.048 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-10T10:04:03.048 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-10T10:04:03.048 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-10T10:04:03.048 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-10T10:04:03.048 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-10T10:04:03.048 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-10T10:04:03.049 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-10T10:04:03.049 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-10T10:04:03.049 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-10T10:04:03.049 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-10T10:04:03.049 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-10T10:04:03.049 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-10T10:04:03.049 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-10T10:04:03.049 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-10T10:04:03.050 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-10T10:04:03.050 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-10T10:04:03.050 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-10T10:04:03.050 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-10T10:04:03.050 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-10T10:04:03.050 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-10T10:04:03.050 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-10T10:04:03.050 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-10T10:04:03.051 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-10T10:04:03.051 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-10T10:04:03.051 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-10T10:04:03.051 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-10T10:04:03.051 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-10T10:04:03.051 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-10T10:04:03.051 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-10T10:04:03.051 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-10T10:04:03.052 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-10T10:04:03.052 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-10T10:04:03.052 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-10T10:04:03.052 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-10T10:04:03.052 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-10T10:04:03.052 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-10T10:04:03.052 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-10T10:04:03.053 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-10T10:04:03.053 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-10T10:04:03.053 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-10T10:04:03.053 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-10T10:04:03.053 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-10T10:04:03.053 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-10T10:04:03.053 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-10T10:04:03.053 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-10T10:04:03.054 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-10T10:04:03.054 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-10T10:04:03.054 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-10T10:04:03.054 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-10T10:04:03.054 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-10T10:04:03.054 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-10T10:04:03.054 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-10T10:04:03.054 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-10T10:04:03.055 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-10T10:04:03.055 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-10T10:04:03.055 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-10T10:04:03.055 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-10T10:04:03.055 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-10T10:04:03.055 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-10T10:04:03.055 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-10T10:04:03.055 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-10T10:04:03.056 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-10T10:04:03.056 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-10T10:04:03.056 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-10T10:04:03.056 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-10T10:04:03.056 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-10T10:04:03.056 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-10T10:04:03.056 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-10T10:04:03.056 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-10T10:04:03.057 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-10T10:04:03.057 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-10T10:04:03.057 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-10T10:04:03.057 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-10T10:04:03.057 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-10T10:04:03.057 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-10T10:04:03.057 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-10T10:04:03.057 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-10T10:04:03.058 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-10T10:04:03.058 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-10T10:04:03.058 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-10T10:04:03.058 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-10T10:04:03.058 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-10T10:04:03.058 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-10T10:04:03.058 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-10T10:04:03.059 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-10T10:04:03.059 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-10T10:04:03.059 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-10T10:04:03.059 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-10T10:04:03.059 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-10T10:04:03.059 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-10T10:04:03.059 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-10T10:04:03.059 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-10T10:04:03.060 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-10T10:04:03.060 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-10T10:04:03.060 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-10T10:04:03.060 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-10T10:04:03.060 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-10T10:04:03.060 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-10T10:04:03.060 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-10T10:04:03.060 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-10T10:04:03.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-10T10:04:03.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-10T10:04:03.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-10T10:04:03.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-10T10:04:03.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-10T10:04:03.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-10T10:04:03.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-10T10:04:03.061 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-10T10:04:03.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-10T10:04:03.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-10T10:04:03.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-10T10:04:03.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-10T10:04:03.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-10T10:04:03.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-10T10:04:03.062 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-10T10:04:03.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-10T10:04:03.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-10T10:04:03.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-10T10:04:03.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-10T10:04:03.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-10T10:04:03.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-10T10:04:03.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-10T10:04:03.063 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-10T10:04:03.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-10T10:04:03.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-10T10:04:03.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-10T10:04:03.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-10T10:04:03.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-10T10:04:03.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-10T10:04:03.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-10T10:04:03.064 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-10T10:04:03.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-10T10:04:03.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-10T10:04:03.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-10T10:04:03.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-10T10:04:03.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-10T10:04:03.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-10T10:04:03.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-10T10:04:03.065 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-10T10:04:03.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-10T10:04:03.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-10T10:04:03.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-10T10:04:03.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-10T10:04:03.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-10T10:04:03.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-10T10:04:03.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-10T10:04:03.066 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-10T10:04:03.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-10T10:04:03.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-10T10:04:03.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-10T10:04:03.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-10T10:04:03.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-10T10:04:03.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-10T10:04:03.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-10T10:04:03.067 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-10T10:04:03.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-10T10:04:03.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-10T10:04:03.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-10T10:04:03.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-10T10:04:03.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-10T10:04:03.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-10T10:04:03.068 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-10T10:04:03.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-10T10:04:03.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-10T10:04:03.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-10T10:04:03.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-10T10:04:03.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-10T10:04:03.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-10T10:04:03.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-10T10:04:03.069 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-10T10:04:03.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-10T10:04:03.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-10T10:04:03.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-10T10:04:03.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-10T10:04:03.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-10T10:04:03.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-10T10:04:03.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-10T10:04:03.070 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-10T10:04:03.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-10T10:04:03.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-10T10:04:03.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-10T10:04:03.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-10T10:04:03.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-10T10:04:03.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-10T10:04:03.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-10T10:04:03.071 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-10T10:04:03.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-10T10:04:03.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-10T10:04:03.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-10T10:04:03.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-10T10:04:03.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-10T10:04:03.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-10T10:04:03.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-10T10:04:03.072 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-10T10:04:03.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-10T10:04:03.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-10T10:04:03.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-10T10:04:03.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-10T10:04:03.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-10T10:04:03.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-10T10:04:03.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-10T10:04:03.073 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-10T10:04:03.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-10T10:04:03.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-10T10:04:03.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-10T10:04:03.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-10T10:04:03.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-10T10:04:03.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-10T10:04:03.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-10T10:04:03.074 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-10T10:04:03.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-10T10:04:03.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-10T10:04:03.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-10T10:04:03.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-10T10:04:03.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-10T10:04:03.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-10T10:04:03.075 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-10T10:04:03.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-10T10:04:03.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-10T10:04:03.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-10T10:04:03.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-10T10:04:03.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-10T10:04:03.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-10T10:04:03.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-10T10:04:03.076 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-10T10:04:03.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-10T10:04:03.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-10T10:04:03.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-10T10:04:03.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-10T10:04:03.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-10T10:04:03.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-10T10:04:03.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-10T10:04:03.077 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-10T10:04:03.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-10T10:04:03.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-10T10:04:03.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-10T10:04:03.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-10T10:04:03.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-10T10:04:03.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-10T10:04:03.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-10T10:04:03.078 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-10T10:04:03.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-10T10:04:03.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-10T10:04:03.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-10T10:04:03.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-10T10:04:03.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-10T10:04:03.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-10T10:04:03.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-10T10:04:03.079 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-10T10:04:03.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-10T10:04:03.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-10T10:04:03.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-10T10:04:03.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-10T10:04:03.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-10T10:04:03.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-10T10:04:03.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-10T10:04:03.080 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-10T10:04:03.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-10T10:04:03.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-10T10:04:03.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-10T10:04:03.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-10T10:04:03.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-10T10:04:03.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-10T10:04:03.081 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-10T10:04:03.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-10T10:04:03.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-10T10:04:03.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-10T10:04:03.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-10T10:04:03.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-10T10:04:03.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-10T10:04:03.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-10T10:04:03.082 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-10T10:04:03.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-10T10:04:03.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-10T10:04:03.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-10T10:04:03.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-10T10:04:03.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-10T10:04:03.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-10T10:04:03.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-10T10:04:03.083 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-10T10:04:03.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-10T10:04:03.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-10T10:04:03.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-10T10:04:03.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-10T10:04:03.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-10T10:04:03.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-10T10:04:03.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-10T10:04:03.084 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-10T10:04:03.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-10T10:04:03.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-10T10:04:03.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-10T10:04:03.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-10T10:04:03.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-10T10:04:03.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-10T10:04:03.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-10T10:04:03.085 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-10T10:04:03.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-10T10:04:03.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-10T10:04:03.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-10T10:04:03.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-10T10:04:03.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-10T10:04:03.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-10T10:04:03.086 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-10T10:04:03.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-10T10:04:03.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-10T10:04:03.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-10T10:04:03.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-10T10:04:03.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-10T10:04:03.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-10T10:04:03.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-10T10:04:03.087 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-10T10:04:03.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-10T10:04:03.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-10T10:04:03.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-10T10:04:03.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-10T10:04:03.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-10T10:04:03.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-10T10:04:03.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-10T10:04:03.088 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-10T10:04:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-10T10:04:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-10T10:04:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-10T10:04:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-10T10:04:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-10T10:04:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-10T10:04:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-10T10:04:03.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-10T10:04:03.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-10T10:04:03.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-10T10:04:03.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-10T10:04:03.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-10T10:04:03.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-10T10:04:03.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-10T10:04:03.090 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-10T10:04:03.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-10T10:04:03.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-10T10:04:03.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-10T10:04:03.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-10T10:04:03.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-10T10:04:03.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-10T10:04:03.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-10T10:04:03.091 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-10T10:04:03.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-10T10:04:03.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-10T10:04:03.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-10T10:04:03.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-10T10:04:03.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-10T10:04:03.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-10T10:04:03.092 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-10T10:04:03.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-10T10:04:03.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-10T10:04:03.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-10T10:04:03.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-10T10:04:03.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-10T10:04:03.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-10T10:04:03.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-10T10:04:03.093 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-10T10:04:03.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-10T10:04:03.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-10T10:04:03.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-10T10:04:03.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-10T10:04:03.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-10T10:04:03.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-10T10:04:03.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-10T10:04:03.094 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-10T10:04:03.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-10T10:04:03.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-10T10:04:03.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-10T10:04:03.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-10T10:04:03.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-10T10:04:03.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-10T10:04:03.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-10T10:04:03.095 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-10T10:04:03.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-10T10:04:03.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-10T10:04:03.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-10T10:04:03.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-10T10:04:03.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-10T10:04:03.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-10T10:04:03.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-10T10:04:03.096 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-10T10:04:03.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-10T10:04:03.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-10T10:04:03.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-10T10:04:03.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-10T10:04:03.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-10T10:04:03.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-10T10:04:03.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-10T10:04:03.097 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-10T10:04:03.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-10T10:04:03.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-10T10:04:03.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-10T10:04:03.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-10T10:04:03.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-10T10:04:03.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-10T10:04:03.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-10T10:04:03.098 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-10T10:04:03.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-10T10:04:03.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-10T10:04:03.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-10T10:04:03.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-10T10:04:03.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-10T10:04:03.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-10T10:04:03.099 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-10T10:04:03.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-10T10:04:03.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-10T10:04:03.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-10T10:04:03.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-10T10:04:03.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-10T10:04:03.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-10T10:04:03.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-10T10:04:03.100 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-10T10:04:03.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-10T10:04:03.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-10T10:04:03.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-10T10:04:03.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-10T10:04:03.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-10T10:04:03.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-10T10:04:03.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-10T10:04:03.101 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-10T10:04:03.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-10T10:04:03.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-10T10:04:03.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-10T10:04:03.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-10T10:04:03.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-10T10:04:03.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-10T10:04:03.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-10T10:04:03.102 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-10T10:04:03.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-10T10:04:03.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-10T10:04:03.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-10T10:04:03.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-10T10:04:03.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-10T10:04:03.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-10T10:04:03.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-10T10:04:03.103 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-10T10:04:03.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-10T10:04:03.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-10T10:04:03.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-10T10:04:03.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-10T10:04:03.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-10T10:04:03.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-10T10:04:03.104 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-10T10:04:03.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-10T10:04:03.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-10T10:04:03.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-10T10:04:03.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-10T10:04:03.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-10T10:04:03.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-10T10:04:03.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-10T10:04:03.105 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-10T10:04:03.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-10T10:04:03.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-10T10:04:03.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-10T10:04:03.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-10T10:04:03.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-10T10:04:03.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-10T10:04:03.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-10T10:04:03.106 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-10T10:04:03.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-10T10:04:03.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-10T10:04:03.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-10T10:04:03.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-10T10:04:03.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-10T10:04:03.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-10T10:04:03.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-10T10:04:03.107 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-10T10:04:03.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-10T10:04:03.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-10T10:04:03.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-10T10:04:03.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-10T10:04:03.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-10T10:04:03.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-10T10:04:03.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-10T10:04:03.108 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-10T10:04:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-10T10:04:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-10T10:04:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-10T10:04:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-10T10:04:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-10T10:04:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-10T10:04:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-10T10:04:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-10T10:04:03.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-10T10:04:03.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-10T10:04:03.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-10T10:04:03.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-10T10:04:03.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-10T10:04:03.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-10T10:04:03.110 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-10T10:04:03.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-10T10:04:03.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-10T10:04:03.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-10T10:04:03.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-10T10:04:03.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-10T10:04:03.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-10T10:04:03.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-10T10:04:03.111 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-10T10:04:03.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-10T10:04:03.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-10T10:04:03.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-10T10:04:03.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-10T10:04:03.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-10T10:04:03.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-10T10:04:03.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-10T10:04:03.112 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-10T10:04:03.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-10T10:04:03.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-10T10:04:03.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-10T10:04:03.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-10T10:04:03.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-10T10:04:03.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-10T10:04:03.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-10T10:04:03.113 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-10T10:04:03.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-10T10:04:03.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-10T10:04:03.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-10T10:04:03.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-10T10:04:03.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-10T10:04:03.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-10T10:04:03.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-10T10:04:03.114 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-10T10:04:03.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-10T10:04:03.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-10T10:04:03.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-10T10:04:03.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-10T10:04:03.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-10T10:04:03.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-10T10:04:03.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-10T10:04:03.115 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-10T10:04:03.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-10T10:04:03.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-10T10:04:03.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-10T10:04:03.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-10T10:04:03.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-10T10:04:03.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-10T10:04:03.116 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-10T10:04:03.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-10T10:04:03.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-10T10:04:03.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-10T10:04:03.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-10T10:04:03.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-10T10:04:03.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-10T10:04:03.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-10T10:04:03.117 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-10T10:04:03.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-10T10:04:03.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-10T10:04:03.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-10T10:04:03.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-10T10:04:03.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-10T10:04:03.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-10T10:04:03.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-10T10:04:03.118 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-10T10:04:03.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-10T10:04:03.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-10T10:04:03.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-10T10:04:03.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-10T10:04:03.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-10T10:04:03.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-10T10:04:03.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-10T10:04:03.119 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-10T10:04:03.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-10T10:04:03.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-10T10:04:03.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-10T10:04:03.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-10T10:04:03.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-10T10:04:03.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-10T10:04:03.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-10T10:04:03.120 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-10T10:04:03.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-10T10:04:03.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-10T10:04:03.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-10T10:04:03.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-10T10:04:03.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-10T10:04:03.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-10T10:04:03.121 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-10T10:04:03.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-10T10:04:03.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-10T10:04:03.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-10T10:04:03.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-10T10:04:03.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-10T10:04:03.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-10T10:04:03.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-10T10:04:03.122 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-10T10:04:03.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-10T10:04:03.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-10T10:04:03.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-10T10:04:03.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-10T10:04:03.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-10T10:04:03.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-10T10:04:03.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-10T10:04:03.123 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-10T10:04:03.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-10T10:04:03.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-10T10:04:03.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-10T10:04:03.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-10T10:04:03.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-10T10:04:03.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-10T10:04:03.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-10T10:04:03.124 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-10T10:04:03.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-10T10:04:03.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-10T10:04:03.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-10T10:04:03.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-10T10:04:03.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-10T10:04:03.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-10T10:04:03.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-10T10:04:03.125 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-10T10:04:03.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-10T10:04:03.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-10T10:04:03.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-10T10:04:03.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-10T10:04:03.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-10T10:04:03.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-10T10:04:03.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-10T10:04:03.126 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-10T10:04:03.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-10T10:04:03.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-10T10:04:03.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-10T10:04:03.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-10T10:04:03.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-10T10:04:03.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-10T10:04:03.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-10T10:04:03.127 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-10T10:04:03.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-10T10:04:03.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-10T10:04:03.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-10T10:04:03.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-10T10:04:03.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-10T10:04:03.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-10T10:04:03.128 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-10T10:04:03.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-10T10:04:03.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-10T10:04:03.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-10T10:04:03.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-10T10:04:03.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-10T10:04:03.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-10T10:04:03.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-10T10:04:03.129 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-10T10:04:03.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-10T10:04:03.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-10T10:04:03.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-10T10:04:03.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-10T10:04:03.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-10T10:04:03.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-10T10:04:03.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-10T10:04:03.130 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-10T10:04:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-10T10:04:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-10T10:04:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-10T10:04:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-10T10:04:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-10T10:04:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-10T10:04:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-10T10:04:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-10T10:04:03.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-10T10:04:03.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-10T10:04:03.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-10T10:04:03.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-10T10:04:03.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-10T10:04:03.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-10T10:04:03.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-10T10:04:03.132 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-10T10:04:03.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-10T10:04:03.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-10T10:04:03.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-10T10:04:03.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-10T10:04:03.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-10T10:04:03.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-10T10:04:03.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-10T10:04:03.133 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-10T10:04:03.134 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:03.134 DEBUG:teuthology.orchestra.run.smithi157:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-10T10:04:03.161 INFO:teuthology.orchestra.run.smithi157.stdout:postinstall scriptlet (using /bin/sh): 2023-08-10T10:04:03.161 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-10T10:04:03.161 INFO:teuthology.orchestra.run.smithi157.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:04:03.161 INFO:teuthology.orchestra.run.smithi157.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:04:03.161 INFO:teuthology.orchestra.run.smithi157.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:03.161 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:04:03.162 INFO:teuthology.orchestra.run.smithi157.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:04:03.162 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2023-08-10T10:04:03.162 INFO:teuthology.orchestra.run.smithi157.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-10T10:04:03.162 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-10T10:04:03.162 INFO:teuthology.orchestra.run.smithi157.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-10T10:04:03.162 INFO:teuthology.orchestra.run.smithi157.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-10T10:04:03.162 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:03.163 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2023-08-10T10:04:03.163 INFO:teuthology.orchestra.run.smithi157.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-10T10:04:03.163 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-10T10:04:03.163 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:03.163 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2023-08-10T10:04:03.164 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -qi grub2-tools 2023-08-10T10:04:03.240 INFO:teuthology.orchestra.run.smithi157.stdout:Name : grub2-tools 2023-08-10T10:04:03.240 INFO:teuthology.orchestra.run.smithi157.stdout:Epoch : 1 2023-08-10T10:04:03.241 INFO:teuthology.orchestra.run.smithi157.stdout:Version : 2.02 2023-08-10T10:04:03.241 INFO:teuthology.orchestra.run.smithi157.stdout:Release : 123.el8 2023-08-10T10:04:03.241 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: x86_64 2023-08-10T10:04:03.242 INFO:teuthology.orchestra.run.smithi157.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-08-10T10:04:03.242 INFO:teuthology.orchestra.run.smithi157.stdout:Group : System Environment/Base 2023-08-10T10:04:03.242 INFO:teuthology.orchestra.run.smithi157.stdout:Size : 9265450 2023-08-10T10:04:03.242 INFO:teuthology.orchestra.run.smithi157.stdout:License : GPLv3+ 2023-08-10T10:04:03.243 INFO:teuthology.orchestra.run.smithi157.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-08-10T10:04:03.243 INFO:teuthology.orchestra.run.smithi157.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-08-10T10:04:03.243 INFO:teuthology.orchestra.run.smithi157.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-08-10T10:04:03.243 INFO:teuthology.orchestra.run.smithi157.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-08-10T10:04:03.244 INFO:teuthology.orchestra.run.smithi157.stdout:Relocations : (not relocatable) 2023-08-10T10:04:03.244 INFO:teuthology.orchestra.run.smithi157.stdout:Packager : Red Hat, Inc. 2023-08-10T10:04:03.244 INFO:teuthology.orchestra.run.smithi157.stdout:Vendor : Red Hat, Inc. 2023-08-10T10:04:03.245 INFO:teuthology.orchestra.run.smithi157.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-10T10:04:03.245 INFO:teuthology.orchestra.run.smithi157.stdout:Summary : Support tools for GRUB. 2023-08-10T10:04:03.245 INFO:teuthology.orchestra.run.smithi157.stdout:Description : 2023-08-10T10:04:03.245 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:04:03.246 INFO:teuthology.orchestra.run.smithi157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-10T10:04:03.246 INFO:teuthology.orchestra.run.smithi157.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-10T10:04:03.246 INFO:teuthology.orchestra.run.smithi157.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-10T10:04:03.246 INFO:teuthology.orchestra.run.smithi157.stdout:hardware devices. 2023-08-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:04:03.247 INFO:teuthology.orchestra.run.smithi157.stdout:This subpackage provides tools for support of all platforms. 2023-08-10T10:04:03.248 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-10T10:04:03.249 INFO:teuthology.task.kernel:Updating grub on smithi157 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:03.249 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-10T10:04:08.005 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2023-08-10T10:04:10.073 INFO:teuthology.orchestra.run.smithi157.stderr:done 2023-08-10T10:04:10.075 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2023-08-10T10:04:10.097 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.q884waNtrL 2023-08-10T10:04:10.098 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.q884waNtrL 2023-08-10T10:04:10.171 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.q884waNtrL 2023-08-10T10:04:10.314 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.q884waNtrL is 6KB 2023-08-10T10:04:10.334 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.q884waNtrL 2023-08-10T10:04:10.354 DEBUG:teuthology.orchestra.run.smithi157:> sudo /bin/ls /boot/loader/entries || true 2023-08-10T10:04:10.419 INFO:teuthology.orchestra.run.smithi157.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-08-10T10:04:10.420 INFO:teuthology.orchestra.run.smithi157.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-08-10T10:04:10.420 INFO:teuthology.orchestra.run.smithi157.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc4-ga7fb1265323d.conf 2023-08-10T10:04:10.422 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:10.557 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2023-08-10T10:04:22.568 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-10T10:04:22.569 DEBUG:teuthology.orchestra.run.smithi107:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-10T10:04:22.618 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:22.618 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:22.618 INFO:teuthology.orchestra.run.smithi107.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:22.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:22.618 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-10T10:04:22.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-10T10:04:22.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-10T10:04:22.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-10T10:04:22.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-10T10:04:22.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-10T10:04:22.619 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-10T10:04:22.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-10T10:04:22.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-10T10:04:22.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-10T10:04:22.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-10T10:04:22.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-10T10:04:22.620 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-10T10:04:22.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-10T10:04:22.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-10T10:04:22.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-10T10:04:22.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-10T10:04:22.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-10T10:04:22.621 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-10T10:04:22.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-10T10:04:22.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-10T10:04:22.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-10T10:04:22.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-10T10:04:22.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-10T10:04:22.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-10T10:04:22.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-10T10:04:22.622 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-10T10:04:22.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-10T10:04:22.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-10T10:04:22.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-10T10:04:22.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-10T10:04:22.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-10T10:04:22.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-10T10:04:22.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-10T10:04:22.623 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-10T10:04:22.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-10T10:04:22.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-10T10:04:22.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-10T10:04:22.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-10T10:04:22.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-10T10:04:22.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-10T10:04:22.624 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-10T10:04:22.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-10T10:04:22.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-10T10:04:22.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-10T10:04:22.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-10T10:04:22.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-10T10:04:22.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-10T10:04:22.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-10T10:04:22.625 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-10T10:04:22.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-10T10:04:22.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-10T10:04:22.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-10T10:04:22.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-10T10:04:22.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-10T10:04:22.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-10T10:04:22.626 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-10T10:04:22.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-10T10:04:22.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-10T10:04:22.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-10T10:04:22.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-10T10:04:22.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-10T10:04:22.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-10T10:04:22.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-10T10:04:22.627 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-10T10:04:22.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-10T10:04:22.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-10T10:04:22.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-10T10:04:22.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-10T10:04:22.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-10T10:04:22.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-10T10:04:22.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-10T10:04:22.628 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-10T10:04:22.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-10T10:04:22.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-10T10:04:22.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-10T10:04:22.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-10T10:04:22.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-10T10:04:22.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-10T10:04:22.629 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-10T10:04:22.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-10T10:04:22.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-10T10:04:22.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-10T10:04:22.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-10T10:04:22.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-10T10:04:22.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-10T10:04:22.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-10T10:04:22.630 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-10T10:04:22.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-10T10:04:22.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-10T10:04:22.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-10T10:04:22.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-10T10:04:22.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-10T10:04:22.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-10T10:04:22.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-10T10:04:22.631 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-10T10:04:22.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-10T10:04:22.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-10T10:04:22.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-10T10:04:22.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-10T10:04:22.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-10T10:04:22.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-10T10:04:22.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-10T10:04:22.632 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-10T10:04:22.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-10T10:04:22.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-10T10:04:22.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-10T10:04:22.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-10T10:04:22.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-10T10:04:22.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-10T10:04:22.633 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-10T10:04:22.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-10T10:04:22.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-10T10:04:22.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-10T10:04:22.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-10T10:04:22.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-10T10:04:22.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-10T10:04:22.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-10T10:04:22.634 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-10T10:04:22.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-10T10:04:22.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-10T10:04:22.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-10T10:04:22.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-10T10:04:22.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-10T10:04:22.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-10T10:04:22.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-10T10:04:22.635 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-10T10:04:22.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-10T10:04:22.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-10T10:04:22.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-10T10:04:22.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-10T10:04:22.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-10T10:04:22.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-10T10:04:22.636 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-10T10:04:22.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-10T10:04:22.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-10T10:04:22.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-10T10:04:22.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-10T10:04:22.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-10T10:04:22.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-10T10:04:22.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-10T10:04:22.637 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-10T10:04:22.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-10T10:04:22.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-10T10:04:22.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-10T10:04:22.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-10T10:04:22.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-10T10:04:22.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-10T10:04:22.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-10T10:04:22.638 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-10T10:04:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-10T10:04:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-10T10:04:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-10T10:04:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-10T10:04:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-10T10:04:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-10T10:04:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-10T10:04:22.639 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-10T10:04:22.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-10T10:04:22.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-10T10:04:22.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-10T10:04:22.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-10T10:04:22.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-10T10:04:22.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-10T10:04:22.640 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-10T10:04:22.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-10T10:04:22.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-10T10:04:22.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-10T10:04:22.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-10T10:04:22.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-10T10:04:22.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-10T10:04:22.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-10T10:04:22.641 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-10T10:04:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-10T10:04:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-10T10:04:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-10T10:04:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-10T10:04:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-10T10:04:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-10T10:04:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-10T10:04:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-10T10:04:22.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-10T10:04:22.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-10T10:04:22.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-10T10:04:22.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-10T10:04:22.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-10T10:04:22.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-10T10:04:22.643 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-10T10:04:22.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-10T10:04:22.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-10T10:04:22.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-10T10:04:22.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-10T10:04:22.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-10T10:04:22.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-10T10:04:22.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-10T10:04:22.644 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-10T10:04:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-10T10:04:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-10T10:04:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-10T10:04:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-10T10:04:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-10T10:04:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-10T10:04:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-10T10:04:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-10T10:04:22.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-10T10:04:22.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-10T10:04:22.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-10T10:04:22.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-10T10:04:22.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-10T10:04:22.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-10T10:04:22.646 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-10T10:04:22.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-10T10:04:22.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-10T10:04:22.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-10T10:04:22.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-10T10:04:22.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-10T10:04:22.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-10T10:04:22.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-10T10:04:22.647 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-10T10:04:22.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-10T10:04:22.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-10T10:04:22.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-10T10:04:22.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-10T10:04:22.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-10T10:04:22.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-10T10:04:22.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-10T10:04:22.648 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-10T10:04:22.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-10T10:04:22.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-10T10:04:22.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-10T10:04:22.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-10T10:04:22.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-10T10:04:22.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-10T10:04:22.649 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-10T10:04:22.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-10T10:04:22.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-10T10:04:22.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-10T10:04:22.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-10T10:04:22.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-10T10:04:22.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-10T10:04:22.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-10T10:04:22.650 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-10T10:04:22.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-10T10:04:22.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-10T10:04:22.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-10T10:04:22.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-10T10:04:22.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-10T10:04:22.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-10T10:04:22.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-10T10:04:22.651 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-10T10:04:22.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-10T10:04:22.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-10T10:04:22.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-10T10:04:22.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-10T10:04:22.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-10T10:04:22.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-10T10:04:22.652 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-10T10:04:22.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-10T10:04:22.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-10T10:04:22.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-10T10:04:22.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-10T10:04:22.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-10T10:04:22.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-10T10:04:22.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-10T10:04:22.653 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-10T10:04:22.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-10T10:04:22.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-10T10:04:22.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-10T10:04:22.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-10T10:04:22.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-10T10:04:22.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-10T10:04:22.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-10T10:04:22.654 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-10T10:04:22.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-10T10:04:22.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-10T10:04:22.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-10T10:04:22.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-10T10:04:22.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-10T10:04:22.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-10T10:04:22.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-10T10:04:22.655 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-10T10:04:22.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-10T10:04:22.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-10T10:04:22.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-10T10:04:22.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-10T10:04:22.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-10T10:04:22.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-10T10:04:22.656 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-10T10:04:22.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-10T10:04:22.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-10T10:04:22.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-10T10:04:22.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-10T10:04:22.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-10T10:04:22.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-10T10:04:22.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-10T10:04:22.657 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-10T10:04:22.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-10T10:04:22.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-10T10:04:22.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-10T10:04:22.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-10T10:04:22.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-10T10:04:22.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-10T10:04:22.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-10T10:04:22.658 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-10T10:04:22.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-10T10:04:22.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-10T10:04:22.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-10T10:04:22.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-10T10:04:22.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-10T10:04:22.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-10T10:04:22.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-10T10:04:22.659 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-10T10:04:22.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-10T10:04:22.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-10T10:04:22.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-10T10:04:22.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-10T10:04:22.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-10T10:04:22.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-10T10:04:22.660 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-10T10:04:22.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-10T10:04:22.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-10T10:04:22.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-10T10:04:22.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-10T10:04:22.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-10T10:04:22.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-10T10:04:22.661 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-10T10:04:22.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-10T10:04:22.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-10T10:04:22.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-10T10:04:22.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-10T10:04:22.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-10T10:04:22.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-10T10:04:22.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-10T10:04:22.662 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-10T10:04:22.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-10T10:04:22.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-10T10:04:22.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-10T10:04:22.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-10T10:04:22.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-10T10:04:22.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-10T10:04:22.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-10T10:04:22.663 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-10T10:04:22.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-10T10:04:22.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-10T10:04:22.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-10T10:04:22.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-10T10:04:22.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-10T10:04:22.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-10T10:04:22.664 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-10T10:04:22.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-10T10:04:22.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-10T10:04:22.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-10T10:04:22.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-10T10:04:22.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-10T10:04:22.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-10T10:04:22.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-10T10:04:22.665 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-10T10:04:22.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-10T10:04:22.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-10T10:04:22.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-10T10:04:22.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-10T10:04:22.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-10T10:04:22.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-10T10:04:22.666 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-10T10:04:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-10T10:04:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-10T10:04:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-10T10:04:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-10T10:04:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-10T10:04:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-10T10:04:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-10T10:04:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-10T10:04:22.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-10T10:04:22.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-10T10:04:22.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-10T10:04:22.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-10T10:04:22.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-10T10:04:22.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-10T10:04:22.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-10T10:04:22.668 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-10T10:04:22.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-10T10:04:22.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-10T10:04:22.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-10T10:04:22.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-10T10:04:22.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-10T10:04:22.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-10T10:04:22.669 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-10T10:04:22.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-10T10:04:22.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-10T10:04:22.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-10T10:04:22.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-10T10:04:22.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-10T10:04:22.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-10T10:04:22.670 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-10T10:04:22.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-10T10:04:22.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-10T10:04:22.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-10T10:04:22.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-10T10:04:22.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-10T10:04:22.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-10T10:04:22.671 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-10T10:04:22.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-10T10:04:22.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-10T10:04:22.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-10T10:04:22.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-10T10:04:22.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-10T10:04:22.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-10T10:04:22.672 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-10T10:04:22.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-10T10:04:22.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-10T10:04:22.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-10T10:04:22.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-10T10:04:22.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-10T10:04:22.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-10T10:04:22.673 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-10T10:04:22.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-10T10:04:22.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-10T10:04:22.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-10T10:04:22.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-10T10:04:22.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-10T10:04:22.674 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-10T10:04:22.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-10T10:04:22.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-10T10:04:22.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-10T10:04:22.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-10T10:04:22.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-10T10:04:22.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-10T10:04:22.675 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-10T10:04:22.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-10T10:04:22.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-10T10:04:22.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-10T10:04:22.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-10T10:04:22.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-10T10:04:22.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-10T10:04:22.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-10T10:04:22.676 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-10T10:04:22.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-10T10:04:22.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-10T10:04:22.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-10T10:04:22.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-10T10:04:22.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-10T10:04:22.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-10T10:04:22.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-10T10:04:22.677 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-10T10:04:22.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-10T10:04:22.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-10T10:04:22.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-10T10:04:22.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-10T10:04:22.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-10T10:04:22.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-10T10:04:22.678 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-10T10:04:22.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-10T10:04:22.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-10T10:04:22.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-10T10:04:22.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-10T10:04:22.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-10T10:04:22.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-10T10:04:22.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-10T10:04:22.679 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-10T10:04:22.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-10T10:04:22.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-10T10:04:22.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-10T10:04:22.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-10T10:04:22.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-10T10:04:22.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-10T10:04:22.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-10T10:04:22.680 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-10T10:04:22.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-10T10:04:22.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-10T10:04:22.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-10T10:04:22.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-10T10:04:22.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-10T10:04:22.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-10T10:04:22.681 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-10T10:04:22.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-10T10:04:22.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-10T10:04:22.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-10T10:04:22.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-10T10:04:22.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-10T10:04:22.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-10T10:04:22.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-10T10:04:22.682 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-10T10:04:22.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-10T10:04:22.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-10T10:04:22.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-10T10:04:22.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-10T10:04:22.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-10T10:04:22.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-10T10:04:22.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-10T10:04:22.683 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-10T10:04:22.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-10T10:04:22.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-10T10:04:22.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-10T10:04:22.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-10T10:04:22.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-10T10:04:22.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-10T10:04:22.684 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-10T10:04:22.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-10T10:04:22.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-10T10:04:22.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-10T10:04:22.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-10T10:04:22.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-10T10:04:22.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-10T10:04:22.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-10T10:04:22.685 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-10T10:04:22.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-10T10:04:22.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-10T10:04:22.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-10T10:04:22.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-10T10:04:22.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-10T10:04:22.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-10T10:04:22.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-10T10:04:22.686 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-10T10:04:22.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-10T10:04:22.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-10T10:04:22.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-10T10:04:22.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-10T10:04:22.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-10T10:04:22.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-10T10:04:22.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-10T10:04:22.687 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-10T10:04:22.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-10T10:04:22.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-10T10:04:22.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-10T10:04:22.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-10T10:04:22.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-10T10:04:22.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-10T10:04:22.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-10T10:04:22.688 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-10T10:04:22.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-10T10:04:22.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-10T10:04:22.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-10T10:04:22.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-10T10:04:22.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-10T10:04:22.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-10T10:04:22.689 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-10T10:04:22.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-10T10:04:22.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-10T10:04:22.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-10T10:04:22.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-10T10:04:22.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-10T10:04:22.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-10T10:04:22.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-10T10:04:22.690 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-10T10:04:22.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-10T10:04:22.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-10T10:04:22.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-10T10:04:22.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-10T10:04:22.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-10T10:04:22.691 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-10T10:04:22.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-10T10:04:22.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-10T10:04:22.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-10T10:04:22.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-10T10:04:22.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-10T10:04:22.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-10T10:04:22.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-10T10:04:22.692 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-10T10:04:22.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-10T10:04:22.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-10T10:04:22.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-10T10:04:22.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-10T10:04:22.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-10T10:04:22.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-10T10:04:22.693 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-10T10:04:22.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-10T10:04:22.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-10T10:04:22.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-10T10:04:22.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-10T10:04:22.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-10T10:04:22.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-10T10:04:22.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-10T10:04:22.694 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-10T10:04:22.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-10T10:04:22.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-10T10:04:22.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-10T10:04:22.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-10T10:04:22.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-10T10:04:22.695 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-10T10:04:22.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-10T10:04:22.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-10T10:04:22.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-10T10:04:22.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-10T10:04:22.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-10T10:04:22.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-10T10:04:22.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-10T10:04:22.696 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-10T10:04:22.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-10T10:04:22.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-10T10:04:22.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-10T10:04:22.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-10T10:04:22.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-10T10:04:22.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-10T10:04:22.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-10T10:04:22.697 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-10T10:04:22.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-10T10:04:22.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-10T10:04:22.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-10T10:04:22.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-10T10:04:22.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-10T10:04:22.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-10T10:04:22.698 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-10T10:04:22.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-10T10:04:22.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-10T10:04:22.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-10T10:04:22.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-10T10:04:22.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-10T10:04:22.699 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-10T10:04:22.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-10T10:04:22.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-10T10:04:22.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-10T10:04:22.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-10T10:04:22.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-10T10:04:22.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-10T10:04:22.700 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-10T10:04:22.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-10T10:04:22.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-10T10:04:22.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-10T10:04:22.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-10T10:04:22.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-10T10:04:22.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-10T10:04:22.701 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-10T10:04:22.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-10T10:04:22.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-10T10:04:22.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-10T10:04:22.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-10T10:04:22.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-10T10:04:22.702 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-10T10:04:22.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-10T10:04:22.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-10T10:04:22.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-10T10:04:22.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-10T10:04:22.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-10T10:04:22.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-10T10:04:22.703 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-10T10:04:22.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-10T10:04:22.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-10T10:04:22.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-10T10:04:22.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-10T10:04:22.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-10T10:04:22.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-10T10:04:22.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-10T10:04:22.704 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-10T10:04:22.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-10T10:04:22.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-10T10:04:22.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-10T10:04:22.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-10T10:04:22.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-10T10:04:22.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-10T10:04:22.705 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-10T10:04:22.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-10T10:04:22.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-10T10:04:22.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-10T10:04:22.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-10T10:04:22.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-10T10:04:22.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-10T10:04:22.706 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-10T10:04:22.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-10T10:04:22.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-10T10:04:22.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-10T10:04:22.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-10T10:04:22.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-10T10:04:22.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-10T10:04:22.707 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-10T10:04:22.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-10T10:04:22.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-10T10:04:22.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-10T10:04:22.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-10T10:04:22.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-10T10:04:22.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-10T10:04:22.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-10T10:04:22.708 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-10T10:04:22.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-10T10:04:22.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-10T10:04:22.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-10T10:04:22.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-10T10:04:22.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-10T10:04:22.709 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-10T10:04:22.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-10T10:04:22.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-10T10:04:22.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-10T10:04:22.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-10T10:04:22.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-10T10:04:22.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-10T10:04:22.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-10T10:04:22.710 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-10T10:04:22.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-10T10:04:22.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-10T10:04:22.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-10T10:04:22.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-10T10:04:22.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-10T10:04:22.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-10T10:04:22.711 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-10T10:04:22.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-10T10:04:22.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-10T10:04:22.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-10T10:04:22.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-10T10:04:22.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-10T10:04:22.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-10T10:04:22.712 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-10T10:04:22.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-10T10:04:22.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-10T10:04:22.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-10T10:04:22.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-10T10:04:22.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-10T10:04:22.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-10T10:04:22.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-10T10:04:22.713 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-10T10:04:22.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-10T10:04:22.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-10T10:04:22.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-10T10:04:22.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-10T10:04:22.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-10T10:04:22.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-10T10:04:22.714 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-10T10:04:22.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-10T10:04:22.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-10T10:04:22.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-10T10:04:22.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-10T10:04:22.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-10T10:04:22.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-10T10:04:22.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-10T10:04:22.715 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-10T10:04:22.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-10T10:04:22.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-10T10:04:22.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-10T10:04:22.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-10T10:04:22.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-10T10:04:22.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-10T10:04:22.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-10T10:04:22.716 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-10T10:04:22.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-10T10:04:22.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-10T10:04:22.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-10T10:04:22.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-10T10:04:22.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-10T10:04:22.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-10T10:04:22.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-10T10:04:22.717 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-10T10:04:22.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-10T10:04:22.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-10T10:04:22.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-10T10:04:22.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-10T10:04:22.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-10T10:04:22.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-10T10:04:22.718 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-10T10:04:22.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-10T10:04:22.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-10T10:04:22.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-10T10:04:22.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-10T10:04:22.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-10T10:04:22.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-10T10:04:22.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-10T10:04:22.719 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-10T10:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-10T10:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-10T10:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-10T10:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-10T10:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-10T10:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-10T10:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-10T10:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-10T10:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-10T10:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-10T10:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-10T10:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-10T10:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-10T10:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-10T10:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-10T10:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-10T10:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-10T10:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-10T10:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-10T10:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-10T10:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-10T10:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-10T10:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-10T10:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-10T10:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-10T10:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-10T10:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-10T10:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-10T10:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-10T10:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-10T10:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-10T10:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-10T10:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-10T10:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-10T10:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-10T10:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-10T10:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-10T10:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-10T10:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-10T10:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-10T10:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-10T10:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-10T10:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-10T10:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-10T10:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-10T10:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-10T10:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-10T10:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-10T10:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-10T10:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-10T10:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-10T10:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-10T10:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-10T10:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-10T10:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-10T10:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-10T10:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-10T10:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-10T10:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-10T10:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-10T10:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-10T10:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-10T10:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-10T10:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-10T10:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-10T10:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-10T10:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-10T10:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-10T10:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-10T10:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-10T10:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-10T10:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-10T10:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-10T10:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-10T10:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-10T10:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-10T10:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-10T10:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-10T10:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-10T10:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-10T10:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-10T10:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-10T10:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-10T10:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-10T10:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-10T10:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-10T10:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-10T10:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-10T10:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-10T10:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-10T10:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-10T10:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-10T10:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-10T10:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-10T10:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-10T10:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-10T10:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-10T10:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-10T10:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-10T10:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-10T10:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-10T10:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-10T10:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-10T10:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-10T10:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-10T10:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-10T10:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-10T10:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-10T10:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-10T10:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-10T10:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-10T10:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-10T10:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-10T10:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-10T10:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-10T10:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-10T10:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-10T10:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-10T10:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-10T10:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-10T10:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-10T10:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-10T10:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-10T10:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-10T10:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-10T10:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-10T10:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-10T10:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-10T10:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-10T10:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-10T10:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-10T10:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-10T10:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-10T10:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-10T10:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-10T10:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-10T10:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-10T10:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-10T10:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-10T10:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-10T10:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-10T10:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-10T10:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-10T10:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-10T10:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-10T10:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-10T10:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-10T10:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-10T10:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-10T10:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-10T10:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-10T10:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-10T10:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-10T10:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-10T10:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-10T10:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-10T10:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-10T10:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-10T10:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-10T10:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-10T10:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-10T10:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-10T10:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-10T10:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-10T10:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-10T10:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-10T10:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-10T10:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-10T10:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-10T10:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-10T10:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-10T10:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-10T10:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-10T10:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-10T10:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-10T10:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-10T10:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-10T10:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-10T10:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-10T10:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-10T10:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-10T10:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-10T10:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-10T10:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-10T10:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-10T10:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-10T10:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-10T10:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-10T10:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-10T10:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-10T10:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-10T10:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-10T10:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-10T10:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-10T10:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-10T10:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-10T10:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-10T10:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-10T10:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-10T10:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-10T10:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-10T10:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-10T10:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-10T10:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-10T10:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-10T10:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-10T10:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-10T10:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-10T10:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-10T10:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-10T10:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-10T10:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-10T10:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-10T10:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-10T10:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-10T10:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-10T10:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-10T10:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-10T10:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-10T10:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-10T10:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-10T10:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-10T10:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-10T10:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-10T10:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-10T10:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-10T10:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-10T10:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-10T10:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-10T10:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-10T10:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-10T10:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-10T10:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-10T10:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-10T10:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-10T10:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-10T10:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-10T10:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-10T10:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-10T10:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-10T10:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-10T10:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-10T10:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-10T10:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-10T10:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-10T10:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-10T10:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-10T10:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-10T10:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-10T10:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-10T10:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-10T10:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-10T10:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-10T10:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-10T10:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-10T10:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-10T10:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-10T10:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-10T10:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-10T10:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-10T10:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-10T10:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-10T10:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-10T10:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-10T10:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-10T10:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-10T10:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-10T10:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-10T10:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-10T10:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-10T10:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-10T10:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-10T10:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-10T10:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-10T10:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-10T10:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-10T10:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-10T10:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-10T10:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-10T10:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-10T10:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-10T10:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-10T10:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-10T10:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-10T10:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-10T10:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-10T10:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-10T10:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-10T10:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-10T10:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-10T10:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-10T10:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-10T10:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-10T10:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-10T10:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-10T10:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-10T10:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-10T10:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-10T10:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-10T10:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-10T10:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-10T10:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-10T10:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-10T10:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-10T10:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-10T10:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-10T10:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-10T10:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-10T10:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-10T10:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-10T10:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-10T10:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-10T10:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-10T10:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-10T10:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-10T10:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-10T10:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-10T10:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-10T10:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-10T10:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-10T10:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-10T10:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-10T10:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-10T10:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-10T10:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-10T10:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-10T10:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-10T10:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-10T10:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-10T10:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-10T10:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-10T10:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-10T10:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-10T10:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-10T10:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-10T10:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-10T10:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-10T10:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-10T10:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-10T10:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-10T10:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-10T10:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-10T10:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-10T10:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-10T10:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-10T10:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-10T10:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-10T10:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-10T10:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-10T10:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-10T10:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-10T10:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-10T10:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-10T10:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-10T10:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-10T10:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-10T10:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-10T10:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-10T10:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-10T10:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-10T10:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-10T10:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-10T10:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-10T10:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-10T10:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-10T10:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-10T10:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-10T10:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-10T10:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-10T10:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-10T10:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-10T10:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-10T10:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-10T10:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-10T10:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-10T10:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-10T10:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-10T10:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-10T10:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-10T10:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-10T10:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-10T10:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-10T10:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-10T10:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-10T10:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-10T10:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-10T10:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-10T10:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-10T10:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-10T10:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-10T10:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-10T10:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-10T10:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-10T10:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-10T10:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-10T10:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-10T10:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-10T10:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-10T10:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-10T10:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-10T10:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-10T10:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-10T10:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-10T10:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-10T10:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-10T10:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-10T10:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-10T10:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-10T10:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-10T10:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-10T10:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-10T10:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-10T10:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-10T10:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-10T10:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-10T10:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-10T10:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-10T10:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-10T10:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-10T10:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-10T10:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-10T10:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-10T10:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-10T10:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-10T10:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-10T10:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-10T10:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-10T10:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-10T10:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-10T10:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-10T10:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-10T10:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-10T10:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-10T10:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-10T10:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-10T10:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-10T10:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-10T10:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-10T10:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-10T10:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-10T10:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-10T10:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-10T10:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-10T10:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-10T10:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-10T10:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-10T10:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-10T10:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-10T10:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-10T10:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-10T10:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-10T10:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-10T10:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-10T10:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-10T10:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-10T10:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-10T10:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-10T10:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-10T10:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-10T10:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-10T10:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-10T10:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-10T10:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-10T10:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-10T10:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-10T10:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-10T10:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-10T10:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-10T10:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-10T10:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-10T10:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-10T10:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-10T10:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-10T10:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-10T10:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-10T10:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-10T10:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-10T10:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-10T10:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-10T10:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-10T10:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-10T10:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-10T10:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-10T10:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-10T10:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-10T10:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-10T10:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-10T10:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-10T10:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-10T10:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-10T10:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-10T10:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-10T10:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-10T10:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-10T10:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-10T10:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-10T10:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-10T10:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-10T10:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-10T10:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-10T10:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-10T10:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-10T10:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-10T10:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-10T10:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-10T10:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-10T10:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-10T10:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-10T10:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-10T10:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-10T10:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-10T10:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-10T10:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-10T10:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-10T10:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-10T10:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-10T10:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-10T10:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-10T10:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-10T10:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-10T10:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-10T10:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-10T10:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-10T10:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-10T10:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-10T10:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-10T10:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-10T10:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-10T10:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-10T10:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-10T10:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-10T10:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-10T10:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-10T10:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-10T10:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-10T10:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-10T10:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-10T10:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-10T10:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-10T10:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-10T10:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-10T10:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-10T10:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-10T10:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-10T10:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-10T10:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-10T10:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-10T10:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-10T10:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-10T10:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-10T10:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-10T10:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-10T10:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-10T10:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-10T10:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-10T10:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-10T10:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-10T10:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-10T10:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-10T10:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-10T10:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-10T10:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-10T10:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-10T10:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-10T10:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-10T10:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-10T10:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-10T10:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-10T10:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-10T10:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-10T10:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-10T10:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-10T10:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-10T10:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-10T10:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-10T10:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-10T10:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-10T10:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-10T10:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-10T10:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-10T10:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-10T10:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-10T10:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-10T10:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-10T10:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-10T10:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-10T10:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-10T10:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-10T10:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-10T10:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-10T10:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-10T10:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-10T10:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-10T10:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-10T10:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-10T10:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-10T10:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-10T10:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-10T10:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-10T10:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-10T10:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-10T10:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-10T10:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-10T10:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-10T10:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-10T10:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-10T10:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-10T10:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-10T10:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-10T10:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-10T10:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-10T10:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-10T10:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-10T10:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-10T10:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-10T10:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-10T10:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-10T10:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-10T10:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-10T10:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-10T10:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-10T10:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-10T10:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-10T10:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-10T10:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-10T10:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-10T10:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-10T10:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-10T10:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-10T10:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-10T10:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-10T10:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-10T10:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-10T10:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-10T10:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-10T10:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-10T10:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-10T10:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-10T10:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-10T10:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-10T10:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-10T10:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-10T10:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-10T10:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-10T10:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-10T10:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-10T10:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-10T10:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-10T10:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-10T10:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-10T10:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-10T10:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-10T10:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-10T10:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-10T10:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-10T10:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-10T10:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-10T10:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-10T10:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-10T10:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-10T10:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-10T10:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-10T10:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-10T10:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-10T10:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-10T10:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-10T10:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-10T10:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-10T10:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-10T10:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-10T10:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-10T10:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-10T10:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-10T10:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-10T10:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-10T10:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-10T10:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-10T10:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-10T10:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-10T10:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-10T10:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-10T10:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-10T10:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-10T10:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-10T10:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-10T10:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-10T10:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-10T10:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-10T10:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-10T10:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-10T10:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-10T10:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-10T10:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-10T10:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-10T10:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-10T10:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-10T10:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-10T10:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-10T10:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-10T10:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-10T10:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-10T10:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-10T10:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-10T10:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-10T10:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-10T10:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-10T10:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-10T10:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-10T10:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-10T10:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-10T10:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-10T10:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-10T10:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-10T10:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-10T10:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-10T10:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-10T10:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-10T10:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-10T10:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-10T10:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-10T10:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-10T10:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-10T10:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-10T10:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-10T10:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-10T10:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-10T10:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-10T10:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-10T10:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-10T10:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-10T10:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-10T10:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-10T10:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-10T10:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-10T10:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-10T10:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-10T10:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-10T10:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-10T10:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-10T10:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-10T10:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-10T10:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-10T10:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-10T10:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-10T10:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-10T10:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-10T10:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-10T10:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-10T10:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-10T10:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-10T10:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-10T10:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-10T10:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-10T10:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-10T10:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-10T10:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-10T10:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-10T10:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-10T10:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-10T10:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-10T10:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-10T10:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-10T10:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-10T10:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-10T10:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-10T10:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-10T10:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-10T10:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-10T10:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-10T10:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-10T10:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-10T10:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-10T10:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-10T10:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-10T10:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-10T10:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-10T10:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-10T10:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-10T10:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-10T10:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-10T10:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-10T10:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-10T10:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-10T10:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-10T10:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-10T10:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-10T10:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-10T10:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-10T10:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-10T10:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-10T10:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-10T10:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-10T10:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-10T10:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-10T10:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-10T10:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-10T10:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-10T10:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-10T10:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-10T10:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-10T10:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-10T10:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-10T10:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-10T10:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-10T10:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-10T10:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-10T10:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-10T10:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-10T10:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-10T10:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-10T10:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-10T10:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-10T10:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-10T10:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-10T10:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-10T10:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-10T10:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-10T10:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-10T10:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-10T10:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-10T10:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-10T10:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-10T10:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-10T10:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-10T10:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-10T10:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-10T10:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-10T10:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-10T10:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-10T10:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-10T10:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-10T10:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-10T10:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-10T10:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-10T10:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-10T10:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-10T10:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-10T10:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-10T10:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-10T10:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-10T10:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-10T10:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-10T10:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-10T10:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-10T10:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-10T10:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-10T10:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-10T10:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-10T10:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-10T10:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-10T10:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-10T10:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-10T10:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-10T10:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-10T10:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-10T10:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-10T10:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-10T10:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-10T10:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-10T10:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-10T10:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-10T10:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-10T10:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-10T10:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-10T10:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-10T10:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-10T10:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-10T10:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-10T10:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-10T10:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-10T10:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-10T10:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-10T10:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-10T10:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-10T10:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-10T10:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-10T10:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-10T10:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-10T10:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-10T10:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-10T10:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-10T10:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-10T10:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-10T10:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-10T10:04:22.838 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-10T10:04:22.838 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-10T10:04:22.838 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-10T10:04:22.838 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-10T10:04:22.838 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-10T10:04:22.838 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-10T10:04:22.838 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-10T10:04:22.838 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-10T10:04:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-10T10:04:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-10T10:04:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-10T10:04:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-10T10:04:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-10T10:04:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-10T10:04:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-10T10:04:22.840 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-10T10:04:22.840 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-10T10:04:22.840 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-10T10:04:22.840 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-10T10:04:22.840 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-10T10:04:22.840 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-10T10:04:22.840 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-10T10:04:22.840 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-10T10:04:22.841 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-10T10:04:22.841 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-10T10:04:22.841 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-10T10:04:22.841 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-10T10:04:22.841 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-10T10:04:22.841 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-10T10:04:22.841 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-10T10:04:22.842 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-10T10:04:22.842 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-10T10:04:22.842 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-10T10:04:22.842 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-10T10:04:22.842 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-10T10:04:22.842 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-10T10:04:22.842 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-10T10:04:22.842 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-10T10:04:22.843 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-10T10:04:22.843 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-10T10:04:22.843 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-10T10:04:22.843 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-10T10:04:22.843 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-10T10:04:22.843 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-10T10:04:22.843 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-10T10:04:22.843 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-10T10:04:22.844 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-10T10:04:22.844 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-10T10:04:22.844 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-10T10:04:22.844 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-10T10:04:22.844 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-10T10:04:22.844 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-10T10:04:22.844 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-10T10:04:22.844 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-10T10:04:22.845 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-10T10:04:22.845 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-10T10:04:22.845 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-10T10:04:22.845 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-10T10:04:22.845 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-10T10:04:22.845 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-10T10:04:22.845 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-10T10:04:22.846 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-10T10:04:22.846 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-10T10:04:22.846 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-10T10:04:22.846 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-10T10:04:22.846 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-10T10:04:22.846 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-10T10:04:22.846 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-10T10:04:22.846 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-10T10:04:22.847 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-10T10:04:22.847 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-10T10:04:22.847 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-10T10:04:22.847 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-10T10:04:22.847 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-10T10:04:22.847 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-10T10:04:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-10T10:04:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-10T10:04:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-10T10:04:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-10T10:04:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-10T10:04:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-10T10:04:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-10T10:04:22.848 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-10T10:04:22.849 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-10T10:04:22.849 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-10T10:04:22.849 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-10T10:04:22.849 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-10T10:04:22.849 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-10T10:04:22.849 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-10T10:04:22.849 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-10T10:04:22.850 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-10T10:04:22.850 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-10T10:04:22.850 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-10T10:04:22.850 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-10T10:04:22.850 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-10T10:04:22.850 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-10T10:04:22.850 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-10T10:04:22.851 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-10T10:04:22.851 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-10T10:04:22.851 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-10T10:04:22.851 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-10T10:04:22.851 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-10T10:04:22.851 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-10T10:04:22.851 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-10T10:04:22.852 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-10T10:04:22.852 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-10T10:04:22.852 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-10T10:04:22.852 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-10T10:04:22.852 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-10T10:04:22.852 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-10T10:04:22.852 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-10T10:04:22.852 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-10T10:04:22.853 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-10T10:04:22.853 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-10T10:04:22.853 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-10T10:04:22.853 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-10T10:04:22.853 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-10T10:04:22.853 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-10T10:04:22.853 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-10T10:04:22.854 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-10T10:04:22.854 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-10T10:04:22.854 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-10T10:04:22.854 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-10T10:04:22.854 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-10T10:04:22.854 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-10T10:04:22.855 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-10T10:04:22.855 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-10T10:04:22.855 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-10T10:04:22.855 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-10T10:04:22.855 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-10T10:04:22.855 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-10T10:04:22.855 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-10T10:04:22.855 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-10T10:04:22.856 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-10T10:04:22.856 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-10T10:04:22.856 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-10T10:04:22.856 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-10T10:04:22.856 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-10T10:04:22.856 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-10T10:04:22.856 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-10T10:04:22.857 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-10T10:04:22.857 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-10T10:04:22.857 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-10T10:04:22.857 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-10T10:04:22.857 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-10T10:04:22.857 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-10T10:04:22.858 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-10T10:04:22.858 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-10T10:04:22.858 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-10T10:04:22.858 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-10T10:04:22.858 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-10T10:04:22.858 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-10T10:04:22.858 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-10T10:04:22.858 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-10T10:04:22.859 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-10T10:04:22.859 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-10T10:04:22.859 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-10T10:04:22.859 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-10T10:04:22.859 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-10T10:04:22.859 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-10T10:04:22.859 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-10T10:04:22.859 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-10T10:04:22.860 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-10T10:04:22.860 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-10T10:04:22.860 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-10T10:04:22.860 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-10T10:04:22.860 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-10T10:04:22.860 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-10T10:04:22.861 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-10T10:04:22.861 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-10T10:04:22.861 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-10T10:04:22.861 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-10T10:04:22.861 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-10T10:04:22.861 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-10T10:04:22.862 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-10T10:04:22.862 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-10T10:04:22.862 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-10T10:04:22.862 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-10T10:04:22.862 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-10T10:04:22.862 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-10T10:04:22.862 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-10T10:04:22.862 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-10T10:04:22.863 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-10T10:04:22.863 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-10T10:04:22.863 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-10T10:04:22.863 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-10T10:04:22.863 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-10T10:04:22.863 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-10T10:04:22.863 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-10T10:04:22.864 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-10T10:04:22.864 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-10T10:04:22.864 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-10T10:04:22.864 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-10T10:04:22.864 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-10T10:04:22.864 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-10T10:04:22.865 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-10T10:04:22.865 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-10T10:04:22.865 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-10T10:04:22.865 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-10T10:04:22.865 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-10T10:04:22.865 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-10T10:04:22.866 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-10T10:04:22.866 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-10T10:04:22.866 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-10T10:04:22.866 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-10T10:04:22.866 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-10T10:04:22.866 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-10T10:04:22.866 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-10T10:04:22.866 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-10T10:04:22.867 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-10T10:04:22.867 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-10T10:04:22.867 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-10T10:04:22.867 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-10T10:04:22.867 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-10T10:04:22.867 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-10T10:04:22.867 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-10T10:04:22.868 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-10T10:04:22.868 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-10T10:04:22.868 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-10T10:04:22.868 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-10T10:04:22.868 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-10T10:04:22.868 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-10T10:04:22.868 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-10T10:04:22.869 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-10T10:04:22.869 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-10T10:04:22.869 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-10T10:04:22.869 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-10T10:04:22.869 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-10T10:04:22.869 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-10T10:04:22.869 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-10T10:04:22.870 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-10T10:04:22.870 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-10T10:04:22.870 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-10T10:04:22.870 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-10T10:04:22.870 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-10T10:04:22.870 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-10T10:04:22.870 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-10T10:04:22.870 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-10T10:04:22.871 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-10T10:04:22.871 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-10T10:04:22.871 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-10T10:04:22.871 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-10T10:04:22.871 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-10T10:04:22.871 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-10T10:04:22.871 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-10T10:04:22.871 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-10T10:04:22.872 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-10T10:04:22.872 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-10T10:04:22.872 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-10T10:04:22.872 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-10T10:04:22.872 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-10T10:04:22.872 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-10T10:04:22.872 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-10T10:04:22.873 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-10T10:04:22.873 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-10T10:04:22.873 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-10T10:04:22.873 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-10T10:04:22.873 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-10T10:04:22.873 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-10T10:04:22.873 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-10T10:04:22.874 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-10T10:04:22.874 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-10T10:04:22.874 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-10T10:04:22.874 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-10T10:04:22.874 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-10T10:04:22.874 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-10T10:04:22.874 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-10T10:04:22.875 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-10T10:04:22.875 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-10T10:04:22.875 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-10T10:04:22.875 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-10T10:04:22.875 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-10T10:04:22.875 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-10T10:04:22.875 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-10T10:04:22.875 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-10T10:04:22.876 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-10T10:04:22.876 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-10T10:04:22.876 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-10T10:04:22.876 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-10T10:04:22.876 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-10T10:04:22.876 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-10T10:04:22.876 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-10T10:04:22.876 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-10T10:04:22.877 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-10T10:04:22.877 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-10T10:04:22.877 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-10T10:04:22.877 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-10T10:04:22.877 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-10T10:04:22.877 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-10T10:04:22.877 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-10T10:04:22.877 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-10T10:04:22.878 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-10T10:04:22.878 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-10T10:04:22.878 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-10T10:04:22.878 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-10T10:04:22.878 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-10T10:04:22.878 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-10T10:04:22.878 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-10T10:04:22.879 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-10T10:04:22.879 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-10T10:04:22.879 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-10T10:04:22.879 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-10T10:04:22.879 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-10T10:04:22.879 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-10T10:04:22.879 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-10T10:04:22.879 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-10T10:04:22.880 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-10T10:04:22.880 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-10T10:04:22.880 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-10T10:04:22.880 INFO:teuthology.orchestra.run.smithi107.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-10T10:04:22.881 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:22.881 DEBUG:teuthology.orchestra.run.smithi107:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-10T10:04:22.908 INFO:teuthology.orchestra.run.smithi107.stdout:postinstall scriptlet (using /bin/sh): 2023-08-10T10:04:22.908 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-10T10:04:22.909 INFO:teuthology.orchestra.run.smithi107.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:04:22.909 INFO:teuthology.orchestra.run.smithi107.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:04:22.909 INFO:teuthology.orchestra.run.smithi107.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:22.909 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:04:22.909 INFO:teuthology.orchestra.run.smithi107.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:04:22.909 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2023-08-10T10:04:22.909 INFO:teuthology.orchestra.run.smithi107.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-10T10:04:22.910 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-10T10:04:22.910 INFO:teuthology.orchestra.run.smithi107.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-10T10:04:22.910 INFO:teuthology.orchestra.run.smithi107.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-10T10:04:22.910 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:22.910 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2023-08-10T10:04:22.910 INFO:teuthology.orchestra.run.smithi107.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-10T10:04:22.910 INFO:teuthology.orchestra.run.smithi107.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-10T10:04:22.910 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:22.911 INFO:teuthology.orchestra.run.smithi107.stdout:fi 2023-08-10T10:04:22.911 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2023-08-10T10:04:22.990 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2023-08-10T10:04:22.990 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2023-08-10T10:04:22.990 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.02 2023-08-10T10:04:22.990 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 123.el8 2023-08-10T10:04:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2023-08-10T10:04:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-08-10T10:04:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Group : System Environment/Base 2023-08-10T10:04:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 9265450 2023-08-10T10:04:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2023-08-10T10:04:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-08-10T10:04:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-08-10T10:04:22.991 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-08-10T10:04:22.992 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-08-10T10:04:22.992 INFO:teuthology.orchestra.run.smithi107.stdout:Relocations : (not relocatable) 2023-08-10T10:04:22.992 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : Red Hat, Inc. 2023-08-10T10:04:22.992 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : Red Hat, Inc. 2023-08-10T10:04:22.992 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-10T10:04:22.992 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2023-08-10T10:04:22.992 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2023-08-10T10:04:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:04:22.993 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-10T10:04:22.993 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-10T10:04:22.993 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-10T10:04:22.993 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2023-08-10T10:04:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:04:22.993 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2023-08-10T10:04:22.994 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-10T10:04:22.994 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:22.995 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-10T10:04:27.470 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2023-08-10T10:04:29.561 INFO:teuthology.orchestra.run.smithi107.stderr:done 2023-08-10T10:04:29.562 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2023-08-10T10:04:29.580 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.dTQx3R32Ux 2023-08-10T10:04:29.580 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dTQx3R32Ux 2023-08-10T10:04:29.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.dTQx3R32Ux 2023-08-10T10:04:29.776 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.dTQx3R32Ux is 6KB 2023-08-10T10:04:29.796 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.dTQx3R32Ux 2023-08-10T10:04:29.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2023-08-10T10:04:29.876 INFO:teuthology.orchestra.run.smithi107.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-08-10T10:04:29.876 INFO:teuthology.orchestra.run.smithi107.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-08-10T10:04:29.876 INFO:teuthology.orchestra.run.smithi107.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc4-ga7fb1265323d.conf 2023-08-10T10:04:29.877 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:04:30.030 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2023-08-10T10:04:40.560 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-08-10T10:04:40.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-08-10T10:04:40.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:04:58.552 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10 10:04:58 URL:https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [380807140/380807140] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-10T10:04:58.552 INFO:teuthology.orchestra.run.smithi195.stderr:FINISHED --2023-08-10 10:04:58-- 2023-08-10T10:04:58.552 INFO:teuthology.orchestra.run.smithi195.stderr:Total wall clock time: 2m 16s 2023-08-10T10:04:58.553 INFO:teuthology.orchestra.run.smithi195.stderr:Downloaded: 1 files, 363M in 2m 16s (2.68 MB/s) 2023-08-10T10:04:58.553 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on mon.c... 2023-08-10T10:04:58.554 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-10T10:05:00.033 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-08-10T10:05:00.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-10T10:05:00.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:05:00.198 INFO:teuthology.orchestra.run.smithi195.stdout:Verifying... ######################################## 2023-08-10T10:05:00.256 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing... ######################################## 2023-08-10T10:05:00.362 INFO:teuthology.orchestra.run.smithi195.stdout:Updating / installing... 2023-08-10T10:05:15.252 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-10T10:05:24.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-08-10T10:05:24.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:05:27.312 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-10T10:05:34.704 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-10T10:05:38.376 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-10T10:05:39.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-08-10T10:05:39.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:05:43.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-10T10:05:43.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:05:57.744 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-08-10T10:06:05.146 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-10T10:06:05.146 DEBUG:teuthology.orchestra.run.smithi195:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-10T10:06:05.198 INFO:teuthology.orchestra.run.smithi195.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:05.199 INFO:teuthology.orchestra.run.smithi195.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:05.199 INFO:teuthology.orchestra.run.smithi195.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:05.199 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:05.200 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-10T10:06:05.200 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-10T10:06:05.201 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-10T10:06:05.201 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-10T10:06:05.201 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-10T10:06:05.202 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-10T10:06:05.202 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-10T10:06:05.202 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-10T10:06:05.203 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-10T10:06:05.203 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-10T10:06:05.203 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-10T10:06:05.203 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-10T10:06:05.204 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-10T10:06:05.204 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-10T10:06:05.204 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-10T10:06:05.205 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-10T10:06:05.205 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-10T10:06:05.205 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-10T10:06:05.205 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-10T10:06:05.205 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-10T10:06:05.205 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-10T10:06:05.205 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-10T10:06:05.206 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-10T10:06:05.206 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-10T10:06:05.206 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-10T10:06:05.206 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-10T10:06:05.206 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-10T10:06:05.206 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-10T10:06:05.206 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-10T10:06:05.206 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-10T10:06:05.207 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-10T10:06:05.207 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-10T10:06:05.207 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-10T10:06:05.207 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-10T10:06:05.207 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-10T10:06:05.207 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-10T10:06:05.207 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-10T10:06:05.208 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-10T10:06:05.208 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-10T10:06:05.208 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-10T10:06:05.208 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-10T10:06:05.208 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-10T10:06:05.208 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-10T10:06:05.208 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-10T10:06:05.208 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-10T10:06:05.209 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-10T10:06:05.209 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-10T10:06:05.209 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-10T10:06:05.209 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-10T10:06:05.209 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-10T10:06:05.209 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-10T10:06:05.209 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-10T10:06:05.210 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-10T10:06:05.210 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-10T10:06:05.210 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-10T10:06:05.210 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-10T10:06:05.210 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-10T10:06:05.210 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-10T10:06:05.210 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-10T10:06:05.210 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-10T10:06:05.211 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-10T10:06:05.211 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-10T10:06:05.211 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-10T10:06:05.211 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-10T10:06:05.211 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-10T10:06:05.211 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-10T10:06:05.211 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-10T10:06:05.211 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-10T10:06:05.212 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-10T10:06:05.212 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-10T10:06:05.212 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-10T10:06:05.212 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-10T10:06:05.212 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-10T10:06:05.213 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-10T10:06:05.213 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-10T10:06:05.213 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-10T10:06:05.213 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-10T10:06:05.213 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-10T10:06:05.213 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-10T10:06:05.213 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-10T10:06:05.213 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-10T10:06:05.214 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-10T10:06:05.214 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-10T10:06:05.214 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-10T10:06:05.214 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-10T10:06:05.214 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-10T10:06:05.214 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-10T10:06:05.214 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-10T10:06:05.214 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-10T10:06:05.215 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-10T10:06:05.215 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-10T10:06:05.215 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-10T10:06:05.215 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-10T10:06:05.215 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-10T10:06:05.215 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-10T10:06:05.215 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-10T10:06:05.215 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-10T10:06:05.216 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-10T10:06:05.216 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-10T10:06:05.216 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-10T10:06:05.216 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-10T10:06:05.216 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-10T10:06:05.216 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-10T10:06:05.216 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-10T10:06:05.217 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-10T10:06:05.217 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-10T10:06:05.217 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-10T10:06:05.217 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-10T10:06:05.217 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-10T10:06:05.217 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-10T10:06:05.217 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-10T10:06:05.217 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-10T10:06:05.218 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-10T10:06:05.218 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-10T10:06:05.218 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-10T10:06:05.218 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-10T10:06:05.218 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-10T10:06:05.218 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-10T10:06:05.218 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-10T10:06:05.218 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-10T10:06:05.219 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-10T10:06:05.219 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-10T10:06:05.219 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-10T10:06:05.219 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-10T10:06:05.219 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-10T10:06:05.219 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-10T10:06:05.219 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-10T10:06:05.220 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-10T10:06:05.220 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-10T10:06:05.220 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-10T10:06:05.220 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-10T10:06:05.220 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-10T10:06:05.220 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-10T10:06:05.220 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-10T10:06:05.221 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-10T10:06:05.221 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-10T10:06:05.221 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-10T10:06:05.221 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-10T10:06:05.221 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-10T10:06:05.221 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-10T10:06:05.221 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-10T10:06:05.221 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-10T10:06:05.222 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-10T10:06:05.222 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-10T10:06:05.222 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-10T10:06:05.222 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-10T10:06:05.222 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-10T10:06:05.222 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-10T10:06:05.222 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-10T10:06:05.222 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-10T10:06:05.223 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-10T10:06:05.223 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-10T10:06:05.223 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-10T10:06:05.223 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-10T10:06:05.223 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-10T10:06:05.223 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-10T10:06:05.223 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-10T10:06:05.223 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-10T10:06:05.224 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-10T10:06:05.224 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-10T10:06:05.224 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-10T10:06:05.224 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-10T10:06:05.224 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-10T10:06:05.224 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-10T10:06:05.224 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-10T10:06:05.224 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-10T10:06:05.225 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-10T10:06:05.225 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-10T10:06:05.225 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-10T10:06:05.225 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-10T10:06:05.225 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-10T10:06:05.225 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-10T10:06:05.225 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-10T10:06:05.226 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-10T10:06:05.226 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-10T10:06:05.226 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-10T10:06:05.226 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-10T10:06:05.226 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-10T10:06:05.226 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-10T10:06:05.226 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-10T10:06:05.226 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-10T10:06:05.227 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-10T10:06:05.227 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-10T10:06:05.227 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-10T10:06:05.227 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-10T10:06:05.227 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-10T10:06:05.227 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-10T10:06:05.227 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-10T10:06:05.227 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-10T10:06:05.228 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-10T10:06:05.228 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-10T10:06:05.228 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-10T10:06:05.228 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-10T10:06:05.228 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-10T10:06:05.228 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-10T10:06:05.228 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-10T10:06:05.228 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-10T10:06:05.229 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-10T10:06:05.229 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-10T10:06:05.229 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-10T10:06:05.229 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-10T10:06:05.229 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-10T10:06:05.229 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-10T10:06:05.229 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-10T10:06:05.229 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-10T10:06:05.230 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-10T10:06:05.230 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-10T10:06:05.230 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-10T10:06:05.230 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-10T10:06:05.230 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-10T10:06:05.230 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-10T10:06:05.230 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-10T10:06:05.230 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-10T10:06:05.231 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-10T10:06:05.231 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-10T10:06:05.231 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-10T10:06:05.231 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-10T10:06:05.231 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-10T10:06:05.231 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-10T10:06:05.231 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-10T10:06:05.232 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-10T10:06:05.232 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-10T10:06:05.232 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-10T10:06:05.232 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-10T10:06:05.232 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-10T10:06:05.232 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-10T10:06:05.232 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-10T10:06:05.232 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-10T10:06:05.233 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-10T10:06:05.233 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-10T10:06:05.233 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-10T10:06:05.233 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-10T10:06:05.233 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-10T10:06:05.233 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-10T10:06:05.233 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-10T10:06:05.234 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-10T10:06:05.234 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-10T10:06:05.234 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-10T10:06:05.234 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-10T10:06:05.234 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-10T10:06:05.234 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-10T10:06:05.234 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-10T10:06:05.234 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-10T10:06:05.235 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-10T10:06:05.235 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-10T10:06:05.235 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-10T10:06:05.235 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-10T10:06:05.235 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-10T10:06:05.235 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-10T10:06:05.235 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-10T10:06:05.235 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-10T10:06:05.236 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-10T10:06:05.236 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-10T10:06:05.236 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-10T10:06:05.236 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-10T10:06:05.236 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-10T10:06:05.236 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-10T10:06:05.236 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-10T10:06:05.236 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-10T10:06:05.237 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-10T10:06:05.237 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-10T10:06:05.237 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-10T10:06:05.237 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-10T10:06:05.237 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-10T10:06:05.237 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-10T10:06:05.237 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-10T10:06:05.237 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-10T10:06:05.238 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-10T10:06:05.238 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-10T10:06:05.238 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-10T10:06:05.238 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-10T10:06:05.238 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-10T10:06:05.238 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-10T10:06:05.238 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-10T10:06:05.238 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-10T10:06:05.239 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-10T10:06:05.239 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-10T10:06:05.239 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-10T10:06:05.239 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-10T10:06:05.239 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-10T10:06:05.239 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-10T10:06:05.239 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-10T10:06:05.239 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-10T10:06:05.240 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-10T10:06:05.240 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-10T10:06:05.240 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-10T10:06:05.240 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-10T10:06:05.240 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-10T10:06:05.240 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-10T10:06:05.240 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-10T10:06:05.241 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-10T10:06:05.241 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-10T10:06:05.241 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-10T10:06:05.241 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-10T10:06:05.241 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-10T10:06:05.241 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-10T10:06:05.241 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-10T10:06:05.241 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-10T10:06:05.242 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-10T10:06:05.242 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-10T10:06:05.242 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-10T10:06:05.242 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-10T10:06:05.242 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-10T10:06:05.242 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-10T10:06:05.242 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-10T10:06:05.242 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-10T10:06:05.243 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-10T10:06:05.243 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-10T10:06:05.243 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-10T10:06:05.243 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-10T10:06:05.243 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-10T10:06:05.243 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-10T10:06:05.243 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-10T10:06:05.243 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-10T10:06:05.244 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-10T10:06:05.244 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-10T10:06:05.244 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-10T10:06:05.244 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-10T10:06:05.244 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-10T10:06:05.244 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-10T10:06:05.244 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-10T10:06:05.244 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-10T10:06:05.245 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-10T10:06:05.245 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-10T10:06:05.245 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-10T10:06:05.245 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-10T10:06:05.245 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-10T10:06:05.245 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-10T10:06:05.245 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-10T10:06:05.245 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-10T10:06:05.246 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-10T10:06:05.246 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-10T10:06:05.246 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-10T10:06:05.246 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-10T10:06:05.246 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-10T10:06:05.246 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-10T10:06:05.246 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-10T10:06:05.246 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-10T10:06:05.247 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-10T10:06:05.247 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-10T10:06:05.247 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-10T10:06:05.247 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-10T10:06:05.247 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-10T10:06:05.247 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-10T10:06:05.247 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-10T10:06:05.247 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-10T10:06:05.248 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-10T10:06:05.248 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-10T10:06:05.248 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-10T10:06:05.248 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-10T10:06:05.248 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-10T10:06:05.248 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-10T10:06:05.248 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-10T10:06:05.249 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-10T10:06:05.249 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-10T10:06:05.249 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-10T10:06:05.249 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-10T10:06:05.249 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-10T10:06:05.249 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-10T10:06:05.249 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-10T10:06:05.249 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-10T10:06:05.250 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-10T10:06:05.250 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-10T10:06:05.250 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-10T10:06:05.250 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-10T10:06:05.250 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-10T10:06:05.250 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-10T10:06:05.250 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-10T10:06:05.250 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-10T10:06:05.251 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-10T10:06:05.251 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-10T10:06:05.251 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-10T10:06:05.251 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-10T10:06:05.251 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-10T10:06:05.251 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-10T10:06:05.251 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-10T10:06:05.251 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-10T10:06:05.252 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-10T10:06:05.252 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-10T10:06:05.252 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-10T10:06:05.252 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-10T10:06:05.252 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-10T10:06:05.252 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-10T10:06:05.252 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-10T10:06:05.253 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-10T10:06:05.253 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-10T10:06:05.253 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-10T10:06:05.253 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-10T10:06:05.253 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-10T10:06:05.253 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-10T10:06:05.253 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-10T10:06:05.253 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-10T10:06:05.254 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-10T10:06:05.254 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-10T10:06:05.254 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-10T10:06:05.254 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-10T10:06:05.254 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-10T10:06:05.254 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-10T10:06:05.254 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-10T10:06:05.254 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-10T10:06:05.255 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-10T10:06:05.255 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-10T10:06:05.255 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-10T10:06:05.255 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-10T10:06:05.255 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-10T10:06:05.255 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-10T10:06:05.255 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-10T10:06:05.255 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-10T10:06:05.256 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-10T10:06:05.256 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-10T10:06:05.256 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-10T10:06:05.256 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-10T10:06:05.256 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-10T10:06:05.256 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-10T10:06:05.256 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-10T10:06:05.256 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-10T10:06:05.257 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-10T10:06:05.257 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-10T10:06:05.257 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-10T10:06:05.257 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-10T10:06:05.257 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-10T10:06:05.257 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-10T10:06:05.257 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-10T10:06:05.257 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-10T10:06:05.258 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-10T10:06:05.258 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-10T10:06:05.258 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-10T10:06:05.258 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-10T10:06:05.258 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-10T10:06:05.258 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-10T10:06:05.258 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-10T10:06:05.258 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-10T10:06:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-10T10:06:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-10T10:06:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-10T10:06:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-10T10:06:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-10T10:06:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-10T10:06:05.259 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-10T10:06:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-10T10:06:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-10T10:06:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-10T10:06:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-10T10:06:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-10T10:06:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-10T10:06:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-10T10:06:05.260 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-10T10:06:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-10T10:06:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-10T10:06:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-10T10:06:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-10T10:06:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-10T10:06:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-10T10:06:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-10T10:06:05.261 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-10T10:06:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-10T10:06:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-10T10:06:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-10T10:06:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-10T10:06:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-10T10:06:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-10T10:06:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-10T10:06:05.262 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-10T10:06:05.263 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-10T10:06:05.263 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-10T10:06:05.263 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-10T10:06:05.263 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-10T10:06:05.263 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-10T10:06:05.263 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-10T10:06:05.263 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-10T10:06:05.263 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-10T10:06:05.264 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-10T10:06:05.264 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-10T10:06:05.264 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-10T10:06:05.264 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-10T10:06:05.264 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-10T10:06:05.264 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-10T10:06:05.264 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-10T10:06:05.265 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-10T10:06:05.265 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-10T10:06:05.265 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-10T10:06:05.265 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-10T10:06:05.265 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-10T10:06:05.265 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-10T10:06:05.265 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-10T10:06:05.265 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-10T10:06:05.266 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-10T10:06:05.266 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-10T10:06:05.266 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-10T10:06:05.266 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-10T10:06:05.266 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-10T10:06:05.266 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-10T10:06:05.266 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-10T10:06:05.266 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-10T10:06:05.267 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-10T10:06:05.267 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-10T10:06:05.267 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-10T10:06:05.267 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-10T10:06:05.267 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-10T10:06:05.267 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-10T10:06:05.267 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-10T10:06:05.267 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-10T10:06:05.268 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-10T10:06:05.268 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-10T10:06:05.268 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-10T10:06:05.268 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-10T10:06:05.268 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-10T10:06:05.268 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-10T10:06:05.268 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-10T10:06:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-10T10:06:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-10T10:06:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-10T10:06:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-10T10:06:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-10T10:06:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-10T10:06:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-10T10:06:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-10T10:06:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-10T10:06:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-10T10:06:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-10T10:06:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-10T10:06:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-10T10:06:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-10T10:06:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-10T10:06:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-10T10:06:05.271 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-10T10:06:05.271 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-10T10:06:05.271 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-10T10:06:05.271 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-10T10:06:05.271 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-10T10:06:05.271 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-10T10:06:05.271 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-10T10:06:05.271 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-10T10:06:05.272 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-10T10:06:05.272 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-10T10:06:05.272 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-10T10:06:05.272 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-10T10:06:05.272 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-10T10:06:05.272 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-10T10:06:05.272 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-10T10:06:05.272 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-10T10:06:05.273 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-10T10:06:05.273 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-10T10:06:05.273 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-10T10:06:05.273 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-10T10:06:05.273 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-10T10:06:05.273 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-10T10:06:05.273 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-10T10:06:05.274 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-10T10:06:05.274 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-10T10:06:05.274 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-10T10:06:05.274 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-10T10:06:05.274 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-10T10:06:05.274 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-10T10:06:05.274 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-10T10:06:05.274 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-10T10:06:05.275 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-10T10:06:05.275 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-10T10:06:05.275 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-10T10:06:05.275 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-10T10:06:05.275 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-10T10:06:05.275 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-10T10:06:05.275 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-10T10:06:05.275 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-10T10:06:05.276 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-10T10:06:05.276 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-10T10:06:05.276 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-10T10:06:05.276 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-10T10:06:05.276 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-10T10:06:05.276 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-10T10:06:05.276 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-10T10:06:05.276 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-10T10:06:05.277 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-10T10:06:05.277 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-10T10:06:05.277 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-10T10:06:05.277 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-10T10:06:05.277 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-10T10:06:05.277 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-10T10:06:05.277 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-10T10:06:05.278 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-10T10:06:05.278 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-10T10:06:05.278 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-10T10:06:05.278 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-10T10:06:05.278 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-10T10:06:05.278 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-10T10:06:05.278 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-10T10:06:05.278 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-10T10:06:05.279 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-10T10:06:05.279 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-10T10:06:05.279 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-10T10:06:05.279 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-10T10:06:05.279 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-10T10:06:05.279 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-10T10:06:05.279 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-10T10:06:05.279 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-10T10:06:05.280 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-10T10:06:05.280 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-10T10:06:05.280 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-10T10:06:05.280 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-10T10:06:05.280 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-10T10:06:05.280 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-10T10:06:05.280 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-10T10:06:05.280 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-10T10:06:05.281 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-10T10:06:05.281 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-10T10:06:05.281 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-10T10:06:05.281 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-10T10:06:05.281 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-10T10:06:05.281 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-10T10:06:05.281 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-10T10:06:05.282 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-10T10:06:05.282 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-10T10:06:05.282 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-10T10:06:05.282 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-10T10:06:05.282 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-10T10:06:05.282 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-10T10:06:05.282 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-10T10:06:05.282 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-10T10:06:05.283 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-10T10:06:05.283 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-10T10:06:05.283 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-10T10:06:05.283 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-10T10:06:05.283 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-10T10:06:05.283 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-10T10:06:05.283 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-10T10:06:05.283 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-10T10:06:05.284 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-10T10:06:05.284 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-10T10:06:05.284 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-10T10:06:05.284 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-10T10:06:05.284 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-10T10:06:05.284 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-10T10:06:05.284 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-10T10:06:05.284 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-10T10:06:05.285 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-10T10:06:05.285 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-10T10:06:05.285 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-10T10:06:05.285 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-10T10:06:05.285 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-10T10:06:05.285 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-10T10:06:05.285 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-10T10:06:05.285 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-10T10:06:05.286 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-10T10:06:05.286 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-10T10:06:05.286 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-10T10:06:05.286 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-10T10:06:05.286 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-10T10:06:05.286 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-10T10:06:05.286 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-10T10:06:05.286 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-10T10:06:05.287 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-10T10:06:05.287 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-10T10:06:05.287 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-10T10:06:05.287 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-10T10:06:05.287 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-10T10:06:05.287 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-10T10:06:05.287 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-10T10:06:05.287 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-10T10:06:05.288 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-10T10:06:05.288 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-10T10:06:05.288 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-10T10:06:05.288 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-10T10:06:05.288 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-10T10:06:05.288 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-10T10:06:05.288 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-10T10:06:05.289 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-10T10:06:05.289 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-10T10:06:05.289 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-10T10:06:05.289 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-10T10:06:05.289 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-10T10:06:05.289 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-10T10:06:05.289 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-10T10:06:05.289 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-10T10:06:05.290 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-10T10:06:05.290 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-10T10:06:05.290 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-10T10:06:05.290 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-10T10:06:05.290 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-10T10:06:05.290 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-10T10:06:05.290 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-10T10:06:05.290 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-10T10:06:05.291 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-10T10:06:05.291 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-10T10:06:05.291 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-10T10:06:05.291 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-10T10:06:05.291 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-10T10:06:05.291 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-10T10:06:05.291 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-10T10:06:05.291 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-10T10:06:05.292 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-10T10:06:05.292 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-10T10:06:05.292 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-10T10:06:05.292 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-10T10:06:05.292 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-10T10:06:05.292 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-10T10:06:05.292 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-10T10:06:05.293 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-10T10:06:05.293 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-10T10:06:05.293 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-10T10:06:05.293 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-10T10:06:05.293 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-10T10:06:05.293 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-10T10:06:05.293 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-10T10:06:05.293 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-10T10:06:05.294 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-10T10:06:05.294 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-10T10:06:05.294 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-10T10:06:05.294 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-10T10:06:05.294 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-10T10:06:05.294 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-10T10:06:05.294 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-10T10:06:05.294 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-10T10:06:05.295 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-10T10:06:05.295 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-10T10:06:05.295 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-10T10:06:05.295 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-10T10:06:05.295 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-10T10:06:05.295 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-10T10:06:05.295 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-10T10:06:05.295 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-10T10:06:05.296 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-10T10:06:05.296 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-10T10:06:05.296 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-10T10:06:05.296 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-10T10:06:05.296 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-10T10:06:05.296 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-10T10:06:05.296 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-10T10:06:05.297 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-10T10:06:05.297 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-10T10:06:05.297 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-10T10:06:05.297 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-10T10:06:05.297 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-10T10:06:05.297 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-10T10:06:05.297 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-10T10:06:05.297 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-10T10:06:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-10T10:06:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-10T10:06:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-10T10:06:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-10T10:06:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-10T10:06:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-10T10:06:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-10T10:06:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-10T10:06:05.299 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-10T10:06:05.299 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-10T10:06:05.299 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-10T10:06:05.299 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-10T10:06:05.299 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-10T10:06:05.299 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-10T10:06:05.299 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-10T10:06:05.299 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-10T10:06:05.300 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-10T10:06:05.300 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-10T10:06:05.300 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-10T10:06:05.300 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-10T10:06:05.300 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-10T10:06:05.300 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-10T10:06:05.300 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-10T10:06:05.300 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-10T10:06:05.301 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-10T10:06:05.301 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-10T10:06:05.301 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-10T10:06:05.301 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-10T10:06:05.301 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-10T10:06:05.301 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-10T10:06:05.301 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-10T10:06:05.302 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-10T10:06:05.302 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-10T10:06:05.302 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-10T10:06:05.302 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-10T10:06:05.302 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-10T10:06:05.302 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-10T10:06:05.302 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-10T10:06:05.302 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-10T10:06:05.303 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-10T10:06:05.303 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-10T10:06:05.303 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-10T10:06:05.303 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-10T10:06:05.303 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-10T10:06:05.303 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-10T10:06:05.303 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-10T10:06:05.303 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-10T10:06:05.304 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-10T10:06:05.304 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-10T10:06:05.304 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-10T10:06:05.304 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-10T10:06:05.304 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-10T10:06:05.304 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-10T10:06:05.304 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-10T10:06:05.304 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-10T10:06:05.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-10T10:06:05.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-10T10:06:05.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-10T10:06:05.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-10T10:06:05.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-10T10:06:05.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-10T10:06:05.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-10T10:06:05.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-10T10:06:05.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-10T10:06:05.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-10T10:06:05.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-10T10:06:05.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-10T10:06:05.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-10T10:06:05.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-10T10:06:05.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-10T10:06:05.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-10T10:06:05.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-10T10:06:05.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-10T10:06:05.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-10T10:06:05.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-10T10:06:05.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-10T10:06:05.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-10T10:06:05.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-10T10:06:05.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-10T10:06:05.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-10T10:06:05.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-10T10:06:05.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-10T10:06:05.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-10T10:06:05.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-10T10:06:05.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-10T10:06:05.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-10T10:06:05.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-10T10:06:05.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-10T10:06:05.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-10T10:06:05.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-10T10:06:05.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-10T10:06:05.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-10T10:06:05.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-10T10:06:05.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-10T10:06:05.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-10T10:06:05.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-10T10:06:05.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-10T10:06:05.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-10T10:06:05.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-10T10:06:05.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-10T10:06:05.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-10T10:06:05.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-10T10:06:05.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-10T10:06:05.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-10T10:06:05.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-10T10:06:05.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-10T10:06:05.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-10T10:06:05.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-10T10:06:05.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-10T10:06:05.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-10T10:06:05.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-10T10:06:05.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-10T10:06:05.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-10T10:06:05.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-10T10:06:05.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-10T10:06:05.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-10T10:06:05.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-10T10:06:05.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-10T10:06:05.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-10T10:06:05.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-10T10:06:05.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-10T10:06:05.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-10T10:06:05.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-10T10:06:05.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-10T10:06:05.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-10T10:06:05.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-10T10:06:05.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-10T10:06:05.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-10T10:06:05.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-10T10:06:05.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-10T10:06:05.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-10T10:06:05.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-10T10:06:05.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-10T10:06:05.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-10T10:06:05.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-10T10:06:05.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-10T10:06:05.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-10T10:06:05.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-10T10:06:05.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-10T10:06:05.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-10T10:06:05.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-10T10:06:05.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-10T10:06:05.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-10T10:06:05.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-10T10:06:05.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-10T10:06:05.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-10T10:06:05.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-10T10:06:05.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-10T10:06:05.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-10T10:06:05.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-10T10:06:05.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-10T10:06:05.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-10T10:06:05.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-10T10:06:05.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-10T10:06:05.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-10T10:06:05.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-10T10:06:05.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-10T10:06:05.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-10T10:06:05.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-10T10:06:05.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-10T10:06:05.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-10T10:06:05.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-10T10:06:05.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-10T10:06:05.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-10T10:06:05.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-10T10:06:05.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-10T10:06:05.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-10T10:06:05.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-10T10:06:05.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-10T10:06:05.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-10T10:06:05.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-10T10:06:05.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-10T10:06:05.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-10T10:06:05.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-10T10:06:05.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-10T10:06:05.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-10T10:06:05.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-10T10:06:05.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-10T10:06:05.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-10T10:06:05.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-10T10:06:05.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-10T10:06:05.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-10T10:06:05.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-10T10:06:05.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-10T10:06:05.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-10T10:06:05.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-10T10:06:05.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-10T10:06:05.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-10T10:06:05.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-10T10:06:05.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-10T10:06:05.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-10T10:06:05.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-10T10:06:05.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-10T10:06:05.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-10T10:06:05.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-10T10:06:05.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-10T10:06:05.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-10T10:06:05.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-10T10:06:05.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-10T10:06:05.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-10T10:06:05.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-10T10:06:05.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-10T10:06:05.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-10T10:06:05.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-10T10:06:05.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-10T10:06:05.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-10T10:06:05.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-10T10:06:05.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-10T10:06:05.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-10T10:06:05.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-10T10:06:05.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-10T10:06:05.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-10T10:06:05.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-10T10:06:05.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-10T10:06:05.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-10T10:06:05.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-10T10:06:05.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-10T10:06:05.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-10T10:06:05.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-10T10:06:05.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-10T10:06:05.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-10T10:06:05.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-10T10:06:05.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-10T10:06:05.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-10T10:06:05.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-10T10:06:05.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-10T10:06:05.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-10T10:06:05.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-10T10:06:05.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-10T10:06:05.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-10T10:06:05.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-10T10:06:05.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-10T10:06:05.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-10T10:06:05.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-10T10:06:05.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-10T10:06:05.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-10T10:06:05.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-10T10:06:05.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-10T10:06:05.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-10T10:06:05.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-10T10:06:05.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-10T10:06:05.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-10T10:06:05.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-10T10:06:05.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-10T10:06:05.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-10T10:06:05.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-10T10:06:05.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-10T10:06:05.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-10T10:06:05.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-10T10:06:05.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-10T10:06:05.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-10T10:06:05.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-10T10:06:05.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-10T10:06:05.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-10T10:06:05.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-10T10:06:05.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-10T10:06:05.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-10T10:06:05.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-10T10:06:05.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-10T10:06:05.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-10T10:06:05.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-10T10:06:05.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-10T10:06:05.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-10T10:06:05.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-10T10:06:05.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-10T10:06:05.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-10T10:06:05.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-10T10:06:05.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-10T10:06:05.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-10T10:06:05.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-10T10:06:05.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-10T10:06:05.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-10T10:06:05.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-10T10:06:05.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-10T10:06:05.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-10T10:06:05.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-10T10:06:05.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-10T10:06:05.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-10T10:06:05.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-10T10:06:05.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-10T10:06:05.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-10T10:06:05.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-10T10:06:05.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-10T10:06:05.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-10T10:06:05.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-10T10:06:05.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-10T10:06:05.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-10T10:06:05.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-10T10:06:05.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-10T10:06:05.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-10T10:06:05.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-10T10:06:05.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-10T10:06:05.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-10T10:06:05.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-10T10:06:05.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-10T10:06:05.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-10T10:06:05.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-10T10:06:05.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-10T10:06:05.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-10T10:06:05.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-10T10:06:05.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-10T10:06:05.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-10T10:06:05.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-10T10:06:05.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-10T10:06:05.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-10T10:06:05.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-10T10:06:05.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-10T10:06:05.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-10T10:06:05.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-10T10:06:05.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-10T10:06:05.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-10T10:06:05.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-10T10:06:05.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-10T10:06:05.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-10T10:06:05.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-10T10:06:05.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-10T10:06:05.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-10T10:06:05.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-10T10:06:05.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-10T10:06:05.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-10T10:06:05.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-10T10:06:05.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-10T10:06:05.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-10T10:06:05.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-10T10:06:05.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-10T10:06:05.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-10T10:06:05.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-10T10:06:05.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-10T10:06:05.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-10T10:06:05.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-10T10:06:05.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-10T10:06:05.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-10T10:06:05.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-10T10:06:05.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-10T10:06:05.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-10T10:06:05.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-10T10:06:05.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-10T10:06:05.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-10T10:06:05.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-10T10:06:05.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-10T10:06:05.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-10T10:06:05.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-10T10:06:05.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-10T10:06:05.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-10T10:06:05.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-10T10:06:05.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-10T10:06:05.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-10T10:06:05.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-10T10:06:05.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-10T10:06:05.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-10T10:06:05.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-10T10:06:05.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-10T10:06:05.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-10T10:06:05.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-10T10:06:05.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-10T10:06:05.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-10T10:06:05.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-10T10:06:05.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-10T10:06:05.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-10T10:06:05.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-10T10:06:05.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-10T10:06:05.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-10T10:06:05.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-10T10:06:05.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-10T10:06:05.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-10T10:06:05.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-10T10:06:05.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-10T10:06:05.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-10T10:06:05.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-10T10:06:05.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-10T10:06:05.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-10T10:06:05.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-10T10:06:05.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-10T10:06:05.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-10T10:06:05.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-10T10:06:05.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-10T10:06:05.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-10T10:06:05.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-10T10:06:05.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-10T10:06:05.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-10T10:06:05.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-10T10:06:05.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-10T10:06:05.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-10T10:06:05.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-10T10:06:05.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-10T10:06:05.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-10T10:06:05.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-10T10:06:05.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-10T10:06:05.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-10T10:06:05.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-10T10:06:05.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-10T10:06:05.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-10T10:06:05.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-10T10:06:05.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-10T10:06:05.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-10T10:06:05.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-10T10:06:05.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-10T10:06:05.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-10T10:06:05.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-10T10:06:05.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-10T10:06:05.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-10T10:06:05.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-10T10:06:05.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-10T10:06:05.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-10T10:06:05.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-10T10:06:05.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-10T10:06:05.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-10T10:06:05.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-10T10:06:05.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-10T10:06:05.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-10T10:06:05.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-10T10:06:05.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-10T10:06:05.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-10T10:06:05.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-10T10:06:05.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-10T10:06:05.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-10T10:06:05.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-10T10:06:05.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-10T10:06:05.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-10T10:06:05.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-10T10:06:05.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-10T10:06:05.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-10T10:06:05.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-10T10:06:05.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-10T10:06:05.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-10T10:06:05.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-10T10:06:05.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-10T10:06:05.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-10T10:06:05.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-10T10:06:05.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-10T10:06:05.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-10T10:06:05.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-10T10:06:05.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-10T10:06:05.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-10T10:06:05.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-10T10:06:05.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-10T10:06:05.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-10T10:06:05.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-10T10:06:05.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-10T10:06:05.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-10T10:06:05.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-10T10:06:05.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-10T10:06:05.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-10T10:06:05.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-10T10:06:05.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-10T10:06:05.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-10T10:06:05.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-10T10:06:05.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-10T10:06:05.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-10T10:06:05.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-10T10:06:05.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-10T10:06:05.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-10T10:06:05.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-10T10:06:05.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-10T10:06:05.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-10T10:06:05.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-10T10:06:05.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-10T10:06:05.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-10T10:06:05.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-10T10:06:05.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-10T10:06:05.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-10T10:06:05.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-10T10:06:05.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-10T10:06:05.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-10T10:06:05.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-10T10:06:05.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-10T10:06:05.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-10T10:06:05.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-10T10:06:05.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-10T10:06:05.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-10T10:06:05.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-10T10:06:05.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-10T10:06:05.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-10T10:06:05.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-10T10:06:05.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-10T10:06:05.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-10T10:06:05.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-10T10:06:05.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-10T10:06:05.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-10T10:06:05.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-10T10:06:05.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-10T10:06:05.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-10T10:06:05.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-10T10:06:05.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-10T10:06:05.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-10T10:06:05.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-10T10:06:05.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-10T10:06:05.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-10T10:06:05.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-10T10:06:05.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-10T10:06:05.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-10T10:06:05.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-10T10:06:05.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-10T10:06:05.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-10T10:06:05.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-10T10:06:05.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-10T10:06:05.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-10T10:06:05.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-10T10:06:05.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-10T10:06:05.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-10T10:06:05.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-10T10:06:05.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-10T10:06:05.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-10T10:06:05.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-10T10:06:05.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-10T10:06:05.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-10T10:06:05.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-10T10:06:05.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-10T10:06:05.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-10T10:06:05.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-10T10:06:05.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-10T10:06:05.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-10T10:06:05.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-10T10:06:05.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-10T10:06:05.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-10T10:06:05.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-10T10:06:05.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-10T10:06:05.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-10T10:06:05.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-10T10:06:05.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-10T10:06:05.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-10T10:06:05.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-10T10:06:05.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-10T10:06:05.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-10T10:06:05.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-10T10:06:05.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-10T10:06:05.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-10T10:06:05.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-10T10:06:05.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-10T10:06:05.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-10T10:06:05.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-10T10:06:05.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-10T10:06:05.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-10T10:06:05.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-10T10:06:05.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-10T10:06:05.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-10T10:06:05.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-10T10:06:05.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-10T10:06:05.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-10T10:06:05.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-10T10:06:05.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-10T10:06:05.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-10T10:06:05.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-10T10:06:05.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-10T10:06:05.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-10T10:06:05.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-10T10:06:05.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-10T10:06:05.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-10T10:06:05.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-10T10:06:05.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-10T10:06:05.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-10T10:06:05.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-10T10:06:05.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-10T10:06:05.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-10T10:06:05.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-10T10:06:05.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-10T10:06:05.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-10T10:06:05.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-10T10:06:05.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-10T10:06:05.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-10T10:06:05.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-10T10:06:05.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-10T10:06:05.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-10T10:06:05.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-10T10:06:05.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-10T10:06:05.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-10T10:06:05.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-10T10:06:05.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-10T10:06:05.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-10T10:06:05.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-10T10:06:05.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-10T10:06:05.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-10T10:06:05.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-10T10:06:05.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-10T10:06:05.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-10T10:06:05.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-10T10:06:05.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-10T10:06:05.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-10T10:06:05.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-10T10:06:05.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-10T10:06:05.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-10T10:06:05.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-10T10:06:05.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-10T10:06:05.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-10T10:06:05.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-10T10:06:05.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-10T10:06:05.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-10T10:06:05.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-10T10:06:05.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-10T10:06:05.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-10T10:06:05.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-10T10:06:05.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-10T10:06:05.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-10T10:06:05.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-10T10:06:05.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-10T10:06:05.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-10T10:06:05.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-10T10:06:05.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-10T10:06:05.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-10T10:06:05.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-10T10:06:05.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-10T10:06:05.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-10T10:06:05.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-10T10:06:05.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-10T10:06:05.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-10T10:06:05.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-10T10:06:05.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-10T10:06:05.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-10T10:06:05.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-10T10:06:05.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-10T10:06:05.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-10T10:06:05.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-10T10:06:05.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-10T10:06:05.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-10T10:06:05.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-10T10:06:05.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-10T10:06:05.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-10T10:06:05.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-10T10:06:05.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-10T10:06:05.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-10T10:06:05.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-10T10:06:05.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-10T10:06:05.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-10T10:06:05.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-10T10:06:05.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-10T10:06:05.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-10T10:06:05.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-10T10:06:05.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-10T10:06:05.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-10T10:06:05.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-10T10:06:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-10T10:06:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-10T10:06:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-10T10:06:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-10T10:06:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-10T10:06:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-10T10:06:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-10T10:06:05.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-10T10:06:05.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-10T10:06:05.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-10T10:06:05.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-10T10:06:05.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-10T10:06:05.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-10T10:06:05.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-10T10:06:05.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-10T10:06:05.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-10T10:06:05.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-10T10:06:05.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-10T10:06:05.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-10T10:06:05.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-10T10:06:05.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-10T10:06:05.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-10T10:06:05.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-10T10:06:05.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-10T10:06:05.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-10T10:06:05.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-10T10:06:05.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-10T10:06:05.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-10T10:06:05.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-10T10:06:05.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-10T10:06:05.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-10T10:06:05.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-10T10:06:05.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-10T10:06:05.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-10T10:06:05.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-10T10:06:05.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-10T10:06:05.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-10T10:06:05.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-10T10:06:05.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-10T10:06:05.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-10T10:06:05.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-10T10:06:05.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-10T10:06:05.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-10T10:06:05.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-10T10:06:05.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-10T10:06:05.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-10T10:06:05.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-10T10:06:05.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-10T10:06:05.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-10T10:06:05.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-10T10:06:05.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-10T10:06:05.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-10T10:06:05.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-10T10:06:05.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-10T10:06:05.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-10T10:06:05.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-10T10:06:05.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-10T10:06:05.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-10T10:06:05.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-10T10:06:05.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-10T10:06:05.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-10T10:06:05.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-10T10:06:05.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-10T10:06:05.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-10T10:06:05.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-10T10:06:05.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-10T10:06:05.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-10T10:06:05.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-10T10:06:05.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-10T10:06:05.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-10T10:06:05.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-10T10:06:05.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-10T10:06:05.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-10T10:06:05.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-10T10:06:05.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-10T10:06:05.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-10T10:06:05.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-10T10:06:05.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-10T10:06:05.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-10T10:06:05.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-10T10:06:05.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-10T10:06:05.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-10T10:06:05.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-10T10:06:05.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-10T10:06:05.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-10T10:06:05.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-10T10:06:05.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-10T10:06:05.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-10T10:06:05.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-10T10:06:05.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-10T10:06:05.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-10T10:06:05.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-10T10:06:05.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-10T10:06:05.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-10T10:06:05.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-10T10:06:05.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-10T10:06:05.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-10T10:06:05.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-10T10:06:05.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-10T10:06:05.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-10T10:06:05.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-10T10:06:05.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-10T10:06:05.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-10T10:06:05.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-10T10:06:05.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-10T10:06:05.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-10T10:06:05.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-10T10:06:05.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-10T10:06:05.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-10T10:06:05.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-10T10:06:05.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-10T10:06:05.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-10T10:06:05.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-10T10:06:05.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-10T10:06:05.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-10T10:06:05.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-10T10:06:05.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-10T10:06:05.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-10T10:06:05.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-10T10:06:05.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-10T10:06:05.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-10T10:06:05.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-10T10:06:05.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-10T10:06:05.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-10T10:06:05.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-10T10:06:05.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-10T10:06:05.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-10T10:06:05.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-10T10:06:05.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-10T10:06:05.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-10T10:06:05.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-10T10:06:05.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-10T10:06:05.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-10T10:06:05.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-10T10:06:05.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-10T10:06:05.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-10T10:06:05.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-10T10:06:05.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-10T10:06:05.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-10T10:06:05.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-10T10:06:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-10T10:06:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-10T10:06:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-10T10:06:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-10T10:06:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-10T10:06:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-10T10:06:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-10T10:06:05.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-10T10:06:05.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-10T10:06:05.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-10T10:06:05.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-10T10:06:05.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-10T10:06:05.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-10T10:06:05.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-10T10:06:05.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-10T10:06:05.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-10T10:06:05.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-10T10:06:05.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-10T10:06:05.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-10T10:06:05.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-10T10:06:05.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-10T10:06:05.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-10T10:06:05.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-10T10:06:05.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-10T10:06:05.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-10T10:06:05.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-10T10:06:05.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-10T10:06:05.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-10T10:06:05.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-10T10:06:05.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-10T10:06:05.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-10T10:06:05.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-10T10:06:05.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-10T10:06:05.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-10T10:06:05.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-10T10:06:05.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-10T10:06:05.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-10T10:06:05.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-10T10:06:05.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-10T10:06:05.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-10T10:06:05.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-10T10:06:05.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-10T10:06:05.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-10T10:06:05.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-10T10:06:05.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-10T10:06:05.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-10T10:06:05.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-10T10:06:05.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-10T10:06:05.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-10T10:06:05.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-10T10:06:05.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-10T10:06:05.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-10T10:06:05.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-10T10:06:05.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-10T10:06:05.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-10T10:06:05.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-10T10:06:05.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-10T10:06:05.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-10T10:06:05.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-10T10:06:05.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-10T10:06:05.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-10T10:06:05.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-10T10:06:05.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-10T10:06:05.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-10T10:06:05.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-10T10:06:05.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-10T10:06:05.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-10T10:06:05.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-10T10:06:05.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-10T10:06:05.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-10T10:06:05.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-10T10:06:05.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-10T10:06:05.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-10T10:06:05.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-10T10:06:05.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-10T10:06:05.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-10T10:06:05.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-10T10:06:05.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-10T10:06:05.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-10T10:06:05.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-10T10:06:05.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-10T10:06:05.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-10T10:06:05.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-10T10:06:05.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-10T10:06:05.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-10T10:06:05.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-10T10:06:05.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-10T10:06:05.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-10T10:06:05.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-10T10:06:05.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-10T10:06:05.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-10T10:06:05.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-10T10:06:05.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-10T10:06:05.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-10T10:06:05.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-10T10:06:05.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-10T10:06:05.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-10T10:06:05.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-10T10:06:05.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-10T10:06:05.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-10T10:06:05.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-10T10:06:05.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-10T10:06:05.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-10T10:06:05.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-10T10:06:05.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-10T10:06:05.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-10T10:06:05.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-10T10:06:05.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-10T10:06:05.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-10T10:06:05.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-10T10:06:05.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-10T10:06:05.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-10T10:06:05.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-10T10:06:05.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-10T10:06:05.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-10T10:06:05.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-10T10:06:05.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-10T10:06:05.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-10T10:06:05.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-10T10:06:05.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-10T10:06:05.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-10T10:06:05.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-10T10:06:05.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-10T10:06:05.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-10T10:06:05.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-10T10:06:05.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-10T10:06:05.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-10T10:06:05.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-10T10:06:05.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-10T10:06:05.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-10T10:06:05.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-10T10:06:05.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-10T10:06:05.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-10T10:06:05.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-10T10:06:05.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-10T10:06:05.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-10T10:06:05.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-10T10:06:05.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-10T10:06:05.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-10T10:06:05.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-10T10:06:05.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-10T10:06:05.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-10T10:06:05.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-10T10:06:05.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-10T10:06:05.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-10T10:06:05.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-10T10:06:05.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-10T10:06:05.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-10T10:06:05.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-10T10:06:05.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-10T10:06:05.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-10T10:06:05.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-10T10:06:05.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-10T10:06:05.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-10T10:06:05.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-10T10:06:05.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-10T10:06:05.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-10T10:06:05.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-10T10:06:05.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-10T10:06:05.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-10T10:06:05.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-10T10:06:05.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-10T10:06:05.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-10T10:06:05.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-10T10:06:05.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-10T10:06:05.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-10T10:06:05.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-10T10:06:05.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-10T10:06:05.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-10T10:06:05.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-10T10:06:05.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-10T10:06:05.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-10T10:06:05.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-10T10:06:05.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-10T10:06:05.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-10T10:06:05.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-10T10:06:05.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-10T10:06:05.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-10T10:06:05.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-10T10:06:05.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-10T10:06:05.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-10T10:06:05.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-10T10:06:05.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-10T10:06:05.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-10T10:06:05.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-10T10:06:05.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-10T10:06:05.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-10T10:06:05.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-10T10:06:05.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-10T10:06:05.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-10T10:06:05.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-10T10:06:05.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-10T10:06:05.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-10T10:06:05.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-10T10:06:05.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-10T10:06:05.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-10T10:06:05.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-10T10:06:05.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-10T10:06:05.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-10T10:06:05.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-10T10:06:05.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-10T10:06:05.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-10T10:06:05.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-10T10:06:05.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-10T10:06:05.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-10T10:06:05.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-10T10:06:05.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-10T10:06:05.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-10T10:06:05.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-10T10:06:05.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-10T10:06:05.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-10T10:06:05.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-10T10:06:05.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-10T10:06:05.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-10T10:06:05.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-10T10:06:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-10T10:06:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-10T10:06:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-10T10:06:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-10T10:06:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-10T10:06:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-10T10:06:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-10T10:06:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-10T10:06:05.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-10T10:06:05.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-10T10:06:05.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-10T10:06:05.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-10T10:06:05.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-10T10:06:05.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-10T10:06:05.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-10T10:06:05.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-10T10:06:05.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-10T10:06:05.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-10T10:06:05.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-10T10:06:05.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-10T10:06:05.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-10T10:06:05.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-10T10:06:05.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-10T10:06:05.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-10T10:06:05.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-10T10:06:05.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-10T10:06:05.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-10T10:06:05.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-10T10:06:05.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-10T10:06:05.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-10T10:06:05.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-10T10:06:05.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-10T10:06:05.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-10T10:06:05.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-10T10:06:05.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-10T10:06:05.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-10T10:06:05.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-10T10:06:05.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-10T10:06:05.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-10T10:06:05.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-10T10:06:05.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-10T10:06:05.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-10T10:06:05.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-10T10:06:05.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-10T10:06:05.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-10T10:06:05.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-10T10:06:05.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-10T10:06:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-10T10:06:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-10T10:06:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-10T10:06:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-10T10:06:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-10T10:06:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-10T10:06:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-10T10:06:05.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-10T10:06:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-10T10:06:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-10T10:06:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-10T10:06:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-10T10:06:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-10T10:06:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-10T10:06:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-10T10:06:05.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-10T10:06:05.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-10T10:06:05.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-10T10:06:05.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-10T10:06:05.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-10T10:06:05.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-10T10:06:05.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-10T10:06:05.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-10T10:06:05.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-10T10:06:05.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-10T10:06:05.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-10T10:06:05.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-10T10:06:05.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-10T10:06:05.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-10T10:06:05.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-10T10:06:05.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-10T10:06:05.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-10T10:06:05.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-10T10:06:05.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-10T10:06:05.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-10T10:06:05.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-10T10:06:05.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-10T10:06:05.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-10T10:06:05.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-10T10:06:05.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-10T10:06:05.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-10T10:06:05.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-10T10:06:05.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-10T10:06:05.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-10T10:06:05.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-10T10:06:05.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-10T10:06:05.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-10T10:06:05.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-10T10:06:05.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-10T10:06:05.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-10T10:06:05.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-10T10:06:05.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-10T10:06:05.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-10T10:06:05.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-10T10:06:05.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-10T10:06:05.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-10T10:06:05.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-10T10:06:05.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-10T10:06:05.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-10T10:06:05.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-10T10:06:05.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-10T10:06:05.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-10T10:06:05.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-10T10:06:05.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-10T10:06:05.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-10T10:06:05.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-10T10:06:05.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-10T10:06:05.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-10T10:06:05.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-10T10:06:05.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-10T10:06:05.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-10T10:06:05.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-10T10:06:05.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-10T10:06:05.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-10T10:06:05.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-10T10:06:05.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-10T10:06:05.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-10T10:06:05.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-10T10:06:05.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-10T10:06:05.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-10T10:06:05.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-10T10:06:05.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-10T10:06:05.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-10T10:06:05.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-10T10:06:05.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-10T10:06:05.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-10T10:06:05.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-10T10:06:05.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-10T10:06:05.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-10T10:06:05.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-10T10:06:05.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-10T10:06:05.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-10T10:06:05.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-10T10:06:05.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-10T10:06:05.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-10T10:06:05.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-10T10:06:05.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-10T10:06:05.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-10T10:06:05.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-10T10:06:05.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-10T10:06:05.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-10T10:06:05.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-10T10:06:05.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-10T10:06:05.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-10T10:06:05.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-10T10:06:05.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-10T10:06:05.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-10T10:06:05.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-10T10:06:05.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-10T10:06:05.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-10T10:06:05.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-10T10:06:05.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-10T10:06:05.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-10T10:06:05.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-10T10:06:05.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-10T10:06:05.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-10T10:06:05.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-10T10:06:05.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-10T10:06:05.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-10T10:06:05.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-10T10:06:05.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-10T10:06:05.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-10T10:06:05.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-10T10:06:05.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-10T10:06:05.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-10T10:06:05.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-10T10:06:05.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-10T10:06:05.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-10T10:06:05.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-10T10:06:05.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-10T10:06:05.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-10T10:06:05.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-10T10:06:05.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-10T10:06:05.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-10T10:06:05.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-10T10:06:05.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-10T10:06:05.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-10T10:06:05.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-10T10:06:05.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-10T10:06:05.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-10T10:06:05.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-10T10:06:05.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-10T10:06:05.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-10T10:06:05.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-10T10:06:05.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-10T10:06:05.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-10T10:06:05.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-10T10:06:05.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-10T10:06:05.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-10T10:06:05.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-10T10:06:05.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-10T10:06:05.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-10T10:06:05.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-10T10:06:05.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-10T10:06:05.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-10T10:06:05.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-10T10:06:05.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-10T10:06:05.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-10T10:06:05.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-10T10:06:05.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-10T10:06:05.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-10T10:06:05.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-10T10:06:05.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-10T10:06:05.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-10T10:06:05.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-10T10:06:05.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-10T10:06:05.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-10T10:06:05.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-10T10:06:05.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-10T10:06:05.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-10T10:06:05.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-10T10:06:05.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-10T10:06:05.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-10T10:06:05.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-10T10:06:05.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-10T10:06:05.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-10T10:06:05.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-10T10:06:05.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-10T10:06:05.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-10T10:06:05.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-10T10:06:05.455 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-10T10:06:05.455 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:05.456 DEBUG:teuthology.orchestra.run.smithi195:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-10T10:06:05.483 INFO:teuthology.orchestra.run.smithi195.stdout:postinstall scriptlet (using /bin/sh): 2023-08-10T10:06:05.483 INFO:teuthology.orchestra.run.smithi195.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-10T10:06:05.483 INFO:teuthology.orchestra.run.smithi195.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:05.484 INFO:teuthology.orchestra.run.smithi195.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:05.484 INFO:teuthology.orchestra.run.smithi195.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:05.484 INFO:teuthology.orchestra.run.smithi195.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:05.484 INFO:teuthology.orchestra.run.smithi195.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:05.484 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2023-08-10T10:06:05.484 INFO:teuthology.orchestra.run.smithi195.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-10T10:06:05.484 INFO:teuthology.orchestra.run.smithi195.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-10T10:06:05.485 INFO:teuthology.orchestra.run.smithi195.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-10T10:06:05.485 INFO:teuthology.orchestra.run.smithi195.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-10T10:06:05.485 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:05.485 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2023-08-10T10:06:05.485 INFO:teuthology.orchestra.run.smithi195.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-10T10:06:05.486 INFO:teuthology.orchestra.run.smithi195.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-10T10:06:05.486 INFO:teuthology.orchestra.run.smithi195.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:05.486 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2023-08-10T10:06:05.487 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2023-08-10T10:06:05.566 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2023-08-10T10:06:05.566 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2023-08-10T10:06:05.566 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.02 2023-08-10T10:06:05.566 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 123.el8 2023-08-10T10:06:05.567 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2023-08-10T10:06:05.567 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-08-10T10:06:05.567 INFO:teuthology.orchestra.run.smithi195.stdout:Group : System Environment/Base 2023-08-10T10:06:05.567 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 9265450 2023-08-10T10:06:05.567 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2023-08-10T10:06:05.567 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-08-10T10:06:05.567 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-08-10T10:06:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-08-10T10:06:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-08-10T10:06:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Relocations : (not relocatable) 2023-08-10T10:06:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : Red Hat, Inc. 2023-08-10T10:06:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : Red Hat, Inc. 2023-08-10T10:06:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-10T10:06:05.568 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2023-08-10T10:06:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2023-08-10T10:06:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:06:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-10T10:06:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-10T10:06:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-10T10:06:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2023-08-10T10:06:05.569 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:06:05.569 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2023-08-10T10:06:05.570 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-10T10:06:05.570 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:05.571 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-10T10:06:07.980 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2023-08-10T10:06:09.859 INFO:teuthology.orchestra.run.smithi195.stderr:done 2023-08-10T10:06:09.861 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2023-08-10T10:06:09.886 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.N53vuoYqJA 2023-08-10T10:06:09.887 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.N53vuoYqJA 2023-08-10T10:06:09.958 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.N53vuoYqJA 2023-08-10T10:06:10.117 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.N53vuoYqJA is 6KB 2023-08-10T10:06:10.165 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.N53vuoYqJA 2023-08-10T10:06:10.181 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2023-08-10T10:06:10.253 INFO:teuthology.orchestra.run.smithi195.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-08-10T10:06:10.254 INFO:teuthology.orchestra.run.smithi195.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-08-10T10:06:10.254 INFO:teuthology.orchestra.run.smithi195.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc4-ga7fb1265323d.conf 2023-08-10T10:06:10.255 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:10.423 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2023-08-10T10:06:12.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-08-10T10:06:12.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:06:13.143 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-08-10T10:06:13.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-08-10T10:06:13.688 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-10T10:06:13.689 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2023-08-10T10:06:13.730 INFO:teuthology.orchestra.run.smithi157.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:13.731 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:13.731 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-10T10:06:13.731 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-08-10T10:06:14.733 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-08-10T10:06:14.733 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-10T10:06:14.870 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2023-08-10T10:06:14.903 DEBUG:teuthology.parallel:result is None 2023-08-10T10:06:40.426 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2023-08-10T10:06:40.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-08-10T10:06:40.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:06:43.707 DEBUG:teuthology.orchestra.remote:timed out 2023-08-10T10:06:55.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-10T10:06:55.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:06:56.082 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-08-10T10:06:56.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-10T10:06:56.497 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-10T10:06:56.498 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2023-08-10T10:06:56.540 INFO:teuthology.orchestra.run.smithi107.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:56.540 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:56.540 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-10T10:06:56.541 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-08-10T10:06:57.542 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-08-10T10:06:57.542 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-10T10:06:57.678 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2023-08-10T10:06:57.707 DEBUG:teuthology.parallel:result is None 2023-08-10T10:07:40.430 DEBUG:teuthology.orchestra.remote:timed out 2023-08-10T10:07:49.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-08-10T10:07:49.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:07:50.805 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-08-10T10:07:51.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-08-10T10:07:51.415 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-10T10:07:51.415 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2023-08-10T10:07:51.456 INFO:teuthology.orchestra.run.smithi195.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:51.457 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:51.457 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-10T10:07:51.457 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-08-10T10:07:52.458 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-08-10T10:07:52.459 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-10T10:07:52.604 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2023-08-10T10:07:52.631 DEBUG:teuthology.parallel:result is None 2023-08-10T10:07:52.632 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-10T10:07:52.639 INFO:teuthology.task.internal:Creating test directory... 2023-08-10T10:07:52.639 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T10:07:52.645 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T10:07:52.652 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T10:07:52.697 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-10T10:07:52.709 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-10T10:07:52.719 INFO:teuthology.task.internal:Creating archive directory... 2023-08-10T10:07:52.719 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T10:07:52.734 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T10:07:52.738 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T10:07:52.798 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-10T10:07:52.806 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-10T10:07:52.806 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T10:07:52.811 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T10:07:52.816 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T10:07:52.885 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:07:52.895 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:07:52.914 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:07:52.923 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:07:52.929 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:07:52.957 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:07:52.960 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-10T10:07:52.970 INFO:teuthology.task.internal:Configuring sudo... 2023-08-10T10:07:52.970 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T10:07:52.975 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T10:07:52.980 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T10:07:53.049 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-10T10:07:53.059 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-10T10:07:53.060 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T10:07:53.064 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T10:07:53.069 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T10:07:53.111 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:07:53.214 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:07:53.308 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:07:53.380 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:07:53.463 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:07:53.463 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T10:07:53.531 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:07:53.604 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:07:53.683 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:07:53.753 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:07:53.821 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:07:53.821 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T10:07:53.889 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:07:53.963 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:07:54.043 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:07:54.115 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:07:54.185 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:07:54.185 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T10:07:54.255 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2023-08-10T10:07:54.261 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2023-08-10T10:07:54.266 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2023-08-10T10:07:54.385 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:07:54.386 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:07:54.417 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:07:54.820 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-10T10:07:54.830 INFO:teuthology.task.internal:Starting timer... 2023-08-10T10:07:54.830 INFO:teuthology.run_tasks:Running task pcp... 2023-08-10T10:07:54.842 INFO:teuthology.run_tasks:Running task selinux... 2023-08-10T10:07:54.853 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-10T10:07:54.853 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2023-08-10T10:07:54.973 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2023-08-10T10:07:54.977 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2023-08-10T10:07:55.094 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2023-08-10T10:07:55.097 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2023-08-10T10:07:55.220 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2023-08-10T10:07:55.224 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-10T10:07:55.225 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2023-08-10T10:07:55.274 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2023-08-10T10:07:55.274 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2023-08-10T10:07:55.337 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2023-08-10T10:07:55.338 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2023-08-10T10:07:55.381 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2023-08-10T10:07:55.381 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2023-08-10T10:07:55.382 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:07:55.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:07:55.454 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:07:55.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:07:55.528 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:07:55.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:07:55.598 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-10T10:07:55.598 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2023-08-10T10:07:55.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2023-08-10T10:07:55.738 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2023-08-10T10:07:55.805 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-10T10:07:55.815 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-10T10:07:55.815 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-10T10:07:55.839 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-10T10:07:55.841 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi157.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-10T10:27:32.030 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2023-08-10T10:27:32.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-10T10:27:32.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:27:32.120 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-08-10T10:27:32.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-10T10:27:32.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-08-10T10:27:32.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:27:32.322 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-08-10T10:27:32.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-08-10T10:27:32.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-08-10T10:27:32.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:27:32.527 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-08-10T10:27:32.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-08-10T10:27:32.643 INFO:teuthology.run_tasks:Running task clock... 2023-08-10T10:27:32.655 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-10T10:27:32.656 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T10:27:32.656 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:27:32.661 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T10:27:32.661 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:27:32.666 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T10:27:32.666 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:27:32.730 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T10:27:32.736 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T10:27:32.756 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T10:27:32.765 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T10:27:32.771 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T10:27:32.790 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T10:27:32.856 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2023-08-10T10:27:32.865 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2023-08-10T10:27:32.884 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2023-08-10T10:27:32.885 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2023-08-10T10:27:32.894 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2023-08-10T10:27:32.913 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2023-08-10T10:27:32.920 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T10:27:32.928 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T10:27:32.947 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T10:27:32.955 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T10:27:32.963 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T10:27:32.981 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T10:27:33.047 INFO:teuthology.orchestra.run.smithi107.stderr:bash: ntpq: command not found 2023-08-10T10:27:33.052 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2023-08-10T10:27:33.054 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:27:33.055 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2023-08-10T10:27:33.055 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.055 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.055 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.056 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.059 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:27:33.060 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2023-08-10T10:27:33.060 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.060 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.060 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.061 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.073 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2023-08-10T10:27:33.080 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:27:33.080 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2023-08-10T10:27:33.081 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.081 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.081 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.081 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:27:33.082 INFO:teuthology.run_tasks:Running task pexec... 2023-08-10T10:27:33.091 INFO:teuthology.task.pexec:Executing custom commands... 2023-08-10T10:27:33.092 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T10:27:33.092 DEBUG:teuthology.orchestra.run.smithi107:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-08-10T10:27:33.092 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi157.front.sepia.ceph.com 2023-08-10T10:27:33.093 DEBUG:teuthology.orchestra.run.smithi157:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-08-10T10:27:33.093 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi195.front.sepia.ceph.com 2023-08-10T10:27:33.093 DEBUG:teuthology.orchestra.run.smithi195:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-08-10T10:27:33.575 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:33.576 INFO:teuthology.orchestra.run.smithi107.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:33.576 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:34.539 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:53 ago on Thu 10 Aug 2023 10:25:41 AM UTC. 2023-08-10T10:27:34.547 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:54 ago on Thu 10 Aug 2023 10:25:40 AM UTC. 2023-08-10T10:27:34.550 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:56 ago on Thu 10 Aug 2023 10:25:38 AM UTC. 2023-08-10T10:27:36.341 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-08-10T10:27:36.343 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-08-10T10:27:36.343 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2023-08-10T10:27:36.343 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-08-10T10:27:36.343 INFO:teuthology.orchestra.run.smithi195.stdout:Resetting modules: 2023-08-10T10:27:36.343 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools 2023-08-10T10:27:36.343 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:27:36.344 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-08-10T10:27:36.344 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-08-10T10:27:36.344 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:27:36.382 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2023-08-10T10:27:36.384 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2023-08-10T10:27:36.384 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2023-08-10T10:27:36.384 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2023-08-10T10:27:36.384 INFO:teuthology.orchestra.run.smithi107.stdout:Resetting modules: 2023-08-10T10:27:36.384 INFO:teuthology.orchestra.run.smithi107.stdout: container-tools 2023-08-10T10:27:36.385 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:27:36.385 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2023-08-10T10:27:36.385 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2023-08-10T10:27:36.385 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:27:36.420 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-08-10T10:27:36.421 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2023-08-10T10:27:36.421 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2023-08-10T10:27:36.421 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2023-08-10T10:27:36.422 INFO:teuthology.orchestra.run.smithi157.stdout:Resetting modules: 2023-08-10T10:27:36.422 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools 2023-08-10T10:27:36.422 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:27:36.422 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2023-08-10T10:27:36.422 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2023-08-10T10:27:36.423 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:27:37.588 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:59 ago on Thu 10 Aug 2023 10:25:38 AM UTC. 2023-08-10T10:27:37.614 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:56 ago on Thu 10 Aug 2023 10:25:41 AM UTC. 2023-08-10T10:27:37.661 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:57 ago on Thu 10 Aug 2023 10:25:40 AM UTC. 2023-08-10T10:27:40.526 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-08-10T10:27:40.551 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2023-08-10T10:27:40.643 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-08-10T10:27:41.108 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:41.135 INFO:teuthology.orchestra.run.smithi107.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:41.237 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:42.065 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:02:00 ago on Thu 10 Aug 2023 10:25:41 AM UTC. 2023-08-10T10:27:42.067 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:03 ago on Thu 10 Aug 2023 10:25:38 AM UTC. 2023-08-10T10:27:42.176 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:01 ago on Thu 10 Aug 2023 10:25:40 AM UTC. 2023-08-10T10:27:43.852 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2023-08-10T10:27:43.853 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-08-10T10:27:43.949 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================================================ 2023-08-10T10:27:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2023-08-10T10:27:43.950 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================================================ 2023-08-10T10:27:43.950 INFO:teuthology.orchestra.run.smithi107.stdout:Installing group/module packages: 2023-08-10T10:27:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-08-10T10:27:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-08-10T10:27:43.950 INFO:teuthology.orchestra.run.smithi107.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-08-10T10:27:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-08-10T10:27:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-08-10T10:27:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-08-10T10:27:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-08-10T10:27:43.951 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2023-08-10T10:27:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-08-10T10:27:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-08-10T10:27:43.951 INFO:teuthology.orchestra.run.smithi107.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-08-10T10:27:43.952 INFO:teuthology.orchestra.run.smithi107.stdout:Installing module profiles: 2023-08-10T10:27:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: container-tools/common 2023-08-10T10:27:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:27:43.952 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling module streams: 2023-08-10T10:27:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: container-tools rhel8 2023-08-10T10:27:43.952 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:27:43.952 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2023-08-10T10:27:43.953 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================================================ 2023-08-10T10:27:43.953 INFO:teuthology.orchestra.run.smithi107.stdout:Install 10 Packages 2023-08-10T10:27:43.953 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:27:43.954 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 18 M 2023-08-10T10:27:43.954 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 65 M 2023-08-10T10:27:43.954 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2023-08-10T10:27:43.954 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================================ 2023-08-10T10:27:43.954 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2023-08-10T10:27:43.954 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================================ 2023-08-10T10:27:43.955 INFO:teuthology.orchestra.run.smithi195.stdout:Installing group/module packages: 2023-08-10T10:27:43.955 INFO:teuthology.orchestra.run.smithi195.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-08-10T10:27:43.955 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-08-10T10:27:43.955 INFO:teuthology.orchestra.run.smithi195.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-08-10T10:27:43.955 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-08-10T10:27:43.955 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-08-10T10:27:43.955 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-08-10T10:27:43.956 INFO:teuthology.orchestra.run.smithi195.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-08-10T10:27:43.956 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2023-08-10T10:27:43.956 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-08-10T10:27:43.956 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-08-10T10:27:43.956 INFO:teuthology.orchestra.run.smithi195.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-08-10T10:27:43.956 INFO:teuthology.orchestra.run.smithi195.stdout:Installing module profiles: 2023-08-10T10:27:43.956 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools/common 2023-08-10T10:27:43.956 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:27:43.957 INFO:teuthology.orchestra.run.smithi195.stdout:Enabling module streams: 2023-08-10T10:27:43.957 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools rhel8 2023-08-10T10:27:43.957 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:27:43.957 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-08-10T10:27:43.957 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================================ 2023-08-10T10:27:43.957 INFO:teuthology.orchestra.run.smithi195.stdout:Install 10 Packages 2023-08-10T10:27:43.957 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:27:43.957 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 18 M 2023-08-10T10:27:43.958 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 65 M 2023-08-10T10:27:43.958 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2023-08-10T10:27:43.958 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-08-10T10:27:44.025 INFO:teuthology.orchestra.run.smithi107.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.3 MB/s | 94 kB 00:00 2023-08-10T10:27:44.042 INFO:teuthology.orchestra.run.smithi195.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 467 kB/s | 41 kB 00:00 2023-08-10T10:27:44.057 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================================ 2023-08-10T10:27:44.058 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2023-08-10T10:27:44.058 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================================ 2023-08-10T10:27:44.058 INFO:teuthology.orchestra.run.smithi157.stdout:Installing group/module packages: 2023-08-10T10:27:44.058 INFO:teuthology.orchestra.run.smithi157.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-08-10T10:27:44.058 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-08-10T10:27:44.058 INFO:teuthology.orchestra.run.smithi157.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-08-10T10:27:44.059 INFO:teuthology.orchestra.run.smithi157.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-08-10T10:27:44.059 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-08-10T10:27:44.059 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-08-10T10:27:44.059 INFO:teuthology.orchestra.run.smithi157.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-08-10T10:27:44.059 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2023-08-10T10:27:44.059 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-08-10T10:27:44.059 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-08-10T10:27:44.059 INFO:teuthology.orchestra.run.smithi157.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-08-10T10:27:44.060 INFO:teuthology.orchestra.run.smithi157.stdout:Installing module profiles: 2023-08-10T10:27:44.060 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools/common 2023-08-10T10:27:44.060 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:27:44.060 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling module streams: 2023-08-10T10:27:44.060 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools rhel8 2023-08-10T10:27:44.060 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:27:44.060 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2023-08-10T10:27:44.061 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================================ 2023-08-10T10:27:44.061 INFO:teuthology.orchestra.run.smithi157.stdout:Install 10 Packages 2023-08-10T10:27:44.061 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:27:44.062 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 18 M 2023-08-10T10:27:44.062 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 65 M 2023-08-10T10:27:44.062 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2023-08-10T10:27:44.067 INFO:teuthology.orchestra.run.smithi195.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 221 kB/s | 25 kB 00:00 2023-08-10T10:27:44.075 INFO:teuthology.orchestra.run.smithi107.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 203 kB/s | 25 kB 00:00 2023-08-10T10:27:44.093 INFO:teuthology.orchestra.run.smithi195.stdout:(3/10): udica-0.2.6-4.module+el8.6.0+16771+28df 983 kB/s | 49 kB 00:00 2023-08-10T10:27:44.101 INFO:teuthology.orchestra.run.smithi107.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 276 kB/s | 41 kB 00:00 2023-08-10T10:27:44.118 INFO:teuthology.orchestra.run.smithi195.stdout:(4/10): python3-pyxdg-0.25-16.el8.noarch.rpm 573 kB/s | 94 kB 00:00 2023-08-10T10:27:44.126 INFO:teuthology.orchestra.run.smithi107.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 492 kB/s | 49 kB 00:00 2023-08-10T10:27:44.137 INFO:teuthology.orchestra.run.smithi157.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 326 kB/s | 25 kB 00:00 2023-08-10T10:27:44.152 INFO:teuthology.orchestra.run.smithi195.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-08-10T10:27:44.162 INFO:teuthology.orchestra.run.smithi157.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 402 kB/s | 41 kB 00:00 2023-08-10T10:27:44.168 INFO:teuthology.orchestra.run.smithi107.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.5 MB/s | 524 kB 00:00 2023-08-10T10:27:44.177 INFO:teuthology.orchestra.run.smithi195.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-08-10T10:27:44.188 INFO:teuthology.orchestra.run.smithi157.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 741 kB/s | 94 kB 00:00 2023-08-10T10:27:44.193 INFO:teuthology.orchestra.run.smithi107.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.2 MB/s | 149 kB 00:00 2023-08-10T10:27:44.202 INFO:teuthology.orchestra.run.smithi195.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-08-10T10:27:44.213 INFO:teuthology.orchestra.run.smithi157.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 655 kB/s | 49 kB 00:00 2023-08-10T10:27:44.227 INFO:teuthology.orchestra.run.smithi107.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.6 MB/s | 213 kB 00:00 2023-08-10T10:27:44.255 INFO:teuthology.orchestra.run.smithi157.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.5 MB/s | 524 kB 00:00 2023-08-10T10:27:44.281 INFO:teuthology.orchestra.run.smithi157.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.2 MB/s | 149 kB 00:00 2023-08-10T10:27:44.314 INFO:teuthology.orchestra.run.smithi157.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.5 MB/s | 213 kB 00:00 2023-08-10T10:27:44.345 INFO:teuthology.orchestra.run.smithi195.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 15 MB/s | 2.2 MB 00:00 2023-08-10T10:27:44.352 INFO:teuthology.orchestra.run.smithi107.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 18 MB/s | 2.2 MB 00:00 2023-08-10T10:27:44.448 INFO:teuthology.orchestra.run.smithi157.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 16 MB/s | 2.2 MB 00:00 2023-08-10T10:27:44.487 INFO:teuthology.orchestra.run.smithi195.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 23 MB/s | 7.0 MB 00:00 2023-08-10T10:27:44.511 INFO:teuthology.orchestra.run.smithi107.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 22 MB/s | 7.0 MB 00:00 2023-08-10T10:27:44.578 INFO:teuthology.orchestra.run.smithi195.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 16 MB/s | 8.0 MB 00:00 2023-08-10T10:27:44.579 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:27:44.579 INFO:teuthology.orchestra.run.smithi195.stdout:Total 29 MB/s | 18 MB 00:00 2023-08-10T10:27:44.611 INFO:teuthology.orchestra.run.smithi107.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 16 MB/s | 8.0 MB 00:00 2023-08-10T10:27:44.611 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:27:44.612 INFO:teuthology.orchestra.run.smithi107.stdout:Total 28 MB/s | 18 MB 00:00 2023-08-10T10:27:44.615 INFO:teuthology.orchestra.run.smithi157.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 21 MB/s | 7.0 MB 00:00 2023-08-10T10:27:44.715 INFO:teuthology.orchestra.run.smithi157.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 15 MB/s | 8.0 MB 00:00 2023-08-10T10:27:44.716 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:27:44.716 INFO:teuthology.orchestra.run.smithi157.stdout:Total 28 MB/s | 18 MB 00:00 2023-08-10T10:27:44.911 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2023-08-10T10:27:44.934 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2023-08-10T10:27:44.934 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2023-08-10T10:27:44.944 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2023-08-10T10:27:44.967 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2023-08-10T10:27:44.967 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2023-08-10T10:27:45.050 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2023-08-10T10:27:45.074 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2023-08-10T10:27:45.074 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2023-08-10T10:27:45.464 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2023-08-10T10:27:45.469 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2023-08-10T10:27:45.514 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2023-08-10T10:27:45.519 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2023-08-10T10:27:45.615 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2023-08-10T10:27:45.620 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2023-08-10T10:27:46.068 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2023-08-10T10:27:46.069 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2023-08-10T10:27:46.208 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2023-08-10T10:27:46.253 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-08-10T10:27:46.296 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-08-10T10:27:46.421 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T10:27:46.432 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-08-10T10:27:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T10:27:46.651 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T10:27:46.672 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-08-10T10:27:46.716 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-08-10T10:27:46.887 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-08-10T10:27:46.896 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-08-10T10:27:46.981 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-08-10T10:27:47.166 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-08-10T10:27:47.309 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-08-10T10:27:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-08-10T10:27:47.563 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-08-10T10:27:48.172 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-08-10T10:27:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-08-10T10:27:48.413 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-08-10T10:27:49.102 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-08-10T10:27:49.145 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-08-10T10:27:49.353 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-08-10T10:27:49.377 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-08-10T10:27:49.445 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-08-10T10:27:49.560 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-08-10T10:27:49.611 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-08-10T10:27:49.663 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-08-10T10:27:49.751 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T10:27:49.847 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-08-10T10:27:49.852 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T10:27:50.088 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T10:27:50.167 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T10:27:50.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-08-10T10:27:50.168 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T10:27:50.168 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-08-10T10:27:50.168 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-08-10T10:27:50.168 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-08-10T10:27:50.168 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-08-10T10:27:50.168 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-08-10T10:27:50.169 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-08-10T10:27:50.169 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-08-10T10:27:50.242 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T10:27:50.242 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-08-10T10:27:50.242 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T10:27:50.242 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-08-10T10:27:50.242 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-08-10T10:27:50.242 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-08-10T10:27:50.243 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-08-10T10:27:50.243 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-08-10T10:27:50.243 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-08-10T10:27:50.243 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-08-10T10:27:50.464 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-08-10T10:27:50.464 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-08-10T10:27:50.464 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-08-10T10:27:50.464 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-08-10T10:27:50.465 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-08-10T10:27:50.465 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-08-10T10:27:50.465 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-08-10T10:27:50.465 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-08-10T10:27:50.465 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-08-10T10:27:50.465 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-08-10T10:27:51.561 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-08-10T10:27:51.561 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:02:10 ago on Thu 10 Aug 2023 10:25:41 AM UTC. 2023-08-10T10:27:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-08-10T10:27:51.708 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:13 ago on Thu 10 Aug 2023 10:25:38 AM UTC. 2023-08-10T10:27:51.914 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-08-10T10:27:51.914 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:11 ago on Thu 10 Aug 2023 10:25:40 AM UTC. 2023-08-10T10:27:54.831 INFO:teuthology.orchestra.run.smithi107.stdout:Installed products updated. 2023-08-10T10:27:55.027 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2023-08-10T10:27:55.029 INFO:teuthology.orchestra.run.smithi195.stdout:Installed products updated. 2023-08-10T10:27:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:27:55.082 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2023-08-10T10:27:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T10:27:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-08-10T10:27:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-08-10T10:27:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-08-10T10:27:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T10:27:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: yajl-2.1.0-10.el8.x86_64 2023-08-10T10:27:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:27:55.083 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2023-08-10T10:27:55.265 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:27:55.265 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2023-08-10T10:27:55.265 INFO:teuthology.orchestra.run.smithi195.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.265 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T10:27:55.265 INFO:teuthology.orchestra.run.smithi195.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.265 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-08-10T10:27:55.266 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-08-10T10:27:55.266 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-08-10T10:27:55.266 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.266 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.266 INFO:teuthology.orchestra.run.smithi195.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T10:27:55.266 INFO:teuthology.orchestra.run.smithi195.stdout: yajl-2.1.0-10.el8.x86_64 2023-08-10T10:27:55.266 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:27:55.266 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-08-10T10:27:55.271 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:27:55.271 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2023-08-10T10:27:55.271 INFO:teuthology.orchestra.run.smithi157.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.271 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T10:27:55.271 INFO:teuthology.orchestra.run.smithi157.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.272 INFO:teuthology.orchestra.run.smithi157.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-08-10T10:27:55.272 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-08-10T10:27:55.272 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-08-10T10:27:55.272 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.272 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-08-10T10:27:55.272 INFO:teuthology.orchestra.run.smithi157.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-08-10T10:27:55.272 INFO:teuthology.orchestra.run.smithi157.stdout: yajl-2.1.0-10.el8.x86_64 2023-08-10T10:27:55.272 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:27:55.273 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-08-10T10:27:55.329 DEBUG:teuthology.parallel:result is None 2023-08-10T10:27:55.487 DEBUG:teuthology.parallel:result is None 2023-08-10T10:27:55.501 DEBUG:teuthology.parallel:result is None 2023-08-10T10:27:55.502 INFO:teuthology.run_tasks:Running task install... 2023-08-10T10:27:55.511 DEBUG:teuthology.task.install:project ceph 2023-08-10T10:27:55.511 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}} 2023-08-10T10:27:55.511 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'} 2023-08-10T10:27:55.512 INFO:teuthology.task.install:Using flavor: default 2023-08-10T10:27:55.517 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-10T10:27:55.518 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-10T10:27:55.518 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T10:27:55.519 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:27:55.521 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T10:27:55.521 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:27:55.522 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T10:27:55.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:27:55.681 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T10:27:55.682 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T10:27:55.748 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T10:27:55.748 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T10:27:55.758 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T10:27:55.758 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T10:27:55.844 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T10:27:55.845 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:27:55.845 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T10:27:55.860 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T10:27:55.860 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:27:55.860 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T10:27:55.917 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T10:27:55.918 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T10:27:55.921 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T10:27:55.921 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:27:55.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T10:27:55.933 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T10:27:55.933 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T10:27:55.990 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T10:27:55.990 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T10:27:56.031 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T10:27:56.044 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T10:27:56.104 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T10:27:56.134 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T10:27:56.145 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T10:27:56.201 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T10:27:56.202 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2023-08-10T10:27:56.206 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2023-08-10T10:27:56.215 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2023-08-10T10:27:56.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2023-08-10T10:27:56.271 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2023-08-10T10:27:56.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2023-08-10T10:27:56.690 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:56.711 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:56.748 INFO:teuthology.orchestra.run.smithi107.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:57.061 INFO:teuthology.orchestra.run.smithi157.stdout:44 files removed 2023-08-10T10:27:57.071 INFO:teuthology.orchestra.run.smithi195.stdout:44 files removed 2023-08-10T10:27:57.077 INFO:teuthology.orchestra.run.smithi107.stdout:44 files removed 2023-08-10T10:27:57.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T10:27:57.133 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T10:27:57.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T10:27:57.599 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:57.605 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:57.630 INFO:teuthology.orchestra.run.smithi107.stdout:Updating Subscription Management repositories. 2023-08-10T10:27:58.442 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 268 kB/s | 81 kB 00:00 2023-08-10T10:27:58.486 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 193 kB/s | 81 kB 00:00 2023-08-10T10:27:58.521 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 208 kB/s | 81 kB 00:00 2023-08-10T10:27:58.811 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2023-08-10T10:27:58.835 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-08-10T10:27:58.872 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-08-10T10:27:59.103 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 6.2 kB/s | 1.5 kB 00:00 2023-08-10T10:27:59.187 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-08-10T10:27:59.274 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 4.0 kB/s | 1.5 kB 00:00 2023-08-10T10:27:59.278 INFO:teuthology.orchestra.run.smithi107.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-08-10T10:27:59.322 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-08-10T10:27:59.424 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-08-10T10:32:28.641 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 60 kB/s | 16 MB 04:29 2023-08-10T10:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 59 kB/s | 16 MB 04:31 2023-08-10T10:32:31.874 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 59 kB/s | 16 MB 04:32 2023-08-10T10:32:32.648 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 408 kB/s | 24 kB 00:00 2023-08-10T10:32:33.792 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-08-10T10:32:35.055 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 358 kB/s | 24 kB 00:00 2023-08-10T10:32:35.924 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 366 kB/s | 24 kB 00:00 2023-08-10T10:32:36.224 INFO:teuthology.orchestra.run.smithi107.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 53 MB 00:01 2023-08-10T10:32:36.968 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 49 MB/s | 47 MB 00:00 2023-08-10T10:32:42.518 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 47 MB 00:01 2023-08-10T10:32:44.841 INFO:teuthology.orchestra.run.smithi107.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 47 MB 00:01 2023-08-10T10:32:45.543 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 53 MB 00:01 2023-08-10T10:32:54.055 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:32:54.056 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:32:54.071 INFO:teuthology.orchestra.run.smithi157.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-10T10:32:54.072 INFO:teuthology.orchestra.run.smithi157.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-10T10:32:54.073 INFO:teuthology.orchestra.run.smithi157.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-10T10:32:54.075 INFO:teuthology.orchestra.run.smithi157.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T10:32:54.077 INFO:teuthology.orchestra.run.smithi157.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T10:32:54.081 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T10:32:54.082 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:32:54.221 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-08-10T10:32:54.234 INFO:teuthology.orchestra.run.smithi157.stdout:=========================================================================================================================== 2023-08-10T10:32:54.234 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2023-08-10T10:32:54.235 INFO:teuthology.orchestra.run.smithi157.stdout:=========================================================================================================================== 2023-08-10T10:32:54.235 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2023-08-10T10:32:54.235 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-10T10:32:54.235 INFO:teuthology.orchestra.run.smithi157.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-10T10:32:54.235 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T10:32:54.235 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T10:32:54.235 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T10:32:54.236 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T10:32:54.236 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T10:32:54.236 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T10:32:54.236 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T10:32:54.236 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T10:32:54.236 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T10:32:54.236 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T10:32:54.237 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T10:32:54.237 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T10:32:54.237 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T10:32:54.237 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T10:32:54.237 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T10:32:54.237 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-10T10:32:54.237 INFO:teuthology.orchestra.run.smithi157.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-10T10:32:54.238 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-10T10:32:54.238 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T10:32:54.238 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T10:32:54.238 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:32:54.238 INFO:teuthology.orchestra.run.smithi157.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-10T10:32:54.238 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-10T10:32:54.238 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-10T10:32:54.238 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-10T10:32:54.239 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-10T10:32:54.239 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-10T10:32:54.239 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T10:32:54.239 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T10:32:54.239 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T10:32:54.239 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T10:32:54.239 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T10:32:54.240 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T10:32:54.240 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T10:32:54.240 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-10T10:32:54.240 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2023-08-10T10:32:54.240 INFO:teuthology.orchestra.run.smithi157.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-10T10:32:54.240 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T10:32:54.240 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T10:32:54.240 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2023-08-10T10:32:54.241 INFO:teuthology.orchestra.run.smithi157.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-10T10:32:54.241 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T10:32:54.241 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T10:32:54.241 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T10:32:54.241 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T10:32:54.241 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T10:32:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T10:32:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T10:32:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T10:32:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-10T10:32:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T10:32:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-10T10:32:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-10T10:32:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-10T10:32:54.243 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:32:54.243 INFO:teuthology.orchestra.run.smithi157.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-10T10:32:54.243 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-10T10:32:54.243 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T10:32:54.243 INFO:teuthology.orchestra.run.smithi157.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-10T10:32:54.243 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-10T10:32:54.243 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-10T10:32:54.244 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T10:32:54.244 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-10T10:32:54.244 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T10:32:54.244 INFO:teuthology.orchestra.run.smithi157.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-10T10:32:54.244 INFO:teuthology.orchestra.run.smithi157.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-10T10:32:54.244 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T10:32:54.244 INFO:teuthology.orchestra.run.smithi157.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-10T10:32:54.245 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-10T10:32:54.245 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-10T10:32:54.245 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-10T10:32:54.245 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-10T10:32:54.245 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-10T10:32:54.245 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-10T10:32:54.246 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-10T10:32:54.246 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T10:32:54.246 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-10T10:32:54.246 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T10:32:54.246 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T10:32:54.246 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T10:32:54.246 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T10:32:54.246 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T10:32:54.247 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T10:32:54.247 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-10T10:32:54.247 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T10:32:54.247 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T10:32:54.247 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-10T10:32:54.247 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T10:32:54.247 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T10:32:54.247 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T10:32:54.248 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-10T10:32:54.248 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-10T10:32:54.248 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-10T10:32:54.248 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:32:54.248 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T10:32:54.248 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T10:32:54.248 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-10T10:32:54.249 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-10T10:32:54.249 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T10:32:54.249 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T10:32:54.249 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-10T10:32:54.249 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-10T10:32:54.249 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-10T10:32:54.249 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T10:32:54.249 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T10:32:54.250 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-10T10:32:54.250 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-10T10:32:54.250 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-10T10:32:54.250 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-10T10:32:54.250 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-10T10:32:54.250 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-10T10:32:54.250 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T10:32:54.250 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:32:54.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T10:32:54.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T10:32:54.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-10T10:32:54.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T10:32:54.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T10:32:54.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T10:32:54.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T10:32:54.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T10:32:54.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T10:32:54.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T10:32:54.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T10:32:54.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-10T10:32:54.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T10:32:54.252 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-10T10:32:54.252 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T10:32:54.253 INFO:teuthology.orchestra.run.smithi157.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-10T10:32:54.253 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-10T10:32:54.253 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-10T10:32:54.253 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling module streams: 2023-08-10T10:32:54.253 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql 10 2023-08-10T10:32:54.253 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:32:54.253 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2023-08-10T10:32:54.254 INFO:teuthology.orchestra.run.smithi157.stdout:=========================================================================================================================== 2023-08-10T10:32:54.254 INFO:teuthology.orchestra.run.smithi157.stdout:Install 128 Packages 2023-08-10T10:32:54.254 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 3 Packages 2023-08-10T10:32:54.254 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:32:54.255 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 206 M 2023-08-10T10:32:54.255 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2023-08-10T10:32:54.601 INFO:teuthology.orchestra.run.smithi157.stdout:(1/131): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 32 kB/s | 6.4 kB 00:00 2023-08-10T10:32:54.893 INFO:teuthology.orchestra.run.smithi157.stdout:(2/131): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 11 MB/s | 5.4 MB 00:00 2023-08-10T10:32:54.968 INFO:teuthology.orchestra.run.smithi157.stdout:(3/131): ceph-immutable-object-cache-18.0.0-511 2.2 MB/s | 167 kB 00:00 2023-08-10T10:32:55.110 INFO:teuthology.orchestra.run.smithi157.stdout:(4/131): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 16 MB/s | 2.3 MB 00:00 2023-08-10T10:32:55.218 INFO:teuthology.orchestra.run.smithi157.stdout:(5/131): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.3 MB/s | 849 kB 00:00 2023-08-10T10:32:55.260 INFO:teuthology.orchestra.run.smithi157.stdout:(6/131): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 10 MB/s | 1.6 MB 00:00 2023-08-10T10:32:56.169 INFO:teuthology.orchestra.run.smithi157.stdout:(7/131): ceph-osd-18.0.0-5118.ga8bf445f.el8.x86 20 MB/s | 18 MB 00:00 2023-08-10T10:32:56.427 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:32:56.428 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:32:56.443 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-10T10:32:56.444 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-10T10:32:56.446 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-10T10:32:56.447 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T10:32:56.449 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T10:32:56.453 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T10:32:56.454 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:32:56.593 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2023-08-10T10:32:56.606 INFO:teuthology.orchestra.run.smithi107.stdout:=========================================================================================================================== 2023-08-10T10:32:56.606 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2023-08-10T10:32:56.606 INFO:teuthology.orchestra.run.smithi107.stdout:=========================================================================================================================== 2023-08-10T10:32:56.607 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2023-08-10T10:32:56.607 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-10T10:32:56.607 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-10T10:32:56.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T10:32:56.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T10:32:56.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T10:32:56.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T10:32:56.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T10:32:56.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T10:32:56.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T10:32:56.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T10:32:56.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T10:32:56.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T10:32:56.609 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T10:32:56.609 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T10:32:56.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T10:32:56.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T10:32:56.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T10:32:56.609 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-10T10:32:56.609 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-10T10:32:56.610 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-10T10:32:56.610 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T10:32:56.610 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T10:32:56.610 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:32:56.610 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-10T10:32:56.610 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-10T10:32:56.610 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-10T10:32:56.611 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-10T10:32:56.611 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-10T10:32:56.611 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-10T10:32:56.611 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T10:32:56.611 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T10:32:56.612 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T10:32:56.612 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T10:32:56.612 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T10:32:56.612 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T10:32:56.612 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T10:32:56.612 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-10T10:32:56.612 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2023-08-10T10:32:56.613 INFO:teuthology.orchestra.run.smithi107.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-10T10:32:56.613 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T10:32:56.613 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T10:32:56.613 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2023-08-10T10:32:56.613 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-10T10:32:56.613 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T10:32:56.614 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T10:32:56.614 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T10:32:56.614 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T10:32:56.614 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T10:32:56.614 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T10:32:56.614 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T10:32:56.615 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T10:32:56.615 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-10T10:32:56.615 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T10:32:56.615 INFO:teuthology.orchestra.run.smithi107.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-10T10:32:56.615 INFO:teuthology.orchestra.run.smithi107.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-10T10:32:56.616 INFO:teuthology.orchestra.run.smithi107.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-10T10:32:56.616 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:32:56.616 INFO:teuthology.orchestra.run.smithi107.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-10T10:32:56.616 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-10T10:32:56.616 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T10:32:56.616 INFO:teuthology.orchestra.run.smithi107.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-10T10:32:56.616 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-10T10:32:56.617 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-10T10:32:56.617 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T10:32:56.617 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-10T10:32:56.617 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T10:32:56.617 INFO:teuthology.orchestra.run.smithi107.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-10T10:32:56.617 INFO:teuthology.orchestra.run.smithi107.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-10T10:32:56.618 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T10:32:56.618 INFO:teuthology.orchestra.run.smithi107.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-10T10:32:56.618 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-10T10:32:56.618 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-10T10:32:56.618 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-10T10:32:56.618 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-10T10:32:56.618 INFO:teuthology.orchestra.run.smithi107.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-10T10:32:56.618 INFO:teuthology.orchestra.run.smithi107.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-10T10:32:56.619 INFO:teuthology.orchestra.run.smithi107.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-10T10:32:56.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T10:32:56.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-10T10:32:56.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T10:32:56.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T10:32:56.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T10:32:56.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T10:32:56.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T10:32:56.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T10:32:56.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-10T10:32:56.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T10:32:56.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T10:32:56.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-10T10:32:56.620 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T10:32:56.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T10:32:56.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T10:32:56.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-10T10:32:56.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-10T10:32:56.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-10T10:32:56.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:32:56.621 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T10:32:56.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T10:32:56.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-10T10:32:56.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-10T10:32:56.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T10:32:56.622 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T10:32:56.623 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-10T10:32:56.623 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-10T10:32:56.623 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-10T10:32:56.623 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T10:32:56.623 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T10:32:56.623 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-10T10:32:56.624 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-10T10:32:56.624 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-10T10:32:56.624 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-10T10:32:56.624 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-10T10:32:56.624 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-10T10:32:56.624 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T10:32:56.624 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:32:56.625 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T10:32:56.625 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T10:32:56.625 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-10T10:32:56.625 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T10:32:56.625 INFO:teuthology.orchestra.run.smithi107.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T10:32:56.625 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T10:32:56.626 INFO:teuthology.orchestra.run.smithi107.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T10:32:56.626 INFO:teuthology.orchestra.run.smithi107.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T10:32:56.626 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T10:32:56.626 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T10:32:56.626 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T10:32:56.626 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-10T10:32:56.627 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T10:32:56.627 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-10T10:32:56.627 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T10:32:56.627 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-10T10:32:56.627 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-10T10:32:56.627 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-10T10:32:56.628 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling module streams: 2023-08-10T10:32:56.628 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql 10 2023-08-10T10:32:56.628 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:32:56.628 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2023-08-10T10:32:56.628 INFO:teuthology.orchestra.run.smithi107.stdout:=========================================================================================================================== 2023-08-10T10:32:56.628 INFO:teuthology.orchestra.run.smithi107.stdout:Install 128 Packages 2023-08-10T10:32:56.628 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 3 Packages 2023-08-10T10:32:56.629 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:32:56.629 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 206 M 2023-08-10T10:32:56.629 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2023-08-10T10:32:56.915 INFO:teuthology.orchestra.run.smithi107.stdout:(1/131): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-08-10T10:32:56.944 INFO:teuthology.orchestra.run.smithi157.stdout:(8/131): ceph-radosgw-18.0.0-5118.ga8bf445f.el8 17 MB/s | 14 MB 00:00 2023-08-10T10:32:57.019 INFO:teuthology.orchestra.run.smithi157.stdout:(9/131): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 2.6 MB/s | 4.6 MB 00:01 2023-08-10T10:32:57.078 INFO:teuthology.orchestra.run.smithi157.stdout:(10/131): ceph-selinux-18.0.0-5118.ga8bf445f.el 182 kB/s | 24 kB 00:00 2023-08-10T10:32:57.145 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:32:57.146 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:32:57.160 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-10T10:32:57.161 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-10T10:32:57.163 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-10T10:32:57.164 INFO:teuthology.orchestra.run.smithi195.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T10:32:57.166 INFO:teuthology.orchestra.run.smithi195.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T10:32:57.170 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T10:32:57.171 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:32:57.178 INFO:teuthology.orchestra.run.smithi157.stdout:(11/131): cephfs-mirror-18.0.0-5118.ga8bf445f.e 2.5 MB/s | 260 kB 00:00 2023-08-10T10:32:57.270 INFO:teuthology.orchestra.run.smithi157.stdout:(12/131): libcephfs-devel-18.0.0-5118.ga8bf445f 339 kB/s | 31 kB 00:00 2023-08-10T10:32:57.310 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-08-10T10:32:57.322 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================================================== 2023-08-10T10:32:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2023-08-10T10:32:57.323 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================================================== 2023-08-10T10:32:57.323 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2023-08-10T10:32:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-10T10:32:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-10T10:32:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T10:32:57.324 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T10:32:57.324 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T10:32:57.324 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T10:32:57.324 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T10:32:57.324 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T10:32:57.324 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T10:32:57.324 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T10:32:57.325 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T10:32:57.325 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T10:32:57.325 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T10:32:57.325 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T10:32:57.325 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T10:32:57.325 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T10:32:57.325 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T10:32:57.325 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-10T10:32:57.326 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-10T10:32:57.326 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-10T10:32:57.326 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T10:32:57.326 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T10:32:57.326 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:32:57.326 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-10T10:32:57.326 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-10T10:32:57.327 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-10T10:32:57.327 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-10T10:32:57.327 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-10T10:32:57.327 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-10T10:32:57.327 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T10:32:57.327 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T10:32:57.327 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T10:32:57.327 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T10:32:57.328 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T10:32:57.328 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T10:32:57.328 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T10:32:57.328 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-10T10:32:57.328 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2023-08-10T10:32:57.328 INFO:teuthology.orchestra.run.smithi195.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-10T10:32:57.328 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T10:32:57.328 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T10:32:57.329 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2023-08-10T10:32:57.329 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-10T10:32:57.329 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T10:32:57.329 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T10:32:57.329 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T10:32:57.329 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T10:32:57.329 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T10:32:57.330 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T10:32:57.330 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T10:32:57.330 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T10:32:57.330 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-10T10:32:57.330 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T10:32:57.330 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-10T10:32:57.331 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-10T10:32:57.332 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-10T10:32:57.332 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:32:57.332 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-10T10:32:57.332 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-10T10:32:57.332 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T10:32:57.332 INFO:teuthology.orchestra.run.smithi195.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-10T10:32:57.332 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-10T10:32:57.332 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-10T10:32:57.333 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T10:32:57.333 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-10T10:32:57.333 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T10:32:57.333 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-10T10:32:57.333 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-10T10:32:57.333 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T10:32:57.333 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-10T10:32:57.334 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-10T10:32:57.334 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-10T10:32:57.334 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-10T10:32:57.334 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-10T10:32:57.334 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-10T10:32:57.334 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-10T10:32:57.334 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-10T10:32:57.334 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T10:32:57.335 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-10T10:32:57.335 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T10:32:57.335 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T10:32:57.335 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T10:32:57.335 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T10:32:57.335 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T10:32:57.335 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T10:32:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-10T10:32:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T10:32:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T10:32:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-10T10:32:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T10:32:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T10:32:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T10:32:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-10T10:32:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-10T10:32:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-10T10:32:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:32:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T10:32:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T10:32:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-10T10:32:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-10T10:32:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T10:32:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T10:32:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-10T10:32:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-10T10:32:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-10T10:32:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T10:32:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T10:32:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-10T10:32:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-10T10:32:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-10T10:32:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-10T10:32:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-10T10:32:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-10T10:32:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T10:32:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-10T10:32:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T10:32:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T10:32:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-10T10:32:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T10:32:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T10:32:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T10:32:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T10:32:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T10:32:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T10:32:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T10:32:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T10:32:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-10T10:32:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T10:32:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-10T10:32:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T10:32:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-10T10:32:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-10T10:32:57.342 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-10T10:32:57.342 INFO:teuthology.orchestra.run.smithi195.stdout:Enabling module streams: 2023-08-10T10:32:57.342 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql 10 2023-08-10T10:32:57.342 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:32:57.342 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-08-10T10:32:57.342 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================================================== 2023-08-10T10:32:57.342 INFO:teuthology.orchestra.run.smithi195.stdout:Install 128 Packages 2023-08-10T10:32:57.343 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 3 Packages 2023-08-10T10:32:57.343 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:32:57.343 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 206 M 2023-08-10T10:32:57.343 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2023-08-10T10:32:57.440 INFO:teuthology.orchestra.run.smithi107.stdout:(2/131): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 6.9 MB/s | 5.4 MB 00:00 2023-08-10T10:32:57.532 INFO:teuthology.orchestra.run.smithi107.stdout:(3/131): ceph-immutable-object-cache-18.0.0-511 1.8 MB/s | 167 kB 00:00 2023-08-10T10:32:57.694 INFO:teuthology.orchestra.run.smithi195.stdout:(1/131): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-08-10T10:32:57.758 INFO:teuthology.orchestra.run.smithi107.stdout:(4/131): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.0 MB/s | 849 kB 00:00 2023-08-10T10:32:57.824 INFO:teuthology.orchestra.run.smithi107.stdout:(5/131): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 7.8 MB/s | 2.3 MB 00:00 2023-08-10T10:32:57.867 INFO:teuthology.orchestra.run.smithi157.stdout:(13/131): libcephfs2-18.0.0-5118.ga8bf445f.el8. 1.3 MB/s | 772 kB 00:00 2023-08-10T10:32:58.170 INFO:teuthology.orchestra.run.smithi157.stdout:(14/131): libcephsqlite-18.0.0-5118.ga8bf445f.e 451 kB/s | 139 kB 00:00 2023-08-10T10:32:58.346 INFO:teuthology.orchestra.run.smithi157.stdout:(15/131): librados-devel-18.0.0-5118.ga8bf445f. 795 kB/s | 139 kB 00:00 2023-08-10T10:32:58.544 INFO:teuthology.orchestra.run.smithi195.stdout:(2/131): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.0 MB/s | 849 kB 00:00 2023-08-10T10:32:58.566 INFO:teuthology.orchestra.run.smithi107.stdout:(6/131): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 6.2 MB/s | 4.6 MB 00:00 2023-08-10T10:32:58.652 INFO:teuthology.orchestra.run.smithi195.stdout:(3/131): ceph-immutable-object-cache-18.0.0-511 1.5 MB/s | 167 kB 00:00 2023-08-10T10:32:58.663 INFO:teuthology.orchestra.run.smithi157.stdout:(16/131): ceph-common-18.0.0-5118.ga8bf445f.el8 5.2 MB/s | 22 MB 00:04 2023-08-10T10:32:58.696 INFO:teuthology.orchestra.run.smithi157.stdout:(17/131): libradosstriper1-18.0.0-5118.ga8bf445 1.3 MB/s | 473 kB 00:00 2023-08-10T10:32:58.797 INFO:teuthology.orchestra.run.smithi157.stdout:(18/131): python3-ceph-argparse-18.0.0-5118.ga8 448 kB/s | 45 kB 00:00 2023-08-10T10:32:58.897 INFO:teuthology.orchestra.run.smithi157.stdout:(19/131): python3-ceph-common-18.0.0-5118.ga8bf 1.2 MB/s | 122 kB 00:00 2023-08-10T10:32:58.991 INFO:teuthology.orchestra.run.smithi107.stdout:(7/131): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 1.3 MB/s | 1.6 MB 00:01 2023-08-10T10:32:59.064 INFO:teuthology.orchestra.run.smithi157.stdout:(20/131): python3-cephfs-18.0.0-5118.ga8bf445f. 1.2 MB/s | 197 kB 00:00 2023-08-10T10:32:59.306 INFO:teuthology.orchestra.run.smithi157.stdout:(21/131): python3-rados-18.0.0-5118.ga8bf445f.e 1.5 MB/s | 371 kB 00:00 2023-08-10T10:32:59.498 INFO:teuthology.orchestra.run.smithi157.stdout:(22/131): python3-rbd-18.0.0-5118.ga8bf445f.el8 1.9 MB/s | 364 kB 00:00 2023-08-10T10:32:59.607 INFO:teuthology.orchestra.run.smithi157.stdout:(23/131): python3-rgw-18.0.0-5118.ga8bf445f.el8 985 kB/s | 107 kB 00:00 2023-08-10T10:32:59.690 INFO:teuthology.orchestra.run.smithi157.stdout:(24/131): librgw2-18.0.0-5118.ga8bf445f.el8.x86 6.6 MB/s | 6.8 MB 00:01 2023-08-10T10:32:59.715 INFO:teuthology.orchestra.run.smithi157.stdout:(25/131): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 864 kB/s | 93 kB 00:00 2023-08-10T10:33:00.219 INFO:teuthology.orchestra.run.smithi195.stdout:(4/131): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-08-10T10:33:00.233 INFO:teuthology.orchestra.run.smithi157.stdout:(26/131): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 6.5 MB/s | 3.5 MB 00:00 2023-08-10T10:33:00.258 INFO:teuthology.orchestra.run.smithi157.stdout:(27/131): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 330 kB/s | 179 kB 00:00 2023-08-10T10:33:00.325 INFO:teuthology.orchestra.run.smithi157.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5118.g 252 kB/s | 23 kB 00:00 2023-08-10T10:33:00.350 INFO:teuthology.orchestra.run.smithi157.stdout:(29/131): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 1.4 MB/s | 129 kB 00:00 2023-08-10T10:33:00.361 INFO:teuthology.orchestra.run.smithi195.stdout:(5/131): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 1.9 MB/s | 5.4 MB 00:02 2023-08-10T10:33:00.675 INFO:teuthology.orchestra.run.smithi157.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 4.9 MB/s | 1.7 MB 00:00 2023-08-10T10:33:00.776 INFO:teuthology.orchestra.run.smithi157.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5118.ga8 2.4 MB/s | 241 kB 00:00 2023-08-10T10:33:00.876 INFO:teuthology.orchestra.run.smithi157.stdout:(32/131): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 474 kB/s | 47 kB 00:00 2023-08-10T10:33:00.968 INFO:teuthology.orchestra.run.smithi157.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5118.ga 159 kB/s | 15 kB 00:00 2023-08-10T10:33:01.068 INFO:teuthology.orchestra.run.smithi157.stdout:(34/131): ceph-volume-18.0.0-5118.ga8bf445f.el8 2.5 MB/s | 258 kB 00:00 2023-08-10T10:33:01.185 INFO:teuthology.orchestra.run.smithi157.stdout:(35/131): cephadm-18.0.0-5118.ga8bf445f.el8.noa 1.4 MB/s | 168 kB 00:00 2023-08-10T10:33:01.268 INFO:teuthology.orchestra.run.smithi157.stdout:(36/131): cephfs-top-18.0.0-5118.ga8bf445f.el8. 216 kB/s | 18 kB 00:00 2023-08-10T10:33:01.269 INFO:teuthology.orchestra.run.smithi195.stdout:(6/131): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 5.1 MB/s | 4.6 MB 00:00 2023-08-10T10:33:01.353 INFO:teuthology.orchestra.run.smithi195.stdout:(7/131): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 1.4 MB/s | 1.6 MB 00:01 2023-08-10T10:33:01.533 INFO:teuthology.orchestra.run.smithi107.stdout:(8/131): ceph-osd-18.0.0-5118.ga8bf445f.el8.x86 6.0 MB/s | 18 MB 00:02 2023-08-10T10:33:01.608 INFO:teuthology.orchestra.run.smithi107.stdout:(9/131): ceph-selinux-18.0.0-5118.ga8bf445f.el8 326 kB/s | 24 kB 00:00 2023-08-10T10:33:02.709 INFO:teuthology.orchestra.run.smithi107.stdout:(10/131): ceph-common-18.0.0-5118.ga8bf445f.el8 3.7 MB/s | 22 MB 00:06 2023-08-10T10:33:02.992 INFO:teuthology.orchestra.run.smithi107.stdout:(11/131): cephfs-mirror-18.0.0-5118.ga8bf445f.e 918 kB/s | 260 kB 00:00 2023-08-10T10:33:03.034 INFO:teuthology.orchestra.run.smithi107.stdout:(12/131): libcephfs-devel-18.0.0-5118.ga8bf445f 751 kB/s | 31 kB 00:00 2023-08-10T10:33:03.153 INFO:teuthology.orchestra.run.smithi195.stdout:(8/131): ceph-osd-18.0.0-5118.ga8bf445f.el8.x86 9.4 MB/s | 18 MB 00:01 2023-08-10T10:33:03.228 INFO:teuthology.orchestra.run.smithi195.stdout:(9/131): ceph-selinux-18.0.0-5118.ga8bf445f.el8 325 kB/s | 24 kB 00:00 2023-08-10T10:33:03.321 INFO:teuthology.orchestra.run.smithi157.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 2.5 MB/s | 7.4 MB 00:02 2023-08-10T10:33:03.401 INFO:teuthology.orchestra.run.smithi107.stdout:(13/131): libcephfs2-18.0.0-5118.ga8bf445f.el8. 2.1 MB/s | 772 kB 00:00 2023-08-10T10:33:03.560 INFO:teuthology.orchestra.run.smithi107.stdout:(14/131): libcephsqlite-18.0.0-5118.ga8bf445f.e 879 kB/s | 139 kB 00:00 2023-08-10T10:33:03.718 INFO:teuthology.orchestra.run.smithi107.stdout:(15/131): librados-devel-18.0.0-5118.ga8bf445f. 878 kB/s | 139 kB 00:00 2023-08-10T10:33:04.085 INFO:teuthology.orchestra.run.smithi107.stdout:(16/131): libradosstriper1-18.0.0-5118.ga8bf445 1.3 MB/s | 473 kB 00:00 2023-08-10T10:33:05.528 INFO:teuthology.orchestra.run.smithi195.stdout:(10/131): ceph-common-18.0.0-5118.ga8bf445f.el8 2.7 MB/s | 22 MB 00:08 2023-08-10T10:33:05.678 INFO:teuthology.orchestra.run.smithi195.stdout:(11/131): cephfs-mirror-18.0.0-5118.ga8bf445f.e 1.7 MB/s | 260 kB 00:00 2023-08-10T10:33:05.770 INFO:teuthology.orchestra.run.smithi195.stdout:(12/131): libcephfs-devel-18.0.0-5118.ga8bf445f 339 kB/s | 31 kB 00:00 2023-08-10T10:33:06.104 INFO:teuthology.orchestra.run.smithi195.stdout:(13/131): libcephfs2-18.0.0-5118.ga8bf445f.el8. 2.3 MB/s | 772 kB 00:00 2023-08-10T10:33:06.213 INFO:teuthology.orchestra.run.smithi195.stdout:(14/131): libcephsqlite-18.0.0-5118.ga8bf445f.e 1.3 MB/s | 139 kB 00:00 2023-08-10T10:33:06.321 INFO:teuthology.orchestra.run.smithi195.stdout:(15/131): librados-devel-18.0.0-5118.ga8bf445f. 1.3 MB/s | 139 kB 00:00 2023-08-10T10:33:06.580 INFO:teuthology.orchestra.run.smithi195.stdout:(16/131): libradosstriper1-18.0.0-5118.ga8bf445 1.8 MB/s | 473 kB 00:00 2023-08-10T10:33:07.264 INFO:teuthology.orchestra.run.smithi195.stdout:(17/131): ceph-test-18.0.0-5118.ga8bf445f.el8.x 12 MB/s | 48 MB 00:04 2023-08-10T10:33:07.347 INFO:teuthology.orchestra.run.smithi195.stdout:(18/131): python3-ceph-argparse-18.0.0-5118.ga8 539 kB/s | 45 kB 00:00 2023-08-10T10:33:07.439 INFO:teuthology.orchestra.run.smithi195.stdout:(19/131): python3-ceph-common-18.0.0-5118.ga8bf 1.3 MB/s | 122 kB 00:00 2023-08-10T10:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout:(17/131): librgw2-18.0.0-5118.ga8bf445f.el8.x86 2.0 MB/s | 6.8 MB 00:03 2023-08-10T10:33:07.523 INFO:teuthology.orchestra.run.smithi195.stdout:(20/131): python3-cephfs-18.0.0-5118.ga8bf445f. 2.3 MB/s | 197 kB 00:00 2023-08-10T10:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout:(18/131): python3-ceph-argparse-18.0.0-5118.ga8 772 kB/s | 45 kB 00:00 2023-08-10T10:33:07.615 INFO:teuthology.orchestra.run.smithi195.stdout:(21/131): python3-rados-18.0.0-5118.ga8bf445f.e 4.0 MB/s | 371 kB 00:00 2023-08-10T10:33:07.619 INFO:teuthology.orchestra.run.smithi107.stdout:(19/131): python3-ceph-common-18.0.0-5118.ga8bf 1.3 MB/s | 122 kB 00:00 2023-08-10T10:33:07.707 INFO:teuthology.orchestra.run.smithi195.stdout:(22/131): python3-rbd-18.0.0-5118.ga8bf445f.el8 3.9 MB/s | 364 kB 00:00 2023-08-10T10:33:07.736 INFO:teuthology.orchestra.run.smithi107.stdout:(20/131): python3-cephfs-18.0.0-5118.ga8bf445f. 1.6 MB/s | 197 kB 00:00 2023-08-10T10:33:07.790 INFO:teuthology.orchestra.run.smithi195.stdout:(23/131): python3-rgw-18.0.0-5118.ga8bf445f.el8 1.3 MB/s | 107 kB 00:00 2023-08-10T10:33:07.886 INFO:teuthology.orchestra.run.smithi107.stdout:(21/131): python3-rados-18.0.0-5118.ga8bf445f.e 2.4 MB/s | 371 kB 00:00 2023-08-10T10:33:07.932 INFO:teuthology.orchestra.run.smithi195.stdout:(24/131): ceph-radosgw-18.0.0-5118.ga8bf445f.el 2.1 MB/s | 14 MB 00:06 2023-08-10T10:33:07.983 INFO:teuthology.orchestra.run.smithi195.stdout:(25/131): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 488 kB/s | 93 kB 00:00 2023-08-10T10:33:08.037 INFO:teuthology.orchestra.run.smithi107.stdout:(22/131): python3-rbd-18.0.0-5118.ga8bf445f.el8 2.4 MB/s | 364 kB 00:00 2023-08-10T10:33:08.066 INFO:teuthology.orchestra.run.smithi195.stdout:(26/131): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 2.1 MB/s | 179 kB 00:00 2023-08-10T10:33:08.103 INFO:teuthology.orchestra.run.smithi107.stdout:(23/131): python3-rgw-18.0.0-5118.ga8bf445f.el8 1.6 MB/s | 107 kB 00:00 2023-08-10T10:33:08.162 INFO:teuthology.orchestra.run.smithi107.stdout:(24/131): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.6 MB/s | 93 kB 00:00 2023-08-10T10:33:08.309 INFO:teuthology.orchestra.run.smithi195.stdout:(27/131): librgw2-18.0.0-5118.ga8bf445f.el8.x86 3.9 MB/s | 6.8 MB 00:01 2023-08-10T10:33:08.333 INFO:teuthology.orchestra.run.smithi195.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5118.g 86 kB/s | 23 kB 00:00 2023-08-10T10:33:08.417 INFO:teuthology.orchestra.run.smithi195.stdout:(29/131): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 1.2 MB/s | 129 kB 00:00 2023-08-10T10:33:08.601 INFO:teuthology.orchestra.run.smithi195.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 6.4 MB/s | 1.7 MB 00:00 2023-08-10T10:33:08.692 INFO:teuthology.orchestra.run.smithi195.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5118.ga8 2.6 MB/s | 241 kB 00:00 2023-08-10T10:33:08.776 INFO:teuthology.orchestra.run.smithi195.stdout:(32/131): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 570 kB/s | 47 kB 00:00 2023-08-10T10:33:08.851 INFO:teuthology.orchestra.run.smithi195.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5118.ga 194 kB/s | 15 kB 00:00 2023-08-10T10:33:08.921 INFO:teuthology.orchestra.run.smithi107.stdout:(25/131): ceph-radosgw-18.0.0-5118.ga8bf445f.el 1.4 MB/s | 14 MB 00:09 2023-08-10T10:33:08.985 INFO:teuthology.orchestra.run.smithi195.stdout:(34/131): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 3.4 MB/s | 3.5 MB 00:01 2023-08-10T10:33:09.010 INFO:teuthology.orchestra.run.smithi195.stdout:(35/131): ceph-volume-18.0.0-5118.ga8bf445f.el8 1.6 MB/s | 258 kB 00:00 2023-08-10T10:33:09.036 INFO:teuthology.orchestra.run.smithi195.stdout:(36/131): cephadm-18.0.0-5118.ga8bf445f.el8.noa 3.3 MB/s | 168 kB 00:00 2023-08-10T10:33:09.069 INFO:teuthology.orchestra.run.smithi195.stdout:(37/131): cephfs-top-18.0.0-5118.ga8bf445f.el8. 307 kB/s | 18 kB 00:00 2023-08-10T10:33:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:(26/131): ceph-test-18.0.0-5118.ga8bf445f.el8.x 6.2 MB/s | 48 MB 00:07 2023-08-10T10:33:09.379 INFO:teuthology.orchestra.run.smithi107.stdout:(27/131): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 391 kB/s | 179 kB 00:00 2023-08-10T10:33:09.405 INFO:teuthology.orchestra.run.smithi107.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5118.g 464 kB/s | 23 kB 00:00 2023-08-10T10:33:09.472 INFO:teuthology.orchestra.run.smithi107.stdout:(29/131): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 2.7 MB/s | 3.5 MB 00:01 2023-08-10T10:33:09.495 INFO:teuthology.orchestra.run.smithi195.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 6.9 MB/s | 7.4 MB 00:01 2023-08-10T10:33:09.529 INFO:teuthology.orchestra.run.smithi107.stdout:(30/131): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 867 kB/s | 129 kB 00:00 2023-08-10T10:33:09.656 INFO:teuthology.orchestra.run.smithi107.stdout:(31/131): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 6.8 MB/s | 1.7 MB 00:00 2023-08-10T10:33:09.689 INFO:teuthology.orchestra.run.smithi107.stdout:(32/131): ceph-mgr-modules-core-18.0.0-5118.ga8 1.5 MB/s | 241 kB 00:00 2023-08-10T10:33:09.715 INFO:teuthology.orchestra.run.smithi107.stdout:(33/131): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 811 kB/s | 47 kB 00:00 2023-08-10T10:33:09.748 INFO:teuthology.orchestra.run.smithi107.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5118.ga 249 kB/s | 15 kB 00:00 2023-08-10T10:33:09.774 INFO:teuthology.orchestra.run.smithi107.stdout:(35/131): ceph-volume-18.0.0-5118.ga8bf445f.el8 4.3 MB/s | 258 kB 00:00 2023-08-10T10:33:09.816 INFO:teuthology.orchestra.run.smithi107.stdout:(36/131): cephfs-top-18.0.0-5118.ga8bf445f.el8. 432 kB/s | 18 kB 00:00 2023-08-10T10:33:09.849 INFO:teuthology.orchestra.run.smithi107.stdout:(37/131): cephadm-18.0.0-5118.ga8bf445f.el8.noa 1.6 MB/s | 168 kB 00:00 2023-08-10T10:33:09.927 INFO:teuthology.orchestra.run.smithi157.stdout:(38/131): ceph-test-18.0.0-5118.ga8bf445f.el8.x 3.7 MB/s | 48 MB 00:12 2023-08-10T10:33:10.591 INFO:teuthology.orchestra.run.smithi107.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 6.6 MB/s | 7.4 MB 00:01 2023-08-10T10:35:15.460 INFO:teuthology.orchestra.run.smithi157.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:35:15.625 INFO:teuthology.orchestra.run.smithi157.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:14 2023-08-10T10:35:19.830 INFO:teuthology.orchestra.run.smithi157.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:35:19.874 INFO:teuthology.orchestra.run.smithi157.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 441 B/s | 59 kB 02:16 2023-08-10T10:35:22.272 INFO:teuthology.orchestra.run.smithi195.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:35:22.273 INFO:teuthology.orchestra.run.smithi195.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:35:22.273 INFO:teuthology.orchestra.run.smithi195.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:35:22.652 INFO:teuthology.orchestra.run.smithi195.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 450 B/s | 59 kB 02:13 2023-08-10T10:35:22.677 INFO:teuthology.orchestra.run.smithi195.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 577 B/s | 75 kB 02:13 2023-08-10T10:35:22.778 INFO:teuthology.orchestra.run.smithi195.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2023-08-10T10:35:22.845 INFO:teuthology.orchestra.run.smithi195.stdout:(42/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:13 2023-08-10T10:35:22.887 INFO:teuthology.orchestra.run.smithi107.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:35:22.888 INFO:teuthology.orchestra.run.smithi107.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:35:22.919 INFO:teuthology.orchestra.run.smithi195.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-08-10T10:35:22.945 INFO:teuthology.orchestra.run.smithi195.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 329 kB/s | 33 kB 00:00 2023-08-10T10:35:22.979 INFO:teuthology.orchestra.run.smithi195.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 923 kB/s | 185 kB 00:00 2023-08-10T10:35:22.990 INFO:teuthology.orchestra.run.smithi107.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 452 B/s | 59 kB 02:13 2023-08-10T10:35:23.021 INFO:teuthology.orchestra.run.smithi195.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-08-10T10:35:23.054 INFO:teuthology.orchestra.run.smithi195.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2023-08-10T10:35:23.138 INFO:teuthology.orchestra.run.smithi195.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 696 kB/s | 81 kB 00:00 2023-08-10T10:35:23.163 INFO:teuthology.orchestra.run.smithi195.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-08-10T10:35:23.173 INFO:teuthology.orchestra.run.smithi107.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:13 2023-08-10T10:35:23.188 INFO:teuthology.orchestra.run.smithi195.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2023-08-10T10:35:23.239 INFO:teuthology.orchestra.run.smithi195.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-08-10T10:35:23.289 INFO:teuthology.orchestra.run.smithi195.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 485 kB/s | 49 kB 00:00 2023-08-10T10:35:23.340 INFO:teuthology.orchestra.run.smithi195.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 586 kB/s | 59 kB 00:00 2023-08-10T10:35:23.389 INFO:teuthology.orchestra.run.smithi195.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 603 kB/s | 60 kB 00:00 2023-08-10T10:35:23.456 INFO:teuthology.orchestra.run.smithi195.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 4.0 MB/s | 1.2 MB 00:00 2023-08-10T10:35:23.482 INFO:teuthology.orchestra.run.smithi195.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-08-10T10:35:23.507 INFO:teuthology.orchestra.run.smithi195.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-08-10T10:35:23.557 INFO:teuthology.orchestra.run.smithi195.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2023-08-10T10:35:23.624 INFO:teuthology.orchestra.run.smithi195.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-08-10T10:35:23.649 INFO:teuthology.orchestra.run.smithi195.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 452 kB/s | 64 kB 00:00 2023-08-10T10:35:23.675 INFO:teuthology.orchestra.run.smithi195.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 159 kB/s | 19 kB 00:00 2023-08-10T10:35:23.725 INFO:teuthology.orchestra.run.smithi195.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 237 kB/s | 24 kB 00:00 2023-08-10T10:35:23.751 INFO:teuthology.orchestra.run.smithi195.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 289 kB/s | 29 kB 00:00 2023-08-10T10:35:23.776 INFO:teuthology.orchestra.run.smithi195.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-08-10T10:35:23.834 INFO:teuthology.orchestra.run.smithi195.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-08-10T10:35:23.860 INFO:teuthology.orchestra.run.smithi195.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-08-10T10:35:23.885 INFO:teuthology.orchestra.run.smithi195.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 562 kB/s | 61 kB 00:00 2023-08-10T10:35:23.936 INFO:teuthology.orchestra.run.smithi195.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 848 kB/s | 85 kB 00:00 2023-08-10T10:35:23.970 INFO:teuthology.orchestra.run.smithi195.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 210 kB/s | 23 kB 00:00 2023-08-10T10:35:23.994 INFO:teuthology.orchestra.run.smithi195.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 70 kB 00:00 2023-08-10T10:35:24.079 INFO:teuthology.orchestra.run.smithi157.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:35:24.092 INFO:teuthology.orchestra.run.smithi195.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.2 MB/s | 110 kB 00:00 2023-08-10T10:35:24.136 INFO:teuthology.orchestra.run.smithi195.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.2 MB/s | 54 kB 00:00 2023-08-10T10:35:24.187 INFO:teuthology.orchestra.run.smithi195.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-08-10T10:35:24.245 INFO:teuthology.orchestra.run.smithi195.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-08-10T10:35:24.295 INFO:teuthology.orchestra.run.smithi195.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 4.2 MB/s | 1.7 MB 00:00 2023-08-10T10:35:24.313 INFO:teuthology.orchestra.run.smithi195.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 581 kB/s | 39 kB 00:00 2023-08-10T10:35:24.324 INFO:teuthology.orchestra.run.smithi157.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 571 B/s | 75 kB 02:14 2023-08-10T10:35:24.374 INFO:teuthology.orchestra.run.smithi157.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-08-10T10:35:24.379 INFO:teuthology.orchestra.run.smithi195.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 8.6 MB/s | 538 kB 00:00 2023-08-10T10:35:24.413 INFO:teuthology.orchestra.run.smithi195.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 5.7 MB/s | 688 kB 00:00 2023-08-10T10:35:24.416 INFO:teuthology.orchestra.run.smithi157.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 795 kB/s | 33 kB 00:00 2023-08-10T10:35:24.438 INFO:teuthology.orchestra.run.smithi195.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-08-10T10:35:24.458 INFO:teuthology.orchestra.run.smithi157.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 391 kB/s | 16 kB 00:00 2023-08-10T10:35:24.464 INFO:teuthology.orchestra.run.smithi195.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-08-10T10:35:24.508 INFO:teuthology.orchestra.run.smithi157.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-08-10T10:35:24.514 INFO:teuthology.orchestra.run.smithi195.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 9.2 MB/s | 713 kB 00:00 2023-08-10T10:35:24.567 INFO:teuthology.orchestra.run.smithi157.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 6.5 MB/s | 384 kB 00:00 2023-08-10T10:35:24.589 INFO:teuthology.orchestra.run.smithi195.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 358 kB/s | 27 kB 00:00 2023-08-10T10:35:24.609 INFO:teuthology.orchestra.run.smithi157.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-08-10T10:35:24.648 INFO:teuthology.orchestra.run.smithi195.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2023-08-10T10:35:24.690 INFO:teuthology.orchestra.run.smithi195.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-08-10T10:35:24.692 INFO:teuthology.orchestra.run.smithi157.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-08-10T10:35:24.734 INFO:teuthology.orchestra.run.smithi157.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 422 kB/s | 18 kB 00:00 2023-08-10T10:35:24.799 INFO:teuthology.orchestra.run.smithi195.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2023-08-10T10:35:24.826 INFO:teuthology.orchestra.run.smithi157.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 13 MB/s | 1.2 MB 00:00 2023-08-10T10:35:24.849 INFO:teuthology.orchestra.run.smithi195.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-08-10T10:35:24.868 INFO:teuthology.orchestra.run.smithi157.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-08-10T10:35:24.910 INFO:teuthology.orchestra.run.smithi157.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-08-10T10:35:24.952 INFO:teuthology.orchestra.run.smithi157.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-08-10T10:35:24.994 INFO:teuthology.orchestra.run.smithi157.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 6.6 MB/s | 283 kB 00:00 2023-08-10T10:35:24.999 INFO:teuthology.orchestra.run.smithi195.stdout:(87/131): python3-scipy-1.0.0-21.module+el8.5.0 13 MB/s | 14 MB 00:01 2023-08-10T10:35:25.033 INFO:teuthology.orchestra.run.smithi195.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.2 MB/s | 225 kB 00:00 2023-08-10T10:35:25.036 INFO:teuthology.orchestra.run.smithi157.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 373 kB/s | 16 kB 00:00 2023-08-10T10:35:25.095 INFO:teuthology.orchestra.run.smithi195.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 671 kB/s | 64 kB 00:00 2023-08-10T10:35:25.112 INFO:teuthology.orchestra.run.smithi157.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 449 kB/s | 34 kB 00:00 2023-08-10T10:35:25.133 INFO:teuthology.orchestra.run.smithi195.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-08-10T10:35:25.159 INFO:teuthology.orchestra.run.smithi195.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 315 kB/s | 20 kB 00:00 2023-08-10T10:35:25.162 INFO:teuthology.orchestra.run.smithi157.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-08-10T10:35:25.185 INFO:teuthology.orchestra.run.smithi195.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-08-10T10:35:25.204 INFO:teuthology.orchestra.run.smithi157.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.5 MB/s | 64 kB 00:00 2023-08-10T10:35:25.245 INFO:teuthology.orchestra.run.smithi157.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 450 kB/s | 19 kB 00:00 2023-08-10T10:35:25.260 INFO:teuthology.orchestra.run.smithi195.stdout:(93/131): python3-numpy-1.14.3-10.el8.x86_64.rp 6.6 MB/s | 3.7 MB 00:00 2023-08-10T10:35:25.285 INFO:teuthology.orchestra.run.smithi195.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2023-08-10T10:35:25.318 INFO:teuthology.orchestra.run.smithi195.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-08-10T10:35:25.360 INFO:teuthology.orchestra.run.smithi195.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-08-10T10:35:25.411 INFO:teuthology.orchestra.run.smithi195.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-08-10T10:35:25.545 INFO:teuthology.orchestra.run.smithi195.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 14 MB/s | 4.9 MB 00:00 2023-08-10T10:35:25.579 INFO:teuthology.orchestra.run.smithi157.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 72 kB/s | 24 kB 00:00 2023-08-10T10:35:25.628 INFO:teuthology.orchestra.run.smithi195.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-08-10T10:35:25.638 INFO:teuthology.orchestra.run.smithi157.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 503 kB/s | 29 kB 00:00 2023-08-10T10:35:25.670 INFO:teuthology.orchestra.run.smithi195.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-08-10T10:35:25.697 INFO:teuthology.orchestra.run.smithi157.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 472 kB/s | 27 kB 00:00 2023-08-10T10:35:25.712 INFO:teuthology.orchestra.run.smithi195.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-08-10T10:35:25.762 INFO:teuthology.orchestra.run.smithi195.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-08-10T10:35:25.763 INFO:teuthology.orchestra.run.smithi157.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 3.8 MB/s | 255 kB 00:00 2023-08-10T10:35:25.787 INFO:teuthology.orchestra.run.smithi195.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.6 MB/s | 200 kB 00:00 2023-08-10T10:35:25.813 INFO:teuthology.orchestra.run.smithi195.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 851 kB/s | 43 kB 00:00 2023-08-10T10:35:25.830 INFO:teuthology.orchestra.run.smithi157.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-08-10T10:35:25.838 INFO:teuthology.orchestra.run.smithi195.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-08-10T10:35:25.863 INFO:teuthology.orchestra.run.smithi195.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 954 kB/s | 48 kB 00:00 2023-08-10T10:35:25.889 INFO:teuthology.orchestra.run.smithi195.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-08-10T10:35:25.914 INFO:teuthology.orchestra.run.smithi195.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 855 kB/s | 43 kB 00:00 2023-08-10T10:35:25.931 INFO:teuthology.orchestra.run.smithi157.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 612 kB/s | 61 kB 00:00 2023-08-10T10:35:25.990 INFO:teuthology.orchestra.run.smithi195.stdout:(109/131): postgresql-server-10.21-2.module+el8 8.8 MB/s | 5.1 MB 00:00 2023-08-10T10:35:26.006 INFO:teuthology.orchestra.run.smithi157.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-08-10T10:35:26.014 INFO:teuthology.orchestra.run.smithi195.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 870 kB/s | 109 kB 00:00 2023-08-10T10:35:26.074 INFO:teuthology.orchestra.run.smithi195.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-08-10T10:35:26.090 INFO:teuthology.orchestra.run.smithi157.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 275 kB/s | 23 kB 00:00 2023-08-10T10:35:26.107 INFO:teuthology.orchestra.run.smithi195.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 203 kB/s | 19 kB 00:00 2023-08-10T10:35:26.132 INFO:teuthology.orchestra.run.smithi195.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.7 MB/s | 155 kB 00:00 2023-08-10T10:35:26.165 INFO:teuthology.orchestra.run.smithi195.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.1 MB/s | 560 kB 00:00 2023-08-10T10:35:26.191 INFO:teuthology.orchestra.run.smithi195.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 306 kB/s | 18 kB 00:00 2023-08-10T10:35:26.224 INFO:teuthology.orchestra.run.smithi195.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.7 MB/s | 559 kB 00:00 2023-08-10T10:35:26.258 INFO:teuthology.orchestra.run.smithi195.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-08-10T10:35:26.283 INFO:teuthology.orchestra.run.smithi195.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-08-10T10:35:26.290 INFO:teuthology.orchestra.run.smithi157.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 8.7 MB/s | 1.7 MB 00:00 2023-08-10T10:35:26.309 INFO:teuthology.orchestra.run.smithi195.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-08-10T10:35:26.334 INFO:teuthology.orchestra.run.smithi195.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-08-10T10:35:26.358 INFO:teuthology.orchestra.run.smithi157.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 70 kB 00:00 2023-08-10T10:35:26.359 INFO:teuthology.orchestra.run.smithi195.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-08-10T10:35:26.385 INFO:teuthology.orchestra.run.smithi195.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-08-10T10:35:26.410 INFO:teuthology.orchestra.run.smithi195.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-08-10T10:35:26.416 INFO:teuthology.orchestra.run.smithi157.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 817 kB/s | 47 kB 00:00 2023-08-10T10:35:26.435 INFO:teuthology.orchestra.run.smithi195.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 771 kB/s | 39 kB 00:00 2023-08-10T10:35:26.458 INFO:teuthology.orchestra.run.smithi157.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-08-10T10:35:26.478 INFO:teuthology.orchestra.run.smithi195.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-08-10T10:35:26.491 INFO:teuthology.orchestra.run.smithi157.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2023-08-10T10:35:26.508 INFO:teuthology.orchestra.run.smithi195.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-08-10T10:35:26.528 INFO:teuthology.orchestra.run.smithi195.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-08-10T10:35:26.533 INFO:teuthology.orchestra.run.smithi157.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-08-10T10:35:26.566 INFO:teuthology.orchestra.run.smithi157.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.4 MB/s | 48 kB 00:00 2023-08-10T10:35:26.568 INFO:teuthology.orchestra.run.smithi107.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:35:26.609 INFO:teuthology.orchestra.run.smithi157.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-08-10T10:35:26.634 INFO:teuthology.orchestra.run.smithi157.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.7 MB/s | 43 kB 00:00 2023-08-10T10:35:26.636 INFO:teuthology.orchestra.run.smithi195.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.6 MB/s | 2.3 MB 00:00 2023-08-10T10:35:26.676 INFO:teuthology.orchestra.run.smithi157.stdout:(77/131): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2023-08-10T10:35:26.704 INFO:teuthology.orchestra.run.smithi195.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-08-10T10:35:26.718 INFO:teuthology.orchestra.run.smithi157.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-08-10T10:35:26.810 INFO:teuthology.orchestra.run.smithi157.stdout:(79/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.0 MB/s | 560 kB 00:00 2023-08-10T10:35:26.835 INFO:teuthology.orchestra.run.smithi157.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 748 kB/s | 19 kB 00:00 2023-08-10T10:35:26.877 INFO:teuthology.orchestra.run.smithi157.stdout:(81/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.7 MB/s | 155 kB 00:00 2023-08-10T10:35:26.927 INFO:teuthology.orchestra.run.smithi157.stdout:(82/131): python3-cryptography-3.2.1-5.el8.x86_ 11 MB/s | 559 kB 00:00 2023-08-10T10:35:26.961 INFO:teuthology.orchestra.run.smithi157.stdout:(83/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 540 kB/s | 18 kB 00:00 2023-08-10T10:35:27.003 INFO:teuthology.orchestra.run.smithi195.stdout:(130/131): librados2-18.0.0-5118.ga8bf445f.el8. 7.4 MB/s | 3.7 MB 00:00 2023-08-10T10:35:27.011 INFO:teuthology.orchestra.run.smithi157.stdout:(84/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-08-10T10:35:27.023 INFO:teuthology.orchestra.run.smithi107.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 563 B/s | 75 kB 02:16 2023-08-10T10:35:27.053 INFO:teuthology.orchestra.run.smithi157.stdout:(85/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2023-08-10T10:35:27.153 INFO:teuthology.orchestra.run.smithi157.stdout:(86/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 23 MB/s | 2.3 MB 00:00 2023-08-10T10:35:27.212 INFO:teuthology.orchestra.run.smithi157.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-08-10T10:35:27.240 INFO:teuthology.orchestra.run.smithi107.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 855 kB/s | 185 kB 00:00 2023-08-10T10:35:27.254 INFO:teuthology.orchestra.run.smithi157.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-08-10T10:35:27.287 INFO:teuthology.orchestra.run.smithi157.stdout:(89/131): elfutils-libelf-devel-0.186-1.el8.x86 1.8 MB/s | 60 kB 00:00 2023-08-10T10:35:27.321 INFO:teuthology.orchestra.run.smithi157.stdout:(90/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.9 MB/s | 98 kB 00:00 2023-08-10T10:35:27.355 INFO:teuthology.orchestra.run.smithi157.stdout:(91/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2023-08-10T10:35:27.356 INFO:teuthology.orchestra.run.smithi107.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 283 kB/s | 33 kB 00:00 2023-08-10T10:35:27.388 INFO:teuthology.orchestra.run.smithi157.stdout:(92/131): libcom_err-devel-1.45.6-4.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-08-10T10:35:27.438 INFO:teuthology.orchestra.run.smithi157.stdout:(93/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 13 MB/s | 644 kB 00:00 2023-08-10T10:35:27.471 INFO:teuthology.orchestra.run.smithi195.stdout:(131/131): librbd1-18.0.0-5118.ga8bf445f.el8.x8 3.9 MB/s | 3.6 MB 00:00 2023-08-10T10:35:27.473 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:35:27.473 INFO:teuthology.orchestra.run.smithi195.stdout:Total 1.4 MB/s | 206 MB 02:30 2023-08-10T10:35:27.480 INFO:teuthology.orchestra.run.smithi157.stdout:(94/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 171 kB 00:00 2023-08-10T10:35:27.522 INFO:teuthology.orchestra.run.smithi157.stdout:(95/131): NetworkManager-initscripts-updown-1.3 3.2 MB/s | 138 kB 00:00 2023-08-10T10:35:27.557 INFO:teuthology.orchestra.run.smithi107.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 81 kB/s | 16 kB 00:00 2023-08-10T10:35:27.607 INFO:teuthology.orchestra.run.smithi107.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-08-10T10:35:27.674 INFO:teuthology.orchestra.run.smithi107.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.7 MB/s | 384 kB 00:00 2023-08-10T10:35:27.716 INFO:teuthology.orchestra.run.smithi107.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-08-10T10:35:27.758 INFO:teuthology.orchestra.run.smithi107.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 267 kB/s | 11 kB 00:00 2023-08-10T10:35:27.800 INFO:teuthology.orchestra.run.smithi107.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 423 kB/s | 18 kB 00:00 2023-08-10T10:35:27.856 INFO:teuthology.orchestra.run.smithi157.stdout:(96/131): python3-scipy-1.0.0-21.module+el8.5.0 41 MB/s | 14 MB 00:00 2023-08-10T10:35:27.875 INFO:teuthology.orchestra.run.smithi107.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 16 MB/s | 1.2 MB 00:00 2023-08-10T10:35:27.898 INFO:teuthology.orchestra.run.smithi157.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-08-10T10:35:27.940 INFO:teuthology.orchestra.run.smithi157.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-08-10T10:35:27.959 INFO:teuthology.orchestra.run.smithi107.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 585 kB/s | 49 kB 00:00 2023-08-10T10:35:27.982 INFO:teuthology.orchestra.run.smithi157.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.0 MB/s | 259 kB 00:00 2023-08-10T10:35:28.000 INFO:teuthology.orchestra.run.smithi107.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-08-10T10:35:28.043 INFO:teuthology.orchestra.run.smithi107.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-08-10T10:35:28.057 INFO:teuthology.orchestra.run.smithi157.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-08-10T10:35:28.091 INFO:teuthology.orchestra.run.smithi157.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-08-10T10:35:28.150 INFO:teuthology.orchestra.run.smithi157.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-08-10T10:35:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 11 MB/s | 538 kB 00:00 2023-08-10T10:35:28.242 INFO:teuthology.orchestra.run.smithi157.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-08-10T10:35:28.283 INFO:teuthology.orchestra.run.smithi157.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-08-10T10:35:28.334 INFO:teuthology.orchestra.run.smithi157.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-08-10T10:35:28.501 INFO:teuthology.orchestra.run.smithi157.stdout:(107/131): python3-babel-2.5.1-7.el8.noarch.rpm 29 MB/s | 4.8 MB 00:00 2023-08-10T10:35:28.536 INFO:teuthology.orchestra.run.smithi157.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 801 kB/s | 27 kB 00:00 2023-08-10T10:35:28.576 INFO:teuthology.orchestra.run.smithi157.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-08-10T10:35:28.610 INFO:teuthology.orchestra.run.smithi107.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 499 kB/s | 283 kB 00:00 2023-08-10T10:35:28.610 INFO:teuthology.orchestra.run.smithi157.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-08-10T10:35:28.652 INFO:teuthology.orchestra.run.smithi107.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 374 kB/s | 16 kB 00:00 2023-08-10T10:35:28.694 INFO:teuthology.orchestra.run.smithi107.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 810 kB/s | 34 kB 00:00 2023-08-10T10:35:28.727 INFO:teuthology.orchestra.run.smithi157.stdout:(111/131): python3-numpy-1.14.3-10.el8.x86_64.r 32 MB/s | 3.7 MB 00:00 2023-08-10T10:35:28.736 INFO:teuthology.orchestra.run.smithi107.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 4.6 MB/s | 196 kB 00:00 2023-08-10T10:35:28.769 INFO:teuthology.orchestra.run.smithi157.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-08-10T10:35:28.778 INFO:teuthology.orchestra.run.smithi107.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.5 MB/s | 64 kB 00:00 2023-08-10T10:35:28.811 INFO:teuthology.orchestra.run.smithi157.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-08-10T10:35:28.820 INFO:teuthology.orchestra.run.smithi107.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 449 kB/s | 19 kB 00:00 2023-08-10T10:35:28.862 INFO:teuthology.orchestra.run.smithi107.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 575 kB/s | 24 kB 00:00 2023-08-10T10:35:28.878 INFO:teuthology.orchestra.run.smithi157.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 962 kB/s | 64 kB 00:00 2023-08-10T10:35:28.911 INFO:teuthology.orchestra.run.smithi157.stdout:(115/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.7 MB/s | 126 kB 00:00 2023-08-10T10:35:28.929 INFO:teuthology.orchestra.run.smithi107.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 438 kB/s | 29 kB 00:00 2023-08-10T10:35:28.936 INFO:teuthology.orchestra.run.smithi157.stdout:(116/131): python3-jsonpointer-1.10-11.el8.noar 800 kB/s | 20 kB 00:00 2023-08-10T10:35:28.962 INFO:teuthology.orchestra.run.smithi157.stdout:(117/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 4.0 MB/s | 103 kB 00:00 2023-08-10T10:35:29.012 INFO:teuthology.orchestra.run.smithi157.stdout:(118/131): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-08-10T10:35:29.116 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2023-08-10T10:35:29.137 INFO:teuthology.orchestra.run.smithi107.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 132 kB/s | 27 kB 00:00 2023-08-10T10:35:29.146 INFO:teuthology.orchestra.run.smithi157.stdout:(119/131): openblas-threads-0.3.15-3.el8.x86_64 36 MB/s | 4.9 MB 00:00 2023-08-10T10:35:29.179 INFO:teuthology.orchestra.run.smithi107.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 6.0 MB/s | 255 kB 00:00 2023-08-10T10:35:29.187 INFO:teuthology.orchestra.run.smithi157.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-08-10T10:35:29.221 INFO:teuthology.orchestra.run.smithi107.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 5.9 MB/s | 251 kB 00:00 2023-08-10T10:35:29.250 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2023-08-10T10:35:29.251 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2023-08-10T10:35:29.263 INFO:teuthology.orchestra.run.smithi107.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-08-10T10:35:29.305 INFO:teuthology.orchestra.run.smithi107.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2023-08-10T10:35:29.330 INFO:teuthology.orchestra.run.smithi157.stdout:(121/131): openblas-0.3.15-3.el8.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2023-08-10T10:35:29.347 INFO:teuthology.orchestra.run.smithi107.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 554 kB/s | 23 kB 00:00 2023-08-10T10:35:29.371 INFO:teuthology.orchestra.run.smithi157.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-08-10T10:35:29.413 INFO:teuthology.orchestra.run.smithi157.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.2 MB/s | 354 kB 00:00 2023-08-10T10:35:29.430 INFO:teuthology.orchestra.run.smithi107.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2023-08-10T10:35:29.456 INFO:teuthology.orchestra.run.smithi107.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-08-10T10:35:29.506 INFO:teuthology.orchestra.run.smithi107.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 938 kB/s | 47 kB 00:00 2023-08-10T10:35:29.548 INFO:teuthology.orchestra.run.smithi107.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-08-10T10:35:29.555 INFO:teuthology.orchestra.run.smithi157.stdout:(124/131): postgresql-server-10.21-2.module+el8 36 MB/s | 5.1 MB 00:00 2023-08-10T10:35:29.573 INFO:teuthology.orchestra.run.smithi107.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2023-08-10T10:35:29.614 INFO:teuthology.orchestra.run.smithi157.stdout:(125/131): postgresql-contrib-10.21-2.module+el 14 MB/s | 808 kB 00:00 2023-08-10T10:35:29.615 INFO:teuthology.orchestra.run.smithi107.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-08-10T10:35:29.649 INFO:teuthology.orchestra.run.smithi107.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.4 MB/s | 48 kB 00:00 2023-08-10T10:35:29.691 INFO:teuthology.orchestra.run.smithi107.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.1 MB/s | 87 kB 00:00 2023-08-10T10:35:29.714 INFO:teuthology.orchestra.run.smithi157.stdout:(126/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-08-10T10:35:29.716 INFO:teuthology.orchestra.run.smithi107.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.7 MB/s | 43 kB 00:00 2023-08-10T10:35:29.758 INFO:teuthology.orchestra.run.smithi107.stdout:(77/131): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2023-08-10T10:35:29.800 INFO:teuthology.orchestra.run.smithi107.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-08-10T10:35:29.885 INFO:teuthology.orchestra.run.smithi107.stdout:(79/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.5 MB/s | 560 kB 00:00 2023-08-10T10:35:29.926 INFO:teuthology.orchestra.run.smithi107.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 464 kB/s | 19 kB 00:00 2023-08-10T10:35:29.968 INFO:teuthology.orchestra.run.smithi107.stdout:(81/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-08-10T10:35:30.018 INFO:teuthology.orchestra.run.smithi107.stdout:(82/131): python3-cryptography-3.2.1-5.el8.x86_ 11 MB/s | 559 kB 00:00 2023-08-10T10:35:30.052 INFO:teuthology.orchestra.run.smithi107.stdout:(83/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 537 kB/s | 18 kB 00:00 2023-08-10T10:35:30.110 INFO:teuthology.orchestra.run.smithi107.stdout:(84/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-08-10T10:35:30.152 INFO:teuthology.orchestra.run.smithi107.stdout:(85/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2023-08-10T10:35:30.269 INFO:teuthology.orchestra.run.smithi107.stdout:(86/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 20 MB/s | 2.3 MB 00:00 2023-08-10T10:35:30.311 INFO:teuthology.orchestra.run.smithi107.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-08-10T10:35:30.382 INFO:teuthology.orchestra.run.smithi107.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-08-10T10:35:30.420 INFO:teuthology.orchestra.run.smithi107.stdout:(89/131): elfutils-libelf-devel-0.186-1.el8.x86 1.5 MB/s | 60 kB 00:00 2023-08-10T10:35:30.462 INFO:teuthology.orchestra.run.smithi107.stdout:(90/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.3 MB/s | 98 kB 00:00 2023-08-10T10:35:30.496 INFO:teuthology.orchestra.run.smithi107.stdout:(91/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2023-08-10T10:35:30.529 INFO:teuthology.orchestra.run.smithi107.stdout:(92/131): libcom_err-devel-1.45.6-4.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-08-10T10:35:30.579 INFO:teuthology.orchestra.run.smithi107.stdout:(93/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 13 MB/s | 644 kB 00:00 2023-08-10T10:35:30.598 INFO:teuthology.orchestra.run.smithi157.stdout:(127/131): librados2-18.0.0-5118.ga8bf445f.el8. 4.2 MB/s | 3.7 MB 00:00 2023-08-10T10:35:30.621 INFO:teuthology.orchestra.run.smithi107.stdout:(94/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 171 kB 00:00 2023-08-10T10:35:30.663 INFO:teuthology.orchestra.run.smithi107.stdout:(95/131): NetworkManager-initscripts-updown-1.3 3.2 MB/s | 138 kB 00:00 2023-08-10T10:35:30.807 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2023-08-10T10:35:30.812 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2023-08-10T10:35:30.980 INFO:teuthology.orchestra.run.smithi107.stdout:(96/131): python3-scipy-1.0.0-21.module+el8.5.0 43 MB/s | 14 MB 00:00 2023-08-10T10:35:30.998 INFO:teuthology.orchestra.run.smithi157.stdout:(128/131): librbd1-18.0.0-5118.ga8bf445f.el8.x8 9.1 MB/s | 3.6 MB 00:00 2023-08-10T10:35:31.022 INFO:teuthology.orchestra.run.smithi107.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-08-10T10:35:31.056 INFO:teuthology.orchestra.run.smithi107.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-08-10T10:35:31.057 INFO:teuthology.orchestra.run.smithi157.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-08-10T10:35:31.106 INFO:teuthology.orchestra.run.smithi107.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-08-10T10:35:31.148 INFO:teuthology.orchestra.run.smithi107.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-08-10T10:35:31.182 INFO:teuthology.orchestra.run.smithi107.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-08-10T10:35:31.241 INFO:teuthology.orchestra.run.smithi107.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-08-10T10:35:31.282 INFO:teuthology.orchestra.run.smithi107.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 13 MB/s | 538 kB 00:00 2023-08-10T10:35:31.349 INFO:teuthology.orchestra.run.smithi107.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-08-10T10:35:31.391 INFO:teuthology.orchestra.run.smithi107.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-08-10T10:35:31.441 INFO:teuthology.orchestra.run.smithi107.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-08-10T10:35:31.592 INFO:teuthology.orchestra.run.smithi107.stdout:(107/131): python3-babel-2.5.1-7.el8.noarch.rpm 32 MB/s | 4.8 MB 00:00 2023-08-10T10:35:31.625 INFO:teuthology.orchestra.run.smithi107.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 802 kB/s | 27 kB 00:00 2023-08-10T10:35:31.667 INFO:teuthology.orchestra.run.smithi107.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-08-10T10:35:31.701 INFO:teuthology.orchestra.run.smithi107.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-08-10T10:35:31.852 INFO:teuthology.orchestra.run.smithi107.stdout:(111/131): python3-numpy-1.14.3-10.el8.x86_64.r 25 MB/s | 3.7 MB 00:00 2023-08-10T10:35:31.902 INFO:teuthology.orchestra.run.smithi107.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 8.9 MB/s | 457 kB 00:00 2023-08-10T10:35:31.944 INFO:teuthology.orchestra.run.smithi107.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-08-10T10:35:31.986 INFO:teuthology.orchestra.run.smithi107.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-08-10T10:35:32.036 INFO:teuthology.orchestra.run.smithi107.stdout:(115/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-08-10T10:35:32.070 INFO:teuthology.orchestra.run.smithi107.stdout:(116/131): python3-jsonpointer-1.10-11.el8.noar 598 kB/s | 20 kB 00:00 2023-08-10T10:35:32.111 INFO:teuthology.orchestra.run.smithi107.stdout:(117/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-08-10T10:35:32.162 INFO:teuthology.orchestra.run.smithi107.stdout:(118/131): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-08-10T10:35:32.354 INFO:teuthology.orchestra.run.smithi107.stdout:(119/131): openblas-threads-0.3.15-3.el8.x86_64 25 MB/s | 4.9 MB 00:00 2023-08-10T10:35:32.404 INFO:teuthology.orchestra.run.smithi107.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-08-10T10:35:32.538 INFO:teuthology.orchestra.run.smithi107.stdout:(121/131): openblas-0.3.15-3.el8.x86_64.rpm 35 MB/s | 4.7 MB 00:00 2023-08-10T10:35:32.579 INFO:teuthology.orchestra.run.smithi107.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-08-10T10:35:32.630 INFO:teuthology.orchestra.run.smithi107.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-08-10T10:35:32.801 INFO:teuthology.orchestra.run.smithi107.stdout:(124/131): postgresql-server-10.21-2.module+el8 30 MB/s | 5.1 MB 00:00 2023-08-10T10:35:32.855 INFO:teuthology.orchestra.run.smithi107.stdout:(125/131): postgresql-contrib-10.21-2.module+el 15 MB/s | 808 kB 00:00 2023-08-10T10:35:32.922 INFO:teuthology.orchestra.run.smithi107.stdout:(126/131): postgresql-10.21-2.module+el8.6.0+15 23 MB/s | 1.5 MB 00:00 2023-08-10T10:35:33.489 INFO:teuthology.orchestra.run.smithi107.stdout:(127/131): librados2-18.0.0-5118.ga8bf445f.el8. 6.5 MB/s | 3.7 MB 00:00 2023-08-10T10:35:33.715 INFO:teuthology.orchestra.run.smithi107.stdout:(128/131): librbd1-18.0.0-5118.ga8bf445f.el8.x8 16 MB/s | 3.6 MB 00:00 2023-08-10T10:35:33.798 INFO:teuthology.orchestra.run.smithi107.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 9.4 MB/s | 798 kB 00:00 2023-08-10T10:35:35.885 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2023-08-10T10:35:36.123 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-10T10:35:36.300 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-10T10:35:36.518 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-10T10:35:36.683 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T10:35:36.811 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-10T10:35:37.058 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T10:35:37.525 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-10T10:35:37.749 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:35:38.210 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:35:38.374 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:35:38.562 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:35:38.749 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:35:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:35:39.071 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T10:35:39.316 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-10T10:35:39.579 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-10T10:35:39.992 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-10T10:35:40.229 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-10T10:35:40.374 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:35:40.531 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:35:40.682 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:35:40.782 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:35:40.907 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T10:35:41.105 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-10T10:35:41.273 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T10:35:41.974 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-10T10:35:42.165 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T10:35:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-10T10:35:43.065 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T10:35:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-10T10:35:44.198 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-10T10:35:44.450 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-10T10:35:44.663 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-10T10:35:44.874 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-10T10:35:45.151 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-10T10:35:45.419 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-10T10:35:45.605 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 26/134 2023-08-10T10:35:45.745 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 27/134 2023-08-10T10:35:46.822 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 28/134 2023-08-10T10:35:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-10T10:35:47.491 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-10T10:35:47.796 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-10T10:35:48.022 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T10:35:50.128 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-10T10:35:50.531 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-10T10:35:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-10T10:35:51.004 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-10T10:35:51.214 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 36/134 2023-08-10T10:35:51.477 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 37/134 2023-08-10T10:35:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-10T10:35:51.817 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-10T10:35:52.075 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-10T10:35:52.236 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-10T10:35:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-10T10:35:52.727 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-10T10:35:53.185 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-10T10:35:53.605 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-10T10:35:53.795 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-10T10:35:54.085 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-10T10:35:54.307 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-10T10:35:54.676 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-10T10:35:54.923 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-10T10:35:55.100 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-10T10:35:55.323 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-10T10:35:55.537 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-10T10:35:55.701 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-10T10:35:56.071 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-10T10:35:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-10T10:35:56.596 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-10T10:35:56.821 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-10T10:35:57.022 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-10T10:35:57.199 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-10T10:35:57.412 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T10:35:57.493 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-10T10:35:57.751 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-10T10:35:58.010 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-10T10:35:58.221 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T10:35:58.304 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-10T10:35:58.548 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-10T10:35:58.757 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-10T10:35:58.972 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-10T10:35:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-10T10:35:59.454 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-10T10:35:59.654 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-10T10:35:59.859 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-10T10:36:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-10T10:36:00.219 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-10T10:36:00.488 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-10T10:36:00.677 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-10T10:36:00.891 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-10T10:36:01.045 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-10T10:36:01.287 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-10T10:36:01.527 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-10T10:36:01.737 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-10T10:36:02.064 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-10T10:36:02.330 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-10T10:36:02.506 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-10T10:36:02.730 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-10T10:36:04.104 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-10T10:36:04.426 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-10T10:36:04.719 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-10T10:36:05.130 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-10T10:36:05.487 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-10T10:36:05.698 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-10T10:36:06.608 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-10T10:36:06.819 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:36:06.898 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 93/134 2023-08-10T10:36:12.161 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:36:12.403 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:36:13.101 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:36:13.405 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:36:13.727 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:36:14.502 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:36:34.653 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:36:34.654 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2023-08-10T10:36:34.654 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2023-08-10T10:36:34.655 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2023-08-10T10:36:34.655 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /run 2023-08-10T10:36:34.655 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2023-08-10T10:36:34.656 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2023-08-10T10:36:34.656 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2023-08-10T10:36:34.656 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2023-08-10T10:36:34.656 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2023-08-10T10:36:34.657 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:36:35.049 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:36:36.805 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:36:37.001 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:36:37.271 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:36:37.468 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:36:37.995 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:36:38.232 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:36:38.274 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:36:41.142 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:36:41.337 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:36:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 102/134 2023-08-10T10:36:41.721 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 103/134 2023-08-10T10:36:41.923 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:36:42.188 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:36:42.383 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:36:43.507 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:36:43.722 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:36:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:36:44.244 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 107/134 2023-08-10T10:36:44.502 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:36:44.568 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:36:44.789 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:36:44.832 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:36:46.218 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 110/134 2023-08-10T10:36:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:36:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:36:46.689 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:36:46.764 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:36:46.922 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:36:47.339 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:36:47.506 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:36:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:36:52.901 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 115/134 2023-08-10T10:36:53.113 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T10:36:53.380 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-10T10:36:54.647 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-10T10:36:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-10T10:36:55.227 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 119/134 2023-08-10T10:36:55.467 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T10:36:55.626 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 121/134 2023-08-10T10:36:55.772 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T10:36:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:36:59.454 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:36:59.492 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:36:59.704 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 124/134 2023-08-10T10:36:59.963 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 125/134 2023-08-10T10:37:00.286 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/134 2023-08-10T10:37:00.605 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-10T10:37:00.778 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T10:37:00.801 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T10:37:01.063 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-10T10:37:01.253 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T10:37:01.363 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-10T10:37:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T10:37:01.648 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-10T10:37:01.649 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:37:01.851 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:37:01.851 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:37:02.140 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:37:02.353 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:37:02.627 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:37:02.628 INFO:teuthology.orchestra.run.smithi195.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-10T10:37:02.628 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:37:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/134 2023-08-10T10:37:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/134 2023-08-10T10:37:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/134 2023-08-10T10:37:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/134 2023-08-10T10:37:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/134 2023-08-10T10:37:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:37:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:37:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:37:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T10:37:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/134 2023-08-10T10:37:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/134 2023-08-10T10:37:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/134 2023-08-10T10:37:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/134 2023-08-10T10:37:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/134 2023-08-10T10:37:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/134 2023-08-10T10:37:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/134 2023-08-10T10:37:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/134 2023-08-10T10:37:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/134 2023-08-10T10:37:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/134 2023-08-10T10:37:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/134 2023-08-10T10:37:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/134 2023-08-10T10:37:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/134 2023-08-10T10:37:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/134 2023-08-10T10:37:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/134 2023-08-10T10:37:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/134 2023-08-10T10:37:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/134 2023-08-10T10:37:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/134 2023-08-10T10:37:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/134 2023-08-10T10:37:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/134 2023-08-10T10:37:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/134 2023-08-10T10:37:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/134 2023-08-10T10:37:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/134 2023-08-10T10:37:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/134 2023-08-10T10:37:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/134 2023-08-10T10:37:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/134 2023-08-10T10:37:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/134 2023-08-10T10:37:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/134 2023-08-10T10:37:03.246 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/134 2023-08-10T10:37:03.246 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-10T10:37:03.246 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-10T10:37:03.246 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-10T10:37:03.246 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-10T10:37:03.246 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-10T10:37:03.246 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-10T10:37:03.247 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-10T10:37:03.247 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-10T10:37:03.247 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-10T10:37:03.247 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-10T10:37:03.247 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-10T10:37:03.247 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-10T10:37:03.247 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-10T10:37:03.247 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-10T10:37:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-10T10:37:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-10T10:37:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-10T10:37:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-10T10:37:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-10T10:37:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-10T10:37:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-10T10:37:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-10T10:37:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-10T10:37:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-10T10:37:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-10T10:37:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-10T10:37:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-10T10:37:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-10T10:37:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-10T10:37:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-10T10:37:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-10T10:37:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-10T10:37:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-10T10:37:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-10T10:37:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-10T10:37:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-10T10:37:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-10T10:37:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-10T10:37:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-10T10:37:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-10T10:37:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-10T10:37:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-10T10:37:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-10T10:37:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-10T10:37:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-10T10:37:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-10T10:37:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-10T10:37:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-10T10:37:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-10T10:37:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-10T10:37:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-10T10:37:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-10T10:37:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-10T10:37:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-10T10:37:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-10T10:37:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-10T10:37:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-10T10:37:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-10T10:37:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-10T10:37:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-10T10:37:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-10T10:37:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-10T10:37:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-10T10:37:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-10T10:37:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-10T10:37:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-10T10:37:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-10T10:37:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-10T10:37:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-10T10:37:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-10T10:37:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-10T10:37:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-10T10:37:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-10T10:37:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-10T10:37:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-10T10:37:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-10T10:37:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-10T10:37:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-10T10:37:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-10T10:37:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-10T10:37:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-10T10:37:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-10T10:37:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-10T10:37:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T10:37:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-10T10:37:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-10T10:37:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-10T10:37:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-10T10:37:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-10T10:37:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-10T10:37:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/134 2023-08-10T10:37:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-10T10:37:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/134 2023-08-10T10:37:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:37:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-10T10:37:06.018 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:37:06.018 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:04:21 ago on Thu 10 Aug 2023 10:32:45 AM UTC. 2023-08-10T10:37:08.810 INFO:teuthology.orchestra.run.smithi195.stdout:Installed products updated. 2023-08-10T10:37:09.048 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:37:09.049 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2023-08-10T10:37:09.049 INFO:teuthology.orchestra.run.smithi195.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-10T10:37:09.049 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.049 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.049 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2023-08-10T10:37:09.049 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-10T10:37:09.049 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T10:37:09.050 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T10:37:09.050 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.050 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.050 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.051 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.051 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.051 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.051 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.051 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.051 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.051 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.052 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.052 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.052 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.052 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.052 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.052 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.052 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.053 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.053 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.053 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.053 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.053 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.053 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:37:09.054 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-10T10:37:09.054 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T10:37:09.054 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-10T10:37:09.054 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T10:37:09.055 INFO:teuthology.orchestra.run.smithi195.stdout: jq-1.6-3.el8.x86_64 2023-08-10T10:37:09.055 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T10:37:09.055 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-10T10:37:09.055 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T10:37:09.055 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.055 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.056 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.056 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-10T10:37:09.056 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:37:09.056 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T10:37:09.056 INFO:teuthology.orchestra.run.smithi195.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T10:37:09.056 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:37:09.057 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-10T10:37:09.057 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.057 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.057 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T10:37:09.057 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.057 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-10T10:37:09.057 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T10:37:09.057 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T10:37:09.058 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T10:37:09.058 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-10T10:37:09.058 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-10T10:37:09.058 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T10:37:09.058 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T10:37:09.058 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-10T10:37:09.058 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-10T10:37:09.058 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-10T10:37:09.059 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-10T10:37:09.059 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-10T10:37:09.059 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-10T10:37:09.059 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:37:09.059 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:37:09.059 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:37:09.059 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T10:37:09.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T10:37:09.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T10:37:09.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T10:37:09.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T10:37:09.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.061 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.061 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T10:37:09.061 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-10T10:37:09.061 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T10:37:09.061 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T10:37:09.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-10T10:37:09.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T10:37:09.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T10:37:09.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T10:37:09.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T10:37:09.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T10:37:09.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T10:37:09.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T10:37:09.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T10:37:09.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T10:37:09.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-10T10:37:09.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T10:37:09.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T10:37:09.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T10:37:09.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T10:37:09.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T10:37:09.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T10:37:09.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T10:37:09.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T10:37:09.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T10:37:09.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T10:37:09.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T10:37:09.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T10:37:09.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T10:37:09.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T10:37:09.067 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.067 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.067 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T10:37:09.067 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T10:37:09.067 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T10:37:09.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T10:37:09.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-10T10:37:09.068 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T10:37:09.069 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T10:37:09.069 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T10:37:09.069 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T10:37:09.069 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T10:37:09.069 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T10:37:09.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T10:37:09.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T10:37:09.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T10:37:09.070 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T10:37:09.070 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.071 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.071 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:37:09.071 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T10:37:09.071 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T10:37:09.072 INFO:teuthology.orchestra.run.smithi195.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T10:37:09.072 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-10T10:37:09.072 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T10:37:09.073 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-10T10:37:09.073 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:37:09.073 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-08-10T10:37:09.353 DEBUG:teuthology.parallel:result is None 2023-08-10T10:37:30.648 INFO:teuthology.orchestra.run.smithi157.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:37:30.881 INFO:teuthology.orchestra.run.smithi157.stdout:(130/131): python3-asyncssh-2.7.0-2.el8.noarch. 3.5 kB/s | 476 kB 02:15 2023-08-10T10:37:34.723 INFO:teuthology.orchestra.run.smithi157.stdout:[MIRROR] python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:37:36.755 INFO:teuthology.orchestra.run.smithi157.stdout:(131/131): python3-bcrypt-3.1.6-2.el8.1.x86_64. 326 B/s | 44 kB 02:16 2023-08-10T10:37:36.755 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:37:36.756 INFO:teuthology.orchestra.run.smithi157.stdout:Total 746 kB/s | 206 MB 04:42 2023-08-10T10:37:37.640 INFO:teuthology.orchestra.run.smithi107.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:37:37.641 INFO:teuthology.orchestra.run.smithi107.stdout:[MIRROR] python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:37:37.782 INFO:teuthology.orchestra.run.smithi107.stdout:(130/131): python3-bcrypt-3.1.6-2.el8.1.x86_64. 331 B/s | 44 kB 02:14 2023-08-10T10:37:37.865 INFO:teuthology.orchestra.run.smithi107.stdout:(131/131): python3-asyncssh-2.7.0-2.el8.noarch. 3.5 kB/s | 476 kB 02:14 2023-08-10T10:37:37.866 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:37:37.866 INFO:teuthology.orchestra.run.smithi107.stdout:Total 750 kB/s | 206 MB 04:41 2023-08-10T10:37:38.397 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2023-08-10T10:37:38.531 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2023-08-10T10:37:38.531 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2023-08-10T10:37:39.512 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2023-08-10T10:37:39.646 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2023-08-10T10:37:39.647 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2023-08-10T10:37:40.071 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2023-08-10T10:37:40.075 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2023-08-10T10:37:41.230 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2023-08-10T10:37:41.235 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2023-08-10T10:37:45.158 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2023-08-10T10:37:45.371 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-10T10:37:45.558 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-10T10:37:45.764 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-10T10:37:45.912 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-10T10:37:46.115 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-10T10:37:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2023-08-10T10:37:46.512 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-10T10:37:46.604 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-10T10:37:46.707 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-10T10:37:46.823 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 5/134 2023-08-10T10:37:46.939 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-10T10:37:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-10T10:37:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-10T10:37:47.288 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 5/134 2023-08-10T10:37:47.481 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:37:47.629 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:37:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-10T10:37:47.872 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:37:47.990 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:37:48.038 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 5/134 2023-08-10T10:37:48.161 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:37:48.386 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-10T10:37:48.495 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 5/134 2023-08-10T10:37:48.630 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-10T10:37:48.671 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:37:48.830 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:37:48.903 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-10T10:37:49.021 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:37:49.141 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:37:49.334 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-10T10:37:49.344 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:37:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-10T10:37:49.594 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-10T10:37:49.747 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:37:49.763 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-10T10:37:49.872 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:37:50.018 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-10T10:37:50.097 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:37:50.278 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:37:50.418 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-10T10:37:50.570 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-10T10:37:50.668 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-10T10:37:50.756 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-10T10:37:50.854 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:37:50.989 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 14/134 2023-08-10T10:37:50.995 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-10T10:37:51.138 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:37:51.138 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-10T10:37:51.340 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-10T10:37:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 15/134 2023-08-10T10:37:51.489 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-10T10:37:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-10T10:37:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-10T10:37:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-10T10:37:52.145 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-10T10:37:52.179 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-10T10:37:52.335 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-10T10:37:52.347 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-10T10:37:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-10T10:37:53.073 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-10T10:37:53.210 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-10T10:37:53.255 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-10T10:37:53.370 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-10T10:37:54.053 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-10T10:37:54.108 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-10T10:37:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-10T10:37:54.387 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-10T10:37:54.598 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-10T10:37:54.850 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-10T10:37:55.070 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 26/134 2023-08-10T10:37:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-10T10:37:55.201 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 27/134 2023-08-10T10:37:55.361 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-10T10:37:55.423 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 28/134 2023-08-10T10:37:55.563 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-10T10:37:55.638 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-10T10:37:55.841 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-10T10:37:56.002 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 26/134 2023-08-10T10:37:56.175 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 27/134 2023-08-10T10:37:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 28/134 2023-08-10T10:37:56.645 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-10T10:37:57.709 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-10T10:37:58.725 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-10T10:37:58.900 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-10T10:37:59.443 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-10T10:37:59.761 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-10T10:37:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-10T10:38:00.030 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-10T10:38:00.274 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-10T10:38:00.291 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-10T10:38:00.509 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-10T10:38:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-10T10:38:00.732 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 36/134 2023-08-10T10:38:00.796 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-10T10:38:00.995 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 37/134 2023-08-10T10:38:01.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-10T10:38:01.162 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-10T10:38:01.250 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-10T10:38:01.348 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-10T10:38:01.468 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 36/134 2023-08-10T10:38:01.595 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-10T10:38:01.652 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 37/134 2023-08-10T10:38:01.687 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-10T10:38:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-10T10:38:01.974 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-10T10:38:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-10T10:38:02.184 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-10T10:38:02.210 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-10T10:38:02.286 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-10T10:38:02.386 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-10T10:38:02.483 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-10T10:38:02.564 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-10T10:38:02.755 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-10T10:38:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-10T10:38:02.916 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-10T10:38:02.943 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-10T10:38:03.040 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-10T10:38:03.153 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-10T10:38:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-10T10:38:03.356 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-10T10:38:03.490 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-10T10:38:03.581 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-10T10:38:03.635 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-10T10:38:03.766 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-10T10:38:03.855 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-10T10:38:04.038 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-10T10:38:04.039 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-10T10:38:04.232 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-10T10:38:04.263 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-10T10:38:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-10T10:38:04.691 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-10T10:38:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-10T10:38:05.068 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-10T10:38:05.157 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-10T10:38:05.318 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-10T10:38:05.507 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-10T10:38:05.565 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-10T10:38:05.807 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-10T10:38:05.846 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-10T10:38:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-10T10:38:06.236 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-10T10:38:06.344 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-10T10:38:06.496 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-10T10:38:06.694 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-10T10:38:06.702 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-10T10:38:06.927 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-10T10:38:06.946 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-10T10:38:07.118 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-10T10:38:07.129 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-10T10:38:07.295 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-10T10:38:07.403 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-10T10:38:07.608 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-10T10:38:07.669 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-10T10:38:07.798 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-10T10:38:07.990 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-10T10:38:08.293 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-10T10:38:08.478 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-10T10:38:08.531 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-10T10:38:08.745 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-10T10:38:08.761 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-10T10:38:08.909 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-10T10:38:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-10T10:38:09.277 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-10T10:38:09.287 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-10T10:38:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-10T10:38:09.535 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-10T10:38:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-10T10:38:09.699 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-10T10:38:09.890 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-10T10:38:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-10T10:38:10.100 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-10T10:38:10.200 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-10T10:38:10.360 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-10T10:38:10.372 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-10T10:38:10.538 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-10T10:38:10.558 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-10T10:38:10.781 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-10T10:38:10.789 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-10T10:38:10.934 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-10T10:38:11.015 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-10T10:38:11.203 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-10T10:38:11.247 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-10T10:38:11.417 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-10T10:38:11.420 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-10T10:38:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-10T10:38:11.642 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-10T10:38:11.803 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-10T10:38:11.918 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-10T10:38:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-10T10:38:12.161 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-10T10:38:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-10T10:38:12.337 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-10T10:38:12.550 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-10T10:38:12.602 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-10T10:38:12.825 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-10T10:38:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-10T10:38:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-10T10:38:14.004 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-10T10:38:14.330 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-10T10:38:14.632 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-10T10:38:14.659 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-10T10:38:14.969 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-10T10:38:15.011 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-10T10:38:15.272 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-10T10:38:15.347 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-10T10:38:15.560 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-10T10:38:15.632 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-10T10:38:15.953 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-10T10:38:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-10T10:38:16.457 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-10T10:38:16.651 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:38:16.731 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:38:16.918 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 93/134 2023-08-10T10:38:17.070 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-10T10:38:17.232 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:38:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 92/134 2023-08-10T10:38:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 93/134 2023-08-10T10:38:22.292 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:38:22.534 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:38:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:38:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:38:23.219 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:38:23.501 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:38:23.654 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:38:23.709 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 94/134 2023-08-10T10:38:23.792 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:38:24.676 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:38:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 95/134 2023-08-10T10:38:24.998 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:38:44.257 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:38:44.258 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2023-08-10T10:38:44.258 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2023-08-10T10:38:44.258 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2023-08-10T10:38:44.258 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /run 2023-08-10T10:38:44.258 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2023-08-10T10:38:44.258 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2023-08-10T10:38:44.259 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2023-08-10T10:38:44.259 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2023-08-10T10:38:44.259 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2023-08-10T10:38:44.259 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:38:44.655 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:38:45.201 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 96/134 2023-08-10T10:38:45.201 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2023-08-10T10:38:45.201 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2023-08-10T10:38:45.201 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /dev 2023-08-10T10:38:45.201 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /run 2023-08-10T10:38:45.202 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2023-08-10T10:38:45.202 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2023-08-10T10:38:45.202 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2023-08-10T10:38:45.202 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2023-08-10T10:38:45.202 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /dev 2023-08-10T10:38:45.202 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:38:45.601 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:38:46.427 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:38:46.672 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:38:46.943 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:38:47.146 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:38:47.357 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 97/134 2023-08-10T10:38:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:38:47.677 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:38:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 98/134 2023-08-10T10:38:47.929 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:38:47.971 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:38:48.001 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:38:48.545 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 99/134 2023-08-10T10:38:48.784 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:38:48.825 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/134 2023-08-10T10:38:50.752 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:38:50.933 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:38:51.103 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 102/134 2023-08-10T10:38:51.308 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 103/134 2023-08-10T10:38:51.537 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:38:51.554 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:38:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 101/134 2023-08-10T10:38:51.799 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:38:51.833 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 102/134 2023-08-10T10:38:52.046 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:38:52.047 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 103/134 2023-08-10T10:38:52.241 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:38:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 104/134 2023-08-10T10:38:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:38:53.163 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:38:53.353 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:38:53.482 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:38:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 105/134 2023-08-10T10:38:53.898 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 107/134 2023-08-10T10:38:54.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:38:54.168 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:38:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 106/134 2023-08-10T10:38:54.233 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:38:54.453 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:38:54.481 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:38:54.612 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 107/134 2023-08-10T10:38:54.899 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:38:54.964 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 108/134 2023-08-10T10:38:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:38:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 109/134 2023-08-10T10:38:55.893 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 110/134 2023-08-10T10:38:56.141 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:38:56.202 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:38:56.369 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:38:56.452 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:38:56.532 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 110/134 2023-08-10T10:38:56.661 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:38:56.729 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:38:56.791 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 111/134 2023-08-10T10:38:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:38:57.032 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 112/134 2023-08-10T10:38:57.079 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:38:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:38:57.261 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:38:57.616 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 113/134 2023-08-10T10:38:57.816 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:39:02.307 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:39:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 114/134 2023-08-10T10:39:03.596 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 115/134 2023-08-10T10:39:03.964 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-10T10:39:04.136 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 115/134 2023-08-10T10:39:04.192 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 117/134 2023-08-10T10:39:04.454 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-10T10:39:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-10T10:39:04.668 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-10T10:39:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 117/134 2023-08-10T10:39:04.917 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-10T10:39:04.932 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-10T10:39:05.121 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-10T10:39:05.190 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-10T10:39:05.375 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-10T10:39:05.398 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 121/134 2023-08-10T10:39:05.586 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T10:39:05.669 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-10T10:39:05.835 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 121/134 2023-08-10T10:39:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-10T10:39:09.039 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:39:09.343 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:39:09.379 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:39:09.382 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:39:09.618 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 124/134 2023-08-10T10:39:09.655 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:39:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-10T10:39:09.827 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 125/134 2023-08-10T10:39:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 124/134 2023-08-10T10:39:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 125/134 2023-08-10T10:39:10.200 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/134 2023-08-10T10:39:10.549 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/134 2023-08-10T10:39:10.589 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-10T10:39:10.783 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-10T10:39:10.900 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-10T10:39:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-10T10:39:11.117 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-10T10:39:11.136 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-10T10:39:11.144 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-10T10:39:11.245 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-10T10:39:11.367 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-10T10:39:11.388 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-10T10:39:11.520 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-10T10:39:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-10T10:39:11.562 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-10T10:39:11.562 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:39:11.737 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-10T10:39:11.759 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-10T10:39:11.823 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:39:11.823 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:39:11.973 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-10T10:39:11.974 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:39:12.096 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:39:12.193 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:39:12.193 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:39:12.333 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:39:12.503 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-10T10:39:12.581 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:39:12.581 INFO:teuthology.orchestra.run.smithi157.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-10T10:39:12.581 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:39:12.720 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:39:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:39:13.012 INFO:teuthology.orchestra.run.smithi107.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-10T10:39:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:39:13.205 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/134 2023-08-10T10:39:13.205 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/134 2023-08-10T10:39:13.205 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/134 2023-08-10T10:39:13.205 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/134 2023-08-10T10:39:13.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/134 2023-08-10T10:39:13.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:39:13.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:39:13.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:39:13.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T10:39:13.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/134 2023-08-10T10:39:13.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/134 2023-08-10T10:39:13.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/134 2023-08-10T10:39:13.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/134 2023-08-10T10:39:13.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/134 2023-08-10T10:39:13.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/134 2023-08-10T10:39:13.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/134 2023-08-10T10:39:13.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/134 2023-08-10T10:39:13.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/134 2023-08-10T10:39:13.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/134 2023-08-10T10:39:13.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/134 2023-08-10T10:39:13.208 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/134 2023-08-10T10:39:13.208 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/134 2023-08-10T10:39:13.208 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/134 2023-08-10T10:39:13.208 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/134 2023-08-10T10:39:13.208 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/134 2023-08-10T10:39:13.208 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/134 2023-08-10T10:39:13.208 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/134 2023-08-10T10:39:13.209 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/134 2023-08-10T10:39:13.209 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/134 2023-08-10T10:39:13.215 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/134 2023-08-10T10:39:13.216 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/134 2023-08-10T10:39:13.216 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/134 2023-08-10T10:39:13.216 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/134 2023-08-10T10:39:13.216 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/134 2023-08-10T10:39:13.216 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/134 2023-08-10T10:39:13.216 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/134 2023-08-10T10:39:13.217 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/134 2023-08-10T10:39:13.217 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/134 2023-08-10T10:39:13.217 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-10T10:39:13.217 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-10T10:39:13.217 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-10T10:39:13.217 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-10T10:39:13.217 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-10T10:39:13.218 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-10T10:39:13.218 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-10T10:39:13.218 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-10T10:39:13.218 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-10T10:39:13.218 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-10T10:39:13.218 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-10T10:39:13.218 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-10T10:39:13.218 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-10T10:39:13.219 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-10T10:39:13.219 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-10T10:39:13.219 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-10T10:39:13.219 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-10T10:39:13.219 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-10T10:39:13.219 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-10T10:39:13.219 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-10T10:39:13.219 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-10T10:39:13.220 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-10T10:39:13.220 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-10T10:39:13.220 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-10T10:39:13.220 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-10T10:39:13.220 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-10T10:39:13.220 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-10T10:39:13.220 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-10T10:39:13.221 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-10T10:39:13.221 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-10T10:39:13.221 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-10T10:39:13.221 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-10T10:39:13.221 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-10T10:39:13.221 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-10T10:39:13.221 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-10T10:39:13.221 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-10T10:39:13.222 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-10T10:39:13.222 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-10T10:39:13.222 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-10T10:39:13.222 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-10T10:39:13.222 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-10T10:39:13.222 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-10T10:39:13.222 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-10T10:39:13.222 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-10T10:39:13.223 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-10T10:39:13.223 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-10T10:39:13.223 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-10T10:39:13.223 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-10T10:39:13.223 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-10T10:39:13.223 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-10T10:39:13.223 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-10T10:39:13.224 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-10T10:39:13.224 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-10T10:39:13.224 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-10T10:39:13.224 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-10T10:39:13.224 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-10T10:39:13.224 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-10T10:39:13.224 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-10T10:39:13.224 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-10T10:39:13.225 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-10T10:39:13.225 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-10T10:39:13.225 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-10T10:39:13.225 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-10T10:39:13.225 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-10T10:39:13.225 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-10T10:39:13.225 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-10T10:39:13.225 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-10T10:39:13.226 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-10T10:39:13.226 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-10T10:39:13.226 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-10T10:39:13.226 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-10T10:39:13.226 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-10T10:39:13.226 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-10T10:39:13.226 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-10T10:39:13.226 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-10T10:39:13.227 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-10T10:39:13.227 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-10T10:39:13.227 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-10T10:39:13.227 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-10T10:39:13.227 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-10T10:39:13.227 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-10T10:39:13.227 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-10T10:39:13.227 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-10T10:39:13.228 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-10T10:39:13.228 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-10T10:39:13.228 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-10T10:39:13.228 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-10T10:39:13.228 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-10T10:39:13.228 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-10T10:39:13.228 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-10T10:39:13.229 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/134 2023-08-10T10:39:13.229 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-10T10:39:13.229 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/134 2023-08-10T10:39:13.229 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:39:13.229 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-10T10:39:13.625 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/134 2023-08-10T10:39:13.625 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/134 2023-08-10T10:39:13.625 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/134 2023-08-10T10:39:13.625 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/134 2023-08-10T10:39:13.626 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/134 2023-08-10T10:39:13.626 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/134 2023-08-10T10:39:13.626 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/134 2023-08-10T10:39:13.626 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/134 2023-08-10T10:39:13.626 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/134 2023-08-10T10:39:13.626 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/134 2023-08-10T10:39:13.626 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/134 2023-08-10T10:39:13.627 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/134 2023-08-10T10:39:13.627 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/134 2023-08-10T10:39:13.627 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/134 2023-08-10T10:39:13.627 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/134 2023-08-10T10:39:13.627 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/134 2023-08-10T10:39:13.627 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/134 2023-08-10T10:39:13.627 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/134 2023-08-10T10:39:13.627 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/134 2023-08-10T10:39:13.628 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/134 2023-08-10T10:39:13.628 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/134 2023-08-10T10:39:13.628 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/134 2023-08-10T10:39:13.628 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/134 2023-08-10T10:39:13.628 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/134 2023-08-10T10:39:13.628 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/134 2023-08-10T10:39:13.636 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/134 2023-08-10T10:39:13.637 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/134 2023-08-10T10:39:13.637 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/134 2023-08-10T10:39:13.637 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/134 2023-08-10T10:39:13.637 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/134 2023-08-10T10:39:13.637 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/134 2023-08-10T10:39:13.637 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/134 2023-08-10T10:39:13.637 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/134 2023-08-10T10:39:13.638 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/134 2023-08-10T10:39:13.638 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/134 2023-08-10T10:39:13.638 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/134 2023-08-10T10:39:13.638 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/134 2023-08-10T10:39:13.638 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/134 2023-08-10T10:39:13.638 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-10T10:39:13.638 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-10T10:39:13.638 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-10T10:39:13.639 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-10T10:39:13.639 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-10T10:39:13.639 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-10T10:39:13.639 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-10T10:39:13.639 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-10T10:39:13.639 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-10T10:39:13.639 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-10T10:39:13.640 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-10T10:39:13.640 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-10T10:39:13.640 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-10T10:39:13.640 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-10T10:39:13.640 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-10T10:39:13.640 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-10T10:39:13.640 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-10T10:39:13.640 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-10T10:39:13.641 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-10T10:39:13.641 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-10T10:39:13.641 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-10T10:39:13.641 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-10T10:39:13.641 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-10T10:39:13.641 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-10T10:39:13.641 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-10T10:39:13.641 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-10T10:39:13.642 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-10T10:39:13.642 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-10T10:39:13.642 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-10T10:39:13.642 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-10T10:39:13.642 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-10T10:39:13.642 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-10T10:39:13.642 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-10T10:39:13.642 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-10T10:39:13.643 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-10T10:39:13.643 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-10T10:39:13.643 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-10T10:39:13.643 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-10T10:39:13.643 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-10T10:39:13.643 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-10T10:39:13.643 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-10T10:39:13.644 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-10T10:39:13.644 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-10T10:39:13.644 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-10T10:39:13.644 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-10T10:39:13.644 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-10T10:39:13.644 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-10T10:39:13.644 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-10T10:39:13.644 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-10T10:39:13.645 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-10T10:39:13.645 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-10T10:39:13.645 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-10T10:39:13.645 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-10T10:39:13.645 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-10T10:39:13.645 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-10T10:39:13.645 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-10T10:39:13.645 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-10T10:39:13.646 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-10T10:39:13.646 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-10T10:39:13.646 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-10T10:39:13.646 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-10T10:39:13.646 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-10T10:39:13.646 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-10T10:39:13.646 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-10T10:39:13.646 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-10T10:39:13.647 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-10T10:39:13.647 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-10T10:39:13.647 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-10T10:39:13.647 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-10T10:39:13.647 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-10T10:39:13.647 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-10T10:39:13.647 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-10T10:39:13.647 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-10T10:39:13.648 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-10T10:39:13.648 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-10T10:39:13.648 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-10T10:39:13.648 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-10T10:39:13.648 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-10T10:39:13.648 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-10T10:39:13.648 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-10T10:39:13.649 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-10T10:39:13.649 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-10T10:39:13.649 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-10T10:39:13.649 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-10T10:39:13.649 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-10T10:39:13.649 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-10T10:39:13.649 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-10T10:39:13.649 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-10T10:39:13.650 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-10T10:39:13.650 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-10T10:39:13.650 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/134 2023-08-10T10:39:13.650 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-10T10:39:13.650 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/134 2023-08-10T10:39:13.650 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-10T10:39:13.651 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-10T10:39:16.015 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:39:16.015 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:06:35 ago on Thu 10 Aug 2023 10:32:41 AM UTC. 2023-08-10T10:39:16.398 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-10T10:39:16.398 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:06:32 ago on Thu 10 Aug 2023 10:32:44 AM UTC. 2023-08-10T10:39:19.163 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2023-08-10T10:39:19.402 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:39:19.402 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2023-08-10T10:39:19.402 INFO:teuthology.orchestra.run.smithi157.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-10T10:39:19.402 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.402 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.402 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2023-08-10T10:39:19.403 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-10T10:39:19.403 INFO:teuthology.orchestra.run.smithi157.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T10:39:19.403 INFO:teuthology.orchestra.run.smithi157.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T10:39:19.403 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.403 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.403 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.403 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.404 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.404 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.404 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.404 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.404 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.404 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.404 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.405 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.405 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.405 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.405 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.405 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.405 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.405 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.405 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.406 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.406 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.406 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.406 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.406 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-10T10:39:19.406 INFO:teuthology.orchestra.run.smithi157.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T10:39:19.406 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-10T10:39:19.406 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T10:39:19.407 INFO:teuthology.orchestra.run.smithi157.stdout: jq-1.6-3.el8.x86_64 2023-08-10T10:39:19.407 INFO:teuthology.orchestra.run.smithi157.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T10:39:19.407 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-10T10:39:19.407 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T10:39:19.407 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.407 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.407 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.408 INFO:teuthology.orchestra.run.smithi157.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-10T10:39:19.408 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:39:19.408 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T10:39:19.408 INFO:teuthology.orchestra.run.smithi157.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T10:39:19.408 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:39:19.408 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-10T10:39:19.408 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.408 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.409 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T10:39:19.409 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.409 INFO:teuthology.orchestra.run.smithi157.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-10T10:39:19.409 INFO:teuthology.orchestra.run.smithi157.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T10:39:19.409 INFO:teuthology.orchestra.run.smithi157.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T10:39:19.409 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T10:39:19.409 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-10T10:39:19.409 INFO:teuthology.orchestra.run.smithi157.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-10T10:39:19.410 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T10:39:19.410 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T10:39:19.410 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-10T10:39:19.410 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-10T10:39:19.410 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-10T10:39:19.410 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-10T10:39:19.410 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-10T10:39:19.410 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-10T10:39:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:39:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:39:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:39:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T10:39:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T10:39:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T10:39:19.411 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T10:39:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T10:39:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T10:39:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-10T10:39:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T10:39:19.412 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T10:39:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-10T10:39:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T10:39:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T10:39:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T10:39:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T10:39:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T10:39:19.413 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T10:39:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T10:39:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T10:39:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T10:39:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-10T10:39:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T10:39:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T10:39:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T10:39:19.414 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T10:39:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T10:39:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T10:39:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T10:39:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T10:39:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T10:39:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T10:39:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T10:39:19.415 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T10:39:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T10:39:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T10:39:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T10:39:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T10:39:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T10:39:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T10:39:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-10T10:39:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T10:39:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T10:39:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T10:39:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T10:39:19.417 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T10:39:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T10:39:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T10:39:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T10:39:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T10:39:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T10:39:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.418 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T10:39:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T10:39:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T10:39:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-10T10:39:19.419 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T10:39:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-10T10:39:19.420 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-08-10T10:39:19.420 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-08-10T10:39:19.538 INFO:teuthology.orchestra.run.smithi107.stdout:Installed products updated. 2023-08-10T10:39:19.742 DEBUG:teuthology.parallel:result is None 2023-08-10T10:39:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:39:19.780 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2023-08-10T10:39:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-10T10:39:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.780 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2023-08-10T10:39:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-10T10:39:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T10:39:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T10:39:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:39:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-10T10:39:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T10:39:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-10T10:39:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T10:39:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: jq-1.6-3.el8.x86_64 2023-08-10T10:39:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T10:39:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-10T10:39:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T10:39:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-10T10:39:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:39:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T10:39:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T10:39:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-10T10:39:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-10T10:39:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T10:39:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-10T10:39:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T10:39:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T10:39:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T10:39:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-10T10:39:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-10T10:39:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T10:39:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T10:39:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-10T10:39:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-10T10:39:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-10T10:39:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-10T10:39:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-10T10:39:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-10T10:39:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:39:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:39:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-10T10:39:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T10:39:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T10:39:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T10:39:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T10:39:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T10:39:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T10:39:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-10T10:39:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T10:39:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T10:39:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-10T10:39:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T10:39:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T10:39:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T10:39:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T10:39:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T10:39:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T10:39:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T10:39:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T10:39:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T10:39:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-10T10:39:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T10:39:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T10:39:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T10:39:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T10:39:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T10:39:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T10:39:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T10:39:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T10:39:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T10:39:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T10:39:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T10:39:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T10:39:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T10:39:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T10:39:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T10:39:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T10:39:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T10:39:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T10:39:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-10T10:39:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T10:39:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T10:39:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T10:39:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T10:39:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T10:39:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T10:39:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T10:39:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T10:39:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T10:39:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T10:39:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:39:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T10:39:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T10:39:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T10:39:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-10T10:39:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T10:39:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-10T10:39:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:39:19.798 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2023-08-10T10:39:20.144 DEBUG:teuthology.parallel:result is None 2023-08-10T10:39:20.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:39:20.286 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T10:39:20.342 INFO:teuthology.orchestra.run.smithi107.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T10:39:20.343 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T10:39:20.344 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T10:39:20.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:39:20.481 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T10:39:20.537 INFO:teuthology.orchestra.run.smithi157.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T10:39:20.537 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T10:39:20.537 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T10:39:20.538 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:39:20.677 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T10:39:20.739 INFO:teuthology.orchestra.run.smithi195.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T10:39:20.740 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T10:39:20.740 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T10:39:20.740 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-10T10:39:20.741 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:39:20.741 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T10:39:20.833 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:39:20.834 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T10:39:20.924 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:39:20.924 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T10:39:21.018 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-10T10:39:21.018 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:39:21.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T10:39:21.088 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T10:39:21.196 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:39:21.196 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T10:39:21.265 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T10:39:21.373 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:39:21.373 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T10:39:21.443 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T10:39:21.551 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-10T10:39:21.552 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:39:21.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T10:39:21.621 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T10:39:21.728 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:39:21.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T10:39:21.796 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T10:39:21.903 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:39:21.904 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T10:39:21.973 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T10:39:22.080 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-10T10:39:22.080 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:39:22.081 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T10:39:22.151 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T10:39:22.259 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:39:22.260 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T10:39:22.329 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T10:39:22.438 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:39:22.439 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T10:39:22.506 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T10:39:22.612 INFO:teuthology.run_tasks:Running task cephadm... 2023-08-10T10:39:22.713 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-08-10T10:39:22.715 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:39:22.725 INFO:tasks.cephadm:Cluster fsid is 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:39:22.726 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-08-10T10:39:22.727 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.107', 'mon.b': '172.21.15.157', 'mon.c': '172.21.15.195'} 2023-08-10T10:39:22.727 INFO:tasks.cephadm:First mon is mon.a on smithi107 2023-08-10T10:39:22.727 INFO:tasks.cephadm:First mgr is x 2023-08-10T10:39:22.727 INFO:tasks.cephadm:Normalizing hostnames... 2023-08-10T10:39:22.728 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname $(hostname -s) 2023-08-10T10:39:22.799 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2023-08-10T10:39:22.871 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2023-08-10T10:39:22.940 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-08-10T10:39:22.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:39:23.170 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/71841/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-5118-ga8bf445f', 'node_name': '172.21.2.5+braggi05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-5118.ga8bf445f'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-08-03 14:58:59.502988', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-2023Aug1-3', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-08-10T10:39:23.387 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-rishabh-2023Aug1-3, sha1 a8bf445f2d27d8e12e060dff0fd151d481b5290b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:39:23.388 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/x86_64/flavors/default/cephadm 2023-08-10T10:39:23.388 DEBUG:teuthology.orchestra.run.smithi107:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-08-10T10:39:23.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-rw-r--. 1 ubuntu ubuntu 670007 Aug 10 10:39 /home/ubuntu/cephtest/cephadm 2023-08-10T10:39:23.786 DEBUG:teuthology.orchestra.run.smithi157:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-08-10T10:39:24.187 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-rw-r--. 1 ubuntu ubuntu 670007 Aug 10 10:39 /home/ubuntu/cephtest/cephadm 2023-08-10T10:39:24.188 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-08-10T10:39:24.597 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-rw-r--. 1 ubuntu ubuntu 670007 Aug 10 10:39 /home/ubuntu/cephtest/cephadm 2023-08-10T10:39:24.598 DEBUG:teuthology.orchestra.run.smithi107:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-08-10T10:39:24.649 DEBUG:teuthology.orchestra.run.smithi157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-08-10T10:39:24.700 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-08-10T10:39:24.766 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b on all hosts... 2023-08-10T10:39:24.766 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b pull 2023-08-10T10:39:24.772 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b pull 2023-08-10T10:39:24.776 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b pull 2023-08-10T10:39:26.295 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T10:39:29.306 INFO:teuthology.orchestra.run.smithi107.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T10:39:29.393 INFO:teuthology.orchestra.run.smithi157.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T10:39:55.953 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-08-10T10:39:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev)", 2023-08-10T10:39:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "image_id": "97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e", 2023-08-10T10:39:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "repo_digests": [ 2023-08-10T10:39:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ac5117ff7e66d24d9c7c962bd24dac658fc55abae75f6360257e176fd9162a06" 2023-08-10T10:39:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2023-08-10T10:39:55.954 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-08-10T10:39:57.458 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-08-10T10:39:57.459 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev)", 2023-08-10T10:39:57.459 INFO:teuthology.orchestra.run.smithi157.stdout: "image_id": "97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e", 2023-08-10T10:39:57.460 INFO:teuthology.orchestra.run.smithi157.stdout: "repo_digests": [ 2023-08-10T10:39:57.460 INFO:teuthology.orchestra.run.smithi157.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ac5117ff7e66d24d9c7c962bd24dac658fc55abae75f6360257e176fd9162a06" 2023-08-10T10:39:57.460 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2023-08-10T10:39:57.460 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-08-10T10:40:01.669 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:40:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev)", 2023-08-10T10:40:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "image_id": "97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e", 2023-08-10T10:40:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "repo_digests": [ 2023-08-10T10:40:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ac5117ff7e66d24d9c7c962bd24dac658fc55abae75f6360257e176fd9162a06" 2023-08-10T10:40:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T10:40:01.671 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:40:01.694 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph 2023-08-10T10:40:01.766 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2023-08-10T10:40:01.852 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2023-08-10T10:40:01.935 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /etc/ceph 2023-08-10T10:40:02.004 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2023-08-10T10:40:02.077 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2023-08-10T10:40:02.148 INFO:tasks.cephadm:Writing seed config... 2023-08-10T10:40:02.150 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-08-10T10:40:02.150 INFO:tasks.cephadm: override: [client] debug client = 20 2023-08-10T10:40:02.150 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-08-10T10:40:02.150 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-08-10T10:40:02.151 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-08-10T10:40:02.151 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-08-10T10:40:02.151 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-08-10T10:40:02.151 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-08-10T10:40:02.151 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-08-10T10:40:02.152 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-08-10T10:40:02.152 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-08-10T10:40:02.152 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-08-10T10:40:02.152 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-08-10T10:40:02.152 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-08-10T10:40:02.153 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-08-10T10:40:02.153 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-08-10T10:40:02.153 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-08-10T10:40:02.153 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-08-10T10:40:02.153 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-08-10T10:40:02.154 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-08-10T10:40:02.154 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-08-10T10:40:02.154 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-08-10T10:40:02.154 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-08-10T10:40:02.154 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-08-10T10:40:02.155 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-08-10T10:40:02.155 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-08-10T10:40:02.155 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-08-10T10:40:02.155 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-08-10T10:40:02.155 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-08-10T10:40:02.156 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-08-10T10:40:02.156 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-08-10T10:40:02.156 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-08-10T10:40:02.156 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-08-10T10:40:02.157 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-08-10T10:40:02.157 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-08-10T10:40:02.157 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-08-10T10:40:02.157 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-08-10T10:40:02.158 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-08-10T10:40:02.158 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-08-10T10:40:02.158 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-08-10T10:40:02.158 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-08-10T10:40:02.158 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-08-10T10:40:02.159 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-08-10T10:40:02.159 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-08-10T10:40:02.160 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:40:02.160 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-08-10T10:40:02.203 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 2b47e340-376a-11ee-9b37-001a4aab830c [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-08-10T10:40:02.203 DEBUG:teuthology.orchestra.run.smithi107:mon.a> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.a.service 2023-08-10T10:40:02.247 DEBUG:teuthology.orchestra.run.smithi107:mgr.x> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.x.service 2023-08-10T10:40:02.292 INFO:tasks.cephadm:Bootstrapping... 2023-08-10T10:40:02.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b -v bootstrap --fsid 2b47e340-376a-11ee-9b37-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.107 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-08-10T10:40:02.314 INFO:journalctl@ceph.mon.a.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:40:02.361 INFO:journalctl@ceph.mgr.x.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:40:02.513 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:40:02.513 INFO:teuthology.orchestra.run.smithi107.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b', '-v', 'bootstrap', '--fsid', '2b47e340-376a-11ee-9b37-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.107', '--skip-admin-label'] 2023-08-10T10:40:02.590 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout 4.1.1 2023-08-10T10:40:02.590 INFO:teuthology.orchestra.run.smithi107.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-08-10T10:40:02.591 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying podman|docker is present... 2023-08-10T10:40:02.761 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout 4.1.1 2023-08-10T10:40:02.761 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying lvm2 is present... 2023-08-10T10:40:02.762 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying time synchronization is in place... 2023-08-10T10:40:02.775 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-08-10T10:40:02.776 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-08-10T10:40:02.788 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-08-10T10:40:02.788 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2023-08-10T10:40:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout enabled 2023-08-10T10:40:02.814 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout active 2023-08-10T10:40:02.814 INFO:teuthology.orchestra.run.smithi107.stdout:Unit chronyd.service is enabled and running 2023-08-10T10:40:02.814 INFO:teuthology.orchestra.run.smithi107.stdout:Repeating the final host check... 2023-08-10T10:40:02.984 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout 4.1.1 2023-08-10T10:40:02.984 INFO:teuthology.orchestra.run.smithi107.stdout:podman (/bin/podman) version 4.1.1 is present 2023-08-10T10:40:02.985 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl is present 2023-08-10T10:40:02.985 INFO:teuthology.orchestra.run.smithi107.stdout:lvcreate is present 2023-08-10T10:40:02.997 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-08-10T10:40:02.998 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-08-10T10:40:03.010 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-08-10T10:40:03.011 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2023-08-10T10:40:03.024 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout enabled 2023-08-10T10:40:03.036 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout active 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi107.stdout:Unit chronyd.service is enabled and running 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi107.stdout:Host looks OK 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi107.stdout:Cluster fsid: 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi107.stdout:Acquiring lock 140011554580968 on /run/cephadm/2b47e340-376a-11ee-9b37-001a4aab830c.lock 2023-08-10T10:40:03.037 INFO:teuthology.orchestra.run.smithi107.stdout:Lock 140011554580968 acquired on /run/cephadm/2b47e340-376a-11ee-9b37-001a4aab830c.lock 2023-08-10T10:40:03.038 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying IP 172.21.15.107 port 3300 ... 2023-08-10T10:40:03.038 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying IP 172.21.15.107 port 6789 ... 2023-08-10T10:40:03.038 INFO:teuthology.orchestra.run.smithi107.stdout:Base mon IP(s) is [172.21.15.107:3300, 172.21.15.107:6789], mon addrv is [v2:172.21.15.107:3300,v1:172.21.15.107:6789] 2023-08-10T10:40:03.045 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-08-10T10:40:03.046 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.107 metric 100 2023-08-10T10:40:03.052 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-08-10T10:40:03.053 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-08-10T10:40:03.053 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-08-10T10:40:03.059 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-08-10T10:40:03.059 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-08-10T10:40:03.059 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-08-10T10:40:03.059 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-08-10T10:40:03.059 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout inet6 fe80::3b9b:a750:7172:f772/64 scope link noprefixroute 2023-08-10T10:40:03.060 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-08-10T10:40:03.060 INFO:teuthology.orchestra.run.smithi107.stdout:Mon IP `172.21.15.107` is in CIDR network `172.21.0.0/20` 2023-08-10T10:40:03.060 INFO:teuthology.orchestra.run.smithi107.stdout:Mon IP `172.21.15.107` is in CIDR network `172.21.0.0/20` 2023-08-10T10:40:03.060 INFO:teuthology.orchestra.run.smithi107.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-08-10T10:40:03.061 INFO:teuthology.orchestra.run.smithi107.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-08-10T10:40:03.062 INFO:teuthology.orchestra.run.smithi107.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T10:40:03.534 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout 97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e 2023-08-10T10:40:03.534 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b... 2023-08-10T10:40:03.535 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Getting image source signatures 2023-08-10T10:40:03.535 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Copying blob sha256:39d70b65b369c6d58e403c39285d11b8f4bfcaf0a5e142f386f4e8ab865f72a5 2023-08-10T10:40:03.535 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Copying blob sha256:6022c611d474f2b306ddd1edfc8360123ece5266119096f25fde843d7967e636 2023-08-10T10:40:03.536 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Copying config sha256:97af32c09d742b2a6ea432ce98c21da04dbcc0be5a0d3cb00a27bd1a1d70a52e 2023-08-10T10:40:03.536 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Writing manifest to image destination 2023-08-10T10:40:03.536 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Storing signatures 2023-08-10T10:40:04.508 INFO:teuthology.orchestra.run.smithi107.stdout:ceph: stdout ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev) 2023-08-10T10:40:04.509 INFO:teuthology.orchestra.run.smithi107.stdout:Ceph version: ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev) 2023-08-10T10:40:04.509 INFO:teuthology.orchestra.run.smithi107.stdout:Extracting ceph user uid/gid from container image... 2023-08-10T10:40:05.382 INFO:teuthology.orchestra.run.smithi107.stdout:stat: stdout 167 167 2023-08-10T10:40:05.382 INFO:teuthology.orchestra.run.smithi107.stdout:Creating initial keys... 2023-08-10T10:40:06.156 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph-authtool: stdout AQCFvtRkEyBYLhAAkTkxSDzjItu3jEYxymCf1g== 2023-08-10T10:40:06.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph-authtool: stdout AQCGvtRkDzyKIBAArjWdLrFlDW3d38XWijh8oQ== 2023-08-10T10:40:07.807 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph-authtool: stdout AQCHvtRk/OMGFRAAULNQVhmlehK1LybmAGHBLg== 2023-08-10T10:40:07.808 INFO:teuthology.orchestra.run.smithi107.stdout:Creating initial monmap... 2023-08-10T10:40:08.587 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-08-10T10:40:08.587 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-08-10T10:40:08.587 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:08.587 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-08-10T10:40:08.587 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool for a [v2:172.21.15.107:3300,v1:172.21.15.107:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-08-10T10:40:08.587 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = pacific 2023-08-10T10:40:08.588 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: set fsid to 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:08.588 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-08-10T10:40:08.588 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:40:08.589 INFO:teuthology.orchestra.run.smithi107.stdout:Creating mon... 2023-08-10T10:40:09.867 INFO:teuthology.orchestra.run.smithi107.stdout:create mon.a on 2023-08-10T10:40:10.110 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-08-10T10:40:10.315 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-08-10T10:40:10.556 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-2b47e340-376a-11ee-9b37-001a4aab830c.target → /etc/systemd/system/ceph-2b47e340-376a-11ee-9b37-001a4aab830c.target. 2023-08-10T10:40:10.557 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-2b47e340-376a-11ee-9b37-001a4aab830c.target → /etc/systemd/system/ceph-2b47e340-376a-11ee-9b37-001a4aab830c.target. 2023-08-10T10:40:10.967 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.a 2023-08-10T10:40:10.968 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.a.service: Unit ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.a.service not loaded. 2023-08-10T10:40:11.170 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2b47e340-376a-11ee-9b37-001a4aab830c.target.wants/ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-2b47e340-376a-11ee-9b37-001a4aab830c@.service. 2023-08-10T10:40:11.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:11 smithi107 systemd[1]: Starting Ceph mon.a for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:40:11.951 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:11 smithi107 podman[127400]: 2023-08-10T10:40:11.951 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:11 smithi107 bash[127400]: 068aac0da6d8c513c98023f240c9f3d148bd132c0b03dc6a57e2a5e3a0abe275 2023-08-10T10:40:11.975 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-10T10:40:11.975 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2023-08-10T10:40:11.990 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-10T10:40:11.990 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2023-08-10T10:40:11.991 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2023-08-10T10:40:11.991 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to enable service . firewalld.service is not available 2023-08-10T10:40:11.991 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mon to start... 2023-08-10T10:40:11.992 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mon... 2023-08-10T10:40:12.299 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:11 smithi107 systemd[1]: Started Ceph mon.a for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:40:12.299 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:11 smithi107 ceph-mon[127440]: mkfs 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:12.299 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:11 smithi107 ceph-mon[127440]: mon.a is new leader, mons a in quorum (ranks 0) 2023-08-10T10:40:13.072 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout cluster: 2023-08-10T10:40:13.076 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout id: 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:13.077 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-08-10T10:40:13.077 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:13.077 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout services: 2023-08-10T10:40:13.077 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.679564s) 2023-08-10T10:40:13.077 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-08-10T10:40:13.077 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-08-10T10:40:13.077 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:13.078 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout data: 2023-08-10T10:40:13.078 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-08-10T10:40:13.078 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-08-10T10:40:13.078 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-08-10T10:40:13.078 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout pgs: 2023-08-10T10:40:13.078 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:13.078 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.547+0000 7f83be001700 1 Processor -- start 2023-08-10T10:40:13.078 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.547+0000 7f83be001700 1 -- start start 2023-08-10T10:40:13.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.548+0000 7f83be001700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b807a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.548+0000 7f83be001700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b807a8d0 con 0x7f83b807bea0 2023-08-10T10:40:13.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.548+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b807a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.548+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b807a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46452/0 (socket says 172.21.15.107:46452) 2023-08-10T10:40:13.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.549+0000 7f83b77fe700 1 -- 172.21.15.107:0/83407174 learned_addr learned my addr 172.21.15.107:0/83407174 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:13.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.549+0000 7f83b77fe700 1 -- 172.21.15.107:0/83407174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b807aa10 con 0x7f83b807bea0 2023-08-10T10:40:13.079 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.549+0000 7f83b77fe700 1 --2- 172.21.15.107:0/83407174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b807a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f83a80098a0 tx=0x7f83a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4574486e94dfc43 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.549+0000 7f83b67fc700 1 -- 172.21.15.107:0/83407174 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83a8004160 con 0x7f83b807bea0 2023-08-10T10:40:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.549+0000 7f83b67fc700 1 -- 172.21.15.107:0/83407174 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a80042c0 con 0x7f83b807bea0 2023-08-10T10:40:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.549+0000 7f83b67fc700 1 -- 172.21.15.107:0/83407174 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83a80045a0 con 0x7f83b807bea0 2023-08-10T10:40:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.550+0000 7f83be001700 1 -- 172.21.15.107:0/83407174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 msgr2=0x7f83b807a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.550+0000 7f83be001700 1 --2- 172.21.15.107:0/83407174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b807a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f83a80098a0 tx=0x7f83a8009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.550+0000 7f83be001700 1 -- 172.21.15.107:0/83407174 shutdown_connections 2023-08-10T10:40:13.080 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.550+0000 7f83be001700 1 --2- 172.21.15.107:0/83407174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b807a300 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.550+0000 7f83be001700 1 -- 172.21.15.107:0/83407174 >> 172.21.15.107:0/83407174 conn(0x7f83b81014b0 msgr2=0x7f83b81038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:13.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.550+0000 7f83be001700 1 -- 172.21.15.107:0/83407174 shutdown_connections 2023-08-10T10:40:13.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.550+0000 7f83be001700 1 -- 172.21.15.107:0/83407174 wait complete. 2023-08-10T10:40:13.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.551+0000 7f83be001700 1 Processor -- start 2023-08-10T10:40:13.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.551+0000 7f83be001700 1 -- start start 2023-08-10T10:40:13.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.552+0000 7f83be001700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b819b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:13.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.552+0000 7f83be001700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b819bb00 con 0x7f83b807bea0 2023-08-10T10:40:13.081 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.552+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b819b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:13.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.552+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b819b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46468/0 (socket says 172.21.15.107:46468) 2023-08-10T10:40:13.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.552+0000 7f83b77fe700 1 -- 172.21.15.107:0/1730057040 learned_addr learned my addr 172.21.15.107:0/1730057040 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:13.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.552+0000 7f83b77fe700 1 -- 172.21.15.107:0/1730057040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8009550 con 0x7f83b807bea0 2023-08-10T10:40:13.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.552+0000 7f83b77fe700 1 --2- 172.21.15.107:0/1730057040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b819b5c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f83a8004000 tx=0x7f83a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:13.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.553+0000 7f83b4ff9700 1 -- 172.21.15.107:0/1730057040 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83a8011630 con 0x7f83b807bea0 2023-08-10T10:40:13.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.553+0000 7f83b4ff9700 1 -- 172.21.15.107:0/1730057040 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a8011790 con 0x7f83b807bea0 2023-08-10T10:40:13.082 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.553+0000 7f83b4ff9700 1 -- 172.21.15.107:0/1730057040 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83a8011a30 con 0x7f83b807bea0 2023-08-10T10:40:13.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.553+0000 7f83be001700 1 -- 172.21.15.107:0/1730057040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b819bd00 con 0x7f83b807bea0 2023-08-10T10:40:13.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.553+0000 7f83be001700 1 -- 172.21.15.107:0/1730057040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b819c120 con 0x7f83b807bea0 2023-08-10T10:40:13.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.553+0000 7f83b4ff9700 1 -- 172.21.15.107:0/1730057040 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f83a8022070 con 0x7f83b807bea0 2023-08-10T10:40:13.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.553+0000 7f83b4ff9700 1 -- 172.21.15.107:0/1730057040 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f83a801c450 con 0x7f83b807bea0 2023-08-10T10:40:13.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.554+0000 7f83be001700 1 -- 172.21.15.107:0/1730057040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b81953c0 con 0x7f83b807bea0 2023-08-10T10:40:13.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.557+0000 7f83b4ff9700 1 -- 172.21.15.107:0/1730057040 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f83a801b450 con 0x7f83b807bea0 2023-08-10T10:40:13.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.629+0000 7f83be001700 1 -- 172.21.15.107:0/1730057040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f83b802cb60 con 0x7f83b807bea0 2023-08-10T10:40:13.083 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.630+0000 7f83b4ff9700 1 -- 172.21.15.107:0/1730057040 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f83a801b5f0 con 0x7f83b807bea0 2023-08-10T10:40:13.084 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.630+0000 7f83be001700 1 -- 172.21.15.107:0/1730057040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 msgr2=0x7f83b819b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:13.084 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.630+0000 7f83be001700 1 --2- 172.21.15.107:0/1730057040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b819b5c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f83a8004000 tx=0x7f83a8004750 comp rx=0 tx=0).stop 2023-08-10T10:40:13.084 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.630+0000 7f83be001700 1 -- 172.21.15.107:0/1730057040 shutdown_connections 2023-08-10T10:40:13.084 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.630+0000 7f83be001700 1 --2- 172.21.15.107:0/1730057040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83b807bea0 0x7f83b819b5c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:13.084 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.630+0000 7f83be001700 1 -- 172.21.15.107:0/1730057040 >> 172.21.15.107:0/1730057040 conn(0x7f83b81014b0 msgr2=0x7f83b8102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:13.084 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.630+0000 7f83be001700 1 -- 172.21.15.107:0/1730057040 shutdown_connections 2023-08-10T10:40:13.084 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:12.631+0000 7f83be001700 1 -- 172.21.15.107:0/1730057040 wait complete. 2023-08-10T10:40:13.084 INFO:teuthology.orchestra.run.smithi107.stdout:mon is available 2023-08-10T10:40:13.085 INFO:teuthology.orchestra.run.smithi107.stdout:Assimilating anything we can from ceph.conf... 2023-08-10T10:40:13.322 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:12 smithi107 ceph-mon[127440]: mon.a is new leader, mons a in quorum (ranks 0) 2023-08-10T10:40:13.322 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:12 smithi107 ceph-mon[127440]: monmap e1: 1 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0]} removed_ranks: {} 2023-08-10T10:40:13.323 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:12 smithi107 ceph-mon[127440]: fsmap 2023-08-10T10:40:13.323 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:12 smithi107 ceph-mon[127440]: osdmap e1: 0 total, 0 up, 0 in 2023-08-10T10:40:13.323 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:12 smithi107 ceph-mon[127440]: mgrmap e1: no daemons active 2023-08-10T10:40:13.323 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:12 smithi107 ceph-mon[127440]: from='client.? 172.21.15.107:0/1730057040' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-08-10T10:40:14.054 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:14.054 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [global] 2023-08-10T10:40:14.054 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout fsid = 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:14.054 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.107:3300,v1:172.21.15.107:6789] 2023-08-10T10:40:14.055 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-08-10T10:40:14.055 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-08-10T10:40:14.055 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-08-10T10:40:14.055 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-08-10T10:40:14.056 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:14.056 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [mgr] 2023-08-10T10:40:14.056 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-08-10T10:40:14.056 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:14.056 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [osd] 2023-08-10T10:40:14.056 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-08-10T10:40:14.056 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-08-10T10:40:14.057 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-08-10T10:40:14.057 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-08-10T10:40:14.057 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-08-10T10:40:14.057 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.571+0000 7f9a512d3700 1 Processor -- start 2023-08-10T10:40:14.057 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.571+0000 7f9a512d3700 1 -- start start 2023-08-10T10:40:14.057 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.571+0000 7f9a512d3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c1062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.057 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.571+0000 7f9a512d3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c1067f0 con 0x7f9a4c105e90 2023-08-10T10:40:14.057 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.572+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c1062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.058 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.572+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c1062b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44070/0 (socket says 172.21.15.107:44070) 2023-08-10T10:40:14.058 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.572+0000 7f9a4affd700 1 -- 172.21.15.107:0/3153083406 learned_addr learned my addr 172.21.15.107:0/3153083406 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:14.058 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.572+0000 7f9a4affd700 1 -- 172.21.15.107:0/3153083406 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c106930 con 0x7f9a4c105e90 2023-08-10T10:40:14.058 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.573+0000 7f9a4affd700 1 --2- 172.21.15.107:0/3153083406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c1062b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0098a0 tx=0x7f9a3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61826fdc6ef395db server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:14.058 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.573+0000 7f9a49ffb700 1 -- 172.21.15.107:0/3153083406 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c004160 con 0x7f9a4c105e90 2023-08-10T10:40:14.058 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.573+0000 7f9a49ffb700 1 -- 172.21.15.107:0/3153083406 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c0042c0 con 0x7f9a4c105e90 2023-08-10T10:40:14.058 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.573+0000 7f9a49ffb700 1 -- 172.21.15.107:0/3153083406 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c0045a0 con 0x7f9a4c105e90 2023-08-10T10:40:14.059 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.573+0000 7f9a512d3700 1 -- 172.21.15.107:0/3153083406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 msgr2=0x7f9a4c1062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.059 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.573+0000 7f9a512d3700 1 --2- 172.21.15.107:0/3153083406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c1062b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0098a0 tx=0x7f9a3c009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.059 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.573+0000 7f9a512d3700 1 -- 172.21.15.107:0/3153083406 shutdown_connections 2023-08-10T10:40:14.059 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.573+0000 7f9a512d3700 1 --2- 172.21.15.107:0/3153083406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c1062b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.059 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.573+0000 7f9a512d3700 1 -- 172.21.15.107:0/3153083406 >> 172.21.15.107:0/3153083406 conn(0x7f9a4c1014b0 msgr2=0x7f9a4c1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:14.059 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.574+0000 7f9a512d3700 1 -- 172.21.15.107:0/3153083406 shutdown_connections 2023-08-10T10:40:14.059 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.574+0000 7f9a512d3700 1 -- 172.21.15.107:0/3153083406 wait complete. 2023-08-10T10:40:14.059 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.575+0000 7f9a512d3700 1 Processor -- start 2023-08-10T10:40:14.060 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.575+0000 7f9a512d3700 1 -- start start 2023-08-10T10:40:14.060 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.575+0000 7f9a512d3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c19b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:14.060 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.575+0000 7f9a512d3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c19bac0 con 0x7f9a4c105e90 2023-08-10T10:40:14.060 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.575+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c19b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:14.060 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.575+0000 7f9a4affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c19b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44074/0 (socket says 172.21.15.107:44074) 2023-08-10T10:40:14.060 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.575+0000 7f9a4affd700 1 -- 172.21.15.107:0/687126606 learned_addr learned my addr 172.21.15.107:0/687126606 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:14.060 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.576+0000 7f9a4affd700 1 -- 172.21.15.107:0/687126606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c009550 con 0x7f9a4c105e90 2023-08-10T10:40:14.061 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.576+0000 7f9a4affd700 1 --2- 172.21.15.107:0/687126606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c19b580 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c106b20 tx=0x7f9a3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:14.061 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.576+0000 7f9a33fff700 1 -- 172.21.15.107:0/687126606 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c011630 con 0x7f9a4c105e90 2023-08-10T10:40:14.061 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.576+0000 7f9a33fff700 1 -- 172.21.15.107:0/687126606 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c011790 con 0x7f9a4c105e90 2023-08-10T10:40:14.061 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.576+0000 7f9a512d3700 1 -- 172.21.15.107:0/687126606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c19bcc0 con 0x7f9a4c105e90 2023-08-10T10:40:14.061 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.576+0000 7f9a33fff700 1 -- 172.21.15.107:0/687126606 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a3c011a30 con 0x7f9a4c105e90 2023-08-10T10:40:14.061 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.576+0000 7f9a512d3700 1 -- 172.21.15.107:0/687126606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c19c0e0 con 0x7f9a4c105e90 2023-08-10T10:40:14.061 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.576+0000 7f9a33fff700 1 -- 172.21.15.107:0/687126606 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9a3c022070 con 0x7f9a4c105e90 2023-08-10T10:40:14.061 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.577+0000 7f9a33fff700 1 -- 172.21.15.107:0/687126606 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9a3c01c450 con 0x7f9a4c105e90 2023-08-10T10:40:14.062 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.577+0000 7f9a512d3700 1 -- 172.21.15.107:0/687126606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4c061da0 con 0x7f9a4c105e90 2023-08-10T10:40:14.062 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.580+0000 7f9a33fff700 1 -- 172.21.15.107:0/687126606 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f9a3c01b450 con 0x7f9a4c105e90 2023-08-10T10:40:14.062 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.649+0000 7f9a512d3700 1 -- 172.21.15.107:0/687126606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9a4c19eb20 con 0x7f9a4c105e90 2023-08-10T10:40:14.062 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.653+0000 7f9a33fff700 1 -- 172.21.15.107:0/687126606 <== mon.0 v2:172.21.15.107:3300/0 7 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9a3c01b5f0 con 0x7f9a4c105e90 2023-08-10T10:40:14.062 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.653+0000 7f9a33fff700 1 -- 172.21.15.107:0/687126606 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f9a3c037580 con 0x7f9a4c105e90 2023-08-10T10:40:14.062 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.654+0000 7f9a512d3700 1 -- 172.21.15.107:0/687126606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 msgr2=0x7f9a4c19b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:14.062 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.654+0000 7f9a512d3700 1 --2- 172.21.15.107:0/687126606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c19b580 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c106b20 tx=0x7f9a3c004750 comp rx=0 tx=0).stop 2023-08-10T10:40:14.063 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.654+0000 7f9a512d3700 1 -- 172.21.15.107:0/687126606 shutdown_connections 2023-08-10T10:40:14.063 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.654+0000 7f9a512d3700 1 --2- 172.21.15.107:0/687126606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a4c105e90 0x7f9a4c19b580 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:14.063 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.654+0000 7f9a512d3700 1 -- 172.21.15.107:0/687126606 >> 172.21.15.107:0/687126606 conn(0x7f9a4c1014b0 msgr2=0x7f9a4c07a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:14.063 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.654+0000 7f9a512d3700 1 -- 172.21.15.107:0/687126606 shutdown_connections 2023-08-10T10:40:14.063 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:13.654+0000 7f9a512d3700 1 -- 172.21.15.107:0/687126606 wait complete. 2023-08-10T10:40:14.063 INFO:teuthology.orchestra.run.smithi107.stdout:Generating new minimal ceph.conf... 2023-08-10T10:40:14.314 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:13 smithi107 ceph-mon[127440]: from='client.? 172.21.15.107:0/687126606' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-08-10T10:40:14.314 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:13 smithi107 ceph-mon[127440]: from='client.? 172.21.15.107:0/687126606' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-08-10T10:40:16.241 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:15 smithi107 ceph-mon[127440]: from='client.? 172.21.15.107:0/1412684857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:40:16.539 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.799+0000 7fb4f53de700 1 Processor -- start 2023-08-10T10:40:16.539 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.800+0000 7fb4f53de700 1 -- start start 2023-08-10T10:40:16.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.800+0000 7fb4f53de700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f007a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.800+0000 7fb4f53de700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f007a8f0 con 0x7fb4f007bec0 2023-08-10T10:40:16.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.800+0000 7fb4eeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f007a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.800+0000 7fb4eeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f007a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44078/0 (socket says 172.21.15.107:44078) 2023-08-10T10:40:16.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.800+0000 7fb4eeffd700 1 -- 172.21.15.107:0/1922572440 learned_addr learned my addr 172.21.15.107:0/1922572440 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:16.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.801+0000 7fb4eeffd700 1 -- 172.21.15.107:0/1922572440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f007aa30 con 0x7fb4f007bec0 2023-08-10T10:40:16.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.801+0000 7fb4eeffd700 1 --2- 172.21.15.107:0/1922572440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f007a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00098a0 tx=0x7fb4e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff543d89e9fc54a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:16.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.801+0000 7fb4edffb700 1 -- 172.21.15.107:0/1922572440 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e0004160 con 0x7fb4f007bec0 2023-08-10T10:40:16.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.801+0000 7fb4edffb700 1 -- 172.21.15.107:0/1922572440 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb4e00042c0 con 0x7fb4f007bec0 2023-08-10T10:40:16.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.801+0000 7fb4edffb700 1 -- 172.21.15.107:0/1922572440 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e0011940 con 0x7fb4f007bec0 2023-08-10T10:40:16.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.802+0000 7fb4f53de700 1 -- 172.21.15.107:0/1922572440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 msgr2=0x7fb4f007a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.802+0000 7fb4f53de700 1 --2- 172.21.15.107:0/1922572440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f007a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00098a0 tx=0x7fb4e0009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.802+0000 7fb4f53de700 1 -- 172.21.15.107:0/1922572440 shutdown_connections 2023-08-10T10:40:16.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.802+0000 7fb4f53de700 1 --2- 172.21.15.107:0/1922572440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f007a320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.802+0000 7fb4f53de700 1 -- 172.21.15.107:0/1922572440 >> 172.21.15.107:0/1922572440 conn(0x7fb4f01014b0 msgr2=0x7fb4f01038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:16.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.802+0000 7fb4f53de700 1 -- 172.21.15.107:0/1922572440 shutdown_connections 2023-08-10T10:40:16.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.802+0000 7fb4f53de700 1 -- 172.21.15.107:0/1922572440 wait complete. 2023-08-10T10:40:16.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.803+0000 7fb4f53de700 1 Processor -- start 2023-08-10T10:40:16.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.803+0000 7fb4f53de700 1 -- start start 2023-08-10T10:40:16.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.803+0000 7fb4f53de700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:16.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.803+0000 7fb4f53de700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f019c270 con 0x7fb4f007bec0 2023-08-10T10:40:16.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.803+0000 7fb4eeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:16.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.804+0000 7fb4eeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f019bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44086/0 (socket says 172.21.15.107:44086) 2023-08-10T10:40:16.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.804+0000 7fb4eeffd700 1 -- 172.21.15.107:0/1412684857 learned_addr learned my addr 172.21.15.107:0/1412684857 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:16.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.804+0000 7fb4eeffd700 1 -- 172.21.15.107:0/1412684857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009550 con 0x7fb4f007bec0 2023-08-10T10:40:16.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.804+0000 7fb4eeffd700 1 --2- 172.21.15.107:0/1412684857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f019bd30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0000c00 tx=0x7fb4e0011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:16.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.804+0000 7fb4d7fff700 1 -- 172.21.15.107:0/1412684857 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e00036a0 con 0x7fb4f007bec0 2023-08-10T10:40:16.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.804+0000 7fb4f53de700 1 -- 172.21.15.107:0/1412684857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f019c470 con 0x7fb4f007bec0 2023-08-10T10:40:16.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.804+0000 7fb4d7fff700 1 -- 172.21.15.107:0/1412684857 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb4e0003c70 con 0x7fb4f007bec0 2023-08-10T10:40:16.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.804+0000 7fb4d7fff700 1 -- 172.21.15.107:0/1412684857 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e00193f0 con 0x7fb4f007bec0 2023-08-10T10:40:16.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.804+0000 7fb4f53de700 1 -- 172.21.15.107:0/1412684857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f019c890 con 0x7fb4f007bec0 2023-08-10T10:40:16.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.805+0000 7fb4d7fff700 1 -- 172.21.15.107:0/1412684857 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb4e0019970 con 0x7fb4f007bec0 2023-08-10T10:40:16.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.805+0000 7fb4d7fff700 1 -- 172.21.15.107:0/1412684857 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb4e001a3d0 con 0x7fb4f007bec0 2023-08-10T10:40:16.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.806+0000 7fb4f53de700 1 -- 172.21.15.107:0/1412684857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f010c1e0 con 0x7fb4f007bec0 2023-08-10T10:40:16.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.808+0000 7fb4d7fff700 1 -- 172.21.15.107:0/1412684857 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb4e0029060 con 0x7fb4f007bec0 2023-08-10T10:40:16.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.878+0000 7fb4f53de700 1 -- 172.21.15.107:0/1412684857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb4f019f8a0 con 0x7fb4f007bec0 2023-08-10T10:40:16.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.878+0000 7fb4d7fff700 1 -- 172.21.15.107:0/1412684857 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fb4e0033090 con 0x7fb4f007bec0 2023-08-10T10:40:16.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.879+0000 7fb4f53de700 1 -- 172.21.15.107:0/1412684857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 msgr2=0x7fb4f019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:16.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.879+0000 7fb4f53de700 1 --2- 172.21.15.107:0/1412684857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f019bd30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0000c00 tx=0x7fb4e0011e70 comp rx=0 tx=0).stop 2023-08-10T10:40:16.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.879+0000 7fb4f53de700 1 -- 172.21.15.107:0/1412684857 shutdown_connections 2023-08-10T10:40:16.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.879+0000 7fb4f53de700 1 --2- 172.21.15.107:0/1412684857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4f007bec0 0x7fb4f019bd30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:16.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.879+0000 7fb4f53de700 1 -- 172.21.15.107:0/1412684857 >> 172.21.15.107:0/1412684857 conn(0x7fb4f01014b0 msgr2=0x7fb4f0102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:16.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.880+0000 7fb4f53de700 1 -- 172.21.15.107:0/1412684857 shutdown_connections 2023-08-10T10:40:16.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:15.880+0000 7fb4f53de700 1 -- 172.21.15.107:0/1412684857 wait complete. 2023-08-10T10:40:16.546 INFO:teuthology.orchestra.run.smithi107.stdout:Restarting the monitor... 2023-08-10T10:40:16.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:16 smithi107 systemd[1]: Stopping Ceph mon.a for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:40:17.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:16 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-a[127416]: 2023-08-10T10:40:16.984+0000 7f471eac2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T10:40:17.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:16 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-a[127416]: 2023-08-10T10:40:16.984+0000 7f471eac2700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-08-10T10:40:17.715 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:17 smithi107 bash[127791]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-a 2023-08-10T10:40:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:17 smithi107 systemd[1]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.a.service: Succeeded. 2023-08-10T10:40:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:17 smithi107 systemd[1]: Stopped Ceph mon.a for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:40:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:17 smithi107 systemd[1]: Starting Ceph mon.a for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:40:18.448 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 podman[127913]: 2023-08-10T10:40:18.449 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 bash[127913]: c2ce6b5f6d2f7f8b745a483092999631a2a9f0f6f9528523d5d89c94fe46f271 2023-08-10T10:40:18.449 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: set uid:gid to 167:167 (ceph:ceph) 2023-08-10T10:40:18.485 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev), process ceph-mon, pid 7 2023-08-10T10:40:18.486 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: pidfile_write: ignore empty --pid-file 2023-08-10T10:40:18.486 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: load: jerasure load: lrc 2023-08-10T10:40:18.486 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: RocksDB version: 7.9.2 2023-08-10T10:40:18.486 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Git sha 0 2023-08-10T10:40:18.486 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Compile date 2023-08-03 13:43:35 2023-08-10T10:40:18.487 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: DB SUMMARY 2023-08-10T10:40:18.487 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: DB Session ID: MP5WMSRM2Y4AEYK4GS9P 2023-08-10T10:40:18.487 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: CURRENT file: CURRENT 2023-08-10T10:40:18.487 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: IDENTITY file: IDENTITY 2023-08-10T10:40:18.487 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-08-10T10:40:18.487 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-08-10T10:40:18.487 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99282 ; 2023-08-10T10:40:18.487 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.error_if_exists: 0 2023-08-10T10:40:18.488 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.create_if_missing: 0 2023-08-10T10:40:18.488 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.paranoid_checks: 1 2023-08-10T10:40:18.488 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.flush_verify_memtable_count: 1 2023-08-10T10:40:18.488 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-08-10T10:40:18.488 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-08-10T10:40:18.488 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.env: 0x55600c5f2c60 2023-08-10T10:40:18.488 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.fs: PosixFileSystem 2023-08-10T10:40:18.489 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.info_log: 0x55600dead2c0 2023-08-10T10:40:18.489 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_file_opening_threads: 16 2023-08-10T10:40:18.489 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.statistics: (nil) 2023-08-10T10:40:18.489 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.use_fsync: 0 2023-08-10T10:40:18.489 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_log_file_size: 0 2023-08-10T10:40:18.489 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-08-10T10:40:18.489 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.log_file_time_to_roll: 0 2023-08-10T10:40:18.489 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.keep_log_file_num: 1000 2023-08-10T10:40:18.490 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.recycle_log_file_num: 0 2023-08-10T10:40:18.490 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.allow_fallocate: 1 2023-08-10T10:40:18.490 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.allow_mmap_reads: 0 2023-08-10T10:40:18.490 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.allow_mmap_writes: 0 2023-08-10T10:40:18.490 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.use_direct_reads: 0 2023-08-10T10:40:18.490 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-08-10T10:40:18.490 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.create_missing_column_families: 0 2023-08-10T10:40:18.490 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.db_log_dir: 2023-08-10T10:40:18.491 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.wal_dir: 2023-08-10T10:40:18.491 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.table_cache_numshardbits: 6 2023-08-10T10:40:18.491 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.WAL_ttl_seconds: 0 2023-08-10T10:40:18.492 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.WAL_size_limit_MB: 0 2023-08-10T10:40:18.492 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-08-10T10:40:18.492 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-08-10T10:40:18.492 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.is_fd_close_on_exec: 1 2023-08-10T10:40:18.492 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.advise_random_on_open: 1 2023-08-10T10:40:18.492 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.db_write_buffer_size: 0 2023-08-10T10:40:18.492 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.write_buffer_manager: 0x55600ddce3c0 2023-08-10T10:40:18.493 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-08-10T10:40:18.493 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-08-10T10:40:18.493 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.use_adaptive_mutex: 0 2023-08-10T10:40:18.493 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.rate_limiter: (nil) 2023-08-10T10:40:18.493 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-08-10T10:40:18.493 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.wal_recovery_mode: 2 2023-08-10T10:40:18.493 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.enable_thread_tracking: 0 2023-08-10T10:40:18.493 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.enable_pipelined_write: 0 2023-08-10T10:40:18.494 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.unordered_write: 0 2023-08-10T10:40:18.494 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-08-10T10:40:18.494 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-08-10T10:40:18.494 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-08-10T10:40:18.494 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-08-10T10:40:18.494 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.row_cache: None 2023-08-10T10:40:18.495 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.wal_filter: None 2023-08-10T10:40:18.495 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-08-10T10:40:18.495 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.allow_ingest_behind: 0 2023-08-10T10:40:18.495 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.two_write_queues: 0 2023-08-10T10:40:18.495 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.manual_wal_flush: 0 2023-08-10T10:40:18.495 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.wal_compression: 0 2023-08-10T10:40:18.495 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.atomic_flush: 0 2023-08-10T10:40:18.496 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-08-10T10:40:18.496 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.persist_stats_to_disk: 0 2023-08-10T10:40:18.496 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.write_dbid_to_manifest: 0 2023-08-10T10:40:18.496 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.log_readahead_size: 0 2023-08-10T10:40:18.496 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-08-10T10:40:18.496 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.best_efforts_recovery: 0 2023-08-10T10:40:18.496 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-08-10T10:40:18.496 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-08-10T10:40:18.497 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.allow_data_in_errors: 0 2023-08-10T10:40:18.497 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.db_host_id: __hostname__ 2023-08-10T10:40:18.497 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.enforce_single_del_contracts: true 2023-08-10T10:40:18.498 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_background_jobs: 2 2023-08-10T10:40:18.498 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_background_compactions: -1 2023-08-10T10:40:18.498 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_subcompactions: 1 2023-08-10T10:40:18.498 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-08-10T10:40:18.499 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-08-10T10:40:18.499 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.delayed_write_rate : 16777216 2023-08-10T10:40:18.499 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_total_wal_size: 0 2023-08-10T10:40:18.499 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-08-10T10:40:18.499 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.stats_dump_period_sec: 600 2023-08-10T10:40:18.499 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.stats_persist_period_sec: 600 2023-08-10T10:40:18.499 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-08-10T10:40:18.500 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_open_files: -1 2023-08-10T10:40:18.500 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bytes_per_sync: 0 2023-08-10T10:40:18.500 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.wal_bytes_per_sync: 0 2023-08-10T10:40:18.500 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.strict_bytes_per_sync: 0 2023-08-10T10:40:18.500 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_readahead_size: 0 2023-08-10T10:40:18.500 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_background_flushes: -1 2023-08-10T10:40:18.500 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Compression algorithms supported: 2023-08-10T10:40:18.500 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-08-10T10:40:18.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: kZSTD supported: 0 2023-08-10T10:40:18.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: kXpressCompression supported: 0 2023-08-10T10:40:18.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: kLZ4HCCompression supported: 1 2023-08-10T10:40:18.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: kZlibCompression supported: 1 2023-08-10T10:40:18.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: kSnappyCompression supported: 1 2023-08-10T10:40:18.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: kLZ4Compression supported: 1 2023-08-10T10:40:18.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: kBZip2Compression supported: 0 2023-08-10T10:40:18.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Fast CRC32 supported: Supported on x86 2023-08-10T10:40:18.502 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: DMutex implementation: pthread_mutex_t 2023-08-10T10:40:18.502 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-08-10T10:40:18.502 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-08-10T10:40:18.502 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-08-10T10:40:18.502 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.merge_operator: 2023-08-10T10:40:18.502 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_filter: None 2023-08-10T10:40:18.503 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_filter_factory: None 2023-08-10T10:40:18.503 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.sst_partitioner_factory: None 2023-08-10T10:40:18.503 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.memtable_factory: SkipListFactory 2023-08-10T10:40:18.503 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.table_factory: BlockBasedTable 2023-08-10T10:40:18.503 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55600dead3c0) 2023-08-10T10:40:18.503 INFO:journalctl@ceph.mon.a.smithi107.stdout: cache_index_and_filter_blocks: 1 2023-08-10T10:40:18.503 INFO:journalctl@ceph.mon.a.smithi107.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-08-10T10:40:18.503 INFO:journalctl@ceph.mon.a.smithi107.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-08-10T10:40:18.504 INFO:journalctl@ceph.mon.a.smithi107.stdout: pin_top_level_index_and_filter: 1 2023-08-10T10:40:18.504 INFO:journalctl@ceph.mon.a.smithi107.stdout: index_type: 0 2023-08-10T10:40:18.504 INFO:journalctl@ceph.mon.a.smithi107.stdout: data_block_index_type: 0 2023-08-10T10:40:18.504 INFO:journalctl@ceph.mon.a.smithi107.stdout: index_shortening: 1 2023-08-10T10:40:18.504 INFO:journalctl@ceph.mon.a.smithi107.stdout: data_block_hash_table_util_ratio: 0.750000 2023-08-10T10:40:18.504 INFO:journalctl@ceph.mon.a.smithi107.stdout: checksum: 4 2023-08-10T10:40:18.504 INFO:journalctl@ceph.mon.a.smithi107.stdout: no_block_cache: 0 2023-08-10T10:40:18.505 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_cache: 0x55600de6d1f0 2023-08-10T10:40:18.505 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_cache_name: BinnedLRUCache 2023-08-10T10:40:18.505 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_cache_options: 2023-08-10T10:40:18.505 INFO:journalctl@ceph.mon.a.smithi107.stdout: capacity : 536870912 2023-08-10T10:40:18.505 INFO:journalctl@ceph.mon.a.smithi107.stdout: num_shard_bits : 4 2023-08-10T10:40:18.505 INFO:journalctl@ceph.mon.a.smithi107.stdout: strict_capacity_limit : 0 2023-08-10T10:40:18.506 INFO:journalctl@ceph.mon.a.smithi107.stdout: high_pri_pool_ratio: 0.000 2023-08-10T10:40:18.506 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_cache_compressed: (nil) 2023-08-10T10:40:18.506 INFO:journalctl@ceph.mon.a.smithi107.stdout: persistent_cache: (nil) 2023-08-10T10:40:18.506 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_size: 4096 2023-08-10T10:40:18.506 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_size_deviation: 10 2023-08-10T10:40:18.506 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_restart_interval: 16 2023-08-10T10:40:18.506 INFO:journalctl@ceph.mon.a.smithi107.stdout: index_block_restart_interval: 1 2023-08-10T10:40:18.506 INFO:journalctl@ceph.mon.a.smithi107.stdout: metadata_block_size: 4096 2023-08-10T10:40:18.507 INFO:journalctl@ceph.mon.a.smithi107.stdout: partition_filters: 0 2023-08-10T10:40:18.507 INFO:journalctl@ceph.mon.a.smithi107.stdout: use_delta_encoding: 1 2023-08-10T10:40:18.507 INFO:journalctl@ceph.mon.a.smithi107.stdout: filter_policy: bloomfilter 2023-08-10T10:40:18.507 INFO:journalctl@ceph.mon.a.smithi107.stdout: whole_key_filtering: 1 2023-08-10T10:40:18.507 INFO:journalctl@ceph.mon.a.smithi107.stdout: verify_compression: 0 2023-08-10T10:40:18.507 INFO:journalctl@ceph.mon.a.smithi107.stdout: read_amp_bytes_per_bit: 0 2023-08-10T10:40:18.507 INFO:journalctl@ceph.mon.a.smithi107.stdout: format_version: 5 2023-08-10T10:40:18.508 INFO:journalctl@ceph.mon.a.smithi107.stdout: enable_index_compression: 1 2023-08-10T10:40:18.508 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_align: 0 2023-08-10T10:40:18.508 INFO:journalctl@ceph.mon.a.smithi107.stdout: max_auto_readahead_size: 262144 2023-08-10T10:40:18.508 INFO:journalctl@ceph.mon.a.smithi107.stdout: prepopulate_block_cache: 0 2023-08-10T10:40:18.508 INFO:journalctl@ceph.mon.a.smithi107.stdout: initial_auto_readahead_size: 8192 2023-08-10T10:40:18.508 INFO:journalctl@ceph.mon.a.smithi107.stdout: num_file_reads_for_auto_readahead: 2 2023-08-10T10:40:18.508 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.write_buffer_size: 33554432 2023-08-10T10:40:18.508 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_write_buffer_number: 2 2023-08-10T10:40:18.509 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression: NoCompression 2023-08-10T10:40:18.509 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression: Disabled 2023-08-10T10:40:18.509 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.prefix_extractor: nullptr 2023-08-10T10:40:18.509 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-08-10T10:40:18.509 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.num_levels: 7 2023-08-10T10:40:18.509 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-08-10T10:40:18.509 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-08-10T10:40:18.509 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-08-10T10:40:18.510 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-08-10T10:40:18.510 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-08-10T10:40:18.510 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-08-10T10:40:18.510 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-08-10T10:40:18.510 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-08-10T10:40:18.510 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-08-10T10:40:18.510 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-08-10T10:40:18.511 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-08-10T10:40:18.511 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-08-10T10:40:18.511 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression_opts.window_bits: -14 2023-08-10T10:40:18.511 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression_opts.level: 32767 2023-08-10T10:40:18.511 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression_opts.strategy: 0 2023-08-10T10:40:18.511 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-08-10T10:40:18.511 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-08-10T10:40:18.511 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-08-10T10:40:18.512 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-08-10T10:40:18.512 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression_opts.enabled: false 2023-08-10T10:40:18.512 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-08-10T10:40:18.512 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-08-10T10:40:18.512 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-08-10T10:40:18.512 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-08-10T10:40:18.512 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.target_file_size_base: 67108864 2023-08-10T10:40:18.512 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.target_file_size_multiplier: 1 2023-08-10T10:40:18.513 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-08-10T10:40:18.513 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-08-10T10:40:18.513 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-08-10T10:40:18.513 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-08-10T10:40:18.513 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-08-10T10:40:18.513 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-08-10T10:40:18.513 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-08-10T10:40:18.514 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-08-10T10:40:18.514 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-08-10T10:40:18.514 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-08-10T10:40:18.514 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-08-10T10:40:18.514 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-08-10T10:40:18.514 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-08-10T10:40:18.514 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.arena_block_size: 1048576 2023-08-10T10:40:18.514 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-08-10T10:40:18.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-08-10T10:40:18.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.disable_auto_compactions: 0 2023-08-10T10:40:18.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-08-10T10:40:18.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-08-10T10:40:18.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-08-10T10:40:18.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-08-10T10:40:18.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-08-10T10:40:18.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-08-10T10:40:18.516 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-08-10T10:40:18.516 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-08-10T10:40:18.516 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-08-10T10:40:18.516 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-08-10T10:40:18.516 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.table_properties_collectors: 2023-08-10T10:40:18.516 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.inplace_update_support: 0 2023-08-10T10:40:18.516 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.inplace_update_num_locks: 10000 2023-08-10T10:40:18.517 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-08-10T10:40:18.517 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-08-10T10:40:18.517 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.memtable_huge_page_size: 0 2023-08-10T10:40:18.517 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.bloom_locality: 0 2023-08-10T10:40:18.517 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.max_successive_merges: 0 2023-08-10T10:40:18.517 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.optimize_filters_for_hits: 0 2023-08-10T10:40:18.517 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.paranoid_file_checks: 0 2023-08-10T10:40:18.518 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.force_consistency_checks: 1 2023-08-10T10:40:18.518 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.report_bg_io_stats: 0 2023-08-10T10:40:18.518 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.ttl: 2592000 2023-08-10T10:40:18.518 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.periodic_compaction_seconds: 0 2023-08-10T10:40:18.518 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-08-10T10:40:18.518 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-08-10T10:40:18.518 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.enable_blob_files: false 2023-08-10T10:40:18.518 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.min_blob_size: 0 2023-08-10T10:40:18.519 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.blob_file_size: 268435456 2023-08-10T10:40:18.519 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.blob_compression_type: NoCompression 2023-08-10T10:40:18.519 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.enable_blob_garbage_collection: false 2023-08-10T10:40:18.519 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-08-10T10:40:18.519 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-08-10T10:40:18.519 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-08-10T10:40:18.519 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.blob_file_starting_level: 0 2023-08-10T10:40:18.520 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-08-10T10:40:18.520 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-08-10T10:40:18.520 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-08-10T10:40:18.520 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e95136ab-322a-48c6-a76d-166ffbde0eb1 2023-08-10T10:40:18.520 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691664018456965, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-08-10T10:40:18.520 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-08-10T10:40:18.520 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691664018459029, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94265, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 323, "table_properties": {"data_size": 92276, "index_size": 271, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13654, "raw_average_key_size": 49, "raw_value_size": 84838, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 274, "num_filter_entries": 274, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1691664018, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e95136ab-322a-48c6-a76d-166ffbde0eb1", "db_session_id": "MP5WMSRM2Y4AEYK4GS9P", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-08-10T10:40:18.521 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691664018459239, "job": 1, "event": "recovery_finished"} 2023-08-10T10:40:18.521 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-08-10T10:40:18.521 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-08-10T10:40:18.521 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55600df08000 2023-08-10T10:40:18.521 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: DB pointer 0x55600def4000 2023-08-10T10:40:18.521 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-08-10T10:40:18.521 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-08-10T10:40:18.521 INFO:journalctl@ceph.mon.a.smithi107.stdout: ** DB Stats ** 2023-08-10T10:40:18.522 INFO:journalctl@ceph.mon.a.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T10:40:18.522 INFO:journalctl@ceph.mon.a.smithi107.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-08-10T10:40:18.522 INFO:journalctl@ceph.mon.a.smithi107.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T10:40:18.522 INFO:journalctl@ceph.mon.a.smithi107.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T10:40:18.522 INFO:journalctl@ceph.mon.a.smithi107.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-08-10T10:40:18.522 INFO:journalctl@ceph.mon.a.smithi107.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T10:40:18.522 INFO:journalctl@ceph.mon.a.smithi107.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T10:40:18.522 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2023-08-10T10:40:18.523 INFO:journalctl@ceph.mon.a.smithi107.stdout: ** Compaction Stats [default] ** 2023-08-10T10:40:18.523 INFO:journalctl@ceph.mon.a.smithi107.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T10:40:18.523 INFO:journalctl@ceph.mon.a.smithi107.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-08-10T10:40:18.523 INFO:journalctl@ceph.mon.a.smithi107.stdout: L0 2/0 93.89 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 62.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-10T10:40:18.523 INFO:journalctl@ceph.mon.a.smithi107.stdout: Sum 2/0 93.89 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 62.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-10T10:40:18.523 INFO:journalctl@ceph.mon.a.smithi107.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 62.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-10T10:40:18.523 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2023-08-10T10:40:18.524 INFO:journalctl@ceph.mon.a.smithi107.stdout: ** Compaction Stats [default] ** 2023-08-10T10:40:18.524 INFO:journalctl@ceph.mon.a.smithi107.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T10:40:18.524 INFO:journalctl@ceph.mon.a.smithi107.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-08-10T10:40:18.524 INFO:journalctl@ceph.mon.a.smithi107.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 62.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-08-10T10:40:18.524 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2023-08-10T10:40:18.524 INFO:journalctl@ceph.mon.a.smithi107.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-08-10T10:40:18.525 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2023-08-10T10:40:18.525 INFO:journalctl@ceph.mon.a.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T10:40:18.525 INFO:journalctl@ceph.mon.a.smithi107.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-08-10T10:40:18.525 INFO:journalctl@ceph.mon.a.smithi107.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-08-10T10:40:18.525 INFO:journalctl@ceph.mon.a.smithi107.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-08-10T10:40:18.525 INFO:journalctl@ceph.mon.a.smithi107.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-08-10T10:40:18.526 INFO:journalctl@ceph.mon.a.smithi107.stdout: AddFile(Keys): cumulative 0, interval 0 2023-08-10T10:40:18.526 INFO:journalctl@ceph.mon.a.smithi107.stdout: Cumulative compaction: 0.00 GB write, 12.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T10:40:18.526 INFO:journalctl@ceph.mon.a.smithi107.stdout: Interval compaction: 0.00 GB write, 12.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T10:40:18.526 INFO:journalctl@ceph.mon.a.smithi107.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-08-10T10:40:18.526 INFO:journalctl@ceph.mon.a.smithi107.stdout: Block cache BinnedLRUCache@0x55600de6d1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-08-10T10:40:18.526 INFO:journalctl@ceph.mon.a.smithi107.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-08-10T10:40:18.526 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2023-08-10T10:40:18.526 INFO:journalctl@ceph.mon.a.smithi107.stdout: ** File Read Latency Histogram By Level [default] ** 2023-08-10T10:40:18.527 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: starting mon.a rank 0 at public addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] at bind addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:18.527 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mon.a@-1(???) e1 preinit fsid 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:18.527 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mon.a@-1(???).mds e1 new map 2023-08-10T10:40:18.527 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mon.a@-1(???).mds e1 print_map 2023-08-10T10:40:18.527 INFO:journalctl@ceph.mon.a.smithi107.stdout: e1 2023-08-10T10:40:18.527 INFO:journalctl@ceph.mon.a.smithi107.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-08-10T10:40:18.527 INFO:journalctl@ceph.mon.a.smithi107.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-08-10T10:40:18.528 INFO:journalctl@ceph.mon.a.smithi107.stdout: legacy client fscid: -1 2023-08-10T10:40:18.528 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2023-08-10T10:40:18.528 INFO:journalctl@ceph.mon.a.smithi107.stdout: No filesystems configured 2023-08-10T10:40:18.528 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-08-10T10:40:18.528 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T10:40:18.528 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T10:40:18.528 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T10:40:18.529 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-08-10T10:40:18.529 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta expand map: {default=false} 2023-08-10T10:40:18.529 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta from 'false' to 'false' 2023-08-10T10:40:18.529 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta expanded map: {default=false} 2023-08-10T10:40:18.529 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta expand map: {default=info} 2023-08-10T10:40:18.529 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta from 'info' to 'info' 2023-08-10T10:40:18.529 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta expanded map: {default=info} 2023-08-10T10:40:18.530 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta expand map: {default=daemon} 2023-08-10T10:40:18.530 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta from 'daemon' to 'daemon' 2023-08-10T10:40:18.530 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta expanded map: {default=daemon} 2023-08-10T10:40:18.530 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta expand map: {default=debug} 2023-08-10T10:40:18.530 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta from 'debug' to 'debug' 2023-08-10T10:40:18.530 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: expand_channel_meta expanded map: {default=debug} 2023-08-10T10:40:18.530 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 systemd[1]: Started Ceph mon.a for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:40:18.531 INFO:teuthology.orchestra.run.smithi107.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-08-10T10:40:18.779 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mon.a is new leader, mons a in quorum (ranks 0) 2023-08-10T10:40:18.780 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: monmap e1: 1 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0]} removed_ranks: {} 2023-08-10T10:40:18.780 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: fsmap 2023-08-10T10:40:18.780 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: osdmap e1: 0 total, 0 up, 0 in 2023-08-10T10:40:18.780 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:18 smithi107 ceph-mon[127953]: mgrmap e1: no daemons active 2023-08-10T10:40:19.572 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.032+0000 7f31978d4700 1 Processor -- start 2023-08-10T10:40:19.573 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.033+0000 7f31978d4700 1 -- start start 2023-08-10T10:40:19.573 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.033+0000 7f31978d4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319007a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.573 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.033+0000 7f31978d4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319007a8d0 con 0x7f319007bea0 2023-08-10T10:40:19.573 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.034+0000 7f3195670700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319007a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:19.574 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.034+0000 7f3195670700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319007a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44090/0 (socket says 172.21.15.107:44090) 2023-08-10T10:40:19.574 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.034+0000 7f3195670700 1 -- 172.21.15.107:0/962044900 learned_addr learned my addr 172.21.15.107:0/962044900 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:19.574 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.034+0000 7f3195670700 1 -- 172.21.15.107:0/962044900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319007aa10 con 0x7f319007bea0 2023-08-10T10:40:19.574 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.034+0000 7f3195670700 1 --2- 172.21.15.107:0/962044900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319007a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f318c0098a0 tx=0x7f318c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad2af6910aad31c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:19.577 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f3187fff700 1 -- 172.21.15.107:0/962044900 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f318c004160 con 0x7f319007bea0 2023-08-10T10:40:19.577 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f3187fff700 1 -- 172.21.15.107:0/962044900 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f318c0042c0 con 0x7f319007bea0 2023-08-10T10:40:19.577 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f3187fff700 1 -- 172.21.15.107:0/962044900 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f318c011940 con 0x7f319007bea0 2023-08-10T10:40:19.578 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f31978d4700 1 -- 172.21.15.107:0/962044900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 msgr2=0x7f319007a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.578 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f31978d4700 1 --2- 172.21.15.107:0/962044900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319007a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f318c0098a0 tx=0x7f318c009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.578 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f31978d4700 1 -- 172.21.15.107:0/962044900 shutdown_connections 2023-08-10T10:40:19.578 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f31978d4700 1 --2- 172.21.15.107:0/962044900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319007a300 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.578 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f31978d4700 1 -- 172.21.15.107:0/962044900 >> 172.21.15.107:0/962044900 conn(0x7f3190101470 msgr2=0x7f3190103890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:19.578 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f31978d4700 1 -- 172.21.15.107:0/962044900 shutdown_connections 2023-08-10T10:40:19.578 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.035+0000 7f31978d4700 1 -- 172.21.15.107:0/962044900 wait complete. 2023-08-10T10:40:19.579 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.037+0000 7f31978d4700 1 Processor -- start 2023-08-10T10:40:19.579 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.037+0000 7f31978d4700 1 -- start start 2023-08-10T10:40:19.579 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.037+0000 7f31978d4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:19.579 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.037+0000 7f31978d4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319019c220 con 0x7f319007bea0 2023-08-10T10:40:19.579 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.037+0000 7f3195670700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:19.579 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.037+0000 7f3195670700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319019bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44100/0 (socket says 172.21.15.107:44100) 2023-08-10T10:40:19.579 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.037+0000 7f3195670700 1 -- 172.21.15.107:0/2307546991 learned_addr learned my addr 172.21.15.107:0/2307546991 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:19.580 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.038+0000 7f3195670700 1 -- 172.21.15.107:0/2307546991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c009550 con 0x7f319007bea0 2023-08-10T10:40:19.580 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.038+0000 7f3195670700 1 --2- 172.21.15.107:0/2307546991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319019bce0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f318c000c00 tx=0x7f318c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:19.580 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.038+0000 7f31867fc700 1 -- 172.21.15.107:0/2307546991 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f318c0036a0 con 0x7f319007bea0 2023-08-10T10:40:19.580 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.038+0000 7f31867fc700 1 -- 172.21.15.107:0/2307546991 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f318c003c70 con 0x7f319007bea0 2023-08-10T10:40:19.580 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.038+0000 7f31978d4700 1 -- 172.21.15.107:0/2307546991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319019c420 con 0x7f319007bea0 2023-08-10T10:40:19.580 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.038+0000 7f31867fc700 1 -- 172.21.15.107:0/2307546991 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f318c0193f0 con 0x7f319007bea0 2023-08-10T10:40:19.580 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.038+0000 7f31978d4700 1 -- 172.21.15.107:0/2307546991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319019c840 con 0x7f319007bea0 2023-08-10T10:40:19.580 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.039+0000 7f31867fc700 1 -- 172.21.15.107:0/2307546991 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f318c019970 con 0x7f319007bea0 2023-08-10T10:40:19.581 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.039+0000 7f31867fc700 1 -- 172.21.15.107:0/2307546991 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f318c01a3d0 con 0x7f319007bea0 2023-08-10T10:40:19.581 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.039+0000 7f31978d4700 1 -- 172.21.15.107:0/2307546991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3190061da0 con 0x7f319007bea0 2023-08-10T10:40:19.581 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.042+0000 7f31867fc700 1 -- 172.21.15.107:0/2307546991 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f318c029060 con 0x7f319007bea0 2023-08-10T10:40:19.581 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.112+0000 7f31978d4700 1 -- 172.21.15.107:0/2307546991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f319019f240 con 0x7f319007bea0 2023-08-10T10:40:19.581 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.114+0000 7f31867fc700 1 -- 172.21.15.107:0/2307546991 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f318c0330c0 con 0x7f319007bea0 2023-08-10T10:40:19.581 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.115+0000 7f31978d4700 1 -- 172.21.15.107:0/2307546991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 msgr2=0x7f319019bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:19.581 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.115+0000 7f31978d4700 1 --2- 172.21.15.107:0/2307546991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319019bce0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f318c000c00 tx=0x7f318c011e70 comp rx=0 tx=0).stop 2023-08-10T10:40:19.581 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.115+0000 7f31978d4700 1 -- 172.21.15.107:0/2307546991 shutdown_connections 2023-08-10T10:40:19.582 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.115+0000 7f31978d4700 1 --2- 172.21.15.107:0/2307546991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f319007bea0 0x7f319019bce0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:19.582 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.115+0000 7f31978d4700 1 -- 172.21.15.107:0/2307546991 >> 172.21.15.107:0/2307546991 conn(0x7f3190101470 msgr2=0x7f3190102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:19.582 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.115+0000 7f31978d4700 1 -- 172.21.15.107:0/2307546991 shutdown_connections 2023-08-10T10:40:19.582 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:19.115+0000 7f31978d4700 1 -- 172.21.15.107:0/2307546991 wait complete. 2023-08-10T10:40:19.582 INFO:teuthology.orchestra.run.smithi107.stdout:Wrote config to /etc/ceph/ceph.conf 2023-08-10T10:40:19.592 INFO:teuthology.orchestra.run.smithi107.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-08-10T10:40:19.593 INFO:teuthology.orchestra.run.smithi107.stdout:Creating mgr... 2023-08-10T10:40:19.593 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying port 9283 ... 2023-08-10T10:40:19.594 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying port 8765 ... 2023-08-10T10:40:20.006 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.x 2023-08-10T10:40:20.007 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.x.service: Unit ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.x.service not loaded. 2023-08-10T10:40:20.215 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2b47e340-376a-11ee-9b37-001a4aab830c.target.wants/ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-2b47e340-376a-11ee-9b37-001a4aab830c@.service. 2023-08-10T10:40:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:20 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2307546991' entity='client.admin' 2023-08-10T10:40:20.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:20 smithi107 systemd[1]: Starting Ceph mgr.x for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:40:21.009 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-10T10:40:21.009 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2023-08-10T10:40:21.026 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-10T10:40:21.027 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2023-08-10T10:40:21.028 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2023-08-10T10:40:21.028 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to enable service . firewalld.service is not available 2023-08-10T10:40:21.043 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-10T10:40:21.044 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2023-08-10T10:40:21.060 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-10T10:40:21.061 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2023-08-10T10:40:21.061 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2023-08-10T10:40:21.061 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-08-10T10:40:21.062 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr to start... 2023-08-10T10:40:21.062 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr... 2023-08-10T10:40:21.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:20 smithi107 podman[128185]: 2023-08-10T10:40:21.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:20 smithi107 bash[128185]: 5daa8652a44e4076acaee51884219b4688ab356a505f72b81e7c8ab20d4521e2 2023-08-10T10:40:21.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:20 smithi107 systemd[1]: Started Ceph mgr.x for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:40:21.426 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:21 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:21.157+0000 7f699ba03200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:40:21.426 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:21 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:21.262+0000 7f699ba03200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:40:21.426 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:21 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:21.382+0000 7f699ba03200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:40:21.732 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:21 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:21.511+0000 7f699ba03200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:40:22.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:21 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1534143634' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-10T10:40:22.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:21 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:21.744+0000 7f699ba03200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:40:22.151 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:22.152 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2023-08-10T10:40:22.152 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:40:22.152 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2023-08-10T10:40:22.152 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-10T10:40:22.152 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-10T10:40:22.153 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-10T10:40:22.153 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:22.153 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-10T10:40:22.153 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-10T10:40:22.153 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2023-08-10T10:40:22.153 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2023-08-10T10:40:22.153 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-10T10:40:22.153 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "a" 2023-08-10T10:40:22.154 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2023-08-10T10:40:22.154 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-08-10T10:40:22.154 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-10T10:40:22.154 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:22.154 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-10T10:40:22.154 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-10T10:40:22.154 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:22.154 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-10T10:40:22.155 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:22.155 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-10T10:40:22.155 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-10T10:40:22.155 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-10T10:40:22.160 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-10T10:40:22.161 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-10T10:40:22.161 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-10T10:40:22.161 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:22.161 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-10T10:40:22.161 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-10T10:40:22.161 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-10T10:40:22.162 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-10T10:40:22.162 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-10T10:40:22.162 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-10T10:40:22.162 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-10T10:40:22.162 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-10T10:40:22.162 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-10T10:40:22.162 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:22.163 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-10T10:40:22.163 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:22.163 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-10T10:40:22.163 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-10T10:40:22.163 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:22.163 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-10T10:40:22.163 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": false, 2023-08-10T10:40:22.163 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-10T10:40:22.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-10T10:40:22.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-10T10:40:22.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-10T10:40:22.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2023-08-10T10:40:22.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2023-08-10T10:40:22.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T10:40:22.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:22.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-10T10:40:22.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:22.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2023-08-10T10:40:11.954259+0000", 2023-08-10T10:40:22.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T10:40:22.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:22.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-10T10:40:22.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2023-08-10T10:40:22.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.624+0000 7ffb65b40700 1 Processor -- start 2023-08-10T10:40:22.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.625+0000 7ffb65b40700 1 -- start start 2023-08-10T10:40:22.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.625+0000 7ffb65b40700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb601062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:22.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.625+0000 7ffb65b40700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601067f0 con 0x7ffb60105e90 2023-08-10T10:40:22.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.625+0000 7ffb5f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb601062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:22.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.626+0000 7ffb5f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb601062b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44120/0 (socket says 172.21.15.107:44120) 2023-08-10T10:40:22.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.626+0000 7ffb5f7fe700 1 -- 172.21.15.107:0/475585511 learned_addr learned my addr 172.21.15.107:0/475585511 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:22.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.626+0000 7ffb5f7fe700 1 -- 172.21.15.107:0/475585511 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60106930 con 0x7ffb60105e90 2023-08-10T10:40:22.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.626+0000 7ffb5f7fe700 1 --2- 172.21.15.107:0/475585511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb601062b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffb500098a0 tx=0x7ffb50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca0e9ea3e3919e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:22.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.626+0000 7ffb5e7fc700 1 -- 172.21.15.107:0/475585511 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb50004160 con 0x7ffb60105e90 2023-08-10T10:40:22.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.626+0000 7ffb5e7fc700 1 -- 172.21.15.107:0/475585511 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ffb500042c0 con 0x7ffb60105e90 2023-08-10T10:40:22.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.626+0000 7ffb5e7fc700 1 -- 172.21.15.107:0/475585511 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb50011940 con 0x7ffb60105e90 2023-08-10T10:40:22.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.627+0000 7ffb65b40700 1 -- 172.21.15.107:0/475585511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 msgr2=0x7ffb601062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:22.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.627+0000 7ffb65b40700 1 --2- 172.21.15.107:0/475585511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb601062b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffb500098a0 tx=0x7ffb50009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.627+0000 7ffb65b40700 1 -- 172.21.15.107:0/475585511 shutdown_connections 2023-08-10T10:40:22.171 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.627+0000 7ffb65b40700 1 --2- 172.21.15.107:0/475585511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb601062b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.627+0000 7ffb65b40700 1 -- 172.21.15.107:0/475585511 >> 172.21.15.107:0/475585511 conn(0x7ffb601014b0 msgr2=0x7ffb601038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:22.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.627+0000 7ffb65b40700 1 -- 172.21.15.107:0/475585511 shutdown_connections 2023-08-10T10:40:22.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.627+0000 7ffb65b40700 1 -- 172.21.15.107:0/475585511 wait complete. 2023-08-10T10:40:22.173 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.628+0000 7ffb65b40700 1 Processor -- start 2023-08-10T10:40:22.173 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.628+0000 7ffb65b40700 1 -- start start 2023-08-10T10:40:22.174 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.629+0000 7ffb65b40700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb6007bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:22.174 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.629+0000 7ffb65b40700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6007c190 con 0x7ffb60105e90 2023-08-10T10:40:22.174 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.629+0000 7ffb5f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb6007bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:22.174 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.629+0000 7ffb5f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb6007bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44134/0 (socket says 172.21.15.107:44134) 2023-08-10T10:40:22.175 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.629+0000 7ffb5f7fe700 1 -- 172.21.15.107:0/1534143634 learned_addr learned my addr 172.21.15.107:0/1534143634 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:22.175 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.629+0000 7ffb5f7fe700 1 -- 172.21.15.107:0/1534143634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb50009550 con 0x7ffb60105e90 2023-08-10T10:40:22.175 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.630+0000 7ffb5f7fe700 1 --2- 172.21.15.107:0/1534143634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb6007bc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffb50006af0 tx=0x7ffb50011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:22.175 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.630+0000 7ffb5cff9700 1 -- 172.21.15.107:0/1534143634 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb50003bf0 con 0x7ffb60105e90 2023-08-10T10:40:22.175 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.630+0000 7ffb5cff9700 1 -- 172.21.15.107:0/1534143634 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ffb5001b8b0 con 0x7ffb60105e90 2023-08-10T10:40:22.176 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.630+0000 7ffb65b40700 1 -- 172.21.15.107:0/1534143634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6007a2a0 con 0x7ffb60105e90 2023-08-10T10:40:22.176 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.630+0000 7ffb5cff9700 1 -- 172.21.15.107:0/1534143634 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb500197b0 con 0x7ffb60105e90 2023-08-10T10:40:22.176 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.630+0000 7ffb65b40700 1 -- 172.21.15.107:0/1534143634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6007a6c0 con 0x7ffb60105e90 2023-08-10T10:40:22.177 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.630+0000 7ffb5cff9700 1 -- 172.21.15.107:0/1534143634 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffb500233f0 con 0x7ffb60105e90 2023-08-10T10:40:22.177 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.630+0000 7ffb5cff9700 1 -- 172.21.15.107:0/1534143634 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffb5001a7e0 con 0x7ffb60105e90 2023-08-10T10:40:22.177 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.632+0000 7ffb467fc700 1 -- 172.21.15.107:0/1534143634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb400052f0 con 0x7ffb60105e90 2023-08-10T10:40:22.177 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.634+0000 7ffb5cff9700 1 -- 172.21.15.107:0/1534143634 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ffb50028060 con 0x7ffb60105e90 2023-08-10T10:40:22.177 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.708+0000 7ffb467fc700 1 -- 172.21.15.107:0/1534143634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ffb40005160 con 0x7ffb60105e90 2023-08-10T10:40:22.178 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.709+0000 7ffb5cff9700 1 -- 172.21.15.107:0/1534143634 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7ffb50031090 con 0x7ffb60105e90 2023-08-10T10:40:22.178 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.710+0000 7ffb467fc700 1 -- 172.21.15.107:0/1534143634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 msgr2=0x7ffb6007bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:22.178 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.710+0000 7ffb467fc700 1 --2- 172.21.15.107:0/1534143634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb6007bc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffb50006af0 tx=0x7ffb50011a30 comp rx=0 tx=0).stop 2023-08-10T10:40:22.178 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.710+0000 7ffb467fc700 1 -- 172.21.15.107:0/1534143634 shutdown_connections 2023-08-10T10:40:22.178 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.710+0000 7ffb467fc700 1 --2- 172.21.15.107:0/1534143634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb60105e90 0x7ffb6007bc50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:22.178 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.710+0000 7ffb467fc700 1 -- 172.21.15.107:0/1534143634 >> 172.21.15.107:0/1534143634 conn(0x7ffb601014b0 msgr2=0x7ffb601022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:22.178 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.710+0000 7ffb467fc700 1 -- 172.21.15.107:0/1534143634 shutdown_connections 2023-08-10T10:40:22.179 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:21.710+0000 7ffb467fc700 1 -- 172.21.15.107:0/1534143634 wait complete. 2023-08-10T10:40:22.179 INFO:teuthology.orchestra.run.smithi107.stdout:mgr not available, waiting (1/15)... 2023-08-10T10:40:22.430 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:22 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:22.155+0000 7f699ba03200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:40:22.431 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:22 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:22.270+0000 7f699ba03200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:40:22.431 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:22 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:22.429+0000 7f699ba03200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:40:22.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:22 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:22.552+0000 7f699ba03200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:40:23.576 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:23 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:23.096+0000 7f699ba03200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:40:24.326 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:23 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:23.868+0000 7f699ba03200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:40:24.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:24 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:24.073+0000 7f699ba03200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:40:25.058 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:24 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2188643625' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-10T10:40:25.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:25.241 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2023-08-10T10:40:25.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:40:25.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2023-08-10T10:40:25.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-10T10:40:25.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-10T10:40:25.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-10T10:40:25.242 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:25.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-10T10:40:25.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-10T10:40:25.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2023-08-10T10:40:25.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2023-08-10T10:40:25.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-10T10:40:25.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "a" 2023-08-10T10:40:25.243 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2023-08-10T10:40:25.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-08-10T10:40:25.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-10T10:40:25.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:25.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-10T10:40:25.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-10T10:40:25.244 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:25.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-10T10:40:25.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:25.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-10T10:40:25.245 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-10T10:40:25.251 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-10T10:40:25.252 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-10T10:40:25.252 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-10T10:40:25.252 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-10T10:40:25.252 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:25.252 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-10T10:40:25.253 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-10T10:40:25.253 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-10T10:40:25.253 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-10T10:40:25.253 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-10T10:40:25.253 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-10T10:40:25.253 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-10T10:40:25.254 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-10T10:40:25.254 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-10T10:40:25.254 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:25.254 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-10T10:40:25.254 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:25.254 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-10T10:40:25.255 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-10T10:40:25.255 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:25.255 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-10T10:40:25.255 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": false, 2023-08-10T10:40:25.255 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-10T10:40:25.255 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-10T10:40:25.255 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-10T10:40:25.256 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-10T10:40:25.256 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2023-08-10T10:40:25.256 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2023-08-10T10:40:25.256 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T10:40:25.256 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:25.256 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-10T10:40:25.256 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:25.257 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2023-08-10T10:40:11.954259+0000", 2023-08-10T10:40:25.257 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T10:40:25.257 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:25.257 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-10T10:40:25.257 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2023-08-10T10:40:25.257 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.688+0000 7f41a45db700 1 Processor -- start 2023-08-10T10:40:25.257 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.688+0000 7f41a45db700 1 -- start start 2023-08-10T10:40:25.257 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.688+0000 7f41a45db700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c07a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.688+0000 7f41a45db700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c07a8b0 con 0x7f419c07be80 2023-08-10T10:40:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.689+0000 7f41a2377700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c07a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.689+0000 7f41a2377700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c07a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39404/0 (socket says 172.21.15.107:39404) 2023-08-10T10:40:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.689+0000 7f41a2377700 1 -- 172.21.15.107:0/2879107566 learned_addr learned my addr 172.21.15.107:0/2879107566 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.689+0000 7f41a2377700 1 -- 172.21.15.107:0/2879107566 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c07a9f0 con 0x7f419c07be80 2023-08-10T10:40:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.689+0000 7f41a2377700 1 --2- 172.21.15.107:0/2879107566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c07a2e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f41980098a0 tx=0x7f4198009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41da34b9320f329f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.258 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.690+0000 7f41a1375700 1 -- 172.21.15.107:0/2879107566 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4198004160 con 0x7f419c07be80 2023-08-10T10:40:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.690+0000 7f41a1375700 1 -- 172.21.15.107:0/2879107566 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f41980042c0 con 0x7f419c07be80 2023-08-10T10:40:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.690+0000 7f41a1375700 1 -- 172.21.15.107:0/2879107566 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4198011940 con 0x7f419c07be80 2023-08-10T10:40:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.690+0000 7f41a45db700 1 -- 172.21.15.107:0/2879107566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 msgr2=0x7f419c07a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.690+0000 7f41a45db700 1 --2- 172.21.15.107:0/2879107566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c07a2e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f41980098a0 tx=0x7f4198009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.690+0000 7f41a45db700 1 -- 172.21.15.107:0/2879107566 shutdown_connections 2023-08-10T10:40:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.690+0000 7f41a45db700 1 --2- 172.21.15.107:0/2879107566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c07a2e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.690+0000 7f41a45db700 1 -- 172.21.15.107:0/2879107566 >> 172.21.15.107:0/2879107566 conn(0x7f419c1014b0 msgr2=0x7f419c1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:25.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.691+0000 7f41a45db700 1 -- 172.21.15.107:0/2879107566 shutdown_connections 2023-08-10T10:40:25.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.691+0000 7f41a45db700 1 -- 172.21.15.107:0/2879107566 wait complete. 2023-08-10T10:40:25.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.691+0000 7f41a45db700 1 Processor -- start 2023-08-10T10:40:25.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.692+0000 7f41a45db700 1 -- start start 2023-08-10T10:40:25.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.692+0000 7f41a45db700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:25.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.692+0000 7f41a45db700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c19c280 con 0x7f419c07be80 2023-08-10T10:40:25.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.692+0000 7f41a2377700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:25.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.692+0000 7f41a2377700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39414/0 (socket says 172.21.15.107:39414) 2023-08-10T10:40:25.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.692+0000 7f41a2377700 1 -- 172.21.15.107:0/2188643625 learned_addr learned my addr 172.21.15.107:0/2188643625 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:25.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.693+0000 7f41a2377700 1 -- 172.21.15.107:0/2188643625 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198009550 con 0x7f419c07be80 2023-08-10T10:40:25.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.693+0000 7f41a2377700 1 --2- 172.21.15.107:0/2188643625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c19bd40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4198011dc0 tx=0x7f4198011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:25.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.693+0000 7f41937fe700 1 -- 172.21.15.107:0/2188643625 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41980037d0 con 0x7f419c07be80 2023-08-10T10:40:25.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.693+0000 7f41937fe700 1 -- 172.21.15.107:0/2188643625 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f419801b440 con 0x7f419c07be80 2023-08-10T10:40:25.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.693+0000 7f41a45db700 1 -- 172.21.15.107:0/2188643625 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c19c480 con 0x7f419c07be80 2023-08-10T10:40:25.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.693+0000 7f41937fe700 1 -- 172.21.15.107:0/2188643625 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f419801a560 con 0x7f419c07be80 2023-08-10T10:40:25.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.693+0000 7f41a45db700 1 -- 172.21.15.107:0/2188643625 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c19c8a0 con 0x7f419c07be80 2023-08-10T10:40:25.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.694+0000 7f41937fe700 1 -- 172.21.15.107:0/2188643625 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f419801ab20 con 0x7f419c07be80 2023-08-10T10:40:25.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.694+0000 7f41937fe700 1 -- 172.21.15.107:0/2188643625 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f41980193f0 con 0x7f419c07be80 2023-08-10T10:40:25.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.694+0000 7f41a45db700 1 -- 172.21.15.107:0/2188643625 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c061da0 con 0x7f419c07be80 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.699+0000 7f41937fe700 1 -- 172.21.15.107:0/2188643625 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f4198029060 con 0x7f419c07be80 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.773+0000 7f41a45db700 1 -- 172.21.15.107:0/2188643625 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f419c19f390 con 0x7f419c07be80 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.773+0000 7f41937fe700 1 -- 172.21.15.107:0/2188643625 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f419801f070 con 0x7f419c07be80 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.774+0000 7f41a45db700 1 -- 172.21.15.107:0/2188643625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 msgr2=0x7f419c19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:25.263 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.774+0000 7f41a45db700 1 --2- 172.21.15.107:0/2188643625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c19bd40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4198011dc0 tx=0x7f4198011ea0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.264 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.774+0000 7f41a45db700 1 -- 172.21.15.107:0/2188643625 shutdown_connections 2023-08-10T10:40:25.264 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.774+0000 7f41a45db700 1 --2- 172.21.15.107:0/2188643625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f419c07be80 0x7f419c19bd40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:25.264 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.774+0000 7f41a45db700 1 -- 172.21.15.107:0/2188643625 >> 172.21.15.107:0/2188643625 conn(0x7f419c1014b0 msgr2=0x7f419c102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:25.264 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.775+0000 7f41a45db700 1 -- 172.21.15.107:0/2188643625 shutdown_connections 2023-08-10T10:40:25.264 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:24.775+0000 7f41a45db700 1 -- 172.21.15.107:0/2188643625 wait complete. 2023-08-10T10:40:25.265 INFO:teuthology.orchestra.run.smithi107.stdout:mgr not available, waiting (2/15)... 2023-08-10T10:40:25.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:25 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:25.056+0000 7f699ba03200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:40:25.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:25 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:25.177+0000 7f699ba03200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:40:25.765 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:25 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:25.406+0000 7f699ba03200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:40:26.043 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:25 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:25.764+0000 7f699ba03200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:40:26.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:26 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:26.041+0000 7f699ba03200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:40:26.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:26 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:26.232+0000 7f699ba03200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:40:26.826 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:26 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:26.574+0000 7f699ba03200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:40:27.940 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:27 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:27.510+0000 7f699ba03200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:40:27.940 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:27 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:27.686+0000 7f699ba03200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:40:28.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:27 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:27.939+0000 7f699ba03200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:40:28.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:28 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:28.085+0000 7f699ba03200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:40:28.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:28 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:28.358+0000 7f699ba03200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:40:29.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:29 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:29.441+0000 7f699ba03200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:40:29.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:29 smithi107 ceph-mon[127953]: Activating manager daemon x 2023-08-10T10:40:29.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:29 smithi107 ceph-mon[127953]: mgrmap e2: x(active, starting, since 0.00400379s) 2023-08-10T10:40:29.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:29 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T10:40:29.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:29 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T10:40:29.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:29 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T10:40:29.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:29 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:40:29.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:29 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T10:40:29.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:29 smithi107 ceph-mon[127953]: Manager daemon x is now available 2023-08-10T10:40:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:30 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T10:40:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:30 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' 2023-08-10T10:40:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:30 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T10:40:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:30 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' 2023-08-10T10:40:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:30 smithi107 ceph-mon[127953]: from='mgr.14100 172.21.15.107:0/3664040519' entity='mgr.x' 2023-08-10T10:40:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:30 smithi107 ceph-mon[127953]: mgrmap e3: x(active, since 1.00965s) 2023-08-10T10:40:32.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:32 smithi107 ceph-mon[127953]: mgrmap e4: x(active, since 2s) 2023-08-10T10:40:34.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:34 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1676568998' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-08-10T10:40:34.642 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:34.643 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2023-08-10T10:40:34.643 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:40:34.643 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2023-08-10T10:40:34.643 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-08-10T10:40:34.643 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-08-10T10:40:34.643 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-08-10T10:40:34.643 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:34.644 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-08-10T10:40:34.644 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-08-10T10:40:34.644 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2023-08-10T10:40:34.644 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2023-08-10T10:40:34.644 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-08-10T10:40:34.644 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "a" 2023-08-10T10:40:34.644 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2023-08-10T10:40:34.645 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2023-08-10T10:40:34.645 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2023-08-10T10:40:34.645 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:34.645 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-08-10T10:40:34.645 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-08-10T10:40:34.645 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:34.645 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-08-10T10:40:34.646 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:34.646 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-08-10T10:40:34.646 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-08-10T10:40:34.656 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-08-10T10:40:34.657 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-08-10T10:40:34.657 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-08-10T10:40:34.657 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-08-10T10:40:34.658 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:34.658 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-08-10T10:40:34.658 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-08-10T10:40:34.658 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-08-10T10:40:34.659 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-08-10T10:40:34.659 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-08-10T10:40:34.660 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-08-10T10:40:34.661 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-08-10T10:40:34.661 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-08-10T10:40:34.661 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-08-10T10:40:34.661 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:34.661 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-08-10T10:40:34.662 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:34.662 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-08-10T10:40:34.662 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-08-10T10:40:34.662 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:34.662 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-08-10T10:40:34.662 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": true, 2023-08-10T10:40:34.662 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-08-10T10:40:34.662 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2023-08-10T10:40:34.663 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2023-08-10T10:40:34.663 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2023-08-10T10:40:34.663 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2023-08-10T10:40:34.663 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2023-08-10T10:40:34.663 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T10:40:34.663 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:34.663 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-08-10T10:40:34.663 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-08-10T10:40:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2023-08-10T10:40:11.954259+0000", 2023-08-10T10:40:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2023-08-10T10:40:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2023-08-10T10:40:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-08-10T10:40:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2023-08-10T10:40:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.935+0000 7f77eaf63700 1 Processor -- start 2023-08-10T10:40:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.935+0000 7f77eaf63700 1 -- start start 2023-08-10T10:40:34.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.935+0000 7f77eaf63700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e407a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:34.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.935+0000 7f77eaf63700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e407a8f0 con 0x7f77e407bec0 2023-08-10T10:40:34.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.935+0000 7f77e8cff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e407a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:34.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.935+0000 7f77e8cff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e407a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42766/0 (socket says 172.21.15.107:42766) 2023-08-10T10:40:34.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.935+0000 7f77e8cff700 1 -- 172.21.15.107:0/4074021384 learned_addr learned my addr 172.21.15.107:0/4074021384 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:34.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.936+0000 7f77e8cff700 1 -- 172.21.15.107:0/4074021384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e407aa30 con 0x7f77e407bec0 2023-08-10T10:40:34.665 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.936+0000 7f77e8cff700 1 --2- 172.21.15.107:0/4074021384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e407a320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f77d80098a0 tx=0x7f77d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636778532e7cef33 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:34.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.936+0000 7f77e37fe700 1 -- 172.21.15.107:0/4074021384 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d8004160 con 0x7f77e407bec0 2023-08-10T10:40:34.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.936+0000 7f77e37fe700 1 -- 172.21.15.107:0/4074021384 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f77d80042c0 con 0x7f77e407bec0 2023-08-10T10:40:34.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.936+0000 7f77e37fe700 1 -- 172.21.15.107:0/4074021384 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d8011940 con 0x7f77e407bec0 2023-08-10T10:40:34.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.937+0000 7f77eaf63700 1 -- 172.21.15.107:0/4074021384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 msgr2=0x7f77e407a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:34.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.937+0000 7f77eaf63700 1 --2- 172.21.15.107:0/4074021384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e407a320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f77d80098a0 tx=0x7f77d8009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.937+0000 7f77eaf63700 1 -- 172.21.15.107:0/4074021384 shutdown_connections 2023-08-10T10:40:34.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.937+0000 7f77eaf63700 1 --2- 172.21.15.107:0/4074021384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e407a320 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.666 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.937+0000 7f77eaf63700 1 -- 172.21.15.107:0/4074021384 >> 172.21.15.107:0/4074021384 conn(0x7f77e41014b0 msgr2=0x7f77e41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:34.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.937+0000 7f77eaf63700 1 -- 172.21.15.107:0/4074021384 shutdown_connections 2023-08-10T10:40:34.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.937+0000 7f77eaf63700 1 -- 172.21.15.107:0/4074021384 wait complete. 2023-08-10T10:40:34.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.938+0000 7f77eaf63700 1 Processor -- start 2023-08-10T10:40:34.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.938+0000 7f77eaf63700 1 -- start start 2023-08-10T10:40:34.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.938+0000 7f77eaf63700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:34.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.938+0000 7f77eaf63700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e419c270 con 0x7f77e407bec0 2023-08-10T10:40:34.667 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.939+0000 7f77e8cff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:34.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.939+0000 7f77e8cff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e419bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42780/0 (socket says 172.21.15.107:42780) 2023-08-10T10:40:34.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.939+0000 7f77e8cff700 1 -- 172.21.15.107:0/1676568998 learned_addr learned my addr 172.21.15.107:0/1676568998 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:34.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.939+0000 7f77e8cff700 1 -- 172.21.15.107:0/1676568998 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009550 con 0x7f77e407bec0 2023-08-10T10:40:34.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.939+0000 7f77e8cff700 1 --2- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e419bd30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f77d8000c00 tx=0x7f77d8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:34.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.939+0000 7f77e1ffb700 1 -- 172.21.15.107:0/1676568998 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d80036a0 con 0x7f77e407bec0 2023-08-10T10:40:34.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.939+0000 7f77e1ffb700 1 -- 172.21.15.107:0/1676568998 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f77d8003c70 con 0x7f77e407bec0 2023-08-10T10:40:34.668 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.939+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e419c470 con 0x7f77e407bec0 2023-08-10T10:40:34.669 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.939+0000 7f77e1ffb700 1 -- 172.21.15.107:0/1676568998 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77d80193f0 con 0x7f77e407bec0 2023-08-10T10:40:34.669 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.940+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e419c890 con 0x7f77e407bec0 2023-08-10T10:40:34.669 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.941+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e4061da0 con 0x7f77e407bec0 2023-08-10T10:40:34.669 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.941+0000 7f77e1ffb700 1 -- 172.21.15.107:0/1676568998 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f77d801b440 con 0x7f77e407bec0 2023-08-10T10:40:34.669 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.941+0000 7f77e1ffb700 1 --2- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f77d4038710 0x7f77d403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:34.669 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.941+0000 7f77e1ffb700 1 -- 172.21.15.107:0/1676568998 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f77d804c470 con 0x7f77e407bec0 2023-08-10T10:40:34.669 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.941+0000 7f77e3fff700 1 --2- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f77d4038710 0x7f77d403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:34.669 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.942+0000 7f77e3fff700 1 --2- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f77d4038710 0x7f77d403abd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77d0006fd0 tx=0x7f77d0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:34.670 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:33.947+0000 7f77e1ffb700 1 -- 172.21.15.107:0/1676568998 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f77d8022930 con 0x7f77e407bec0 2023-08-10T10:40:34.670 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.213+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f77e419f980 con 0x7f77e407bec0 2023-08-10T10:40:34.670 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.214+0000 7f77e1ffb700 1 -- 172.21.15.107:0/1676568998 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f77d801f070 con 0x7f77e407bec0 2023-08-10T10:40:34.670 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.216+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f77d4038710 msgr2=0x7f77d403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:34.670 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.216+0000 7f77eaf63700 1 --2- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f77d4038710 0x7f77d403abd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77d0006fd0 tx=0x7f77d0006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:34.670 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.216+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 msgr2=0x7f77e419bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:34.670 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.216+0000 7f77eaf63700 1 --2- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e419bd30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f77d8000c00 tx=0x7f77d8011e70 comp rx=0 tx=0).stop 2023-08-10T10:40:34.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.217+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 shutdown_connections 2023-08-10T10:40:34.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.217+0000 7f77eaf63700 1 --2- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f77d4038710 0x7f77d403abd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.217+0000 7f77eaf63700 1 --2- 172.21.15.107:0/1676568998 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77e407bec0 0x7f77e419bd30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:34.671 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.217+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 >> 172.21.15.107:0/1676568998 conn(0x7f77e41014b0 msgr2=0x7f77e4102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:34.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.217+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 shutdown_connections 2023-08-10T10:40:34.672 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:34.217+0000 7f77eaf63700 1 -- 172.21.15.107:0/1676568998 wait complete. 2023-08-10T10:40:34.672 INFO:teuthology.orchestra.run.smithi107.stdout:mgr is available 2023-08-10T10:40:35.823 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:35 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1069000501' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-08-10T10:40:35.824 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:35.824 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [global] 2023-08-10T10:40:35.825 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout fsid = 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:35.825 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-08-10T10:40:35.825 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-08-10T10:40:35.825 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-08-10T10:40:35.825 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-08-10T10:40:35.825 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:35.825 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [mgr] 2023-08-10T10:40:35.825 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-08-10T10:40:35.826 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2023-08-10T10:40:35.826 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [osd] 2023-08-10T10:40:35.826 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-08-10T10:40:35.826 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-08-10T10:40:35.826 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-08-10T10:40:35.826 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-08-10T10:40:35.826 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-08-10T10:40:35.830 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.190+0000 7f713874e700 1 Processor -- start 2023-08-10T10:40:35.830 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.190+0000 7f713874e700 1 -- start start 2023-08-10T10:40:35.830 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.191+0000 7f713874e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713007a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.831 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.191+0000 7f713874e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713007a8f0 con 0x7f713007bec0 2023-08-10T10:40:35.831 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.191+0000 7f71364ea700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713007a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.831 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.191+0000 7f71364ea700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713007a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42790/0 (socket says 172.21.15.107:42790) 2023-08-10T10:40:35.831 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.191+0000 7f71364ea700 1 -- 172.21.15.107:0/3209647395 learned_addr learned my addr 172.21.15.107:0/3209647395 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:35.831 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.191+0000 7f71364ea700 1 -- 172.21.15.107:0/3209647395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713007aa30 con 0x7f713007bec0 2023-08-10T10:40:35.831 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.192+0000 7f71364ea700 1 --2- 172.21.15.107:0/3209647395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713007a320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f712c0098a0 tx=0x7f712c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a797ce252076460 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:35.831 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.192+0000 7f71354e8700 1 -- 172.21.15.107:0/3209647395 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f712c004160 con 0x7f713007bec0 2023-08-10T10:40:35.832 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.192+0000 7f71354e8700 1 -- 172.21.15.107:0/3209647395 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f712c0042c0 con 0x7f713007bec0 2023-08-10T10:40:35.832 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.192+0000 7f71354e8700 1 -- 172.21.15.107:0/3209647395 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f712c011940 con 0x7f713007bec0 2023-08-10T10:40:35.832 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.192+0000 7f713874e700 1 -- 172.21.15.107:0/3209647395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 msgr2=0x7f713007a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.832 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.192+0000 7f713874e700 1 --2- 172.21.15.107:0/3209647395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713007a320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f712c0098a0 tx=0x7f712c009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.832 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.193+0000 7f713874e700 1 -- 172.21.15.107:0/3209647395 shutdown_connections 2023-08-10T10:40:35.832 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.193+0000 7f713874e700 1 --2- 172.21.15.107:0/3209647395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713007a320 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.832 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.193+0000 7f713874e700 1 -- 172.21.15.107:0/3209647395 >> 172.21.15.107:0/3209647395 conn(0x7f71301014b0 msgr2=0x7f71301038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:35.832 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.193+0000 7f713874e700 1 -- 172.21.15.107:0/3209647395 shutdown_connections 2023-08-10T10:40:35.833 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.193+0000 7f713874e700 1 -- 172.21.15.107:0/3209647395 wait complete. 2023-08-10T10:40:35.833 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.194+0000 7f713874e700 1 Processor -- start 2023-08-10T10:40:35.833 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.194+0000 7f713874e700 1 -- start start 2023-08-10T10:40:35.833 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.194+0000 7f713874e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.833 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.194+0000 7f713874e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713019c270 con 0x7f713007bec0 2023-08-10T10:40:35.833 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.194+0000 7f71364ea700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.833 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.194+0000 7f71364ea700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713019bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42800/0 (socket says 172.21.15.107:42800) 2023-08-10T10:40:35.834 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.194+0000 7f71364ea700 1 -- 172.21.15.107:0/1069000501 learned_addr learned my addr 172.21.15.107:0/1069000501 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:35.834 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.195+0000 7f71364ea700 1 -- 172.21.15.107:0/1069000501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c009550 con 0x7f713007bec0 2023-08-10T10:40:35.834 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.195+0000 7f71364ea700 1 --2- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713019bd30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f712c006af0 tx=0x7f712c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:35.834 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.195+0000 7f71277fe700 1 -- 172.21.15.107:0/1069000501 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f712c003bf0 con 0x7f713007bec0 2023-08-10T10:40:35.834 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.195+0000 7f71277fe700 1 -- 172.21.15.107:0/1069000501 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f712c01b8b0 con 0x7f713007bec0 2023-08-10T10:40:35.834 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.195+0000 7f71277fe700 1 -- 172.21.15.107:0/1069000501 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f712c0197e0 con 0x7f713007bec0 2023-08-10T10:40:35.834 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.195+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713019c470 con 0x7f713007bec0 2023-08-10T10:40:35.834 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.195+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713019c890 con 0x7f713007bec0 2023-08-10T10:40:35.835 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.196+0000 7f71277fe700 1 -- 172.21.15.107:0/1069000501 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f712c01ba20 con 0x7f713007bec0 2023-08-10T10:40:35.835 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.196+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713010c1e0 con 0x7f713007bec0 2023-08-10T10:40:35.835 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.197+0000 7f71277fe700 1 --2- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f711c038670 0x7f711c03ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:35.835 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.197+0000 7f71277fe700 1 -- 172.21.15.107:0/1069000501 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f712c04c900 con 0x7f713007bec0 2023-08-10T10:40:35.835 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.197+0000 7f7135ce9700 1 --2- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f711c038670 0x7f711c03ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:35.835 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.198+0000 7f7135ce9700 1 --2- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f711c038670 0x7f711c03ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7120006fd0 tx=0x7f7120006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:35.835 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.201+0000 7f71277fe700 1 -- 172.21.15.107:0/1069000501 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f712c018920 con 0x7f713007bec0 2023-08-10T10:40:35.835 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.392+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f713019f6f0 con 0x7f713007bec0 2023-08-10T10:40:35.836 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.393+0000 7f71277fe700 1 -- 172.21.15.107:0/1069000501 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f712c018350 con 0x7f713007bec0 2023-08-10T10:40:35.836 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f711c038670 msgr2=0x7f711c03ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.836 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 --2- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f711c038670 0x7f711c03ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7120006fd0 tx=0x7f7120006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:35.836 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 msgr2=0x7f713019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:35.836 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 --2- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713019bd30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f712c006af0 tx=0x7f712c011a30 comp rx=0 tx=0).stop 2023-08-10T10:40:35.836 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 shutdown_connections 2023-08-10T10:40:35.836 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 --2- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f711c038670 0x7f711c03ab30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.837 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 --2- 172.21.15.107:0/1069000501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f713007bec0 0x7f713019bd30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:35.837 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 >> 172.21.15.107:0/1069000501 conn(0x7f71301014b0 msgr2=0x7f7130102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:35.837 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 shutdown_connections 2023-08-10T10:40:35.837 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:35.396+0000 7f713874e700 1 -- 172.21.15.107:0/1069000501 wait complete. 2023-08-10T10:40:35.837 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling cephadm module... 2023-08-10T10:40:36.904 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:36 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2523710989' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-08-10T10:40:36.904 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:36 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: ignoring --setuser ceph since I am not root 2023-08-10T10:40:36.905 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:36 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: ignoring --setgroup ceph since I am not root 2023-08-10T10:40:36.905 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:36 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:36.903+0000 7f76ecc10200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:40:37.111 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.324+0000 7fb21e987700 1 Processor -- start 2023-08-10T10:40:37.111 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.324+0000 7fb21e987700 1 -- start start 2023-08-10T10:40:37.111 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.325+0000 7fb21e987700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21807a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:37.112 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.325+0000 7fb21e987700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21807a8b0 con 0x7fb21807be80 2023-08-10T10:40:37.112 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.325+0000 7fb217fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21807a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:37.112 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.325+0000 7fb217fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21807a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42802/0 (socket says 172.21.15.107:42802) 2023-08-10T10:40:37.112 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.325+0000 7fb217fff700 1 -- 172.21.15.107:0/423134362 learned_addr learned my addr 172.21.15.107:0/423134362 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:37.112 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.326+0000 7fb217fff700 1 -- 172.21.15.107:0/423134362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21807a9f0 con 0x7fb21807be80 2023-08-10T10:40:37.112 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.326+0000 7fb217fff700 1 --2- 172.21.15.107:0/423134362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21807a2e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2080098a0 tx=0x7fb208009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4de03fdc4662e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:37.112 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.326+0000 7fb216ffd700 1 -- 172.21.15.107:0/423134362 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb208004160 con 0x7fb21807be80 2023-08-10T10:40:37.113 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.326+0000 7fb216ffd700 1 -- 172.21.15.107:0/423134362 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb2080042c0 con 0x7fb21807be80 2023-08-10T10:40:37.113 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.326+0000 7fb216ffd700 1 -- 172.21.15.107:0/423134362 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb208011940 con 0x7fb21807be80 2023-08-10T10:40:37.113 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.327+0000 7fb21e987700 1 -- 172.21.15.107:0/423134362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 msgr2=0x7fb21807a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:37.113 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.327+0000 7fb21e987700 1 --2- 172.21.15.107:0/423134362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21807a2e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2080098a0 tx=0x7fb208009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:37.113 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.327+0000 7fb21e987700 1 -- 172.21.15.107:0/423134362 shutdown_connections 2023-08-10T10:40:37.113 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.327+0000 7fb21e987700 1 --2- 172.21.15.107:0/423134362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21807a2e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:37.113 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.327+0000 7fb21e987700 1 -- 172.21.15.107:0/423134362 >> 172.21.15.107:0/423134362 conn(0x7fb218101470 msgr2=0x7fb218103890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:37.114 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.327+0000 7fb21e987700 1 -- 172.21.15.107:0/423134362 shutdown_connections 2023-08-10T10:40:37.114 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.327+0000 7fb21e987700 1 -- 172.21.15.107:0/423134362 wait complete. 2023-08-10T10:40:37.114 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.328+0000 7fb21e987700 1 Processor -- start 2023-08-10T10:40:37.114 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.328+0000 7fb21e987700 1 -- start start 2023-08-10T10:40:37.114 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.328+0000 7fb21e987700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:37.114 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.328+0000 7fb21e987700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21819c1d0 con 0x7fb21807be80 2023-08-10T10:40:37.114 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.328+0000 7fb217fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:37.114 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.328+0000 7fb217fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21819bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42812/0 (socket says 172.21.15.107:42812) 2023-08-10T10:40:37.115 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.328+0000 7fb217fff700 1 -- 172.21.15.107:0/2523710989 learned_addr learned my addr 172.21.15.107:0/2523710989 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:37.115 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.329+0000 7fb217fff700 1 -- 172.21.15.107:0/2523710989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb208009550 con 0x7fb21807be80 2023-08-10T10:40:37.115 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.329+0000 7fb217fff700 1 --2- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21819bc90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb208011dc0 tx=0x7fb208011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:37.115 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.329+0000 7fb2157fa700 1 -- 172.21.15.107:0/2523710989 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2080037d0 con 0x7fb21807be80 2023-08-10T10:40:37.115 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.329+0000 7fb2157fa700 1 -- 172.21.15.107:0/2523710989 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb20801b440 con 0x7fb21807be80 2023-08-10T10:40:37.115 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.329+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21819c3d0 con 0x7fb21807be80 2023-08-10T10:40:37.115 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.329+0000 7fb2157fa700 1 -- 172.21.15.107:0/2523710989 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb20801a560 con 0x7fb21807be80 2023-08-10T10:40:37.116 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.329+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21819c7f0 con 0x7fb21807be80 2023-08-10T10:40:37.116 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.330+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21810c200 con 0x7fb21807be80 2023-08-10T10:40:37.116 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.331+0000 7fb2157fa700 1 -- 172.21.15.107:0/2523710989 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7fb20801b5b0 con 0x7fb21807be80 2023-08-10T10:40:37.116 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.331+0000 7fb2157fa700 1 --2- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7fb200038710 0x7fb20003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:37.116 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.331+0000 7fb2157fa700 1 -- 172.21.15.107:0/2523710989 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb20804c4b0 con 0x7fb21807be80 2023-08-10T10:40:37.116 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.331+0000 7fb2177fe700 1 --2- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7fb200038710 0x7fb20003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:37.116 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.332+0000 7fb2177fe700 1 --2- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7fb200038710 0x7fb20003abd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb20c006fd0 tx=0x7fb20c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:37.117 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.336+0000 7fb2157fa700 1 -- 172.21.15.107:0/2523710989 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb208023590 con 0x7fb21807be80 2023-08-10T10:40:37.117 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.580+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fb21810c3f0 con 0x7fb21807be80 2023-08-10T10:40:37.117 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.634+0000 7fb2157fa700 1 -- 172.21.15.107:0/2523710989 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fb20800fda0 con 0x7fb21807be80 2023-08-10T10:40:37.117 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.635+0000 7fb2157fa700 1 -- 172.21.15.107:0/2523710989 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fb20804bed0 con 0x7fb21807be80 2023-08-10T10:40:37.117 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7fb200038710 msgr2=0x7fb20003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:37.118 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 --2- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7fb200038710 0x7fb20003abd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb20c006fd0 tx=0x7fb20c006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:37.118 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 msgr2=0x7fb21819bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:37.118 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 --2- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21819bc90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb208011dc0 tx=0x7fb208011ea0 comp rx=0 tx=0).stop 2023-08-10T10:40:37.118 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 shutdown_connections 2023-08-10T10:40:37.118 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 --2- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7fb200038710 0x7fb20003abd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:37.118 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 --2- 172.21.15.107:0/2523710989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb21807be80 0x7fb21819bc90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:37.119 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 >> 172.21.15.107:0/2523710989 conn(0x7fb218101470 msgr2=0x7fb218102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:37.119 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 shutdown_connections 2023-08-10T10:40:37.119 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:36.639+0000 7fb21e987700 1 -- 172.21.15.107:0/2523710989 wait complete. 2023-08-10T10:40:37.256 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:37.007+0000 7f76ecc10200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:40:37.256 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:37.124+0000 7f76ecc10200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:40:37.257 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:37.254+0000 7f76ecc10200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:40:37.576 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:37.486+0000 7f76ecc10200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:40:37.977 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:37 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2523710989' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-08-10T10:40:37.978 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:37 smithi107 ceph-mon[127953]: mgrmap e5: x(active, since 7s) 2023-08-10T10:40:37.978 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:37.884+0000 7f76ecc10200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:40:38.299 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:38.003+0000 7f76ecc10200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:40:38.300 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:38.176+0000 7f76ecc10200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:40:38.300 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:38.298+0000 7f76ecc10200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:40:38.397 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2023-08-10T10:40:38.398 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-08-10T10:40:38.398 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": true, 2023-08-10T10:40:38.398 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-08-10T10:40:38.398 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-08-10T10:40:38.398 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2023-08-10T10:40:38.398 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.685+0000 7f2764ab6700 1 Processor -- start 2023-08-10T10:40:38.399 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.686+0000 7f2764ab6700 1 -- start start 2023-08-10T10:40:38.399 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.686+0000 7f2764ab6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276007a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:38.399 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.686+0000 7f2764ab6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276007a8d0 con 0x7f276007bea0 2023-08-10T10:40:38.399 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.686+0000 7f275e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276007a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:38.400 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.686+0000 7f275e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276007a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42844/0 (socket says 172.21.15.107:42844) 2023-08-10T10:40:38.400 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.686+0000 7f275e59c700 1 -- 172.21.15.107:0/862403219 learned_addr learned my addr 172.21.15.107:0/862403219 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:38.400 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.687+0000 7f275e59c700 1 -- 172.21.15.107:0/862403219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276007aa10 con 0x7f276007bea0 2023-08-10T10:40:38.400 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.687+0000 7f275e59c700 1 --2- 172.21.15.107:0/862403219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276007a300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f27500098a0 tx=0x7f2750009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6c42ab116b2410 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:38.404 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.687+0000 7f275d59a700 1 -- 172.21.15.107:0/862403219 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2750004160 con 0x7f276007bea0 2023-08-10T10:40:38.405 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.687+0000 7f275d59a700 1 -- 172.21.15.107:0/862403219 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f27500042c0 con 0x7f276007bea0 2023-08-10T10:40:38.405 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.687+0000 7f275d59a700 1 -- 172.21.15.107:0/862403219 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2750011940 con 0x7f276007bea0 2023-08-10T10:40:38.405 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.688+0000 7f2764ab6700 1 -- 172.21.15.107:0/862403219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 msgr2=0x7f276007a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:38.405 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.688+0000 7f2764ab6700 1 --2- 172.21.15.107:0/862403219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276007a300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f27500098a0 tx=0x7f2750009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.405 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.688+0000 7f2764ab6700 1 -- 172.21.15.107:0/862403219 shutdown_connections 2023-08-10T10:40:38.405 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.688+0000 7f2764ab6700 1 --2- 172.21.15.107:0/862403219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276007a300 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.406 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.688+0000 7f2764ab6700 1 -- 172.21.15.107:0/862403219 >> 172.21.15.107:0/862403219 conn(0x7f27601014b0 msgr2=0x7f27601038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:38.406 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.688+0000 7f2764ab6700 1 -- 172.21.15.107:0/862403219 shutdown_connections 2023-08-10T10:40:38.406 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.688+0000 7f2764ab6700 1 -- 172.21.15.107:0/862403219 wait complete. 2023-08-10T10:40:38.406 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.690+0000 7f2764ab6700 1 Processor -- start 2023-08-10T10:40:38.406 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.690+0000 7f2764ab6700 1 -- start start 2023-08-10T10:40:38.406 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.690+0000 7f2764ab6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:38.407 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.690+0000 7f2764ab6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276019c2a0 con 0x7f276007bea0 2023-08-10T10:40:38.407 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.690+0000 7f275e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:38.407 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.691+0000 7f275e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42854/0 (socket says 172.21.15.107:42854) 2023-08-10T10:40:38.407 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.691+0000 7f275e59c700 1 -- 172.21.15.107:0/3384550818 learned_addr learned my addr 172.21.15.107:0/3384550818 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:38.407 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.691+0000 7f275e59c700 1 -- 172.21.15.107:0/3384550818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750009550 con 0x7f276007bea0 2023-08-10T10:40:38.407 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.691+0000 7f275e59c700 1 --2- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276019bd60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2750000c00 tx=0x7f2750011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:38.407 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.691+0000 7f274f7fe700 1 -- 172.21.15.107:0/3384550818 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500036a0 con 0x7f276007bea0 2023-08-10T10:40:38.408 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.691+0000 7f274f7fe700 1 -- 172.21.15.107:0/3384550818 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2750003c70 con 0x7f276007bea0 2023-08-10T10:40:38.408 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.691+0000 7f274f7fe700 1 -- 172.21.15.107:0/3384550818 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27500193f0 con 0x7f276007bea0 2023-08-10T10:40:38.408 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.691+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276019c4a0 con 0x7f276007bea0 2023-08-10T10:40:38.408 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.691+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276019c8c0 con 0x7f276007bea0 2023-08-10T10:40:38.408 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.692+0000 7f274f7fe700 1 -- 172.21.15.107:0/3384550818 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f275001b440 con 0x7f276007bea0 2023-08-10T10:40:38.408 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.692+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276010c200 con 0x7f276007bea0 2023-08-10T10:40:38.408 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.693+0000 7f274f7fe700 1 --2- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f2748038760 0x7f274803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:38.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.693+0000 7f274f7fe700 1 -- 172.21.15.107:0/3384550818 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f275004c500 con 0x7f276007bea0 2023-08-10T10:40:38.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.693+0000 7f275dd9b700 1 -- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f2748038760 msgr2=0x7f274803ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/4026286774 2023-08-10T10:40:38.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.693+0000 7f275dd9b700 1 --2- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f2748038760 0x7f274803ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:40:38.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.698+0000 7f274f7fe700 1 -- 172.21.15.107:0/3384550818 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2750022950 con 0x7f276007bea0 2023-08-10T10:40:38.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.894+0000 7f275dd9b700 1 -- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f2748038760 msgr2=0x7f274803ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/4026286774 2023-08-10T10:40:38.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.894+0000 7f275dd9b700 1 --2- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f2748038760 0x7f274803ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T10:40:38.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.953+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f276019f720 con 0x7f276007bea0 2023-08-10T10:40:38.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.953+0000 7f274f7fe700 1 -- 172.21.15.107:0/3384550818 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f275001f020 con 0x7f276007bea0 2023-08-10T10:40:38.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.955+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f2748038760 msgr2=0x7f274803ac20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:40:38.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.955+0000 7f2764ab6700 1 --2- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f2748038760 0x7f274803ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.955+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 msgr2=0x7f276019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:38.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.955+0000 7f2764ab6700 1 --2- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276019bd60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2750000c00 tx=0x7f2750011e70 comp rx=0 tx=0).stop 2023-08-10T10:40:38.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.956+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 shutdown_connections 2023-08-10T10:40:38.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.956+0000 7f2764ab6700 1 --2- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f2748038760 0x7f274803ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.956+0000 7f2764ab6700 1 --2- 172.21.15.107:0/3384550818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f276007bea0 0x7f276019bd60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:38.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.956+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 >> 172.21.15.107:0/3384550818 conn(0x7f27601014b0 msgr2=0x7f2760102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:38.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.956+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 shutdown_connections 2023-08-10T10:40:38.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:37.956+0000 7f2764ab6700 1 -- 172.21.15.107:0/3384550818 wait complete. 2023-08-10T10:40:38.412 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for the mgr to restart... 2023-08-10T10:40:38.412 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr epoch 5... 2023-08-10T10:40:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:38 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3384550818' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-08-10T10:40:39.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:38.875+0000 7f76ecc10200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:40:40.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:39.608+0000 7f76ecc10200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:40:40.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:39.814+0000 7f76ecc10200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:40:41.076 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:40 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:40.737+0000 7f76ecc10200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:40:41.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:40 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:40.855+0000 7f76ecc10200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:40:41.434 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:41.076+0000 7f76ecc10200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:40:41.713 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:41.433+0000 7f76ecc10200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:40:42.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:41.712+0000 7f76ecc10200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:40:42.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:41.902+0000 7f76ecc10200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:40:42.576 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:42 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:42.237+0000 7f76ecc10200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:40:43.567 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:43.151+0000 7f76ecc10200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:40:43.568 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:43.320+0000 7f76ecc10200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:40:43.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:43.566+0000 7f76ecc10200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:40:43.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:43.710+0000 7f76ecc10200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:40:44.326 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:43.980+0000 7f76ecc10200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:40:45.326 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:40:45.029+0000 7f76ecc10200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:40:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: Active manager daemon x restarted 2023-08-10T10:40:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: Activating manager daemon x 2023-08-10T10:40:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: osdmap e2: 0 total, 0 up, 0 in 2023-08-10T10:40:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: mgrmap e6: x(active, starting, since 0.00401791s) 2023-08-10T10:40:45.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:40:45.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T10:40:45.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T10:40:45.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T10:40:45.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T10:40:45.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: Manager daemon x is now available 2023-08-10T10:40:45.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:45.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:45.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:40:45.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:40:45.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:45 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:40:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:46 smithi107 ceph-mon[127953]: Found migration_current of "None". Setting to last migration. 2023-08-10T10:40:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:46 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T10:40:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:46 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T10:40:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:46 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:46.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:46 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:46.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:46 smithi107 ceph-mon[127953]: mgrmap e7: x(active, since 1.00715s) 2023-08-10T10:40:46.495 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2023-08-10T10:40:46.495 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-08-10T10:40:46.496 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "initialized": true 2023-08-10T10:40:46.496 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2023-08-10T10:40:46.496 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.936+0000 7f89cac74700 1 Processor -- start 2023-08-10T10:40:46.496 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.936+0000 7f89cac74700 1 -- start start 2023-08-10T10:40:46.496 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.936+0000 7f89cac74700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c407a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:46.496 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.936+0000 7f89cac74700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c407a8b0 con 0x7f89c407be80 2023-08-10T10:40:46.497 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.937+0000 7f89c8a10700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c407a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:46.497 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.937+0000 7f89c8a10700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c407a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42858/0 (socket says 172.21.15.107:42858) 2023-08-10T10:40:46.497 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.937+0000 7f89c8a10700 1 -- 172.21.15.107:0/1881891597 learned_addr learned my addr 172.21.15.107:0/1881891597 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:46.497 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.937+0000 7f89c8a10700 1 -- 172.21.15.107:0/1881891597 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c407a9f0 con 0x7f89c407be80 2023-08-10T10:40:46.497 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.937+0000 7f89c8a10700 1 --2- 172.21.15.107:0/1881891597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c407a2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89b80098a0 tx=0x7f89b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54700c81bef4889 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:46.497 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.937+0000 7f89c37fe700 1 -- 172.21.15.107:0/1881891597 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89b8004160 con 0x7f89c407be80 2023-08-10T10:40:46.498 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.938+0000 7f89c37fe700 1 -- 172.21.15.107:0/1881891597 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f89b80042c0 con 0x7f89c407be80 2023-08-10T10:40:46.498 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.938+0000 7f89c37fe700 1 -- 172.21.15.107:0/1881891597 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89b8011940 con 0x7f89c407be80 2023-08-10T10:40:46.498 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.938+0000 7f89cac74700 1 -- 172.21.15.107:0/1881891597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 msgr2=0x7f89c407a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:46.498 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.938+0000 7f89cac74700 1 --2- 172.21.15.107:0/1881891597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c407a2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89b80098a0 tx=0x7f89b8009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:46.498 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.938+0000 7f89cac74700 1 -- 172.21.15.107:0/1881891597 shutdown_connections 2023-08-10T10:40:46.498 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.938+0000 7f89cac74700 1 --2- 172.21.15.107:0/1881891597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c407a2e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:46.498 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.938+0000 7f89cac74700 1 -- 172.21.15.107:0/1881891597 >> 172.21.15.107:0/1881891597 conn(0x7f89c41014b0 msgr2=0x7f89c41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:46.499 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.938+0000 7f89cac74700 1 -- 172.21.15.107:0/1881891597 shutdown_connections 2023-08-10T10:40:46.499 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.938+0000 7f89cac74700 1 -- 172.21.15.107:0/1881891597 wait complete. 2023-08-10T10:40:46.499 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.939+0000 7f89cac74700 1 Processor -- start 2023-08-10T10:40:46.499 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.940+0000 7f89cac74700 1 -- start start 2023-08-10T10:40:46.499 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.940+0000 7f89cac74700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:46.499 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.940+0000 7f89cac74700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c419c280 con 0x7f89c407be80 2023-08-10T10:40:46.499 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.940+0000 7f89c8a10700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:46.500 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.940+0000 7f89c8a10700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c419bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42866/0 (socket says 172.21.15.107:42866) 2023-08-10T10:40:46.500 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.940+0000 7f89c8a10700 1 -- 172.21.15.107:0/2246830244 learned_addr learned my addr 172.21.15.107:0/2246830244 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:46.500 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.940+0000 7f89c8a10700 1 -- 172.21.15.107:0/2246830244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b8009550 con 0x7f89c407be80 2023-08-10T10:40:46.500 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.941+0000 7f89c8a10700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c419bd40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89b8011dc0 tx=0x7f89b8011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:46.500 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.941+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89b80037d0 con 0x7f89c407be80 2023-08-10T10:40:46.501 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.941+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f89b801b440 con 0x7f89c407be80 2023-08-10T10:40:46.501 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.941+0000 7f89cac74700 1 -- 172.21.15.107:0/2246830244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c419c480 con 0x7f89c407be80 2023-08-10T10:40:46.501 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.941+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89b801a560 con 0x7f89c407be80 2023-08-10T10:40:46.501 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.941+0000 7f89cac74700 1 -- 172.21.15.107:0/2246830244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c419c8a0 con 0x7f89c407be80 2023-08-10T10:40:46.501 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.942+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f89b8003930 con 0x7f89c407be80 2023-08-10T10:40:46.501 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.943+0000 7f89c1ffb700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 0x7f89b403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:46.501 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.943+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 --> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89b403b330 con 0x7f89b4038760 2023-08-10T10:40:46.502 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.943+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f89b804c530 con 0x7f89c407be80 2023-08-10T10:40:46.502 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.943+0000 7f89c3fff700 1 -- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 msgr2=0x7f89b403ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/4026286774 2023-08-10T10:40:46.502 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:38.943+0000 7f89c3fff700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 0x7f89b403ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:40:46.502 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:39.144+0000 7f89c3fff700 1 -- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 msgr2=0x7f89b403ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/4026286774 2023-08-10T10:40:46.502 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:39.144+0000 7f89c3fff700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 0x7f89b403ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T10:40:46.502 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:39.545+0000 7f89c3fff700 1 -- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 msgr2=0x7f89b403ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/4026286774 2023-08-10T10:40:46.502 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:39.545+0000 7f89c3fff700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 0x7f89b403ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-10T10:40:46.502 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:40.346+0000 7f89c3fff700 1 -- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 msgr2=0x7f89b403ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/4026286774 2023-08-10T10:40:46.503 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:40.346+0000 7f89c3fff700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 0x7f89b403ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-10T10:40:46.503 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:41.947+0000 7f89c3fff700 1 -- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 msgr2=0x7f89b403ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/4026286774 2023-08-10T10:40:46.503 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:41.948+0000 7f89c3fff700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 0x7f89b403ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-08-10T10:40:46.503 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:45.033+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mgrmap(e 6) v1 ==== 45250+0+0 (secure 0 0 0) 0x7f89b800bcc0 con 0x7f89c407be80 2023-08-10T10:40:46.503 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:45.033+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 msgr2=0x7f89b403ac20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:40:46.503 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:45.033+0000 7f89c1ffb700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 0x7f89b403ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:46.503 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.035+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f89b801a6c0 con 0x7f89c407be80 2023-08-10T10:40:46.504 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.035+0000 7f89c1ffb700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f89b403bff0 0x7f89b403e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:46.504 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.035+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89b403b330 con 0x7f89b403bff0 2023-08-10T10:40:46.504 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.036+0000 7f89c3fff700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f89b403bff0 0x7f89b403e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:46.504 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.037+0000 7f89c3fff700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f89b403bff0 0x7f89b403e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f89b0003a10 tx=0x7f89b00092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:46.504 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.038+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 <== mgr.14118 v2:172.21.15.107:6800/294010818 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f89b403b330 con 0x7f89b403bff0 2023-08-10T10:40:46.504 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.045+0000 7f89cac74700 1 -- 172.21.15.107:0/2246830244 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f89c419cff0 con 0x7f89b403bff0 2023-08-10T10:40:46.505 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.045+0000 7f89c1ffb700 1 -- 172.21.15.107:0/2246830244 <== mgr.14118 v2:172.21.15.107:6800/294010818 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f89c419cff0 con 0x7f89b403bff0 2023-08-10T10:40:46.505 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.045+0000 7f89cac74700 1 -- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f89b403bff0 msgr2=0x7f89b403e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:46.505 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.045+0000 7f89cac74700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f89b403bff0 0x7f89b403e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f89b0003a10 tx=0x7f89b00092b0 comp rx=0 tx=0).stop 2023-08-10T10:40:46.505 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.045+0000 7f89cac74700 1 -- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 msgr2=0x7f89c419bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:46.505 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.045+0000 7f89cac74700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c419bd40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89b8011dc0 tx=0x7f89b8011ea0 comp rx=0 tx=0).stop 2023-08-10T10:40:46.505 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.046+0000 7f89cac74700 1 -- 172.21.15.107:0/2246830244 shutdown_connections 2023-08-10T10:40:46.505 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.046+0000 7f89cac74700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f89b403bff0 0x7f89b403e3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:46.505 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.046+0000 7f89cac74700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89c407be80 0x7f89c419bd40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:46.506 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.046+0000 7f89cac74700 1 --2- 172.21.15.107:0/2246830244 >> [v2:172.21.15.107:6800/4026286774,v1:172.21.15.107:6801/4026286774] conn(0x7f89b4038760 0x7f89b403ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:46.506 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.046+0000 7f89cac74700 1 -- 172.21.15.107:0/2246830244 >> 172.21.15.107:0/2246830244 conn(0x7f89c41014b0 msgr2=0x7f89c4102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:46.506 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.046+0000 7f89cac74700 1 -- 172.21.15.107:0/2246830244 shutdown_connections 2023-08-10T10:40:46.506 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:46.046+0000 7f89cac74700 1 -- 172.21.15.107:0/2246830244 wait complete. 2023-08-10T10:40:46.506 INFO:teuthology.orchestra.run.smithi107.stdout:mgr epoch 5 is available 2023-08-10T10:40:46.506 INFO:teuthology.orchestra.run.smithi107.stdout:Setting orchestrator backend to cephadm... 2023-08-10T10:40:47.459 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:47 smithi107 ceph-mon[127953]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-08-10T10:40:47.459 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:47 smithi107 ceph-mon[127953]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-08-10T10:40:47.778 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.043+0000 7f49af5fe700 1 Processor -- start 2023-08-10T10:40:47.778 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.043+0000 7f49af5fe700 1 -- start start 2023-08-10T10:40:47.778 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.043+0000 7f49af5fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a807a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:47.778 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.043+0000 7f49af5fe700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a807a8d0 con 0x7f49a807bea0 2023-08-10T10:40:47.778 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.044+0000 7f49ad39a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a807a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:47.779 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.044+0000 7f49ad39a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a807a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35944/0 (socket says 172.21.15.107:35944) 2023-08-10T10:40:47.779 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.044+0000 7f49ad39a700 1 -- 172.21.15.107:0/3715315663 learned_addr learned my addr 172.21.15.107:0/3715315663 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:47.779 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.044+0000 7f49ad39a700 1 -- 172.21.15.107:0/3715315663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a807aa10 con 0x7f49a807bea0 2023-08-10T10:40:47.779 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.044+0000 7f49ad39a700 1 --2- 172.21.15.107:0/3715315663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a807a300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49a40098a0 tx=0x7f49a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e607cdf77caaee22 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:47.779 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.044+0000 7f499ffff700 1 -- 172.21.15.107:0/3715315663 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49a4004160 con 0x7f49a807bea0 2023-08-10T10:40:47.779 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.045+0000 7f499ffff700 1 -- 172.21.15.107:0/3715315663 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f49a40042c0 con 0x7f49a807bea0 2023-08-10T10:40:47.779 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.045+0000 7f499ffff700 1 -- 172.21.15.107:0/3715315663 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49a4011940 con 0x7f49a807bea0 2023-08-10T10:40:47.780 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.045+0000 7f49af5fe700 1 -- 172.21.15.107:0/3715315663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 msgr2=0x7f49a807a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:47.780 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.045+0000 7f49af5fe700 1 --2- 172.21.15.107:0/3715315663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a807a300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49a40098a0 tx=0x7f49a4009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:47.780 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.045+0000 7f49af5fe700 1 -- 172.21.15.107:0/3715315663 shutdown_connections 2023-08-10T10:40:47.780 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.045+0000 7f49af5fe700 1 --2- 172.21.15.107:0/3715315663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a807a300 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:47.780 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.045+0000 7f49af5fe700 1 -- 172.21.15.107:0/3715315663 >> 172.21.15.107:0/3715315663 conn(0x7f49a8101470 msgr2=0x7f49a8103890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:47.780 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.045+0000 7f49af5fe700 1 -- 172.21.15.107:0/3715315663 shutdown_connections 2023-08-10T10:40:47.780 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.045+0000 7f49af5fe700 1 -- 172.21.15.107:0/3715315663 wait complete. 2023-08-10T10:40:47.781 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.047+0000 7f49af5fe700 1 Processor -- start 2023-08-10T10:40:47.781 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.047+0000 7f49af5fe700 1 -- start start 2023-08-10T10:40:47.781 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.047+0000 7f49af5fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:47.781 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.048+0000 7f49af5fe700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a819c220 con 0x7f49a807bea0 2023-08-10T10:40:47.781 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.048+0000 7f49ad39a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:47.781 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.048+0000 7f49ad39a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a819bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35960/0 (socket says 172.21.15.107:35960) 2023-08-10T10:40:47.782 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.048+0000 7f49ad39a700 1 -- 172.21.15.107:0/3334024019 learned_addr learned my addr 172.21.15.107:0/3334024019 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:47.782 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.048+0000 7f49ad39a700 1 -- 172.21.15.107:0/3334024019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a4009550 con 0x7f49a807bea0 2023-08-10T10:40:47.782 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.048+0000 7f49ad39a700 1 --2- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a819bce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49a4000c00 tx=0x7f49a4011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:47.782 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.049+0000 7f499e7fc700 1 -- 172.21.15.107:0/3334024019 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49a40036a0 con 0x7f49a807bea0 2023-08-10T10:40:47.782 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.049+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a819c420 con 0x7f49a807bea0 2023-08-10T10:40:47.782 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.049+0000 7f499e7fc700 1 -- 172.21.15.107:0/3334024019 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f49a4003c70 con 0x7f49a807bea0 2023-08-10T10:40:47.783 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.049+0000 7f499e7fc700 1 -- 172.21.15.107:0/3334024019 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49a40193f0 con 0x7f49a807bea0 2023-08-10T10:40:47.783 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.049+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a819c840 con 0x7f49a807bea0 2023-08-10T10:40:47.783 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.050+0000 7f499e7fc700 1 -- 172.21.15.107:0/3334024019 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f49a401b440 con 0x7f49a807bea0 2023-08-10T10:40:47.783 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.050+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a8061da0 con 0x7f49a807bea0 2023-08-10T10:40:47.783 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.050+0000 7f499e7fc700 1 --2- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f49940385e0 0x7f499403aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:47.783 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.050+0000 7f499e7fc700 1 -- 172.21.15.107:0/3334024019 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f49a404c440 con 0x7f49a807bea0 2023-08-10T10:40:47.783 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.051+0000 7f49acb99700 1 --2- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f49940385e0 0x7f499403aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:47.784 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.051+0000 7f49acb99700 1 --2- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f49940385e0 0x7f499403aaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4998006fd0 tx=0x7f4998006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:47.784 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.056+0000 7f499e7fc700 1 -- 172.21.15.107:0/3334024019 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f49a4022950 con 0x7f49a807bea0 2023-08-10T10:40:47.784 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.093+0000 7f499e7fc700 1 -- 172.21.15.107:0/3334024019 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f49a402c350 con 0x7f49a807bea0 2023-08-10T10:40:47.784 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.293+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f49a8103730 con 0x7f49940385e0 2023-08-10T10:40:47.784 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.302+0000 7f499e7fc700 1 -- 172.21.15.107:0/3334024019 <== mgr.14118 v2:172.21.15.107:6800/294010818 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f49a8103730 con 0x7f49940385e0 2023-08-10T10:40:47.784 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.305+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f49940385e0 msgr2=0x7f499403aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:47.784 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.305+0000 7f49af5fe700 1 --2- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f49940385e0 0x7f499403aaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4998006fd0 tx=0x7f4998006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:47.785 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.305+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 msgr2=0x7f49a819bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:47.785 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.305+0000 7f49af5fe700 1 --2- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a819bce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49a4000c00 tx=0x7f49a4011e70 comp rx=0 tx=0).stop 2023-08-10T10:40:47.785 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.305+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 shutdown_connections 2023-08-10T10:40:47.785 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.305+0000 7f49af5fe700 1 --2- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f49940385e0 0x7f499403aaa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:47.785 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.305+0000 7f49af5fe700 1 --2- 172.21.15.107:0/3334024019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49a807bea0 0x7f49a819bce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:47.785 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.305+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 >> 172.21.15.107:0/3334024019 conn(0x7f49a8101470 msgr2=0x7f49a8102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:47.785 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.306+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 shutdown_connections 2023-08-10T10:40:47.785 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:47.306+0000 7f49af5fe700 1 -- 172.21.15.107:0/3334024019 wait complete. 2023-08-10T10:40:48.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:48 smithi107 ceph-mon[127953]: mgrmap e8: x(active, since 2s) 2023-08-10T10:40:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:48 smithi107 ceph-mon[127953]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:40:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:48 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:48 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:40:48.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:48 smithi107 ceph-mon[127953]: [10/Aug/2023:10:40:47] ENGINE Bus STARTING 2023-08-10T10:40:48.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:48 smithi107 ceph-mon[127953]: [10/Aug/2023:10:40:47] ENGINE Serving on http://172.21.15.107:8765 2023-08-10T10:40:48.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:48 smithi107 ceph-mon[127953]: [10/Aug/2023:10:40:47] ENGINE Serving on https://172.21.15.107:7150 2023-08-10T10:40:48.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:48 smithi107 ceph-mon[127953]: [10/Aug/2023:10:40:47] ENGINE Bus STARTED 2023-08-10T10:40:48.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:48 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:40:48.951 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout value unchanged 2023-08-10T10:40:48.952 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.304+0000 7f24800ec700 1 Processor -- start 2023-08-10T10:40:48.952 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.304+0000 7f24800ec700 1 -- start start 2023-08-10T10:40:48.952 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.305+0000 7f24800ec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247807a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:48.952 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.305+0000 7f24800ec700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247807a8b0 con 0x7f247807be80 2023-08-10T10:40:48.952 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.305+0000 7f247de88700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247807a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:48.953 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.305+0000 7f247de88700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247807a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35972/0 (socket says 172.21.15.107:35972) 2023-08-10T10:40:48.953 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.305+0000 7f247de88700 1 -- 172.21.15.107:0/2418614329 learned_addr learned my addr 172.21.15.107:0/2418614329 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:48.953 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.305+0000 7f247de88700 1 -- 172.21.15.107:0/2418614329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247807a9f0 con 0x7f247807be80 2023-08-10T10:40:48.953 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.306+0000 7f247de88700 1 --2- 172.21.15.107:0/2418614329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247807a2e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f24740098a0 tx=0x7f2474009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74caea7d98a7c0e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:48.953 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.306+0000 7f247ce86700 1 -- 172.21.15.107:0/2418614329 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2474004160 con 0x7f247807be80 2023-08-10T10:40:48.953 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.306+0000 7f247ce86700 1 -- 172.21.15.107:0/2418614329 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f24740042c0 con 0x7f247807be80 2023-08-10T10:40:48.953 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.306+0000 7f247ce86700 1 -- 172.21.15.107:0/2418614329 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2474011940 con 0x7f247807be80 2023-08-10T10:40:48.954 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.306+0000 7f24800ec700 1 -- 172.21.15.107:0/2418614329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 msgr2=0x7f247807a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:48.954 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.306+0000 7f24800ec700 1 --2- 172.21.15.107:0/2418614329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247807a2e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f24740098a0 tx=0x7f2474009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:48.954 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.307+0000 7f24800ec700 1 -- 172.21.15.107:0/2418614329 shutdown_connections 2023-08-10T10:40:48.954 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.307+0000 7f24800ec700 1 --2- 172.21.15.107:0/2418614329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247807a2e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:48.954 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.307+0000 7f24800ec700 1 -- 172.21.15.107:0/2418614329 >> 172.21.15.107:0/2418614329 conn(0x7f24781014b0 msgr2=0x7f24781038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:48.954 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.307+0000 7f24800ec700 1 -- 172.21.15.107:0/2418614329 shutdown_connections 2023-08-10T10:40:48.954 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.307+0000 7f24800ec700 1 -- 172.21.15.107:0/2418614329 wait complete. 2023-08-10T10:40:48.954 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.308+0000 7f24800ec700 1 Processor -- start 2023-08-10T10:40:48.955 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.308+0000 7f24800ec700 1 -- start start 2023-08-10T10:40:48.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.308+0000 7f24800ec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:48.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.308+0000 7f24800ec700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247819c280 con 0x7f247807be80 2023-08-10T10:40:48.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.308+0000 7f247de88700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:48.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.308+0000 7f247de88700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247819bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35978/0 (socket says 172.21.15.107:35978) 2023-08-10T10:40:48.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.308+0000 7f247de88700 1 -- 172.21.15.107:0/3856745691 learned_addr learned my addr 172.21.15.107:0/3856745691 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:48.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.309+0000 7f247de88700 1 -- 172.21.15.107:0/3856745691 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2474009550 con 0x7f247807be80 2023-08-10T10:40:48.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.309+0000 7f247de88700 1 --2- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247819bd40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2474011dc0 tx=0x7f2474011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:48.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.309+0000 7f246effd700 1 -- 172.21.15.107:0/3856745691 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24740037d0 con 0x7f247807be80 2023-08-10T10:40:48.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.309+0000 7f246effd700 1 -- 172.21.15.107:0/3856745691 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f247401b440 con 0x7f247807be80 2023-08-10T10:40:48.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.309+0000 7f246effd700 1 -- 172.21.15.107:0/3856745691 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f247401a560 con 0x7f247807be80 2023-08-10T10:40:48.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.309+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247819c480 con 0x7f247807be80 2023-08-10T10:40:48.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.309+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247819c8a0 con 0x7f247807be80 2023-08-10T10:40:48.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.310+0000 7f246effd700 1 -- 172.21.15.107:0/3856745691 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f247401b5b0 con 0x7f247807be80 2023-08-10T10:40:48.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.310+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247810c220 con 0x7f247807be80 2023-08-10T10:40:48.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.311+0000 7f246effd700 1 --2- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2464038760 0x7f246403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:48.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.311+0000 7f246effd700 1 -- 172.21.15.107:0/3856745691 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f247404c650 con 0x7f247807be80 2023-08-10T10:40:48.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.311+0000 7f247d687700 1 --2- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2464038760 0x7f246403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:48.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.312+0000 7f247d687700 1 --2- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2464038760 0x7f246403ac20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2468006fd0 tx=0x7f2468006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:48.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.316+0000 7f246effd700 1 -- 172.21.15.107:0/3856745691 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2474023a00 con 0x7f247807be80 2023-08-10T10:40:48.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.512+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f247819f6c0 con 0x7f2464038760 2023-08-10T10:40:48.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.513+0000 7f246effd700 1 -- 172.21.15.107:0/3856745691 <== mgr.14118 v2:172.21.15.107:6800/294010818 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f247819f6c0 con 0x7f2464038760 2023-08-10T10:40:48.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.515+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2464038760 msgr2=0x7f246403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:48.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.515+0000 7f24800ec700 1 --2- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2464038760 0x7f246403ac20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2468006fd0 tx=0x7f2468006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:48.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.515+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 msgr2=0x7f247819bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:48.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.515+0000 7f24800ec700 1 --2- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247819bd40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2474011dc0 tx=0x7f2474011ea0 comp rx=0 tx=0).stop 2023-08-10T10:40:48.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.515+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 shutdown_connections 2023-08-10T10:40:48.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.515+0000 7f24800ec700 1 --2- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2464038760 0x7f246403ac20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:48.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.515+0000 7f24800ec700 1 --2- 172.21.15.107:0/3856745691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f247807be80 0x7f247819bd40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:48.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.515+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 >> 172.21.15.107:0/3856745691 conn(0x7f24781014b0 msgr2=0x7f2478102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:48.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.516+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 shutdown_connections 2023-08-10T10:40:48.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:48.516+0000 7f24800ec700 1 -- 172.21.15.107:0/3856745691 wait complete. 2023-08-10T10:40:48.962 INFO:teuthology.orchestra.run.smithi107.stdout:Generating ssh key... 2023-08-10T10:40:49.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:49 smithi107 ceph-mon[127953]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:40:50.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: Generating public/private rsa key pair. 2023-08-10T10:40:50.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: Your identification has been saved in /tmp/tmppdy8sf8f/key. 2023-08-10T10:40:50.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: Your public key has been saved in /tmp/tmppdy8sf8f/key.pub. 2023-08-10T10:40:50.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: The key fingerprint is: 2023-08-10T10:40:50.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: SHA256:c7T/egphvnzD0+xvmu/JN14Rspe6TCGUeLH+fGjiaTg ceph-2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:50.328 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: The key's randomart image is: 2023-08-10T10:40:50.328 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: +---[RSA 3072]----+ 2023-08-10T10:40:50.328 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: | . | 2023-08-10T10:40:50.328 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: | . + | 2023-08-10T10:40:50.328 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: | ..= . . | 2023-08-10T10:40:50.328 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: | .+. o o| 2023-08-10T10:40:50.329 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: | S =o o + | 2023-08-10T10:40:50.329 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: | = o+ = .| 2023-08-10T10:40:50.329 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: | +o.X ..| 2023-08-10T10:40:50.329 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: | E.+@.Bo=| 2023-08-10T10:40:50.329 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: | =+oX*X*| 2023-08-10T10:40:50.329 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: +----[SHA256]-----+ 2023-08-10T10:40:50.532 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.478+0000 7f8fa9445700 1 Processor -- start 2023-08-10T10:40:50.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.479+0000 7f8fa9445700 1 -- start start 2023-08-10T10:40:50.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.479+0000 7f8fa9445700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa407a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.479+0000 7f8fa9445700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa407a8f0 con 0x7f8fa407bec0 2023-08-10T10:40:50.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.479+0000 7f8fa2ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa407a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.479+0000 7f8fa2ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa407a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35980/0 (socket says 172.21.15.107:35980) 2023-08-10T10:40:50.533 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.479+0000 7f8fa2ffd700 1 -- 172.21.15.107:0/835637739 learned_addr learned my addr 172.21.15.107:0/835637739 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:50.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.480+0000 7f8fa2ffd700 1 -- 172.21.15.107:0/835637739 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa407aa30 con 0x7f8fa407bec0 2023-08-10T10:40:50.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.480+0000 7f8fa2ffd700 1 --2- 172.21.15.107:0/835637739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa407a320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8f940098a0 tx=0x7f8f94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8ec10b5a0f2a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:50.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.480+0000 7f8fa1ffb700 1 -- 172.21.15.107:0/835637739 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f94004160 con 0x7f8fa407bec0 2023-08-10T10:40:50.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.480+0000 7f8fa1ffb700 1 -- 172.21.15.107:0/835637739 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8f940042c0 con 0x7f8fa407bec0 2023-08-10T10:40:50.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.480+0000 7f8fa1ffb700 1 -- 172.21.15.107:0/835637739 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f94011940 con 0x7f8fa407bec0 2023-08-10T10:40:50.534 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.481+0000 7f8fa9445700 1 -- 172.21.15.107:0/835637739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 msgr2=0x7f8fa407a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:50.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.481+0000 7f8fa9445700 1 --2- 172.21.15.107:0/835637739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa407a320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8f940098a0 tx=0x7f8f94009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.481+0000 7f8fa9445700 1 -- 172.21.15.107:0/835637739 shutdown_connections 2023-08-10T10:40:50.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.481+0000 7f8fa9445700 1 --2- 172.21.15.107:0/835637739 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa407a320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.535 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.481+0000 7f8fa9445700 1 -- 172.21.15.107:0/835637739 >> 172.21.15.107:0/835637739 conn(0x7f8fa41014b0 msgr2=0x7f8fa41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:50.536 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.481+0000 7f8fa9445700 1 -- 172.21.15.107:0/835637739 shutdown_connections 2023-08-10T10:40:50.536 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.481+0000 7f8fa9445700 1 -- 172.21.15.107:0/835637739 wait complete. 2023-08-10T10:40:50.536 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.482+0000 7f8fa9445700 1 Processor -- start 2023-08-10T10:40:50.536 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.483+0000 7f8fa9445700 1 -- start start 2023-08-10T10:40:50.536 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.483+0000 7f8fa9445700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.536 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.483+0000 7f8fa9445700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa419c270 con 0x7f8fa407bec0 2023-08-10T10:40:50.537 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.483+0000 7f8fa2ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.537 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.483+0000 7f8fa2ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa419bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35990/0 (socket says 172.21.15.107:35990) 2023-08-10T10:40:50.537 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.483+0000 7f8fa2ffd700 1 -- 172.21.15.107:0/2705440190 learned_addr learned my addr 172.21.15.107:0/2705440190 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:50.537 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.483+0000 7f8fa2ffd700 1 -- 172.21.15.107:0/2705440190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94009550 con 0x7f8fa407bec0 2023-08-10T10:40:50.537 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.484+0000 7f8fa2ffd700 1 --2- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa419bd30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000c00 tx=0x7f8f94011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:50.537 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.484+0000 7f8f8bfff700 1 -- 172.21.15.107:0/2705440190 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f940036a0 con 0x7f8fa407bec0 2023-08-10T10:40:50.538 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.484+0000 7f8f8bfff700 1 -- 172.21.15.107:0/2705440190 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8f94003c70 con 0x7f8fa407bec0 2023-08-10T10:40:50.538 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.484+0000 7f8f8bfff700 1 -- 172.21.15.107:0/2705440190 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f940193f0 con 0x7f8fa407bec0 2023-08-10T10:40:50.538 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.484+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa419c470 con 0x7f8fa407bec0 2023-08-10T10:40:50.538 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.484+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa419c890 con 0x7f8fa407bec0 2023-08-10T10:40:50.538 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.485+0000 7f8f8bfff700 1 -- 172.21.15.107:0/2705440190 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f8f9401b440 con 0x7f8fa407bec0 2023-08-10T10:40:50.538 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.485+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa4061da0 con 0x7f8fa407bec0 2023-08-10T10:40:50.539 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.486+0000 7f8f8bfff700 1 --2- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f8f8c038760 0x7f8f8c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:50.539 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.486+0000 7f8f8bfff700 1 -- 172.21.15.107:0/2705440190 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8f9404c5d0 con 0x7f8fa407bec0 2023-08-10T10:40:50.539 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.486+0000 7f8fa27fc700 1 --2- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f8f8c038760 0x7f8f8c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:50.539 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.486+0000 7f8fa27fc700 1 --2- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f8f8c038760 0x7f8f8c03ac20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f98006fd0 tx=0x7f8f98006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:50.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.491+0000 7f8f8bfff700 1 -- 172.21.15.107:0/2705440190 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8f94022950 con 0x7f8fa407bec0 2023-08-10T10:40:50.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:49.686+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fa41037b0 con 0x7f8f8c038760 2023-08-10T10:40:50.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.077+0000 7f8f8bfff700 1 -- 172.21.15.107:0/2705440190 <== mgr.14118 v2:172.21.15.107:6800/294010818 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8fa41037b0 con 0x7f8f8c038760 2023-08-10T10:40:50.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.079+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f8f8c038760 msgr2=0x7f8f8c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:50.540 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.079+0000 7f8fa9445700 1 --2- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f8f8c038760 0x7f8f8c03ac20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f98006fd0 tx=0x7f8f98006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:50.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.079+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 msgr2=0x7f8fa419bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:50.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.079+0000 7f8fa9445700 1 --2- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa419bd30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000c00 tx=0x7f8f94011e70 comp rx=0 tx=0).stop 2023-08-10T10:40:50.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.079+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 shutdown_connections 2023-08-10T10:40:50.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.079+0000 7f8fa9445700 1 --2- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f8f8c038760 0x7f8f8c03ac20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.079+0000 7f8fa9445700 1 --2- 172.21.15.107:0/2705440190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fa407bec0 0x7f8fa419bd30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:50.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.080+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 >> 172.21.15.107:0/2705440190 conn(0x7f8fa41014b0 msgr2=0x7f8fa4102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:50.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.080+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 shutdown_connections 2023-08-10T10:40:50.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:50.080+0000 7f8fa9445700 1 -- 172.21.15.107:0/2705440190 wait complete. 2023-08-10T10:40:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-mon[127953]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:40:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-mon[127953]: Generating ssh key... 2023-08-10T10:40:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:50.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:50 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:51.809 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOCaYg2ZmE+Cg37OAZTsJswbZ3expPoCq8eLRkeH8zbVikKHOVmQQComkSOMhcHFZyUPUt6a3yOwsm7n68NXUAr1ZrETY1d6wPGNy7HBFIdG4hAagsO7oDtd4bK+NRfGRz0cZU/IPBbwfTam/6Nera1UA9p7+/hyoWpjTW4oGQnuHQVqe202DQCLvxs6S9T4UPegfrP4eGD1rSqBdt39b0L4ITQatGR/LBnwWMGbX51ZZOOT3zm6taidXQWduA+8lF0PB8WgzNQwqhBAuwZSjuwmbJohydJbVlJcFqHaXtVAqcMXZ5HiM/LCTSeR7vikNbbO4iWKFUAZINlAb7XeVMXR1ChI9IyqhMYHa1GgcdEz8TgsZTlsuHjSdf4Sv8hBrOo7GkifIxGd/majad/vcFa1XllkqwjLQwd4zxsyrzMCOkyv8VXOOHEobJU2EjobpDPXBD2y/qrqX3U1rkn6QTvVcKWnoCSf5YYKknExrpDgt1PRHPonW5S/Vx8eYqNa0= ceph-2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:40:51.810 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.088+0000 7f46119be700 1 Processor -- start 2023-08-10T10:40:51.810 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.089+0000 7f46119be700 1 -- start start 2023-08-10T10:40:51.810 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.089+0000 7f46119be700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.810 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.089+0000 7f46119be700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c07a890 con 0x7f460c07be60 2023-08-10T10:40:51.810 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.089+0000 7f460affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.810 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.089+0000 7f460affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35996/0 (socket says 172.21.15.107:35996) 2023-08-10T10:40:51.811 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.089+0000 7f460affd700 1 -- 172.21.15.107:0/1098629630 learned_addr learned my addr 172.21.15.107:0/1098629630 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:51.811 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.090+0000 7f460affd700 1 -- 172.21.15.107:0/1098629630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c07a9d0 con 0x7f460c07be60 2023-08-10T10:40:51.811 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.090+0000 7f460affd700 1 --2- 172.21.15.107:0/1098629630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c07a2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0098a0 tx=0x7f45fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414541fececb989d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:51.811 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.090+0000 7f4609ffb700 1 -- 172.21.15.107:0/1098629630 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45fc004160 con 0x7f460c07be60 2023-08-10T10:40:51.811 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.090+0000 7f4609ffb700 1 -- 172.21.15.107:0/1098629630 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f45fc0042c0 con 0x7f460c07be60 2023-08-10T10:40:51.811 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.090+0000 7f4609ffb700 1 -- 172.21.15.107:0/1098629630 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45fc011940 con 0x7f460c07be60 2023-08-10T10:40:51.811 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.091+0000 7f46119be700 1 -- 172.21.15.107:0/1098629630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 msgr2=0x7f460c07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:51.812 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.091+0000 7f46119be700 1 --2- 172.21.15.107:0/1098629630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c07a2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0098a0 tx=0x7f45fc009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.812 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.091+0000 7f46119be700 1 -- 172.21.15.107:0/1098629630 shutdown_connections 2023-08-10T10:40:51.812 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.091+0000 7f46119be700 1 --2- 172.21.15.107:0/1098629630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c07a2c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.812 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.091+0000 7f46119be700 1 -- 172.21.15.107:0/1098629630 >> 172.21.15.107:0/1098629630 conn(0x7f460c1014b0 msgr2=0x7f460c1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:51.812 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.091+0000 7f46119be700 1 -- 172.21.15.107:0/1098629630 shutdown_connections 2023-08-10T10:40:51.812 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.091+0000 7f46119be700 1 -- 172.21.15.107:0/1098629630 wait complete. 2023-08-10T10:40:51.812 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.092+0000 7f46119be700 1 Processor -- start 2023-08-10T10:40:51.813 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.092+0000 7f46119be700 1 -- start start 2023-08-10T10:40:51.813 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.092+0000 7f46119be700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.813 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.092+0000 7f46119be700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c19c290 con 0x7f460c07be60 2023-08-10T10:40:51.813 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.092+0000 7f460affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.813 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.093+0000 7f460affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c19bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36004/0 (socket says 172.21.15.107:36004) 2023-08-10T10:40:51.813 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.093+0000 7f460affd700 1 -- 172.21.15.107:0/4269797805 learned_addr learned my addr 172.21.15.107:0/4269797805 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:51.813 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.093+0000 7f460affd700 1 -- 172.21.15.107:0/4269797805 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc009550 con 0x7f460c07be60 2023-08-10T10:40:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.093+0000 7f460affd700 1 --2- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c19bd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45fc011dc0 tx=0x7f45fc011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.093+0000 7f46109bc700 1 -- 172.21.15.107:0/4269797805 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45fc0037d0 con 0x7f460c07be60 2023-08-10T10:40:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.093+0000 7f46109bc700 1 -- 172.21.15.107:0/4269797805 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f45fc01b440 con 0x7f460c07be60 2023-08-10T10:40:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.093+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c19c490 con 0x7f460c07be60 2023-08-10T10:40:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.093+0000 7f46109bc700 1 -- 172.21.15.107:0/4269797805 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45fc01a560 con 0x7f460c07be60 2023-08-10T10:40:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.093+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c19c8b0 con 0x7f460c07be60 2023-08-10T10:40:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.094+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c10c1e0 con 0x7f460c07be60 2023-08-10T10:40:51.815 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.095+0000 7f46109bc700 1 -- 172.21.15.107:0/4269797805 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f45fc01b5b0 con 0x7f460c07be60 2023-08-10T10:40:51.815 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.095+0000 7f46109bc700 1 --2- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f45f4038760 0x7f45f403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:51.815 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.095+0000 7f46109bc700 1 -- 172.21.15.107:0/4269797805 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f45fc04c5f0 con 0x7f460c07be60 2023-08-10T10:40:51.815 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.095+0000 7f460a7fc700 1 --2- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f45f4038760 0x7f45f403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:51.815 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.096+0000 7f460a7fc700 1 --2- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f45f4038760 0x7f45f403ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4600006fd0 tx=0x7f4600006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:51.815 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.100+0000 7f46109bc700 1 -- 172.21.15.107:0/4269797805 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f45fc023590 con 0x7f460c07be60 2023-08-10T10:40:51.815 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.296+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f460c19f710 con 0x7f45f4038760 2023-08-10T10:40:51.815 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.297+0000 7f46109bc700 1 -- 172.21.15.107:0/4269797805 <== mgr.14118 v2:172.21.15.107:6800/294010818 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f460c19f710 con 0x7f45f4038760 2023-08-10T10:40:51.816 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f45f4038760 msgr2=0x7f45f403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:51.816 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 --2- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f45f4038760 0x7f45f403ac20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4600006fd0 tx=0x7f4600006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:51.816 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 msgr2=0x7f460c19bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:51.816 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 --2- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c19bd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45fc011dc0 tx=0x7f45fc011ea0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.816 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 shutdown_connections 2023-08-10T10:40:51.816 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 --2- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f45f4038760 0x7f45f403ac20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.816 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 --2- 172.21.15.107:0/4269797805 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f460c07be60 0x7f460c19bd50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:51.817 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 >> 172.21.15.107:0/4269797805 conn(0x7f460c1014b0 msgr2=0x7f460c102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:51.817 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 shutdown_connections 2023-08-10T10:40:51.817 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:51.299+0000 7f46119be700 1 -- 172.21.15.107:0/4269797805 wait complete. 2023-08-10T10:40:51.817 INFO:teuthology.orchestra.run.smithi107.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-08-10T10:40:51.817 INFO:teuthology.orchestra.run.smithi107.stdout:Adding key to root@localhost authorized_keys... 2023-08-10T10:40:51.818 INFO:teuthology.orchestra.run.smithi107.stdout:Adding host smithi107... 2023-08-10T10:40:52.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:51 smithi107 ceph-mon[127953]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:40:52.986 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:52 smithi107 ceph-mon[127953]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi107", "addr": "172.21.15.107", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:40:54.826 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:54 smithi107 ceph-mon[127953]: Deploying cephadm binary to smithi107 2023-08-10T10:40:56.195 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Added host 'smithi107' with addr '172.21.15.107' 2023-08-10T10:40:56.195 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.355+0000 7f5741ef9700 1 Processor -- start 2023-08-10T10:40:56.195 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.356+0000 7f5741ef9700 1 -- start start 2023-08-10T10:40:56.195 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.356+0000 7f5741ef9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c106290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:56.196 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.356+0000 7f5741ef9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c1067d0 con 0x7f573c105e70 2023-08-10T10:40:56.196 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.356+0000 7f573b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c106290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:56.196 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.356+0000 7f573b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c106290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36006/0 (socket says 172.21.15.107:36006) 2023-08-10T10:40:56.196 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.356+0000 7f573b7fe700 1 -- 172.21.15.107:0/976317156 learned_addr learned my addr 172.21.15.107:0/976317156 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:56.196 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.357+0000 7f573b7fe700 1 -- 172.21.15.107:0/976317156 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c106910 con 0x7f573c105e70 2023-08-10T10:40:56.196 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.357+0000 7f573b7fe700 1 --2- 172.21.15.107:0/976317156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c106290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f572c0098a0 tx=0x7f572c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d20e9a343206c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:56.197 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.357+0000 7f573a7fc700 1 -- 172.21.15.107:0/976317156 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f572c004160 con 0x7f573c105e70 2023-08-10T10:40:56.197 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.357+0000 7f573a7fc700 1 -- 172.21.15.107:0/976317156 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f572c0042c0 con 0x7f573c105e70 2023-08-10T10:40:56.197 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.357+0000 7f573a7fc700 1 -- 172.21.15.107:0/976317156 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f572c011940 con 0x7f573c105e70 2023-08-10T10:40:56.197 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.358+0000 7f5741ef9700 1 -- 172.21.15.107:0/976317156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 msgr2=0x7f573c106290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:56.197 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.358+0000 7f5741ef9700 1 --2- 172.21.15.107:0/976317156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c106290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f572c0098a0 tx=0x7f572c009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:56.197 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.358+0000 7f5741ef9700 1 -- 172.21.15.107:0/976317156 shutdown_connections 2023-08-10T10:40:56.200 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.358+0000 7f5741ef9700 1 --2- 172.21.15.107:0/976317156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c106290 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:56.200 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.358+0000 7f5741ef9700 1 -- 172.21.15.107:0/976317156 >> 172.21.15.107:0/976317156 conn(0x7f573c101470 msgr2=0x7f573c103890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:56.201 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.358+0000 7f5741ef9700 1 -- 172.21.15.107:0/976317156 shutdown_connections 2023-08-10T10:40:56.201 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.358+0000 7f5741ef9700 1 -- 172.21.15.107:0/976317156 wait complete. 2023-08-10T10:40:56.201 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.359+0000 7f5741ef9700 1 Processor -- start 2023-08-10T10:40:56.201 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.359+0000 7f5741ef9700 1 -- start start 2023-08-10T10:40:56.201 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.359+0000 7f5741ef9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:56.201 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.359+0000 7f5741ef9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c199fa0 con 0x7f573c105e70 2023-08-10T10:40:56.201 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.360+0000 7f573b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:56.202 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.360+0000 7f573b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36010/0 (socket says 172.21.15.107:36010) 2023-08-10T10:40:56.202 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.360+0000 7f573b7fe700 1 -- 172.21.15.107:0/957545588 learned_addr learned my addr 172.21.15.107:0/957545588 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:56.202 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.360+0000 7f573b7fe700 1 -- 172.21.15.107:0/957545588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c009550 con 0x7f573c105e70 2023-08-10T10:40:56.202 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.360+0000 7f573b7fe700 1 --2- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c199a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f572c011dc0 tx=0x7f572c011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:56.202 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.360+0000 7f5738ff9700 1 -- 172.21.15.107:0/957545588 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f572c0037d0 con 0x7f573c105e70 2023-08-10T10:40:56.202 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.360+0000 7f5738ff9700 1 -- 172.21.15.107:0/957545588 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f572c01b440 con 0x7f573c105e70 2023-08-10T10:40:56.202 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.360+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c19a1a0 con 0x7f573c105e70 2023-08-10T10:40:56.203 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.360+0000 7f5738ff9700 1 -- 172.21.15.107:0/957545588 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f572c01a560 con 0x7f573c105e70 2023-08-10T10:40:56.203 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.361+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c19a5c0 con 0x7f573c105e70 2023-08-10T10:40:56.203 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.362+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c061da0 con 0x7f573c105e70 2023-08-10T10:40:56.203 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.362+0000 7f5738ff9700 1 -- 172.21.15.107:0/957545588 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f572c01b5b0 con 0x7f573c105e70 2023-08-10T10:40:56.203 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.362+0000 7f5738ff9700 1 --2- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5724038760 0x7f572403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:56.204 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.362+0000 7f5738ff9700 1 -- 172.21.15.107:0/957545588 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f572c04c5f0 con 0x7f573c105e70 2023-08-10T10:40:56.204 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.363+0000 7f573affd700 1 --2- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5724038760 0x7f572403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:56.204 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.363+0000 7f573affd700 1 --2- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5724038760 0x7f572403ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5730006fd0 tx=0x7f5730006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:56.204 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.367+0000 7f5738ff9700 1 -- 172.21.15.107:0/957545588 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f572c023590 con 0x7f573c105e70 2023-08-10T10:40:56.204 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:52.565+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi107", "addr": "172.21.15.107", "target": ["mon-mgr", ""]}) v1 -- 0x7f573c19d420 con 0x7f5724038760 2023-08-10T10:40:56.205 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.731+0000 7f5738ff9700 1 -- 172.21.15.107:0/957545588 <== mgr.14118 v2:172.21.15.107:6800/294010818 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f573c19d420 con 0x7f5724038760 2023-08-10T10:40:56.205 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5724038760 msgr2=0x7f572403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:56.205 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 --2- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5724038760 0x7f572403ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5730006fd0 tx=0x7f5730006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:56.205 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 msgr2=0x7f573c199a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:56.205 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 --2- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c199a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f572c011dc0 tx=0x7f572c011ea0 comp rx=0 tx=0).stop 2023-08-10T10:40:56.205 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 shutdown_connections 2023-08-10T10:40:56.205 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 --2- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5724038760 0x7f572403ac20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:56.205 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 --2- 172.21.15.107:0/957545588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f573c105e70 0x7f573c199a60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:56.206 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 >> 172.21.15.107:0/957545588 conn(0x7f573c101470 msgr2=0x7f573c1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:56.206 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 shutdown_connections 2023-08-10T10:40:56.206 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:55.734+0000 7f5741ef9700 1 -- 172.21.15.107:0/957545588 wait complete. 2023-08-10T10:40:56.206 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying unmanaged mon service... 2023-08-10T10:40:56.991 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:56 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:56.991 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:56 smithi107 ceph-mon[127953]: Added host smithi107 2023-08-10T10:40:56.991 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:56 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:40:57.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-08-10T10:40:57.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.735+0000 7f742b59e700 1 Processor -- start 2023-08-10T10:40:57.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.735+0000 7f742b59e700 1 -- start start 2023-08-10T10:40:57.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.735+0000 7f742b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:57.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.735+0000 7f742b59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c07a890 con 0x7f742c07be60 2023-08-10T10:40:57.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.735+0000 7f742a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:57.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.736+0000 7f742a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59650/0 (socket says 172.21.15.107:59650) 2023-08-10T10:40:57.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.736+0000 7f742a59c700 1 -- 172.21.15.107:0/745698115 learned_addr learned my addr 172.21.15.107:0/745698115 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:57.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.736+0000 7f742a59c700 1 -- 172.21.15.107:0/745698115 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c07a9d0 con 0x7f742c07be60 2023-08-10T10:40:57.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.736+0000 7f742a59c700 1 --2- 172.21.15.107:0/745698115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c07a2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f741c0098a0 tx=0x7f741c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4dbbf609a8e016 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:57.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.736+0000 7f742959a700 1 -- 172.21.15.107:0/745698115 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f741c004160 con 0x7f742c07be60 2023-08-10T10:40:57.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.736+0000 7f742959a700 1 -- 172.21.15.107:0/745698115 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f741c0042c0 con 0x7f742c07be60 2023-08-10T10:40:57.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.736+0000 7f742959a700 1 -- 172.21.15.107:0/745698115 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f741c011940 con 0x7f742c07be60 2023-08-10T10:40:57.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.737+0000 7f742b59e700 1 -- 172.21.15.107:0/745698115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 msgr2=0x7f742c07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:57.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.737+0000 7f742b59e700 1 --2- 172.21.15.107:0/745698115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c07a2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f741c0098a0 tx=0x7f741c009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:57.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.737+0000 7f742b59e700 1 -- 172.21.15.107:0/745698115 shutdown_connections 2023-08-10T10:40:57.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.737+0000 7f742b59e700 1 --2- 172.21.15.107:0/745698115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c07a2c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:57.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.737+0000 7f742b59e700 1 -- 172.21.15.107:0/745698115 >> 172.21.15.107:0/745698115 conn(0x7f742c1012b0 msgr2=0x7f742c1036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:57.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.737+0000 7f742b59e700 1 -- 172.21.15.107:0/745698115 shutdown_connections 2023-08-10T10:40:57.382 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.737+0000 7f742b59e700 1 -- 172.21.15.107:0/745698115 wait complete. 2023-08-10T10:40:57.382 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.738+0000 7f742b59e700 1 Processor -- start 2023-08-10T10:40:57.382 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.738+0000 7f742b59e700 1 -- start start 2023-08-10T10:40:57.382 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.739+0000 7f742b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:57.382 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.739+0000 7f742b59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c19bfd0 con 0x7f742c07be60 2023-08-10T10:40:57.382 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.739+0000 7f742a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:57.382 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.739+0000 7f742a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c19ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59652/0 (socket says 172.21.15.107:59652) 2023-08-10T10:40:57.383 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.739+0000 7f742a59c700 1 -- 172.21.15.107:0/4007911937 learned_addr learned my addr 172.21.15.107:0/4007911937 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:57.383 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.739+0000 7f742a59c700 1 -- 172.21.15.107:0/4007911937 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c009550 con 0x7f742c07be60 2023-08-10T10:40:57.383 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.739+0000 7f742a59c700 1 --2- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c19ba90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f741c011dc0 tx=0x7f741c011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:57.383 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.740+0000 7f741b7fe700 1 -- 172.21.15.107:0/4007911937 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f741c0037d0 con 0x7f742c07be60 2023-08-10T10:40:57.383 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.740+0000 7f741b7fe700 1 -- 172.21.15.107:0/4007911937 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f741c01b440 con 0x7f742c07be60 2023-08-10T10:40:57.383 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.740+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c19c1d0 con 0x7f742c07be60 2023-08-10T10:40:57.383 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.740+0000 7f741b7fe700 1 -- 172.21.15.107:0/4007911937 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f741c01a560 con 0x7f742c07be60 2023-08-10T10:40:57.383 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.740+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c19c5f0 con 0x7f742c07be60 2023-08-10T10:40:57.384 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.741+0000 7f741b7fe700 1 -- 172.21.15.107:0/4007911937 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f741c003930 con 0x7f742c07be60 2023-08-10T10:40:57.384 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.741+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c10c000 con 0x7f742c07be60 2023-08-10T10:40:57.384 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.741+0000 7f741b7fe700 1 --2- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7414038760 0x7f741403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:57.384 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.741+0000 7f741b7fe700 1 -- 172.21.15.107:0/4007911937 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f741c04c670 con 0x7f742c07be60 2023-08-10T10:40:57.384 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.742+0000 7f7429d9b700 1 --2- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7414038760 0x7f741403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:57.384 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.742+0000 7f7429d9b700 1 --2- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7414038760 0x7f741403ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7420006fd0 tx=0x7f7420006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:57.384 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.747+0000 7f741b7fe700 1 -- 172.21.15.107:0/4007911937 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f741c01b920 con 0x7f742c07be60 2023-08-10T10:40:57.385 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.959+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f742c19f400 con 0x7f7414038760 2023-08-10T10:40:57.385 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.967+0000 7f741b7fe700 1 -- 172.21.15.107:0/4007911937 <== mgr.14118 v2:172.21.15.107:6800/294010818 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f742c19f400 con 0x7f7414038760 2023-08-10T10:40:57.385 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7414038760 msgr2=0x7f741403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:57.385 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 --2- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7414038760 0x7f741403ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7420006fd0 tx=0x7f7420006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:57.385 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 msgr2=0x7f742c19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:57.385 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 --2- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c19ba90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f741c011dc0 tx=0x7f741c011ea0 comp rx=0 tx=0).stop 2023-08-10T10:40:57.385 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 shutdown_connections 2023-08-10T10:40:57.385 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 --2- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7414038760 0x7f741403ac20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:57.386 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 --2- 172.21.15.107:0/4007911937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f742c07be60 0x7f742c19ba90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:57.386 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 >> 172.21.15.107:0/4007911937 conn(0x7f742c1012b0 msgr2=0x7f742c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:57.386 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 shutdown_connections 2023-08-10T10:40:57.386 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:56.969+0000 7f742b59e700 1 -- 172.21.15.107:0/4007911937 wait complete. 2023-08-10T10:40:57.386 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying unmanaged mgr service... 2023-08-10T10:40:58.107 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:57 smithi107 ceph-mon[127953]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:40:58.107 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:57 smithi107 ceph-mon[127953]: Saving service mon spec with placement count:5 2023-08-10T10:40:58.107 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:57 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:58.860 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-08-10T10:40:58.860 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.130+0000 7f5d12794700 1 Processor -- start 2023-08-10T10:40:58.861 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.130+0000 7f5d12794700 1 -- start start 2023-08-10T10:40:58.861 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.130+0000 7f5d12794700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c106290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:58.861 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.130+0000 7f5d12794700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c1067d0 con 0x7f5d0c105e70 2023-08-10T10:40:58.861 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.131+0000 7f5d0bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c106290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:58.862 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.131+0000 7f5d0bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c106290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59656/0 (socket says 172.21.15.107:59656) 2023-08-10T10:40:58.863 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.131+0000 7f5d0bfff700 1 -- 172.21.15.107:0/473780583 learned_addr learned my addr 172.21.15.107:0/473780583 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:58.863 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.131+0000 7f5d0bfff700 1 -- 172.21.15.107:0/473780583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c106910 con 0x7f5d0c105e70 2023-08-10T10:40:58.863 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.131+0000 7f5d0bfff700 1 --2- 172.21.15.107:0/473780583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c106290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0098a0 tx=0x7f5cfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3f33120b690391 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:58.864 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d0affd700 1 -- 172.21.15.107:0/473780583 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc004160 con 0x7f5d0c105e70 2023-08-10T10:40:58.864 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d0affd700 1 -- 172.21.15.107:0/473780583 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5cfc0042c0 con 0x7f5d0c105e70 2023-08-10T10:40:58.864 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d0affd700 1 -- 172.21.15.107:0/473780583 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc011940 con 0x7f5d0c105e70 2023-08-10T10:40:58.864 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d12794700 1 -- 172.21.15.107:0/473780583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 msgr2=0x7f5d0c106290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:58.865 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d12794700 1 --2- 172.21.15.107:0/473780583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c106290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0098a0 tx=0x7f5cfc009bb0 comp rx=0 tx=0).stop 2023-08-10T10:40:58.865 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d12794700 1 -- 172.21.15.107:0/473780583 shutdown_connections 2023-08-10T10:40:58.866 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d12794700 1 --2- 172.21.15.107:0/473780583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c106290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:58.866 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d12794700 1 -- 172.21.15.107:0/473780583 >> 172.21.15.107:0/473780583 conn(0x7f5d0c101470 msgr2=0x7f5d0c103890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:58.866 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d12794700 1 -- 172.21.15.107:0/473780583 shutdown_connections 2023-08-10T10:40:58.867 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.132+0000 7f5d12794700 1 -- 172.21.15.107:0/473780583 wait complete. 2023-08-10T10:40:58.867 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.133+0000 7f5d12794700 1 Processor -- start 2023-08-10T10:40:58.867 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.133+0000 7f5d12794700 1 -- start start 2023-08-10T10:40:58.867 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.134+0000 7f5d12794700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c19bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:58.868 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.134+0000 7f5d12794700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c19c1a0 con 0x7f5d0c105e70 2023-08-10T10:40:58.868 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.134+0000 7f5d0bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c19bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:58.868 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.134+0000 7f5d0bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c19bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59668/0 (socket says 172.21.15.107:59668) 2023-08-10T10:40:58.868 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.134+0000 7f5d0bfff700 1 -- 172.21.15.107:0/898642146 learned_addr learned my addr 172.21.15.107:0/898642146 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:40:58.868 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.134+0000 7f5d0bfff700 1 -- 172.21.15.107:0/898642146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc009550 con 0x7f5d0c105e70 2023-08-10T10:40:58.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.134+0000 7f5d0bfff700 1 --2- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c19bc60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc011dc0 tx=0x7f5cfc011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:58.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.135+0000 7f5d097fa700 1 -- 172.21.15.107:0/898642146 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc0037d0 con 0x7f5d0c105e70 2023-08-10T10:40:58.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.135+0000 7f5d097fa700 1 -- 172.21.15.107:0/898642146 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5cfc01b440 con 0x7f5d0c105e70 2023-08-10T10:40:58.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.135+0000 7f5d097fa700 1 -- 172.21.15.107:0/898642146 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc01a560 con 0x7f5d0c105e70 2023-08-10T10:40:58.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.135+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c19c3a0 con 0x7f5d0c105e70 2023-08-10T10:40:58.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.135+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c19c7c0 con 0x7f5d0c105e70 2023-08-10T10:40:58.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.136+0000 7f5d097fa700 1 -- 172.21.15.107:0/898642146 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f5cfc01b5b0 con 0x7f5d0c105e70 2023-08-10T10:40:58.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.136+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c061da0 con 0x7f5d0c105e70 2023-08-10T10:40:58.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.136+0000 7f5d097fa700 1 --2- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5cf4038760 0x7f5cf403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:40:58.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.136+0000 7f5d097fa700 1 -- 172.21.15.107:0/898642146 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5cfc04c5f0 con 0x7f5d0c105e70 2023-08-10T10:40:58.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.137+0000 7f5d0b7fe700 1 --2- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5cf4038760 0x7f5cf403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:40:58.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.137+0000 7f5d0b7fe700 1 --2- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5cf4038760 0x7f5cf403ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5d00006fd0 tx=0x7f5d00006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:40:58.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.141+0000 7f5d097fa700 1 -- 172.21.15.107:0/898642146 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5cfc023590 con 0x7f5d0c105e70 2023-08-10T10:40:58.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.359+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f5d0c10a260 con 0x7f5cf4038760 2023-08-10T10:40:58.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.366+0000 7f5d097fa700 1 -- 172.21.15.107:0/898642146 <== mgr.14118 v2:172.21.15.107:6800/294010818 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5d0c10a260 con 0x7f5cf4038760 2023-08-10T10:40:58.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5cf4038760 msgr2=0x7f5cf403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:58.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 --2- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5cf4038760 0x7f5cf403ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5d00006fd0 tx=0x7f5d00006e40 comp rx=0 tx=0).stop 2023-08-10T10:40:58.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 msgr2=0x7f5d0c19bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:40:58.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 --2- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c19bc60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc011dc0 tx=0x7f5cfc011ea0 comp rx=0 tx=0).stop 2023-08-10T10:40:58.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 shutdown_connections 2023-08-10T10:40:58.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 --2- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f5cf4038760 0x7f5cf403ac20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:58.872 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 --2- 172.21.15.107:0/898642146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5d0c105e70 0x7f5d0c19bc60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:40:58.872 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 >> 172.21.15.107:0/898642146 conn(0x7f5d0c101470 msgr2=0x7f5d0c1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:40:58.872 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 shutdown_connections 2023-08-10T10:40:58.872 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:58.369+0000 7f5d12794700 1 -- 172.21.15.107:0/898642146 wait complete. 2023-08-10T10:40:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:59 smithi107 ceph-mon[127953]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:40:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:59 smithi107 ceph-mon[127953]: Saving service mgr spec with placement count:2 2023-08-10T10:40:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:59 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:59 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:40:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:40:59 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:41:00.142 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.399+0000 7fc6a33ac700 1 Processor -- start 2023-08-10T10:41:00.142 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.400+0000 7fc6a33ac700 1 -- start start 2023-08-10T10:41:00.142 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.400+0000 7fc6a33ac700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c108db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:00.142 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.400+0000 7fc6a33ac700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c079df0 con 0x7fc69c1069c0 2023-08-10T10:41:00.142 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.400+0000 7fc6a1148700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c108db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:00.143 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.400+0000 7fc6a1148700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c108db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59676/0 (socket says 172.21.15.107:59676) 2023-08-10T10:41:00.143 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.400+0000 7fc6a1148700 1 -- 172.21.15.107:0/1042181936 learned_addr learned my addr 172.21.15.107:0/1042181936 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:00.143 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.401+0000 7fc6a1148700 1 -- 172.21.15.107:0/1042181936 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c079f30 con 0x7fc69c1069c0 2023-08-10T10:41:00.143 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.401+0000 7fc6a1148700 1 --2- 172.21.15.107:0/1042181936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c108db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc6980098a0 tx=0x7fc698009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2573ec4ba56d9a0a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:00.143 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.401+0000 7fc693fff700 1 -- 172.21.15.107:0/1042181936 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc698004160 con 0x7fc69c1069c0 2023-08-10T10:41:00.144 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.401+0000 7fc693fff700 1 -- 172.21.15.107:0/1042181936 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc6980042c0 con 0x7fc69c1069c0 2023-08-10T10:41:00.144 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.401+0000 7fc693fff700 1 -- 172.21.15.107:0/1042181936 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc6980118e0 con 0x7fc69c1069c0 2023-08-10T10:41:00.144 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.402+0000 7fc6a33ac700 1 -- 172.21.15.107:0/1042181936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 msgr2=0x7fc69c108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:00.144 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.402+0000 7fc6a33ac700 1 --2- 172.21.15.107:0/1042181936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c108db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc6980098a0 tx=0x7fc698009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:00.144 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.402+0000 7fc6a33ac700 1 -- 172.21.15.107:0/1042181936 shutdown_connections 2023-08-10T10:41:00.144 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.402+0000 7fc6a33ac700 1 --2- 172.21.15.107:0/1042181936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c108db0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:00.144 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.402+0000 7fc6a33ac700 1 -- 172.21.15.107:0/1042181936 >> 172.21.15.107:0/1042181936 conn(0x7fc69c100330 msgr2=0x7fc69c102770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:00.144 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.402+0000 7fc6a33ac700 1 -- 172.21.15.107:0/1042181936 shutdown_connections 2023-08-10T10:41:00.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.402+0000 7fc6a33ac700 1 -- 172.21.15.107:0/1042181936 wait complete. 2023-08-10T10:41:00.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.403+0000 7fc6a33ac700 1 Processor -- start 2023-08-10T10:41:00.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.403+0000 7fc6a33ac700 1 -- start start 2023-08-10T10:41:00.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.403+0000 7fc6a33ac700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:00.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.403+0000 7fc6a33ac700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c19a0a0 con 0x7fc69c1069c0 2023-08-10T10:41:00.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.404+0000 7fc6a1148700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:00.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.404+0000 7fc6a1148700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59680/0 (socket says 172.21.15.107:59680) 2023-08-10T10:41:00.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.404+0000 7fc6a1148700 1 -- 172.21.15.107:0/2583516601 learned_addr learned my addr 172.21.15.107:0/2583516601 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:00.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.404+0000 7fc6a1148700 1 -- 172.21.15.107:0/2583516601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698009550 con 0x7fc69c1069c0 2023-08-10T10:41:00.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.404+0000 7fc6a1148700 1 --2- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c199b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc6980118f0 tx=0x7fc6980119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:00.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.404+0000 7fc6927fc700 1 -- 172.21.15.107:0/2583516601 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc6980036a0 con 0x7fc69c1069c0 2023-08-10T10:41:00.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.404+0000 7fc6927fc700 1 -- 172.21.15.107:0/2583516601 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc69801b440 con 0x7fc69c1069c0 2023-08-10T10:41:00.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.404+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69c19a2a0 con 0x7fc69c1069c0 2023-08-10T10:41:00.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.405+0000 7fc6927fc700 1 -- 172.21.15.107:0/2583516601 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc6980193f0 con 0x7fc69c1069c0 2023-08-10T10:41:00.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.405+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c19a6c0 con 0x7fc69c1069c0 2023-08-10T10:41:00.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.406+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c10a000 con 0x7fc69c1069c0 2023-08-10T10:41:00.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.406+0000 7fc6927fc700 1 -- 172.21.15.107:0/2583516601 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fc69801b5b0 con 0x7fc69c1069c0 2023-08-10T10:41:00.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.406+0000 7fc6927fc700 1 --2- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fc688038710 0x7fc68803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:00.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.406+0000 7fc6927fc700 1 -- 172.21.15.107:0/2583516601 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc69804c610 con 0x7fc69c1069c0 2023-08-10T10:41:00.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.406+0000 7fc6a0947700 1 --2- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fc688038710 0x7fc68803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:00.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.407+0000 7fc6a0947700 1 --2- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fc688038710 0x7fc68803abd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc68c006fd0 tx=0x7fc68c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:00.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.411+0000 7fc6927fc700 1 -- 172.21.15.107:0/2583516601 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc698023590 con 0x7fc69c1069c0 2023-08-10T10:41:00.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.616+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fc69c10a220 con 0x7fc69c1069c0 2023-08-10T10:41:00.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.622+0000 7fc6927fc700 1 -- 172.21.15.107:0/2583516601 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc69801f070 con 0x7fc69c1069c0 2023-08-10T10:41:00.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fc688038710 msgr2=0x7fc68803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:00.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 --2- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fc688038710 0x7fc68803abd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc68c006fd0 tx=0x7fc68c006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:00.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 msgr2=0x7fc69c199b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:00.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 --2- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c199b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc6980118f0 tx=0x7fc6980119d0 comp rx=0 tx=0).stop 2023-08-10T10:41:00.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 shutdown_connections 2023-08-10T10:41:00.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 --2- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fc688038710 0x7fc68803abd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:00.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 --2- 172.21.15.107:0/2583516601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc69c1069c0 0x7fc69c199b60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:00.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 >> 172.21.15.107:0/2583516601 conn(0x7fc69c100330 msgr2=0x7fc69c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:00.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 shutdown_connections 2023-08-10T10:41:00.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:40:59.625+0000 7fc6a33ac700 1 -- 172.21.15.107:0/2583516601 wait complete. 2023-08-10T10:41:00.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2583516601' entity='client.admin' 2023-08-10T10:41:01.421 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.732+0000 7f2ff7562700 1 Processor -- start 2023-08-10T10:41:01.421 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.732+0000 7f2ff7562700 1 -- start start 2023-08-10T10:41:01.421 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.733+0000 7f2ff7562700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff0106290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:01.422 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.733+0000 7f2ff7562700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff01067d0 con 0x7f2ff0105e70 2023-08-10T10:41:01.422 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.733+0000 7f2ff52fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff0106290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:01.422 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.733+0000 7f2ff52fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff0106290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59682/0 (socket says 172.21.15.107:59682) 2023-08-10T10:41:01.422 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.733+0000 7f2ff52fe700 1 -- 172.21.15.107:0/1243406741 learned_addr learned my addr 172.21.15.107:0/1243406741 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:01.422 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.734+0000 7f2ff52fe700 1 -- 172.21.15.107:0/1243406741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff0106910 con 0x7f2ff0105e70 2023-08-10T10:41:01.422 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.734+0000 7f2ff52fe700 1 --2- 172.21.15.107:0/1243406741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff0106290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0098a0 tx=0x7f2fec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8559c3c77c500c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:01.423 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.734+0000 7f2fe7fff700 1 -- 172.21.15.107:0/1243406741 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2fec004160 con 0x7f2ff0105e70 2023-08-10T10:41:01.423 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.734+0000 7f2fe7fff700 1 -- 172.21.15.107:0/1243406741 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2fec0042c0 con 0x7f2ff0105e70 2023-08-10T10:41:01.423 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.734+0000 7f2fe7fff700 1 -- 172.21.15.107:0/1243406741 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2fec0118e0 con 0x7f2ff0105e70 2023-08-10T10:41:01.423 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.735+0000 7f2ff7562700 1 -- 172.21.15.107:0/1243406741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 msgr2=0x7f2ff0106290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:01.424 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.735+0000 7f2ff7562700 1 --2- 172.21.15.107:0/1243406741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff0106290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0098a0 tx=0x7f2fec009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:01.424 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.735+0000 7f2ff7562700 1 -- 172.21.15.107:0/1243406741 shutdown_connections 2023-08-10T10:41:01.424 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.735+0000 7f2ff7562700 1 --2- 172.21.15.107:0/1243406741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff0106290 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:01.424 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.735+0000 7f2ff7562700 1 -- 172.21.15.107:0/1243406741 >> 172.21.15.107:0/1243406741 conn(0x7f2ff0101470 msgr2=0x7f2ff0103890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:01.425 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.735+0000 7f2ff7562700 1 -- 172.21.15.107:0/1243406741 shutdown_connections 2023-08-10T10:41:01.425 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.735+0000 7f2ff7562700 1 -- 172.21.15.107:0/1243406741 wait complete. 2023-08-10T10:41:01.425 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.736+0000 7f2ff7562700 1 Processor -- start 2023-08-10T10:41:01.425 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.736+0000 7f2ff7562700 1 -- start start 2023-08-10T10:41:01.425 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.737+0000 7f2ff7562700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:01.425 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.737+0000 7f2ff7562700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff019c290 con 0x7f2ff0105e70 2023-08-10T10:41:01.425 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.737+0000 7f2ff52fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:01.426 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.737+0000 7f2ff52fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff019bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59696/0 (socket says 172.21.15.107:59696) 2023-08-10T10:41:01.426 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.737+0000 7f2ff52fe700 1 -- 172.21.15.107:0/1377762351 learned_addr learned my addr 172.21.15.107:0/1377762351 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:01.426 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.737+0000 7f2ff52fe700 1 -- 172.21.15.107:0/1377762351 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec009550 con 0x7f2ff0105e70 2023-08-10T10:41:01.426 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.738+0000 7f2ff52fe700 1 --2- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff019bd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0118f0 tx=0x7f2fec0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:01.426 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.738+0000 7f2fe67fc700 1 -- 172.21.15.107:0/1377762351 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2fec0036a0 con 0x7f2ff0105e70 2023-08-10T10:41:01.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.738+0000 7f2fe67fc700 1 -- 172.21.15.107:0/1377762351 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2fec024440 con 0x7f2ff0105e70 2023-08-10T10:41:01.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.738+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff019c490 con 0x7f2ff0105e70 2023-08-10T10:41:01.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.738+0000 7f2fe67fc700 1 -- 172.21.15.107:0/1377762351 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2fec01a430 con 0x7f2ff0105e70 2023-08-10T10:41:01.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.738+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff019c8b0 con 0x7f2ff0105e70 2023-08-10T10:41:01.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.739+0000 7f2fe67fc700 1 -- 172.21.15.107:0/1377762351 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f2fec01a6a0 con 0x7f2ff0105e70 2023-08-10T10:41:01.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.739+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff0061da0 con 0x7f2ff0105e70 2023-08-10T10:41:01.427 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.740+0000 7f2fe67fc700 1 --2- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2fdc038760 0x7f2fdc03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:01.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.740+0000 7f2fe67fc700 1 -- 172.21.15.107:0/1377762351 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2fec04c580 con 0x7f2ff0105e70 2023-08-10T10:41:01.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.740+0000 7f2ff4afd700 1 --2- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2fdc038760 0x7f2fdc03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:01.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.741+0000 7f2ff4afd700 1 --2- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2fdc038760 0x7f2fdc03ac20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0006fd0 tx=0x7f2fe0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:01.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.745+0000 7f2fe67fc700 1 -- 172.21.15.107:0/1377762351 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2fec018b80 con 0x7f2ff0105e70 2023-08-10T10:41:01.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.966+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f2ff0107c80 con 0x7f2ff0105e70 2023-08-10T10:41:01.428 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.972+0000 7f2fe67fc700 1 -- 172.21.15.107:0/1377762351 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f2fec018350 con 0x7f2ff0105e70 2023-08-10T10:41:01.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.975+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2fdc038760 msgr2=0x7f2fdc03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:01.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.975+0000 7f2ff7562700 1 --2- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2fdc038760 0x7f2fdc03ac20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0006fd0 tx=0x7f2fe0006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:01.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.975+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 msgr2=0x7f2ff019bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:01.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.975+0000 7f2ff7562700 1 --2- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff019bd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0118f0 tx=0x7f2fec0119d0 comp rx=0 tx=0).stop 2023-08-10T10:41:01.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.975+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 shutdown_connections 2023-08-10T10:41:01.429 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.975+0000 7f2ff7562700 1 --2- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2fdc038760 0x7f2fdc03ac20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:01.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.975+0000 7f2ff7562700 1 --2- 172.21.15.107:0/1377762351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ff0105e70 0x7f2ff019bd50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:01.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.975+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 >> 172.21.15.107:0/1377762351 conn(0x7f2ff0101470 msgr2=0x7f2ff0102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:01.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.975+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 shutdown_connections 2023-08-10T10:41:01.430 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:00.976+0000 7f2ff7562700 1 -- 172.21.15.107:0/1377762351 wait complete. 2023-08-10T10:41:01.430 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling the dashboard module... 2023-08-10T10:41:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:01 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1377762351' entity='client.admin' 2023-08-10T10:41:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:01 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:41:03.278 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: ignoring --setuser ceph since I am not root 2023-08-10T10:41:03.278 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: ignoring --setgroup ceph since I am not root 2023-08-10T10:41:03.279 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:02 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2152490235' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-08-10T10:41:03.279 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:02 smithi107 ceph-mon[127953]: from='mgr.14118 172.21.15.107:0/1258974939' entity='mgr.x' 2023-08-10T10:41:03.402 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.931+0000 7f794bd9e700 1 Processor -- start 2023-08-10T10:41:03.408 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.931+0000 7f794bd9e700 1 -- start start 2023-08-10T10:41:03.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.931+0000 7f794bd9e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f7944106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:03.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.931+0000 7f794bd9e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7944079eb0 con 0x7f79441046d0 2023-08-10T10:41:03.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.931+0000 7f7949b3a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f7944106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:03.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.932+0000 7f7949b3a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f7944106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59698/0 (socket says 172.21.15.107:59698) 2023-08-10T10:41:03.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.932+0000 7f7949b3a700 1 -- 172.21.15.107:0/3667613587 learned_addr learned my addr 172.21.15.107:0/3667613587 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:03.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.932+0000 7f7949b3a700 1 -- 172.21.15.107:0/3667613587 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7944107040 con 0x7f79441046d0 2023-08-10T10:41:03.409 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.932+0000 7f7949b3a700 1 --2- 172.21.15.107:0/3667613587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f7944106b00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79400098a0 tx=0x7f7940009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e111b61f1f570d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:03.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.932+0000 7f7948b38700 1 -- 172.21.15.107:0/3667613587 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7940004160 con 0x7f79441046d0 2023-08-10T10:41:03.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.932+0000 7f7948b38700 1 -- 172.21.15.107:0/3667613587 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79400042c0 con 0x7f79441046d0 2023-08-10T10:41:03.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.932+0000 7f7948b38700 1 -- 172.21.15.107:0/3667613587 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79400118e0 con 0x7f79441046d0 2023-08-10T10:41:03.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.933+0000 7f794bd9e700 1 -- 172.21.15.107:0/3667613587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 msgr2=0x7f7944106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:03.410 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.933+0000 7f794bd9e700 1 --2- 172.21.15.107:0/3667613587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f7944106b00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79400098a0 tx=0x7f7940009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:03.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.933+0000 7f794bd9e700 1 -- 172.21.15.107:0/3667613587 shutdown_connections 2023-08-10T10:41:03.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.933+0000 7f794bd9e700 1 --2- 172.21.15.107:0/3667613587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f7944106b00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:03.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.933+0000 7f794bd9e700 1 -- 172.21.15.107:0/3667613587 >> 172.21.15.107:0/3667613587 conn(0x7f7944100330 msgr2=0x7f7944102750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:03.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.933+0000 7f794bd9e700 1 -- 172.21.15.107:0/3667613587 shutdown_connections 2023-08-10T10:41:03.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.933+0000 7f794bd9e700 1 -- 172.21.15.107:0/3667613587 wait complete. 2023-08-10T10:41:03.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.934+0000 7f794bd9e700 1 Processor -- start 2023-08-10T10:41:03.411 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.934+0000 7f794bd9e700 1 -- start start 2023-08-10T10:41:03.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.935+0000 7f794bd9e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f79441a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:03.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.935+0000 7f794bd9e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79441a0600 con 0x7f79441046d0 2023-08-10T10:41:03.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.935+0000 7f7949b3a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f79441a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:03.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.935+0000 7f7949b3a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f79441a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59702/0 (socket says 172.21.15.107:59702) 2023-08-10T10:41:03.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.935+0000 7f7949b3a700 1 -- 172.21.15.107:0/2152490235 learned_addr learned my addr 172.21.15.107:0/2152490235 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:03.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.935+0000 7f7949b3a700 1 -- 172.21.15.107:0/2152490235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940009550 con 0x7f79441046d0 2023-08-10T10:41:03.412 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.935+0000 7f7949b3a700 1 --2- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f79441a00c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7940006af0 tx=0x7f7940011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:03.413 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.936+0000 7f793affd700 1 -- 172.21.15.107:0/2152490235 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79400037d0 con 0x7f79441046d0 2023-08-10T10:41:03.413 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.936+0000 7f793affd700 1 -- 172.21.15.107:0/2152490235 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f794001b440 con 0x7f79441046d0 2023-08-10T10:41:03.413 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.936+0000 7f793affd700 1 -- 172.21.15.107:0/2152490235 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7940023400 con 0x7f79441046d0 2023-08-10T10:41:03.413 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.936+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79441a0800 con 0x7f79441046d0 2023-08-10T10:41:03.413 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.936+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79441a0c20 con 0x7f79441046d0 2023-08-10T10:41:03.413 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.937+0000 7f793affd700 1 -- 172.21.15.107:0/2152490235 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f794001b5b0 con 0x7f79441046d0 2023-08-10T10:41:03.413 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.937+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7944061da0 con 0x7f79441046d0 2023-08-10T10:41:03.413 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.937+0000 7f793affd700 1 --2- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7930038710 0x7f793003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:03.414 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.937+0000 7f793affd700 1 -- 172.21.15.107:0/2152490235 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f794004c750 con 0x7f79441046d0 2023-08-10T10:41:03.414 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.938+0000 7f7949339700 1 --2- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7930038710 0x7f793003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:03.414 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.938+0000 7f7949339700 1 --2- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7930038710 0x7f793003abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7934006fd0 tx=0x7f7934006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:03.414 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:01.942+0000 7f793affd700 1 -- 172.21.15.107:0/2152490235 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f794001b8d0 con 0x7f79441046d0 2023-08-10T10:41:03.414 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.215+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f79441a3d10 con 0x7f79441046d0 2023-08-10T10:41:03.414 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.984+0000 7f793affd700 1 -- 172.21.15.107:0/2152490235 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f7940003930 con 0x7f79441046d0 2023-08-10T10:41:03.414 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.986+0000 7f793affd700 1 -- 172.21.15.107:0/2152490235 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f794004c0e0 con 0x7f79441046d0 2023-08-10T10:41:03.415 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7930038710 msgr2=0x7f793003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:03.415 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 --2- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7930038710 0x7f793003abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7934006fd0 tx=0x7f7934006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:03.415 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 msgr2=0x7f79441a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:03.415 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 --2- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f79441a00c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7940006af0 tx=0x7f7940011ed0 comp rx=0 tx=0).stop 2023-08-10T10:41:03.415 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 shutdown_connections 2023-08-10T10:41:03.415 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 --2- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f7930038710 0x7f793003abd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:03.415 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 --2- 172.21.15.107:0/2152490235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79441046d0 0x7f79441a00c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:03.416 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 >> 172.21.15.107:0/2152490235 conn(0x7f7944100330 msgr2=0x7f7944102720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:03.416 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 shutdown_connections 2023-08-10T10:41:03.416 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:02.989+0000 7f794bd9e700 1 -- 172.21.15.107:0/2152490235 wait complete. 2023-08-10T10:41:03.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:03.277+0000 7f1acd87b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:41:03.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:03.381+0000 7f1acd87b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:41:03.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:03.519+0000 7f1acd87b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:41:03.989 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:03.641+0000 7f1acd87b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:41:03.989 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:03.882+0000 7f1acd87b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:41:04.268 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:03 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2152490235' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-08-10T10:41:04.269 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:03 smithi107 ceph-mon[127953]: mgrmap e9: x(active, since 17s) 2023-08-10T10:41:04.574 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:04.281+0000 7f1acd87b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:41:04.575 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:04.408+0000 7f1acd87b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:41:04.695 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2023-08-10T10:41:04.696 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-08-10T10:41:04.696 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": true, 2023-08-10T10:41:04.696 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-08-10T10:41:04.696 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-08-10T10:41:04.699 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2023-08-10T10:41:04.699 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.974+0000 7f2ab4e72700 1 Processor -- start 2023-08-10T10:41:04.699 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.975+0000 7f2ab4e72700 1 -- start start 2023-08-10T10:41:04.699 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.975+0000 7f2ab4e72700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab0108cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.699 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.975+0000 7f2ab4e72700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab0079eb0 con 0x7f2ab0106900 2023-08-10T10:41:04.699 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.975+0000 7f2aae59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab0108cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:04.699 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.976+0000 7f2aae59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab0108cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33072/0 (socket says 172.21.15.107:33072) 2023-08-10T10:41:04.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.976+0000 7f2aae59c700 1 -- 172.21.15.107:0/2461263277 learned_addr learned my addr 172.21.15.107:0/2461263277 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:04.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.976+0000 7f2aae59c700 1 -- 172.21.15.107:0/2461263277 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0109230 con 0x7f2ab0106900 2023-08-10T10:41:04.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.976+0000 7f2aae59c700 1 --2- 172.21.15.107:0/2461263277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab0108cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00098a0 tx=0x7f2aa0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1c8ed6715bcd4a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:04.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.976+0000 7f2aad59a700 1 -- 172.21.15.107:0/2461263277 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2aa0004160 con 0x7f2ab0106900 2023-08-10T10:41:04.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.977+0000 7f2aad59a700 1 -- 172.21.15.107:0/2461263277 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2aa00042c0 con 0x7f2ab0106900 2023-08-10T10:41:04.700 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.977+0000 7f2aad59a700 1 -- 172.21.15.107:0/2461263277 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2aa00118e0 con 0x7f2ab0106900 2023-08-10T10:41:04.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.977+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2461263277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 msgr2=0x7f2ab0108cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:04.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.977+0000 7f2ab4e72700 1 --2- 172.21.15.107:0/2461263277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab0108cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00098a0 tx=0x7f2aa0009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.977+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2461263277 shutdown_connections 2023-08-10T10:41:04.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.977+0000 7f2ab4e72700 1 --2- 172.21.15.107:0/2461263277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab0108cf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.977+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2461263277 >> 172.21.15.107:0/2461263277 conn(0x7f2ab0100330 msgr2=0x7f2ab0102770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:04.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.977+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2461263277 shutdown_connections 2023-08-10T10:41:04.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.977+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2461263277 wait complete. 2023-08-10T10:41:04.701 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.978+0000 7f2ab4e72700 1 Processor -- start 2023-08-10T10:41:04.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.979+0000 7f2ab4e72700 1 -- start start 2023-08-10T10:41:04.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.979+0000 7f2ab4e72700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.979+0000 7f2ab4e72700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab019c2a0 con 0x7f2ab0106900 2023-08-10T10:41:04.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.979+0000 7f2aae59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:04.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.979+0000 7f2aae59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33082/0 (socket says 172.21.15.107:33082) 2023-08-10T10:41:04.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.979+0000 7f2aae59c700 1 -- 172.21.15.107:0/2341419639 learned_addr learned my addr 172.21.15.107:0/2341419639 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:04.702 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.979+0000 7f2aae59c700 1 -- 172.21.15.107:0/2341419639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0009550 con 0x7f2ab0106900 2023-08-10T10:41:04.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.980+0000 7f2aae59c700 1 --2- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab019bd60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00118f0 tx=0x7f2aa00119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:04.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.980+0000 7f2a9f7fe700 1 -- 172.21.15.107:0/2341419639 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2aa00036a0 con 0x7f2ab0106900 2023-08-10T10:41:04.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.980+0000 7f2a9f7fe700 1 -- 172.21.15.107:0/2341419639 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2aa001b440 con 0x7f2ab0106900 2023-08-10T10:41:04.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.980+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab019c4a0 con 0x7f2ab0106900 2023-08-10T10:41:04.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.980+0000 7f2a9f7fe700 1 -- 172.21.15.107:0/2341419639 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2aa00193f0 con 0x7f2ab0106900 2023-08-10T10:41:04.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.980+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab019c8c0 con 0x7f2ab0106900 2023-08-10T10:41:04.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.981+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab010a010 con 0x7f2ab0106900 2023-08-10T10:41:04.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.982+0000 7f2a9f7fe700 1 -- 172.21.15.107:0/2341419639 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f2aa001b5b0 con 0x7f2ab0106900 2023-08-10T10:41:04.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.982+0000 7f2a9f7fe700 1 --2- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2a98038760 0x7f2a9803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:04.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.982+0000 7f2a9f7fe700 1 -- 172.21.15.107:0/2341419639 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2aa004c690 con 0x7f2ab0106900 2023-08-10T10:41:04.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.982+0000 7f2aadd9b700 1 -- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2a98038760 msgr2=0x7f2a9803ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/294010818 2023-08-10T10:41:04.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.982+0000 7f2aadd9b700 1 --2- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2a98038760 0x7f2a9803ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:41:04.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:03.987+0000 7f2a9f7fe700 1 -- 172.21.15.107:0/2341419639 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2aa0023590 con 0x7f2ab0106900 2023-08-10T10:41:04.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.183+0000 7f2aadd9b700 1 -- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2a98038760 msgr2=0x7f2a9803ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/294010818 2023-08-10T10:41:04.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.183+0000 7f2aadd9b700 1 --2- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2a98038760 0x7f2a9803ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T10:41:04.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.243+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f2ab019f980 con 0x7f2ab0106900 2023-08-10T10:41:04.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.243+0000 7f2a9f7fe700 1 -- 172.21.15.107:0/2341419639 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f2aa001f020 con 0x7f2ab0106900 2023-08-10T10:41:04.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2a98038760 msgr2=0x7f2a9803ac20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:41:04.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 --2- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2a98038760 0x7f2a9803ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 msgr2=0x7f2ab019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:04.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 --2- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab019bd60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00118f0 tx=0x7f2aa00119d0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.708 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 shutdown_connections 2023-08-10T10:41:04.708 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 --2- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7f2a98038760 0x7f2a9803ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.708 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 --2- 172.21.15.107:0/2341419639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab0106900 0x7f2ab019bd60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:04.708 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 >> 172.21.15.107:0/2341419639 conn(0x7f2ab0100330 msgr2=0x7f2ab0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:04.708 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 shutdown_connections 2023-08-10T10:41:04.708 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:04.246+0000 7f2ab4e72700 1 -- 172.21.15.107:0/2341419639 wait complete. 2023-08-10T10:41:04.708 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for the mgr to restart... 2023-08-10T10:41:04.709 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr epoch 9... 2023-08-10T10:41:04.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:04.573+0000 7f1acd87b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:41:04.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:04.707+0000 7f1acd87b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:41:05.288 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:04 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2341419639' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-08-10T10:41:05.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:05.287+0000 7f1acd87b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:41:06.326 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:06.014+0000 7f1acd87b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:41:06.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:06.220+0000 7f1acd87b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:41:07.496 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:07.157+0000 7f1acd87b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:41:07.496 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:07.275+0000 7f1acd87b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:41:08.135 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:07.495+0000 7f1acd87b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:41:08.135 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:07.853+0000 7f1acd87b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:41:08.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:08.134+0000 7f1acd87b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:41:08.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:08.323+0000 7f1acd87b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:41:09.076 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:08.662+0000 7f1acd87b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:41:09.996 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:09.579+0000 7f1acd87b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:41:09.997 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:09.751+0000 7f1acd87b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:41:10.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:09.995+0000 7f1acd87b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:41:10.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:10.140+0000 7f1acd87b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:41:10.826 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:10.414+0000 7f1acd87b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:41:11.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:41:11.472+0000 7f1acd87b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:41:11.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: Active manager daemon x restarted 2023-08-10T10:41:11.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: Activating manager daemon x 2023-08-10T10:41:11.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: osdmap e3: 0 total, 0 up, 0 in 2023-08-10T10:41:11.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: mgrmap e10: x(active, starting, since 0.00537491s) 2023-08-10T10:41:11.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:41:11.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T10:41:11.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T10:41:11.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T10:41:11.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T10:41:11.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: Manager daemon x is now available 2023-08-10T10:41:11.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:11.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:12.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T10:41:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T10:41:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:12 smithi107 ceph-mon[127953]: mgrmap e11: x(active, since 1.00856s) 2023-08-10T10:41:12.919 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2023-08-10T10:41:12.919 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-08-10T10:41:12.919 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "initialized": true 2023-08-10T10:41:12.920 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2023-08-10T10:41:12.920 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.255+0000 7fe42871b700 1 Processor -- start 2023-08-10T10:41:12.920 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.255+0000 7fe42871b700 1 -- start start 2023-08-10T10:41:12.920 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.256+0000 7fe42871b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420108cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.920 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.256+0000 7fe42871b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420079eb0 con 0x7fe420106900 2023-08-10T10:41:12.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.256+0000 7fe4264b7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420108cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.256+0000 7fe4264b7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420108cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33094/0 (socket says 172.21.15.107:33094) 2023-08-10T10:41:12.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.256+0000 7fe4264b7700 1 -- 172.21.15.107:0/1268063033 learned_addr learned my addr 172.21.15.107:0/1268063033 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:12.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.256+0000 7fe4264b7700 1 -- 172.21.15.107:0/1268063033 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420109230 con 0x7fe420106900 2023-08-10T10:41:12.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.257+0000 7fe4264b7700 1 --2- 172.21.15.107:0/1268063033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420108cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0098a0 tx=0x7fe41c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ff016aa3724eb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:12.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.257+0000 7fe4254b5700 1 -- 172.21.15.107:0/1268063033 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe41c004160 con 0x7fe420106900 2023-08-10T10:41:12.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.257+0000 7fe4254b5700 1 -- 172.21.15.107:0/1268063033 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe41c0042c0 con 0x7fe420106900 2023-08-10T10:41:12.922 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.257+0000 7fe4254b5700 1 -- 172.21.15.107:0/1268063033 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe41c0118e0 con 0x7fe420106900 2023-08-10T10:41:12.922 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.258+0000 7fe42871b700 1 -- 172.21.15.107:0/1268063033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 msgr2=0x7fe420108cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.258+0000 7fe42871b700 1 --2- 172.21.15.107:0/1268063033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420108cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0098a0 tx=0x7fe41c009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.258+0000 7fe42871b700 1 -- 172.21.15.107:0/1268063033 shutdown_connections 2023-08-10T10:41:12.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.258+0000 7fe42871b700 1 --2- 172.21.15.107:0/1268063033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420108cf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.258+0000 7fe42871b700 1 -- 172.21.15.107:0/1268063033 >> 172.21.15.107:0/1268063033 conn(0x7fe420100330 msgr2=0x7fe420102770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:12.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.258+0000 7fe42871b700 1 -- 172.21.15.107:0/1268063033 shutdown_connections 2023-08-10T10:41:12.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.258+0000 7fe42871b700 1 -- 172.21.15.107:0/1268063033 wait complete. 2023-08-10T10:41:12.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.259+0000 7fe42871b700 1 Processor -- start 2023-08-10T10:41:12.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.259+0000 7fe42871b700 1 -- start start 2023-08-10T10:41:12.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.260+0000 7fe42871b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420106260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.260+0000 7fe42871b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4201067a0 con 0x7fe420106900 2023-08-10T10:41:12.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.260+0000 7fe4264b7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420106260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.260+0000 7fe4264b7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420106260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33100/0 (socket says 172.21.15.107:33100) 2023-08-10T10:41:12.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.260+0000 7fe4264b7700 1 -- 172.21.15.107:0/3989961766 learned_addr learned my addr 172.21.15.107:0/3989961766 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:12.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.261+0000 7fe4264b7700 1 -- 172.21.15.107:0/3989961766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c009550 con 0x7fe420106900 2023-08-10T10:41:12.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.261+0000 7fe4264b7700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420106260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe41c006af0 tx=0x7fe41c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:12.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.261+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe41c0037d0 con 0x7fe420106900 2023-08-10T10:41:12.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.261+0000 7fe42871b700 1 -- 172.21.15.107:0/3989961766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4201048b0 con 0x7fe420106900 2023-08-10T10:41:12.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.261+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe41c01b440 con 0x7fe420106900 2023-08-10T10:41:12.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.261+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe41c0193d0 con 0x7fe420106900 2023-08-10T10:41:12.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.261+0000 7fe42871b700 1 -- 172.21.15.107:0/3989961766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe420104cd0 con 0x7fe420106900 2023-08-10T10:41:12.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.263+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fe41c003930 con 0x7fe420106900 2023-08-10T10:41:12.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.263+0000 7fe4177fe700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 0x7fe40c03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.263+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 --> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe40c03b2e0 con 0x7fe40c038710 2023-08-10T10:41:12.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.263+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe41c04c610 con 0x7fe420106900 2023-08-10T10:41:12.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.263+0000 7fe425cb6700 1 -- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 msgr2=0x7fe40c03abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/294010818 2023-08-10T10:41:12.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.263+0000 7fe425cb6700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 0x7fe40c03abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:41:12.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.464+0000 7fe425cb6700 1 -- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 msgr2=0x7fe40c03abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/294010818 2023-08-10T10:41:12.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.464+0000 7fe425cb6700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 0x7fe40c03abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T10:41:12.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.865+0000 7fe425cb6700 1 -- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 msgr2=0x7fe40c03abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/294010818 2023-08-10T10:41:12.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:05.865+0000 7fe425cb6700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 0x7fe40c03abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-10T10:41:12.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:06.666+0000 7fe425cb6700 1 -- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 msgr2=0x7fe40c03abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/294010818 2023-08-10T10:41:12.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:06.666+0000 7fe425cb6700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 0x7fe40c03abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-10T10:41:12.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:08.268+0000 7fe425cb6700 1 -- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 msgr2=0x7fe40c03abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/294010818 2023-08-10T10:41:12.931 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:08.268+0000 7fe425cb6700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 0x7fe40c03abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-08-10T10:41:12.931 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:11.471+0000 7fe425cb6700 1 -- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 msgr2=0x7fe40c03abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/294010818 2023-08-10T10:41:12.931 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:11.471+0000 7fe425cb6700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 0x7fe40c03abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-08-10T10:41:12.931 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:11.478+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mgrmap(e 10) v1 ==== 45263+0+0 (secure 0 0 0) 0x7fe41c01b8b0 con 0x7fe420106900 2023-08-10T10:41:12.931 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:11.478+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 msgr2=0x7fe40c03abd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:41:12.931 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:11.478+0000 7fe4177fe700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 0x7fe40c03abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.931 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.480+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7fe41c023400 con 0x7fe420106900 2023-08-10T10:41:12.931 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.480+0000 7fe4177fe700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe40c03bfb0 0x7fe40c03e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:12.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.480+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe40c03b2e0 con 0x7fe40c03bfb0 2023-08-10T10:41:12.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.481+0000 7fe425cb6700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe40c03bfb0 0x7fe40c03e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:12.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.482+0000 7fe425cb6700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe40c03bfb0 0x7fe40c03e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe410003a10 tx=0x7fe4100092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:12.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.483+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fe40c03b2e0 con 0x7fe40c03bfb0 2023-08-10T10:41:12.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 -- 172.21.15.107:0/3989961766 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fe420105e00 con 0x7fe40c03bfb0 2023-08-10T10:41:12.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe4177fe700 1 -- 172.21.15.107:0/3989961766 <== mgr.14150 v2:172.21.15.107:6800/438388714 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fe420105e00 con 0x7fe40c03bfb0 2023-08-10T10:41:12.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 -- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe40c03bfb0 msgr2=0x7fe40c03e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe40c03bfb0 0x7fe40c03e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe410003a10 tx=0x7fe4100092b0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 -- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 msgr2=0x7fe420106260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:12.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420106260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe41c006af0 tx=0x7fe41c011e80 comp rx=0 tx=0).stop 2023-08-10T10:41:12.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 -- 172.21.15.107:0/3989961766 shutdown_connections 2023-08-10T10:41:12.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe40c03bfb0 0x7fe40c03e3a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe420106900 0x7fe420106260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 --2- 172.21.15.107:0/3989961766 >> [v2:172.21.15.107:6800/294010818,v1:172.21.15.107:6801/294010818] conn(0x7fe40c038710 0x7fe40c03abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:12.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.490+0000 7fe42871b700 1 -- 172.21.15.107:0/3989961766 >> 172.21.15.107:0/3989961766 conn(0x7fe420100330 msgr2=0x7fe420101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:12.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.491+0000 7fe42871b700 1 -- 172.21.15.107:0/3989961766 shutdown_connections 2023-08-10T10:41:12.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:12.491+0000 7fe42871b700 1 -- 172.21.15.107:0/3989961766 wait complete. 2023-08-10T10:41:12.934 INFO:teuthology.orchestra.run.smithi107.stdout:mgr epoch 9 is available 2023-08-10T10:41:12.934 INFO:teuthology.orchestra.run.smithi107.stdout:Generating a dashboard self-signed certificate... 2023-08-10T10:41:13.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:13 smithi107 ceph-mon[127953]: [10/Aug/2023:10:41:12] ENGINE Bus STARTING 2023-08-10T10:41:13.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:13 smithi107 ceph-mon[127953]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-08-10T10:41:13.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:13 smithi107 ceph-mon[127953]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-08-10T10:41:13.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:13 smithi107 ceph-mon[127953]: [10/Aug/2023:10:41:12] ENGINE Serving on https://172.21.15.107:7150 2023-08-10T10:41:13.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:13 smithi107 ceph-mon[127953]: [10/Aug/2023:10:41:12] ENGINE Serving on http://172.21.15.107:8765 2023-08-10T10:41:13.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:13 smithi107 ceph-mon[127953]: [10/Aug/2023:10:41:12] ENGINE Bus STARTED 2023-08-10T10:41:14.507 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-08-10T10:41:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.567+0000 7f202d9e6700 1 Processor -- start 2023-08-10T10:41:14.511 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.567+0000 7f202d9e6700 1 -- start start 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.567+0000 7f202d9e6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202807a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.567+0000 7f202d9e6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202807a8b0 con 0x7f202807be80 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.568+0000 7f2026ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202807a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.512 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.568+0000 7f2026ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202807a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36820/0 (socket says 172.21.15.107:36820) 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.568+0000 7f2026ffd700 1 -- 172.21.15.107:0/3120697630 learned_addr learned my addr 172.21.15.107:0/3120697630 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.568+0000 7f2026ffd700 1 -- 172.21.15.107:0/3120697630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202807a9f0 con 0x7f202807be80 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.568+0000 7f2026ffd700 1 --2- 172.21.15.107:0/3120697630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202807a2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20180098a0 tx=0x7f2018009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa4f318bc158437 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.568+0000 7f2025ffb700 1 -- 172.21.15.107:0/3120697630 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2018004160 con 0x7f202807be80 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.569+0000 7f2025ffb700 1 -- 172.21.15.107:0/3120697630 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20180042c0 con 0x7f202807be80 2023-08-10T10:41:14.513 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.569+0000 7f2025ffb700 1 -- 172.21.15.107:0/3120697630 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20180118e0 con 0x7f202807be80 2023-08-10T10:41:14.514 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.569+0000 7f202d9e6700 1 -- 172.21.15.107:0/3120697630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 msgr2=0x7f202807a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.514 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.569+0000 7f202d9e6700 1 --2- 172.21.15.107:0/3120697630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202807a2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20180098a0 tx=0x7f2018009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.514 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.569+0000 7f202d9e6700 1 -- 172.21.15.107:0/3120697630 shutdown_connections 2023-08-10T10:41:14.514 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.569+0000 7f202d9e6700 1 --2- 172.21.15.107:0/3120697630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202807a2e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.514 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.569+0000 7f202d9e6700 1 -- 172.21.15.107:0/3120697630 >> 172.21.15.107:0/3120697630 conn(0x7f20281014b0 msgr2=0x7f20281038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.569+0000 7f202d9e6700 1 -- 172.21.15.107:0/3120697630 shutdown_connections 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.569+0000 7f202d9e6700 1 -- 172.21.15.107:0/3120697630 wait complete. 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.570+0000 7f202d9e6700 1 Processor -- start 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.570+0000 7f202d9e6700 1 -- start start 2023-08-10T10:41:14.515 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.571+0000 7f202d9e6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.571+0000 7f202d9e6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202819c330 con 0x7f202807be80 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.571+0000 7f2026ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.571+0000 7f2026ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202819bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36822/0 (socket says 172.21.15.107:36822) 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.571+0000 7f2026ffd700 1 -- 172.21.15.107:0/1933141881 learned_addr learned my addr 172.21.15.107:0/1933141881 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.571+0000 7f2026ffd700 1 -- 172.21.15.107:0/1933141881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018009550 con 0x7f202807be80 2023-08-10T10:41:14.516 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.572+0000 7f2026ffd700 1 --2- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202819bdf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2018003e30 tx=0x7f20180119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.572+0000 7f202c9e4700 1 -- 172.21.15.107:0/1933141881 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20180036a0 con 0x7f202807be80 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.572+0000 7f202c9e4700 1 -- 172.21.15.107:0/1933141881 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f201801b440 con 0x7f202807be80 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.572+0000 7f202c9e4700 1 -- 172.21.15.107:0/1933141881 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2018023400 con 0x7f202807be80 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.572+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202819c530 con 0x7f202807be80 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.572+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202819c950 con 0x7f202807be80 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.573+0000 7f202c9e4700 1 -- 172.21.15.107:0/1933141881 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f201801b5b0 con 0x7f202807be80 2023-08-10T10:41:14.517 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.573+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2028061da0 con 0x7f202807be80 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.574+0000 7f202c9e4700 1 --2- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2010038760 0x7f201003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.574+0000 7f202c9e4700 1 -- 172.21.15.107:0/1933141881 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f201804c7e0 con 0x7f202807be80 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.574+0000 7f20267fc700 1 --2- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2010038760 0x7f201003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.575+0000 7f20267fc700 1 --2- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2010038760 0x7f201003ac20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f201c006fd0 tx=0x7f201c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.579+0000 7f202c9e4700 1 -- 172.21.15.107:0/1933141881 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f20180195b0 con 0x7f202807be80 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.795+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f202819f390 con 0x7f2010038760 2023-08-10T10:41:14.518 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.860+0000 7f202c9e4700 1 -- 172.21.15.107:0/1933141881 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f202819f390 con 0x7f2010038760 2023-08-10T10:41:14.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2010038760 msgr2=0x7f201003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 --2- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2010038760 0x7f201003ac20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f201c006fd0 tx=0x7f201c006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:14.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 msgr2=0x7f202819bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:14.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 --2- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202819bdf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2018003e30 tx=0x7f20180119a0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 shutdown_connections 2023-08-10T10:41:14.519 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 --2- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2010038760 0x7f201003ac20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 --2- 172.21.15.107:0/1933141881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f202807be80 0x7f202819bdf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 >> 172.21.15.107:0/1933141881 conn(0x7f20281014b0 msgr2=0x7f2028102be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 shutdown_connections 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:13.863+0000 7f202d9e6700 1 -- 172.21.15.107:0/1933141881 wait complete. 2023-08-10T10:41:14.520 INFO:teuthology.orchestra.run.smithi107.stdout:Creating initial admin user... 2023-08-10T10:41:14.776 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:14 smithi107 ceph-mon[127953]: mgrmap e12: x(active, since 2s) 2023-08-10T10:41:14.776 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:14 smithi107 ceph-mon[127953]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:41:14.776 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:14.776 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:14.776 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:15.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$wxtNEPuRR32u6j6ZZwK/Yuuhm5CFl8X6AR1TzV8jr50t45CirO.ne", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1691664075, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-08-10T10:41:15.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.063+0000 7f0cdea1d700 1 Processor -- start 2023-08-10T10:41:15.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.063+0000 7f0cdea1d700 1 -- start start 2023-08-10T10:41:15.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.063+0000 7f0cdea1d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd807a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.063+0000 7f0cdea1d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd807a8d0 con 0x7f0cd807bea0 2023-08-10T10:41:15.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.064+0000 7f0cd7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd807a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.064+0000 7f0cd7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd807a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36830/0 (socket says 172.21.15.107:36830) 2023-08-10T10:41:15.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.064+0000 7f0cd7fff700 1 -- 172.21.15.107:0/3198933945 learned_addr learned my addr 172.21.15.107:0/3198933945 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:15.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.064+0000 7f0cd7fff700 1 -- 172.21.15.107:0/3198933945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd807aa10 con 0x7f0cd807bea0 2023-08-10T10:41:15.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.065+0000 7f0cd7fff700 1 --2- 172.21.15.107:0/3198933945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd807a300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80098a0 tx=0x7f0cc8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712013601d317608 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:15.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.065+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/3198933945 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cc8004160 con 0x7f0cd807bea0 2023-08-10T10:41:15.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.065+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/3198933945 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cc80042c0 con 0x7f0cd807bea0 2023-08-10T10:41:15.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.065+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/3198933945 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cc80118e0 con 0x7f0cd807bea0 2023-08-10T10:41:15.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.065+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3198933945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 msgr2=0x7f0cd807a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.065+0000 7f0cdea1d700 1 --2- 172.21.15.107:0/3198933945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd807a300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80098a0 tx=0x7f0cc8009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.066+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3198933945 shutdown_connections 2023-08-10T10:41:15.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.066+0000 7f0cdea1d700 1 --2- 172.21.15.107:0/3198933945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd807a300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.066+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3198933945 >> 172.21.15.107:0/3198933945 conn(0x7f0cd81014b0 msgr2=0x7f0cd81038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:15.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.066+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3198933945 shutdown_connections 2023-08-10T10:41:15.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.066+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3198933945 wait complete. 2023-08-10T10:41:15.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.067+0000 7f0cdea1d700 1 Processor -- start 2023-08-10T10:41:15.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.067+0000 7f0cdea1d700 1 -- start start 2023-08-10T10:41:15.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.067+0000 7f0cdea1d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.995 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.067+0000 7f0cdea1d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd819c370 con 0x7f0cd807bea0 2023-08-10T10:41:15.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.068+0000 7f0cd7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.068+0000 7f0cd7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd819be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36834/0 (socket says 172.21.15.107:36834) 2023-08-10T10:41:15.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.068+0000 7f0cd7fff700 1 -- 172.21.15.107:0/3990612749 learned_addr learned my addr 172.21.15.107:0/3990612749 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:15.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.068+0000 7f0cd7fff700 1 -- 172.21.15.107:0/3990612749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8009550 con 0x7f0cd807bea0 2023-08-10T10:41:15.996 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.068+0000 7f0cd7fff700 1 --2- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd819be30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8003e30 tx=0x7f0cc80119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:15.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.068+0000 7f0cd57fa700 1 -- 172.21.15.107:0/3990612749 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cc80036a0 con 0x7f0cd807bea0 2023-08-10T10:41:15.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.068+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd819c570 con 0x7f0cd807bea0 2023-08-10T10:41:15.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.068+0000 7f0cd57fa700 1 -- 172.21.15.107:0/3990612749 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cc801b440 con 0x7f0cd807bea0 2023-08-10T10:41:15.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.068+0000 7f0cd57fa700 1 -- 172.21.15.107:0/3990612749 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cc8023400 con 0x7f0cd807bea0 2023-08-10T10:41:15.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.069+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd819c990 con 0x7f0cd807bea0 2023-08-10T10:41:15.997 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.070+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd8195e30 con 0x7f0cd807bea0 2023-08-10T10:41:15.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.070+0000 7f0cd57fa700 1 -- 172.21.15.107:0/3990612749 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f0cc801b5b0 con 0x7f0cd807bea0 2023-08-10T10:41:15.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.070+0000 7f0cd57fa700 1 --2- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0cc0038760 0x7f0cc003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:15.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.070+0000 7f0cd57fa700 1 -- 172.21.15.107:0/3990612749 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0cc804c850 con 0x7f0cd807bea0 2023-08-10T10:41:15.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.071+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0cc0038760 0x7f0cc003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:15.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.071+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0cc0038760 0x7f0cc003ac20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc006fd0 tx=0x7f0ccc006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:15.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.078+0000 7f0cd57fa700 1 -- 172.21.15.107:0/3990612749 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0cc800bc10 con 0x7f0cd807bea0 2023-08-10T10:41:15.998 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.313+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0cd802ce00 con 0x7f0cc0038760 2023-08-10T10:41:15.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.546+0000 7f0cd57fa700 1 -- 172.21.15.107:0/3990612749 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f0cd802ce00 con 0x7f0cc0038760 2023-08-10T10:41:15.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.548+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0cc0038760 msgr2=0x7f0cc003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.548+0000 7f0cdea1d700 1 --2- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0cc0038760 0x7f0cc003ac20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc006fd0 tx=0x7f0ccc006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:15.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.548+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 msgr2=0x7f0cd819be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:15.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.548+0000 7f0cdea1d700 1 --2- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd819be30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8003e30 tx=0x7f0cc80119a0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.549+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 shutdown_connections 2023-08-10T10:41:15.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.549+0000 7f0cdea1d700 1 --2- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0cc0038760 0x7f0cc003ac20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:15.999 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.549+0000 7f0cdea1d700 1 --2- 172.21.15.107:0/3990612749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd807bea0 0x7f0cd819be30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:16.000 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.549+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 >> 172.21.15.107:0/3990612749 conn(0x7f0cd81014b0 msgr2=0x7f0cd8103880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:16.000 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.549+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 shutdown_connections 2023-08-10T10:41:16.000 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:15.549+0000 7f0cdea1d700 1 -- 172.21.15.107:0/3990612749 wait complete. 2023-08-10T10:41:16.000 INFO:teuthology.orchestra.run.smithi107.stdout:Fetching dashboard port number... 2023-08-10T10:41:16.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:16 smithi107 ceph-mon[127953]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:41:16.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:16.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:17.370 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 8443 2023-08-10T10:41:17.370 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.573+0000 7f01350a0700 1 Processor -- start 2023-08-10T10:41:17.370 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.573+0000 7f01350a0700 1 -- start start 2023-08-10T10:41:17.370 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.573+0000 7f01350a0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f0130105190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.371 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.573+0000 7f01350a0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0130105760 con 0x7f0130104d70 2023-08-10T10:41:17.371 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.574+0000 7f012ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f0130105190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.371 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.574+0000 7f012ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f0130105190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36842/0 (socket says 172.21.15.107:36842) 2023-08-10T10:41:17.371 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.574+0000 7f012ed9d700 1 -- 172.21.15.107:0/2687175828 learned_addr learned my addr 172.21.15.107:0/2687175828 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:17.371 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.574+0000 7f012ed9d700 1 -- 172.21.15.107:0/2687175828 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130105f70 con 0x7f0130104d70 2023-08-10T10:41:17.371 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.575+0000 7f012ed9d700 1 --2- 172.21.15.107:0/2687175828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f0130105190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01200098a0 tx=0x7f0120009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1299fc4e2e7df3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:17.371 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.575+0000 7f012dd9b700 1 -- 172.21.15.107:0/2687175828 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0120004160 con 0x7f0130104d70 2023-08-10T10:41:17.372 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.575+0000 7f012dd9b700 1 -- 172.21.15.107:0/2687175828 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01200042c0 con 0x7f0130104d70 2023-08-10T10:41:17.372 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.575+0000 7f012dd9b700 1 -- 172.21.15.107:0/2687175828 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01200118e0 con 0x7f0130104d70 2023-08-10T10:41:17.372 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.576+0000 7f01350a0700 1 -- 172.21.15.107:0/2687175828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 msgr2=0x7f0130105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.372 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.576+0000 7f01350a0700 1 --2- 172.21.15.107:0/2687175828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f0130105190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01200098a0 tx=0x7f0120009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.372 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.576+0000 7f01350a0700 1 -- 172.21.15.107:0/2687175828 shutdown_connections 2023-08-10T10:41:17.372 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.576+0000 7f01350a0700 1 --2- 172.21.15.107:0/2687175828 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f0130105190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.372 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.576+0000 7f01350a0700 1 -- 172.21.15.107:0/2687175828 >> 172.21.15.107:0/2687175828 conn(0x7f0130100330 msgr2=0x7f0130102750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:17.373 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.576+0000 7f01350a0700 1 -- 172.21.15.107:0/2687175828 shutdown_connections 2023-08-10T10:41:17.373 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.576+0000 7f01350a0700 1 -- 172.21.15.107:0/2687175828 wait complete. 2023-08-10T10:41:17.373 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.577+0000 7f01350a0700 1 Processor -- start 2023-08-10T10:41:17.373 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.577+0000 7f01350a0700 1 -- start start 2023-08-10T10:41:17.373 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.578+0000 7f01350a0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f013018f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.373 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.578+0000 7f01350a0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013018fd50 con 0x7f0130104d70 2023-08-10T10:41:17.373 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.578+0000 7f012ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f013018f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.373 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.578+0000 7f012ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f013018f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36844/0 (socket says 172.21.15.107:36844) 2023-08-10T10:41:17.374 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.578+0000 7f012ed9d700 1 -- 172.21.15.107:0/4292791143 learned_addr learned my addr 172.21.15.107:0/4292791143 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:17.374 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.578+0000 7f012ed9d700 1 -- 172.21.15.107:0/4292791143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120009550 con 0x7f0130104d70 2023-08-10T10:41:17.374 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.579+0000 7f012ed9d700 1 --2- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f013018f810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0120003e30 tx=0x7f01200119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:17.374 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.579+0000 7f0117fff700 1 -- 172.21.15.107:0/4292791143 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01200036a0 con 0x7f0130104d70 2023-08-10T10:41:17.374 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.579+0000 7f0117fff700 1 -- 172.21.15.107:0/4292791143 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f012001b440 con 0x7f0130104d70 2023-08-10T10:41:17.374 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.579+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013018ff50 con 0x7f0130104d70 2023-08-10T10:41:17.374 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.579+0000 7f0117fff700 1 -- 172.21.15.107:0/4292791143 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0120023400 con 0x7f0130104d70 2023-08-10T10:41:17.375 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.579+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013018c440 con 0x7f0130104d70 2023-08-10T10:41:17.375 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.580+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01301900e0 con 0x7f0130104d70 2023-08-10T10:41:17.375 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.581+0000 7f0117fff700 1 -- 172.21.15.107:0/4292791143 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f012001b5b0 con 0x7f0130104d70 2023-08-10T10:41:17.375 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.581+0000 7f0117fff700 1 --2- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01180387a0 0x7f011803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:17.375 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.581+0000 7f0117fff700 1 -- 172.21.15.107:0/4292791143 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f012004c7f0 con 0x7f0130104d70 2023-08-10T10:41:17.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.581+0000 7f012e59c700 1 --2- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01180387a0 0x7f011803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:17.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.582+0000 7f012e59c700 1 --2- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01180387a0 0x7f011803ac60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0124006fd0 tx=0x7f0124006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:17.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.586+0000 7f0117fff700 1 -- 172.21.15.107:0/4292791143 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f012000be40 con 0x7f0130104d70 2023-08-10T10:41:17.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.822+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f0130061da0 con 0x7f0130104d70 2023-08-10T10:41:17.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.823+0000 7f0117fff700 1 -- 172.21.15.107:0/4292791143 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f012000b3e0 con 0x7f0130104d70 2023-08-10T10:41:17.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.825+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01180387a0 msgr2=0x7f011803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.825+0000 7f01350a0700 1 --2- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01180387a0 0x7f011803ac60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0124006fd0 tx=0x7f0124006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:17.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.825+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 msgr2=0x7f013018f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:17.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.825+0000 7f01350a0700 1 --2- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f013018f810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0120003e30 tx=0x7f01200119a0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.825+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 shutdown_connections 2023-08-10T10:41:17.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.825+0000 7f01350a0700 1 --2- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01180387a0 0x7f011803ac60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.825+0000 7f01350a0700 1 --2- 172.21.15.107:0/4292791143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0130104d70 0x7f013018f810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:17.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.825+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 >> 172.21.15.107:0/4292791143 conn(0x7f0130100330 msgr2=0x7f0130192b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:17.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.826+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 shutdown_connections 2023-08-10T10:41:17.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:16.826+0000 7f01350a0700 1 -- 172.21.15.107:0/4292791143 wait complete. 2023-08-10T10:41:17.388 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-08-10T10:41:17.388 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2023-08-10T10:41:17.404 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-08-10T10:41:17.404 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2023-08-10T10:41:17.404 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2023-08-10T10:41:17.404 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-08-10T10:41:17.407 INFO:teuthology.orchestra.run.smithi107.stdout:Ceph Dashboard is now available at: 2023-08-10T10:41:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: URL: https://smithi107.front.sepia.ceph.com:8443/ 2023-08-10T10:41:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: User: admin 2023-08-10T10:41:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: Password: tffh2bp97e 2023-08-10T10:41:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:17.408 INFO:teuthology.orchestra.run.smithi107.stdout:Saving cluster configuration to /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config directory 2023-08-10T10:41:17.408 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling autotune for osd_memory_target 2023-08-10T10:41:17.620 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:17 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4292791143' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-08-10T10:41:18.788 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.170+0000 7f24d9188700 1 Processor -- start 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.170+0000 7f24d9188700 1 -- start start 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.170+0000 7f24d9188700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d407a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.170+0000 7f24d9188700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d407a8b0 con 0x7f24d407be80 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.170+0000 7f24d2d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d407a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.170+0000 7f24d2d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d407a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36846/0 (socket says 172.21.15.107:36846) 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.170+0000 7f24d2d9d700 1 -- 172.21.15.107:0/3968544552 learned_addr learned my addr 172.21.15.107:0/3968544552 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:18.789 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.171+0000 7f24d2d9d700 1 -- 172.21.15.107:0/3968544552 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d407a9f0 con 0x7f24d407be80 2023-08-10T10:41:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.171+0000 7f24d2d9d700 1 --2- 172.21.15.107:0/3968544552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d407a2e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24c40098a0 tx=0x7f24c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130e0625af34533 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.171+0000 7f24d1d9b700 1 -- 172.21.15.107:0/3968544552 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24c4004160 con 0x7f24d407be80 2023-08-10T10:41:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.171+0000 7f24d1d9b700 1 -- 172.21.15.107:0/3968544552 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24c40042c0 con 0x7f24d407be80 2023-08-10T10:41:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.171+0000 7f24d1d9b700 1 -- 172.21.15.107:0/3968544552 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24c40118e0 con 0x7f24d407be80 2023-08-10T10:41:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.172+0000 7f24d9188700 1 -- 172.21.15.107:0/3968544552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 msgr2=0x7f24d407a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.172+0000 7f24d9188700 1 --2- 172.21.15.107:0/3968544552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d407a2e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24c40098a0 tx=0x7f24c4009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.172+0000 7f24d9188700 1 -- 172.21.15.107:0/3968544552 shutdown_connections 2023-08-10T10:41:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.172+0000 7f24d9188700 1 --2- 172.21.15.107:0/3968544552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d407a2e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.172+0000 7f24d9188700 1 -- 172.21.15.107:0/3968544552 >> 172.21.15.107:0/3968544552 conn(0x7f24d4101470 msgr2=0x7f24d4103890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:18.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.172+0000 7f24d9188700 1 -- 172.21.15.107:0/3968544552 shutdown_connections 2023-08-10T10:41:18.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.172+0000 7f24d9188700 1 -- 172.21.15.107:0/3968544552 wait complete. 2023-08-10T10:41:18.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.173+0000 7f24d9188700 1 Processor -- start 2023-08-10T10:41:18.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.173+0000 7f24d9188700 1 -- start start 2023-08-10T10:41:18.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.173+0000 7f24d9188700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.791 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.173+0000 7f24d9188700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d419c270 con 0x7f24d407be80 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.174+0000 7f24d2d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.174+0000 7f24d2d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d419bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36862/0 (socket says 172.21.15.107:36862) 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.174+0000 7f24d2d9d700 1 -- 172.21.15.107:0/3323542883 learned_addr learned my addr 172.21.15.107:0/3323542883 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.174+0000 7f24d2d9d700 1 -- 172.21.15.107:0/3323542883 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4009550 con 0x7f24d407be80 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.174+0000 7f24d2d9d700 1 --2- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d419bd30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24c4003e30 tx=0x7f24c40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.174+0000 7f24bbfff700 1 -- 172.21.15.107:0/3323542883 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24c40036a0 con 0x7f24d407be80 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.174+0000 7f24bbfff700 1 -- 172.21.15.107:0/3323542883 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24c401b440 con 0x7f24d407be80 2023-08-10T10:41:18.792 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.174+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d419c470 con 0x7f24d407be80 2023-08-10T10:41:18.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.174+0000 7f24bbfff700 1 -- 172.21.15.107:0/3323542883 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24c4023400 con 0x7f24d407be80 2023-08-10T10:41:18.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.175+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d419c890 con 0x7f24d407be80 2023-08-10T10:41:18.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.176+0000 7f24bbfff700 1 -- 172.21.15.107:0/3323542883 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f24c4003800 con 0x7f24d407be80 2023-08-10T10:41:18.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.176+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d4195e50 con 0x7f24d407be80 2023-08-10T10:41:18.793 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.176+0000 7f24bbfff700 1 --2- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24bc0387b0 0x7f24bc03ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.176+0000 7f24bbfff700 1 -- 172.21.15.107:0/3323542883 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f24c404c850 con 0x7f24d407be80 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.176+0000 7f24d259c700 1 --2- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24bc0387b0 0x7f24bc03ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.177+0000 7f24d259c700 1 --2- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24bc0387b0 0x7f24bc03ac70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f24c8006fd0 tx=0x7f24c8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.181+0000 7f24bbfff700 1 -- 172.21.15.107:0/3323542883 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f24c4019b80 con 0x7f24d407be80 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.376+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f24d402cbf0 con 0x7f24d407be80 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.377+0000 7f24bbfff700 1 -- 172.21.15.107:0/3323542883 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f24c4019b80 con 0x7f24d407be80 2023-08-10T10:41:18.794 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24bc0387b0 msgr2=0x7f24bc03ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 --2- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24bc0387b0 0x7f24bc03ac70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f24c8006fd0 tx=0x7f24c8006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:18.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 msgr2=0x7f24d419bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:18.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 --2- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d419bd30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24c4003e30 tx=0x7f24c40119a0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.795 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 shutdown_connections 2023-08-10T10:41:18.796 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 --2- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24bc0387b0 0x7f24bc03ac70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.796 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 --2- 172.21.15.107:0/3323542883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24d407be80 0x7f24d419bd30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:18.796 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 >> 172.21.15.107:0/3323542883 conn(0x7f24d4101470 msgr2=0x7f24d4102be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:18.796 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 shutdown_connections 2023-08-10T10:41:18.797 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:18.379+0000 7f24d9188700 1 -- 172.21.15.107:0/3323542883 wait complete. 2023-08-10T10:41:19.656 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:19 smithi107 ceph-mon[127953]: mgrmap e13: x(active, since 6s) 2023-08-10T10:41:20.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.315+0000 7f6dc4fc5700 1 Processor -- start 2023-08-10T10:41:20.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.315+0000 7f6dc4fc5700 1 -- start start 2023-08-10T10:41:20.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.315+0000 7f6dc4fc5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc007a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.315+0000 7f6dc4fc5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc007a890 con 0x7f6dc007be60 2023-08-10T10:41:20.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.316+0000 7f6dbe59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc007a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:20.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.316+0000 7f6dbe59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc007a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36874/0 (socket says 172.21.15.107:36874) 2023-08-10T10:41:20.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.316+0000 7f6dbe59c700 1 -- 172.21.15.107:0/954722302 learned_addr learned my addr 172.21.15.107:0/954722302 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:20.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.316+0000 7f6dbe59c700 1 -- 172.21.15.107:0/954722302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc007a9d0 con 0x7f6dc007be60 2023-08-10T10:41:20.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.316+0000 7f6dbe59c700 1 --2- 172.21.15.107:0/954722302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc007a2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6db00098a0 tx=0x7f6db0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac82d926d2f4786b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:20.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.316+0000 7f6dbd59a700 1 -- 172.21.15.107:0/954722302 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6db0004160 con 0x7f6dc007be60 2023-08-10T10:41:20.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.316+0000 7f6dbd59a700 1 -- 172.21.15.107:0/954722302 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6db00042c0 con 0x7f6dc007be60 2023-08-10T10:41:20.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.316+0000 7f6dbd59a700 1 -- 172.21.15.107:0/954722302 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6db00118e0 con 0x7f6dc007be60 2023-08-10T10:41:20.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.317+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/954722302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 msgr2=0x7f6dc007a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:20.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.317+0000 7f6dc4fc5700 1 --2- 172.21.15.107:0/954722302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc007a2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6db00098a0 tx=0x7f6db0009bb0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.317+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/954722302 shutdown_connections 2023-08-10T10:41:20.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.317+0000 7f6dc4fc5700 1 --2- 172.21.15.107:0/954722302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc007a2c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.317+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/954722302 >> 172.21.15.107:0/954722302 conn(0x7f6dc0101470 msgr2=0x7f6dc0103890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:20.169 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.317+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/954722302 shutdown_connections 2023-08-10T10:41:20.169 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.317+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/954722302 wait complete. 2023-08-10T10:41:20.169 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.319+0000 7f6dc4fc5700 1 Processor -- start 2023-08-10T10:41:20.169 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.319+0000 7f6dc4fc5700 1 -- start start 2023-08-10T10:41:20.169 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.319+0000 7f6dc4fc5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.169 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.319+0000 7f6dc4fc5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc019c2a0 con 0x7f6dc007be60 2023-08-10T10:41:20.169 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.319+0000 7f6dbe59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:20.169 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.320+0000 7f6dbe59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36888/0 (socket says 172.21.15.107:36888) 2023-08-10T10:41:20.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.320+0000 7f6dbe59c700 1 -- 172.21.15.107:0/2262246459 learned_addr learned my addr 172.21.15.107:0/2262246459 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:20.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.320+0000 7f6dbe59c700 1 -- 172.21.15.107:0/2262246459 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0009550 con 0x7f6dc007be60 2023-08-10T10:41:20.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.320+0000 7f6dbe59c700 1 --2- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc019bd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6db0006af0 tx=0x7f6db0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:20.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.320+0000 7f6daf7fe700 1 -- 172.21.15.107:0/2262246459 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6db00037d0 con 0x7f6dc007be60 2023-08-10T10:41:20.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.320+0000 7f6daf7fe700 1 -- 172.21.15.107:0/2262246459 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6db001b440 con 0x7f6dc007be60 2023-08-10T10:41:20.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.320+0000 7f6daf7fe700 1 -- 172.21.15.107:0/2262246459 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6db0023400 con 0x7f6dc007be60 2023-08-10T10:41:20.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.320+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc019c4a0 con 0x7f6dc007be60 2023-08-10T10:41:20.170 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.320+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc019c8c0 con 0x7f6dc007be60 2023-08-10T10:41:20.171 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.322+0000 7f6daf7fe700 1 -- 172.21.15.107:0/2262246459 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f6db001b5b0 con 0x7f6dc007be60 2023-08-10T10:41:20.171 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.322+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc0061da0 con 0x7f6dc007be60 2023-08-10T10:41:20.171 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.322+0000 7f6daf7fe700 1 --2- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6da8038800 0x7f6da803acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:20.171 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.322+0000 7f6daf7fe700 1 -- 172.21.15.107:0/2262246459 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6db004c980 con 0x7f6dc007be60 2023-08-10T10:41:20.171 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.322+0000 7f6dbdd9b700 1 --2- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6da8038800 0x7f6da803acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:20.171 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.323+0000 7f6dbdd9b700 1 --2- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6da8038800 0x7f6da803acc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6db4006fd0 tx=0x7f6db4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:20.171 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.327+0000 7f6daf7fe700 1 -- 172.21.15.107:0/2262246459 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6db001b8d0 con 0x7f6dc007be60 2023-08-10T10:41:20.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.627+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f6dc019f720 con 0x7f6dc007be60 2023-08-10T10:41:20.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.632+0000 7f6daf7fe700 1 -- 172.21.15.107:0/2262246459 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f6db000b3e0 con 0x7f6dc007be60 2023-08-10T10:41:20.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.634+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6da8038800 msgr2=0x7f6da803acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:20.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.634+0000 7f6dc4fc5700 1 --2- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6da8038800 0x7f6da803acc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6db4006fd0 tx=0x7f6db4006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:20.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.634+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 msgr2=0x7f6dc019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:20.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.634+0000 7f6dc4fc5700 1 --2- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc019bd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6db0006af0 tx=0x7f6db0011ed0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.172 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.634+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 shutdown_connections 2023-08-10T10:41:20.173 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.635+0000 7f6dc4fc5700 1 --2- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6da8038800 0x7f6da803acc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.173 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.635+0000 7f6dc4fc5700 1 --2- 172.21.15.107:0/2262246459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6dc007be60 0x7f6dc019bd60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:20.173 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.635+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 >> 172.21.15.107:0/2262246459 conn(0x7f6dc0101470 msgr2=0x7f6dc0102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:20.173 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.635+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 shutdown_connections 2023-08-10T10:41:20.173 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2023-08-10T10:41:19.635+0000 7f6dc4fc5700 1 -- 172.21.15.107:0/2262246459 wait complete. 2023-08-10T10:41:20.173 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-08-10T10:41:20.174 INFO:teuthology.orchestra.run.smithi107.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-08-10T10:41:20.174 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:20.174 INFO:teuthology.orchestra.run.smithi107.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-08-10T10:41:20.174 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:20.175 INFO:teuthology.orchestra.run.smithi107.stdout:Or, if you are only running a single cluster on this host: 2023-08-10T10:41:20.175 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:20.175 INFO:teuthology.orchestra.run.smithi107.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-08-10T10:41:20.175 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:20.176 INFO:teuthology.orchestra.run.smithi107.stdout:Please consider enabling telemetry to help improve Ceph: 2023-08-10T10:41:20.176 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:20.176 INFO:teuthology.orchestra.run.smithi107.stdout: ceph telemetry on 2023-08-10T10:41:20.177 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:20.177 INFO:teuthology.orchestra.run.smithi107.stdout:For more information see: 2023-08-10T10:41:20.177 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:20.177 INFO:teuthology.orchestra.run.smithi107.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-08-10T10:41:20.178 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:20.178 INFO:teuthology.orchestra.run.smithi107.stdout:Bootstrap complete. 2023-08-10T10:41:20.230 INFO:tasks.cephadm:Fetching config... 2023-08-10T10:41:20.231 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:41:20.231 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-08-10T10:41:20.275 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-08-10T10:41:20.276 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:41:20.277 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-08-10T10:41:20.362 INFO:tasks.cephadm:Fetching mon keyring... 2023-08-10T10:41:20.362 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:41:20.363 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-08-10T10:41:20.472 INFO:tasks.cephadm:Fetching pub ssh key... 2023-08-10T10:41:20.473 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:41:20.473 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-08-10T10:41:20.558 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-08-10T10:41:20.558 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOCaYg2ZmE+Cg37OAZTsJswbZ3expPoCq8eLRkeH8zbVikKHOVmQQComkSOMhcHFZyUPUt6a3yOwsm7n68NXUAr1ZrETY1d6wPGNy7HBFIdG4hAagsO7oDtd4bK+NRfGRz0cZU/IPBbwfTam/6Nera1UA9p7+/hyoWpjTW4oGQnuHQVqe202DQCLvxs6S9T4UPegfrP4eGD1rSqBdt39b0L4ITQatGR/LBnwWMGbX51ZZOOT3zm6taidXQWduA+8lF0PB8WgzNQwqhBAuwZSjuwmbJohydJbVlJcFqHaXtVAqcMXZ5HiM/LCTSeR7vikNbbO4iWKFUAZINlAb7XeVMXR1ChI9IyqhMYHa1GgcdEz8TgsZTlsuHjSdf4Sv8hBrOo7GkifIxGd/majad/vcFa1XllkqwjLQwd4zxsyrzMCOkyv8VXOOHEobJU2EjobpDPXBD2y/qrqX3U1rkn6QTvVcKWnoCSf5YYKknExrpDgt1PRHPonW5S/Vx8eYqNa0= ceph-2b47e340-376a-11ee-9b37-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-08-10T10:41:20.697 INFO:teuthology.orchestra.run.smithi107.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOCaYg2ZmE+Cg37OAZTsJswbZ3expPoCq8eLRkeH8zbVikKHOVmQQComkSOMhcHFZyUPUt6a3yOwsm7n68NXUAr1ZrETY1d6wPGNy7HBFIdG4hAagsO7oDtd4bK+NRfGRz0cZU/IPBbwfTam/6Nera1UA9p7+/hyoWpjTW4oGQnuHQVqe202DQCLvxs6S9T4UPegfrP4eGD1rSqBdt39b0L4ITQatGR/LBnwWMGbX51ZZOOT3zm6taidXQWduA+8lF0PB8WgzNQwqhBAuwZSjuwmbJohydJbVlJcFqHaXtVAqcMXZ5HiM/LCTSeR7vikNbbO4iWKFUAZINlAb7XeVMXR1ChI9IyqhMYHa1GgcdEz8TgsZTlsuHjSdf4Sv8hBrOo7GkifIxGd/majad/vcFa1XllkqwjLQwd4zxsyrzMCOkyv8VXOOHEobJU2EjobpDPXBD2y/qrqX3U1rkn6QTvVcKWnoCSf5YYKknExrpDgt1PRHPonW5S/Vx8eYqNa0= ceph-2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:41:20.719 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:20 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2262246459' entity='client.admin' 2023-08-10T10:41:20.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOCaYg2ZmE+Cg37OAZTsJswbZ3expPoCq8eLRkeH8zbVikKHOVmQQComkSOMhcHFZyUPUt6a3yOwsm7n68NXUAr1ZrETY1d6wPGNy7HBFIdG4hAagsO7oDtd4bK+NRfGRz0cZU/IPBbwfTam/6Nera1UA9p7+/hyoWpjTW4oGQnuHQVqe202DQCLvxs6S9T4UPegfrP4eGD1rSqBdt39b0L4ITQatGR/LBnwWMGbX51ZZOOT3zm6taidXQWduA+8lF0PB8WgzNQwqhBAuwZSjuwmbJohydJbVlJcFqHaXtVAqcMXZ5HiM/LCTSeR7vikNbbO4iWKFUAZINlAb7XeVMXR1ChI9IyqhMYHa1GgcdEz8TgsZTlsuHjSdf4Sv8hBrOo7GkifIxGd/majad/vcFa1XllkqwjLQwd4zxsyrzMCOkyv8VXOOHEobJU2EjobpDPXBD2y/qrqX3U1rkn6QTvVcKWnoCSf5YYKknExrpDgt1PRHPonW5S/Vx8eYqNa0= ceph-2b47e340-376a-11ee-9b37-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-08-10T10:41:20.832 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOCaYg2ZmE+Cg37OAZTsJswbZ3expPoCq8eLRkeH8zbVikKHOVmQQComkSOMhcHFZyUPUt6a3yOwsm7n68NXUAr1ZrETY1d6wPGNy7HBFIdG4hAagsO7oDtd4bK+NRfGRz0cZU/IPBbwfTam/6Nera1UA9p7+/hyoWpjTW4oGQnuHQVqe202DQCLvxs6S9T4UPegfrP4eGD1rSqBdt39b0L4ITQatGR/LBnwWMGbX51ZZOOT3zm6taidXQWduA+8lF0PB8WgzNQwqhBAuwZSjuwmbJohydJbVlJcFqHaXtVAqcMXZ5HiM/LCTSeR7vikNbbO4iWKFUAZINlAb7XeVMXR1ChI9IyqhMYHa1GgcdEz8TgsZTlsuHjSdf4Sv8hBrOo7GkifIxGd/majad/vcFa1XllkqwjLQwd4zxsyrzMCOkyv8VXOOHEobJU2EjobpDPXBD2y/qrqX3U1rkn6QTvVcKWnoCSf5YYKknExrpDgt1PRHPonW5S/Vx8eYqNa0= ceph-2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:41:20.863 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOCaYg2ZmE+Cg37OAZTsJswbZ3expPoCq8eLRkeH8zbVikKHOVmQQComkSOMhcHFZyUPUt6a3yOwsm7n68NXUAr1ZrETY1d6wPGNy7HBFIdG4hAagsO7oDtd4bK+NRfGRz0cZU/IPBbwfTam/6Nera1UA9p7+/hyoWpjTW4oGQnuHQVqe202DQCLvxs6S9T4UPegfrP4eGD1rSqBdt39b0L4ITQatGR/LBnwWMGbX51ZZOOT3zm6taidXQWduA+8lF0PB8WgzNQwqhBAuwZSjuwmbJohydJbVlJcFqHaXtVAqcMXZ5HiM/LCTSeR7vikNbbO4iWKFUAZINlAb7XeVMXR1ChI9IyqhMYHa1GgcdEz8TgsZTlsuHjSdf4Sv8hBrOo7GkifIxGd/majad/vcFa1XllkqwjLQwd4zxsyrzMCOkyv8VXOOHEobJU2EjobpDPXBD2y/qrqX3U1rkn6QTvVcKWnoCSf5YYKknExrpDgt1PRHPonW5S/Vx8eYqNa0= ceph-2b47e340-376a-11ee-9b37-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-08-10T10:41:20.968 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOCaYg2ZmE+Cg37OAZTsJswbZ3expPoCq8eLRkeH8zbVikKHOVmQQComkSOMhcHFZyUPUt6a3yOwsm7n68NXUAr1ZrETY1d6wPGNy7HBFIdG4hAagsO7oDtd4bK+NRfGRz0cZU/IPBbwfTam/6Nera1UA9p7+/hyoWpjTW4oGQnuHQVqe202DQCLvxs6S9T4UPegfrP4eGD1rSqBdt39b0L4ITQatGR/LBnwWMGbX51ZZOOT3zm6taidXQWduA+8lF0PB8WgzNQwqhBAuwZSjuwmbJohydJbVlJcFqHaXtVAqcMXZ5HiM/LCTSeR7vikNbbO4iWKFUAZINlAb7XeVMXR1ChI9IyqhMYHa1GgcdEz8TgsZTlsuHjSdf4Sv8hBrOo7GkifIxGd/majad/vcFa1XllkqwjLQwd4zxsyrzMCOkyv8VXOOHEobJU2EjobpDPXBD2y/qrqX3U1rkn6QTvVcKWnoCSf5YYKknExrpDgt1PRHPonW5S/Vx8eYqNa0= ceph-2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:41:20.998 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-08-10T10:41:22.040 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:41:23.214 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:23.214 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:23.215 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi107", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:41:23.215 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:23.215 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:23.215 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:23.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.453+0000 7f72fb779700 1 -- 172.21.15.107:0/1453642015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 msgr2=0x7f72f41006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.453+0000 7f72fb779700 1 --2- 172.21.15.107:0/1453642015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 0x7f72f41006b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009910 tx=0x7f72f0009c20 comp rx=0 tx=0).stop 2023-08-10T10:41:23.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.454+0000 7f72fb779700 1 -- 172.21.15.107:0/1453642015 shutdown_connections 2023-08-10T10:41:23.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.454+0000 7f72fb779700 1 --2- 172.21.15.107:0/1453642015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 0x7f72f41006b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.454+0000 7f72fb779700 1 -- 172.21.15.107:0/1453642015 >> 172.21.15.107:0/1453642015 conn(0x7f72f40fb810 msgr2=0x7f72f40fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:23.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.454+0000 7f72fb779700 1 -- 172.21.15.107:0/1453642015 shutdown_connections 2023-08-10T10:41:23.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.454+0000 7f72fb779700 1 -- 172.21.15.107:0/1453642015 wait complete. 2023-08-10T10:41:23.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.455+0000 7f72fb779700 1 Processor -- start 2023-08-10T10:41:23.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.455+0000 7f72fb779700 1 -- start start 2023-08-10T10:41:23.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.455+0000 7f72fb779700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 0x7f72f41974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.455+0000 7f72fb779700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4197a20 con 0x7f72f4100290 2023-08-10T10:41:23.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.455+0000 7f72f9515700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 0x7f72f41974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.455+0000 7f72f9515700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 0x7f72f41974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34944/0 (socket says 172.21.15.107:34944) 2023-08-10T10:41:23.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.455+0000 7f72f9515700 1 -- 172.21.15.107:0/2837267488 learned_addr learned my addr 172.21.15.107:0/2837267488 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:23.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.456+0000 7f72f9515700 1 -- 172.21.15.107:0/2837267488 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f00095f0 con 0x7f72f4100290 2023-08-10T10:41:23.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.456+0000 7f72f9515700 1 --2- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 0x7f72f41974e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72f0005950 tx=0x7f72f0005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:23.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.456+0000 7f72ea7fc700 1 -- 172.21.15.107:0/2837267488 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f000ba90 con 0x7f72f4100290 2023-08-10T10:41:23.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.456+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f4197c20 con 0x7f72f4100290 2023-08-10T10:41:23.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.456+0000 7f72ea7fc700 1 -- 172.21.15.107:0/2837267488 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72f000bbf0 con 0x7f72f4100290 2023-08-10T10:41:23.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.456+0000 7f72ea7fc700 1 -- 172.21.15.107:0/2837267488 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f0017440 con 0x7f72f4100290 2023-08-10T10:41:23.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.456+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f41980c0 con 0x7f72f4100290 2023-08-10T10:41:23.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.458+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f4105e90 con 0x7f72f4100290 2023-08-10T10:41:23.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.458+0000 7f72ea7fc700 1 -- 172.21.15.107:0/2837267488 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f72f000f460 con 0x7f72f4100290 2023-08-10T10:41:23.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.458+0000 7f72ea7fc700 1 --2- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72e00387b0 0x7f72e003ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:23.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.458+0000 7f72ea7fc700 1 -- 172.21.15.107:0/2837267488 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f72f004c9c0 con 0x7f72f4100290 2023-08-10T10:41:23.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.458+0000 7f72f8d14700 1 --2- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72e00387b0 0x7f72e003ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:23.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.459+0000 7f72f8d14700 1 --2- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72e00387b0 0x7f72e003ac70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006fd0 tx=0x7f72e4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:23.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.463+0000 7f72ea7fc700 1 -- 172.21.15.107:0/2837267488 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f72f0015350 con 0x7f72f4100290 2023-08-10T10:41:23.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.659+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f72f4106080 con 0x7f72f4100290 2023-08-10T10:41:23.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.665+0000 7f72ea7fc700 1 -- 172.21.15.107:0/2837267488 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f72f0027030 con 0x7f72f4100290 2023-08-10T10:41:23.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.667+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72e00387b0 msgr2=0x7f72e003ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.667+0000 7f72fb779700 1 --2- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72e00387b0 0x7f72e003ac70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006fd0 tx=0x7f72e4006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.667+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 msgr2=0x7f72f41974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.667+0000 7f72fb779700 1 --2- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 0x7f72f41974e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72f0005950 tx=0x7f72f0005810 comp rx=0 tx=0).stop 2023-08-10T10:41:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.667+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 shutdown_connections 2023-08-10T10:41:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.667+0000 7f72fb779700 1 --2- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72e00387b0 0x7f72e003ac70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.667+0000 7f72fb779700 1 --2- 172.21.15.107:0/2837267488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4100290 0x7f72f41974e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:23.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.667+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 >> 172.21.15.107:0/2837267488 conn(0x7f72f40fb810 msgr2=0x7f72f4072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:23.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.668+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 shutdown_connections 2023-08-10T10:41:23.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:23.668+0000 7f72fb779700 1 -- 172.21.15.107:0/2837267488 wait complete. 2023-08-10T10:41:24.119 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-08-10T10:41:24.120 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-08-10T10:41:24.834 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:41:25.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:24 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2837267488' entity='client.admin' 2023-08-10T10:41:25.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:25.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:26.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.322+0000 7f60a662a700 1 -- 172.21.15.107:0/2900517326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 msgr2=0x7f60a0072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.322+0000 7f60a662a700 1 --2- 172.21.15.107:0/2900517326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 0x7f60a0072c00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6090009910 tx=0x7f6090009c20 comp rx=0 tx=0).stop 2023-08-10T10:41:26.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.322+0000 7f60a662a700 1 -- 172.21.15.107:0/2900517326 shutdown_connections 2023-08-10T10:41:26.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.322+0000 7f60a662a700 1 --2- 172.21.15.107:0/2900517326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 0x7f60a0072c00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.322+0000 7f60a662a700 1 -- 172.21.15.107:0/2900517326 >> 172.21.15.107:0/2900517326 conn(0x7f60a00fb810 msgr2=0x7f60a00fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:26.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.322+0000 7f60a662a700 1 -- 172.21.15.107:0/2900517326 shutdown_connections 2023-08-10T10:41:26.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.322+0000 7f60a662a700 1 -- 172.21.15.107:0/2900517326 wait complete. 2023-08-10T10:41:26.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.323+0000 7f60a662a700 1 Processor -- start 2023-08-10T10:41:26.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.323+0000 7f60a662a700 1 -- start start 2023-08-10T10:41:26.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.323+0000 7f60a662a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 0x7f60a01974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.323+0000 7f60a662a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a01979f0 con 0x7f60a00747a0 2023-08-10T10:41:26.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.323+0000 7f609ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 0x7f60a01974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.323+0000 7f609ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 0x7f60a01974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34966/0 (socket says 172.21.15.107:34966) 2023-08-10T10:41:26.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.324+0000 7f609ffff700 1 -- 172.21.15.107:0/2337435030 learned_addr learned my addr 172.21.15.107:0/2337435030 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:26.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.324+0000 7f609ffff700 1 -- 172.21.15.107:0/2337435030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900095f0 con 0x7f60a00747a0 2023-08-10T10:41:26.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.324+0000 7f609ffff700 1 --2- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 0x7f60a01974b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6090005950 tx=0x7f6090005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:26.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.324+0000 7f609d7fa700 1 -- 172.21.15.107:0/2337435030 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f609000ba90 con 0x7f60a00747a0 2023-08-10T10:41:26.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.324+0000 7f609d7fa700 1 -- 172.21.15.107:0/2337435030 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f609000bbf0 con 0x7f60a00747a0 2023-08-10T10:41:26.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.324+0000 7f609d7fa700 1 -- 172.21.15.107:0/2337435030 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6090017440 con 0x7f60a00747a0 2023-08-10T10:41:26.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.324+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a0197bf0 con 0x7f60a00747a0 2023-08-10T10:41:26.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.324+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a0198090 con 0x7f60a00747a0 2023-08-10T10:41:26.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.325+0000 7f609d7fa700 1 -- 172.21.15.107:0/2337435030 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f609000f460 con 0x7f60a00747a0 2023-08-10T10:41:26.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.325+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a0190e60 con 0x7f60a00747a0 2023-08-10T10:41:26.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.326+0000 7f609d7fa700 1 --2- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6088038800 0x7f608803acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.326+0000 7f609d7fa700 1 -- 172.21.15.107:0/2337435030 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f609004c960 con 0x7f60a00747a0 2023-08-10T10:41:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.326+0000 7f609f7fe700 1 --2- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6088038800 0x7f608803acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.327+0000 7f609f7fe700 1 --2- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6088038800 0x7f608803acc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6094006fd0 tx=0x7f6094006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:26.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.331+0000 7f609d7fa700 1 -- 172.21.15.107:0/2337435030 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f609002ad30 con 0x7f60a00747a0 2023-08-10T10:41:26.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.528+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f60a0060c40 con 0x7f6088038800 2023-08-10T10:41:26.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.532+0000 7f609d7fa700 1 -- 172.21.15.107:0/2337435030 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f60a0060c40 con 0x7f6088038800 2023-08-10T10:41:26.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.534+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6088038800 msgr2=0x7f608803acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.534+0000 7f60a662a700 1 --2- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6088038800 0x7f608803acc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6094006fd0 tx=0x7f6094006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:26.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.534+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 msgr2=0x7f60a01974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:26.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.534+0000 7f60a662a700 1 --2- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 0x7f60a01974b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6090005950 tx=0x7f6090005810 comp rx=0 tx=0).stop 2023-08-10T10:41:26.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.534+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 shutdown_connections 2023-08-10T10:41:26.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.534+0000 7f60a662a700 1 --2- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6088038800 0x7f608803acc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.534+0000 7f60a662a700 1 --2- 172.21.15.107:0/2337435030 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60a00747a0 0x7f60a01974b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:26.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.534+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 >> 172.21.15.107:0/2337435030 conn(0x7f60a00fb810 msgr2=0x7f60a00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:26.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.535+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 shutdown_connections 2023-08-10T10:41:26.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:26.535+0000 7f60a662a700 1 -- 172.21.15.107:0/2337435030 wait complete. 2023-08-10T10:41:27.110 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi157 2023-08-10T10:41:27.111 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:41:27.111 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.conf 2023-08-10T10:41:27.159 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:41:27.159 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:41:27.244 INFO:tasks.cephadm:Adding host smithi157 to orchestrator... 2023-08-10T10:41:27.244 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch host add smithi157 2023-08-10T10:41:27.576 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:27 smithi107 ceph-mon[127953]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:41:27.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:27 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:27.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:27 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:27.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:27 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:41:27.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:27 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:41:27.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:27 smithi107 ceph-mon[127953]: Updating smithi107:/etc/ceph/ceph.conf 2023-08-10T10:41:28.006 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:41:28.825 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:28 smithi107 ceph-mon[127953]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:41:28.825 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:28 smithi107 ceph-mon[127953]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:41:29.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.384+0000 7f0abc703700 1 -- 172.21.15.107:0/3562077309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 msgr2=0x7f0ab4100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:29.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.384+0000 7f0abc703700 1 --2- 172.21.15.107:0/3562077309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 0x7f0ab4100850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009910 tx=0x7f0ab0009c20 comp rx=0 tx=0).stop 2023-08-10T10:41:29.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.384+0000 7f0abc703700 1 -- 172.21.15.107:0/3562077309 shutdown_connections 2023-08-10T10:41:29.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.384+0000 7f0abc703700 1 --2- 172.21.15.107:0/3562077309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 0x7f0ab4100850 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:29.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.384+0000 7f0abc703700 1 -- 172.21.15.107:0/3562077309 >> 172.21.15.107:0/3562077309 conn(0x7f0ab40fbd60 msgr2=0x7f0ab40fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:29.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.384+0000 7f0abc703700 1 -- 172.21.15.107:0/3562077309 shutdown_connections 2023-08-10T10:41:29.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.384+0000 7f0abc703700 1 -- 172.21.15.107:0/3562077309 wait complete. 2023-08-10T10:41:29.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.385+0000 7f0abc703700 1 Processor -- start 2023-08-10T10:41:29.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.385+0000 7f0abc703700 1 -- start start 2023-08-10T10:41:29.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.385+0000 7f0abc703700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 0x7f0ab4072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:29.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.385+0000 7f0abc703700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab4199670 con 0x7f0ab4100470 2023-08-10T10:41:29.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.386+0000 7f0aba49f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 0x7f0ab4072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:29.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.386+0000 7f0aba49f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 0x7f0ab4072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34980/0 (socket says 172.21.15.107:34980) 2023-08-10T10:41:29.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.386+0000 7f0aba49f700 1 -- 172.21.15.107:0/219829242 learned_addr learned my addr 172.21.15.107:0/219829242 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:29.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.386+0000 7f0aba49f700 1 -- 172.21.15.107:0/219829242 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00095f0 con 0x7f0ab4100470 2023-08-10T10:41:29.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.386+0000 7f0aba49f700 1 --2- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 0x7f0ab4072a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0006010 tx=0x7f0ab0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:29.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.386+0000 7f0aab7fe700 1 -- 172.21.15.107:0/219829242 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ab001d070 con 0x7f0ab4100470 2023-08-10T10:41:29.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.387+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab40747f0 con 0x7f0ab4100470 2023-08-10T10:41:29.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.387+0000 7f0aab7fe700 1 -- 172.21.15.107:0/219829242 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ab000bdf0 con 0x7f0ab4100470 2023-08-10T10:41:29.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.387+0000 7f0aab7fe700 1 -- 172.21.15.107:0/219829242 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ab0022d80 con 0x7f0ab4100470 2023-08-10T10:41:29.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.387+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab4073180 con 0x7f0ab4100470 2023-08-10T10:41:29.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.388+0000 7f0aab7fe700 1 -- 172.21.15.107:0/219829242 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f0ab000f460 con 0x7f0ab4100470 2023-08-10T10:41:29.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.388+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab4108780 con 0x7f0ab4100470 2023-08-10T10:41:29.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.388+0000 7f0aab7fe700 1 --2- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0aa00387b0 0x7f0aa003ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:29.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.388+0000 7f0aab7fe700 1 -- 172.21.15.107:0/219829242 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0ab004c940 con 0x7f0ab4100470 2023-08-10T10:41:29.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.388+0000 7f0ab9c9e700 1 --2- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0aa00387b0 0x7f0aa003ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:29.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.389+0000 7f0ab9c9e700 1 --2- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0aa00387b0 0x7f0aa003ac70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006fd0 tx=0x7f0aa4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:29.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.394+0000 7f0aab7fe700 1 -- 172.21.15.107:0/219829242 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0ab002bba0 con 0x7f0ab4100470 2023-08-10T10:41:29.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:29.594+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ab4074080 con 0x7f0aa00387b0 2023-08-10T10:41:30.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:29 smithi107 ceph-mon[127953]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:41:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:31.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:30 smithi107 ceph-mon[127953]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:41:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:31 smithi107 ceph-mon[127953]: Deploying cephadm binary to smithi157 2023-08-10T10:41:32.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.685+0000 7f0aab7fe700 1 -- 172.21.15.107:0/219829242 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0ab4074080 con 0x7f0aa00387b0 2023-08-10T10:41:32.686 INFO:teuthology.orchestra.run.smithi107.stdout:Added host 'smithi157' with addr '172.21.15.157' 2023-08-10T10:41:32.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0aa00387b0 msgr2=0x7f0aa003ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 --2- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0aa00387b0 0x7f0aa003ac70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006fd0 tx=0x7f0aa4006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:32.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 msgr2=0x7f0ab4072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:32.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 --2- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 0x7f0ab4072a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0006010 tx=0x7f0ab0004ff0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 shutdown_connections 2023-08-10T10:41:32.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 --2- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0aa00387b0 0x7f0aa003ac70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 --2- 172.21.15.107:0/219829242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ab4100470 0x7f0ab4072a70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:32.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 >> 172.21.15.107:0/219829242 conn(0x7f0ab40fbd60 msgr2=0x7f0ab4104740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:32.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 shutdown_connections 2023-08-10T10:41:32.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:32.688+0000 7f0abc703700 1 -- 172.21.15.107:0/219829242 wait complete. 2023-08-10T10:41:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:32 smithi107 ceph-mon[127953]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:33.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:33.187 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch host ls --format=json 2023-08-10T10:41:33.908 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:41:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:33 smithi107 ceph-mon[127953]: Added host smithi157 2023-08-10T10:41:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:33 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:33 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:35.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.422+0000 7f53046fe700 1 -- 172.21.15.107:0/1379480012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 msgr2=0x7f52fc100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.422+0000 7f53046fe700 1 --2- 172.21.15.107:0/1379480012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 0x7f52fc100850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009910 tx=0x7f52f8009c20 comp rx=0 tx=0).stop 2023-08-10T10:41:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.422+0000 7f53046fe700 1 -- 172.21.15.107:0/1379480012 shutdown_connections 2023-08-10T10:41:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.422+0000 7f53046fe700 1 --2- 172.21.15.107:0/1379480012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 0x7f52fc100850 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.422+0000 7f53046fe700 1 -- 172.21.15.107:0/1379480012 >> 172.21.15.107:0/1379480012 conn(0x7f52fc0fbd60 msgr2=0x7f52fc0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.423+0000 7f53046fe700 1 -- 172.21.15.107:0/1379480012 shutdown_connections 2023-08-10T10:41:35.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.423+0000 7f53046fe700 1 -- 172.21.15.107:0/1379480012 wait complete. 2023-08-10T10:41:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.424+0000 7f53046fe700 1 Processor -- start 2023-08-10T10:41:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.424+0000 7f53046fe700 1 -- start start 2023-08-10T10:41:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.425+0000 7f53046fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 0x7f52fc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.425+0000 7f53046fe700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc19db80 con 0x7f52fc100470 2023-08-10T10:41:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.425+0000 7f530249a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 0x7f52fc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.425+0000 7f530249a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 0x7f52fc19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52160/0 (socket says 172.21.15.107:52160) 2023-08-10T10:41:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.425+0000 7f530249a700 1 -- 172.21.15.107:0/800614298 learned_addr learned my addr 172.21.15.107:0/800614298 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.425+0000 7f530249a700 1 -- 172.21.15.107:0/800614298 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f80095f0 con 0x7f52fc100470 2023-08-10T10:41:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.426+0000 7f530249a700 1 --2- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 0x7f52fc19d640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f52f8006010 tx=0x7f52f8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.426+0000 7f52f37fe700 1 -- 172.21.15.107:0/800614298 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52f801d070 con 0x7f52fc100470 2023-08-10T10:41:35.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.426+0000 7f52f37fe700 1 -- 172.21.15.107:0/800614298 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52f800bdf0 con 0x7f52fc100470 2023-08-10T10:41:35.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.426+0000 7f52f37fe700 1 -- 172.21.15.107:0/800614298 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52f8022d80 con 0x7f52fc100470 2023-08-10T10:41:35.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.426+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc19dd80 con 0x7f52fc100470 2023-08-10T10:41:35.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.426+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc19e1a0 con 0x7f52fc100470 2023-08-10T10:41:35.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.427+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc061da0 con 0x7f52fc100470 2023-08-10T10:41:35.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.427+0000 7f52f37fe700 1 -- 172.21.15.107:0/800614298 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f52f8022570 con 0x7f52fc100470 2023-08-10T10:41:35.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.428+0000 7f52f37fe700 1 --2- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f52e8038800 0x7f52e803acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:35.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.428+0000 7f52f37fe700 1 -- 172.21.15.107:0/800614298 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f52f804c960 con 0x7f52fc100470 2023-08-10T10:41:35.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.428+0000 7f5301c99700 1 --2- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f52e8038800 0x7f52e803acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:35.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.428+0000 7f5301c99700 1 --2- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f52e8038800 0x7f52e803acc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52ec006fd0 tx=0x7f52ec006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:35.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.433+0000 7f52f37fe700 1 -- 172.21.15.107:0/800614298 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f52f802b590 con 0x7f52fc100470 2023-08-10T10:41:35.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:35 smithi107 ceph-mon[127953]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:35.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:35 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:35.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.637+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52fc104560 con 0x7f52e8038800 2023-08-10T10:41:35.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.638+0000 7f52f37fe700 1 -- 172.21.15.107:0/800614298 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f52fc104560 con 0x7f52e8038800 2023-08-10T10:41:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:35.640 INFO:teuthology.orchestra.run.smithi107.stdout:[{"addr": "172.21.15.107", "hostname": "smithi107", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}] 2023-08-10T10:41:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f52e8038800 msgr2=0x7f52e803acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 --2- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f52e8038800 0x7f52e803acc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52ec006fd0 tx=0x7f52ec006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 msgr2=0x7f52fc19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 --2- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 0x7f52fc19d640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f52f8006010 tx=0x7f52f8004ff0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 shutdown_connections 2023-08-10T10:41:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 --2- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f52e8038800 0x7f52e803acc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 --2- 172.21.15.107:0/800614298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f52fc100470 0x7f52fc19d640 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 >> 172.21.15.107:0/800614298 conn(0x7f52fc0fbd60 msgr2=0x7f52fc103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 shutdown_connections 2023-08-10T10:41:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:35.641+0000 7f53046fe700 1 -- 172.21.15.107:0/800614298 wait complete. 2023-08-10T10:41:36.079 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2023-08-10T10:41:36.080 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:41:36.080 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2023-08-10T10:41:36.127 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:41:36.128 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:41:36.212 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2023-08-10T10:41:36.213 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch host add smithi195 2023-08-10T10:41:36.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:36 smithi107 ceph-mon[127953]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:36.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:36.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:36 smithi107 ceph-mon[127953]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:41:36.928 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:41:38.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.398+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1743401573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 msgr2=0x7f0f88072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:38.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.398+0000 7f0f8eba5700 1 --2- 172.21.15.107:0/1743401573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 0x7f0f88072f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009910 tx=0x7f0f7c009c20 comp rx=0 tx=0).stop 2023-08-10T10:41:38.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.398+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1743401573 shutdown_connections 2023-08-10T10:41:38.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.398+0000 7f0f8eba5700 1 --2- 172.21.15.107:0/1743401573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 0x7f0f88072f40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:38.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.398+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1743401573 >> 172.21.15.107:0/1743401573 conn(0x7f0f880fbd60 msgr2=0x7f0f880fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:38.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.398+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1743401573 shutdown_connections 2023-08-10T10:41:38.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.398+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1743401573 wait complete. 2023-08-10T10:41:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.399+0000 7f0f8eba5700 1 Processor -- start 2023-08-10T10:41:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.399+0000 7f0f8eba5700 1 -- start start 2023-08-10T10:41:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.400+0000 7f0f8eba5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 0x7f0f8819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.400+0000 7f0f8eba5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8819db80 con 0x7f0f88072b60 2023-08-10T10:41:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.400+0000 7f0f8c941700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 0x7f0f8819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.400+0000 7f0f8c941700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 0x7f0f8819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52180/0 (socket says 172.21.15.107:52180) 2023-08-10T10:41:38.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.400+0000 7f0f8c941700 1 -- 172.21.15.107:0/1607092604 learned_addr learned my addr 172.21.15.107:0/1607092604 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:38.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.400+0000 7f0f8c941700 1 -- 172.21.15.107:0/1607092604 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0095f0 con 0x7f0f88072b60 2023-08-10T10:41:38.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.401+0000 7f0f8c941700 1 --2- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 0x7f0f8819d640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c006010 tx=0x7f0f7c004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:38.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.401+0000 7f0f85ffb700 1 -- 172.21.15.107:0/1607092604 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f7c01d070 con 0x7f0f88072b60 2023-08-10T10:41:38.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.401+0000 7f0f85ffb700 1 -- 172.21.15.107:0/1607092604 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f7c00bdf0 con 0x7f0f88072b60 2023-08-10T10:41:38.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.401+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8819dd80 con 0x7f0f88072b60 2023-08-10T10:41:38.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.401+0000 7f0f85ffb700 1 -- 172.21.15.107:0/1607092604 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f7c022d80 con 0x7f0f88072b60 2023-08-10T10:41:38.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.401+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8819e1a0 con 0x7f0f88072b60 2023-08-10T10:41:38.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.402+0000 7f0f85ffb700 1 -- 172.21.15.107:0/1607092604 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f0f7c022570 con 0x7f0f88072b60 2023-08-10T10:41:38.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.402+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f88061da0 con 0x7f0f88072b60 2023-08-10T10:41:38.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.403+0000 7f0f85ffb700 1 --2- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f78038800 0x7f0f7803acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:38.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.403+0000 7f0f85ffb700 1 -- 172.21.15.107:0/1607092604 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0f7c04c8f0 con 0x7f0f88072b60 2023-08-10T10:41:38.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.403+0000 7f0f87fff700 1 --2- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f78038800 0x7f0f7803acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:38.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.403+0000 7f0f87fff700 1 --2- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f78038800 0x7f0f7803acc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f74006fd0 tx=0x7f0f74006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:38.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.407+0000 7f0f85ffb700 1 -- 172.21.15.107:0/1607092604 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0f7c02bb60 con 0x7f0f88072b60 2023-08-10T10:41:38.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:38.610+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f88109880 con 0x7f0f78038800 2023-08-10T10:41:38.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:38 smithi107 ceph-mon[127953]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:40.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:39 smithi107 ceph-mon[127953]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:41:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:41:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:41:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:41:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:39 smithi107 ceph-mon[127953]: Updating smithi157:/etc/ceph/ceph.conf 2023-08-10T10:41:41.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:40 smithi107 ceph-mon[127953]: Deploying cephadm binary to smithi195 2023-08-10T10:41:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:40 smithi107 ceph-mon[127953]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:41:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:40 smithi107 ceph-mon[127953]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:40 smithi107 ceph-mon[127953]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:41:41.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.733+0000 7f0f85ffb700 1 -- 172.21.15.107:0/1607092604 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0f88109880 con 0x7f0f78038800 2023-08-10T10:41:41.736 INFO:teuthology.orchestra.run.smithi107.stdout:Added host 'smithi195' with addr '172.21.15.195' 2023-08-10T10:41:41.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f78038800 msgr2=0x7f0f7803acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 --2- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f78038800 0x7f0f7803acc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f74006fd0 tx=0x7f0f74006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:41.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 msgr2=0x7f0f8819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:41.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 --2- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 0x7f0f8819d640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c006010 tx=0x7f0f7c004f40 comp rx=0 tx=0).stop 2023-08-10T10:41:41.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 shutdown_connections 2023-08-10T10:41:41.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 --2- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f78038800 0x7f0f7803acc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 --2- 172.21.15.107:0/1607092604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88072b60 0x7f0f8819d640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:41.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 >> 172.21.15.107:0/1607092604 conn(0x7f0f880fbd60 msgr2=0x7f0f88106e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:41.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 shutdown_connections 2023-08-10T10:41:41.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:41.736+0000 7f0f8eba5700 1 -- 172.21.15.107:0/1607092604 wait complete. 2023-08-10T10:41:42.307 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch host ls --format=json 2023-08-10T10:41:43.027 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:41:43.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:42 smithi107 ceph-mon[127953]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:41:43.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:42 smithi107 ceph-mon[127953]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:43.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:43.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:43.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:43.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:43.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:42 smithi107 ceph-mon[127953]: Added host smithi195 2023-08-10T10:41:43.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:43.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:44.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.505+0000 7efc6dc5e700 1 -- 172.21.15.107:0/800304787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 msgr2=0x7efc68100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:44.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.505+0000 7efc6dc5e700 1 --2- 172.21.15.107:0/800304787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 0x7efc68100850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc58009910 tx=0x7efc58009c20 comp rx=0 tx=0).stop 2023-08-10T10:41:44.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.505+0000 7efc6dc5e700 1 -- 172.21.15.107:0/800304787 shutdown_connections 2023-08-10T10:41:44.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.505+0000 7efc6dc5e700 1 --2- 172.21.15.107:0/800304787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 0x7efc68100850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:44.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.505+0000 7efc6dc5e700 1 -- 172.21.15.107:0/800304787 >> 172.21.15.107:0/800304787 conn(0x7efc680fbd60 msgr2=0x7efc680fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:44.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.506+0000 7efc6dc5e700 1 -- 172.21.15.107:0/800304787 shutdown_connections 2023-08-10T10:41:44.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.506+0000 7efc6dc5e700 1 -- 172.21.15.107:0/800304787 wait complete. 2023-08-10T10:41:44.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.506+0000 7efc6dc5e700 1 Processor -- start 2023-08-10T10:41:44.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.507+0000 7efc6dc5e700 1 -- start start 2023-08-10T10:41:44.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.507+0000 7efc6dc5e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 0x7efc6819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:44.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.507+0000 7efc6dc5e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6819db80 con 0x7efc68100470 2023-08-10T10:41:44.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.507+0000 7efc677fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 0x7efc6819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:44.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.507+0000 7efc677fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 0x7efc6819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53018/0 (socket says 172.21.15.107:53018) 2023-08-10T10:41:44.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.507+0000 7efc677fe700 1 -- 172.21.15.107:0/3607250946 learned_addr learned my addr 172.21.15.107:0/3607250946 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:44.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.508+0000 7efc677fe700 1 -- 172.21.15.107:0/3607250946 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc580095f0 con 0x7efc68100470 2023-08-10T10:41:44.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.508+0000 7efc677fe700 1 --2- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 0x7efc6819d640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc58006010 tx=0x7efc58004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:44.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.508+0000 7efc64ff9700 1 -- 172.21.15.107:0/3607250946 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc5801d070 con 0x7efc68100470 2023-08-10T10:41:44.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.508+0000 7efc64ff9700 1 -- 172.21.15.107:0/3607250946 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc5800bdf0 con 0x7efc68100470 2023-08-10T10:41:44.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.508+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6819dd80 con 0x7efc68100470 2023-08-10T10:41:44.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.508+0000 7efc64ff9700 1 -- 172.21.15.107:0/3607250946 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc58022d80 con 0x7efc68100470 2023-08-10T10:41:44.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.508+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6819e1a0 con 0x7efc68100470 2023-08-10T10:41:44.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.509+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc68061da0 con 0x7efc68100470 2023-08-10T10:41:44.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.509+0000 7efc64ff9700 1 -- 172.21.15.107:0/3607250946 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7efc58022570 con 0x7efc68100470 2023-08-10T10:41:44.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.510+0000 7efc64ff9700 1 --2- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efc50038800 0x7efc5003acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:44.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.510+0000 7efc64ff9700 1 -- 172.21.15.107:0/3607250946 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efc5804c960 con 0x7efc68100470 2023-08-10T10:41:44.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.510+0000 7efc66ffd700 1 --2- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efc50038800 0x7efc5003acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:44.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.511+0000 7efc66ffd700 1 --2- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efc50038800 0x7efc5003acc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efc5c006fd0 tx=0x7efc5c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:44.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.515+0000 7efc64ff9700 1 -- 172.21.15.107:0/3607250946 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7efc5802b590 con 0x7efc68100470 2023-08-10T10:41:44.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:44.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:44 smithi107 ceph-mon[127953]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:44.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.715+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc68104560 con 0x7efc50038800 2023-08-10T10:41:44.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.716+0000 7efc64ff9700 1 -- 172.21.15.107:0/3607250946 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+241 (secure 0 0 0) 0x7efc68104560 con 0x7efc50038800 2023-08-10T10:41:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:41:44.717 INFO:teuthology.orchestra.run.smithi107.stdout:[{"addr": "172.21.15.107", "hostname": "smithi107", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}, {"addr": "172.21.15.195", "hostname": "smithi195", "labels": [], "status": ""}] 2023-08-10T10:41:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.718+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efc50038800 msgr2=0x7efc5003acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.718+0000 7efc6dc5e700 1 --2- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efc50038800 0x7efc5003acc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efc5c006fd0 tx=0x7efc5c006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.719+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 msgr2=0x7efc6819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.719+0000 7efc6dc5e700 1 --2- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 0x7efc6819d640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc58006010 tx=0x7efc58004ff0 comp rx=0 tx=0).stop 2023-08-10T10:41:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.719+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 shutdown_connections 2023-08-10T10:41:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.719+0000 7efc6dc5e700 1 --2- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efc50038800 0x7efc5003acc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.719+0000 7efc6dc5e700 1 --2- 172.21.15.107:0/3607250946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc68100470 0x7efc6819d640 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.719+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 >> 172.21.15.107:0/3607250946 conn(0x7efc680fbd60 msgr2=0x7efc68103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.719+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 shutdown_connections 2023-08-10T10:41:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:44.719+0000 7efc6dc5e700 1 -- 172.21.15.107:0/3607250946 wait complete. 2023-08-10T10:41:45.400 INFO:tasks.cephadm:Setting crush tunables to default 2023-08-10T10:41:45.401 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd crush tunables default 2023-08-10T10:41:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:45 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:45 smithi107 ceph-mon[127953]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:41:46.118 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:41:47.047 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:46 smithi107 ceph-mon[127953]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:47.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.582+0000 7faa87875700 1 -- 172.21.15.107:0/1406608740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 msgr2=0x7faa80100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:47.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.582+0000 7faa87875700 1 --2- 172.21.15.107:0/1406608740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 0x7faa80100850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009910 tx=0x7faa7c009c20 comp rx=0 tx=0).stop 2023-08-10T10:41:47.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.582+0000 7faa87875700 1 -- 172.21.15.107:0/1406608740 shutdown_connections 2023-08-10T10:41:47.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.582+0000 7faa87875700 1 --2- 172.21.15.107:0/1406608740 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 0x7faa80100850 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:47.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.582+0000 7faa87875700 1 -- 172.21.15.107:0/1406608740 >> 172.21.15.107:0/1406608740 conn(0x7faa800fbd60 msgr2=0x7faa800fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:47.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.582+0000 7faa87875700 1 -- 172.21.15.107:0/1406608740 shutdown_connections 2023-08-10T10:41:47.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.582+0000 7faa87875700 1 -- 172.21.15.107:0/1406608740 wait complete. 2023-08-10T10:41:47.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.584+0000 7faa87875700 1 Processor -- start 2023-08-10T10:41:47.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.584+0000 7faa87875700 1 -- start start 2023-08-10T10:41:47.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.584+0000 7faa87875700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 0x7faa80195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:47.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.584+0000 7faa87875700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa80195b80 con 0x7faa80100470 2023-08-10T10:41:47.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.585+0000 7faa85611700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 0x7faa80195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:47.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.585+0000 7faa85611700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 0x7faa80195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53028/0 (socket says 172.21.15.107:53028) 2023-08-10T10:41:47.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.585+0000 7faa85611700 1 -- 172.21.15.107:0/1982629403 learned_addr learned my addr 172.21.15.107:0/1982629403 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:41:47.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.585+0000 7faa85611700 1 -- 172.21.15.107:0/1982629403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c0095f0 con 0x7faa80100470 2023-08-10T10:41:47.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.585+0000 7faa85611700 1 --2- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 0x7faa80195640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa7c006010 tx=0x7faa7c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:47.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.585+0000 7faa767fc700 1 -- 172.21.15.107:0/1982629403 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa7c01d070 con 0x7faa80100470 2023-08-10T10:41:47.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.585+0000 7faa767fc700 1 -- 172.21.15.107:0/1982629403 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa7c00bdf0 con 0x7faa80100470 2023-08-10T10:41:47.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.585+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa80195d80 con 0x7faa80100470 2023-08-10T10:41:47.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.586+0000 7faa767fc700 1 -- 172.21.15.107:0/1982629403 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa7c022d80 con 0x7faa80100470 2023-08-10T10:41:47.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.586+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa801961a0 con 0x7faa80100470 2023-08-10T10:41:47.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.587+0000 7faa767fc700 1 -- 172.21.15.107:0/1982629403 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7faa7c022570 con 0x7faa80100470 2023-08-10T10:41:47.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.587+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa80061da0 con 0x7faa80100470 2023-08-10T10:41:47.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.587+0000 7faa767fc700 1 --2- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faa6c038800 0x7faa6c03acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:47.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.587+0000 7faa767fc700 1 -- 172.21.15.107:0/1982629403 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faa7c04c960 con 0x7faa80100470 2023-08-10T10:41:47.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.587+0000 7faa84e10700 1 --2- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faa6c038800 0x7faa6c03acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:47.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.588+0000 7faa84e10700 1 --2- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faa6c038800 0x7faa6c03acc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa70006fd0 tx=0x7faa70006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:47.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.592+0000 7faa767fc700 1 -- 172.21.15.107:0/1982629403 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7faa7c02b590 con 0x7faa80100470 2023-08-10T10:41:47.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:47.793+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7faa80108230 con 0x7faa80100470 2023-08-10T10:41:48.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.716+0000 7faa767fc700 1 -- 172.21.15.107:0/1982629403 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7faa7c027020 con 0x7faa80100470 2023-08-10T10:41:48.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.719+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faa6c038800 msgr2=0x7faa6c03acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:48.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.719+0000 7faa87875700 1 --2- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faa6c038800 0x7faa6c03acc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa70006fd0 tx=0x7faa70006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:48.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.719+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 msgr2=0x7faa80195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:48.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.719+0000 7faa87875700 1 --2- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 0x7faa80195640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa7c006010 tx=0x7faa7c004ff0 comp rx=0 tx=0).stop 2023-08-10T10:41:48.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.719+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 shutdown_connections 2023-08-10T10:41:48.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.719+0000 7faa87875700 1 --2- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faa6c038800 0x7faa6c03acc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:48.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.719+0000 7faa87875700 1 --2- 172.21.15.107:0/1982629403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa80100470 0x7faa80195640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:48.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.719+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 >> 172.21.15.107:0/1982629403 conn(0x7faa800fbd60 msgr2=0x7faa80104740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:48.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.719+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 shutdown_connections 2023-08-10T10:41:48.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:41:48.720+0000 7faa87875700 1 -- 172.21.15.107:0/1982629403 wait complete. 2023-08-10T10:41:48.723 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2023-08-10T10:41:49.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:48 smithi107 ceph-mon[127953]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:49.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:48 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1982629403' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-08-10T10:41:49.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:49.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:49.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:49.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:49.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:41:49.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:41:49.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:41:49.193 INFO:tasks.cephadm:Adding mon.a on smithi107 2023-08-10T10:41:49.194 INFO:tasks.cephadm:Adding mon.b on smithi157 2023-08-10T10:41:49.194 INFO:tasks.cephadm:Adding mon.c on smithi195 2023-08-10T10:41:49.194 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch apply mon '3;smithi107:172.21.15.107=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c' 2023-08-10T10:41:49.937 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:41:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:49 smithi107 ceph-mon[127953]: Updating smithi195:/etc/ceph/ceph.conf 2023-08-10T10:41:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:49 smithi107 ceph-mon[127953]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:41:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:49 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1982629403' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-08-10T10:41:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:49 smithi107 ceph-mon[127953]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:41:51.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:50 smithi107 ceph-mon[127953]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:41:51.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:50 smithi107 ceph-mon[127953]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:51.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:50 smithi107 ceph-mon[127953]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:41:51.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:51.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:51.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:51.430 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.429+0000 7f1c56c86700 1 -- 172.21.15.195:0/2435700670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 msgr2=0x7f1c50100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:51.431 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.429+0000 7f1c56c86700 1 --2- 172.21.15.195:0/2435700670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 0x7f1c50100850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009910 tx=0x7f1c44009c20 comp rx=0 tx=0).stop 2023-08-10T10:41:51.431 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.429+0000 7f1c56c86700 1 -- 172.21.15.195:0/2435700670 shutdown_connections 2023-08-10T10:41:51.431 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.429+0000 7f1c56c86700 1 --2- 172.21.15.195:0/2435700670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 0x7f1c50100850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:51.431 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.429+0000 7f1c56c86700 1 -- 172.21.15.195:0/2435700670 >> 172.21.15.195:0/2435700670 conn(0x7f1c500fbd60 msgr2=0x7f1c500fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:51.431 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.430+0000 7f1c56c86700 1 -- 172.21.15.195:0/2435700670 shutdown_connections 2023-08-10T10:41:51.432 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.430+0000 7f1c56c86700 1 -- 172.21.15.195:0/2435700670 wait complete. 2023-08-10T10:41:51.432 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.431+0000 7f1c56c86700 1 Processor -- start 2023-08-10T10:41:51.433 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.431+0000 7f1c56c86700 1 -- start start 2023-08-10T10:41:51.433 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.431+0000 7f1c56c86700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 0x7f1c50195640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:51.433 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.431+0000 7f1c56c86700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50195b80 con 0x7f1c50100470 2023-08-10T10:41:51.433 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.432+0000 7f1c54a22700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 0x7f1c50195640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:51.433 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.432+0000 7f1c54a22700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 0x7f1c50195640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.195:45548/0 (socket says 172.21.15.195:45548) 2023-08-10T10:41:51.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.432+0000 7f1c54a22700 1 -- 172.21.15.195:0/2082962683 learned_addr learned my addr 172.21.15.195:0/2082962683 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:41:51.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.432+0000 7f1c54a22700 1 -- 172.21.15.195:0/2082962683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c440095f0 con 0x7f1c50100470 2023-08-10T10:41:51.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.432+0000 7f1c54a22700 1 --2- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 0x7f1c50195640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1c44004f40 tx=0x7f1c44005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:51.436 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.432+0000 7f1c4dffb700 1 -- 172.21.15.195:0/2082962683 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c4401d070 con 0x7f1c50100470 2023-08-10T10:41:51.436 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.433+0000 7f1c4dffb700 1 -- 172.21.15.195:0/2082962683 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c440044b0 con 0x7f1c50100470 2023-08-10T10:41:51.436 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.433+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c50195d80 con 0x7f1c50100470 2023-08-10T10:41:51.436 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.433+0000 7f1c4dffb700 1 -- 172.21.15.195:0/2082962683 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c44003860 con 0x7f1c50100470 2023-08-10T10:41:51.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.433+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c50196140 con 0x7f1c50100470 2023-08-10T10:41:51.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.434+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50061da0 con 0x7f1c50100470 2023-08-10T10:41:51.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.434+0000 7f1c4dffb700 1 -- 172.21.15.195:0/2082962683 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f1c4400b960 con 0x7f1c50100470 2023-08-10T10:41:51.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.434+0000 7f1c4dffb700 1 --2- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1c40038800 0x7f1c4003acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:51.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.434+0000 7f1c4dffb700 1 -- 172.21.15.195:0/2082962683 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1c4404c6c0 con 0x7f1c50100470 2023-08-10T10:41:51.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.435+0000 7f1c4ffff700 1 --2- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1c40038800 0x7f1c4003acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:51.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.435+0000 7f1c4ffff700 1 --2- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1c40038800 0x7f1c4003acc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006fd0 tx=0x7f1c3c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:51.441 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.440+0000 7f1c4dffb700 1 -- 172.21.15.195:0/2082962683 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1c4402a540 con 0x7f1c50100470 2023-08-10T10:41:51.643 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.642+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi107:172.21.15.107=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c50108330 con 0x7f1c40038800 2023-08-10T10:41:51.650 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.650+0000 7f1c4dffb700 1 -- 172.21.15.195:0/2082962683 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1c50108330 con 0x7f1c40038800 2023-08-10T10:41:51.651 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mon update... 2023-08-10T10:41:51.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1c40038800 msgr2=0x7f1c4003acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:51.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 --2- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1c40038800 0x7f1c4003acc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006fd0 tx=0x7f1c3c006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:51.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 msgr2=0x7f1c50195640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:51.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 --2- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 0x7f1c50195640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1c44004f40 tx=0x7f1c44005020 comp rx=0 tx=0).stop 2023-08-10T10:41:51.654 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 shutdown_connections 2023-08-10T10:41:51.654 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 --2- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1c40038800 0x7f1c4003acc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:51.654 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 --2- 172.21.15.195:0/2082962683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c50100470 0x7f1c50195640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:51.654 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 >> 172.21.15.195:0/2082962683 conn(0x7f1c500fbd60 msgr2=0x7f1c50104740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:51.654 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 shutdown_connections 2023-08-10T10:41:51.654 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:51.652+0000 7f1c56c86700 1 -- 172.21.15.195:0/2082962683 wait complete. 2023-08-10T10:41:52.119 DEBUG:teuthology.orchestra.run.smithi157:mon.b> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.b.service 2023-08-10T10:41:52.124 DEBUG:teuthology.orchestra.run.smithi195:mon.c> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.c.service 2023-08-10T10:41:52.129 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-08-10T10:41:52.129 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph mon dump -f json 2023-08-10T10:41:52.200 INFO:journalctl@ceph.mon.c.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:41:52.201 INFO:journalctl@ceph.mon.b.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:41:53.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:53.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi107:172.21.15.107=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:41:53.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: Saving service mon spec with placement smithi107:172.21.15.107=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c;count:3 2023-08-10T10:41:53.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:53.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:53.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:41:53.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:41:53.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:53.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:41:53.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:41:53.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:52 smithi107 ceph-mon[127953]: Deploying daemon mon.c on smithi195 2023-08-10T10:41:53.288 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:41:54.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:54 smithi107 ceph-mon[127953]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:55.337 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.334+0000 7f4569520700 1 -- 172.21.15.195:0/3288975815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 msgr2=0x7f4564100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:55.338 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.334+0000 7f4569520700 1 --2- 172.21.15.195:0/3288975815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 0x7f4564100850 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4554009910 tx=0x7f4554009c20 comp rx=0 tx=0).stop 2023-08-10T10:41:55.338 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.334+0000 7f4569520700 1 -- 172.21.15.195:0/3288975815 shutdown_connections 2023-08-10T10:41:55.339 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.334+0000 7f4569520700 1 --2- 172.21.15.195:0/3288975815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 0x7f4564100850 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:55.339 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.334+0000 7f4569520700 1 -- 172.21.15.195:0/3288975815 >> 172.21.15.195:0/3288975815 conn(0x7f45640fbd60 msgr2=0x7f45640fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:55.339 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.334+0000 7f4569520700 1 -- 172.21.15.195:0/3288975815 shutdown_connections 2023-08-10T10:41:55.340 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.334+0000 7f4569520700 1 -- 172.21.15.195:0/3288975815 wait complete. 2023-08-10T10:41:55.340 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.335+0000 7f4569520700 1 Processor -- start 2023-08-10T10:41:55.340 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.336+0000 7f4569520700 1 -- start start 2023-08-10T10:41:55.340 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.336+0000 7f4569520700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 0x7f456419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:55.340 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.336+0000 7f4569520700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456419db80 con 0x7f4564100470 2023-08-10T10:41:55.341 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.336+0000 7f4562ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 0x7f456419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:55.341 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.336+0000 7f4562ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 0x7f456419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.195:54350/0 (socket says 172.21.15.195:54350) 2023-08-10T10:41:55.341 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.337+0000 7f4562ffd700 1 -- 172.21.15.195:0/4023388684 learned_addr learned my addr 172.21.15.195:0/4023388684 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:41:55.342 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.337+0000 7f4562ffd700 1 -- 172.21.15.195:0/4023388684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45540095f0 con 0x7f4564100470 2023-08-10T10:41:55.343 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.337+0000 7f4562ffd700 1 --2- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 0x7f456419d640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4554006010 tx=0x7f4554004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:55.344 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.337+0000 7f4560ff9700 1 -- 172.21.15.195:0/4023388684 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f455401d070 con 0x7f4564100470 2023-08-10T10:41:55.344 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.337+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456419dd80 con 0x7f4564100470 2023-08-10T10:41:55.344 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.337+0000 7f4560ff9700 1 -- 172.21.15.195:0/4023388684 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f455400bdf0 con 0x7f4564100470 2023-08-10T10:41:55.344 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.337+0000 7f4560ff9700 1 -- 172.21.15.195:0/4023388684 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4554022d80 con 0x7f4564100470 2023-08-10T10:41:55.344 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.338+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456419e1a0 con 0x7f4564100470 2023-08-10T10:41:55.344 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.339+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4564061da0 con 0x7f4564100470 2023-08-10T10:41:55.345 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.339+0000 7f4560ff9700 1 -- 172.21.15.195:0/4023388684 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f4554022570 con 0x7f4564100470 2023-08-10T10:41:55.345 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.339+0000 7f4560ff9700 1 --2- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f45500387b0 0x7f455003ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:41:55.345 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.339+0000 7f4560ff9700 1 -- 172.21.15.195:0/4023388684 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f455404c960 con 0x7f4564100470 2023-08-10T10:41:55.345 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.339+0000 7f455bfff700 1 --2- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f45500387b0 0x7f455003ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:41:55.345 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.340+0000 7f455bfff700 1 --2- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f45500387b0 0x7f455003ac70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f454c006fd0 tx=0x7f454c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:41:55.345 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.345+0000 7f4560ff9700 1 -- 172.21.15.195:0/4023388684 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f455402bba0 con 0x7f4564100470 2023-08-10T10:41:55.649 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.648+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4564197830 con 0x7f4564100470 2023-08-10T10:41:55.650 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.649+0000 7f4560ff9700 1 -- 172.21.15.195:0/4023388684 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f4554027030 con 0x7f4564100470 2023-08-10T10:41:55.650 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:41:55.650 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","modified":"2023-08-10T10:40:08.207630Z","created":"2023-08-10T10:40:08.207630Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-08-10T10:41:55.652 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f45500387b0 msgr2=0x7f455003ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:55.652 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 --2- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f45500387b0 0x7f455003ac70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f454c006fd0 tx=0x7f454c006e40 comp rx=0 tx=0).stop 2023-08-10T10:41:55.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 msgr2=0x7f456419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:41:55.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 --2- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 0x7f456419d640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4554006010 tx=0x7f4554004ff0 comp rx=0 tx=0).stop 2023-08-10T10:41:55.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 shutdown_connections 2023-08-10T10:41:55.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 --2- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f45500387b0 0x7f455003ac70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:55.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 --2- 172.21.15.195:0/4023388684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4564100470 0x7f456419d640 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:41:55.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 >> 172.21.15.195:0/4023388684 conn(0x7f45640fbd60 msgr2=0x7f4564103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:41:55.654 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 shutdown_connections 2023-08-10T10:41:55.654 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:41:55.652+0000 7f4569520700 1 -- 172.21.15.195:0/4023388684 wait complete. 2023-08-10T10:41:55.654 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2023-08-10T10:41:56.777 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 podman[129898]: 2023-08-10T10:41:56.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:56 smithi107 ceph-mon[127953]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:56.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:41:56 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/4023388684' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T10:41:57.160 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-08-10T10:41:57.161 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph mon dump -f json 2023-08-10T10:41:57.168 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 bash[129898]: 5acaaa59cee8b0b197137e306771a4ba4b3820d804e61cdcb7140dfc7356e1f6 2023-08-10T10:41:57.168 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: set uid:gid to 167:167 (ceph:ceph) 2023-08-10T10:41:57.168 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev), process ceph-mon, pid 7 2023-08-10T10:41:57.168 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pidfile_write: ignore empty --pid-file 2023-08-10T10:41:57.169 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: load: jerasure load: lrc 2023-08-10T10:41:57.169 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: RocksDB version: 7.9.2 2023-08-10T10:41:57.169 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Git sha 0 2023-08-10T10:41:57.169 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Compile date 2023-08-03 13:43:35 2023-08-10T10:41:57.169 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: DB SUMMARY 2023-08-10T10:41:57.169 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: DB Session ID: 7WUZ377XDWWJ9MX01E6F 2023-08-10T10:41:57.169 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: CURRENT file: CURRENT 2023-08-10T10:41:57.169 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: IDENTITY file: IDENTITY 2023-08-10T10:41:57.170 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-08-10T10:41:57.170 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-08-10T10:41:57.170 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-08-10T10:41:57.170 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.error_if_exists: 0 2023-08-10T10:41:57.170 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.create_if_missing: 0 2023-08-10T10:41:57.170 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.paranoid_checks: 1 2023-08-10T10:41:57.170 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.flush_verify_memtable_count: 1 2023-08-10T10:41:57.171 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-08-10T10:41:57.171 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-08-10T10:41:57.171 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.env: 0x55c407150c60 2023-08-10T10:41:57.171 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.fs: PosixFileSystem 2023-08-10T10:41:57.171 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.info_log: 0x55c4097e72c0 2023-08-10T10:41:57.171 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_file_opening_threads: 16 2023-08-10T10:41:57.171 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.statistics: (nil) 2023-08-10T10:41:57.171 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.use_fsync: 0 2023-08-10T10:41:57.172 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_log_file_size: 0 2023-08-10T10:41:57.172 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-08-10T10:41:57.172 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.log_file_time_to_roll: 0 2023-08-10T10:41:57.172 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.keep_log_file_num: 1000 2023-08-10T10:41:57.172 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.recycle_log_file_num: 0 2023-08-10T10:41:57.172 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.allow_fallocate: 1 2023-08-10T10:41:57.172 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.allow_mmap_reads: 0 2023-08-10T10:41:57.173 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.allow_mmap_writes: 0 2023-08-10T10:41:57.173 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.use_direct_reads: 0 2023-08-10T10:41:57.173 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-08-10T10:41:57.173 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.create_missing_column_families: 0 2023-08-10T10:41:57.173 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.db_log_dir: 2023-08-10T10:41:57.173 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.wal_dir: 2023-08-10T10:41:57.174 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.table_cache_numshardbits: 6 2023-08-10T10:41:57.174 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.WAL_ttl_seconds: 0 2023-08-10T10:41:57.174 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.WAL_size_limit_MB: 0 2023-08-10T10:41:57.174 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-08-10T10:41:57.174 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-08-10T10:41:57.174 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.is_fd_close_on_exec: 1 2023-08-10T10:41:57.174 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.advise_random_on_open: 1 2023-08-10T10:41:57.174 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.db_write_buffer_size: 0 2023-08-10T10:41:57.175 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.write_buffer_manager: 0x55c4097083c0 2023-08-10T10:41:57.175 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-08-10T10:41:57.175 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-08-10T10:41:57.175 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.use_adaptive_mutex: 0 2023-08-10T10:41:57.175 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.rate_limiter: (nil) 2023-08-10T10:41:57.175 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-08-10T10:41:57.175 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.wal_recovery_mode: 2 2023-08-10T10:41:57.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.enable_thread_tracking: 0 2023-08-10T10:41:57.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.enable_pipelined_write: 0 2023-08-10T10:41:57.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.unordered_write: 0 2023-08-10T10:41:57.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-08-10T10:41:57.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-08-10T10:41:57.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-08-10T10:41:57.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-08-10T10:41:57.176 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.row_cache: None 2023-08-10T10:41:57.177 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.wal_filter: None 2023-08-10T10:41:57.177 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-08-10T10:41:57.177 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.allow_ingest_behind: 0 2023-08-10T10:41:57.177 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.two_write_queues: 0 2023-08-10T10:41:57.177 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.manual_wal_flush: 0 2023-08-10T10:41:57.177 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.wal_compression: 0 2023-08-10T10:41:57.177 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.atomic_flush: 0 2023-08-10T10:41:57.177 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-08-10T10:41:57.178 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.persist_stats_to_disk: 0 2023-08-10T10:41:57.178 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.write_dbid_to_manifest: 0 2023-08-10T10:41:57.178 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.log_readahead_size: 0 2023-08-10T10:41:57.178 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-08-10T10:41:57.178 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.best_efforts_recovery: 0 2023-08-10T10:41:57.178 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-08-10T10:41:57.178 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-08-10T10:41:57.178 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.allow_data_in_errors: 0 2023-08-10T10:41:57.179 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.db_host_id: __hostname__ 2023-08-10T10:41:57.179 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.enforce_single_del_contracts: true 2023-08-10T10:41:57.179 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_background_jobs: 2 2023-08-10T10:41:57.179 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_background_compactions: -1 2023-08-10T10:41:57.179 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_subcompactions: 1 2023-08-10T10:41:57.179 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-08-10T10:41:57.179 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-08-10T10:41:57.180 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.delayed_write_rate : 16777216 2023-08-10T10:41:57.180 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_total_wal_size: 0 2023-08-10T10:41:57.180 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-08-10T10:41:57.180 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.stats_dump_period_sec: 600 2023-08-10T10:41:57.180 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.stats_persist_period_sec: 600 2023-08-10T10:41:57.181 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-08-10T10:41:57.181 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_open_files: -1 2023-08-10T10:41:57.181 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bytes_per_sync: 0 2023-08-10T10:41:57.181 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.wal_bytes_per_sync: 0 2023-08-10T10:41:57.181 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.strict_bytes_per_sync: 0 2023-08-10T10:41:57.181 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_readahead_size: 0 2023-08-10T10:41:57.182 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_background_flushes: -1 2023-08-10T10:41:57.182 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Compression algorithms supported: 2023-08-10T10:41:57.182 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-08-10T10:41:57.182 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: kZSTD supported: 0 2023-08-10T10:41:57.182 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: kXpressCompression supported: 0 2023-08-10T10:41:57.182 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: kLZ4HCCompression supported: 1 2023-08-10T10:41:57.182 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: kZlibCompression supported: 1 2023-08-10T10:41:57.182 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: kSnappyCompression supported: 1 2023-08-10T10:41:57.183 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: kLZ4Compression supported: 1 2023-08-10T10:41:57.183 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: kBZip2Compression supported: 0 2023-08-10T10:41:57.183 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Fast CRC32 supported: Supported on x86 2023-08-10T10:41:57.183 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: DMutex implementation: pthread_mutex_t 2023-08-10T10:41:57.183 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-08-10T10:41:57.183 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-08-10T10:41:57.183 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-08-10T10:41:57.183 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.merge_operator: 2023-08-10T10:41:57.184 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_filter: None 2023-08-10T10:41:57.184 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_filter_factory: None 2023-08-10T10:41:57.184 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.sst_partitioner_factory: None 2023-08-10T10:41:57.184 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.memtable_factory: SkipListFactory 2023-08-10T10:41:57.184 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.table_factory: BlockBasedTable 2023-08-10T10:41:57.184 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c4097e73c0) 2023-08-10T10:41:57.184 INFO:journalctl@ceph.mon.c.smithi195.stdout: cache_index_and_filter_blocks: 1 2023-08-10T10:41:57.185 INFO:journalctl@ceph.mon.c.smithi195.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-08-10T10:41:57.185 INFO:journalctl@ceph.mon.c.smithi195.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-08-10T10:41:57.185 INFO:journalctl@ceph.mon.c.smithi195.stdout: pin_top_level_index_and_filter: 1 2023-08-10T10:41:57.185 INFO:journalctl@ceph.mon.c.smithi195.stdout: index_type: 0 2023-08-10T10:41:57.185 INFO:journalctl@ceph.mon.c.smithi195.stdout: data_block_index_type: 0 2023-08-10T10:41:57.185 INFO:journalctl@ceph.mon.c.smithi195.stdout: index_shortening: 1 2023-08-10T10:41:57.185 INFO:journalctl@ceph.mon.c.smithi195.stdout: data_block_hash_table_util_ratio: 0.750000 2023-08-10T10:41:57.185 INFO:journalctl@ceph.mon.c.smithi195.stdout: checksum: 4 2023-08-10T10:41:57.186 INFO:journalctl@ceph.mon.c.smithi195.stdout: no_block_cache: 0 2023-08-10T10:41:57.186 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache: 0x55c4097a71f0 2023-08-10T10:41:57.186 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache_name: BinnedLRUCache 2023-08-10T10:41:57.186 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache_options: 2023-08-10T10:41:57.186 INFO:journalctl@ceph.mon.c.smithi195.stdout: capacity : 536870912 2023-08-10T10:41:57.186 INFO:journalctl@ceph.mon.c.smithi195.stdout: num_shard_bits : 4 2023-08-10T10:41:57.186 INFO:journalctl@ceph.mon.c.smithi195.stdout: strict_capacity_limit : 0 2023-08-10T10:41:57.186 INFO:journalctl@ceph.mon.c.smithi195.stdout: high_pri_pool_ratio: 0.000 2023-08-10T10:41:57.187 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache_compressed: (nil) 2023-08-10T10:41:57.187 INFO:journalctl@ceph.mon.c.smithi195.stdout: persistent_cache: (nil) 2023-08-10T10:41:57.187 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_size: 4096 2023-08-10T10:41:57.187 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_size_deviation: 10 2023-08-10T10:41:57.187 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_restart_interval: 16 2023-08-10T10:41:57.187 INFO:journalctl@ceph.mon.c.smithi195.stdout: index_block_restart_interval: 1 2023-08-10T10:41:57.187 INFO:journalctl@ceph.mon.c.smithi195.stdout: metadata_block_size: 4096 2023-08-10T10:41:57.187 INFO:journalctl@ceph.mon.c.smithi195.stdout: partition_filters: 0 2023-08-10T10:41:57.188 INFO:journalctl@ceph.mon.c.smithi195.stdout: use_delta_encoding: 1 2023-08-10T10:41:57.188 INFO:journalctl@ceph.mon.c.smithi195.stdout: filter_policy: bloomfilter 2023-08-10T10:41:57.188 INFO:journalctl@ceph.mon.c.smithi195.stdout: whole_key_filtering: 1 2023-08-10T10:41:57.188 INFO:journalctl@ceph.mon.c.smithi195.stdout: verify_compression: 0 2023-08-10T10:41:57.188 INFO:journalctl@ceph.mon.c.smithi195.stdout: read_amp_bytes_per_bit: 0 2023-08-10T10:41:57.188 INFO:journalctl@ceph.mon.c.smithi195.stdout: format_version: 5 2023-08-10T10:41:57.188 INFO:journalctl@ceph.mon.c.smithi195.stdout: enable_index_compression: 1 2023-08-10T10:41:57.189 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_align: 0 2023-08-10T10:41:57.189 INFO:journalctl@ceph.mon.c.smithi195.stdout: max_auto_readahead_size: 262144 2023-08-10T10:41:57.189 INFO:journalctl@ceph.mon.c.smithi195.stdout: prepopulate_block_cache: 0 2023-08-10T10:41:57.189 INFO:journalctl@ceph.mon.c.smithi195.stdout: initial_auto_readahead_size: 8192 2023-08-10T10:41:57.189 INFO:journalctl@ceph.mon.c.smithi195.stdout: num_file_reads_for_auto_readahead: 2 2023-08-10T10:41:57.189 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.write_buffer_size: 33554432 2023-08-10T10:41:57.189 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_write_buffer_number: 2 2023-08-10T10:41:57.190 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression: NoCompression 2023-08-10T10:41:57.190 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression: Disabled 2023-08-10T10:41:57.190 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.prefix_extractor: nullptr 2023-08-10T10:41:57.190 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-08-10T10:41:57.190 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.num_levels: 7 2023-08-10T10:41:57.190 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-08-10T10:41:57.190 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-08-10T10:41:57.190 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-08-10T10:41:57.191 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-08-10T10:41:57.191 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-08-10T10:41:57.191 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-08-10T10:41:57.191 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-08-10T10:41:57.191 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-08-10T10:41:57.191 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-08-10T10:41:57.192 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-08-10T10:41:57.192 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-08-10T10:41:57.192 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-08-10T10:41:57.192 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression_opts.window_bits: -14 2023-08-10T10:41:57.192 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression_opts.level: 32767 2023-08-10T10:41:57.192 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression_opts.strategy: 0 2023-08-10T10:41:57.192 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-08-10T10:41:57.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-08-10T10:41:57.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-08-10T10:41:57.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-08-10T10:41:57.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression_opts.enabled: false 2023-08-10T10:41:57.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-08-10T10:41:57.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-08-10T10:41:57.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-08-10T10:41:57.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-08-10T10:41:57.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.target_file_size_base: 67108864 2023-08-10T10:41:57.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.target_file_size_multiplier: 1 2023-08-10T10:41:57.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-08-10T10:41:57.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-08-10T10:41:57.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-08-10T10:41:57.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-08-10T10:41:57.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-08-10T10:41:57.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-08-10T10:41:57.195 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-08-10T10:41:57.195 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-08-10T10:41:57.195 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-08-10T10:41:57.195 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-08-10T10:41:57.195 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-08-10T10:41:57.195 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-08-10T10:41:57.195 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-08-10T10:41:57.195 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.arena_block_size: 1048576 2023-08-10T10:41:57.196 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-08-10T10:41:57.196 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-08-10T10:41:57.196 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.disable_auto_compactions: 0 2023-08-10T10:41:57.196 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-08-10T10:41:57.196 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-08-10T10:41:57.196 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-08-10T10:41:57.197 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-08-10T10:41:57.197 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-08-10T10:41:57.197 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-08-10T10:41:57.197 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-08-10T10:41:57.197 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-08-10T10:41:57.197 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-08-10T10:41:57.197 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-08-10T10:41:57.198 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.table_properties_collectors: 2023-08-10T10:41:57.198 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.inplace_update_support: 0 2023-08-10T10:41:57.198 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.inplace_update_num_locks: 10000 2023-08-10T10:41:57.198 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-08-10T10:41:57.198 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-08-10T10:41:57.198 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.memtable_huge_page_size: 0 2023-08-10T10:41:57.198 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.bloom_locality: 0 2023-08-10T10:41:57.198 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.max_successive_merges: 0 2023-08-10T10:41:57.199 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.optimize_filters_for_hits: 0 2023-08-10T10:41:57.199 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.paranoid_file_checks: 0 2023-08-10T10:41:57.199 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.force_consistency_checks: 1 2023-08-10T10:41:57.199 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.report_bg_io_stats: 0 2023-08-10T10:41:57.199 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.ttl: 2592000 2023-08-10T10:41:57.199 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.periodic_compaction_seconds: 0 2023-08-10T10:41:57.199 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-08-10T10:41:57.199 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-08-10T10:41:57.200 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.enable_blob_files: false 2023-08-10T10:41:57.200 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.min_blob_size: 0 2023-08-10T10:41:57.200 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.blob_file_size: 268435456 2023-08-10T10:41:57.200 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.blob_compression_type: NoCompression 2023-08-10T10:41:57.200 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.enable_blob_garbage_collection: false 2023-08-10T10:41:57.200 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-08-10T10:41:57.200 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-08-10T10:41:57.201 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-08-10T10:41:57.201 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.blob_file_starting_level: 0 2023-08-10T10:41:57.201 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-08-10T10:41:57.201 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-08-10T10:41:57.201 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-08-10T10:41:57.201 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d615643f-f27c-4a40-a7bb-b990d835fefb 2023-08-10T10:41:57.201 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691664116797405, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-08-10T10:41:57.201 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-08-10T10:41:57.202 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691664116799130, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1691664116, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d615643f-f27c-4a40-a7bb-b990d835fefb", "db_session_id": "7WUZ377XDWWJ9MX01E6F", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-08-10T10:41:57.202 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691664116799419, "job": 1, "event": "recovery_finished"} 2023-08-10T10:41:57.202 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-08-10T10:41:57.202 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 systemd[1]: Started Ceph mon.c for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:41:57.202 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-08-10T10:41:57.202 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c409842000 2023-08-10T10:41:57.202 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: DB pointer 0x55c40982e000 2023-08-10T10:41:57.203 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-08-10T10:41:57.203 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-08-10T10:41:57.203 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** DB Stats ** 2023-08-10T10:41:57.203 INFO:journalctl@ceph.mon.c.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T10:41:57.203 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-08-10T10:41:57.203 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T10:41:57.203 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T10:41:57.203 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-08-10T10:41:57.204 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T10:41:57.204 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T10:41:57.204 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-08-10T10:41:57.204 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** Compaction Stats [default] ** 2023-08-10T10:41:57.204 INFO:journalctl@ceph.mon.c.smithi195.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T10:41:57.204 INFO:journalctl@ceph.mon.c.smithi195.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-08-10T10:41:57.204 INFO:journalctl@ceph.mon.c.smithi195.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-08-10T10:41:57.205 INFO:journalctl@ceph.mon.c.smithi195.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-08-10T10:41:57.205 INFO:journalctl@ceph.mon.c.smithi195.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-08-10T10:41:57.205 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-08-10T10:41:57.205 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** Compaction Stats [default] ** 2023-08-10T10:41:57.205 INFO:journalctl@ceph.mon.c.smithi195.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T10:41:57.205 INFO:journalctl@ceph.mon.c.smithi195.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-08-10T10:41:57.206 INFO:journalctl@ceph.mon.c.smithi195.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-08-10T10:41:57.206 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-08-10T10:41:57.206 INFO:journalctl@ceph.mon.c.smithi195.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-08-10T10:41:57.206 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-08-10T10:41:57.206 INFO:journalctl@ceph.mon.c.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T10:41:57.206 INFO:journalctl@ceph.mon.c.smithi195.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-08-10T10:41:57.206 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-08-10T10:41:57.206 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-08-10T10:41:57.207 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-08-10T10:41:57.207 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(Keys): cumulative 0, interval 0 2023-08-10T10:41:57.207 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative compaction: 0.00 GB write, 0.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T10:41:57.207 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval compaction: 0.00 GB write, 0.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T10:41:57.207 INFO:journalctl@ceph.mon.c.smithi195.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-08-10T10:41:57.207 INFO:journalctl@ceph.mon.c.smithi195.stdout: Block cache BinnedLRUCache@0x55c4097a71f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-08-10T10:41:57.207 INFO:journalctl@ceph.mon.c.smithi195.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-08-10T10:41:57.207 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-08-10T10:41:57.208 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** File Read Latency Histogram By Level [default] ** 2023-08-10T10:41:57.208 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-08-10T10:41:57.208 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: using public_addr v2:172.21.15.195:0/0 -> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2023-08-10T10:41:57.208 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: starting mon.c rank -1 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:41:57.208 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(???) e0 preinit fsid 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:41:57.208 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).mds e1 new map 2023-08-10T10:41:57.208 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).mds e1 print_map 2023-08-10T10:41:57.209 INFO:journalctl@ceph.mon.c.smithi195.stdout: e1 2023-08-10T10:41:57.209 INFO:journalctl@ceph.mon.c.smithi195.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-08-10T10:41:57.209 INFO:journalctl@ceph.mon.c.smithi195.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-08-10T10:41:57.209 INFO:journalctl@ceph.mon.c.smithi195.stdout: legacy client fscid: -1 2023-08-10T10:41:57.209 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-08-10T10:41:57.210 INFO:journalctl@ceph.mon.c.smithi195.stdout: No filesystems configured 2023-08-10T10:41:57.210 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-08-10T10:41:57.210 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-08-10T10:41:57.210 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-08-10T10:41:57.210 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-08-10T10:41:57.210 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-08-10T10:41:57.210 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-08-10T10:41:57.210 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-08-10T10:41:57.211 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T10:41:57.211 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T10:41:57.211 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T10:41:57.211 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.211 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.211 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.211 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.212 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:41:57.212 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.212 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:41:57.212 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.212 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.212 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.212 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.212 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:41:57.213 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:41:57.213 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:41:57.213 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Updating smithi157:/etc/ceph/ceph.conf 2023-08-10T10:41:57.213 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Deploying cephadm binary to smithi195 2023-08-10T10:41:57.213 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:41:57.213 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.213 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:41:57.213 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:41:57.214 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.214 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.214 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.214 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.214 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.214 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Added host smithi195 2023-08-10T10:41:57.214 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:57.215 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.215 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.215 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.215 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.215 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:41:57.215 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.215 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.215 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1982629403' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-08-10T10:41:57.216 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.216 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.216 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.216 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.216 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:41:57.216 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:41:57.216 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:41:57.216 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Updating smithi195:/etc/ceph/ceph.conf 2023-08-10T10:41:57.217 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:41:57.217 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1982629403' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-08-10T10:41:57.217 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:41:57.217 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:41:57.217 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.217 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:41:57.217 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.218 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.218 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.218 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.218 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi107:172.21.15.107=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:41:57.218 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Saving service mon spec with placement smithi107:172.21.15.107=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c;count:3 2023-08-10T10:41:57.218 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.218 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:41:57.218 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:41:57.219 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:41:57.219 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:41:57.219 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:41:57.219 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:41:57.219 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: Deploying daemon mon.c on smithi195 2023-08-10T10:41:57.219 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.219 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:41:57.219 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/4023388684' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T10:41:57.220 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-08-10T10:41:57.220 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-08-10T10:41:57.220 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta expand map: {default=false} 2023-08-10T10:41:57.220 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta from 'false' to 'false' 2023-08-10T10:41:57.220 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta expanded map: {default=false} 2023-08-10T10:41:57.220 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta expand map: {default=info} 2023-08-10T10:41:57.220 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta from 'info' to 'info' 2023-08-10T10:41:57.221 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta expanded map: {default=info} 2023-08-10T10:41:57.221 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta expand map: {default=daemon} 2023-08-10T10:41:57.221 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta from 'daemon' to 'daemon' 2023-08-10T10:41:57.221 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta expanded map: {default=daemon} 2023-08-10T10:41:57.221 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta expand map: {default=debug} 2023-08-10T10:41:57.221 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta from 'debug' to 'debug' 2023-08-10T10:41:57.221 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:41:56 smithi195 ceph-mon[129938]: expand_channel_meta expanded map: {default=debug} 2023-08-10T10:41:57.881 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:42:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:42:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: mon.a calling monitor election 2023-08-10T10:42:02.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:02.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: mon.c calling monitor election 2023-08-10T10:42:02.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:02.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T10:42:02.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: monmap e2: 2 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-08-10T10:42:02.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: fsmap 2023-08-10T10:42:02.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:02.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: mgrmap e13: x(active, since 50s) 2023-08-10T10:42:02.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: overall HEALTH_OK 2023-08-10T10:42:02.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:02.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:02.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:02.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:02.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:42:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: mon.a calling monitor election 2023-08-10T10:42:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:02.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: mon.c calling monitor election 2023-08-10T10:42:02.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:02.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:02.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T10:42:02.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: monmap e2: 2 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-08-10T10:42:02.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: fsmap 2023-08-10T10:42:02.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:02.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: mgrmap e13: x(active, since 50s) 2023-08-10T10:42:02.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: overall HEALTH_OK 2023-08-10T10:42:02.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:02.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:02.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:02.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:02.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:02.380 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.378+0000 7fd7aa97c700 1 -- 172.21.15.195:0/3545797893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 msgr2=0x7fd78c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:02.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.378+0000 7fd7aa97c700 1 --2- 172.21.15.195:0/3545797893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 0x7fd78c005a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4100240 tx=0x7fd79400feb0 comp rx=0 tx=0).stop 2023-08-10T10:42:02.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.378+0000 7fd7aa97c700 1 -- 172.21.15.195:0/3545797893 shutdown_connections 2023-08-10T10:42:02.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.378+0000 7fd7aa97c700 1 --2- 172.21.15.195:0/3545797893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 0x7fd78c005a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:02.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.378+0000 7fd7aa97c700 1 -- 172.21.15.195:0/3545797893 >> 172.21.15.195:0/3545797893 conn(0x7fd7a40fbde0 msgr2=0x7fd7a40fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:02.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.379+0000 7fd7aa97c700 1 -- 172.21.15.195:0/3545797893 shutdown_connections 2023-08-10T10:42:02.382 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.379+0000 7fd7aa97c700 1 -- 172.21.15.195:0/3545797893 wait complete. 2023-08-10T10:42:02.382 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.380+0000 7fd7aa97c700 1 Processor -- start 2023-08-10T10:42:02.383 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.380+0000 7fd7aa97c700 1 -- start start 2023-08-10T10:42:02.383 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7aa97c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 0x7fd7a419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:02.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7aa97c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a419dd50 0x7fd7a4197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:02.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7aa97c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a419e290 con 0x7fd78c0035c0 2023-08-10T10:42:02.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7aa97c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a419e400 con 0x7fd7a419dd50 2023-08-10T10:42:02.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7a3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 0x7fd7a419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:02.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7a3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 0x7fd7a419d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.195:54434/0 (socket says 172.21.15.195:54434) 2023-08-10T10:42:02.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7a3fff700 1 -- 172.21.15.195:0/240344201 learned_addr learned my addr 172.21.15.195:0/240344201 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:42:02.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7a37fe700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a419dd50 0x7fd7a4197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:02.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7a37fe700 1 -- 172.21.15.195:0/240344201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a419dd50 msgr2=0x7fd7a4197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-08-10T10:42:02.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7a37fe700 1 -- 172.21.15.195:0/240344201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a419dd50 msgr2=0x7fd7a4197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-08-10T10:42:02.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.381+0000 7fd7a37fe700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a419dd50 0x7fd7a4197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T10:42:02.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.382+0000 7fd7a37fe700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a419dd50 0x7fd7a4197890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:42:02.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.382+0000 7fd7a3fff700 1 -- 172.21.15.195:0/240344201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a419dd50 msgr2=0x7fd7a4197890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:42:02.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.382+0000 7fd7a3fff700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a419dd50 0x7fd7a4197890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:02.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.382+0000 7fd7a3fff700 1 -- 172.21.15.195:0/240344201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79400f900 con 0x7fd78c0035c0 2023-08-10T10:42:02.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.382+0000 7fd7a3fff700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 0x7fd7a419d810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd794010010 tx=0x7fd7940049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:02.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.382+0000 7fd7a17fa700 1 -- 172.21.15.195:0/240344201 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fd794013b70 con 0x7fd78c0035c0 2023-08-10T10:42:02.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.383+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a4197e90 con 0x7fd78c0035c0 2023-08-10T10:42:02.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.383+0000 7fd7a17fa700 1 -- 172.21.15.195:0/240344201 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7940044c0 con 0x7fd78c0035c0 2023-08-10T10:42:02.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.383+0000 7fd7a17fa700 1 -- 172.21.15.195:0/240344201 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fd794003d40 con 0x7fd78c0035c0 2023-08-10T10:42:02.387 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.383+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a41983e0 con 0x7fd78c0035c0 2023-08-10T10:42:02.387 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.384+0000 7fd7a17fa700 1 -- 172.21.15.195:0/240344201 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fd794004030 con 0x7fd78c0035c0 2023-08-10T10:42:02.388 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.384+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a4061da0 con 0x7fd78c0035c0 2023-08-10T10:42:02.388 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.384+0000 7fd7a17fa700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd7900385f0 0x7fd79003aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:02.388 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.384+0000 7fd7a17fa700 1 -- 172.21.15.195:0/240344201 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd79404deb0 con 0x7fd78c0035c0 2023-08-10T10:42:02.388 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.385+0000 7fd7a37fe700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd7900385f0 0x7fd79003aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:02.388 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.385+0000 7fd7a37fe700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd7900385f0 0x7fd79003aab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd798009850 tx=0x7fd798008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:02.390 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.390+0000 7fd7a17fa700 1 -- 172.21.15.195:0/240344201 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd7940349a0 con 0x7fd78c0035c0 2023-08-10T10:42:02.661 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.660+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd7a4198da0 con 0x7fd78c0035c0 2023-08-10T10:42:02.662 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.661+0000 7fd7a17fa700 1 -- 172.21.15.195:0/240344201 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1010 (secure 0 0 0) 0x7fd794013e60 con 0x7fd78c0035c0 2023-08-10T10:42:02.662 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:42:02.662 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","modified":"2023-08-10T10:41:56.844179Z","created":"2023-08-10T10:40:08.207630Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-08-10T10:42:02.664 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.663+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd7900385f0 msgr2=0x7fd79003aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:02.664 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.663+0000 7fd7aa97c700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd7900385f0 0x7fd79003aab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd798009850 tx=0x7fd798008040 comp rx=0 tx=0).stop 2023-08-10T10:42:02.665 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.663+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 msgr2=0x7fd7a419d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:02.665 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.663+0000 7fd7aa97c700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 0x7fd7a419d810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd794010010 tx=0x7fd7940049d0 comp rx=0 tx=0).stop 2023-08-10T10:42:02.665 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.663+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 shutdown_connections 2023-08-10T10:42:02.665 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.663+0000 7fd7aa97c700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd7900385f0 0x7fd79003aab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:02.665 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.663+0000 7fd7aa97c700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78c0035c0 0x7fd7a419d810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:02.665 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.663+0000 7fd7aa97c700 1 --2- 172.21.15.195:0/240344201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a419dd50 0x7fd7a4197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:02.665 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.663+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 >> 172.21.15.195:0/240344201 conn(0x7fd7a40fbde0 msgr2=0x7fd7a40fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:02.666 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.664+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 shutdown_connections 2023-08-10T10:42:02.666 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:02.664+0000 7fd7aa97c700 1 -- 172.21.15.195:0/240344201 wait complete. 2023-08-10T10:42:02.666 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2023-08-10T10:42:03.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:02 smithi195 ceph-mon[129938]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:03.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:02 smithi195 ceph-mon[129938]: Deploying daemon mon.b on smithi157 2023-08-10T10:42:03.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:02 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/240344201' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T10:42:03.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:03.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:02 smithi107 ceph-mon[127953]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:03.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:02 smithi107 ceph-mon[127953]: Deploying daemon mon.b on smithi157 2023-08-10T10:42:03.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:02 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/240344201' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T10:42:03.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:04.159 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-08-10T10:42:04.160 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph mon dump -f json 2023-08-10T10:42:04.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:04 smithi107 ceph-mon[127953]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:04.884 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:42:04.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:04 smithi195 ceph-mon[129938]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:05.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:05 smithi157 systemd[1]: Starting Ceph mon.b for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:42:06.354 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.353+0000 7f37e6473700 1 -- 172.21.15.195:0/1945086473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e0100570 msgr2=0x7f37e0100950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:06.354 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.353+0000 7f37e6473700 1 --2- 172.21.15.195:0/1945086473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e0100570 0x7f37e0100950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009910 tx=0x7f37d0009c20 comp rx=0 tx=0).stop 2023-08-10T10:42:06.354 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.353+0000 7f37e6473700 1 -- 172.21.15.195:0/1945086473 shutdown_connections 2023-08-10T10:42:06.355 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.353+0000 7f37e6473700 1 --2- 172.21.15.195:0/1945086473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e0100570 0x7f37e0100950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:06.355 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.353+0000 7f37e6473700 1 -- 172.21.15.195:0/1945086473 >> 172.21.15.195:0/1945086473 conn(0x7f37e00fbde0 msgr2=0x7f37e00fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:06.355 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.353+0000 7f37e6473700 1 -- 172.21.15.195:0/1945086473 shutdown_connections 2023-08-10T10:42:06.355 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.353+0000 7f37e6473700 1 -- 172.21.15.195:0/1945086473 wait complete. 2023-08-10T10:42:06.357 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.354+0000 7f37e6473700 1 Processor -- start 2023-08-10T10:42:06.357 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.354+0000 7f37e6473700 1 -- start start 2023-08-10T10:42:06.357 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.354+0000 7f37e6473700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 0x7f37e019d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:06.357 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.354+0000 7f37e6473700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e019dda0 0x7f37e0197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:06.357 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.354+0000 7f37e6473700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e019e2c0 con 0x7f37e019dda0 2023-08-10T10:42:06.357 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.354+0000 7f37e6473700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0197d90 con 0x7f37e0100570 2023-08-10T10:42:06.357 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37dffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 0x7f37e019d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:06.358 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37dffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 0x7f37e019d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:60196/0 (socket says 172.21.15.195:60196) 2023-08-10T10:42:06.358 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37dffff700 1 -- 172.21.15.195:0/1753865486 learned_addr learned my addr 172.21.15.195:0/1753865486 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:42:06.358 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37df7fe700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e019dda0 0x7f37e0197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:06.358 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37dffff700 1 -- 172.21.15.195:0/1753865486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 msgr2=0x7f37e019d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-08-10T10:42:06.358 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37dffff700 1 -- 172.21.15.195:0/1753865486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 msgr2=0x7f37e019d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-08-10T10:42:06.358 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37dffff700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 0x7f37e019d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T10:42:06.358 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37dffff700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 0x7f37e019d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:42:06.359 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37df7fe700 1 -- 172.21.15.195:0/1753865486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 msgr2=0x7f37e019d860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:42:06.359 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37df7fe700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 0x7f37e019d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:06.359 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.355+0000 7f37df7fe700 1 -- 172.21.15.195:0/1753865486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00095f0 con 0x7f37e019dda0 2023-08-10T10:42:06.359 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.356+0000 7f37df7fe700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e019dda0 0x7f37e0197850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f37d400b4d0 tx=0x7f37d400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:06.359 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.356+0000 7f37dd7fa700 1 -- 172.21.15.195:0/1753865486 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f37d4011630 con 0x7f37e019dda0 2023-08-10T10:42:06.359 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.356+0000 7f37dd7fa700 1 -- 172.21.15.195:0/1753865486 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37d4011c20 con 0x7f37e019dda0 2023-08-10T10:42:06.359 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.356+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e0198020 con 0x7f37e019dda0 2023-08-10T10:42:06.360 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.356+0000 7f37dd7fa700 1 -- 172.21.15.195:0/1753865486 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f37d4010c60 con 0x7f37e019dda0 2023-08-10T10:42:06.360 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.356+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e0198570 con 0x7f37e019dda0 2023-08-10T10:42:06.360 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.357+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e0061da0 con 0x7f37e019dda0 2023-08-10T10:42:06.361 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.357+0000 7f37dd7fa700 1 -- 172.21.15.195:0/1753865486 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f37d4011790 con 0x7f37e019dda0 2023-08-10T10:42:06.361 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.358+0000 7f37dd7fa700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f37c80385f0 0x7f37c803aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:06.361 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.358+0000 7f37dd7fa700 1 -- 172.21.15.195:0/1753865486 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f37d404ad70 con 0x7f37e019dda0 2023-08-10T10:42:06.361 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.358+0000 7f37dffff700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f37c80385f0 0x7f37c803aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:06.361 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.359+0000 7f37dffff700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f37c80385f0 0x7f37c803aab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f37d00092e0 tx=0x7f37d000b580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:06.364 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.363+0000 7f37dd7fa700 1 -- 172.21.15.195:0/1753865486 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f37d404f070 con 0x7f37e019dda0 2023-08-10T10:42:06.508 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 podman[129564]: 2023-08-10T10:42:06.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 bash[129564]: 00437ddcbe9fc1334c8b99e9c29bcb6360e71e9133b23ca753d03a32e12bee30 2023-08-10T10:42:06.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: set uid:gid to 167:167 (ceph:ceph) 2023-08-10T10:42:06.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev), process ceph-mon, pid 7 2023-08-10T10:42:06.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pidfile_write: ignore empty --pid-file 2023-08-10T10:42:06.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: load: jerasure load: lrc 2023-08-10T10:42:06.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: RocksDB version: 7.9.2 2023-08-10T10:42:06.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Git sha 0 2023-08-10T10:42:06.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Compile date 2023-08-03 13:43:35 2023-08-10T10:42:06.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: DB SUMMARY 2023-08-10T10:42:06.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: DB Session ID: Z1NMSAWUF5LT4QGEPS74 2023-08-10T10:42:06.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: CURRENT file: CURRENT 2023-08-10T10:42:06.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: IDENTITY file: IDENTITY 2023-08-10T10:42:06.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-08-10T10:42:06.511 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-08-10T10:42:06.511 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-08-10T10:42:06.511 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.error_if_exists: 0 2023-08-10T10:42:06.511 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.create_if_missing: 0 2023-08-10T10:42:06.511 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.paranoid_checks: 1 2023-08-10T10:42:06.511 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.flush_verify_memtable_count: 1 2023-08-10T10:42:06.511 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-08-10T10:42:06.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-08-10T10:42:06.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.env: 0x5577d8a3ec60 2023-08-10T10:42:06.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.fs: PosixFileSystem 2023-08-10T10:42:06.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.info_log: 0x5577d9cc92c0 2023-08-10T10:42:06.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_file_opening_threads: 16 2023-08-10T10:42:06.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.statistics: (nil) 2023-08-10T10:42:06.512 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.use_fsync: 0 2023-08-10T10:42:06.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_log_file_size: 0 2023-08-10T10:42:06.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-08-10T10:42:06.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.log_file_time_to_roll: 0 2023-08-10T10:42:06.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.keep_log_file_num: 1000 2023-08-10T10:42:06.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.recycle_log_file_num: 0 2023-08-10T10:42:06.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.allow_fallocate: 1 2023-08-10T10:42:06.513 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.allow_mmap_reads: 0 2023-08-10T10:42:06.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.allow_mmap_writes: 0 2023-08-10T10:42:06.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.use_direct_reads: 0 2023-08-10T10:42:06.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-08-10T10:42:06.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.create_missing_column_families: 0 2023-08-10T10:42:06.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.db_log_dir: 2023-08-10T10:42:06.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.wal_dir: 2023-08-10T10:42:06.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.table_cache_numshardbits: 6 2023-08-10T10:42:06.514 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.WAL_ttl_seconds: 0 2023-08-10T10:42:06.515 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.WAL_size_limit_MB: 0 2023-08-10T10:42:06.515 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-08-10T10:42:06.515 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-08-10T10:42:06.515 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.is_fd_close_on_exec: 1 2023-08-10T10:42:06.515 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.advise_random_on_open: 1 2023-08-10T10:42:06.515 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.db_write_buffer_size: 0 2023-08-10T10:42:06.515 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.write_buffer_manager: 0x5577d9bea3c0 2023-08-10T10:42:06.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-08-10T10:42:06.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-08-10T10:42:06.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.use_adaptive_mutex: 0 2023-08-10T10:42:06.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.rate_limiter: (nil) 2023-08-10T10:42:06.516 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-08-10T10:42:06.517 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.wal_recovery_mode: 2 2023-08-10T10:42:06.517 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.enable_thread_tracking: 0 2023-08-10T10:42:06.517 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.enable_pipelined_write: 0 2023-08-10T10:42:06.517 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.unordered_write: 0 2023-08-10T10:42:06.517 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-08-10T10:42:06.517 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-08-10T10:42:06.517 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-08-10T10:42:06.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-08-10T10:42:06.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.row_cache: None 2023-08-10T10:42:06.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.wal_filter: None 2023-08-10T10:42:06.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-08-10T10:42:06.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.allow_ingest_behind: 0 2023-08-10T10:42:06.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.two_write_queues: 0 2023-08-10T10:42:06.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.manual_wal_flush: 0 2023-08-10T10:42:06.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.wal_compression: 0 2023-08-10T10:42:06.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.atomic_flush: 0 2023-08-10T10:42:06.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-08-10T10:42:06.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.persist_stats_to_disk: 0 2023-08-10T10:42:06.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.write_dbid_to_manifest: 0 2023-08-10T10:42:06.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.log_readahead_size: 0 2023-08-10T10:42:06.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-08-10T10:42:06.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.best_efforts_recovery: 0 2023-08-10T10:42:06.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-08-10T10:42:06.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-08-10T10:42:06.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.allow_data_in_errors: 0 2023-08-10T10:42:06.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.db_host_id: __hostname__ 2023-08-10T10:42:06.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.enforce_single_del_contracts: true 2023-08-10T10:42:06.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_background_jobs: 2 2023-08-10T10:42:06.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_background_compactions: -1 2023-08-10T10:42:06.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_subcompactions: 1 2023-08-10T10:42:06.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-08-10T10:42:06.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-08-10T10:42:06.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.delayed_write_rate : 16777216 2023-08-10T10:42:06.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_total_wal_size: 0 2023-08-10T10:42:06.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-08-10T10:42:06.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.stats_dump_period_sec: 600 2023-08-10T10:42:06.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.stats_persist_period_sec: 600 2023-08-10T10:42:06.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-08-10T10:42:06.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_open_files: -1 2023-08-10T10:42:06.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bytes_per_sync: 0 2023-08-10T10:42:06.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.wal_bytes_per_sync: 0 2023-08-10T10:42:06.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.strict_bytes_per_sync: 0 2023-08-10T10:42:06.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_readahead_size: 0 2023-08-10T10:42:06.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_background_flushes: -1 2023-08-10T10:42:06.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Compression algorithms supported: 2023-08-10T10:42:06.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-08-10T10:42:06.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: kZSTD supported: 0 2023-08-10T10:42:06.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: kXpressCompression supported: 0 2023-08-10T10:42:06.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: kLZ4HCCompression supported: 1 2023-08-10T10:42:06.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: kZlibCompression supported: 1 2023-08-10T10:42:06.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: kSnappyCompression supported: 1 2023-08-10T10:42:06.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: kLZ4Compression supported: 1 2023-08-10T10:42:06.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: kBZip2Compression supported: 0 2023-08-10T10:42:06.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Fast CRC32 supported: Supported on x86 2023-08-10T10:42:06.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: DMutex implementation: pthread_mutex_t 2023-08-10T10:42:06.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-08-10T10:42:06.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-08-10T10:42:06.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-08-10T10:42:06.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.merge_operator: 2023-08-10T10:42:06.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_filter: None 2023-08-10T10:42:06.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_filter_factory: None 2023-08-10T10:42:06.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.sst_partitioner_factory: None 2023-08-10T10:42:06.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.memtable_factory: SkipListFactory 2023-08-10T10:42:06.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.table_factory: BlockBasedTable 2023-08-10T10:42:06.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5577d9cc93c0) 2023-08-10T10:42:06.525 INFO:journalctl@ceph.mon.b.smithi157.stdout: cache_index_and_filter_blocks: 1 2023-08-10T10:42:06.525 INFO:journalctl@ceph.mon.b.smithi157.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-08-10T10:42:06.526 INFO:journalctl@ceph.mon.b.smithi157.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-08-10T10:42:06.526 INFO:journalctl@ceph.mon.b.smithi157.stdout: pin_top_level_index_and_filter: 1 2023-08-10T10:42:06.526 INFO:journalctl@ceph.mon.b.smithi157.stdout: index_type: 0 2023-08-10T10:42:06.526 INFO:journalctl@ceph.mon.b.smithi157.stdout: data_block_index_type: 0 2023-08-10T10:42:06.526 INFO:journalctl@ceph.mon.b.smithi157.stdout: index_shortening: 1 2023-08-10T10:42:06.526 INFO:journalctl@ceph.mon.b.smithi157.stdout: data_block_hash_table_util_ratio: 0.750000 2023-08-10T10:42:06.526 INFO:journalctl@ceph.mon.b.smithi157.stdout: checksum: 4 2023-08-10T10:42:06.526 INFO:journalctl@ceph.mon.b.smithi157.stdout: no_block_cache: 0 2023-08-10T10:42:06.527 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_cache: 0x5577d9c89350 2023-08-10T10:42:06.527 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_cache_name: BinnedLRUCache 2023-08-10T10:42:06.527 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_cache_options: 2023-08-10T10:42:06.527 INFO:journalctl@ceph.mon.b.smithi157.stdout: capacity : 536870912 2023-08-10T10:42:06.527 INFO:journalctl@ceph.mon.b.smithi157.stdout: num_shard_bits : 4 2023-08-10T10:42:06.527 INFO:journalctl@ceph.mon.b.smithi157.stdout: strict_capacity_limit : 0 2023-08-10T10:42:06.527 INFO:journalctl@ceph.mon.b.smithi157.stdout: high_pri_pool_ratio: 0.000 2023-08-10T10:42:06.527 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_cache_compressed: (nil) 2023-08-10T10:42:06.528 INFO:journalctl@ceph.mon.b.smithi157.stdout: persistent_cache: (nil) 2023-08-10T10:42:06.528 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_size: 4096 2023-08-10T10:42:06.528 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_size_deviation: 10 2023-08-10T10:42:06.528 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_restart_interval: 16 2023-08-10T10:42:06.528 INFO:journalctl@ceph.mon.b.smithi157.stdout: index_block_restart_interval: 1 2023-08-10T10:42:06.528 INFO:journalctl@ceph.mon.b.smithi157.stdout: metadata_block_size: 4096 2023-08-10T10:42:06.528 INFO:journalctl@ceph.mon.b.smithi157.stdout: partition_filters: 0 2023-08-10T10:42:06.529 INFO:journalctl@ceph.mon.b.smithi157.stdout: use_delta_encoding: 1 2023-08-10T10:42:06.529 INFO:journalctl@ceph.mon.b.smithi157.stdout: filter_policy: bloomfilter 2023-08-10T10:42:06.529 INFO:journalctl@ceph.mon.b.smithi157.stdout: whole_key_filtering: 1 2023-08-10T10:42:06.529 INFO:journalctl@ceph.mon.b.smithi157.stdout: verify_compression: 0 2023-08-10T10:42:06.529 INFO:journalctl@ceph.mon.b.smithi157.stdout: read_amp_bytes_per_bit: 0 2023-08-10T10:42:06.529 INFO:journalctl@ceph.mon.b.smithi157.stdout: format_version: 5 2023-08-10T10:42:06.529 INFO:journalctl@ceph.mon.b.smithi157.stdout: enable_index_compression: 1 2023-08-10T10:42:06.529 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_align: 0 2023-08-10T10:42:06.530 INFO:journalctl@ceph.mon.b.smithi157.stdout: max_auto_readahead_size: 262144 2023-08-10T10:42:06.530 INFO:journalctl@ceph.mon.b.smithi157.stdout: prepopulate_block_cache: 0 2023-08-10T10:42:06.530 INFO:journalctl@ceph.mon.b.smithi157.stdout: initial_auto_readahead_size: 8192 2023-08-10T10:42:06.530 INFO:journalctl@ceph.mon.b.smithi157.stdout: num_file_reads_for_auto_readahead: 2 2023-08-10T10:42:06.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.write_buffer_size: 33554432 2023-08-10T10:42:06.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_write_buffer_number: 2 2023-08-10T10:42:06.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression: NoCompression 2023-08-10T10:42:06.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression: Disabled 2023-08-10T10:42:06.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.prefix_extractor: nullptr 2023-08-10T10:42:06.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-08-10T10:42:06.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.num_levels: 7 2023-08-10T10:42:06.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-08-10T10:42:06.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-08-10T10:42:06.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-08-10T10:42:06.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-08-10T10:42:06.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-08-10T10:42:06.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-08-10T10:42:06.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-08-10T10:42:06.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-08-10T10:42:06.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-08-10T10:42:06.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-08-10T10:42:06.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-08-10T10:42:06.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-08-10T10:42:06.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression_opts.window_bits: -14 2023-08-10T10:42:06.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression_opts.level: 32767 2023-08-10T10:42:06.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression_opts.strategy: 0 2023-08-10T10:42:06.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-08-10T10:42:06.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-08-10T10:42:06.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-08-10T10:42:06.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-08-10T10:42:06.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression_opts.enabled: false 2023-08-10T10:42:06.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-08-10T10:42:06.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-08-10T10:42:06.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-08-10T10:42:06.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-08-10T10:42:06.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.target_file_size_base: 67108864 2023-08-10T10:42:06.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.target_file_size_multiplier: 1 2023-08-10T10:42:06.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-08-10T10:42:06.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-08-10T10:42:06.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-08-10T10:42:06.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-08-10T10:42:06.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-08-10T10:42:06.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-08-10T10:42:06.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-08-10T10:42:06.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-08-10T10:42:06.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-08-10T10:42:06.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-08-10T10:42:06.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-08-10T10:42:06.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-08-10T10:42:06.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-08-10T10:42:06.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.arena_block_size: 1048576 2023-08-10T10:42:06.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-08-10T10:42:06.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-08-10T10:42:06.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.disable_auto_compactions: 0 2023-08-10T10:42:06.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-08-10T10:42:06.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-08-10T10:42:06.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-08-10T10:42:06.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-08-10T10:42:06.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-08-10T10:42:06.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-08-10T10:42:06.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-08-10T10:42:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-08-10T10:42:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-08-10T10:42:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-08-10T10:42:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.table_properties_collectors: 2023-08-10T10:42:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.inplace_update_support: 0 2023-08-10T10:42:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.inplace_update_num_locks: 10000 2023-08-10T10:42:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-08-10T10:42:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-08-10T10:42:06.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.memtable_huge_page_size: 0 2023-08-10T10:42:06.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.bloom_locality: 0 2023-08-10T10:42:06.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.max_successive_merges: 0 2023-08-10T10:42:06.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.optimize_filters_for_hits: 0 2023-08-10T10:42:06.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.paranoid_file_checks: 0 2023-08-10T10:42:06.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.force_consistency_checks: 1 2023-08-10T10:42:06.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.report_bg_io_stats: 0 2023-08-10T10:42:06.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.ttl: 2592000 2023-08-10T10:42:06.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.periodic_compaction_seconds: 0 2023-08-10T10:42:06.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-08-10T10:42:06.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-08-10T10:42:06.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.enable_blob_files: false 2023-08-10T10:42:06.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.min_blob_size: 0 2023-08-10T10:42:06.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.blob_file_size: 268435456 2023-08-10T10:42:06.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.blob_compression_type: NoCompression 2023-08-10T10:42:06.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.enable_blob_garbage_collection: false 2023-08-10T10:42:06.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-08-10T10:42:06.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-08-10T10:42:06.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-08-10T10:42:06.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.blob_file_starting_level: 0 2023-08-10T10:42:06.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-08-10T10:42:06.542 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.516+0000 7f37dd7fa700 1 -- 172.21.15.195:0/1753865486 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4017e70 con 0x7f37e019dda0 2023-08-10T10:42:06.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-08-10T10:42:06.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-08-10T10:42:06.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dcc9d0a8-86e4-46d0-af50-59d5fba8f905 2023-08-10T10:42:06.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691664126472383, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-08-10T10:42:06.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-08-10T10:42:06.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691664126474099, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1691664126, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dcc9d0a8-86e4-46d0-af50-59d5fba8f905", "db_session_id": "Z1NMSAWUF5LT4QGEPS74", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-08-10T10:42:06.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: EVENT_LOG_v1 {"time_micros": 1691664126474381, "job": 1, "event": "recovery_finished"} 2023-08-10T10:42:06.543 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-08-10T10:42:06.544 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-08-10T10:42:06.544 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5577d9d22000 2023-08-10T10:42:06.544 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: DB pointer 0x5577d9d0e000 2023-08-10T10:42:06.544 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-08-10T10:42:06.544 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-08-10T10:42:06.544 INFO:journalctl@ceph.mon.b.smithi157.stdout: ** DB Stats ** 2023-08-10T10:42:06.544 INFO:journalctl@ceph.mon.b.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T10:42:06.545 INFO:journalctl@ceph.mon.b.smithi157.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-08-10T10:42:06.545 INFO:journalctl@ceph.mon.b.smithi157.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T10:42:06.545 INFO:journalctl@ceph.mon.b.smithi157.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T10:42:06.545 INFO:journalctl@ceph.mon.b.smithi157.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-08-10T10:42:06.545 INFO:journalctl@ceph.mon.b.smithi157.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-08-10T10:42:06.545 INFO:journalctl@ceph.mon.b.smithi157.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-08-10T10:42:06.545 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-08-10T10:42:06.545 INFO:journalctl@ceph.mon.b.smithi157.stdout: ** Compaction Stats [default] ** 2023-08-10T10:42:06.546 INFO:journalctl@ceph.mon.b.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T10:42:06.546 INFO:journalctl@ceph.mon.b.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-08-10T10:42:06.546 INFO:journalctl@ceph.mon.b.smithi157.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-08-10T10:42:06.546 INFO:journalctl@ceph.mon.b.smithi157.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-08-10T10:42:06.546 INFO:journalctl@ceph.mon.b.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-08-10T10:42:06.546 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-08-10T10:42:06.546 INFO:journalctl@ceph.mon.b.smithi157.stdout: ** Compaction Stats [default] ** 2023-08-10T10:42:06.547 INFO:journalctl@ceph.mon.b.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-08-10T10:42:06.547 INFO:journalctl@ceph.mon.b.smithi157.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-08-10T10:42:06.547 INFO:journalctl@ceph.mon.b.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-08-10T10:42:06.547 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-08-10T10:42:06.547 INFO:journalctl@ceph.mon.b.smithi157.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-08-10T10:42:06.547 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-08-10T10:42:06.547 INFO:journalctl@ceph.mon.b.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-08-10T10:42:06.547 INFO:journalctl@ceph.mon.b.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-08-10T10:42:06.548 INFO:journalctl@ceph.mon.b.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-08-10T10:42:06.548 INFO:journalctl@ceph.mon.b.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-08-10T10:42:06.548 INFO:journalctl@ceph.mon.b.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-08-10T10:42:06.548 INFO:journalctl@ceph.mon.b.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2023-08-10T10:42:06.548 INFO:journalctl@ceph.mon.b.smithi157.stdout: Cumulative compaction: 0.00 GB write, 0.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T10:42:06.548 INFO:journalctl@ceph.mon.b.smithi157.stdout: Interval compaction: 0.00 GB write, 0.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-08-10T10:42:06.548 INFO:journalctl@ceph.mon.b.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-08-10T10:42:06.549 INFO:journalctl@ceph.mon.b.smithi157.stdout: Block cache BinnedLRUCache@0x5577d9c89350#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-08-10T10:42:06.549 INFO:journalctl@ceph.mon.b.smithi157.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-08-10T10:42:06.549 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-08-10T10:42:06.549 INFO:journalctl@ceph.mon.b.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2023-08-10T10:42:06.549 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-08-10T10:42:06.549 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: using public_addr v2:172.21.15.157:0/0 -> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2023-08-10T10:42:06.549 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: starting mon.b rank -1 at public addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] at bind addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:42:06.550 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(???) e0 preinit fsid 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:42:06.550 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).mds e1 new map 2023-08-10T10:42:06.550 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).mds e1 print_map 2023-08-10T10:42:06.550 INFO:journalctl@ceph.mon.b.smithi157.stdout: e1 2023-08-10T10:42:06.550 INFO:journalctl@ceph.mon.b.smithi157.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-08-10T10:42:06.550 INFO:journalctl@ceph.mon.b.smithi157.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-08-10T10:42:06.550 INFO:journalctl@ceph.mon.b.smithi157.stdout: legacy client fscid: -1 2023-08-10T10:42:06.550 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-08-10T10:42:06.551 INFO:journalctl@ceph.mon.b.smithi157.stdout: No filesystems configured 2023-08-10T10:42:06.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-08-10T10:42:06.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-08-10T10:42:06.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-08-10T10:42:06.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-08-10T10:42:06.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-08-10T10:42:06.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-08-10T10:42:06.551 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-08-10T10:42:06.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T10:42:06.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T10:42:06.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-08-10T10:42:06.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.552 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.553 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.553 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.553 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:42:06.553 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.553 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:06.553 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.553 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.554 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.554 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.554 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:42:06.554 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:06.554 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:06.554 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Updating smithi157:/etc/ceph/ceph.conf 2023-08-10T10:42:06.554 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Deploying cephadm binary to smithi195 2023-08-10T10:42:06.636 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:06.635+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f37e01a2600 con 0x7f37e019dda0 2023-08-10T10:42:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:42:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:42:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Added host smithi195 2023-08-10T10:42:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:42:06.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1982629403' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-08-10T10:42:06.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:42:06.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:06.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:06.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Updating smithi195:/etc/ceph/ceph.conf 2023-08-10T10:42:06.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:06.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1982629403' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-08-10T10:42:06.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:06.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:42:06.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:42:06.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi107:172.21.15.107=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:06.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Saving service mon spec with placement smithi107:172.21.15.107=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c;count:3 2023-08-10T10:42:06.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:06.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:06.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:06.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:06.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:06.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Deploying daemon mon.c on smithi195 2023-08-10T10:42:06.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.796 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/4023388684' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T10:42:06.796 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:42:06.796 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.a calling monitor election 2023-08-10T10:42:06.796 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:06.796 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.796 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:06.796 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:06.797 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.c calling monitor election 2023-08-10T10:42:06.797 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.797 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:06.797 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:06.797 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:06.797 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T10:42:06.797 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: monmap e2: 2 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-08-10T10:42:06.797 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: fsmap 2023-08-10T10:42:06.798 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:06.798 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mgrmap e13: x(active, since 50s) 2023-08-10T10:42:06.798 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: overall HEALTH_OK 2023-08-10T10:42:06.798 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.798 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.798 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:06.798 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:06.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:06.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: Deploying daemon mon.b on smithi157 2023-08-10T10:42:06.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/240344201' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T10:42:06.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:06.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-08-10T10:42:06.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-08-10T10:42:06.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta expand map: {default=false} 2023-08-10T10:42:06.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta from 'false' to 'false' 2023-08-10T10:42:06.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta expanded map: {default=false} 2023-08-10T10:42:06.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta expand map: {default=info} 2023-08-10T10:42:06.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta from 'info' to 'info' 2023-08-10T10:42:06.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta expanded map: {default=info} 2023-08-10T10:42:06.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta expand map: {default=daemon} 2023-08-10T10:42:06.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta from 'daemon' to 'daemon' 2023-08-10T10:42:06.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta expanded map: {default=daemon} 2023-08-10T10:42:06.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta expand map: {default=debug} 2023-08-10T10:42:06.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta from 'debug' to 'debug' 2023-08-10T10:42:06.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 ceph-mon[129604]: expand_channel_meta expanded map: {default=debug} 2023-08-10T10:42:06.801 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:06 smithi157 systemd[1]: Started Ceph mon.b for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:42:06.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:06 smithi107 ceph-mon[127953]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:06.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:06 smithi195 ceph-mon[129938]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:11.526 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.524+0000 7f37dd7fa700 1 -- 172.21.15.195:0/1753865486 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1278 (secure 0 0 0) 0x7f37d404f070 con 0x7f37e019dda0 2023-08-10T10:42:11.527 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-08-10T10:42:11.527 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":3,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","modified":"2023-08-10T10:42:06.515580Z","created":"2023-08-10T10:40:08.207630Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-08-10T10:42:11.529 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.527+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f37c80385f0 msgr2=0x7f37c803aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:11.530 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.527+0000 7f37e6473700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f37c80385f0 0x7f37c803aab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f37d00092e0 tx=0x7f37d000b580 comp rx=0 tx=0).stop 2023-08-10T10:42:11.530 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.527+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e019dda0 msgr2=0x7f37e0197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:11.530 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.527+0000 7f37e6473700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e019dda0 0x7f37e0197850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f37d400b4d0 tx=0x7f37d400b890 comp rx=0 tx=0).stop 2023-08-10T10:42:11.530 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.527+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 shutdown_connections 2023-08-10T10:42:11.530 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.527+0000 7f37e6473700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f37c80385f0 0x7f37c803aab0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:11.530 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.527+0000 7f37e6473700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37e0100570 0x7f37e019d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:11.530 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.527+0000 7f37e6473700 1 --2- 172.21.15.195:0/1753865486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37e019dda0 0x7f37e0197850 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:11.531 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.528+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 >> 172.21.15.195:0/1753865486 conn(0x7f37e00fbde0 msgr2=0x7f37e0103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:11.531 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.528+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 shutdown_connections 2023-08-10T10:42:11.531 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:11.528+0000 7f37e6473700 1 -- 172.21.15.195:0/1753865486 wait complete. 2023-08-10T10:42:11.531 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 3 2023-08-10T10:42:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:42:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: mon.a calling monitor election 2023-08-10T10:42:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: mon.c calling monitor election 2023-08-10T10:42:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:11.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:11.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/1753865486' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T10:42:11.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:11.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:11.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:11.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:11.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:11.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:11.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:11.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T10:42:11.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: monmap e3: 3 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-08-10T10:42:11.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: fsmap 2023-08-10T10:42:11.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:11.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: mgrmap e13: x(active, since 60s) 2023-08-10T10:42:11.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-08-10T10:42:11.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-08-10T10:42:11.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-08-10T10:42:11.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: mon.b (rank 2) addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] is down (out of quorum) 2023-08-10T10:42:11.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:11.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:11.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:11.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:12.073 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-08-10T10:42:12.074 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph config generate-minimal-conf 2023-08-10T10:42:12.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:42:12.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: mon.a calling monitor election 2023-08-10T10:42:12.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: mon.c calling monitor election 2023-08-10T10:42:12.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:12.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:12.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/1753865486' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T10:42:12.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:12.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:12.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:12.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:12.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:12.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:12.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:12.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T10:42:12.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: monmap e3: 3 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-08-10T10:42:12.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: fsmap 2023-08-10T10:42:12.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:12.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: mgrmap e13: x(active, since 60s) 2023-08-10T10:42:12.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-08-10T10:42:12.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-08-10T10:42:12.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-08-10T10:42:12.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: mon.b (rank 2) addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] is down (out of quorum) 2023-08-10T10:42:12.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:12.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:12.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:12.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:12.801 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:42:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:12 smithi107 ceph-mon[127953]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:13.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:12 smithi195 ceph-mon[129938]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:13.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:13.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:42:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: mon.a calling monitor election 2023-08-10T10:42:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: mon.c calling monitor election 2023-08-10T10:42:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:42:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/1753865486' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-08-10T10:42:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-08-10T10:42:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: monmap e3: 3 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-08-10T10:42:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: fsmap 2023-08-10T10:42:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: mgrmap e13: x(active, since 60s) 2023-08-10T10:42:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-08-10T10:42:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-08-10T10:42:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-08-10T10:42:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: mon.b (rank 2) addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] is down (out of quorum) 2023-08-10T10:42:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:14.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.267+0000 7f827ba57700 1 -- 172.21.15.107:0/1034204693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 msgr2=0x7f8274072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:14.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.267+0000 7f827ba57700 1 --2- 172.21.15.107:0/1034204693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 0x7f8274072f40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8270009910 tx=0x7f8270009c20 comp rx=0 tx=0).stop 2023-08-10T10:42:14.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.267+0000 7f827ba57700 1 -- 172.21.15.107:0/1034204693 shutdown_connections 2023-08-10T10:42:14.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.267+0000 7f827ba57700 1 --2- 172.21.15.107:0/1034204693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 0x7f8274072f40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:14.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.267+0000 7f827ba57700 1 -- 172.21.15.107:0/1034204693 >> 172.21.15.107:0/1034204693 conn(0x7f82740fbd60 msgr2=0x7f82740fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:14.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.267+0000 7f827ba57700 1 -- 172.21.15.107:0/1034204693 shutdown_connections 2023-08-10T10:42:14.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.267+0000 7f827ba57700 1 -- 172.21.15.107:0/1034204693 wait complete. 2023-08-10T10:42:14.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.269+0000 7f827ba57700 1 Processor -- start 2023-08-10T10:42:14.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.269+0000 7f827ba57700 1 -- start start 2023-08-10T10:42:14.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.269+0000 7f827ba57700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 0x7f827419d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:14.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.269+0000 7f827ba57700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f827419dd90 0x7f82741978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:14.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.269+0000 7f827ba57700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8274197e10 0x7f82741982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:14.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.269+0000 7f827ba57700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827419e3f0 con 0x7f8274072b60 2023-08-10T10:42:14.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.269+0000 7f827ba57700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82741a4670 con 0x7f827419dd90 2023-08-10T10:42:14.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.269+0000 7f827ba57700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82741a4800 con 0x7f8274197e10 2023-08-10T10:42:14.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f82797f3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 0x7f827419d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:14.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f82797f3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 0x7f827419d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50364/0 (socket says 172.21.15.107:50364) 2023-08-10T10:42:14.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f82797f3700 1 -- 172.21.15.107:0/3155582329 learned_addr learned my addr 172.21.15.107:0/3155582329 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:42:14.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f8279ff4700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8274197e10 0x7f82741982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:14.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f8278ff2700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f827419dd90 0x7f82741978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:14.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f82797f3700 1 -- 172.21.15.107:0/3155582329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8274197e10 msgr2=0x7f82741982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:14.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f82797f3700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8274197e10 0x7f82741982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:14.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f82797f3700 1 -- 172.21.15.107:0/3155582329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f827419dd90 msgr2=0x7f82741978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:14.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f82797f3700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f827419dd90 0x7f82741978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:14.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f82797f3700 1 -- 172.21.15.107:0/3155582329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82700095f0 con 0x7f8274072b60 2023-08-10T10:42:14.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f8278ff2700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f827419dd90 0x7f82741978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:42:14.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.270+0000 7f82797f3700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 0x7f827419d850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f827000bca0 tx=0x7f827000bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:14.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.271+0000 7f826a7fc700 1 -- 172.21.15.107:0/3155582329 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827001d070 con 0x7f8274072b60 2023-08-10T10:42:14.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.271+0000 7f826a7fc700 1 -- 172.21.15.107:0/3155582329 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8270004db0 con 0x7f8274072b60 2023-08-10T10:42:14.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.271+0000 7f826a7fc700 1 -- 172.21.15.107:0/3155582329 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270022d60 con 0x7f8274072b60 2023-08-10T10:42:14.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.271+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82741a4a80 con 0x7f8274072b60 2023-08-10T10:42:14.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.271+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82741a4f20 con 0x7f8274072b60 2023-08-10T10:42:14.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.272+0000 7f826a7fc700 1 -- 172.21.15.107:0/3155582329 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f8270004920 con 0x7f8274072b60 2023-08-10T10:42:14.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.272+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8274109c50 con 0x7f8274072b60 2023-08-10T10:42:14.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.273+0000 7f826a7fc700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8260038c80 0x7f826003b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:14.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.273+0000 7f826a7fc700 1 -- 172.21.15.107:0/3155582329 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f827004cb60 con 0x7f8274072b60 2023-08-10T10:42:14.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.273+0000 7f8278ff2700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8260038c80 0x7f826003b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:14.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.274+0000 7f8278ff2700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8260038c80 0x7f826003b140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f82640079b0 tx=0x7f8264008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:14.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.281+0000 7f826a7fc700 1 -- 172.21.15.107:0/3155582329 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f827000e5c0 con 0x7f8274072b60 2023-08-10T10:42:14.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.491+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f8274061da0 con 0x7f8274072b60 2023-08-10T10:42:14.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.493+0000 7f826a7fc700 1 -- 172.21.15.107:0/3155582329 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7f8270027030 con 0x7f8274072b60 2023-08-10T10:42:14.493 INFO:teuthology.orchestra.run.smithi107.stdout:# minimal ceph.conf for 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:42:14.493 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2023-08-10T10:42:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:42:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: mon_host = [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2023-08-10T10:42:14.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8260038c80 msgr2=0x7f826003b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:14.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8260038c80 0x7f826003b140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f82640079b0 tx=0x7f8264008040 comp rx=0 tx=0).stop 2023-08-10T10:42:14.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 msgr2=0x7f827419d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:14.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 0x7f827419d850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f827000bca0 tx=0x7f827000bd80 comp rx=0 tx=0).stop 2023-08-10T10:42:14.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 shutdown_connections 2023-08-10T10:42:14.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8260038c80 0x7f826003b140 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:14.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8274197e10 0x7f82741982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:14.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8274072b60 0x7f827419d850 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:14.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 --2- 172.21.15.107:0/3155582329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f827419dd90 0x7f82741978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:14.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.495+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 >> 172.21.15.107:0/3155582329 conn(0x7f82740fbd60 msgr2=0x7f8274106d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:14.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.496+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 shutdown_connections 2023-08-10T10:42:14.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:14.496+0000 7f827ba57700 1 -- 172.21.15.107:0/3155582329 wait complete. 2023-08-10T10:42:14.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: mon.b calling monitor election 2023-08-10T10:42:14.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:14.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: mon.b calling monitor election 2023-08-10T10:42:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: mon.a calling monitor election 2023-08-10T10:42:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: mon.c calling monitor election 2023-08-10T10:42:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-08-10T10:42:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: monmap e3: 3 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-08-10T10:42:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: fsmap 2023-08-10T10:42:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: mgrmap e13: x(active, since 62s) 2023-08-10T10:42:14.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-08-10T10:42:14.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: Cluster is now healthy 2023-08-10T10:42:14.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: overall HEALTH_OK 2023-08-10T10:42:14.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:14.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:14.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: Updating smithi107:/etc/ceph/ceph.conf 2023-08-10T10:42:14.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: Updating smithi157:/etc/ceph/ceph.conf 2023-08-10T10:42:14.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:14 smithi157 ceph-mon[129604]: Updating smithi195:/etc/ceph/ceph.conf 2023-08-10T10:42:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: mon.b calling monitor election 2023-08-10T10:42:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: mon.b calling monitor election 2023-08-10T10:42:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: mon.a calling monitor election 2023-08-10T10:42:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: mon.c calling monitor election 2023-08-10T10:42:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-08-10T10:42:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: monmap e3: 3 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-08-10T10:42:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: fsmap 2023-08-10T10:42:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: mgrmap e13: x(active, since 62s) 2023-08-10T10:42:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-08-10T10:42:14.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: Cluster is now healthy 2023-08-10T10:42:14.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: overall HEALTH_OK 2023-08-10T10:42:14.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:14.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:14.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: Updating smithi107:/etc/ceph/ceph.conf 2023-08-10T10:42:14.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: Updating smithi157:/etc/ceph/ceph.conf 2023-08-10T10:42:14.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:14 smithi107 ceph-mon[127953]: Updating smithi195:/etc/ceph/ceph.conf 2023-08-10T10:42:14.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: mon.b calling monitor election 2023-08-10T10:42:14.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:14.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: mon.b calling monitor election 2023-08-10T10:42:14.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: mon.a calling monitor election 2023-08-10T10:42:14.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: mon.c calling monitor election 2023-08-10T10:42:14.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-08-10T10:42:14.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: monmap e3: 3 mons at {a=[v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-08-10T10:42:14.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: fsmap 2023-08-10T10:42:14.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: osdmap e4: 0 total, 0 up, 0 in 2023-08-10T10:42:14.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: mgrmap e13: x(active, since 62s) 2023-08-10T10:42:14.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-08-10T10:42:14.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: Cluster is now healthy 2023-08-10T10:42:14.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: overall HEALTH_OK 2023-08-10T10:42:14.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:14.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:14.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:14.918 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: Updating smithi107:/etc/ceph/ceph.conf 2023-08-10T10:42:14.918 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: Updating smithi157:/etc/ceph/ceph.conf 2023-08-10T10:42:14.918 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:14 smithi195 ceph-mon[129938]: Updating smithi195:/etc/ceph/ceph.conf 2023-08-10T10:42:14.981 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-08-10T10:42:14.981 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:42:14.981 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.conf 2023-08-10T10:42:15.053 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:42:15.054 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:42:15.161 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:42:15.162 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2023-08-10T10:42:15.233 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:42:15.234 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:42:15.342 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:42:15.342 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2023-08-10T10:42:15.412 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:42:15.413 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:42:15.520 INFO:tasks.cephadm:Adding mgr.x on smithi107 2023-08-10T10:42:15.521 INFO:tasks.cephadm:Adding mgr.y on smithi157 2023-08-10T10:42:15.521 INFO:tasks.cephadm:Adding mgr.z on smithi195 2023-08-10T10:42:15.522 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch apply mgr '3;smithi107=x;smithi157=y;smithi195=z' 2023-08-10T10:42:15.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3155582329' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:15.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T10:42:15.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:15.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:15.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:15.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:15.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3155582329' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:15.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:15.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:15.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T10:42:15.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:15.826 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:42:15.516+0000 7f1a87164700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-10T10:42:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:42:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3155582329' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:15.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:42:15.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:15.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:15.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T10:42:15.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:16.273 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:42:16.535 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:16 smithi107 ceph-mon[127953]: Reconfiguring mon.a (unknown last config time)... 2023-08-10T10:42:16.536 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:16 smithi107 ceph-mon[127953]: Reconfiguring daemon mon.a on smithi107 2023-08-10T10:42:16.536 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:16 smithi107 ceph-mon[127953]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:16.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:16 smithi157 ceph-mon[129604]: Reconfiguring mon.a (unknown last config time)... 2023-08-10T10:42:16.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:16 smithi157 ceph-mon[129604]: Reconfiguring daemon mon.a on smithi107 2023-08-10T10:42:16.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:16 smithi157 ceph-mon[129604]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:16.817 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:16 smithi195 ceph-mon[129938]: Reconfiguring mon.a (unknown last config time)... 2023-08-10T10:42:16.817 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:16 smithi195 ceph-mon[129938]: Reconfiguring daemon mon.a on smithi107 2023-08-10T10:42:16.817 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:16 smithi195 ceph-mon[129938]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:17.701 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:17.702 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:17.702 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:17.703 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:17 smithi157 ceph-mon[129604]: Reconfiguring mon.b (monmap changed)... 2023-08-10T10:42:17.703 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:17.703 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T10:42:17.704 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:17.704 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:17 smithi157 ceph-mon[129604]: Reconfiguring daemon mon.b on smithi157 2023-08-10T10:42:17.754 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.752+0000 7fcdb3975700 1 -- 172.21.15.195:0/843519632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac1003a0 msgr2=0x7fcdac1007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:17.754 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.752+0000 7fcdb3975700 1 --2- 172.21.15.195:0/843519632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac1003a0 0x7fcdac1007c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009910 tx=0x7fcda8009c20 comp rx=0 tx=0).stop 2023-08-10T10:42:17.754 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.752+0000 7fcdb3975700 1 -- 172.21.15.195:0/843519632 shutdown_connections 2023-08-10T10:42:17.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.752+0000 7fcdb3975700 1 --2- 172.21.15.195:0/843519632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac1003a0 0x7fcdac1007c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:17.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.752+0000 7fcdb3975700 1 -- 172.21.15.195:0/843519632 >> 172.21.15.195:0/843519632 conn(0x7fcdac0fb940 msgr2=0x7fcdac0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:17.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.752+0000 7fcdb3975700 1 -- 172.21.15.195:0/843519632 shutdown_connections 2023-08-10T10:42:17.755 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.752+0000 7fcdb3975700 1 -- 172.21.15.195:0/843519632 wait complete. 2023-08-10T10:42:17.756 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.753+0000 7fcdb3975700 1 Processor -- start 2023-08-10T10:42:17.756 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb3975700 1 -- start start 2023-08-10T10:42:17.756 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb3975700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac1003a0 0x7fcdac1977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:17.756 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb3975700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac197d10 0x7fcdac19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:17.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb3975700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac198190 0x7fcdac19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:17.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb3975700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac19fab0 con 0x7fcdac1003a0 2023-08-10T10:42:17.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb3975700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac19fc20 con 0x7fcdac197d10 2023-08-10T10:42:17.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb3975700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac19fde0 con 0x7fcdac198190 2023-08-10T10:42:17.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb1711700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac1003a0 0x7fcdac1977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:17.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb1f12700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac198190 0x7fcdac19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:17.757 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb1711700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac1003a0 0x7fcdac1977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.195:43782/0 (socket says 172.21.15.195:43782) 2023-08-10T10:42:17.758 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb1711700 1 -- 172.21.15.195:0/3825879407 learned_addr learned my addr 172.21.15.195:0/3825879407 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:42:17.758 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.754+0000 7fcdb0f10700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac197d10 0x7fcdac19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:17.759 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcdb1f12700 1 -- 172.21.15.195:0/3825879407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac197d10 msgr2=0x7fcdac19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:17.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcdb1f12700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac197d10 0x7fcdac19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:17.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcdb1f12700 1 -- 172.21.15.195:0/3825879407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac1003a0 msgr2=0x7fcdac1977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:17.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcdb1f12700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac1003a0 0x7fcdac1977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:17.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcdb1f12700 1 -- 172.21.15.195:0/3825879407 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda80095f0 con 0x7fcdac198190 2023-08-10T10:42:17.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcdb1f12700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac198190 0x7fcdac19f310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcda400bd50 tx=0x7fcda400bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:17.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcda27fc700 1 -- 172.21.15.195:0/3825879407 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda400cbb0 con 0x7fcdac198190 2023-08-10T10:42:17.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcda27fc700 1 -- 172.21.15.195:0/3825879407 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcda400cd10 con 0x7fcdac198190 2023-08-10T10:42:17.761 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac1a00c0 con 0x7fcdac198190 2023-08-10T10:42:17.761 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcda27fc700 1 -- 172.21.15.195:0/3825879407 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40125c0 con 0x7fcdac198190 2023-08-10T10:42:17.761 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.755+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac1a0640 con 0x7fcdac198190 2023-08-10T10:42:17.761 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.756+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac105fa0 con 0x7fcdac198190 2023-08-10T10:42:17.761 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.757+0000 7fcda27fc700 1 -- 172.21.15.195:0/3825879407 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fcda4014440 con 0x7fcdac198190 2023-08-10T10:42:17.761 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.757+0000 7fcda27fc700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcd98038c80 0x7fcd9803b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:17.761 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.757+0000 7fcda27fc700 1 -- 172.21.15.195:0/3825879407 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcda404b160 con 0x7fcdac198190 2023-08-10T10:42:17.761 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.758+0000 7fcdb1711700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcd98038c80 0x7fcd9803b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:17.762 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.759+0000 7fcdb1711700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcd98038c80 0x7fcd9803b140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005090 tx=0x7fcda80058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:17.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.762+0000 7fcda27fc700 1 -- 172.21.15.195:0/3825879407 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcda401bb10 con 0x7fcdac198190 2023-08-10T10:42:17.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:17.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:17.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:17.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:17 smithi107 ceph-mon[127953]: Reconfiguring mon.b (monmap changed)... 2023-08-10T10:42:17.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:17.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T10:42:17.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:17.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:17 smithi107 ceph-mon[127953]: Reconfiguring daemon mon.b on smithi157 2023-08-10T10:42:17.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:17.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:17.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:17.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:17 smithi195 ceph-mon[129938]: Reconfiguring mon.b (monmap changed)... 2023-08-10T10:42:17.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:17.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T10:42:17.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:17.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:17 smithi195 ceph-mon[129938]: Reconfiguring daemon mon.b on smithi157 2023-08-10T10:42:17.968 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.966+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi107=x;smithi157=y;smithi195=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdac073150 con 0x7fcd98038c80 2023-08-10T10:42:17.975 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.973+0000 7fcda27fc700 1 -- 172.21.15.195:0/3825879407 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcdac073150 con 0x7fcd98038c80 2023-08-10T10:42:17.975 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mgr update... 2023-08-10T10:42:17.977 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.975+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcd98038c80 msgr2=0x7fcd9803b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:17.977 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.975+0000 7fcdb3975700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcd98038c80 0x7fcd9803b140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005090 tx=0x7fcda80058e0 comp rx=0 tx=0).stop 2023-08-10T10:42:17.978 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.975+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac198190 msgr2=0x7fcdac19f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:17.978 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.975+0000 7fcdb3975700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac198190 0x7fcdac19f310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcda400bd50 tx=0x7fcda400bd80 comp rx=0 tx=0).stop 2023-08-10T10:42:17.978 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.976+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 shutdown_connections 2023-08-10T10:42:17.978 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.976+0000 7fcdb3975700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcd98038c80 0x7fcd9803b140 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:17.978 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.976+0000 7fcdb3975700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac198190 0x7fcdac19f310 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:17.978 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.976+0000 7fcdb3975700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcdac1003a0 0x7fcdac1977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:17.978 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.976+0000 7fcdb3975700 1 --2- 172.21.15.195:0/3825879407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdac197d10 0x7fcdac19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:17.979 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.976+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 >> 172.21.15.195:0/3825879407 conn(0x7fcdac0fb940 msgr2=0x7fcdac072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:17.979 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.976+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 shutdown_connections 2023-08-10T10:42:17.979 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:42:17.976+0000 7fcdb3975700 1 -- 172.21.15.195:0/3825879407 wait complete. 2023-08-10T10:42:18.449 DEBUG:teuthology.orchestra.run.smithi157:mgr.y> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.y.service 2023-08-10T10:42:18.454 DEBUG:teuthology.orchestra.run.smithi195:mgr.z> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.z.service 2023-08-10T10:42:18.458 INFO:tasks.cephadm:Deploying OSDs... 2023-08-10T10:42:18.459 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:42:18.459 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T10:42:18.508 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T10:42:18.509 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2023-08-10T10:42:18.529 INFO:journalctl@ceph.mgr.y.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:42:18.529 INFO:journalctl@ceph.mgr.z.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:42:18.555 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T10:42:18.555 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:18.555 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-08-10T10:42:18.555 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:18.556 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:18.556 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-08-10 10:41:21.169930535 +0000 2023-08-10T10:42:18.556 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-08-10 10:26:50.189427212 +0000 2023-08-10T10:42:18.556 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-08-10 10:26:50.189427212 +0000 2023-08-10T10:42:18.556 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2023-08-10 10:26:50.158427733 +0000 2023-08-10T10:42:18.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T10:42:18.624 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-08-10T10:42:18.625 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-08-10T10:42:18.625 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000272774 s, 1.9 MB/s 2023-08-10T10:42:18.627 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T10:42:18.672 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2023-08-10T10:42:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T10:42:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:18.757 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-08-10T10:42:18.757 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:18.757 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:18.758 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-08-10 10:41:21.169930535 +0000 2023-08-10T10:42:18.758 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-08-10 10:26:51.020413260 +0000 2023-08-10T10:42:18.758 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-08-10 10:26:51.020413260 +0000 2023-08-10T10:42:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2023-08-10 10:26:50.993413714 +0000 2023-08-10T10:42:18.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T10:42:18.860 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-08-10T10:42:18.861 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-08-10T10:42:18.861 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000302062 s, 1.7 MB/s 2023-08-10T10:42:18.863 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T10:42:18.907 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2023-08-10T10:42:18.992 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T10:42:18.992 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:18.993 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-08-10T10:42:18.993 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:18.993 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:18.993 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-08-10 10:41:21.169930535 +0000 2023-08-10T10:42:18.993 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-08-10 10:26:51.842399460 +0000 2023-08-10T10:42:18.993 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-08-10 10:26:51.842399460 +0000 2023-08-10T10:42:18.993 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2023-08-10 10:26:51.816399896 +0000 2023-08-10T10:42:18.994 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T10:42:19.097 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-08-10T10:42:19.098 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-08-10T10:42:19.098 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000356398 s, 1.4 MB/s 2023-08-10T10:42:19.100 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T10:42:19.145 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2023-08-10T10:42:19.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi107=x;smithi157=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: Saving service mgr spec with placement smithi107=x;smithi157=y;smithi195=z;count:3 2023-08-10T10:42:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: Reconfiguring mon.c (monmap changed)... 2023-08-10T10:42:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T10:42:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:18 smithi195 ceph-mon[129938]: Reconfiguring daemon mon.c on smithi195 2023-08-10T10:42:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T10:42:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:19.230 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-08-10T10:42:19.230 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:19.230 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:19.230 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2023-08-10 10:41:21.169930535 +0000 2023-08-10T10:42:19.230 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2023-08-10 10:26:52.680385390 +0000 2023-08-10T10:42:19.230 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2023-08-10 10:26:52.680385390 +0000 2023-08-10T10:42:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2023-08-10 10:26:52.654385827 +0000 2023-08-10T10:42:19.231 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T10:42:19.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:19.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi107=x;smithi157=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: Saving service mgr spec with placement smithi107=x;smithi157=y;smithi195=z;count:3 2023-08-10T10:42:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: Reconfiguring mon.c (monmap changed)... 2023-08-10T10:42:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T10:42:19.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:19.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:18 smithi157 ceph-mon[129604]: Reconfiguring daemon mon.c on smithi195 2023-08-10T10:42:19.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:19.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi107=x;smithi157=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:19.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: Saving service mgr spec with placement smithi107=x;smithi157=y;smithi195=z;count:3 2023-08-10T10:42:19.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:19.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:19.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:19.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: Reconfiguring mon.c (monmap changed)... 2023-08-10T10:42:19.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-08-10T10:42:19.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-08-10T10:42:19.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:19.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:18 smithi107 ceph-mon[127953]: Reconfiguring daemon mon.c on smithi195 2023-08-10T10:42:19.334 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2023-08-10T10:42:19.334 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2023-08-10T10:42:19.334 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000311379 s, 1.6 MB/s 2023-08-10T10:42:19.336 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T10:42:19.381 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-08-10T10:42:19.381 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T10:42:19.428 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T10:42:19.429 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2023-08-10T10:42:19.515 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T10:42:19.515 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:19.515 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-08-10T10:42:19.515 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:19.516 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:19.516 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-08-10 10:42:05.623536245 +0000 2023-08-10T10:42:19.516 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-08-10 10:26:51.385353789 +0000 2023-08-10T10:42:19.516 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-08-10 10:26:51.385353789 +0000 2023-08-10T10:42:19.516 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-08-10 10:26:51.362354208 +0000 2023-08-10T10:42:19.516 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T10:42:19.584 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-08-10T10:42:19.584 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-08-10T10:42:19.584 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000193867 s, 2.6 MB/s 2023-08-10T10:42:19.586 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T10:42:19.632 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2023-08-10T10:42:19.716 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T10:42:19.717 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:19.717 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-08-10T10:42:19.717 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:19.717 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:19.717 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-08-10 10:42:05.623536245 +0000 2023-08-10T10:42:19.717 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-08-10 10:26:52.232338381 +0000 2023-08-10T10:42:19.718 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-08-10 10:26:52.232338381 +0000 2023-08-10T10:42:19.718 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-08-10 10:26:52.211338763 +0000 2023-08-10T10:42:19.718 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T10:42:19.822 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-08-10T10:42:19.823 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-08-10T10:42:19.823 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000202192 s, 2.5 MB/s 2023-08-10T10:42:19.825 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T10:42:19.870 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2023-08-10T10:42:19.954 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T10:42:19.955 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:19.955 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-08-10T10:42:19.955 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:19.955 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:19.955 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-08-10 10:42:05.623536245 +0000 2023-08-10T10:42:19.955 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-08-10 10:26:53.105322500 +0000 2023-08-10T10:42:19.956 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-08-10 10:26:53.105322500 +0000 2023-08-10T10:42:19.956 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-08-10 10:26:53.084322883 +0000 2023-08-10T10:42:19.956 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T10:42:20.060 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-08-10T10:42:20.061 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-08-10T10:42:20.061 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000208517 s, 2.5 MB/s 2023-08-10T10:42:20.063 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T10:42:20.109 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2023-08-10T10:42:20.193 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T10:42:20.193 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:20.193 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-08-10T10:42:20.193 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:20.194 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:20.194 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-08-10 10:42:05.623536245 +0000 2023-08-10T10:42:20.194 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-08-10 10:26:53.965306856 +0000 2023-08-10T10:42:20.194 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-08-10 10:26:53.965306856 +0000 2023-08-10T10:42:20.194 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-08-10 10:26:53.941307293 +0000 2023-08-10T10:42:20.194 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T10:42:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-08-10T10:42:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-08-10T10:42:20.299 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000193477 s, 2.6 MB/s 2023-08-10T10:42:20.302 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T10:42:20.347 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-08-10T10:42:20.347 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T10:42:20.392 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T10:42:20.393 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2023-08-10T10:42:20.477 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T10:42:20.477 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:20.478 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-08-10T10:42:20.478 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:20.478 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:20.478 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-08-10 10:41:55.590278382 +0000 2023-08-10T10:42:20.478 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-08-10 10:26:50.602861908 +0000 2023-08-10T10:42:20.478 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-08-10 10:26:50.602861908 +0000 2023-08-10T10:42:20.479 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-08-10 10:26:50.578862384 +0000 2023-08-10T10:42:20.479 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T10:42:20.585 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-08-10T10:42:20.586 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-08-10T10:42:20.586 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000197227 s, 2.6 MB/s 2023-08-10T10:42:20.589 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T10:42:20.639 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2023-08-10T10:42:20.687 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T10:42:20.687 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:20.687 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-08-10T10:42:20.687 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:20.687 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:20.688 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-08-10 10:41:55.590278382 +0000 2023-08-10T10:42:20.688 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-08-10 10:26:51.419845694 +0000 2023-08-10T10:42:20.688 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-08-10 10:26:51.419845694 +0000 2023-08-10T10:42:20.688 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-08-10 10:26:51.398846111 +0000 2023-08-10T10:42:20.688 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T10:42:20.795 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-08-10T10:42:20.795 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-08-10T10:42:20.796 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000191975 s, 2.7 MB/s 2023-08-10T10:42:20.797 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T10:42:20.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:20.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:20.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:20.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:20.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:20.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:20.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:20.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T10:42:20.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T10:42:20.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T10:42:20.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:20.843 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2023-08-10T10:42:20.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:20.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:20.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:20.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:20.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:20.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:20.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:20.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T10:42:20.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T10:42:20.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T10:42:20.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:20.933 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T10:42:20.933 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:20.933 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-08-10T10:42:20.933 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:20.933 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:20.934 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-08-10 10:41:55.590278382 +0000 2023-08-10T10:42:20.934 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-08-10 10:26:52.236829483 +0000 2023-08-10T10:42:20.934 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-08-10 10:26:52.236829483 +0000 2023-08-10T10:42:20.934 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-08-10 10:26:52.215829900 +0000 2023-08-10T10:42:20.934 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T10:42:21.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T10:42:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T10:42:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T10:42:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:21.045 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-08-10T10:42:21.045 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-08-10T10:42:21.045 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000173742 s, 2.9 MB/s 2023-08-10T10:42:21.048 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T10:42:21.095 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2023-08-10T10:42:21.139 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T10:42:21.140 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:42:21.140 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-08-10T10:42:21.140 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:42:21.140 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:42:21.140 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-08-10 10:41:55.590278382 +0000 2023-08-10T10:42:21.140 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-08-10 10:26:53.059813152 +0000 2023-08-10T10:42:21.141 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-08-10 10:26:53.059813152 +0000 2023-08-10T10:42:21.141 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-08-10 10:26:53.038813569 +0000 2023-08-10T10:42:21.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T10:42:21.244 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-08-10T10:42:21.244 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-08-10T10:42:21.245 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000172837 s, 3.0 MB/s 2023-08-10T10:42:21.247 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T10:42:21.295 INFO:tasks.cephadm:Deploying osd.0 on smithi107 with /dev/vg_nvme/lv_4... 2023-08-10T10:42:21.295 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-08-10T10:42:21.587 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:21 smithi195 ceph-mon[129938]: Deploying daemon mgr.z on smithi195 2023-08-10T10:42:21.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:21 smithi107 ceph-mon[127953]: Deploying daemon mgr.z on smithi195 2023-08-10T10:42:22.017 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:42:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:21 smithi157 ceph-mon[129604]: Deploying daemon mgr.z on smithi195 2023-08-10T10:42:22.564 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:22 smithi195 systemd[1]: Starting Ceph mgr.z for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:42:22.576 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:22 smithi107 ceph-mon[127953]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:22.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:22 smithi195 ceph-mon[129938]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:23.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:22 smithi157 ceph-mon[129604]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:23.267 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:23 smithi195 podman[132054]: 2023-08-10T10:42:23.268 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:23 smithi195 bash[132054]: b33feea0f47cbb4fb9d2def11cf0a9f6e321d106dd01708904813092dfe50e55 2023-08-10T10:42:23.540 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:23 smithi195 ceph-mgr[132094]: -- 172.21.15.195:0/3023101505 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fc5a8891e0 con 0x55fc5a85f000 2023-08-10T10:42:23.541 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:23 smithi195 systemd[1]: Started Ceph mgr.z for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:42:23.541 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:23.436+0000 7f837f3a8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:42:23.912 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:23.539+0000 7f837f3a8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:42:23.913 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:23.653+0000 7f837f3a8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:42:23.913 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:23.771+0000 7f837f3a8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:42:24.005 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-08-10T10:42:24.005 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-08-10T10:42:24.005 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2023-08-10T10:42:24.005 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2023-08-10T10:42:24.005 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0299729 s, 350 MB/s 2023-08-10T10:42:24.005 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2023-08-10T10:42:24.387 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:23.992+0000 7f837f3a8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:42:24.388 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:24.387+0000 7f837f3a8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:42:24.490 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi107:vg_nvme/lv_4 2023-08-10T10:42:24.658 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:24 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:24.659 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:24 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:24.659 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:24 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:24.659 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:24 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T10:42:24.659 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:24 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T10:42:24.660 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:24 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T10:42:24.660 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:24 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:24.660 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:24 smithi157 ceph-mon[129604]: Deploying daemon mgr.y on smithi157 2023-08-10T10:42:24.660 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:24 smithi157 ceph-mon[129604]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:24.662 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:24.502+0000 7f837f3a8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:42:24.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:24.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:24.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:24.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T10:42:24.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T10:42:24.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T10:42:24.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:24.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-mon[129938]: Deploying daemon mgr.y on smithi157 2023-08-10T10:42:24.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-mon[129938]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:24.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:24.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:24.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:24.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T10:42:24.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-08-10T10:42:24.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T10:42:24.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:24.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:24 smithi107 ceph-mon[127953]: Deploying daemon mgr.y on smithi157 2023-08-10T10:42:24.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:24 smithi107 ceph-mon[127953]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:25.162 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:24.663+0000 7f837f3a8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:42:25.163 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:24.785+0000 7f837f3a8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:42:25.208 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:42:25.662 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:25.332+0000 7f837f3a8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:42:25.788 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:25 smithi157 systemd[1]: Starting Ceph mgr.y for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:42:26.360 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:26 smithi157 podman[131045]: 2023-08-10T10:42:26.360 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:26 smithi157 bash[131045]: a00097e92d45402e2b9ebc8244a7d8edeb6176430b39d95fb7b1d0f56c3d7e7f 2023-08-10T10:42:26.360 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-mgr[131085]: -- 172.21.15.157:0/2351475251 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c6618cf1e0 con 0x55c6618a5000 2023-08-10T10:42:26.412 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:26.101+0000 7f837f3a8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:42:26.413 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:26.308+0000 7f837f3a8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:42:26.547 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:26 smithi157 systemd[1]: Started Ceph mgr.y for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:42:26.547 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:26.471+0000 7f35ba0ac200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:42:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.694+0000 7fe1070ba700 1 -- 172.21.15.107:0/3724152128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1000731d0 msgr2=0x7fe100073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.694+0000 7fe1070ba700 1 --2- 172.21.15.107:0/3724152128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1000731d0 0x7fe100073650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009990 tx=0x7fe0ec009ca0 comp rx=0 tx=0).stop 2023-08-10T10:42:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.694+0000 7fe1070ba700 1 -- 172.21.15.107:0/3724152128 shutdown_connections 2023-08-10T10:42:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.694+0000 7fe1070ba700 1 --2- 172.21.15.107:0/3724152128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1000747a0 0x7fe100072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.694+0000 7fe1070ba700 1 --2- 172.21.15.107:0/3724152128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1001086d0 0x7fe10010ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:26.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.694+0000 7fe1070ba700 1 --2- 172.21.15.107:0/3724152128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1000731d0 0x7fe100073650 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:26.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.694+0000 7fe1070ba700 1 -- 172.21.15.107:0/3724152128 >> 172.21.15.107:0/3724152128 conn(0x7fe1000fbd60 msgr2=0x7fe1000fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:26.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.694+0000 7fe1070ba700 1 -- 172.21.15.107:0/3724152128 shutdown_connections 2023-08-10T10:42:26.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.694+0000 7fe1070ba700 1 -- 172.21.15.107:0/3724152128 wait complete. 2023-08-10T10:42:26.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.695+0000 7fe1070ba700 1 Processor -- start 2023-08-10T10:42:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.695+0000 7fe1070ba700 1 -- start start 2023-08-10T10:42:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe1070ba700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1000731d0 0x7fe1001986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe1070ba700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1000747a0 0x7fe100198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe1070ba700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1001086d0 0x7fe10019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe1070ba700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1001a0230 con 0x7fe1001086d0 2023-08-10T10:42:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe1070ba700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1001a0370 con 0x7fe1000747a0 2023-08-10T10:42:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe1070ba700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1001a0500 con 0x7fe1000731d0 2023-08-10T10:42:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe105657700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1001086d0 0x7fe10019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe104e56700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1000731d0 0x7fe1001986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe104e56700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1000731d0 0x7fe1001986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:43820/0 (socket says 172.21.15.107:43820) 2023-08-10T10:42:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe104e56700 1 -- 172.21.15.107:0/1054572257 learned_addr learned my addr 172.21.15.107:0/1054572257 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:42:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe0fffff700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1000747a0 0x7fe100198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe105657700 1 -- 172.21.15.107:0/1054572257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1000731d0 msgr2=0x7fe1001986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe105657700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1000731d0 0x7fe1001986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe105657700 1 -- 172.21.15.107:0/1054572257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1000747a0 msgr2=0x7fe100198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.696+0000 7fe105657700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1000747a0 0x7fe100198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.697+0000 7fe105657700 1 -- 172.21.15.107:0/1054572257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0095f0 con 0x7fe1001086d0 2023-08-10T10:42:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.697+0000 7fe105657700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1001086d0 0x7fe10019fc60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8007f40 tx=0x7fe0f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.697+0000 7fe0fdffb700 1 -- 172.21.15.107:0/1054572257 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8004db0 con 0x7fe1001086d0 2023-08-10T10:42:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.697+0000 7fe0fdffb700 1 -- 172.21.15.107:0/1054572257 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe0f800f040 con 0x7fe1001086d0 2023-08-10T10:42:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.697+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1001a07e0 con 0x7fe1001086d0 2023-08-10T10:42:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.697+0000 7fe0fdffb700 1 -- 172.21.15.107:0/1054572257 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8005850 con 0x7fe1001086d0 2023-08-10T10:42:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.697+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1001a0c90 con 0x7fe1001086d0 2023-08-10T10:42:26.702 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:26.578+0000 7f35ba0ac200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:42:26.703 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:26.698+0000 7f35ba0ac200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:42:26.703 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-mon[129604]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:26.703 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.703 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.703 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.704 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.704 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.698+0000 7fe0fdffb700 1 -- 172.21.15.107:0/1054572257 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fe0f800db20 con 0x7fe1001086d0 2023-08-10T10:42:26.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.698+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe100106d80 con 0x7fe1001086d0 2023-08-10T10:42:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.699+0000 7fe0fdffb700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0f00389e0 0x7fe0f003aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.699+0000 7fe0fdffb700 1 -- 172.21.15.107:0/1054572257 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe0f804abd0 con 0x7fe1001086d0 2023-08-10T10:42:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.699+0000 7fe104e56700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0f00389e0 0x7fe0f003aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.700+0000 7fe104e56700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0f00389e0 0x7fe0f003aea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4005950 tx=0x7fe0f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.704+0000 7fe0fdffb700 1 -- 172.21.15.107:0/1054572257 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe0f8005020 con 0x7fe1001086d0 2023-08-10T10:42:26.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:26 smithi107 ceph-mon[127953]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:26.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:26.908+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe100060bb0 con 0x7fe0f00389e0 2023-08-10T10:42:26.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:26 smithi195 ceph-mon[129938]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:26.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:26.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:27.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:26 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:26.818+0000 7f35ba0ac200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:42:27.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:27.060+0000 7f35ba0ac200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:42:27.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:27 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:27.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:27 smithi195 ceph-mon[129938]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:27.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:27 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:42:27.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:27 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:42:27.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:27 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:27.664 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:27.305+0000 7f837f3a8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:42:27.664 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:27.432+0000 7f837f3a8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:42:27.664 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:27.661+0000 7f837f3a8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:42:27.788 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:27.488+0000 7f35ba0ac200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:42:27.789 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:27.615+0000 7f35ba0ac200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:42:27.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:27.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-mon[129604]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:27.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:42:27.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:42:27.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:27.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:27 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:27.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:27 smithi107 ceph-mon[127953]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:27.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:27 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:42:27.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:27 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:42:27.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:27 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:28.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:27.788+0000 7f35ba0ac200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:42:28.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:27 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:27.916+0000 7f35ba0ac200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:42:28.348 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:28.047+0000 7f837f3a8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:42:28.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:28 smithi195 ceph-mon[129938]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:28.663 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:28.346+0000 7f837f3a8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:42:28.663 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:28.548+0000 7f837f3a8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:42:28.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:28 smithi157 ceph-mon[129604]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:28.789 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:28 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:28.495+0000 7f35ba0ac200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:42:28.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:28 smithi107 ceph-mon[127953]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:29.412 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:28.916+0000 7f837f3a8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:42:29.788 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:29.323+0000 7f35ba0ac200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:42:29.789 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:29.532+0000 7f35ba0ac200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:42:30.162 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:29.847+0000 7f837f3a8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:42:30.163 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:30.019+0000 7f837f3a8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:42:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:30.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:30.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T10:42:30.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T10:42:30.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:30.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/308406812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6be24c5b-22c4-465b-bbc9-a6debc566b31"}]: dispatch 2023-08-10T10:42:30.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/308406812' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6be24c5b-22c4-465b-bbc9-a6debc566b31"}]': finished 2023-08-10T10:42:30.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: osdmap e5: 1 total, 0 up, 1 in 2023-08-10T10:42:30.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:30.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:30.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T10:42:30.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T10:42:30.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:30.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/308406812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6be24c5b-22c4-465b-bbc9-a6debc566b31"}]: dispatch 2023-08-10T10:42:30.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/308406812' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6be24c5b-22c4-465b-bbc9-a6debc566b31"}]': finished 2023-08-10T10:42:30.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: osdmap e5: 1 total, 0 up, 1 in 2023-08-10T10:42:30.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:30.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:30.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:30.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:30.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-08-10T10:42:30.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-08-10T10:42:30.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:30.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/308406812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6be24c5b-22c4-465b-bbc9-a6debc566b31"}]: dispatch 2023-08-10T10:42:30.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/308406812' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6be24c5b-22c4-465b-bbc9-a6debc566b31"}]': finished 2023-08-10T10:42:30.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: osdmap e5: 1 total, 0 up, 1 in 2023-08-10T10:42:30.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:30.662 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:30.265+0000 7f837f3a8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:42:30.663 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:30.411+0000 7f837f3a8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:42:30.789 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:30 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:30.484+0000 7f35ba0ac200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:42:30.789 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:30 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:30.603+0000 7f35ba0ac200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:42:31.162 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:30.686+0000 7f837f3a8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:42:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:30 smithi195 ceph-mon[129938]: Reconfiguring mgr.x (unknown last config time)... 2023-08-10T10:42:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:30 smithi195 ceph-mon[129938]: Reconfiguring daemon mgr.x on smithi107 2023-08-10T10:42:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:30 smithi195 ceph-mon[129938]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:30 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2541298302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:42:31.186 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:30 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:30.825+0000 7f35ba0ac200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:42:31.186 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:31 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:31.185+0000 7f35ba0ac200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:42:31.186 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:30 smithi157 ceph-mon[129604]: Reconfiguring mgr.x (unknown last config time)... 2023-08-10T10:42:31.186 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:30 smithi157 ceph-mon[129604]: Reconfiguring daemon mgr.x on smithi107 2023-08-10T10:42:31.187 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:30 smithi157 ceph-mon[129604]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:31.187 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:30 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2541298302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:42:31.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:30 smithi107 ceph-mon[127953]: Reconfiguring mgr.x (unknown last config time)... 2023-08-10T10:42:31.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:30 smithi107 ceph-mon[127953]: Reconfiguring daemon mgr.x on smithi107 2023-08-10T10:42:31.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:30 smithi107 ceph-mon[127953]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:31.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:30 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2541298302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:42:31.788 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:31 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:31.464+0000 7f35ba0ac200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:42:31.788 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:31 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:31.653+0000 7f35ba0ac200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:42:31.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:31.945+0000 7fe0fdffb700 1 -- 172.21.15.107:0/1054572257 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 14) v1 ==== 90600+0+0 (secure 0 0 0) 0x7fe0f8015400 con 0x7fe1001086d0 2023-08-10T10:42:32.162 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:42:31 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:42:31.789+0000 7f837f3a8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:42:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:31 smithi195 ceph-mon[129938]: Standby manager daemon z started 2023-08-10T10:42:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:31 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T10:42:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:31 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:42:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:31 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T10:42:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:31 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:42:32.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:31 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:31.993+0000 7f35ba0ac200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:42:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:31 smithi157 ceph-mon[129604]: Standby manager daemon z started 2023-08-10T10:42:32.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:31 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T10:42:32.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:31 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:42:32.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:31 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T10:42:32.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:31 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:42:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:31 smithi107 ceph-mon[127953]: Standby manager daemon z started 2023-08-10T10:42:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:31 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T10:42:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:31 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:42:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:31 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T10:42:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:31 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.195:0/2371578134' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:42:33.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:32 smithi157 ceph-mon[129604]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:33.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:32 smithi157 ceph-mon[129604]: mgrmap e14: x(active, since 80s), standbys: z 2023-08-10T10:42:33.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T10:42:33.289 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:32 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:32.924+0000 7f35ba0ac200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:42:33.289 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:33 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:33.097+0000 7f35ba0ac200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:42:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:32 smithi107 ceph-mon[127953]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:32 smithi107 ceph-mon[127953]: mgrmap e14: x(active, since 80s), standbys: z 2023-08-10T10:42:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T10:42:33.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:32 smithi195 ceph-mon[129938]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:33.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:32 smithi195 ceph-mon[129938]: mgrmap e14: x(active, since 80s), standbys: z 2023-08-10T10:42:33.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T10:42:33.763 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:33 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:33.340+0000 7f35ba0ac200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:42:33.764 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:33 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:33.487+0000 7f35ba0ac200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:42:34.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:34 smithi157 ceph-mon[129604]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:34.788 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:33 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:33.762+0000 7f35ba0ac200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:42:34.815 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:34 smithi107 ceph-mon[127953]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:34.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:34 smithi195 ceph-mon[129938]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:35.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:42:34 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:42:34.837+0000 7f35ba0ac200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:42:35.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:35.512+0000 7fe0fdffb700 1 -- 172.21.15.107:0/1054572257 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7fe0f801cc10 con 0x7fe1001086d0 2023-08-10T10:42:35.782 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:35 smithi107 ceph-mon[127953]: Standby manager daemon y started 2023-08-10T10:42:35.782 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:35 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T10:42:35.782 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:35 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:42:35.782 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:35 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T10:42:35.782 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:35 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:42:35.782 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:35 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:35.783 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:35 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:35.783 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:35 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:35.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:35 smithi157 ceph-mon[129604]: Standby manager daemon y started 2023-08-10T10:42:35.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:35 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T10:42:35.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:35 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:42:35.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:35 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T10:42:35.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:35 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:42:35.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:35 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:35.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:35 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:35.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:35 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:35.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:35 smithi195 ceph-mon[129938]: Standby manager daemon y started 2023-08-10T10:42:35.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:35 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T10:42:35.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:35 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:42:35.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:35 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T10:42:35.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:35 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.157:0/759872251' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:42:35.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:35 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:35.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:35 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:35.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:35 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:36.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:36 smithi157 ceph-mon[129604]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:36.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:36 smithi157 ceph-mon[129604]: mgrmap e15: x(active, since 84s), standbys: z, y 2023-08-10T10:42:36.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T10:42:36.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:36.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:36.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:36.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:36 smithi107 ceph-mon[127953]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:36.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:36 smithi107 ceph-mon[127953]: mgrmap e15: x(active, since 84s), standbys: z, y 2023-08-10T10:42:36.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T10:42:36.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:36.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:36.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:36.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:36 smithi195 ceph-mon[129938]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:36.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:36 smithi195 ceph-mon[129938]: mgrmap e15: x(active, since 84s), standbys: z, y 2023-08-10T10:42:36.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T10:42:36.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:36.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:36.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:37.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:37 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-08-10T10:42:37.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:37 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:37.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:37 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-08-10T10:42:37.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:37 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:37.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:37 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-08-10T10:42:37.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:37 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:38.694 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:38 smithi107 ceph-mon[127953]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:38.694 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:38 smithi107 ceph-mon[127953]: Deploying daemon osd.0 on smithi107 2023-08-10T10:42:38.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:38 smithi157 ceph-mon[129604]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:38.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:38 smithi157 ceph-mon[129604]: Deploying daemon osd.0 on smithi107 2023-08-10T10:42:38.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:38 smithi195 ceph-mon[129938]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:38.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:38 smithi195 ceph-mon[129938]: Deploying daemon osd.0 on smithi107 2023-08-10T10:42:40.666 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:40 smithi107 ceph-mon[127953]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:40.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:40 smithi157 ceph-mon[129604]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:40.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:40 smithi195 ceph-mon[129938]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:42.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:42 smithi157 ceph-mon[129604]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:42.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:42 smithi107 ceph-mon[127953]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:42.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:42 smithi195 ceph-mon[129938]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:44.975 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:44 smithi107 ceph-mon[127953]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:44.975 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:44.975 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:44.975 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:45.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:44 smithi157 ceph-mon[129604]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:45.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:45.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:44 smithi195 ceph-mon[129938]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:47.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:46 smithi107 ceph-mon[127953]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:47.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:47.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:47.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:47.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:47.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:47.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:46 smithi157 ceph-mon[129604]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:47.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:46 smithi195 ceph-mon[129938]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:47.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:47.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:47.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.373+0000 7fe0fdffb700 1 -- 172.21.15.107:0/1054572257 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe100060bb0 con 0x7fe0f00389e0 2023-08-10T10:42:47.375 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 0 on host 'smithi107' 2023-08-10T10:42:47.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0f00389e0 msgr2=0x7fe0f003aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:47.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0f00389e0 0x7fe0f003aea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4005950 tx=0x7fe0f4009260 comp rx=0 tx=0).stop 2023-08-10T10:42:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1001086d0 msgr2=0x7fe10019fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1001086d0 0x7fe10019fc60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8007f40 tx=0x7fe0f800d3b0 comp rx=0 tx=0).stop 2023-08-10T10:42:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 shutdown_connections 2023-08-10T10:42:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0f00389e0 0x7fe0f003aea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1001086d0 0x7fe10019fc60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1000731d0 0x7fe1001986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 --2- 172.21.15.107:0/1054572257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1000747a0 0x7fe100198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:47.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.376+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 >> 172.21.15.107:0/1054572257 conn(0x7fe1000fbd60 msgr2=0x7fe1000fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:47.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.377+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 shutdown_connections 2023-08-10T10:42:47.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:42:47.377+0000 7fe1070ba700 1 -- 172.21.15.107:0/1054572257 wait complete. 2023-08-10T10:42:47.926 DEBUG:teuthology.orchestra.run.smithi107:osd.0> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.0.service 2023-08-10T10:42:47.930 INFO:tasks.cephadm:Deploying osd.1 on smithi157 with /dev/vg_nvme/lv_4... 2023-08-10T10:42:47.931 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-08-10T10:42:48.005 INFO:journalctl@ceph.osd.0.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:42:48.617 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:48.617 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:48.617 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:48.617 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:48 smithi107 ceph-mon[127953]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:48.617 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:48 smithi107 ceph-mon[127953]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-10T10:42:48.658 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T10:42:48.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:48 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:48.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:48 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:48.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:48 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:48.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:48 smithi195 ceph-mon[129938]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:48.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:48 smithi195 ceph-mon[129938]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-10T10:42:48.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:48 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:48.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:48 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:48.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:48 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:42:48.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:48 smithi157 ceph-mon[129604]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:48.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:48 smithi157 ceph-mon[129604]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-08-10T10:42:49.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:49 smithi157 ceph-mon[129604]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-08-10T10:42:49.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:49 smithi157 ceph-mon[129604]: osdmap e6: 1 total, 0 up, 1 in 2023-08-10T10:42:49.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:49 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:49.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:49 smithi157 ceph-mon[129604]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:42:49.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:49 smithi195 ceph-mon[129938]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-08-10T10:42:49.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:49 smithi195 ceph-mon[129938]: osdmap e6: 1 total, 0 up, 1 in 2023-08-10T10:42:49.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:49 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:49.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:49 smithi195 ceph-mon[129938]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:42:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:49 smithi107 ceph-mon[127953]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-08-10T10:42:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:49 smithi107 ceph-mon[127953]: osdmap e6: 1 total, 0 up, 1 in 2023-08-10T10:42:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:49 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:49.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:49 smithi107 ceph-mon[127953]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:42:49.828 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:42:49 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-0[140160]: 2023-08-10T10:42:49.368+0000 7f538b04b700 -1 osd.0 0 waiting for initial osdmap 2023-08-10T10:42:49.828 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:42:49 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-0[140160]: 2023-08-10T10:42:49.374+0000 7f538563d700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:42:50.607 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-08-10T10:42:50.607 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-08-10T10:42:50.607 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2023-08-10T10:42:50.607 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2023-08-10T10:42:50.607 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0421964 s, 248 MB/s 2023-08-10T10:42:50.608 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2023-08-10T10:42:50.642 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:50 smithi157 ceph-mon[129604]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:42:50.642 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:50 smithi157 ceph-mon[129604]: osdmap e7: 1 total, 0 up, 1 in 2023-08-10T10:42:50.642 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:50 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:50.642 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:50 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:50.643 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:50 smithi157 ceph-mon[129604]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:50 smithi195 ceph-mon[129938]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:42:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:50 smithi195 ceph-mon[129938]: osdmap e7: 1 total, 0 up, 1 in 2023-08-10T10:42:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:50 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:50 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:50 smithi195 ceph-mon[129938]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:50 smithi107 ceph-mon[127953]: from='osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:42:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:50 smithi107 ceph-mon[127953]: osdmap e7: 1 total, 0 up, 1 in 2023-08-10T10:42:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:50.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:50.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:50 smithi107 ceph-mon[127953]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-08-10T10:42:51.031 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi157:vg_nvme/lv_4 2023-08-10T10:42:51.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:42:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:42:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] boot 2023-08-10T10:42:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: osdmap e8: 1 total, 1 up, 1 in 2023-08-10T10:42:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi107 2023-08-10T10:42:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:42:51.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi107 to 17267M 2023-08-10T10:42:51.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:51.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:51.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.758 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T10:42:51.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:42:51.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:42:51.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] boot 2023-08-10T10:42:51.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: osdmap e8: 1 total, 1 up, 1 in 2023-08-10T10:42:51.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:51.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi107 2023-08-10T10:42:51.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:42:51.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi107 to 17267M 2023-08-10T10:42:51.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:51.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:51.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:42:51.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:42:51.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: osd.0 [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] boot 2023-08-10T10:42:51.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: osdmap e8: 1 total, 1 up, 1 in 2023-08-10T10:42:51.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:42:51.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi107 2023-08-10T10:42:51.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:42:51.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi107 to 17267M 2023-08-10T10:42:51.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:51.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:51.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:42:51.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:42:52.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:52 smithi157 ceph-mon[129604]: osdmap e9: 1 total, 1 up, 1 in 2023-08-10T10:42:52.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:52 smithi157 ceph-mon[129604]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:52.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:52 smithi195 ceph-mon[129938]: osdmap e9: 1 total, 1 up, 1 in 2023-08-10T10:42:52.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:52 smithi195 ceph-mon[129938]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:52.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:52 smithi107 ceph-mon[127953]: osdmap e9: 1 total, 1 up, 1 in 2023-08-10T10:42:52.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:52 smithi107 ceph-mon[127953]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:53.283 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.282+0000 7febfc255700 1 -- 172.21.15.157:0/1995107415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf41023a0 msgr2=0x7febf4108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.284 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.282+0000 7febfc255700 1 --2- 172.21.15.157:0/1995107415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf41023a0 0x7febf4108c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7febec00b0d0 tx=0x7febec00b3e0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.284 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.283+0000 7febfc255700 1 -- 172.21.15.157:0/1995107415 shutdown_connections 2023-08-10T10:42:53.284 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.283+0000 7febfc255700 1 --2- 172.21.15.157:0/1995107415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf41023a0 0x7febf4108c50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.284 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.283+0000 7febfc255700 1 --2- 172.21.15.157:0/1995107415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf4100800 0x7febf4100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.284 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.283+0000 7febfc255700 1 --2- 172.21.15.157:0/1995107415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4101a00 0x7febf4101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.283+0000 7febfc255700 1 -- 172.21.15.157:0/1995107415 >> 172.21.15.157:0/1995107415 conn(0x7febf40fbd60 msgr2=0x7febf40fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:42:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.283+0000 7febfc255700 1 -- 172.21.15.157:0/1995107415 shutdown_connections 2023-08-10T10:42:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.283+0000 7febfc255700 1 -- 172.21.15.157:0/1995107415 wait complete. 2023-08-10T10:42:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.284+0000 7febfc255700 1 Processor -- start 2023-08-10T10:42:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.284+0000 7febfc255700 1 -- start start 2023-08-10T10:42:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.284+0000 7febfc255700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf4100800 0x7febf4198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.284+0000 7febfc255700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4101a00 0x7febf4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.284+0000 7febfc255700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf41023a0 0x7febf419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.284+0000 7febfc255700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf41a01a0 con 0x7febf4101a00 2023-08-10T10:42:53.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.284+0000 7febfc255700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf41a02e0 con 0x7febf4100800 2023-08-10T10:42:53.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.284+0000 7febfc255700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf41a0470 con 0x7febf41023a0 2023-08-10T10:42:53.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf97f0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4101a00 0x7febf4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.287 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf97f0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4101a00 0x7febf4198ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.157:60706/0 (socket says 172.21.15.157:60706) 2023-08-10T10:42:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf97f0700 1 -- 172.21.15.157:0/3465102786 learned_addr learned my addr 172.21.15.157:0/3465102786 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-08-10T10:42:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf9ff1700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf4100800 0x7febf4198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febfa7f2700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf41023a0 0x7febf419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf97f0700 1 -- 172.21.15.157:0/3465102786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf41023a0 msgr2=0x7febf419fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf97f0700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf41023a0 0x7febf419fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf97f0700 1 -- 172.21.15.157:0/3465102786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf4100800 msgr2=0x7febf4198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:42:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf97f0700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf4100800 0x7febf4198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:42:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf97f0700 1 -- 172.21.15.157:0/3465102786 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec009d00 con 0x7febf4101a00 2023-08-10T10:42:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.285+0000 7febf97f0700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4101a00 0x7febf4198ba0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7febe400d980 tx=0x7febe400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.286+0000 7febeaffd700 1 -- 172.21.15.157:0/3465102786 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40098d0 con 0x7febf4101a00 2023-08-10T10:42:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.286+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf41a0750 con 0x7febf4101a00 2023-08-10T10:42:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.286+0000 7febeaffd700 1 -- 172.21.15.157:0/3465102786 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febe4010460 con 0x7febf4101a00 2023-08-10T10:42:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.286+0000 7febeaffd700 1 -- 172.21.15.157:0/3465102786 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400f3c0 con 0x7febf4101a00 2023-08-10T10:42:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.286+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf41a0ca0 con 0x7febf4101a00 2023-08-10T10:42:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.287+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf4192cb0 con 0x7febf4101a00 2023-08-10T10:42:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.289+0000 7febeaffd700 1 -- 172.21.15.157:0/3465102786 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7febe40105d0 con 0x7febf4101a00 2023-08-10T10:42:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.290+0000 7febeaffd700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7febe00a10c0 0x7febe00a3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:42:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.291+0000 7febeaffd700 1 -- 172.21.15.157:0/3465102786 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7febe40cac60 con 0x7febf4101a00 2023-08-10T10:42:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.291+0000 7febf9ff1700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7febe00a10c0 0x7febe00a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:42:53.292 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.292+0000 7febf9ff1700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7febe00a10c0 0x7febe00a3580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7febf4101860 tx=0x7febf000a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:42:53.293 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.293+0000 7febeaffd700 1 -- 172.21.15.157:0/3465102786 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7febe4095d80 con 0x7febf4101a00 2023-08-10T10:42:53.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:42:53.493+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7febf4060bb0 con 0x7febe00a10c0 2023-08-10T10:42:54.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:54 smithi157 ceph-mon[129604]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:54.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:54 smithi157 ceph-mon[129604]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:54.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:54 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:42:54.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:54 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:42:54.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:54 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:54.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:54 smithi107 ceph-mon[127953]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:54.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:54 smithi107 ceph-mon[127953]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:54.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:54 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:42:54.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:54 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:42:54.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:54 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:54.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:54 smithi195 ceph-mon[129938]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:42:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:54 smithi195 ceph-mon[129938]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:54 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:42:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:54 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:42:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:54 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:42:56.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:56 smithi157 ceph-mon[129604]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:56.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:56 smithi107 ceph-mon[127953]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:56.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:56 smithi195 ceph-mon[129938]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:57.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:57 smithi157 ceph-mon[129604]: from='client.? 172.21.15.157:0/672017636' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1197ceb3-455f-48be-9ed5-978800d57983"}]: dispatch 2023-08-10T10:42:57.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:57 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1197ceb3-455f-48be-9ed5-978800d57983"}]: dispatch 2023-08-10T10:42:57.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:57 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1197ceb3-455f-48be-9ed5-978800d57983"}]': finished 2023-08-10T10:42:57.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:57 smithi157 ceph-mon[129604]: osdmap e10: 2 total, 1 up, 2 in 2023-08-10T10:42:57.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:57 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:42:57.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:57 smithi157 ceph-mon[129604]: from='client.? 172.21.15.157:0/1366498067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:42:57.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:57 smithi107 ceph-mon[127953]: from='client.? 172.21.15.157:0/672017636' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1197ceb3-455f-48be-9ed5-978800d57983"}]: dispatch 2023-08-10T10:42:57.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:57 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1197ceb3-455f-48be-9ed5-978800d57983"}]: dispatch 2023-08-10T10:42:57.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:57 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1197ceb3-455f-48be-9ed5-978800d57983"}]': finished 2023-08-10T10:42:57.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:57 smithi107 ceph-mon[127953]: osdmap e10: 2 total, 1 up, 2 in 2023-08-10T10:42:57.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:57 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:42:57.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:57 smithi107 ceph-mon[127953]: from='client.? 172.21.15.157:0/1366498067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:42:57.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:57 smithi195 ceph-mon[129938]: from='client.? 172.21.15.157:0/672017636' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1197ceb3-455f-48be-9ed5-978800d57983"}]: dispatch 2023-08-10T10:42:57.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:57 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1197ceb3-455f-48be-9ed5-978800d57983"}]: dispatch 2023-08-10T10:42:57.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:57 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1197ceb3-455f-48be-9ed5-978800d57983"}]': finished 2023-08-10T10:42:57.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:57 smithi195 ceph-mon[129938]: osdmap e10: 2 total, 1 up, 2 in 2023-08-10T10:42:57.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:57 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:42:57.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:57 smithi195 ceph-mon[129938]: from='client.? 172.21.15.157:0/1366498067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:42:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:42:58 smithi195 ceph-mon[129938]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:42:58 smithi157 ceph-mon[129604]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:42:59.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:42:58 smithi107 ceph-mon[127953]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:00.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:00 smithi157 ceph-mon[129604]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:00.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:00 smithi195 ceph-mon[129938]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:00 smithi107 ceph-mon[127953]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:02.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:02 smithi195 ceph-mon[129938]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:02.916 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:02 smithi157 ceph-mon[129604]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:03.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:02 smithi107 ceph-mon[127953]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:04.871 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:04 smithi157 ceph-mon[129604]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:04.871 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:04 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-08-10T10:43:04.871 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:04 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:04.871 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:04 smithi157 ceph-mon[129604]: Deploying daemon osd.1 on smithi157 2023-08-10T10:43:04.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:04 smithi195 ceph-mon[129938]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:04.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:04 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-08-10T10:43:04.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:04 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:04.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:04 smithi195 ceph-mon[129938]: Deploying daemon osd.1 on smithi157 2023-08-10T10:43:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:04 smithi107 ceph-mon[127953]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:04 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-08-10T10:43:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:04 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:04 smithi107 ceph-mon[127953]: Deploying daemon osd.1 on smithi157 2023-08-10T10:43:06.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:06 smithi157 ceph-mon[129604]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:06.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:06 smithi195 ceph-mon[129938]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:06 smithi107 ceph-mon[127953]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:08.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:08 smithi195 ceph-mon[129938]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:08.990 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:08 smithi157 ceph-mon[129604]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:09.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:08 smithi107 ceph-mon[127953]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:10.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:10 smithi195 ceph-mon[129938]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:10.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:10 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:10.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:10 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:10.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:10 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:11.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:10 smithi157 ceph-mon[129604]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:11.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:10 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:11.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:10 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:11.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:10 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:10 smithi107 ceph-mon[127953]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:10 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:10 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:11.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:10 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:12.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:12 smithi157 ceph-mon[129604]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:12.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:12 smithi195 ceph-mon[129938]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:12 smithi107 ceph-mon[127953]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:13.773 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.772+0000 7febeaffd700 1 -- 172.21.15.157:0/3465102786 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7febf4060bb0 con 0x7febe00a10c0 2023-08-10T10:43:13.773 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 1 on host 'smithi157' 2023-08-10T10:43:13.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.774+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7febe00a10c0 msgr2=0x7febe00a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:13.775 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.774+0000 7febfc255700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7febe00a10c0 0x7febe00a3580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7febf4101860 tx=0x7febf000a3b0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.774+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4101a00 msgr2=0x7febf4198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:13.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.774+0000 7febfc255700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4101a00 0x7febf4198ba0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7febe400d980 tx=0x7febe400dc90 comp rx=0 tx=0).stop 2023-08-10T10:43:13.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.775+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 shutdown_connections 2023-08-10T10:43:13.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.775+0000 7febfc255700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7febe00a10c0 0x7febe00a3580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.775+0000 7febfc255700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febf4100800 0x7febf4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.776 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.775+0000 7febfc255700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf41023a0 0x7febf419fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.775+0000 7febfc255700 1 --2- 172.21.15.157:0/3465102786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7febf4101a00 0x7febf4198ba0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:13.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.775+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 >> 172.21.15.157:0/3465102786 conn(0x7febf40fbd60 msgr2=0x7febf41072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:13.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.775+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 shutdown_connections 2023-08-10T10:43:13.777 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:43:13.775+0000 7febfc255700 1 -- 172.21.15.157:0/3465102786 wait complete. 2023-08-10T10:43:13.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:13.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:13.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:13.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:13.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:13.950 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:13.951 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:13.951 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:14.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:14.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:14.282 DEBUG:teuthology.orchestra.run.smithi157:osd.1> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.1.service 2023-08-10T10:43:14.288 INFO:tasks.cephadm:Deploying osd.2 on smithi195 with /dev/vg_nvme/lv_4... 2023-08-10T10:43:14.288 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-08-10T10:43:14.371 INFO:journalctl@ceph.osd.1.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:43:15.015 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:43:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:14 smithi107 ceph-mon[127953]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:14 smithi107 ceph-mon[127953]: from='osd.1 [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T10:43:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:14 smithi107 ceph-mon[127953]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T10:43:15.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:14 smithi195 ceph-mon[129938]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:14 smithi195 ceph-mon[129938]: from='osd.1 [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T10:43:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:14 smithi195 ceph-mon[129938]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T10:43:15.225 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:14 smithi157 ceph-mon[129604]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:15.225 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:14 smithi157 ceph-mon[129604]: from='osd.1 [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T10:43:15.226 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:14 smithi157 ceph-mon[129604]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-08-10T10:43:15.846 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:15 smithi195 ceph-mon[129938]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-08-10T10:43:15.846 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:15 smithi195 ceph-mon[129938]: osdmap e11: 2 total, 1 up, 2 in 2023-08-10T10:43:15.847 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:15.847 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:15 smithi195 ceph-mon[129938]: from='osd.1 [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:43:15.847 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:15 smithi195 ceph-mon[129938]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:43:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:15 smithi107 ceph-mon[127953]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-08-10T10:43:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:15 smithi107 ceph-mon[127953]: osdmap e11: 2 total, 1 up, 2 in 2023-08-10T10:43:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:15 smithi107 ceph-mon[127953]: from='osd.1 [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:43:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:15 smithi107 ceph-mon[127953]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:43:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:15 smithi157 ceph-mon[129604]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-08-10T10:43:16.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:15 smithi157 ceph-mon[129604]: osdmap e11: 2 total, 1 up, 2 in 2023-08-10T10:43:16.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:16.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:15 smithi157 ceph-mon[129604]: from='osd.1 [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:43:16.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:15 smithi157 ceph-mon[129604]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:43:16.289 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:15 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-1[134715]: 2023-08-10T10:43:15.825+0000 7fee1e1e6700 -1 osd.1 0 waiting for initial osdmap 2023-08-10T10:43:16.289 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:15 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-1[134715]: 2023-08-10T10:43:15.830+0000 7fee19fdb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:43:16.975 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-08-10T10:43:16.975 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-08-10T10:43:16.975 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-08-10T10:43:16.975 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-08-10T10:43:16.976 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0298212 s, 352 MB/s 2023-08-10T10:43:16.976 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 2023-08-10T10:43:16.976 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-08-10T10:43:17.020 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:16 smithi157 ceph-mon[129604]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:17.021 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:16 smithi157 ceph-mon[129604]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:43:17.021 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:16 smithi157 ceph-mon[129604]: osdmap e12: 2 total, 1 up, 2 in 2023-08-10T10:43:17.021 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:17.022 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:16 smithi107 ceph-mon[127953]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:16 smithi107 ceph-mon[127953]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:43:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:16 smithi107 ceph-mon[127953]: osdmap e12: 2 total, 1 up, 2 in 2023-08-10T10:43:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:17.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:16 smithi195 ceph-mon[129938]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-08-10T10:43:17.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:16 smithi195 ceph-mon[129938]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:43:17.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:16 smithi195 ceph-mon[129938]: osdmap e12: 2 total, 1 up, 2 in 2023-08-10T10:43:17.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:17.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:17.484 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2023-08-10T10:43:18.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:43:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:43:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: osd.1 [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] boot 2023-08-10T10:43:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: osdmap e13: 2 total, 2 up, 2 in 2023-08-10T10:43:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi157 2023-08-10T10:43:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:43:18.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi157 to 17267M 2023-08-10T10:43:18.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:18.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:18.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.206 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:43:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:43:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:43:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: osd.1 [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] boot 2023-08-10T10:43:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: osdmap e13: 2 total, 2 up, 2 in 2023-08-10T10:43:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi157 2023-08-10T10:43:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:43:18.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi157 to 17267M 2023-08-10T10:43:18.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:18.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:18.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:43:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:43:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: osd.1 [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] boot 2023-08-10T10:43:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: osdmap e13: 2 total, 2 up, 2 in 2023-08-10T10:43:18.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:43:18.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi157 2023-08-10T10:43:18.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:43:18.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi157 to 17267M 2023-08-10T10:43:18.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:18.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:18.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:18.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:19 smithi195 ceph-mon[129938]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:19 smithi195 ceph-mon[129938]: osdmap e14: 2 total, 2 up, 2 in 2023-08-10T10:43:19.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:19 smithi157 ceph-mon[129604]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:19.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:19 smithi157 ceph-mon[129604]: osdmap e14: 2 total, 2 up, 2 in 2023-08-10T10:43:19.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:19 smithi107 ceph-mon[127953]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:19.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:19 smithi107 ceph-mon[127953]: osdmap e14: 2 total, 2 up, 2 in 2023-08-10T10:43:19.729 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.727+0000 7f6312f59700 1 -- 172.21.15.195:0/3600696772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0747a0 msgr2=0x7f630c072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.729 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.727+0000 7f6312f59700 1 --2- 172.21.15.195:0/3600696772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0747a0 0x7f630c072c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6300009990 tx=0x7f6300009ca0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.729 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.727+0000 7f6312f59700 1 -- 172.21.15.195:0/3600696772 shutdown_connections 2023-08-10T10:43:19.729 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.727+0000 7f6312f59700 1 --2- 172.21.15.195:0/3600696772 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f630c1086d0 0x7f630c10ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.729 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.727+0000 7f6312f59700 1 --2- 172.21.15.195:0/3600696772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0747a0 0x7f630c072c00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.730 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.727+0000 7f6312f59700 1 --2- 172.21.15.195:0/3600696772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f630c0731d0 0x7f630c073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.730 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.727+0000 7f6312f59700 1 -- 172.21.15.195:0/3600696772 >> 172.21.15.195:0/3600696772 conn(0x7f630c0fbd60 msgr2=0x7f630c0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:19.730 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.728+0000 7f6312f59700 1 -- 172.21.15.195:0/3600696772 shutdown_connections 2023-08-10T10:43:19.730 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.728+0000 7f6312f59700 1 -- 172.21.15.195:0/3600696772 wait complete. 2023-08-10T10:43:19.732 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6312f59700 1 Processor -- start 2023-08-10T10:43:19.732 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6312f59700 1 -- start start 2023-08-10T10:43:19.732 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6312f59700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0731d0 0x7f630c1986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.732 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6312f59700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f630c0747a0 0x7f630c198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.733 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6312f59700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f630c1086d0 0x7f630c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.733 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6312f59700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c1a0270 con 0x7f630c1086d0 2023-08-10T10:43:19.733 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6312f59700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c1a03b0 con 0x7f630c0747a0 2023-08-10T10:43:19.733 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6312f59700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c1a0540 con 0x7f630c0731d0 2023-08-10T10:43:19.733 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6310cf5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0731d0 0x7f630c1986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.733 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6310cf5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0731d0 0x7f630c1986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:36386/0 (socket says 172.21.15.195:36386) 2023-08-10T10:43:19.733 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.729+0000 7f6310cf5700 1 -- 172.21.15.195:0/251074637 learned_addr learned my addr 172.21.15.195:0/251074637 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:43:19.734 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f630bfff700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f630c0747a0 0x7f630c198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.734 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6310cf5700 1 -- 172.21.15.195:0/251074637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f630c0747a0 msgr2=0x7f630c198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.734 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6310cf5700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f630c0747a0 0x7f630c198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.734 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6310cf5700 1 -- 172.21.15.195:0/251074637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f630c1086d0 msgr2=0x7f630c19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:19.734 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6310cf5700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f630c1086d0 0x7f630c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:19.734 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6310cf5700 1 -- 172.21.15.195:0/251074637 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63000095f0 con 0x7f630c0731d0 2023-08-10T10:43:19.735 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f630bfff700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f630c0747a0 0x7f630c198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:43:19.735 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6310cf5700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0731d0 0x7f630c1986e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6300005740 tx=0x7f6300005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:19.735 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6309ffb700 1 -- 172.21.15.195:0/251074637 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630001d070 con 0x7f630c0731d0 2023-08-10T10:43:19.735 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6309ffb700 1 -- 172.21.15.195:0/251074637 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6300004100 con 0x7f630c0731d0 2023-08-10T10:43:19.735 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c1a07c0 con 0x7f630c0731d0 2023-08-10T10:43:19.735 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.730+0000 7f6309ffb700 1 -- 172.21.15.195:0/251074637 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300022ce0 con 0x7f630c0731d0 2023-08-10T10:43:19.735 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.731+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c1a0c30 con 0x7f630c0731d0 2023-08-10T10:43:19.736 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.732+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c106d80 con 0x7f630c0731d0 2023-08-10T10:43:19.737 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.733+0000 7f6309ffb700 1 -- 172.21.15.195:0/251074637 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7f6300022470 con 0x7f630c0731d0 2023-08-10T10:43:19.737 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.735+0000 7f6309ffb700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f62fc0a1140 0x7f62fc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:19.737 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.735+0000 7f6309ffb700 1 -- 172.21.15.195:0/251074637 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f63000cc580 con 0x7f630c0731d0 2023-08-10T10:43:19.737 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.735+0000 7f630bfff700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f62fc0a1140 0x7f62fc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:19.737 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.736+0000 7f630bfff700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f62fc0a1140 0x7f62fc0a3600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f62f8005950 tx=0x7f62f80058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:19.740 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.739+0000 7f6309ffb700 1 -- 172.21.15.195:0/251074637 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6300097510 con 0x7f630c0731d0 2023-08-10T10:43:19.943 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:19.943+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f630c060bb0 con 0x7f62fc0a1140 2023-08-10T10:43:20.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:43:20.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:43:20.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:20.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:43:20.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:43:20.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:20.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:43:20.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:43:20.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:21.326 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:21 smithi195 ceph-mon[129938]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:21.327 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:21 smithi195 ceph-mon[129938]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:43:21.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:21 smithi157 ceph-mon[129604]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:21.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:21 smithi157 ceph-mon[129604]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:43:21.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:21 smithi107 ceph-mon[127953]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:21.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:21 smithi107 ceph-mon[127953]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:43:23.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:23 smithi195 ceph-mon[129938]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:23 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/1376573651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "733c3626-a769-4765-9316-705c451387ec"}]: dispatch 2023-08-10T10:43:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:23 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "733c3626-a769-4765-9316-705c451387ec"}]: dispatch 2023-08-10T10:43:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:23 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "733c3626-a769-4765-9316-705c451387ec"}]': finished 2023-08-10T10:43:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:23 smithi195 ceph-mon[129938]: osdmap e15: 3 total, 2 up, 3 in 2023-08-10T10:43:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:23 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:23.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:23 smithi157 ceph-mon[129604]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:23.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:23 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/1376573651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "733c3626-a769-4765-9316-705c451387ec"}]: dispatch 2023-08-10T10:43:23.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:23 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "733c3626-a769-4765-9316-705c451387ec"}]: dispatch 2023-08-10T10:43:23.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:23 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "733c3626-a769-4765-9316-705c451387ec"}]': finished 2023-08-10T10:43:23.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:23 smithi157 ceph-mon[129604]: osdmap e15: 3 total, 2 up, 3 in 2023-08-10T10:43:23.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:23 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:23.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:23 smithi107 ceph-mon[127953]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:23.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:23 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/1376573651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "733c3626-a769-4765-9316-705c451387ec"}]: dispatch 2023-08-10T10:43:23.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:23 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "733c3626-a769-4765-9316-705c451387ec"}]: dispatch 2023-08-10T10:43:23.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:23 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "733c3626-a769-4765-9316-705c451387ec"}]': finished 2023-08-10T10:43:23.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:23 smithi107 ceph-mon[127953]: osdmap e15: 3 total, 2 up, 3 in 2023-08-10T10:43:23.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:23 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:24.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:24 smithi157 ceph-mon[129604]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:24.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:24 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/3689014193' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:43:24.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:24 smithi107 ceph-mon[127953]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:24.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:24 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/3689014193' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:43:24.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:24 smithi195 ceph-mon[129938]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:24.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:24 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/3689014193' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:43:26.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:26 smithi157 ceph-mon[129604]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:26.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:26 smithi107 ceph-mon[127953]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:26.861 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:26 smithi195 ceph-mon[129938]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:28.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:28 smithi195 ceph-mon[129938]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:28.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:28 smithi157 ceph-mon[129604]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:28.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:28 smithi107 ceph-mon[127953]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:30.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:30 smithi195 ceph-mon[129938]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:30.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:30 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-08-10T10:43:30.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:30 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:30.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:30 smithi157 ceph-mon[129604]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:30.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:30 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-08-10T10:43:30.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:30 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:30 smithi107 ceph-mon[127953]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:30 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-08-10T10:43:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:30 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:31.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:31 smithi157 ceph-mon[129604]: Deploying daemon osd.2 on smithi195 2023-08-10T10:43:31.795 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:31 smithi195 ceph-mon[129938]: Deploying daemon osd.2 on smithi195 2023-08-10T10:43:31.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:31 smithi107 ceph-mon[127953]: Deploying daemon osd.2 on smithi195 2023-08-10T10:43:32.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:32 smithi157 ceph-mon[129604]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:32.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:32 smithi107 ceph-mon[127953]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:32.840 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:32 smithi195 ceph-mon[129938]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:34.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:34 smithi157 ceph-mon[129604]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:34.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:34 smithi107 ceph-mon[127953]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:34.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:34 smithi195 ceph-mon[129938]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:36.580 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:36 smithi195 ceph-mon[129938]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:36.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:36 smithi157 ceph-mon[129604]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:36.826 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:36 smithi107 ceph-mon[127953]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:37.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:37 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:37.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:37 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:37.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:37 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:38.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:37 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:38.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:37 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:38.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:37 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:37 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:37 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:37 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:38.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:38 smithi195 ceph-mon[129938]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:39.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:38 smithi157 ceph-mon[129604]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:38 smithi107 ceph-mon[127953]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:40.216 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.216+0000 7f6309ffb700 1 -- 172.21.15.195:0/251074637 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f630c060bb0 con 0x7f62fc0a1140 2023-08-10T10:43:40.217 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 2 on host 'smithi195' 2023-08-10T10:43:40.219 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f62fc0a1140 msgr2=0x7f62fc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:40.219 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f62fc0a1140 0x7f62fc0a3600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f62f8005950 tx=0x7f62f80058e0 comp rx=0 tx=0).stop 2023-08-10T10:43:40.219 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0731d0 msgr2=0x7f630c1986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:40.219 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0731d0 0x7f630c1986e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6300005740 tx=0x7f6300005ef0 comp rx=0 tx=0).stop 2023-08-10T10:43:40.220 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 shutdown_connections 2023-08-10T10:43:40.220 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f62fc0a1140 0x7f62fc0a3600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:40.220 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f630c1086d0 0x7f630c19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:40.220 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f630c0731d0 0x7f630c1986e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:40.220 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 --2- 172.21.15.195:0/251074637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f630c0747a0 0x7f630c198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:40.220 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 >> 172.21.15.195:0/251074637 conn(0x7f630c0fbd60 msgr2=0x7f630c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:40.220 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 shutdown_connections 2023-08-10T10:43:40.221 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:43:40.218+0000 7f6312f59700 1 -- 172.21.15.195:0/251074637 wait complete. 2023-08-10T10:43:40.447 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:40 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.447 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:40 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.447 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:40 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:40.447 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:40 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:40.447 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:40 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.448 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:40 smithi195 ceph-mon[129938]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:40.448 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:40 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:40.449 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:40 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.449 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:40 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.724 DEBUG:teuthology.orchestra.run.smithi195:osd.2> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.2.service 2023-08-10T10:43:40.728 INFO:tasks.cephadm:Deploying osd.3 on smithi107 with /dev/vg_nvme/lv_3... 2023-08-10T10:43:40.729 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-08-10T10:43:40.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:40 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:40 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:40 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:40.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:40 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:40.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:40 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:40 smithi157 ceph-mon[129604]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:40.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:40 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:40.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:40 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:40 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.798 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:40 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.798 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:40 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.798 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:40 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:40.798 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:40 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:40.799 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:40 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.799 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:40 smithi107 ceph-mon[127953]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:40.799 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:40 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:43:40.799 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:40 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.799 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:40 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:40.811 INFO:journalctl@ceph.osd.2.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:43:41.456 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:43:41.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:41 smithi195 ceph-mon[129938]: from='osd.2 [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T10:43:41.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:41 smithi195 ceph-mon[129938]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T10:43:41.763 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:41 smithi107 ceph-mon[127953]: from='osd.2 [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T10:43:41.763 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:41 smithi107 ceph-mon[127953]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T10:43:41.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:41 smithi157 ceph-mon[129604]: from='osd.2 [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T10:43:41.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:41 smithi157 ceph-mon[129604]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-08-10T10:43:42.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:42 smithi107 ceph-mon[127953]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-08-10T10:43:42.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:42 smithi107 ceph-mon[127953]: osdmap e16: 3 total, 2 up, 3 in 2023-08-10T10:43:42.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:42.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:42 smithi107 ceph-mon[127953]: from='osd.2 [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:43:42.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:42 smithi107 ceph-mon[127953]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:43:42.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:42 smithi107 ceph-mon[127953]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:42.662 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:42 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-2[135752]: 2023-08-10T10:43:42.388+0000 7fa848a5b700 -1 osd.2 0 waiting for initial osdmap 2023-08-10T10:43:42.663 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:42 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-2[135752]: 2023-08-10T10:43:42.394+0000 7fa84184a700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:43:42.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:42 smithi195 ceph-mon[129938]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-08-10T10:43:42.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:42 smithi195 ceph-mon[129938]: osdmap e16: 3 total, 2 up, 3 in 2023-08-10T10:43:42.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:42.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:42 smithi195 ceph-mon[129938]: from='osd.2 [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:43:42.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:42 smithi195 ceph-mon[129938]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:43:42.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:42 smithi195 ceph-mon[129938]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:42.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:42 smithi157 ceph-mon[129604]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-08-10T10:43:42.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:42 smithi157 ceph-mon[129604]: osdmap e16: 3 total, 2 up, 3 in 2023-08-10T10:43:42.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:42.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:42 smithi157 ceph-mon[129604]: from='osd.2 [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:43:42.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:42 smithi157 ceph-mon[129604]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:43:42.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:42 smithi157 ceph-mon[129604]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-08-10T10:43:43.499 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-08-10T10:43:43.500 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-08-10T10:43:43.500 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2023-08-10T10:43:43.500 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2023-08-10T10:43:43.500 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0387475 s, 271 MB/s 2023-08-10T10:43:43.500 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2023-08-10T10:43:43.662 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:43 smithi107 ceph-mon[127953]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:43:43.662 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:43 smithi107 ceph-mon[127953]: osdmap e17: 3 total, 2 up, 3 in 2023-08-10T10:43:43.663 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:43 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:43.663 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:43 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:43.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:43 smithi195 ceph-mon[129938]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:43:43.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:43 smithi195 ceph-mon[129938]: osdmap e17: 3 total, 2 up, 3 in 2023-08-10T10:43:43.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:43 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:43.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:43 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:43.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:43 smithi157 ceph-mon[129604]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:43:43.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:43 smithi157 ceph-mon[129604]: osdmap e17: 3 total, 2 up, 3 in 2023-08-10T10:43:43.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:43 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:43.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:43 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:44.035 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi107:vg_nvme/lv_3 2023-08-10T10:43:44.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:43:44.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:43:44.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: osd.2 [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] boot 2023-08-10T10:43:44.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: osdmap e18: 3 total, 3 up, 3 in 2023-08-10T10:43:44.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:44.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: pgmap v84: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:44.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-08-10T10:43:44.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi195 2023-08-10T10:43:44.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:43:44.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi195 to 17267M 2023-08-10T10:43:44.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:44.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:44.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.767 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:43:44.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:43:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:43:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: osd.2 [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] boot 2023-08-10T10:43:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: osdmap e18: 3 total, 3 up, 3 in 2023-08-10T10:43:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: pgmap v84: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-08-10T10:43:44.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi195 2023-08-10T10:43:44.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:43:44.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi195 to 17267M 2023-08-10T10:43:44.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:44.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:44.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:43:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:43:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: osd.2 [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] boot 2023-08-10T10:43:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: osdmap e18: 3 total, 3 up, 3 in 2023-08-10T10:43:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:43:44.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: pgmap v84: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:44.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-08-10T10:43:44.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi195 2023-08-10T10:43:44.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:43:44.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi195 to 17267M 2023-08-10T10:43:44.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:44.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:44.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:43:44.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:45.656 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:45 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-08-10T10:43:45.656 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:45 smithi107 ceph-mon[127953]: osdmap e19: 3 total, 3 up, 3 in 2023-08-10T10:43:45.657 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:45 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-08-10T10:43:45.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:45 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-08-10T10:43:45.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:45 smithi157 ceph-mon[129604]: osdmap e19: 3 total, 3 up, 3 in 2023-08-10T10:43:45.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:45 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-08-10T10:43:45.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:45 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-08-10T10:43:45.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:45 smithi195 ceph-mon[129938]: osdmap e19: 3 total, 3 up, 3 in 2023-08-10T10:43:45.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:45 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-08-10T10:43:46.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.319+0000 7eff6669f700 1 -- 172.21.15.107:0/4179139921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60100800 msgr2=0x7eff60100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:46.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.319+0000 7eff6669f700 1 --2- 172.21.15.107:0/4179139921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60100800 0x7eff60100c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff500099c0 tx=0x7eff50009cd0 comp rx=0 tx=0).stop 2023-08-10T10:43:46.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.319+0000 7eff6669f700 1 -- 172.21.15.107:0/4179139921 shutdown_connections 2023-08-10T10:43:46.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.319+0000 7eff6669f700 1 --2- 172.21.15.107:0/4179139921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff601023a0 0x7eff60108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:46.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.319+0000 7eff6669f700 1 --2- 172.21.15.107:0/4179139921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60100800 0x7eff60100c20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:46.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.319+0000 7eff6669f700 1 --2- 172.21.15.107:0/4179139921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff60101a00 0x7eff60101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:46.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.319+0000 7eff6669f700 1 -- 172.21.15.107:0/4179139921 >> 172.21.15.107:0/4179139921 conn(0x7eff600fbd60 msgr2=0x7eff600fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:43:46.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.319+0000 7eff6669f700 1 -- 172.21.15.107:0/4179139921 shutdown_connections 2023-08-10T10:43:46.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.319+0000 7eff6669f700 1 -- 172.21.15.107:0/4179139921 wait complete. 2023-08-10T10:43:46.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.321+0000 7eff6669f700 1 Processor -- start 2023-08-10T10:43:46.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.321+0000 7eff6669f700 1 -- start start 2023-08-10T10:43:46.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.321+0000 7eff6669f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff60100800 0x7eff601963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:46.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.321+0000 7eff6669f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60101a00 0x7eff60196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:46.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.321+0000 7eff6669f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff601023a0 0x7eff6019d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:46.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.321+0000 7eff6669f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6019df80 con 0x7eff60101a00 2023-08-10T10:43:46.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.321+0000 7eff6669f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6019e0c0 con 0x7eff601023a0 2023-08-10T10:43:46.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.321+0000 7eff6669f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6019e250 con 0x7eff60100800 2023-08-10T10:43:46.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60101a00 0x7eff60196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:46.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60101a00 0x7eff60196930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37804/0 (socket says 172.21.15.107:37804) 2023-08-10T10:43:46.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5f7fe700 1 -- 172.21.15.107:0/2515242110 learned_addr learned my addr 172.21.15.107:0/2515242110 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:43:46.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5ffff700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff60100800 0x7eff601963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:46.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff64c3c700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff601023a0 0x7eff6019d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:46.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5f7fe700 1 -- 172.21.15.107:0/2515242110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff60100800 msgr2=0x7eff601963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:46.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5f7fe700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff60100800 0x7eff601963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:46.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5f7fe700 1 -- 172.21.15.107:0/2515242110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff601023a0 msgr2=0x7eff6019d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:43:46.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5f7fe700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff601023a0 0x7eff6019d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:43:46.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5f7fe700 1 -- 172.21.15.107:0/2515242110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500095f0 con 0x7eff60101a00 2023-08-10T10:43:46.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff64c3c700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff601023a0 0x7eff6019d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:43:46.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.322+0000 7eff5f7fe700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60101a00 0x7eff60196930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff5400d980 tx=0x7eff5400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:46.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.323+0000 7eff5d7fa700 1 -- 172.21.15.107:0/2515242110 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff54009b40 con 0x7eff60101a00 2023-08-10T10:43:46.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.323+0000 7eff5d7fa700 1 -- 172.21.15.107:0/2515242110 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff5400b6e0 con 0x7eff60101a00 2023-08-10T10:43:46.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.323+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6019e530 con 0x7eff60101a00 2023-08-10T10:43:46.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.323+0000 7eff5d7fa700 1 -- 172.21.15.107:0/2515242110 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400f3c0 con 0x7eff60101a00 2023-08-10T10:43:46.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.323+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6019ea80 con 0x7eff60101a00 2023-08-10T10:43:46.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.324+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff60107ed0 con 0x7eff60101a00 2023-08-10T10:43:46.332 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:43:46 smithi107 sudo[143070]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T10:43:46.332 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:43:46 smithi107 sudo[143070]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:46.332 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:43:46 smithi107 sudo[143070]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:46.332 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:43:46 smithi107 sudo[143070]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:46.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.327+0000 7eff5d7fa700 1 -- 172.21.15.107:0/2515242110 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7eff54010460 con 0x7eff60101a00 2023-08-10T10:43:46.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.329+0000 7eff5d7fa700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff480a1140 0x7eff480a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:43:46.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.329+0000 7eff5d7fa700 1 -- 172.21.15.107:0/2515242110 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3237+0+0 (secure 0 0 0) 0x7eff540cb330 con 0x7eff60101a00 2023-08-10T10:43:46.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.329+0000 7eff5ffff700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff480a1140 0x7eff480a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:43:46.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.330+0000 7eff5ffff700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff480a1140 0x7eff480a3600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff50006010 tx=0x7eff50005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:43:46.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.332+0000 7eff5d7fa700 1 -- 172.21.15.107:0/2515242110 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7eff54095e90 con 0x7eff60101a00 2023-08-10T10:43:46.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:46.544+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7eff60060bb0 con 0x7eff480a1140 2023-08-10T10:43:46.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:46 smithi157 ceph-mon[129604]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:46.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-08-10T10:43:46.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:46 smithi157 ceph-mon[129604]: osdmap e20: 3 total, 3 up, 3 in 2023-08-10T10:43:46.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:46 smithi107 ceph-mon[127953]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:46.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-08-10T10:43:46.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:46 smithi107 ceph-mon[127953]: osdmap e20: 3 total, 3 up, 3 in 2023-08-10T10:43:46.827 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:43:46 smithi107 sudo[143163]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T10:43:46.828 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:43:46 smithi107 sudo[143163]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:46.828 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:43:46 smithi107 sudo[143163]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:46.828 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 10:43:46 smithi107 sudo[143163]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:46.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:46 smithi195 ceph-mon[129938]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-08-10T10:43:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:46 smithi195 ceph-mon[129938]: osdmap e20: 3 total, 3 up, 3 in 2023-08-10T10:43:47.532 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:47 smithi157 sudo[137121]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T10:43:47.532 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:47 smithi157 sudo[137121]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:47.532 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:47 smithi157 sudo[137121]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:47.532 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:47 smithi157 sudo[137121]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:47.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:47 smithi157 ceph-mon[129604]: osdmap e21: 3 total, 3 up, 3 in 2023-08-10T10:43:47.787 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:47 smithi157 ceph-mon[129604]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:43:47.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:47 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:43:47.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:47 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:43:47.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:47 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:47.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:47 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:47.826 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:47 smithi107 ceph-mon[127953]: osdmap e21: 3 total, 3 up, 3 in 2023-08-10T10:43:47.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:47 smithi107 ceph-mon[127953]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:43:47.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:47 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:43:47.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:47 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:43:47.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:47 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:47.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:47 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:47.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:47 smithi195 ceph-mon[129938]: osdmap e21: 3 total, 3 up, 3 in 2023-08-10T10:43:47.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:47 smithi195 ceph-mon[129938]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:43:47.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:47 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:43:47.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:47 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:43:47.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:47 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:47.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:47 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:48.038 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:47 smithi157 sudo[137124]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T10:43:48.039 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:47 smithi157 sudo[137124]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:48.039 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:47 smithi157 sudo[137124]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:48.039 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 10:43:47 smithi157 sudo[137124]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:48.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:43:48.543+0000 7eff5d7fa700 1 -- 172.21.15.107:0/2515242110 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7eff54010710 con 0x7eff60101a00 2023-08-10T10:43:48.662 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:48 smithi195 sudo[137909]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T10:43:48.663 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:48 smithi195 sudo[137909]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:48.663 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:48 smithi195 sudo[137909]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:48.663 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:48 smithi195 sudo[137909]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:49.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:48 smithi107 ceph-mon[127953]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:49.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:49.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:48 smithi107 ceph-mon[127953]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-08-10T10:43:49.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:48 smithi195 ceph-mon[129938]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:49.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:48 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:49.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:48 smithi195 ceph-mon[129938]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-08-10T10:43:49.163 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:48 smithi195 sudo[137912]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T10:43:49.163 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:48 smithi195 sudo[137912]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:49.164 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:48 smithi195 sudo[137912]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:49.164 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 10:43:48 smithi195 sudo[137912]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:49.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:48 smithi157 ceph-mon[129604]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:49.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:48 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:49.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:48 smithi157 ceph-mon[129604]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-08-10T10:43:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 sudo[143360]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T10:43:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 sudo[143360]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 sudo[143360]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 sudo[143360]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:49 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:50.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:49 smithi157 ceph-mon[129604]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T10:43:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 sudo[143363]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T10:43:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 sudo[143363]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 sudo[143363]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 sudo[143363]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:50.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:49 smithi107 ceph-mon[127953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T10:43:50.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:49 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:43:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:49 smithi195 ceph-mon[129938]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T10:43:50.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:50 smithi195 sudo[137915]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T10:43:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:50 smithi195 sudo[137915]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:50 smithi195 sudo[137915]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:50 smithi195 sudo[137915]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:51.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:50 smithi195 sudo[137918]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T10:43:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:50 smithi195 sudo[137918]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:50 smithi195 sudo[137918]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:50 smithi195 sudo[137918]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:51.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 sudo[137127]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-08-10T10:43:51.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 sudo[137127]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:51.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 sudo[137127]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:51.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 sudo[137127]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:52.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 sudo[137130]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-08-10T10:43:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 sudo[137130]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-08-10T10:43:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 sudo[137130]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-08-10T10:43:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 sudo[137130]: pam_unix(sudo:session): session closed for user root 2023-08-10T10:43:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 ceph-mon[129604]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 ceph-mon[129604]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T10:43:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:43:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:43:52.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:43:52.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:43:52.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:43:52.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:43:52.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:51 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4080517806' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "499f11fd-b9fc-4945-8b3a-929bc041ca5f"}]: dispatch 2023-08-10T10:43:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:51 smithi107 ceph-mon[127953]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:51 smithi107 ceph-mon[127953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T10:43:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:43:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:43:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:43:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:43:52.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:43:52.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:43:52.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:51 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4080517806' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "499f11fd-b9fc-4945-8b3a-929bc041ca5f"}]: dispatch 2023-08-10T10:43:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:51 smithi195 ceph-mon[129938]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:51 smithi195 ceph-mon[129938]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T10:43:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:43:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:43:52.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:43:52.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:43:52.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:43:52.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:43:52.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:51 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4080517806' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "499f11fd-b9fc-4945-8b3a-929bc041ca5f"}]: dispatch 2023-08-10T10:43:53.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T10:43:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T10:43:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T10:43:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4080517806' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "499f11fd-b9fc-4945-8b3a-929bc041ca5f"}]': finished 2023-08-10T10:43:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: osdmap e22: 4 total, 3 up, 4 in 2023-08-10T10:43:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:43:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:43:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:43:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:43:53.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:53.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/630081451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:43:53.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:53 smithi157 ceph-mon[129604]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T10:43:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T10:43:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T10:43:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T10:43:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4080517806' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "499f11fd-b9fc-4945-8b3a-929bc041ca5f"}]': finished 2023-08-10T10:43:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: osdmap e22: 4 total, 3 up, 4 in 2023-08-10T10:43:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:43:53.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:43:53.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:43:53.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:43:53.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:53.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/630081451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:43:53.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:53 smithi107 ceph-mon[127953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T10:43:53.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T10:43:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T10:43:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-08-10T10:43:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4080517806' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "499f11fd-b9fc-4945-8b3a-929bc041ca5f"}]': finished 2023-08-10T10:43:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: osdmap e22: 4 total, 3 up, 4 in 2023-08-10T10:43:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:43:53.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:43:53.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:43:53.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:43:53.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:43:53.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/630081451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:43:53.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:53 smithi195 ceph-mon[129938]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-08-10T10:43:55.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:55 smithi157 ceph-mon[129604]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-08-10T10:43:55.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:55 smithi107 ceph-mon[127953]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-08-10T10:43:55.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:55 smithi195 ceph-mon[129938]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-08-10T10:43:57.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:57 smithi157 ceph-mon[129604]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-08-10T10:43:57.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:57 smithi107 ceph-mon[127953]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-08-10T10:43:57.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:57 smithi195 ceph-mon[129938]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-08-10T10:43:59.288 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:59 smithi107 ceph-mon[127953]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-08-10T10:43:59.288 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-08-10T10:43:59.288 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:43:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:59.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:59 smithi157 ceph-mon[129604]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-08-10T10:43:59.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-08-10T10:43:59.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:43:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:43:59.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:59 smithi195 ceph-mon[129938]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-08-10T10:43:59.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-08-10T10:43:59.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:43:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:00 smithi157 ceph-mon[129604]: Deploying daemon osd.3 on smithi107 2023-08-10T10:44:00.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:00 smithi107 ceph-mon[127953]: Deploying daemon osd.3 on smithi107 2023-08-10T10:44:00.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:00 smithi195 ceph-mon[129938]: Deploying daemon osd.3 on smithi107 2023-08-10T10:44:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:01 smithi107 ceph-mon[127953]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-08-10T10:44:01.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:01 smithi157 ceph-mon[129604]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-08-10T10:44:01.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:01 smithi195 ceph-mon[129938]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-08-10T10:44:03.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:03 smithi157 ceph-mon[129604]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-08-10T10:44:03.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:03 smithi107 ceph-mon[127953]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-08-10T10:44:03.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:03 smithi195 ceph-mon[129938]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-08-10T10:44:05.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:05 smithi157 ceph-mon[129604]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-08-10T10:44:05.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:05.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:05.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:05 smithi107 ceph-mon[127953]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-08-10T10:44:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:05.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:05.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:05 smithi195 ceph-mon[129938]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-08-10T10:44:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:07.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:07 smithi157 ceph-mon[129604]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T10:44:07.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:07 smithi107 ceph-mon[127953]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T10:44:07.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:07 smithi195 ceph-mon[129938]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T10:44:08.314 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 3 on host 'smithi107' 2023-08-10T10:44:08.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.313+0000 7eff5d7fa700 1 -- 172.21.15.107:0/2515242110 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7eff60060bb0 con 0x7eff480a1140 2023-08-10T10:44:08.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff480a1140 msgr2=0x7eff480a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:08.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff480a1140 0x7eff480a3600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff50006010 tx=0x7eff50005e80 comp rx=0 tx=0).stop 2023-08-10T10:44:08.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60101a00 msgr2=0x7eff60196930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:08.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60101a00 0x7eff60196930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff5400d980 tx=0x7eff5400dc90 comp rx=0 tx=0).stop 2023-08-10T10:44:08.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 shutdown_connections 2023-08-10T10:44:08.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff480a1140 0x7eff480a3600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:08.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff601023a0 0x7eff6019d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:08.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff60100800 0x7eff601963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:08.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 --2- 172.21.15.107:0/2515242110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff60101a00 0x7eff60196930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:08.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 >> 172.21.15.107:0/2515242110 conn(0x7eff600fbd60 msgr2=0x7eff60105010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:08.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 shutdown_connections 2023-08-10T10:44:08.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:44:08.316+0000 7eff6669f700 1 -- 172.21.15.107:0/2515242110 wait complete. 2023-08-10T10:44:08.552 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.552 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.552 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:08.552 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:08.552 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.553 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:08 smithi107 ceph-mon[127953]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T10:44:08.553 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.553 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.553 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:08.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:08.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:08.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:08 smithi195 ceph-mon[129938]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T10:44:08.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:08.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:08.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:08.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:08 smithi157 ceph-mon[129604]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-08-10T10:44:08.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:08.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:08.888 DEBUG:teuthology.orchestra.run.smithi107:osd.3> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.3.service 2023-08-10T10:44:08.892 INFO:tasks.cephadm:Deploying osd.4 on smithi157 with /dev/vg_nvme/lv_3... 2023-08-10T10:44:08.893 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-08-10T10:44:08.967 INFO:journalctl@ceph.osd.3.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:44:09.626 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T10:44:09.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:09 smithi157 ceph-mon[129604]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-10T10:44:09.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:09 smithi107 ceph-mon[127953]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-10T10:44:09.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:09 smithi195 ceph-mon[129938]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-08-10T10:44:10.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:10 smithi157 ceph-mon[129604]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:44:10.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:10 smithi157 ceph-mon[129604]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-08-10T10:44:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:10 smithi157 ceph-mon[129604]: osdmap e23: 4 total, 3 up, 4 in 2023-08-10T10:44:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:10 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:10 smithi157 ceph-mon[129604]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:44:10.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:10 smithi107 ceph-mon[127953]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:44:10.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:10 smithi107 ceph-mon[127953]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-08-10T10:44:10.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:10 smithi107 ceph-mon[127953]: osdmap e23: 4 total, 3 up, 4 in 2023-08-10T10:44:10.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:10 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:10.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:10 smithi107 ceph-mon[127953]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:44:10.829 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 10:44:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T10:44:10.547+0000 7f089b21f700 -1 osd.3 0 waiting for initial osdmap 2023-08-10T10:44:10.829 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 10:44:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T10:44:10.553+0000 7f0895811700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:44:10.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:10 smithi195 ceph-mon[129938]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:44:10.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:10 smithi195 ceph-mon[129938]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-08-10T10:44:10.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:10 smithi195 ceph-mon[129938]: osdmap e23: 4 total, 3 up, 4 in 2023-08-10T10:44:10.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:10 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:10.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:10 smithi195 ceph-mon[129938]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:44:11.662 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-08-10T10:44:11.662 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-08-10T10:44:11.662 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2023-08-10T10:44:11.662 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2023-08-10T10:44:11.663 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0297023 s, 353 MB/s 2023-08-10T10:44:11.663 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2023-08-10T10:44:11.807 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:11 smithi157 ceph-mon[129604]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:44:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:11 smithi157 ceph-mon[129604]: osdmap e24: 4 total, 3 up, 4 in 2023-08-10T10:44:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:11.808 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:11.811 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:11 smithi107 ceph-mon[127953]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:44:11.811 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:11 smithi107 ceph-mon[127953]: osdmap e24: 4 total, 3 up, 4 in 2023-08-10T10:44:11.811 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:11.812 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:11.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:11 smithi195 ceph-mon[129938]: from='osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:44:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:11 smithi195 ceph-mon[129938]: osdmap e24: 4 total, 3 up, 4 in 2023-08-10T10:44:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:12.106 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi157:vg_nvme/lv_3 2023-08-10T10:44:12.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:44:12.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:44:12.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:44:12.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] boot 2023-08-10T10:44:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: osdmap e25: 4 total, 4 up, 4 in 2023-08-10T10:44:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi107 2023-08-10T10:44:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:12.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi107 to 8633M 2023-08-10T10:44:12.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:12.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:12.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:12.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:12.831 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T10:44:12.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:44:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:44:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:44:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] boot 2023-08-10T10:44:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: osdmap e25: 4 total, 4 up, 4 in 2023-08-10T10:44:12.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:12.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi107 2023-08-10T10:44:12.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:12.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:12.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:12.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:12.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi107 to 8633M 2023-08-10T10:44:12.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:12.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:12.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:12.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:44:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:44:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-08-10T10:44:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: osd.3 [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] boot 2023-08-10T10:44:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: osdmap e25: 4 total, 4 up, 4 in 2023-08-10T10:44:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:44:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi107 2023-08-10T10:44:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi107 to 8633M 2023-08-10T10:44:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:13.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:13.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:13.756 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:13 smithi157 ceph-mon[129604]: osdmap e26: 4 total, 4 up, 4 in 2023-08-10T10:44:13.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:13 smithi107 ceph-mon[127953]: osdmap e26: 4 total, 4 up, 4 in 2023-08-10T10:44:13.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:13 smithi195 ceph-mon[129938]: osdmap e26: 4 total, 4 up, 4 in 2023-08-10T10:44:14.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.345+0000 7fbabfcb4700 1 -- 172.21.15.157:0/2362137860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80747a0 msgr2=0x7fbab8072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.345+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/2362137860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80747a0 0x7fbab8072c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009990 tx=0x7fbab4009ca0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.346+0000 7fbabfcb4700 1 -- 172.21.15.157:0/2362137860 shutdown_connections 2023-08-10T10:44:14.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.346+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/2362137860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80747a0 0x7fbab8072c00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.346+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/2362137860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab81086d0 0x7fbab810ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.347 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.346+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/2362137860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab80731d0 0x7fbab8073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.346+0000 7fbabfcb4700 1 -- 172.21.15.157:0/2362137860 >> 172.21.15.157:0/2362137860 conn(0x7fbab80fbd60 msgr2=0x7fbab80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:14.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.346+0000 7fbabfcb4700 1 -- 172.21.15.157:0/2362137860 shutdown_connections 2023-08-10T10:44:14.348 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.346+0000 7fbabfcb4700 1 -- 172.21.15.157:0/2362137860 wait complete. 2023-08-10T10:44:14.350 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabfcb4700 1 Processor -- start 2023-08-10T10:44:14.350 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabfcb4700 1 -- start start 2023-08-10T10:44:14.350 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabfcb4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80731d0 0x7fbab81986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.350 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabfcb4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab80747a0 0x7fbab8198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.350 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabfcb4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab81086d0 0x7fbab819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabfcb4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab81a0240 con 0x7fbab80747a0 2023-08-10T10:44:14.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabfcb4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab81a0380 con 0x7fbab80731d0 2023-08-10T10:44:14.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabfcb4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab81a0510 con 0x7fbab81086d0 2023-08-10T10:44:14.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabda50700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80731d0 0x7fbab81986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabda50700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80731d0 0x7fbab81986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52890/0 (socket says 172.21.15.157:52890) 2023-08-10T10:44:14.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabda50700 1 -- 172.21.15.157:0/468866702 learned_addr learned my addr 172.21.15.157:0/468866702 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-08-10T10:44:14.351 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.347+0000 7fbabd24f700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab80747a0 0x7fbab8198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbabe251700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab81086d0 0x7fbab819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbabda50700 1 -- 172.21.15.157:0/468866702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab81086d0 msgr2=0x7fbab819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbabda50700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab81086d0 0x7fbab819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbabda50700 1 -- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab80747a0 msgr2=0x7fbab8198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbabda50700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab80747a0 0x7fbab8198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbabda50700 1 -- 172.21.15.157:0/468866702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab0009c40 con 0x7fbab80731d0 2023-08-10T10:44:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbabda50700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80731d0 0x7fbab81986b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbab40098e0 tx=0x7fbab4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:14.352 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbaaeffd700 1 -- 172.21.15.157:0/468866702 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab401d070 con 0x7fbab80731d0 2023-08-10T10:44:14.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbaaeffd700 1 -- 172.21.15.157:0/468866702 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbab400be30 con 0x7fbab80731d0 2023-08-10T10:44:14.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbaaeffd700 1 -- 172.21.15.157:0/468866702 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4022de0 con 0x7fbab80731d0 2023-08-10T10:44:14.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.348+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab40095f0 con 0x7fbab80731d0 2023-08-10T10:44:14.353 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.349+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab81a09c0 con 0x7fbab80731d0 2023-08-10T10:44:14.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.350+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab8106d80 con 0x7fbab80731d0 2023-08-10T10:44:14.354 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.352+0000 7fbaaeffd700 1 -- 172.21.15.157:0/468866702 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fbab4022470 con 0x7fbab80731d0 2023-08-10T10:44:14.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.353+0000 7fbaaeffd700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbaa40a11d0 0x7fbaa40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:14.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.354+0000 7fbaaeffd700 1 -- 172.21.15.157:0/468866702 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7fbab40cd0b0 con 0x7fbab80731d0 2023-08-10T10:44:14.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.354+0000 7fbabd24f700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbaa40a11d0 0x7fbaa40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:14.355 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.355+0000 7fbabd24f700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbaa40a11d0 0x7fbaa40a3690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbab80744d0 tx=0x7fbaa8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:14.356 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.356+0000 7fbaaeffd700 1 -- 172.21.15.157:0/468866702 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fbab40979f0 con 0x7fbab80731d0 2023-08-10T10:44:14.556 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:14.555+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbab8060bb0 con 0x7fbaa40a11d0 2023-08-10T10:44:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:14 smithi107 ceph-mon[127953]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:14 smithi107 ceph-mon[127953]: osdmap e27: 4 total, 4 up, 4 in 2023-08-10T10:44:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:14 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:44:14.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:14 smithi195 ceph-mon[129938]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:14.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:14 smithi195 ceph-mon[129938]: osdmap e27: 4 total, 4 up, 4 in 2023-08-10T10:44:14.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:14 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:44:15.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:14 smithi157 ceph-mon[129604]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:14 smithi157 ceph-mon[129604]: osdmap e27: 4 total, 4 up, 4 in 2023-08-10T10:44:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:14 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:44:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:15 smithi107 ceph-mon[127953]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:44:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:44:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:15 smithi107 ceph-mon[127953]: osdmap e28: 4 total, 4 up, 4 in 2023-08-10T10:44:15.829 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:15 smithi157 ceph-mon[129604]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:44:15.829 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:44:15.829 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:15.829 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:15 smithi157 ceph-mon[129604]: osdmap e28: 4 total, 4 up, 4 in 2023-08-10T10:44:15.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:15 smithi195 ceph-mon[129938]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:44:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:44:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:15 smithi195 ceph-mon[129938]: osdmap e28: 4 total, 4 up, 4 in 2023-08-10T10:44:16.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:16 smithi195 ceph-mon[129938]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:16.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:16 smithi195 ceph-mon[129938]: osdmap e29: 4 total, 4 up, 4 in 2023-08-10T10:44:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:16 smithi157 ceph-mon[129604]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:16 smithi157 ceph-mon[129604]: osdmap e29: 4 total, 4 up, 4 in 2023-08-10T10:44:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:16 smithi107 ceph-mon[127953]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:16 smithi107 ceph-mon[127953]: osdmap e29: 4 total, 4 up, 4 in 2023-08-10T10:44:18.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:18 smithi195 ceph-mon[129938]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-08-10T10:44:18.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:18 smithi195 ceph-mon[129938]: from='client.? 172.21.15.157:0/3711193074' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30"}]: dispatch 2023-08-10T10:44:18.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:18 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30"}]: dispatch 2023-08-10T10:44:18.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:18 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30"}]': finished 2023-08-10T10:44:18.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:18 smithi195 ceph-mon[129938]: osdmap e30: 5 total, 4 up, 5 in 2023-08-10T10:44:18.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:18.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:18 smithi195 ceph-mon[129938]: from='client.? 172.21.15.157:0/2695626854' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:44:19.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:18 smithi157 ceph-mon[129604]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-08-10T10:44:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:18 smithi157 ceph-mon[129604]: from='client.? 172.21.15.157:0/3711193074' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30"}]: dispatch 2023-08-10T10:44:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:18 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30"}]: dispatch 2023-08-10T10:44:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:18 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30"}]': finished 2023-08-10T10:44:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:18 smithi157 ceph-mon[129604]: osdmap e30: 5 total, 4 up, 5 in 2023-08-10T10:44:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:18 smithi157 ceph-mon[129604]: from='client.? 172.21.15.157:0/2695626854' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:44:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:18 smithi107 ceph-mon[127953]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-08-10T10:44:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:18 smithi107 ceph-mon[127953]: from='client.? 172.21.15.157:0/3711193074' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30"}]: dispatch 2023-08-10T10:44:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:18 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30"}]: dispatch 2023-08-10T10:44:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:18 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30"}]': finished 2023-08-10T10:44:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:18 smithi107 ceph-mon[127953]: osdmap e30: 5 total, 4 up, 5 in 2023-08-10T10:44:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:18 smithi107 ceph-mon[127953]: from='client.? 172.21.15.157:0/2695626854' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:44:20.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:20 smithi195 ceph-mon[129938]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-08-10T10:44:21.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:20 smithi157 ceph-mon[129604]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-08-10T10:44:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:20 smithi107 ceph-mon[127953]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-08-10T10:44:22.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:22 smithi195 ceph-mon[129938]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-08-10T10:44:23.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:22 smithi157 ceph-mon[129604]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-08-10T10:44:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:22 smithi107 ceph-mon[127953]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-08-10T10:44:24.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:24 smithi195 ceph-mon[129938]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T10:44:25.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:24 smithi157 ceph-mon[129604]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T10:44:25.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:24 smithi107 ceph-mon[127953]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T10:44:25.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-08-10T10:44:25.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:25.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:25 smithi195 ceph-mon[129938]: Deploying daemon osd.4 on smithi157 2023-08-10T10:44:26.030 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-08-10T10:44:26.030 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:26.030 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:25 smithi157 ceph-mon[129604]: Deploying daemon osd.4 on smithi157 2023-08-10T10:44:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-08-10T10:44:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:25 smithi107 ceph-mon[127953]: Deploying daemon osd.4 on smithi157 2023-08-10T10:44:26.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:26 smithi195 ceph-mon[129938]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T10:44:27.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:26 smithi157 ceph-mon[129604]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T10:44:27.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:26 smithi107 ceph-mon[127953]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T10:44:28.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:28 smithi195 ceph-mon[129938]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:28.954 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:28 smithi157 ceph-mon[129604]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:29.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:28 smithi107 ceph-mon[127953]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:30.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:30 smithi195 ceph-mon[129938]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:30 smithi157 ceph-mon[129604]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:30 smithi107 ceph-mon[127953]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:32.898 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:32 smithi157 ceph-mon[129604]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:32.899 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:32.899 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:32.899 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:32.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:32 smithi195 ceph-mon[129938]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:32 smithi107 ceph-mon[127953]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:34.882 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:34 smithi157 ceph-mon[129604]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:34.883 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:34.883 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:34.883 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:34.883 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:34.883 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:34.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:34 smithi195 ceph-mon[129938]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:34.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:34.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:34.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:34.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:34.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:34 smithi107 ceph-mon[127953]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:35.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:35.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:35.183 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 4 on host 'smithi157' 2023-08-10T10:44:35.183 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.181+0000 7fbaaeffd700 1 -- 172.21.15.157:0/468866702 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbab8060bb0 con 0x7fbaa40a11d0 2023-08-10T10:44:35.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.182+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbaa40a11d0 msgr2=0x7fbaa40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:35.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.182+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbaa40a11d0 0x7fbaa40a3690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbab80744d0 tx=0x7fbaa8009260 comp rx=0 tx=0).stop 2023-08-10T10:44:35.184 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.182+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80731d0 msgr2=0x7fbab81986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:35.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.182+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80731d0 0x7fbab81986b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbab40098e0 tx=0x7fbab4004730 comp rx=0 tx=0).stop 2023-08-10T10:44:35.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.183+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 shutdown_connections 2023-08-10T10:44:35.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.183+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbaa40a11d0 0x7fbaa40a3690 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.183+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbab80731d0 0x7fbab81986b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.183+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbab81086d0 0x7fbab819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.183+0000 7fbabfcb4700 1 --2- 172.21.15.157:0/468866702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbab80747a0 0x7fbab8198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:35.185 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.183+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 >> 172.21.15.157:0/468866702 conn(0x7fbab80fbd60 msgr2=0x7fbab80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:35.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.183+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 shutdown_connections 2023-08-10T10:44:35.186 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:44:35.183+0000 7fbabfcb4700 1 -- 172.21.15.157:0/468866702 wait complete. 2023-08-10T10:44:35.652 DEBUG:teuthology.orchestra.run.smithi157:osd.4> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.4.service 2023-08-10T10:44:35.656 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_3... 2023-08-10T10:44:35.657 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-08-10T10:44:35.766 INFO:journalctl@ceph.osd.4.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:44:36.404 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:44:36.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:36.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:36 smithi195 ceph-mon[129938]: from='osd.4 [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T10:44:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:36 smithi195 ceph-mon[129938]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T10:44:36.477 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:36.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:36.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:36.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:36 smithi157 ceph-mon[129604]: from='osd.4 [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T10:44:36.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:36 smithi157 ceph-mon[129604]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T10:44:36.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:36.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:36.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:36.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:36 smithi107 ceph-mon[127953]: from='osd.4 [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T10:44:36.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:36 smithi107 ceph-mon[127953]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-08-10T10:44:37.328 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:37 smithi195 ceph-mon[129938]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:37.328 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:37 smithi195 ceph-mon[129938]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-08-10T10:44:37.329 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:37 smithi195 ceph-mon[129938]: osdmap e31: 5 total, 4 up, 5 in 2023-08-10T10:44:37.329 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:37 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:37.329 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:37 smithi195 ceph-mon[129938]: from='osd.4 [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:44:37.329 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:37 smithi195 ceph-mon[129938]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:44:37.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:37 smithi157 ceph-mon[129604]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:37.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:37 smithi157 ceph-mon[129604]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-08-10T10:44:37.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:37 smithi157 ceph-mon[129604]: osdmap e31: 5 total, 4 up, 5 in 2023-08-10T10:44:37.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:37 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:37.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:37 smithi157 ceph-mon[129604]: from='osd.4 [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:44:37.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:37 smithi157 ceph-mon[129604]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:44:37.540 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 10:44:37 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T10:44:37.174+0000 7fa666bc7700 -1 osd.4 0 waiting for initial osdmap 2023-08-10T10:44:37.540 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 10:44:37 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T10:44:37.182+0000 7fa65f9b6700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:44:37.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:37 smithi107 ceph-mon[127953]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:37.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:37 smithi107 ceph-mon[127953]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-08-10T10:44:37.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:37 smithi107 ceph-mon[127953]: osdmap e31: 5 total, 4 up, 5 in 2023-08-10T10:44:37.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:37 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:37.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:37 smithi107 ceph-mon[127953]: from='osd.4 [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:44:37.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:37 smithi107 ceph-mon[127953]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:44:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:38 smithi157 ceph-mon[129604]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:44:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:38 smithi157 ceph-mon[129604]: osdmap e32: 5 total, 4 up, 5 in 2023-08-10T10:44:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:38 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:38 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:38 smithi157 ceph-mon[129604]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:38.386 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-08-10T10:44:38.387 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-08-10T10:44:38.387 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-08-10T10:44:38.387 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-08-10T10:44:38.387 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0460264 s, 228 MB/s 2023-08-10T10:44:38.387 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-08-10T10:44:38.512 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:38 smithi195 ceph-mon[129938]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:44:38.513 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:38 smithi195 ceph-mon[129938]: osdmap e32: 5 total, 4 up, 5 in 2023-08-10T10:44:38.513 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:38 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:38.513 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:38 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:38.513 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:38 smithi195 ceph-mon[129938]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:38.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:38 smithi107 ceph-mon[127953]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:44:38.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:38 smithi107 ceph-mon[127953]: osdmap e32: 5 total, 4 up, 5 in 2023-08-10T10:44:38.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:38 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:38.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:38 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:38.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:38 smithi107 ceph-mon[127953]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-08-10T10:44:38.877 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2023-08-10T10:44:39.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:44:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:44:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: osd.4 [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] boot 2023-08-10T10:44:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: osdmap e33: 5 total, 5 up, 5 in 2023-08-10T10:44:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi157 2023-08-10T10:44:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:39.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:39.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi157 to 8633M 2023-08-10T10:44:39.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:39.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:39.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:44:39.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:44:39.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: osd.4 [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] boot 2023-08-10T10:44:39.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: osdmap e33: 5 total, 5 up, 5 in 2023-08-10T10:44:39.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:39.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi157 2023-08-10T10:44:39.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:39.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:39.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi157 to 8633M 2023-08-10T10:44:39.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:39.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:39.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.595 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:44:39.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:44:39.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:44:39.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: osd.4 [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] boot 2023-08-10T10:44:39.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: osdmap e33: 5 total, 5 up, 5 in 2023-08-10T10:44:39.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:44:39.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi157 2023-08-10T10:44:39.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:39.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:44:39.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi157 to 8633M 2023-08-10T10:44:39.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:39.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:39.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:44:39.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:40.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:40 smithi157 ceph-mon[129604]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:40.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:40 smithi157 ceph-mon[129604]: osdmap e34: 5 total, 5 up, 5 in 2023-08-10T10:44:40.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:40 smithi107 ceph-mon[127953]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:40.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:40 smithi107 ceph-mon[127953]: osdmap e34: 5 total, 5 up, 5 in 2023-08-10T10:44:40.839 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:40 smithi195 ceph-mon[129938]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:40.839 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:40 smithi195 ceph-mon[129938]: osdmap e34: 5 total, 5 up, 5 in 2023-08-10T10:44:41.106 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.103+0000 7f50d45e6700 1 -- 172.21.15.195:0/1122563810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0747a0 msgr2=0x7f50cc072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.106 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.103+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1122563810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0747a0 0x7f50cc072c00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009990 tx=0x7f50c8009ca0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.106 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.103+0000 7f50d45e6700 1 -- 172.21.15.195:0/1122563810 shutdown_connections 2023-08-10T10:44:41.107 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.103+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1122563810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50cc1086d0 0x7f50cc10ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.107 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.103+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1122563810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0747a0 0x7f50cc072c00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.107 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.103+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1122563810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50cc0731d0 0x7f50cc073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.107 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.103+0000 7f50d45e6700 1 -- 172.21.15.195:0/1122563810 >> 172.21.15.195:0/1122563810 conn(0x7f50cc0fbd60 msgr2=0x7f50cc0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:44:41.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.104+0000 7f50d45e6700 1 -- 172.21.15.195:0/1122563810 shutdown_connections 2023-08-10T10:44:41.108 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.104+0000 7f50d45e6700 1 -- 172.21.15.195:0/1122563810 wait complete. 2023-08-10T10:44:41.109 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d45e6700 1 Processor -- start 2023-08-10T10:44:41.110 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d45e6700 1 -- start start 2023-08-10T10:44:41.110 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d45e6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0731d0 0x7f50cc198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.110 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d45e6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50cc0747a0 0x7f50cc198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d45e6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50cc1086d0 0x7f50cc19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d45e6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1a0210 con 0x7f50cc1086d0 2023-08-10T10:44:41.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d45e6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1a0350 con 0x7f50cc0747a0 2023-08-10T10:44:41.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d45e6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1a04e0 con 0x7f50cc0731d0 2023-08-10T10:44:41.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d2382700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0731d0 0x7f50cc198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d2382700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0731d0 0x7f50cc198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:59386/0 (socket says 172.21.15.195:59386) 2023-08-10T10:44:41.111 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.105+0000 7f50d2382700 1 -- 172.21.15.195:0/1730661650 learned_addr learned my addr 172.21.15.195:0/1730661650 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:44:41.112 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50d2b83700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50cc1086d0 0x7f50cc19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.112 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50d1b81700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50cc0747a0 0x7f50cc198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.112 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50d2382700 1 -- 172.21.15.195:0/1730661650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50cc0747a0 msgr2=0x7f50cc198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.112 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50d2382700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50cc0747a0 0x7f50cc198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.112 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50d2382700 1 -- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50cc1086d0 msgr2=0x7f50cc19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:44:41.112 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50d2382700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50cc1086d0 0x7f50cc19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:44:41.112 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50d2382700 1 -- 172.21.15.195:0/1730661650 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80095f0 con 0x7f50cc0731d0 2023-08-10T10:44:41.113 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50d2382700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0731d0 0x7f50cc198680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50c80059d0 tx=0x7f50c8003b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:41.113 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50c37fe700 1 -- 172.21.15.195:0/1730661650 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c801d070 con 0x7f50cc0731d0 2023-08-10T10:44:41.113 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc1a0760 con 0x7f50cc0731d0 2023-08-10T10:44:41.113 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50c37fe700 1 -- 172.21.15.195:0/1730661650 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50c800bd70 con 0x7f50cc0731d0 2023-08-10T10:44:41.113 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.106+0000 7f50c37fe700 1 -- 172.21.15.195:0/1730661650 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8022d20 con 0x7f50cc0731d0 2023-08-10T10:44:41.113 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.107+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc1a0c00 con 0x7f50cc0731d0 2023-08-10T10:44:41.113 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.107+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc106d80 con 0x7f50cc0731d0 2023-08-10T10:44:41.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.109+0000 7f50c37fe700 1 -- 172.21.15.195:0/1730661650 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f50c8003fb0 con 0x7f50cc0731d0 2023-08-10T10:44:41.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.111+0000 7f50c37fe700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f50b80a1150 0x7f50b80a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:44:41.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.111+0000 7f50c37fe700 1 -- 172.21.15.195:0/1730661650 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f50c80cd6b0 con 0x7f50cc0731d0 2023-08-10T10:44:41.114 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.111+0000 7f50d1b81700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f50b80a1150 0x7f50b80a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:44:41.115 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.112+0000 7f50d1b81700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f50b80a1150 0x7f50b80a3610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50bc005950 tx=0x7f50bc0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:44:41.115 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.113+0000 7f50c37fe700 1 -- 172.21.15.195:0/1730661650 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f50c8097e60 con 0x7f50cc0731d0 2023-08-10T10:44:41.316 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:44:41.315+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f50cc060bb0 con 0x7f50b80a1150 2023-08-10T10:44:41.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:41 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:44:41.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:41 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:44:41.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:41 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:41.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:41 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:44:41.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:41 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:44:41.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:41 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:41 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:44:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:41 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:44:42.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:41 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:42.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:42 smithi195 ceph-mon[129938]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:44:42.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:42 smithi195 ceph-mon[129938]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:42.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:42 smithi107 ceph-mon[127953]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:44:42.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:42 smithi107 ceph-mon[127953]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:42 smithi157 ceph-mon[129604]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:44:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:42 smithi157 ceph-mon[129604]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:44 smithi107 ceph-mon[127953]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:44 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/1170579352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4638e56c-4db1-4e41-8916-0063d45f3deb"}]: dispatch 2023-08-10T10:44:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:44 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4638e56c-4db1-4e41-8916-0063d45f3deb"}]: dispatch 2023-08-10T10:44:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:44 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4638e56c-4db1-4e41-8916-0063d45f3deb"}]': finished 2023-08-10T10:44:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:44 smithi107 ceph-mon[127953]: osdmap e35: 6 total, 5 up, 6 in 2023-08-10T10:44:44.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:44:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:44 smithi195 ceph-mon[129938]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:44 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/1170579352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4638e56c-4db1-4e41-8916-0063d45f3deb"}]: dispatch 2023-08-10T10:44:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:44 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4638e56c-4db1-4e41-8916-0063d45f3deb"}]: dispatch 2023-08-10T10:44:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:44 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4638e56c-4db1-4e41-8916-0063d45f3deb"}]': finished 2023-08-10T10:44:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:44 smithi195 ceph-mon[129938]: osdmap e35: 6 total, 5 up, 6 in 2023-08-10T10:44:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:44:45.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:44 smithi157 ceph-mon[129604]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:45.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:44 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/1170579352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4638e56c-4db1-4e41-8916-0063d45f3deb"}]: dispatch 2023-08-10T10:44:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:44 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4638e56c-4db1-4e41-8916-0063d45f3deb"}]: dispatch 2023-08-10T10:44:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:44 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4638e56c-4db1-4e41-8916-0063d45f3deb"}]': finished 2023-08-10T10:44:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:44 smithi157 ceph-mon[129604]: osdmap e35: 6 total, 5 up, 6 in 2023-08-10T10:44:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:44:45.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:45 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/3250949075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:44:45.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:45 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/3250949075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:44:46.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:45 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/3250949075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:44:46.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:46 smithi107 ceph-mon[127953]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:46.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:46 smithi195 ceph-mon[129938]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:47.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:46 smithi157 ceph-mon[129604]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:48.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:48 smithi195 ceph-mon[129938]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:48.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:48 smithi107 ceph-mon[127953]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:49.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:48 smithi157 ceph-mon[129604]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:50 smithi195 ceph-mon[129938]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:50 smithi107 ceph-mon[127953]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:51.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:50 smithi157 ceph-mon[129604]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:52.825 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:52 smithi195 ceph-mon[129938]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:52.826 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:52 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-08-10T10:44:52.826 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:52 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:52.826 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:52 smithi195 ceph-mon[129938]: Deploying daemon osd.5 on smithi195 2023-08-10T10:44:52.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:52 smithi107 ceph-mon[127953]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:52.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-08-10T10:44:52.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:52.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:52 smithi107 ceph-mon[127953]: Deploying daemon osd.5 on smithi195 2023-08-10T10:44:53.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:52 smithi157 ceph-mon[129604]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:53.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:52 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-08-10T10:44:53.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:52 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:44:53.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:52 smithi157 ceph-mon[129604]: Deploying daemon osd.5 on smithi195 2023-08-10T10:44:54.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:54 smithi107 ceph-mon[127953]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:54.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:54 smithi195 ceph-mon[129938]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:55.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:54 smithi157 ceph-mon[129604]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:56.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:56 smithi107 ceph-mon[127953]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:56.868 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:56 smithi195 ceph-mon[129938]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:57.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:56 smithi157 ceph-mon[129604]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:58.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:58 smithi107 ceph-mon[127953]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:58.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:58 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:58.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:58 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:58.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:44:58 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:58 smithi195 ceph-mon[129938]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:58.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:58 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:58.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:58 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:58.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:44:58 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:44:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:58 smithi157 ceph-mon[129604]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:44:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:58 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:58 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:44:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:44:58 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:00.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:00 smithi195 ceph-mon[129938]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:45:01.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:00 smithi157 ceph-mon[129604]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:45:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:00 smithi107 ceph-mon[127953]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:45:01.746 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.745+0000 7f50c37fe700 1 -- 172.21.15.195:0/1730661650 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f50cc060bb0 con 0x7f50b80a1150 2023-08-10T10:45:01.746 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2023-08-10T10:45:01.748 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.747+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f50b80a1150 msgr2=0x7f50b80a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:01.749 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.747+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f50b80a1150 0x7f50b80a3610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50bc005950 tx=0x7f50bc0058e0 comp rx=0 tx=0).stop 2023-08-10T10:45:01.749 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.747+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0731d0 msgr2=0x7f50cc198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:01.749 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.747+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0731d0 0x7f50cc198680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50c80059d0 tx=0x7f50c8003b00 comp rx=0 tx=0).stop 2023-08-10T10:45:01.749 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.748+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 shutdown_connections 2023-08-10T10:45:01.750 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.748+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f50b80a1150 0x7f50b80a3610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:01.750 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.748+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f50cc1086d0 0x7f50cc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:01.750 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.748+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50cc0731d0 0x7f50cc198680 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:01.751 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.748+0000 7f50d45e6700 1 --2- 172.21.15.195:0/1730661650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50cc0747a0 0x7f50cc198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:01.751 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.748+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 >> 172.21.15.195:0/1730661650 conn(0x7f50cc0fbd60 msgr2=0x7f50cc0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:01.751 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.748+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 shutdown_connections 2023-08-10T10:45:01.751 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:45:01.748+0000 7f50d45e6700 1 -- 172.21.15.195:0/1730661650 wait complete. 2023-08-10T10:45:02.218 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.5.service 2023-08-10T10:45:02.223 INFO:tasks.cephadm:Deploying osd.6 on smithi107 with /dev/vg_nvme/lv_2... 2023-08-10T10:45:02.223 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-08-10T10:45:02.284 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.285 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.285 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:02.285 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:02.285 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.285 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.285 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.285 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:01 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:01 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:01 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:01 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:02.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:01 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:02.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:01 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:01 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:01 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:01 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:02.299 INFO:journalctl@ceph.osd.5.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:45:02.311 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.312 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.312 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:02.312 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:02.312 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.313 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.313 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:02.313 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:01 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:02.968 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:45:03.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:02 smithi195 ceph-mon[129938]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:45:03.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:02 smithi195 ceph-mon[129938]: from='osd.5 [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T10:45:03.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:02 smithi195 ceph-mon[129938]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T10:45:03.235 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:02 smithi107 ceph-mon[127953]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:45:03.235 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:02 smithi107 ceph-mon[127953]: from='osd.5 [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T10:45:03.236 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:02 smithi107 ceph-mon[127953]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T10:45:03.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:02 smithi157 ceph-mon[129604]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:45:03.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:02 smithi157 ceph-mon[129604]: from='osd.5 [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T10:45:03.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:02 smithi157 ceph-mon[129604]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-08-10T10:45:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:03 smithi195 ceph-mon[129938]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-08-10T10:45:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:03 smithi195 ceph-mon[129938]: osdmap e36: 6 total, 5 up, 6 in 2023-08-10T10:45:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:03 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:03 smithi195 ceph-mon[129938]: from='osd.5 [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:45:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:03 smithi195 ceph-mon[129938]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:45:04.163 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 10:45:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T10:45:03.996+0000 7f981c52e700 -1 osd.5 0 waiting for initial osdmap 2023-08-10T10:45:04.164 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 10:45:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T10:45:04.005+0000 7f9815b1e700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:45:04.218 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:03 smithi107 ceph-mon[127953]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-08-10T10:45:04.219 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:03 smithi107 ceph-mon[127953]: osdmap e36: 6 total, 5 up, 6 in 2023-08-10T10:45:04.219 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:03 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:04.219 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:03 smithi107 ceph-mon[127953]: from='osd.5 [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:45:04.219 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:03 smithi107 ceph-mon[127953]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:45:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:03 smithi157 ceph-mon[129604]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-08-10T10:45:04.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:03 smithi157 ceph-mon[129604]: osdmap e36: 6 total, 5 up, 6 in 2023-08-10T10:45:04.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:03 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:04.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:03 smithi157 ceph-mon[129604]: from='osd.5 [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:45:04.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:03 smithi157 ceph-mon[129604]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:45:04.923 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-08-10T10:45:04.923 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-08-10T10:45:04.923 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2023-08-10T10:45:04.924 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2023-08-10T10:45:04.924 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0297178 s, 353 MB/s 2023-08-10T10:45:04.924 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2023-08-10T10:45:05.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:04 smithi157 ceph-mon[129604]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:45:05.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:04 smithi157 ceph-mon[129604]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:45:05.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:04 smithi157 ceph-mon[129604]: osdmap e37: 6 total, 5 up, 6 in 2023-08-10T10:45:05.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:04 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:05.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:04 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:04 smithi107 ceph-mon[127953]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:45:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:04 smithi107 ceph-mon[127953]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:45:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:04 smithi107 ceph-mon[127953]: osdmap e37: 6 total, 5 up, 6 in 2023-08-10T10:45:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:04 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:04 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:05.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:04 smithi195 ceph-mon[129938]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-08-10T10:45:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:04 smithi195 ceph-mon[129938]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:45:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:04 smithi195 ceph-mon[129938]: osdmap e37: 6 total, 5 up, 6 in 2023-08-10T10:45:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:04 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:04 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:05.443 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi107:vg_nvme/lv_2 2023-08-10T10:45:06.166 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:45:06.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:45:06.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:45:06.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: osd.5 [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] boot 2023-08-10T10:45:06.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: osdmap e38: 6 total, 6 up, 6 in 2023-08-10T10:45:06.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:06.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi195 2023-08-10T10:45:06.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi195 to 8633M 2023-08-10T10:45:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:06.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:06 smithi157 ceph-mon[129604]: osdmap e39: 6 total, 6 up, 6 in 2023-08-10T10:45:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:45:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:45:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: osd.5 [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] boot 2023-08-10T10:45:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: osdmap e38: 6 total, 6 up, 6 in 2023-08-10T10:45:06.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:06.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi195 2023-08-10T10:45:06.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:06.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:06.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi195 to 8633M 2023-08-10T10:45:06.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:06.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:06.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:05 smithi107 ceph-mon[127953]: osdmap e39: 6 total, 6 up, 6 in 2023-08-10T10:45:06.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:45:06.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:45:06.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: osd.5 [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] boot 2023-08-10T10:45:06.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: osdmap e38: 6 total, 6 up, 6 in 2023-08-10T10:45:06.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:45:06.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi195 2023-08-10T10:45:06.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:06.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:06.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi195 to 8633M 2023-08-10T10:45:06.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:06.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:06.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:06.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:05 smithi195 ceph-mon[129938]: osdmap e39: 6 total, 6 up, 6 in 2023-08-10T10:45:07.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:07 smithi107 ceph-mon[127953]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:07.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:07 smithi107 ceph-mon[127953]: osdmap e40: 6 total, 6 up, 6 in 2023-08-10T10:45:07.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:07 smithi195 ceph-mon[129938]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:07 smithi195 ceph-mon[129938]: osdmap e40: 6 total, 6 up, 6 in 2023-08-10T10:45:07.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:07 smithi157 ceph-mon[129604]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:07.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:07 smithi157 ceph-mon[129604]: osdmap e40: 6 total, 6 up, 6 in 2023-08-10T10:45:07.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.703+0000 7f0af20bd700 1 -- 172.21.15.107:0/3808927111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec100800 msgr2=0x7f0aec100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:07.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.703+0000 7f0af20bd700 1 --2- 172.21.15.107:0/3808927111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec100800 0x7f0aec100c20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0099c0 tx=0x7f0adc009cd0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.703+0000 7f0af20bd700 1 -- 172.21.15.107:0/3808927111 shutdown_connections 2023-08-10T10:45:07.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.703+0000 7f0af20bd700 1 --2- 172.21.15.107:0/3808927111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aec1023a0 0x7f0aec108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.703+0000 7f0af20bd700 1 --2- 172.21.15.107:0/3808927111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec100800 0x7f0aec100c20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.703+0000 7f0af20bd700 1 --2- 172.21.15.107:0/3808927111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec101a00 0x7f0aec101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.703+0000 7f0af20bd700 1 -- 172.21.15.107:0/3808927111 >> 172.21.15.107:0/3808927111 conn(0x7f0aec0fbd60 msgr2=0x7f0aec0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:07.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.703+0000 7f0af20bd700 1 -- 172.21.15.107:0/3808927111 shutdown_connections 2023-08-10T10:45:07.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.703+0000 7f0af20bd700 1 -- 172.21.15.107:0/3808927111 wait complete. 2023-08-10T10:45:07.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.704+0000 7f0af20bd700 1 Processor -- start 2023-08-10T10:45:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0af20bd700 1 -- start start 2023-08-10T10:45:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0af20bd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aec100800 0x7f0aec196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0af20bd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec101a00 0x7f0aec196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0af20bd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec1023a0 0x7f0aec19d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:07.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0af20bd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec19dfb0 con 0x7f0aec101a00 2023-08-10T10:45:07.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0af20bd700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec19e0f0 con 0x7f0aec1023a0 2023-08-10T10:45:07.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0af20bd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec19e280 con 0x7f0aec100800 2023-08-10T10:45:07.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0aeaffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec101a00 0x7f0aec196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:07.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0aeaffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec101a00 0x7f0aec196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56434/0 (socket says 172.21.15.107:56434) 2023-08-10T10:45:07.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0aeaffd700 1 -- 172.21.15.107:0/4036645439 learned_addr learned my addr 172.21.15.107:0/4036645439 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:45:07.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0aebfff700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec1023a0 0x7f0aec19d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:07.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.705+0000 7f0aeb7fe700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aec100800 0x7f0aec196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:07.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0aeaffd700 1 -- 172.21.15.107:0/4036645439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aec100800 msgr2=0x7f0aec196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:07.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0aeaffd700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aec100800 0x7f0aec196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0aeaffd700 1 -- 172.21.15.107:0/4036645439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec1023a0 msgr2=0x7f0aec19d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:07.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0aeaffd700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec1023a0 0x7f0aec19d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:07.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0aeaffd700 1 -- 172.21.15.107:0/4036645439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0095f0 con 0x7f0aec101a00 2023-08-10T10:45:07.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0aeaffd700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec101a00 0x7f0aec196960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000d980 tx=0x7f0ae000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:07.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0ae8ff9700 1 -- 172.21.15.107:0/4036645439 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00098d0 con 0x7f0aec101a00 2023-08-10T10:45:07.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec19e560 con 0x7f0aec101a00 2023-08-10T10:45:07.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0ae8ff9700 1 -- 172.21.15.107:0/4036645439 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ae0010460 con 0x7f0aec101a00 2023-08-10T10:45:07.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0ae8ff9700 1 -- 172.21.15.107:0/4036645439 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae000f620 con 0x7f0aec101a00 2023-08-10T10:45:07.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.706+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec19eab0 con 0x7f0aec101a00 2023-08-10T10:45:07.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.707+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec10bf00 con 0x7f0aec101a00 2023-08-10T10:45:07.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.709+0000 7f0ae8ff9700 1 -- 172.21.15.107:0/4036645439 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f0ae0009a30 con 0x7f0aec101a00 2023-08-10T10:45:07.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.711+0000 7f0ae8ff9700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0ad40a11d0 0x7f0ad40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:07.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.711+0000 7f0ae8ff9700 1 -- 172.21.15.107:0/4036645439 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f0ae00cb820 con 0x7f0aec101a00 2023-08-10T10:45:07.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.711+0000 7f0aeb7fe700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0ad40a11d0 0x7f0ad40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:07.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.712+0000 7f0aeb7fe700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0ad40a11d0 0x7f0ad40a3690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0adc006010 tx=0x7f0adc005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:07.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.715+0000 7f0ae8ff9700 1 -- 172.21.15.107:0/4036645439 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0ae0095d70 con 0x7f0aec101a00 2023-08-10T10:45:07.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:07.916+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0aec060bb0 con 0x7f0ad40a11d0 2023-08-10T10:45:08.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:45:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:45:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:08 smithi195 ceph-mon[129938]: osdmap e41: 6 total, 6 up, 6 in 2023-08-10T10:45:08.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:45:08.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:45:08.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:08.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:08 smithi157 ceph-mon[129604]: osdmap e41: 6 total, 6 up, 6 in 2023-08-10T10:45:08.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:45:08.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:45:08.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:08.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:08 smithi107 ceph-mon[127953]: osdmap e41: 6 total, 6 up, 6 in 2023-08-10T10:45:09.285 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:09 smithi107 ceph-mon[127953]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:09.286 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:09 smithi107 ceph-mon[127953]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:45:09.286 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:09 smithi107 ceph-mon[127953]: osdmap e42: 6 total, 6 up, 6 in 2023-08-10T10:45:09.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:09 smithi195 ceph-mon[129938]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:09.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:09 smithi195 ceph-mon[129938]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:45:09.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:09 smithi195 ceph-mon[129938]: osdmap e42: 6 total, 6 up, 6 in 2023-08-10T10:45:09.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:09 smithi157 ceph-mon[129604]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:09.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:09 smithi157 ceph-mon[129604]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:45:09.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:09 smithi157 ceph-mon[129604]: osdmap e42: 6 total, 6 up, 6 in 2023-08-10T10:45:11.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:11 smithi195 ceph-mon[129938]: pgmap v151: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:11.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:11 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3990655461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ac5a683-512b-450f-a2a6-b79cce87988f"}]: dispatch 2023-08-10T10:45:11.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:11 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3990655461' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ac5a683-512b-450f-a2a6-b79cce87988f"}]': finished 2023-08-10T10:45:11.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:11 smithi195 ceph-mon[129938]: osdmap e43: 7 total, 6 up, 7 in 2023-08-10T10:45:11.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:11.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:11 smithi157 ceph-mon[129604]: pgmap v151: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:11.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:11 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3990655461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ac5a683-512b-450f-a2a6-b79cce87988f"}]: dispatch 2023-08-10T10:45:11.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:11 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3990655461' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ac5a683-512b-450f-a2a6-b79cce87988f"}]': finished 2023-08-10T10:45:11.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:11 smithi157 ceph-mon[129604]: osdmap e43: 7 total, 6 up, 7 in 2023-08-10T10:45:11.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:11.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:11 smithi107 ceph-mon[127953]: pgmap v151: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:11.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:11 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3990655461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ac5a683-512b-450f-a2a6-b79cce87988f"}]: dispatch 2023-08-10T10:45:11.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:11 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3990655461' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ac5a683-512b-450f-a2a6-b79cce87988f"}]': finished 2023-08-10T10:45:11.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:11 smithi107 ceph-mon[127953]: osdmap e43: 7 total, 6 up, 7 in 2023-08-10T10:45:11.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:12.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:12 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1165788174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:45:12.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:12 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1165788174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:45:12.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:12 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1165788174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:45:13.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:13 smithi195 ceph-mon[129938]: pgmap v153: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:13.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:13 smithi157 ceph-mon[129604]: pgmap v153: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:13.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:13 smithi107 ceph-mon[127953]: pgmap v153: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:15.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:15 smithi107 ceph-mon[127953]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T10:45:15.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:15 smithi195 ceph-mon[129938]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T10:45:15.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:15 smithi157 ceph-mon[129604]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T10:45:17.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:17 smithi107 ceph-mon[127953]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-08-10T10:45:17.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:17 smithi195 ceph-mon[129938]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-08-10T10:45:17.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:17 smithi157 ceph-mon[129604]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-08-10T10:45:19.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:19 smithi195 ceph-mon[129938]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-08-10T10:45:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-08-10T10:45:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:19.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:19 smithi107 ceph-mon[127953]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-08-10T10:45:19.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-08-10T10:45:19.501 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:19.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:19 smithi157 ceph-mon[129604]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-08-10T10:45:19.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-08-10T10:45:19.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:20.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:20 smithi107 ceph-mon[127953]: Deploying daemon osd.6 on smithi107 2023-08-10T10:45:20.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:20 smithi195 ceph-mon[129938]: Deploying daemon osd.6 on smithi107 2023-08-10T10:45:20.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:20 smithi157 ceph-mon[129604]: Deploying daemon osd.6 on smithi107 2023-08-10T10:45:21.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:21 smithi107 ceph-mon[127953]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T10:45:21.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:21 smithi195 ceph-mon[129938]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T10:45:21.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:21 smithi157 ceph-mon[129604]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T10:45:23.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:23 smithi107 ceph-mon[127953]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-08-10T10:45:23.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:23 smithi195 ceph-mon[129938]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-08-10T10:45:23.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:23 smithi157 ceph-mon[129604]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-08-10T10:45:25.378 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:25 smithi107 ceph-mon[127953]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-10T10:45:25.378 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:25.379 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:25.379 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:25.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:25 smithi195 ceph-mon[129938]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-10T10:45:25.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:25.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:25.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:25.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:25 smithi157 ceph-mon[129604]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-08-10T10:45:25.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:25.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:25.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:27.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:27 smithi195 ceph-mon[129938]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:27.461 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:27 smithi107 ceph-mon[127953]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:27.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:27 smithi157 ceph-mon[129604]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:28.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.729+0000 7f0ae8ff9700 1 -- 172.21.15.107:0/4036645439 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0aec060bb0 con 0x7f0ad40a11d0 2023-08-10T10:45:28.731 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 6 on host 'smithi107' 2023-08-10T10:45:28.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0ad40a11d0 msgr2=0x7f0ad40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0ad40a11d0 0x7f0ad40a3690 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0adc006010 tx=0x7f0adc005e80 comp rx=0 tx=0).stop 2023-08-10T10:45:28.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec101a00 msgr2=0x7f0aec196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:28.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec101a00 0x7f0aec196960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000d980 tx=0x7f0ae000dc90 comp rx=0 tx=0).stop 2023-08-10T10:45:28.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 shutdown_connections 2023-08-10T10:45:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0ad40a11d0 0x7f0ad40a3690 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0aec1023a0 0x7f0aec19d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aec100800 0x7f0aec196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 --2- 172.21.15.107:0/4036645439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0aec101a00 0x7f0aec196960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 >> 172.21.15.107:0/4036645439 conn(0x7f0aec0fbd60 msgr2=0x7f0aec0fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 shutdown_connections 2023-08-10T10:45:28.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:45:28.732+0000 7f0af20bd700 1 -- 172.21.15.107:0/4036645439 wait complete. 2023-08-10T10:45:28.922 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:28 smithi107 ceph-mon[127953]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:28.922 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:28.923 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:28.923 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:28.923 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:28.923 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:28.923 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:28.923 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:28.923 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:29.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:28 smithi195 ceph-mon[129938]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:29.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:29.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:29.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:29.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:28 smithi157 ceph-mon[129604]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:29.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:29.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:29.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:29.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:29.291 DEBUG:teuthology.orchestra.run.smithi107:osd.6> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.6.service 2023-08-10T10:45:29.295 INFO:tasks.cephadm:Deploying osd.7 on smithi157 with /dev/vg_nvme/lv_2... 2023-08-10T10:45:29.295 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-08-10T10:45:29.369 INFO:journalctl@ceph.osd.6.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:45:30.029 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T10:45:30.147 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:29 smithi107 ceph-mon[127953]: from='osd.6 [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-10T10:45:30.147 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:29 smithi107 ceph-mon[127953]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-10T10:45:30.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:29 smithi195 ceph-mon[129938]: from='osd.6 [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-10T10:45:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:29 smithi195 ceph-mon[129938]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-10T10:45:30.282 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:29 smithi157 ceph-mon[129604]: from='osd.6 [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-10T10:45:30.282 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:29 smithi157 ceph-mon[129604]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-08-10T10:45:31.077 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 10:45:30 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T10:45:30.882+0000 7f205c9d2700 -1 osd.6 0 waiting for initial osdmap 2023-08-10T10:45:31.077 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 10:45:30 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T10:45:30.892+0000 7f20547bf700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:45:31.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:30 smithi107 ceph-mon[127953]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:31.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:30 smithi107 ceph-mon[127953]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-08-10T10:45:31.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:30 smithi107 ceph-mon[127953]: osdmap e44: 7 total, 6 up, 7 in 2023-08-10T10:45:31.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:30 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:31.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:30 smithi107 ceph-mon[127953]: from='osd.6 [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:45:31.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:30 smithi107 ceph-mon[127953]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:45:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:30 smithi195 ceph-mon[129938]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:30 smithi195 ceph-mon[129938]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-08-10T10:45:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:30 smithi195 ceph-mon[129938]: osdmap e44: 7 total, 6 up, 7 in 2023-08-10T10:45:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:30 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:30 smithi195 ceph-mon[129938]: from='osd.6 [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:45:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:30 smithi195 ceph-mon[129938]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:45:31.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:30 smithi157 ceph-mon[129604]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:31.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:30 smithi157 ceph-mon[129604]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-08-10T10:45:31.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:30 smithi157 ceph-mon[129604]: osdmap e44: 7 total, 6 up, 7 in 2023-08-10T10:45:31.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:30 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:31.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:30 smithi157 ceph-mon[129604]: from='osd.6 [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:45:31.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:30 smithi157 ceph-mon[129604]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:45:32.113 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-08-10T10:45:32.113 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-08-10T10:45:32.113 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2023-08-10T10:45:32.113 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2023-08-10T10:45:32.114 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0407922 s, 257 MB/s 2023-08-10T10:45:32.114 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 2023-08-10T10:45:32.114 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2023-08-10T10:45:32.149 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:31 smithi157 ceph-mon[129604]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:45:32.149 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:31 smithi157 ceph-mon[129604]: osdmap e45: 7 total, 6 up, 7 in 2023-08-10T10:45:32.149 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:31 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:32.149 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:31 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:32.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:31 smithi195 ceph-mon[129938]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:45:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:31 smithi195 ceph-mon[129938]: osdmap e45: 7 total, 6 up, 7 in 2023-08-10T10:45:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:31 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:31 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:31 smithi107 ceph-mon[127953]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:45:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:31 smithi107 ceph-mon[127953]: osdmap e45: 7 total, 6 up, 7 in 2023-08-10T10:45:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:31 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:31 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:32.705 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi157:vg_nvme/lv_2 2023-08-10T10:45:33.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:45:33.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:45:33.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:33.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: osd.6 [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] boot 2023-08-10T10:45:33.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: osdmap e46: 7 total, 7 up, 7 in 2023-08-10T10:45:33.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:33.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi107 2023-08-10T10:45:33.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:33.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:33.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:33.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi107 to 5755M 2023-08-10T10:45:33.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:33.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:33.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:45:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:45:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: osd.6 [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] boot 2023-08-10T10:45:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: osdmap e46: 7 total, 7 up, 7 in 2023-08-10T10:45:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi107 2023-08-10T10:45:33.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:33.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:33.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:33.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi107 to 5755M 2023-08-10T10:45:33.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:33.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:33.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:45:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:45:33.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-08-10T10:45:33.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: osd.6 [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] boot 2023-08-10T10:45:33.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: osdmap e46: 7 total, 7 up, 7 in 2023-08-10T10:45:33.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:45:33.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi107 2023-08-10T10:45:33.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:33.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:33.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:45:33.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi107 to 5755M 2023-08-10T10:45:33.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:33.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:33.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:33.425 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T10:45:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:34 smithi107 ceph-mon[127953]: osdmap e47: 7 total, 7 up, 7 in 2023-08-10T10:45:34.363 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:34 smithi157 ceph-mon[129604]: osdmap e47: 7 total, 7 up, 7 in 2023-08-10T10:45:34.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:34 smithi195 ceph-mon[129938]: osdmap e47: 7 total, 7 up, 7 in 2023-08-10T10:45:35.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.058+0000 7f6def457700 1 -- 172.21.15.157:0/3985069694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de8101a00 msgr2=0x7f6de8101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.058+0000 7f6def457700 1 --2- 172.21.15.157:0/3985069694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de8101a00 0x7f6de8101e60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80099c0 tx=0x7f6dd8009cd0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.059 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.058+0000 7f6def457700 1 -- 172.21.15.157:0/3985069694 shutdown_connections 2023-08-10T10:45:35.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.058+0000 7f6def457700 1 --2- 172.21.15.157:0/3985069694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de81023a0 0x7f6de8108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.058+0000 7f6def457700 1 --2- 172.21.15.157:0/3985069694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6de8100800 0x7f6de8100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.058+0000 7f6def457700 1 --2- 172.21.15.157:0/3985069694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de8101a00 0x7f6de8101e60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.058+0000 7f6def457700 1 -- 172.21.15.157:0/3985069694 >> 172.21.15.157:0/3985069694 conn(0x7f6de80fbd60 msgr2=0x7f6de80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:35.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.058+0000 7f6def457700 1 -- 172.21.15.157:0/3985069694 shutdown_connections 2023-08-10T10:45:35.060 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.058+0000 7f6def457700 1 -- 172.21.15.157:0/3985069694 wait complete. 2023-08-10T10:45:35.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.059+0000 7f6def457700 1 Processor -- start 2023-08-10T10:45:35.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.059+0000 7f6def457700 1 -- start start 2023-08-10T10:45:35.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.059+0000 7f6def457700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de8100800 0x7f6de8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6def457700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6de8101a00 0x7f6de8198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6def457700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de81023a0 0x7f6de819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6def457700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81a01c0 con 0x7f6de8100800 2023-08-10T10:45:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6def457700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81a0300 con 0x7f6de81023a0 2023-08-10T10:45:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6def457700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81a0490 con 0x7f6de8101a00 2023-08-10T10:45:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded9f4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de81023a0 0x7f6de819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6dec9f2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6de8101a00 0x7f6de8198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded9f4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de81023a0 0x7f6de819fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:50312/0 (socket says 172.21.15.157:50312) 2023-08-10T10:45:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded9f4700 1 -- 172.21.15.157:0/2323816082 learned_addr learned my addr 172.21.15.157:0/2323816082 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-08-10T10:45:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded1f3700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de8100800 0x7f6de8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded9f4700 1 -- 172.21.15.157:0/2323816082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6de8101a00 msgr2=0x7f6de8198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded9f4700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6de8101a00 0x7f6de8198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded9f4700 1 -- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de8100800 msgr2=0x7f6de8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded9f4700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de8100800 0x7f6de8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded9f4700 1 -- 172.21.15.157:0/2323816082 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80095f0 con 0x7f6de81023a0 2023-08-10T10:45:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.060+0000 7f6ded1f3700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de8100800 0x7f6de8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:45:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.061+0000 7f6ded9f4700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de81023a0 0x7f6de819fbf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6de0007ee0 tx=0x7f6de000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:35.065 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.061+0000 7f6dde7fc700 1 -- 172.21.15.157:0/2323816082 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0017070 con 0x7f6de81023a0 2023-08-10T10:45:35.065 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.061+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de81a0770 con 0x7f6de81023a0 2023-08-10T10:45:35.065 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.061+0000 7f6dde7fc700 1 -- 172.21.15.157:0/2323816082 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6de000f040 con 0x7f6de81023a0 2023-08-10T10:45:35.065 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.061+0000 7f6dde7fc700 1 -- 172.21.15.157:0/2323816082 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0004ea0 con 0x7f6de81023a0 2023-08-10T10:45:35.065 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.061+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de81a0c70 con 0x7f6de81023a0 2023-08-10T10:45:35.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.062+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de810bf00 con 0x7f6de81023a0 2023-08-10T10:45:35.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.064+0000 7f6dde7fc700 1 -- 172.21.15.157:0/2323816082 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6de0005020 con 0x7f6de81023a0 2023-08-10T10:45:35.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.065+0000 7f6dde7fc700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6dd40a1150 0x7f6dd40a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:45:35.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.065+0000 7f6dde7fc700 1 -- 172.21.15.157:0/2323816082 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f6de00cb440 con 0x7f6de81023a0 2023-08-10T10:45:35.066 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.066+0000 7f6ded1f3700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6dd40a1150 0x7f6dd40a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:45:35.067 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.066+0000 7f6ded1f3700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6dd40a1150 0x7f6dd40a3610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6de4005950 tx=0x7f6de40058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:45:35.070 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.069+0000 7f6dde7fc700 1 -- 172.21.15.157:0/2323816082 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6de0095800 con 0x7f6de81023a0 2023-08-10T10:45:35.274 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:35.274+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6de8108430 con 0x7f6dd40a1150 2023-08-10T10:45:35.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:35 smithi157 ceph-mon[129604]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:35.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:35 smithi107 ceph-mon[127953]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:35.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:35 smithi195 ceph-mon[129938]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:45:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:45:36.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:36 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:36.388 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:45:36.388 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:45:36.388 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:36 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:36.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:45:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:45:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:36 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:37.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:37 smithi157 ceph-mon[129604]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:45:37.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:37 smithi157 ceph-mon[129604]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:37.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:37 smithi107 ceph-mon[127953]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:45:37.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:37 smithi107 ceph-mon[127953]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:37.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:37 smithi195 ceph-mon[129938]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:45:37.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:37 smithi195 ceph-mon[129938]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:39 smithi107 ceph-mon[127953]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:39 smithi107 ceph-mon[127953]: from='client.? 172.21.15.157:0/1033279404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41ebd81c-5952-4224-9cd5-ae37fa8885a1"}]: dispatch 2023-08-10T10:45:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:39 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41ebd81c-5952-4224-9cd5-ae37fa8885a1"}]: dispatch 2023-08-10T10:45:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:39 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41ebd81c-5952-4224-9cd5-ae37fa8885a1"}]': finished 2023-08-10T10:45:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:39 smithi107 ceph-mon[127953]: osdmap e48: 8 total, 7 up, 8 in 2023-08-10T10:45:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:39.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:39 smithi195 ceph-mon[129938]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:39 smithi195 ceph-mon[129938]: from='client.? 172.21.15.157:0/1033279404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41ebd81c-5952-4224-9cd5-ae37fa8885a1"}]: dispatch 2023-08-10T10:45:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:39 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41ebd81c-5952-4224-9cd5-ae37fa8885a1"}]: dispatch 2023-08-10T10:45:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:39 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41ebd81c-5952-4224-9cd5-ae37fa8885a1"}]': finished 2023-08-10T10:45:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:39 smithi195 ceph-mon[129938]: osdmap e48: 8 total, 7 up, 8 in 2023-08-10T10:45:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:39 smithi157 ceph-mon[129604]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:39 smithi157 ceph-mon[129604]: from='client.? 172.21.15.157:0/1033279404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41ebd81c-5952-4224-9cd5-ae37fa8885a1"}]: dispatch 2023-08-10T10:45:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:39 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41ebd81c-5952-4224-9cd5-ae37fa8885a1"}]: dispatch 2023-08-10T10:45:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:39 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41ebd81c-5952-4224-9cd5-ae37fa8885a1"}]': finished 2023-08-10T10:45:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:39 smithi157 ceph-mon[129604]: osdmap e48: 8 total, 7 up, 8 in 2023-08-10T10:45:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:40 smithi107 ceph-mon[127953]: from='client.? 172.21.15.157:0/329286580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:45:40.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:40 smithi195 ceph-mon[129938]: from='client.? 172.21.15.157:0/329286580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:45:40.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:40 smithi157 ceph-mon[129604]: from='client.? 172.21.15.157:0/329286580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:45:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:41 smithi107 ceph-mon[127953]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:41.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:41 smithi195 ceph-mon[129938]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:41.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:41 smithi157 ceph-mon[129604]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:43.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:43 smithi107 ceph-mon[127953]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:43.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:43 smithi195 ceph-mon[129938]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:43.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:43 smithi157 ceph-mon[129604]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:45.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:45 smithi157 ceph-mon[129604]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:45 smithi107 ceph-mon[127953]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:45.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:45 smithi195 ceph-mon[129938]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-08-10T10:45:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:46.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-08-10T10:45:46.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:46.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-08-10T10:45:46.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:47.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:47 smithi107 ceph-mon[127953]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:47.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:47 smithi107 ceph-mon[127953]: Deploying daemon osd.7 on smithi157 2023-08-10T10:45:47.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:47 smithi157 ceph-mon[129604]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:47.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:47 smithi157 ceph-mon[129604]: Deploying daemon osd.7 on smithi157 2023-08-10T10:45:47.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:47 smithi195 ceph-mon[129938]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:47.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:47 smithi195 ceph-mon[129938]: Deploying daemon osd.7 on smithi157 2023-08-10T10:45:49.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:49 smithi157 ceph-mon[129604]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:49.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:49 smithi107 ceph-mon[127953]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:49.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:49 smithi195 ceph-mon[129938]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:51.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:51 smithi157 ceph-mon[129604]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:51 smithi195 ceph-mon[129938]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:51.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:51 smithi107 ceph-mon[127953]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:53.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:53 smithi195 ceph-mon[129938]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:53.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:53 smithi157 ceph-mon[129604]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:53.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:53.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:53.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:53 smithi107 ceph-mon[127953]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:55.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:55 smithi195 ceph-mon[129938]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:55.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:55 smithi157 ceph-mon[129604]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:55.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:55 smithi107 ceph-mon[127953]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:55.998 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:55.997+0000 7f6dde7fc700 1 -- 172.21.15.157:0/2323816082 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6de8108430 con 0x7f6dd40a1150 2023-08-10T10:45:55.999 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 7 on host 'smithi157' 2023-08-10T10:45:56.000 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6dd40a1150 msgr2=0x7f6dd40a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.000 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6dd40a1150 0x7f6dd40a3610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6de4005950 tx=0x7f6de40058e0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.001 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de81023a0 msgr2=0x7f6de819fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:45:56.001 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de81023a0 0x7f6de819fbf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6de0007ee0 tx=0x7f6de000d3b0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.001 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 shutdown_connections 2023-08-10T10:45:56.001 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6dd40a1150 0x7f6dd40a3610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.001 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6de81023a0 0x7f6de819fbf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.001 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6de8100800 0x7f6de8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.001 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 --2- 172.21.15.157:0/2323816082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6de8101a00 0x7f6de8198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:45:56.002 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 >> 172.21.15.157:0/2323816082 conn(0x7f6de80fbd60 msgr2=0x7f6de80fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:45:56.002 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 shutdown_connections 2023-08-10T10:45:56.002 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:45:56.000+0000 7f6def457700 1 -- 172.21.15.157:0/2323816082 wait complete. 2023-08-10T10:45:56.437 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:56 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.438 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:56 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.438 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:56 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:56.438 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:56 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:56.438 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:56 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.438 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:56 smithi157 ceph-mon[129604]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:56.439 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:56 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.439 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:56 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.439 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:56 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:56.440 DEBUG:teuthology.orchestra.run.smithi157:osd.7> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.7.service 2023-08-10T10:45:56.444 INFO:tasks.cephadm:Deploying osd.8 on smithi195 with /dev/vg_nvme/lv_2... 2023-08-10T10:45:56.445 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-08-10T10:45:56.516 INFO:journalctl@ceph.osd.7.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:45:56.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:56 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:56 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:56 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:56.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:56 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:56.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:56 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:56 smithi107 ceph-mon[127953]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:56.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:56 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:56 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:56 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:56.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:45:56.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:45:56.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:56 smithi195 ceph-mon[129938]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:56.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:45:56.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:56 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:45:57.177 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:45:57.415 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:57 smithi157 ceph-mon[129604]: from='osd.7 [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T10:45:57.415 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:57 smithi157 ceph-mon[129604]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T10:45:57.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:57 smithi107 ceph-mon[127953]: from='osd.7 [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T10:45:57.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:57 smithi107 ceph-mon[127953]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T10:45:57.599 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:57 smithi195 ceph-mon[129938]: from='osd.7 [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T10:45:57.600 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:57 smithi195 ceph-mon[129938]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-08-10T10:45:58.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:58 smithi195 ceph-mon[129938]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-08-10T10:45:58.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:58 smithi195 ceph-mon[129938]: osdmap e49: 8 total, 7 up, 8 in 2023-08-10T10:45:58.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:58 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:58.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:58 smithi195 ceph-mon[129938]: from='osd.7 [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:45:58.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:58 smithi195 ceph-mon[129938]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:45:58.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:58 smithi195 ceph-mon[129938]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:58.539 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 10:45:58 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T10:45:58.305+0000 7f71b57ee700 -1 osd.7 0 waiting for initial osdmap 2023-08-10T10:45:58.539 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 10:45:58 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T10:45:58.323+0000 7f71adddc700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:45:58.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:58 smithi157 ceph-mon[129604]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-08-10T10:45:58.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:58 smithi157 ceph-mon[129604]: osdmap e49: 8 total, 7 up, 8 in 2023-08-10T10:45:58.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:58 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:58.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:58 smithi157 ceph-mon[129604]: from='osd.7 [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:45:58.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:58 smithi157 ceph-mon[129604]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:45:58.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:58 smithi157 ceph-mon[129604]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:58.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:58 smithi107 ceph-mon[127953]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-08-10T10:45:58.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:58 smithi107 ceph-mon[127953]: osdmap e49: 8 total, 7 up, 8 in 2023-08-10T10:45:58.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:58 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:58.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:58 smithi107 ceph-mon[127953]: from='osd.7 [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:45:58.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:58 smithi107 ceph-mon[127953]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:45:58.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:58 smithi107 ceph-mon[127953]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-08-10T10:45:59.123 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-08-10T10:45:59.123 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-08-10T10:45:59.123 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-08-10T10:45:59.123 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-08-10T10:45:59.123 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0296762 s, 353 MB/s 2023-08-10T10:45:59.124 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-08-10T10:45:59.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:59 smithi195 ceph-mon[129938]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:45:59.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:59 smithi195 ceph-mon[129938]: osdmap e50: 8 total, 7 up, 8 in 2023-08-10T10:45:59.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:59.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:59.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:59 smithi195 ceph-mon[129938]: osd.7 [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] boot 2023-08-10T10:45:59.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:59 smithi195 ceph-mon[129938]: osdmap e51: 8 total, 8 up, 8 in 2023-08-10T10:45:59.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:45:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:59 smithi107 ceph-mon[127953]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:45:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:59 smithi107 ceph-mon[127953]: osdmap e50: 8 total, 7 up, 8 in 2023-08-10T10:45:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:59.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:59.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:59 smithi107 ceph-mon[127953]: osd.7 [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] boot 2023-08-10T10:45:59.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:59 smithi107 ceph-mon[127953]: osdmap e51: 8 total, 8 up, 8 in 2023-08-10T10:45:59.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:45:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:59.656 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2023-08-10T10:45:59.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:59 smithi157 ceph-mon[129604]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:45:59.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:59 smithi157 ceph-mon[129604]: osdmap e50: 8 total, 7 up, 8 in 2023-08-10T10:45:59.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:59.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:45:59.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:59 smithi157 ceph-mon[129604]: osd.7 [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] boot 2023-08-10T10:45:59.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:59 smithi157 ceph-mon[129604]: osdmap e51: 8 total, 8 up, 8 in 2023-08-10T10:45:59.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:45:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:46:00.378 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:46:00.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:46:00.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:46:00.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi157 2023-08-10T10:46:00.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi157 to 5755M 2023-08-10T10:46:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:00.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:00.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:00.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:00 smithi107 ceph-mon[127953]: osdmap e52: 8 total, 8 up, 8 in 2023-08-10T10:46:00.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:46:00.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:46:00.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi157 2023-08-10T10:46:00.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:00.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:00.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:00.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi157 to 5755M 2023-08-10T10:46:00.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:00.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:00.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:00.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:00 smithi195 ceph-mon[129938]: osdmap e52: 8 total, 8 up, 8 in 2023-08-10T10:46:00.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:46:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:46:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi157 2023-08-10T10:46:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:00.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi157 to 5755M 2023-08-10T10:46:00.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:00.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:00.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:00.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:00.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:00 smithi157 ceph-mon[129604]: osdmap e52: 8 total, 8 up, 8 in 2023-08-10T10:46:01.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:01 smithi195 ceph-mon[129938]: osdmap e53: 8 total, 8 up, 8 in 2023-08-10T10:46:01.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:01 smithi107 ceph-mon[127953]: osdmap e53: 8 total, 8 up, 8 in 2023-08-10T10:46:01.895 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.894+0000 7feb11267700 1 -- 172.21.15.195:0/386725680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 msgr2=0x7feb0c100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.895 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.894+0000 7feb11267700 1 --2- 172.21.15.195:0/386725680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 0x7feb0c100c20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feafc009990 tx=0x7feafc009ca0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.895 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.894+0000 7feb11267700 1 -- 172.21.15.195:0/386725680 shutdown_connections 2023-08-10T10:46:01.895 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.894+0000 7feb11267700 1 --2- 172.21.15.195:0/386725680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb0c1023a0 0x7feb0c108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.896 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.894+0000 7feb11267700 1 --2- 172.21.15.195:0/386725680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 0x7feb0c100c20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.896 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.894+0000 7feb11267700 1 --2- 172.21.15.195:0/386725680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0c101a00 0x7feb0c101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.896 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.894+0000 7feb11267700 1 -- 172.21.15.195:0/386725680 >> 172.21.15.195:0/386725680 conn(0x7feb0c0fbd60 msgr2=0x7feb0c0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:01.896 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.894+0000 7feb11267700 1 -- 172.21.15.195:0/386725680 shutdown_connections 2023-08-10T10:46:01.896 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.894+0000 7feb11267700 1 -- 172.21.15.195:0/386725680 wait complete. 2023-08-10T10:46:01.898 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.895+0000 7feb11267700 1 Processor -- start 2023-08-10T10:46:01.898 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.895+0000 7feb11267700 1 -- start start 2023-08-10T10:46:01.898 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.895+0000 7feb11267700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 0x7feb0c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.898 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.895+0000 7feb11267700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb0c101a00 0x7feb0c196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.898 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb11267700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0c1023a0 0x7feb0c19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.898 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb11267700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c19dfe0 con 0x7feb0c1023a0 2023-08-10T10:46:01.899 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb11267700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c19e120 con 0x7feb0c101a00 2023-08-10T10:46:01.899 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb11267700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c19e2b0 con 0x7feb0c100800 2023-08-10T10:46:01.899 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 0x7feb0c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.899 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 0x7feb0c196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:51834/0 (socket says 172.21.15.195:51834) 2023-08-10T10:46:01.899 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0affd700 1 -- 172.21.15.195:0/3229517732 learned_addr learned my addr 172.21.15.195:0/3229517732 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:46:01.899 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0a7fc700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb0c101a00 0x7feb0c196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.900 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0b7fe700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0c1023a0 0x7feb0c19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.900 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0affd700 1 -- 172.21.15.195:0/3229517732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb0c101a00 msgr2=0x7feb0c196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.900 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0affd700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb0c101a00 0x7feb0c196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.900 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0affd700 1 -- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0c1023a0 msgr2=0x7feb0c19da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:01.900 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0affd700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0c1023a0 0x7feb0c19da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:01.900 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.896+0000 7feb0affd700 1 -- 172.21.15.195:0/3229517732 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0095f0 con 0x7feb0c100800 2023-08-10T10:46:01.900 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.897+0000 7feb0affd700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 0x7feb0c196450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feafc00bb50 tx=0x7feafc00bb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:01.901 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.897+0000 7feaf3fff700 1 -- 172.21.15.195:0/3229517732 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc01d070 con 0x7feb0c100800 2023-08-10T10:46:01.901 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.897+0000 7feaf3fff700 1 -- 172.21.15.195:0/3229517732 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feafc003da0 con 0x7feb0c100800 2023-08-10T10:46:01.901 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.897+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c19e530 con 0x7feb0c100800 2023-08-10T10:46:01.901 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.897+0000 7feaf3fff700 1 -- 172.21.15.195:0/3229517732 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc005280 con 0x7feb0c100800 2023-08-10T10:46:01.901 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.897+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c19e940 con 0x7feb0c100800 2023-08-10T10:46:01.902 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.898+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c10bf00 con 0x7feb0c100800 2023-08-10T10:46:01.902 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.900+0000 7feaf3fff700 1 -- 172.21.15.195:0/3229517732 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7feafc003910 con 0x7feb0c100800 2023-08-10T10:46:01.903 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.902+0000 7feaf3fff700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feaf40a11d0 0x7feaf40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:01.903 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.903+0000 7feaf3fff700 1 -- 172.21.15.195:0/3229517732 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5397+0+0 (secure 0 0 0) 0x7feafc0cd500 con 0x7feb0c100800 2023-08-10T10:46:01.904 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.903+0000 7feb0a7fc700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feaf40a11d0 0x7feaf40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:01.905 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.904+0000 7feb0a7fc700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feaf40a11d0 0x7feaf40a3690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feb00009c60 tx=0x7feb00009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:01.906 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:01.906+0000 7feaf3fff700 1 -- 172.21.15.195:0/3229517732 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7feafc0977a0 con 0x7feb0c100800 2023-08-10T10:46:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:01 smithi157 ceph-mon[129604]: osdmap e53: 8 total, 8 up, 8 in 2023-08-10T10:46:02.109 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:02.107+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7feb0c19efe0 con 0x7feaf40a11d0 2023-08-10T10:46:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:02 smithi107 ceph-mon[127953]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:02 smithi107 ceph-mon[127953]: osdmap e54: 8 total, 8 up, 8 in 2023-08-10T10:46:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:02 smithi107 ceph-mon[127953]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:46:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:46:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:46:02.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:02.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:02 smithi195 ceph-mon[129938]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:02 smithi195 ceph-mon[129938]: osdmap e54: 8 total, 8 up, 8 in 2023-08-10T10:46:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:02 smithi195 ceph-mon[129938]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:46:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:46:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:46:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:03.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:02 smithi157 ceph-mon[129604]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:03.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:02 smithi157 ceph-mon[129604]: osdmap e54: 8 total, 8 up, 8 in 2023-08-10T10:46:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:02 smithi157 ceph-mon[129604]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:46:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:46:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:46:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:03.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:03 smithi195 ceph-mon[129938]: osdmap e55: 8 total, 8 up, 8 in 2023-08-10T10:46:04.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:03 smithi157 ceph-mon[129604]: osdmap e55: 8 total, 8 up, 8 in 2023-08-10T10:46:04.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:03 smithi107 ceph-mon[127953]: osdmap e55: 8 total, 8 up, 8 in 2023-08-10T10:46:04.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:04 smithi195 ceph-mon[129938]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:04.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:04 smithi195 ceph-mon[129938]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-08-10T10:46:05.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:04 smithi157 ceph-mon[129604]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:05.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:04 smithi157 ceph-mon[129604]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-08-10T10:46:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:04 smithi107 ceph-mon[127953]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:04 smithi107 ceph-mon[127953]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-08-10T10:46:05.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:05 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/2987900947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4173ce-ee76-4468-b01e-92713996ea0a"}]: dispatch 2023-08-10T10:46:05.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:05 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4173ce-ee76-4468-b01e-92713996ea0a"}]: dispatch 2023-08-10T10:46:05.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:05 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b4173ce-ee76-4468-b01e-92713996ea0a"}]': finished 2023-08-10T10:46:05.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:05 smithi195 ceph-mon[129938]: osdmap e56: 9 total, 8 up, 9 in 2023-08-10T10:46:05.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:05 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:06.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:05 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/2987900947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4173ce-ee76-4468-b01e-92713996ea0a"}]: dispatch 2023-08-10T10:46:06.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:05 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4173ce-ee76-4468-b01e-92713996ea0a"}]: dispatch 2023-08-10T10:46:06.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:05 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b4173ce-ee76-4468-b01e-92713996ea0a"}]': finished 2023-08-10T10:46:06.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:05 smithi157 ceph-mon[129604]: osdmap e56: 9 total, 8 up, 9 in 2023-08-10T10:46:06.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:05 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:05 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/2987900947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4173ce-ee76-4468-b01e-92713996ea0a"}]: dispatch 2023-08-10T10:46:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:05 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b4173ce-ee76-4468-b01e-92713996ea0a"}]: dispatch 2023-08-10T10:46:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:05 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b4173ce-ee76-4468-b01e-92713996ea0a"}]': finished 2023-08-10T10:46:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:05 smithi107 ceph-mon[127953]: osdmap e56: 9 total, 8 up, 9 in 2023-08-10T10:46:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:05 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:06.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:06 smithi195 ceph-mon[129938]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:06.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:06 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/22730857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:46:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:06 smithi195 ceph-mon[129938]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-08-10T10:46:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:06 smithi195 ceph-mon[129938]: Cluster is now healthy 2023-08-10T10:46:07.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:06 smithi157 ceph-mon[129604]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:07.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:06 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/22730857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:46:07.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:06 smithi157 ceph-mon[129604]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-08-10T10:46:07.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:06 smithi157 ceph-mon[129604]: Cluster is now healthy 2023-08-10T10:46:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:06 smithi107 ceph-mon[127953]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:06 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/22730857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:46:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:06 smithi107 ceph-mon[127953]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-08-10T10:46:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:06 smithi107 ceph-mon[127953]: Cluster is now healthy 2023-08-10T10:46:08.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:08 smithi195 ceph-mon[129938]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:09.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:08 smithi157 ceph-mon[129604]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:09.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:08 smithi107 ceph-mon[127953]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:10.856 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:10 smithi195 ceph-mon[129938]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:11.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:10 smithi157 ceph-mon[129604]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:10 smithi107 ceph-mon[127953]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:12.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:12 smithi195 ceph-mon[129938]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-08-10T10:46:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:12 smithi157 ceph-mon[129604]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-08-10T10:46:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:12 smithi107 ceph-mon[127953]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-08-10T10:46:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:13.756 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:13 smithi195 ceph-mon[129938]: Deploying daemon osd.8 on smithi195 2023-08-10T10:46:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:13 smithi157 ceph-mon[129604]: Deploying daemon osd.8 on smithi195 2023-08-10T10:46:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:13 smithi107 ceph-mon[127953]: Deploying daemon osd.8 on smithi195 2023-08-10T10:46:14.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:14 smithi195 ceph-mon[129938]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:15.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:14 smithi157 ceph-mon[129604]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:14 smithi107 ceph-mon[127953]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:16.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:16 smithi195 ceph-mon[129938]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:16 smithi157 ceph-mon[129604]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:16 smithi107 ceph-mon[127953]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:18.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:18 smithi195 ceph-mon[129938]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:19.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:18 smithi157 ceph-mon[129604]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:18 smithi107 ceph-mon[127953]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:20.470 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:20.470 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:20.470 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:20 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:20.470 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:20 smithi195 ceph-mon[129938]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:20.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:20.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:20.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:20 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:20.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:20 smithi157 ceph-mon[129604]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:20.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:20.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:20.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:20 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:20.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:20 smithi107 ceph-mon[127953]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:22.637 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.635+0000 7feaf3fff700 1 -- 172.21.15.195:0/3229517732 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7feb0c19efe0 con 0x7feaf40a11d0 2023-08-10T10:46:22.638 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 8 on host 'smithi195' 2023-08-10T10:46:22.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feaf40a11d0 msgr2=0x7feaf40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:22.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feaf40a11d0 0x7feaf40a3690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feb00009c60 tx=0x7feb00009260 comp rx=0 tx=0).stop 2023-08-10T10:46:22.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 msgr2=0x7feb0c196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:22.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 0x7feb0c196450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feafc00bb50 tx=0x7feafc00bb80 comp rx=0 tx=0).stop 2023-08-10T10:46:22.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 shutdown_connections 2023-08-10T10:46:22.640 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feaf40a11d0 0x7feaf40a3690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb0c1023a0 0x7feb0c19da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb0c100800 0x7feb0c196450 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 --2- 172.21.15.195:0/3229517732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb0c101a00 0x7feb0c196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:22.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 >> 172.21.15.195:0/3229517732 conn(0x7feb0c0fbd60 msgr2=0x7feb0c0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:22.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 shutdown_connections 2023-08-10T10:46:22.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:46:22.638+0000 7feb11267700 1 -- 172.21.15.195:0/3229517732 wait complete. 2023-08-10T10:46:22.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:22 smithi195 ceph-mon[129938]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:22 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:22 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:22 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:22 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:22 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:22 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:23.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:22 smithi157 ceph-mon[129604]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:23.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:22 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:22 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:22 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:22 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:22 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:22 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:22 smithi107 ceph-mon[127953]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:23.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:23.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:23.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:23.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:23.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:23.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:23.100 DEBUG:teuthology.orchestra.run.smithi195:osd.8> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.8.service 2023-08-10T10:46:23.105 INFO:tasks.cephadm:Deploying osd.9 on smithi107 with /dev/vg_nvme/lv_1... 2023-08-10T10:46:23.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-08-10T10:46:23.191 INFO:journalctl@ceph.osd.8.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:46:23.835 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:46:23.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:23 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:23.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:23 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:23.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:23 smithi195 ceph-mon[129938]: from='osd.8 [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T10:46:23.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:23 smithi195 ceph-mon[129938]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T10:46:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:23 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:24.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:23 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:24.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:23 smithi157 ceph-mon[129604]: from='osd.8 [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T10:46:24.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:23 smithi157 ceph-mon[129604]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T10:46:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:23 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:23 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:23 smithi107 ceph-mon[127953]: from='osd.8 [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T10:46:24.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:23 smithi107 ceph-mon[127953]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-08-10T10:46:24.663 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:24 smithi107 ceph-mon[127953]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:24.663 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:24 smithi107 ceph-mon[127953]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-08-10T10:46:24.663 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:24 smithi107 ceph-mon[127953]: osdmap e57: 9 total, 8 up, 9 in 2023-08-10T10:46:24.664 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:24 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:24.664 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:24 smithi107 ceph-mon[127953]: from='osd.8 [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:46:24.664 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:24 smithi107 ceph-mon[127953]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:46:24.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:24 smithi195 ceph-mon[129938]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:24.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:24 smithi195 ceph-mon[129938]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-08-10T10:46:24.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:24 smithi195 ceph-mon[129938]: osdmap e57: 9 total, 8 up, 9 in 2023-08-10T10:46:24.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:24 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:24.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:24 smithi195 ceph-mon[129938]: from='osd.8 [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:46:24.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:24 smithi195 ceph-mon[129938]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:46:24.914 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 10:46:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T10:46:24.622+0000 7fbb6d072700 -1 osd.8 0 waiting for initial osdmap 2023-08-10T10:46:24.914 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 10:46:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T10:46:24.635+0000 7fbb66662700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:46:25.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:24 smithi157 ceph-mon[129604]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:25.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:24 smithi157 ceph-mon[129604]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-08-10T10:46:25.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:24 smithi157 ceph-mon[129604]: osdmap e57: 9 total, 8 up, 9 in 2023-08-10T10:46:25.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:24 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:25.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:24 smithi157 ceph-mon[129604]: from='osd.8 [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:46:25.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:24 smithi157 ceph-mon[129604]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:46:25.689 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-08-10T10:46:25.689 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-08-10T10:46:25.689 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2023-08-10T10:46:25.690 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2023-08-10T10:46:25.690 INFO:teuthology.orchestra.run.smithi107.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0357116 s, 294 MB/s 2023-08-10T10:46:25.690 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 2023-08-10T10:46:25.690 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2023-08-10T10:46:25.854 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:25 smithi195 ceph-mon[129938]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:46:25.854 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:25 smithi195 ceph-mon[129938]: osdmap e58: 9 total, 8 up, 9 in 2023-08-10T10:46:25.854 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:25.854 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:25.855 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:25 smithi195 ceph-mon[129938]: osd.8 [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] boot 2023-08-10T10:46:25.855 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:25 smithi195 ceph-mon[129938]: osdmap e59: 9 total, 9 up, 9 in 2023-08-10T10:46:25.855 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:25.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:25 smithi107 ceph-mon[127953]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:46:25.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:25 smithi107 ceph-mon[127953]: osdmap e58: 9 total, 8 up, 9 in 2023-08-10T10:46:25.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:25.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:25.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:25 smithi107 ceph-mon[127953]: osd.8 [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] boot 2023-08-10T10:46:25.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:25 smithi107 ceph-mon[127953]: osdmap e59: 9 total, 9 up, 9 in 2023-08-10T10:46:25.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:25 smithi157 ceph-mon[129604]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:46:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:25 smithi157 ceph-mon[129604]: osdmap e58: 9 total, 8 up, 9 in 2023-08-10T10:46:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:25 smithi157 ceph-mon[129604]: osd.8 [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] boot 2023-08-10T10:46:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:25 smithi157 ceph-mon[129604]: osdmap e59: 9 total, 9 up, 9 in 2023-08-10T10:46:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:46:26.214 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi107:vg_nvme/lv_1 2023-08-10T10:46:26.939 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:46:27.238 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:46:27.239 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:46:27.239 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:27.239 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi195 2023-08-10T10:46:27.239 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.239 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.239 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:27.240 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:27.240 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:27.240 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi195 to 5755M 2023-08-10T10:46:27.240 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.240 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:27.240 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:27.240 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.241 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:26 smithi107 ceph-mon[127953]: osdmap e60: 9 total, 9 up, 9 in 2023-08-10T10:46:27.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:46:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:46:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi195 2023-08-10T10:46:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:27.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:27.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi195 to 5755M 2023-08-10T10:46:27.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:27.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:27.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:26 smithi157 ceph-mon[129604]: osdmap e60: 9 total, 9 up, 9 in 2023-08-10T10:46:27.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:46:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:46:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-08-10T10:46:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi195 2023-08-10T10:46:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:27.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:27.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:27.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi195 to 5755M 2023-08-10T10:46:27.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:27.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:27.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:27.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:26 smithi195 ceph-mon[129938]: osdmap e60: 9 total, 9 up, 9 in 2023-08-10T10:46:28.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.454+0000 7f494a22c700 1 -- 172.21.15.107:0/2517392911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944100800 msgr2=0x7f4944100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:28.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.454+0000 7f494a22c700 1 --2- 172.21.15.107:0/2517392911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944100800 0x7f4944100c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f49340099c0 tx=0x7f4934009cd0 comp rx=0 tx=0).stop 2023-08-10T10:46:28.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.454+0000 7f494a22c700 1 -- 172.21.15.107:0/2517392911 shutdown_connections 2023-08-10T10:46:28.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.454+0000 7f494a22c700 1 --2- 172.21.15.107:0/2517392911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49441023a0 0x7f4944108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:28.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.454+0000 7f494a22c700 1 --2- 172.21.15.107:0/2517392911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944100800 0x7f4944100c20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:28.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.454+0000 7f494a22c700 1 --2- 172.21.15.107:0/2517392911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4944101a00 0x7f4944101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:28.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.454+0000 7f494a22c700 1 -- 172.21.15.107:0/2517392911 >> 172.21.15.107:0/2517392911 conn(0x7f49440fbd60 msgr2=0x7f49440fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:28.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.454+0000 7f494a22c700 1 -- 172.21.15.107:0/2517392911 shutdown_connections 2023-08-10T10:46:28.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.454+0000 7f494a22c700 1 -- 172.21.15.107:0/2517392911 wait complete. 2023-08-10T10:46:28.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.455+0000 7f494a22c700 1 Processor -- start 2023-08-10T10:46:28.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.455+0000 7f494a22c700 1 -- start start 2023-08-10T10:46:28.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f494a22c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4944100800 0x7f4944196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:28.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f494a22c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944101a00 0x7f4944196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:28.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f494a22c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49441023a0 0x7f494419da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:28.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f494a22c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494419dfd0 con 0x7f4944101a00 2023-08-10T10:46:28.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f494a22c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494419e110 con 0x7f4944100800 2023-08-10T10:46:28.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f494a22c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494419e2a0 con 0x7f49441023a0 2023-08-10T10:46:28.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f4942ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944101a00 0x7f4944196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:28.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f4942ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944101a00 0x7f4944196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57364/0 (socket says 172.21.15.107:57364) 2023-08-10T10:46:28.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f4942ffd700 1 -- 172.21.15.107:0/2210132406 learned_addr learned my addr 172.21.15.107:0/2210132406 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:46:28.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f49437fe700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4944100800 0x7f4944196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:28.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.456+0000 7f4943fff700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49441023a0 0x7f494419da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:28.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f4942ffd700 1 -- 172.21.15.107:0/2210132406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49441023a0 msgr2=0x7f494419da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:28.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f4942ffd700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49441023a0 0x7f494419da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:28.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f4942ffd700 1 -- 172.21.15.107:0/2210132406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4944100800 msgr2=0x7f4944196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:28.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f4942ffd700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4944100800 0x7f4944196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:28.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f4942ffd700 1 -- 172.21.15.107:0/2210132406 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49340095f0 con 0x7f4944101a00 2023-08-10T10:46:28.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f4942ffd700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944101a00 0x7f4944196980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f493800d980 tx=0x7f493800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:28.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f4940ff9700 1 -- 172.21.15.107:0/2210132406 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380098d0 con 0x7f4944101a00 2023-08-10T10:46:28.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f4940ff9700 1 -- 172.21.15.107:0/2210132406 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4938010460 con 0x7f4944101a00 2023-08-10T10:46:28.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494419e580 con 0x7f4944101a00 2023-08-10T10:46:28.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f4940ff9700 1 -- 172.21.15.107:0/2210132406 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800f620 con 0x7f4944101a00 2023-08-10T10:46:28.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.457+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494419ea80 con 0x7f4944101a00 2023-08-10T10:46:28.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.458+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494410bf00 con 0x7f4944101a00 2023-08-10T10:46:28.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.461+0000 7f4940ff9700 1 -- 172.21.15.107:0/2210132406 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4938009a30 con 0x7f4944101a00 2023-08-10T10:46:28.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.463+0000 7f4940ff9700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f492c0a1150 0x7f492c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:28.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.463+0000 7f4940ff9700 1 -- 172.21.15.107:0/2210132406 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f49380cbdf0 con 0x7f4944101a00 2023-08-10T10:46:28.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.463+0000 7f49437fe700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f492c0a1150 0x7f492c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:28.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.464+0000 7f49437fe700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f492c0a1150 0x7f492c0a3610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4934000c00 tx=0x7f4934009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:28.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.467+0000 7f4940ff9700 1 -- 172.21.15.107:0/2210132406 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4938095e30 con 0x7f4944101a00 2023-08-10T10:46:28.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:28.674+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4944060bb0 con 0x7f492c0a1150 2023-08-10T10:46:28.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:28 smithi195 ceph-mon[129938]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:28 smithi195 ceph-mon[129938]: osdmap e61: 9 total, 9 up, 9 in 2023-08-10T10:46:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:28 smithi195 ceph-mon[129938]: osdmap e62: 9 total, 9 up, 9 in 2023-08-10T10:46:29.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:28 smithi157 ceph-mon[129604]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:29.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:28 smithi157 ceph-mon[129604]: osdmap e61: 9 total, 9 up, 9 in 2023-08-10T10:46:29.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:28 smithi157 ceph-mon[129604]: osdmap e62: 9 total, 9 up, 9 in 2023-08-10T10:46:29.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:28 smithi107 ceph-mon[127953]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:29.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:28 smithi107 ceph-mon[127953]: osdmap e61: 9 total, 9 up, 9 in 2023-08-10T10:46:29.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:28 smithi107 ceph-mon[127953]: osdmap e62: 9 total, 9 up, 9 in 2023-08-10T10:46:29.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:29 smithi107 ceph-mon[127953]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:46:29.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:46:29.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:46:29.890 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:29 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:29.890 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:29 smithi107 ceph-mon[127953]: osdmap e63: 9 total, 9 up, 9 in 2023-08-10T10:46:29.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:29 smithi195 ceph-mon[129938]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:46:29.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:46:29.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:46:29.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:29 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:29.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:29 smithi195 ceph-mon[129938]: osdmap e63: 9 total, 9 up, 9 in 2023-08-10T10:46:30.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:29 smithi157 ceph-mon[129604]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:46:30.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:46:30.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:46:30.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:29 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:30.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:29 smithi157 ceph-mon[129604]: osdmap e63: 9 total, 9 up, 9 in 2023-08-10T10:46:30.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:30 smithi195 ceph-mon[129938]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-10T10:46:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:30 smithi157 ceph-mon[129604]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-10T10:46:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:30 smithi107 ceph-mon[127953]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-08-10T10:46:32.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:32 smithi195 ceph-mon[129938]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-08-10T10:46:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:32 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3311836380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c771bbc-1eec-4fed-ac65-425b06e9ef59"}]: dispatch 2023-08-10T10:46:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:32 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3311836380' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c771bbc-1eec-4fed-ac65-425b06e9ef59"}]': finished 2023-08-10T10:46:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:32 smithi195 ceph-mon[129938]: osdmap e64: 10 total, 9 up, 10 in 2023-08-10T10:46:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:32 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3124018859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:46:33.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:32 smithi157 ceph-mon[129604]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-08-10T10:46:33.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:32 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3311836380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c771bbc-1eec-4fed-ac65-425b06e9ef59"}]: dispatch 2023-08-10T10:46:33.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:32 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3311836380' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c771bbc-1eec-4fed-ac65-425b06e9ef59"}]': finished 2023-08-10T10:46:33.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:32 smithi157 ceph-mon[129604]: osdmap e64: 10 total, 9 up, 10 in 2023-08-10T10:46:33.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:33.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:32 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3124018859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:46:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:32 smithi107 ceph-mon[127953]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-08-10T10:46:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:32 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3311836380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c771bbc-1eec-4fed-ac65-425b06e9ef59"}]: dispatch 2023-08-10T10:46:33.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:32 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3311836380' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c771bbc-1eec-4fed-ac65-425b06e9ef59"}]': finished 2023-08-10T10:46:33.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:32 smithi107 ceph-mon[127953]: osdmap e64: 10 total, 9 up, 10 in 2023-08-10T10:46:33.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:33.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:32 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3124018859' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:46:34.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:34 smithi195 ceph-mon[129938]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-08-10T10:46:35.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:34 smithi157 ceph-mon[129604]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-08-10T10:46:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:34 smithi107 ceph-mon[127953]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-08-10T10:46:36.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:36 smithi195 ceph-mon[129938]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-08-10T10:46:37.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:36 smithi157 ceph-mon[129604]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-08-10T10:46:37.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:36 smithi107 ceph-mon[127953]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-08-10T10:46:38.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:38 smithi195 ceph-mon[129938]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:39.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:38 smithi157 ceph-mon[129604]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:38 smithi107 ceph-mon[127953]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:39.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-08-10T10:46:39.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:39.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:39 smithi195 ceph-mon[129938]: Deploying daemon osd.9 on smithi107 2023-08-10T10:46:40.004 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-08-10T10:46:40.004 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:40.005 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:39 smithi107 ceph-mon[127953]: Deploying daemon osd.9 on smithi107 2023-08-10T10:46:40.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-08-10T10:46:40.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:40.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:39 smithi157 ceph-mon[129604]: Deploying daemon osd.9 on smithi107 2023-08-10T10:46:40.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:40 smithi195 ceph-mon[129938]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:40.998 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:40 smithi107 ceph-mon[127953]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:41.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:40 smithi157 ceph-mon[129604]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:42.741 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:42 smithi107 ceph-mon[127953]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:42.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:42 smithi195 ceph-mon[129938]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:42 smithi157 ceph-mon[129604]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:44.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:44 smithi195 ceph-mon[129938]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:44.981 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:44 smithi107 ceph-mon[127953]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:45.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:44 smithi157 ceph-mon[129604]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:46.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:46.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:46.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:46.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:46 smithi107 ceph-mon[127953]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:46.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:46.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:46.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:46.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:46 smithi195 ceph-mon[129938]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:46.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:46.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:46.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:46.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:46 smithi157 ceph-mon[129604]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:48.855 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:48 smithi107 ceph-mon[127953]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:48.855 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:48.855 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:48.855 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:48.855 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:48.856 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:48 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:48.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:48 smithi195 ceph-mon[129938]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:48 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:48 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:48 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:48 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:48 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:49.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:48 smithi157 ceph-mon[129604]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:49.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:48 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:49.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:48 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:49.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:48 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:49.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:48 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:49.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:48 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.197+0000 7f4940ff9700 1 -- 172.21.15.107:0/2210132406 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4944060bb0 con 0x7f492c0a1150 2023-08-10T10:46:49.198 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 9 on host 'smithi107' 2023-08-10T10:46:49.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f492c0a1150 msgr2=0x7f492c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:49.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f492c0a1150 0x7f492c0a3610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4934000c00 tx=0x7f4934009f10 comp rx=0 tx=0).stop 2023-08-10T10:46:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944101a00 msgr2=0x7f4944196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944101a00 0x7f4944196980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f493800d980 tx=0x7f493800dc90 comp rx=0 tx=0).stop 2023-08-10T10:46:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 shutdown_connections 2023-08-10T10:46:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f492c0a1150 0x7f492c0a3610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4944100800 0x7f4944196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49441023a0 0x7f494419da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 --2- 172.21.15.107:0/2210132406 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4944101a00 0x7f4944196980 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 >> 172.21.15.107:0/2210132406 conn(0x7f49440fbd60 msgr2=0x7f49440fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 shutdown_connections 2023-08-10T10:46:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:46:49.199+0000 7f494a22c700 1 -- 172.21.15.107:0/2210132406 wait complete. 2023-08-10T10:46:49.767 DEBUG:teuthology.orchestra.run.smithi107:osd.9> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.9.service 2023-08-10T10:46:49.772 INFO:tasks.cephadm:Deploying osd.10 on smithi157 with /dev/vg_nvme/lv_1... 2023-08-10T10:46:49.772 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-08-10T10:46:49.846 INFO:journalctl@ceph.osd.9.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:46:50.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:50.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:50.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:50.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:50 smithi107 ceph-mon[127953]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-08-10T10:46:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T10:46:50.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:50 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:50.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:50 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:50.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:50 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:50.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:50 smithi157 ceph-mon[129604]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-08-10T10:46:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:50 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:50 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:50 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:46:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:50 smithi195 ceph-mon[129938]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-08-10T10:46:51.324 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:51 smithi107 ceph-mon[127953]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:51.324 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:51 smithi107 ceph-mon[127953]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-08-10T10:46:51.324 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:51 smithi107 ceph-mon[127953]: osdmap e65: 10 total, 9 up, 10 in 2023-08-10T10:46:51.324 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:51 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:51.324 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:51 smithi107 ceph-mon[127953]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:46:51.325 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 10:46:51 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T10:46:51.191+0000 7f43222b6700 -1 osd.9 0 waiting for initial osdmap 2023-08-10T10:46:51.325 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 10:46:51 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T10:46:51.207+0000 7f431a0a3700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:46:51.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:51 smithi157 ceph-mon[129604]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:51.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:51 smithi157 ceph-mon[129604]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-08-10T10:46:51.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:51 smithi157 ceph-mon[129604]: osdmap e65: 10 total, 9 up, 10 in 2023-08-10T10:46:51.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:51 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:51.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:51 smithi157 ceph-mon[129604]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:46:51.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:51 smithi195 ceph-mon[129938]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:51 smithi195 ceph-mon[129938]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-08-10T10:46:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:51 smithi195 ceph-mon[129938]: osdmap e65: 10 total, 9 up, 10 in 2023-08-10T10:46:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:51 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:51 smithi195 ceph-mon[129938]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2023-08-10T10:46:52.447 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-08-10T10:46:52.447 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-08-10T10:46:52.447 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2023-08-10T10:46:52.448 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2023-08-10T10:46:52.448 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0299286 s, 350 MB/s 2023-08-10T10:46:52.448 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 2023-08-10T10:46:52.448 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2023-08-10T10:46:52.485 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:52 smithi157 ceph-mon[129604]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:46:52.485 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:52 smithi157 ceph-mon[129604]: osdmap e66: 10 total, 9 up, 10 in 2023-08-10T10:46:52.485 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:52 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:52.485 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:52 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:52.485 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:52 smithi157 ceph-mon[129604]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:52.565 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:52 smithi107 ceph-mon[127953]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:46:52.565 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:52 smithi107 ceph-mon[127953]: osdmap e66: 10 total, 9 up, 10 in 2023-08-10T10:46:52.565 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:52.565 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:52 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:52.565 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:52 smithi107 ceph-mon[127953]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:52.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:52 smithi195 ceph-mon[129938]: from='osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2023-08-10T10:46:52.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:52 smithi195 ceph-mon[129938]: osdmap e66: 10 total, 9 up, 10 in 2023-08-10T10:46:52.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:52 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:52.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:52 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:52.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:52 smithi195 ceph-mon[129938]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-08-10T10:46:52.883 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi157:vg_nvme/lv_1 2023-08-10T10:46:53.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:46:53.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:46:53.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:53.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] boot 2023-08-10T10:46:53.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: osdmap e67: 10 total, 10 up, 10 in 2023-08-10T10:46:53.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:53.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi107 2023-08-10T10:46:53.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi107 to 4316M 2023-08-10T10:46:53.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:53.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:53.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:53 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:46:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:46:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] boot 2023-08-10T10:46:53.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: osdmap e67: 10 total, 10 up, 10 in 2023-08-10T10:46:53.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:53.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi107 2023-08-10T10:46:53.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi107 to 4316M 2023-08-10T10:46:53.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:53.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:53.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:53 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.608 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T10:46:53.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:46:53.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:46:53.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:53.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: osd.9 [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] boot 2023-08-10T10:46:53.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: osdmap e67: 10 total, 10 up, 10 in 2023-08-10T10:46:53.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:46:53.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi107 2023-08-10T10:46:53.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:46:53.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi107 to 4316M 2023-08-10T10:46:53.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:53.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:53.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:46:53.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:53 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:46:54.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:54 smithi157 ceph-mon[129604]: osdmap e68: 10 total, 10 up, 10 in 2023-08-10T10:46:54.421 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:54 smithi157 ceph-mon[129604]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:46:54.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:54 smithi107 ceph-mon[127953]: osdmap e68: 10 total, 10 up, 10 in 2023-08-10T10:46:54.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:54 smithi107 ceph-mon[127953]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:46:54.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:54 smithi195 ceph-mon[129938]: osdmap e68: 10 total, 10 up, 10 in 2023-08-10T10:46:54.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:54 smithi195 ceph-mon[129938]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:46:55.011 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.010+0000 7ff622e84700 1 -- 172.21.15.157:0/897490871 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c100800 msgr2=0x7ff61c100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:55.012 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.010+0000 7ff622e84700 1 --2- 172.21.15.157:0/897490871 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c100800 0x7ff61c100c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff6100099c0 tx=0x7ff610009cd0 comp rx=0 tx=0).stop 2023-08-10T10:46:55.012 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.010+0000 7ff622e84700 1 -- 172.21.15.157:0/897490871 shutdown_connections 2023-08-10T10:46:55.013 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.010+0000 7ff622e84700 1 --2- 172.21.15.157:0/897490871 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c100800 0x7ff61c100c20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:55.013 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.010+0000 7ff622e84700 1 --2- 172.21.15.157:0/897490871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61c1023a0 0x7ff61c108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:55.013 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.010+0000 7ff622e84700 1 --2- 172.21.15.157:0/897490871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff61c101a00 0x7ff61c101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:55.013 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.010+0000 7ff622e84700 1 -- 172.21.15.157:0/897490871 >> 172.21.15.157:0/897490871 conn(0x7ff61c0fbd60 msgr2=0x7ff61c0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:46:55.014 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.010+0000 7ff622e84700 1 -- 172.21.15.157:0/897490871 shutdown_connections 2023-08-10T10:46:55.014 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.010+0000 7ff622e84700 1 -- 172.21.15.157:0/897490871 wait complete. 2023-08-10T10:46:55.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.011+0000 7ff622e84700 1 Processor -- start 2023-08-10T10:46:55.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff622e84700 1 -- start start 2023-08-10T10:46:55.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff622e84700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff61c100800 0x7ff61c196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:55.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff622e84700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61c101a00 0x7ff61c1968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:55.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff622e84700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c1023a0 0x7ff61c19d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:55.016 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff622e84700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c19df00 con 0x7ff61c100800 2023-08-10T10:46:55.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff622e84700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c19e040 con 0x7ff61c1023a0 2023-08-10T10:46:55.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff622e84700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c19e1d0 con 0x7ff61c101a00 2023-08-10T10:46:55.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff621421700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c1023a0 0x7ff61c19d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:55.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff621421700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c1023a0 0x7ff61c19d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:38792/0 (socket says 172.21.15.157:38792) 2023-08-10T10:46:55.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff61bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61c101a00 0x7ff61c1968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:55.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff621421700 1 -- 172.21.15.157:0/2610103316 learned_addr learned my addr 172.21.15.157:0/2610103316 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-08-10T10:46:55.017 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.012+0000 7ff620c20700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff61c100800 0x7ff61c196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:55.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff621421700 1 -- 172.21.15.157:0/2610103316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61c101a00 msgr2=0x7ff61c1968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:55.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff621421700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61c101a00 0x7ff61c1968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:55.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff621421700 1 -- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff61c100800 msgr2=0x7ff61c196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:46:55.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff621421700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff61c100800 0x7ff61c196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:46:55.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff621421700 1 -- 172.21.15.157:0/2610103316 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6100095f0 con 0x7ff61c1023a0 2023-08-10T10:46:55.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff621421700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c1023a0 0x7ff61c19d930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff614007ee0 tx=0x7ff61400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:55.018 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff619ffb700 1 -- 172.21.15.157:0/2610103316 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61400dd20 con 0x7ff61c1023a0 2023-08-10T10:46:55.019 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff619ffb700 1 -- 172.21.15.157:0/2610103316 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff61400f040 con 0x7ff61c1023a0 2023-08-10T10:46:55.019 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff619ffb700 1 -- 172.21.15.157:0/2610103316 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614004770 con 0x7ff61c1023a0 2023-08-10T10:46:55.019 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.013+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c072a00 con 0x7ff61c1023a0 2023-08-10T10:46:55.019 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.014+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c072eb0 con 0x7ff61c1023a0 2023-08-10T10:46:55.019 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.015+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c107df0 con 0x7ff61c1023a0 2023-08-10T10:46:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.016+0000 7ff619ffb700 1 -- 172.21.15.157:0/2610103316 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff614003a00 con 0x7ff61c1023a0 2023-08-10T10:46:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.018+0000 7ff619ffb700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff60c0a1150 0x7ff60c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:46:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.018+0000 7ff619ffb700 1 -- 172.21.15.157:0/2610103316 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7ff6140cb9b0 con 0x7ff61c1023a0 2023-08-10T10:46:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.018+0000 7ff620c20700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff60c0a1150 0x7ff60c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:46:55.020 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.019+0000 7ff620c20700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff60c0a1150 0x7ff60c0a3610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff610006010 tx=0x7ff610005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:46:55.022 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.022+0000 7ff619ffb700 1 -- 172.21.15.157:0/2610103316 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff61404e790 con 0x7ff61c1023a0 2023-08-10T10:46:55.224 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:46:55.223+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff61c0742f0 con 0x7ff60c0a1150 2023-08-10T10:46:55.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:55 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:46:55.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:55 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:46:55.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:55 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:55.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:55 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:46:55.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:55 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:46:55.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:55 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:55.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:55 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:46:55.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:55 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:46:55.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:55 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:46:56.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:56 smithi157 ceph-mon[129604]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:46:56.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:56 smithi157 ceph-mon[129604]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:46:56.576 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:56 smithi107 ceph-mon[127953]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:46:56.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:56 smithi107 ceph-mon[127953]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:46:56.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:56 smithi195 ceph-mon[129938]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:46:56.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:56 smithi195 ceph-mon[129938]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:46:58.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:58 smithi195 ceph-mon[129938]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:46:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:58 smithi195 ceph-mon[129938]: from='client.? 172.21.15.157:0/628959959' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d55b48-d75f-4a1b-a164-308dc2788c93"}]: dispatch 2023-08-10T10:46:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:58 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d55b48-d75f-4a1b-a164-308dc2788c93"}]: dispatch 2023-08-10T10:46:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:58 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56d55b48-d75f-4a1b-a164-308dc2788c93"}]': finished 2023-08-10T10:46:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:58 smithi195 ceph-mon[129938]: osdmap e69: 11 total, 10 up, 11 in 2023-08-10T10:46:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:58 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:46:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:58 smithi157 ceph-mon[129604]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:46:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:58 smithi157 ceph-mon[129604]: from='client.? 172.21.15.157:0/628959959' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d55b48-d75f-4a1b-a164-308dc2788c93"}]: dispatch 2023-08-10T10:46:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:58 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d55b48-d75f-4a1b-a164-308dc2788c93"}]: dispatch 2023-08-10T10:46:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:58 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56d55b48-d75f-4a1b-a164-308dc2788c93"}]': finished 2023-08-10T10:46:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:58 smithi157 ceph-mon[129604]: osdmap e69: 11 total, 10 up, 11 in 2023-08-10T10:46:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:58 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:46:59.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:58 smithi107 ceph-mon[127953]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:46:59.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:58 smithi107 ceph-mon[127953]: from='client.? 172.21.15.157:0/628959959' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d55b48-d75f-4a1b-a164-308dc2788c93"}]: dispatch 2023-08-10T10:46:59.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:58 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56d55b48-d75f-4a1b-a164-308dc2788c93"}]: dispatch 2023-08-10T10:46:59.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:58 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56d55b48-d75f-4a1b-a164-308dc2788c93"}]': finished 2023-08-10T10:46:59.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:58 smithi107 ceph-mon[127953]: osdmap e69: 11 total, 10 up, 11 in 2023-08-10T10:46:59.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:58 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:46:59.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:46:59 smithi195 ceph-mon[129938]: from='client.? 172.21.15.157:0/2069123591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:47:00.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:46:59 smithi157 ceph-mon[129604]: from='client.? 172.21.15.157:0/2069123591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:47:00.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:46:59 smithi107 ceph-mon[127953]: from='client.? 172.21.15.157:0/2069123591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:47:00.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:00 smithi195 ceph-mon[129938]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:01.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:00 smithi157 ceph-mon[129604]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:00 smithi107 ceph-mon[127953]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:02.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:02 smithi195 ceph-mon[129938]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:03.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:02 smithi157 ceph-mon[129604]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:03.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:02 smithi107 ceph-mon[127953]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:04.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:04 smithi195 ceph-mon[129938]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:05.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:04 smithi157 ceph-mon[129604]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:04 smithi107 ceph-mon[127953]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:06 smithi195 ceph-mon[129938]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:06 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-08-10T10:47:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:06 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:06 smithi195 ceph-mon[129938]: Deploying daemon osd.10 on smithi157 2023-08-10T10:47:07.011 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:06 smithi157 ceph-mon[129604]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:07.011 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-08-10T10:47:07.012 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:07.012 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:06 smithi157 ceph-mon[129604]: Deploying daemon osd.10 on smithi157 2023-08-10T10:47:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:06 smithi107 ceph-mon[127953]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:06 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-08-10T10:47:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:06 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:06 smithi107 ceph-mon[127953]: Deploying daemon osd.10 on smithi157 2023-08-10T10:47:08.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:08 smithi195 ceph-mon[129938]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:08 smithi157 ceph-mon[129604]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:09.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:08 smithi107 ceph-mon[127953]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:10.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:10 smithi195 ceph-mon[129938]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:10.944 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:10 smithi157 ceph-mon[129604]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:10 smithi107 ceph-mon[127953]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:13.382 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:13 smithi157 ceph-mon[129604]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:13.382 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:13.382 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:13.382 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:13.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:13 smithi195 ceph-mon[129938]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:13.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:13 smithi107 ceph-mon[127953]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:13.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:13.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:13.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:15.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:15 smithi195 ceph-mon[129938]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:15.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:15 smithi157 ceph-mon[129604]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:15.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:15 smithi107 ceph-mon[127953]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:15.699 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.697+0000 7ff619ffb700 1 -- 172.21.15.157:0/2610103316 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7ff61c0742f0 con 0x7ff60c0a1150 2023-08-10T10:47:15.700 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 10 on host 'smithi157' 2023-08-10T10:47:15.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff60c0a1150 msgr2=0x7ff60c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:15.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff60c0a1150 0x7ff60c0a3610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff610006010 tx=0x7ff610005e80 comp rx=0 tx=0).stop 2023-08-10T10:47:15.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c1023a0 msgr2=0x7ff61c19d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:15.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c1023a0 0x7ff61c19d930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff614007ee0 tx=0x7ff61400d3b0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.702 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 shutdown_connections 2023-08-10T10:47:15.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff60c0a1150 0x7ff60c0a3610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff61c1023a0 0x7ff61c19d930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff61c100800 0x7ff61c196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 --2- 172.21.15.157:0/2610103316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff61c101a00 0x7ff61c1968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:15.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 >> 172.21.15.157:0/2610103316 conn(0x7ff61c0fbd60 msgr2=0x7ff61c104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:15.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 shutdown_connections 2023-08-10T10:47:15.703 INFO:teuthology.orchestra.run.smithi157.stderr:2023-08-10T10:47:15.700+0000 7ff622e84700 1 -- 172.21.15.157:0/2610103316 wait complete. 2023-08-10T10:47:16.185 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.186 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.186 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:16.186 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:16.186 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.186 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.186 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.187 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:16.187 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='osd.10 [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T10:47:16.187 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:16 smithi157 ceph-mon[129604]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T10:47:16.228 DEBUG:teuthology.orchestra.run.smithi157:osd.10> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.10.service 2023-08-10T10:47:16.233 INFO:tasks.cephadm:Deploying osd.11 on smithi195 with /dev/vg_nvme/lv_1... 2023-08-10T10:47:16.233 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-08-10T10:47:16.312 INFO:journalctl@ceph.osd.10.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:47:16.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:16.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='osd.10 [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T10:47:16.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:16 smithi195 ceph-mon[129938]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T10:47:16.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:16.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:16.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:16.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:16.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='osd.10 [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T10:47:16.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:16 smithi107 ceph-mon[127953]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-08-10T10:47:16.963 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:47:17.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:17 smithi157 ceph-mon[129604]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:17.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:17 smithi157 ceph-mon[129604]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-08-10T10:47:17.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:17 smithi157 ceph-mon[129604]: osdmap e70: 11 total, 10 up, 11 in 2023-08-10T10:47:17.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:17 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:17.403 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:17 smithi157 ceph-mon[129604]: from='osd.10 [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:47:17.404 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:17 smithi157 ceph-mon[129604]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:47:17.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:17 smithi195 ceph-mon[129938]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:17 smithi195 ceph-mon[129938]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-08-10T10:47:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:17 smithi195 ceph-mon[129938]: osdmap e70: 11 total, 10 up, 11 in 2023-08-10T10:47:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:17 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:17 smithi195 ceph-mon[129938]: from='osd.10 [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:47:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:17 smithi195 ceph-mon[129938]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:47:17.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:17 smithi107 ceph-mon[127953]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:17.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:17 smithi107 ceph-mon[127953]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-08-10T10:47:17.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:17 smithi107 ceph-mon[127953]: osdmap e70: 11 total, 10 up, 11 in 2023-08-10T10:47:17.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:17 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:17.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:17 smithi107 ceph-mon[127953]: from='osd.10 [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:47:17.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:17 smithi107 ceph-mon[127953]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-08-10T10:47:18.038 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 10:47:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T10:47:17.688+0000 7fc996326700 -1 osd.10 0 waiting for initial osdmap 2023-08-10T10:47:18.039 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 10:47:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T10:47:17.703+0000 7fc99191a700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:47:18.904 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-08-10T10:47:18.904 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-08-10T10:47:18.904 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-08-10T10:47:18.904 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-08-10T10:47:18.904 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0298572 s, 351 MB/s 2023-08-10T10:47:18.905 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-08-10T10:47:18.940 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:18 smithi195 ceph-mon[129938]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:18.941 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:18 smithi195 ceph-mon[129938]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:47:18.941 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:18 smithi195 ceph-mon[129938]: osdmap e71: 11 total, 10 up, 11 in 2023-08-10T10:47:18.941 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:18.941 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:18.941 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:18 smithi195 ceph-mon[129938]: osd.10 [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] boot 2023-08-10T10:47:18.941 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:18 smithi195 ceph-mon[129938]: osdmap e72: 11 total, 11 up, 11 in 2023-08-10T10:47:18.941 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:19.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:18 smithi157 ceph-mon[129604]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:18 smithi157 ceph-mon[129604]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:47:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:18 smithi157 ceph-mon[129604]: osdmap e71: 11 total, 10 up, 11 in 2023-08-10T10:47:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:18 smithi157 ceph-mon[129604]: osd.10 [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] boot 2023-08-10T10:47:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:18 smithi157 ceph-mon[129604]: osdmap e72: 11 total, 11 up, 11 in 2023-08-10T10:47:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:18 smithi107 ceph-mon[127953]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-08-10T10:47:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:18 smithi107 ceph-mon[127953]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-08-10T10:47:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:18 smithi107 ceph-mon[127953]: osdmap e71: 11 total, 10 up, 11 in 2023-08-10T10:47:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:18 smithi107 ceph-mon[127953]: osd.10 [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] boot 2023-08-10T10:47:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:18 smithi107 ceph-mon[127953]: osdmap e72: 11 total, 11 up, 11 in 2023-08-10T10:47:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:47:19.439 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_1 2023-08-10T10:47:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:47:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:47:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi157 2023-08-10T10:47:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:19 smithi157 ceph-mon[129604]: osdmap e73: 11 total, 11 up, 11 in 2023-08-10T10:47:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:47:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:47:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi157 2023-08-10T10:47:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:20.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:20.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:19 smithi107 ceph-mon[127953]: osdmap e73: 11 total, 11 up, 11 in 2023-08-10T10:47:20.161 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:47:20.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:47:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:47:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi157 2023-08-10T10:47:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:19 smithi195 ceph-mon[129938]: osdmap e73: 11 total, 11 up, 11 in 2023-08-10T10:47:20.738 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:20 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi157 to 4316M 2023-08-10T10:47:20.738 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:20 smithi195 ceph-mon[129938]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:20.738 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:20 smithi195 ceph-mon[129938]: osdmap e74: 11 total, 11 up, 11 in 2023-08-10T10:47:21.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:20 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi157 to 4316M 2023-08-10T10:47:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:20 smithi157 ceph-mon[129604]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:20 smithi157 ceph-mon[129604]: osdmap e74: 11 total, 11 up, 11 in 2023-08-10T10:47:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:20 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi157 to 4316M 2023-08-10T10:47:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:20 smithi107 ceph-mon[127953]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:20 smithi107 ceph-mon[127953]: osdmap e74: 11 total, 11 up, 11 in 2023-08-10T10:47:21.699 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.697+0000 7ff6feae8700 1 -- 172.21.15.195:0/1463735409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 msgr2=0x7ff6f8108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:21.700 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.697+0000 7ff6feae8700 1 --2- 172.21.15.195:0/1463735409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 0x7ff6f8108c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000b0a0 tx=0x7ff6f000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.700 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.697+0000 7ff6feae8700 1 -- 172.21.15.195:0/1463735409 shutdown_connections 2023-08-10T10:47:21.700 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.697+0000 7ff6feae8700 1 --2- 172.21.15.195:0/1463735409 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6f8100800 0x7ff6f8100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.700 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.697+0000 7ff6feae8700 1 --2- 172.21.15.195:0/1463735409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 0x7ff6f8108c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.701 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.697+0000 7ff6feae8700 1 --2- 172.21.15.195:0/1463735409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6f8101a00 0x7ff6f8101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.701 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.697+0000 7ff6feae8700 1 -- 172.21.15.195:0/1463735409 >> 172.21.15.195:0/1463735409 conn(0x7ff6f80fbd60 msgr2=0x7ff6f80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:21.701 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.698+0000 7ff6feae8700 1 -- 172.21.15.195:0/1463735409 shutdown_connections 2023-08-10T10:47:21.701 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.698+0000 7ff6feae8700 1 -- 172.21.15.195:0/1463735409 wait complete. 2023-08-10T10:47:21.704 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.698+0000 7ff6feae8700 1 Processor -- start 2023-08-10T10:47:21.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6feae8700 1 -- start start 2023-08-10T10:47:21.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6feae8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6f8100800 0x7ff6f8196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6feae8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6f8101a00 0x7ff6f81969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6feae8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 0x7ff6f819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6feae8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f819e020 con 0x7ff6f8101a00 2023-08-10T10:47:21.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6feae8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f819e160 con 0x7ff6f8100800 2023-08-10T10:47:21.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6feae8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f819e2f0 con 0x7ff6f81023a0 2023-08-10T10:47:21.707 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6fd085700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 0x7ff6f819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.707 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6fd085700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 0x7ff6f819da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:53172/0 (socket says 172.21.15.195:53172) 2023-08-10T10:47:21.707 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6fd085700 1 -- 172.21.15.195:0/4277022726 learned_addr learned my addr 172.21.15.195:0/4277022726 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:47:21.708 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.699+0000 7ff6f7fff700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6f8101a00 0x7ff6f81969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.708 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6fc884700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6f8100800 0x7ff6f8196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.708 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6fd085700 1 -- 172.21.15.195:0/4277022726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6f8100800 msgr2=0x7ff6f8196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:21.709 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6fd085700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6f8100800 0x7ff6f8196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.710 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6fd085700 1 -- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6f8101a00 msgr2=0x7ff6f81969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:21.710 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6fd085700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6f8101a00 0x7ff6f81969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:21.710 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6fd085700 1 -- 172.21.15.195:0/4277022726 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f0009d00 con 0x7ff6f81023a0 2023-08-10T10:47:21.710 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6fc884700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6f8100800 0x7ff6f8196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:21.711 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6fd085700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 0x7ff6f819da50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0006070 tx=0x7ff6f0004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:21.711 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6f5ffb700 1 -- 172.21.15.195:0/4277022726 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000e040 con 0x7ff6f81023a0 2023-08-10T10:47:21.711 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f819e570 con 0x7ff6f81023a0 2023-08-10T10:47:21.711 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6f5ffb700 1 -- 172.21.15.195:0/4277022726 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6f0003e90 con 0x7ff6f81023a0 2023-08-10T10:47:21.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6f5ffb700 1 -- 172.21.15.195:0/4277022726 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0004020 con 0x7ff6f81023a0 2023-08-10T10:47:21.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f819e9e0 con 0x7ff6f81023a0 2023-08-10T10:47:21.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.701+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f810bf10 con 0x7ff6f81023a0 2023-08-10T10:47:21.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.703+0000 7ff6f5ffb700 1 -- 172.21.15.195:0/4277022726 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff6f0003a00 con 0x7ff6f81023a0 2023-08-10T10:47:21.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.705+0000 7ff6f5ffb700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff6e80a11d0 0x7ff6e80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:21.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.705+0000 7ff6f5ffb700 1 -- 172.21.15.195:0/4277022726 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6694+0+0 (secure 0 0 0) 0x7ff6f00cdc30 con 0x7ff6f81023a0 2023-08-10T10:47:21.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.705+0000 7ff6fc884700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff6e80a11d0 0x7ff6e80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:21.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.706+0000 7ff6fc884700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff6e80a11d0 0x7ff6e80a3690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005fd0 tx=0x7ff6ec005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:21.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.710+0000 7ff6f5ffb700 1 -- 172.21.15.195:0/4277022726 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff6f00979c0 con 0x7ff6f81023a0 2023-08-10T10:47:21.912 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:21.912+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6f8060bb0 con 0x7ff6e80a11d0 2023-08-10T10:47:22.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:22 smithi195 ceph-mon[129938]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:22 smithi195 ceph-mon[129938]: osdmap e75: 11 total, 11 up, 11 in 2023-08-10T10:47:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:22 smithi195 ceph-mon[129938]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:47:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:22 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:47:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:22 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:47:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:22 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:23.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:22 smithi157 ceph-mon[129604]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:22 smithi157 ceph-mon[129604]: osdmap e75: 11 total, 11 up, 11 in 2023-08-10T10:47:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:22 smithi157 ceph-mon[129604]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:47:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:22 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:47:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:22 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:47:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:22 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:22 smithi107 ceph-mon[127953]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:22 smithi107 ceph-mon[127953]: osdmap e75: 11 total, 11 up, 11 in 2023-08-10T10:47:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:22 smithi107 ceph-mon[127953]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:47:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-08-10T10:47:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-08-10T10:47:23.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:22 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:23.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:23 smithi195 ceph-mon[129938]: osdmap e76: 11 total, 11 up, 11 in 2023-08-10T10:47:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:23 smithi157 ceph-mon[129604]: osdmap e76: 11 total, 11 up, 11 in 2023-08-10T10:47:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:23 smithi107 ceph-mon[127953]: osdmap e76: 11 total, 11 up, 11 in 2023-08-10T10:47:24.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:24 smithi195 ceph-mon[129938]: pgmap v252: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:25.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:24 smithi157 ceph-mon[129604]: pgmap v252: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:25.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:24 smithi107 ceph-mon[127953]: pgmap v252: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:25.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:25 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/1063898014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bf890d-e08d-447e-b2c4-7a7c3bd30d06"}]: dispatch 2023-08-10T10:47:25.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:25 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bf890d-e08d-447e-b2c4-7a7c3bd30d06"}]: dispatch 2023-08-10T10:47:25.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:25 smithi195 ceph-mon[129938]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36bf890d-e08d-447e-b2c4-7a7c3bd30d06"}]': finished 2023-08-10T10:47:25.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:25 smithi195 ceph-mon[129938]: osdmap e77: 12 total, 11 up, 12 in 2023-08-10T10:47:25.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:25 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/1063898014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bf890d-e08d-447e-b2c4-7a7c3bd30d06"}]: dispatch 2023-08-10T10:47:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:25 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bf890d-e08d-447e-b2c4-7a7c3bd30d06"}]: dispatch 2023-08-10T10:47:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:25 smithi157 ceph-mon[129604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36bf890d-e08d-447e-b2c4-7a7c3bd30d06"}]': finished 2023-08-10T10:47:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:25 smithi157 ceph-mon[129604]: osdmap e77: 12 total, 11 up, 12 in 2023-08-10T10:47:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:25 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/1063898014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bf890d-e08d-447e-b2c4-7a7c3bd30d06"}]: dispatch 2023-08-10T10:47:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:25 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36bf890d-e08d-447e-b2c4-7a7c3bd30d06"}]: dispatch 2023-08-10T10:47:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:25 smithi107 ceph-mon[127953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36bf890d-e08d-447e-b2c4-7a7c3bd30d06"}]': finished 2023-08-10T10:47:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:25 smithi107 ceph-mon[127953]: osdmap e77: 12 total, 11 up, 12 in 2023-08-10T10:47:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:26.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:26 smithi195 ceph-mon[129938]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-08-10T10:47:26.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:26 smithi195 ceph-mon[129938]: from='client.? 172.21.15.195:0/2847706018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:47:27.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:26 smithi157 ceph-mon[129604]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-08-10T10:47:27.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:26 smithi157 ceph-mon[129604]: from='client.? 172.21.15.195:0/2847706018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:47:27.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:26 smithi107 ceph-mon[127953]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-08-10T10:47:27.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:26 smithi107 ceph-mon[127953]: from='client.? 172.21.15.195:0/2847706018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-08-10T10:47:28.854 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:28 smithi195 ceph-mon[129938]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T10:47:29.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:28 smithi157 ceph-mon[129604]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T10:47:29.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:28 smithi107 ceph-mon[127953]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-08-10T10:47:30.760 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:30 smithi195 ceph-mon[129938]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T10:47:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:30 smithi157 ceph-mon[129604]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T10:47:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:30 smithi107 ceph-mon[127953]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-08-10T10:47:32.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:32 smithi195 ceph-mon[129938]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-08-10T10:47:32.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-08-10T10:47:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:32 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:33.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:32 smithi157 ceph-mon[129604]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-08-10T10:47:33.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-08-10T10:47:33.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:32 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:32 smithi107 ceph-mon[127953]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-08-10T10:47:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-08-10T10:47:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:32 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:33.874 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:33 smithi195 ceph-mon[129938]: Deploying daemon osd.11 on smithi195 2023-08-10T10:47:34.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:33 smithi157 ceph-mon[129604]: Deploying daemon osd.11 on smithi195 2023-08-10T10:47:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:33 smithi107 ceph-mon[127953]: Deploying daemon osd.11 on smithi195 2023-08-10T10:47:34.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:34 smithi195 ceph-mon[129938]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T10:47:35.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:34 smithi157 ceph-mon[129604]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T10:47:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:34 smithi107 ceph-mon[127953]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-08-10T10:47:36.873 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:36 smithi195 ceph-mon[129938]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:37.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:36 smithi157 ceph-mon[129604]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:37.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:36 smithi107 ceph-mon[127953]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:38.799 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:38 smithi195 ceph-mon[129938]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:39.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:38 smithi157 ceph-mon[129604]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:38 smithi107 ceph-mon[127953]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:39.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:39.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:39.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:39 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:40.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:40.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:40.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:39 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:39 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:41.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:40 smithi195 ceph-mon[129938]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:41.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:40 smithi157 ceph-mon[129604]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:40 smithi107 ceph-mon[127953]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:42.641 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.640+0000 7ff6f5ffb700 1 -- 172.21.15.195:0/4277022726 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7ff6f8060bb0 con 0x7ff6e80a11d0 2023-08-10T10:47:42.641 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 11 on host 'smithi195' 2023-08-10T10:47:42.643 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff6e80a11d0 msgr2=0x7ff6e80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:42.644 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff6e80a11d0 0x7ff6e80a3690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005fd0 tx=0x7ff6ec005e40 comp rx=0 tx=0).stop 2023-08-10T10:47:42.644 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 msgr2=0x7ff6f819da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:42.644 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 0x7ff6f819da50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0006070 tx=0x7ff6f0004c80 comp rx=0 tx=0).stop 2023-08-10T10:47:42.644 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 shutdown_connections 2023-08-10T10:47:42.644 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff6e80a11d0 0x7ff6e80a3690 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:42.644 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6f8100800 0x7ff6f8196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:42.645 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6f81023a0 0x7ff6f819da50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:42.645 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 --2- 172.21.15.195:0/4277022726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6f8101a00 0x7ff6f81969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:42.645 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 >> 172.21.15.195:0/4277022726 conn(0x7ff6f80fbd60 msgr2=0x7ff6f80fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:42.645 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 shutdown_connections 2023-08-10T10:47:42.645 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:42.643+0000 7ff6feae8700 1 -- 172.21.15.195:0/4277022726 wait complete. 2023-08-10T10:47:43.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:43.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:43.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:43.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:43.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='osd.11 [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T10:47:43.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:42 smithi195 ceph-mon[129938]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T10:47:43.183 DEBUG:teuthology.orchestra.run.smithi195:osd.11> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.11.service 2023-08-10T10:47:43.188 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-08-10T10:47:43.189 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd stat -f json 2023-08-10T10:47:43.254 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:43.255 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.255 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.255 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:43.255 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:43.255 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.255 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.255 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.256 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:43.256 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='osd.11 [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T10:47:43.256 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:42 smithi107 ceph-mon[127953]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T10:47:43.264 INFO:journalctl@ceph.osd.11.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:47:43.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:43.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:43.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:43.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:43.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:43.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='osd.11 [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T10:47:43.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:42 smithi157 ceph-mon[129604]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-08-10T10:47:43.914 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:47:44.819 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:44 smithi107 ceph-mon[127953]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:44.819 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:44 smithi107 ceph-mon[127953]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-08-10T10:47:44.820 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:44 smithi107 ceph-mon[127953]: osdmap e78: 12 total, 11 up, 12 in 2023-08-10T10:47:44.820 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:44 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:44.820 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:44 smithi107 ceph-mon[127953]: from='osd.11 [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:47:44.820 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:44 smithi107 ceph-mon[127953]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:47:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:44 smithi195 ceph-mon[129938]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:44 smithi195 ceph-mon[129938]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-08-10T10:47:44.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:44 smithi195 ceph-mon[129938]: osdmap e78: 12 total, 11 up, 12 in 2023-08-10T10:47:44.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:44 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:44.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:44 smithi195 ceph-mon[129938]: from='osd.11 [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:47:44.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:44 smithi195 ceph-mon[129938]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:47:44.915 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 10:47:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T10:47:44.641+0000 7f114625b700 -1 osd.11 0 waiting for initial osdmap 2023-08-10T10:47:44.915 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 10:47:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T10:47:44.658+0000 7f1142050700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:47:45.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:44 smithi157 ceph-mon[129604]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:44 smithi157 ceph-mon[129604]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-08-10T10:47:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:44 smithi157 ceph-mon[129604]: osdmap e78: 12 total, 11 up, 12 in 2023-08-10T10:47:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:44 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:44 smithi157 ceph-mon[129604]: from='osd.11 [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:47:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:44 smithi157 ceph-mon[129604]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-08-10T10:47:45.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.418+0000 7f29f3685700 1 -- 172.21.15.107:0/1025371976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec101a00 msgr2=0x7f29ec101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:45.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.418+0000 7f29f3685700 1 --2- 172.21.15.107:0/1025371976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec101a00 0x7f29ec101e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0099c0 tx=0x7f29dc009cd0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.418+0000 7f29f3685700 1 -- 172.21.15.107:0/1025371976 shutdown_connections 2023-08-10T10:47:45.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.418+0000 7f29f3685700 1 --2- 172.21.15.107:0/1025371976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec100800 0x7f29ec100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.418+0000 7f29f3685700 1 --2- 172.21.15.107:0/1025371976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29ec1023a0 0x7f29ec108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.418+0000 7f29f3685700 1 --2- 172.21.15.107:0/1025371976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec101a00 0x7f29ec101e60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.418+0000 7f29f3685700 1 -- 172.21.15.107:0/1025371976 >> 172.21.15.107:0/1025371976 conn(0x7f29ec0fbd60 msgr2=0x7f29ec0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:45.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.418+0000 7f29f3685700 1 -- 172.21.15.107:0/1025371976 shutdown_connections 2023-08-10T10:47:45.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.418+0000 7f29f3685700 1 -- 172.21.15.107:0/1025371976 wait complete. 2023-08-10T10:47:45.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.419+0000 7f29f3685700 1 Processor -- start 2023-08-10T10:47:45.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.419+0000 7f29f3685700 1 -- start start 2023-08-10T10:47:45.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.419+0000 7f29f3685700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec100800 0x7f29ec196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:45.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.419+0000 7f29f3685700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29ec101a00 0x7f29ec196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:45.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.419+0000 7f29f3685700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec1023a0 0x7f29ec19d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:45.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f3685700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec19dfc0 con 0x7f29ec100800 2023-08-10T10:47:45.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f3685700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec19e100 con 0x7f29ec1023a0 2023-08-10T10:47:45.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f3685700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec19e290 con 0x7f29ec101a00 2023-08-10T10:47:45.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1421700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec100800 0x7f29ec196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:45.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1421700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec100800 0x7f29ec196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60804/0 (socket says 172.21.15.107:60804) 2023-08-10T10:47:45.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1421700 1 -- 172.21.15.107:0/3258186392 learned_addr learned my addr 172.21.15.107:0/3258186392 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:47:45.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f0c20700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29ec101a00 0x7f29ec196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:45.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1c22700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec1023a0 0x7f29ec19d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:45.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1421700 1 -- 172.21.15.107:0/3258186392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29ec101a00 msgr2=0x7f29ec196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:45.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1421700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29ec101a00 0x7f29ec196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1421700 1 -- 172.21.15.107:0/3258186392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec1023a0 msgr2=0x7f29ec19d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:45.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1421700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec1023a0 0x7f29ec19d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1421700 1 -- 172.21.15.107:0/3258186392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc0095f0 con 0x7f29ec100800 2023-08-10T10:47:45.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.420+0000 7f29f1421700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec100800 0x7f29ec196430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f29e800d9b0 tx=0x7f29e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:45.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.421+0000 7f29e27fc700 1 -- 172.21.15.107:0/3258186392 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800b950 con 0x7f29ec100800 2023-08-10T10:47:45.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.421+0000 7f29e27fc700 1 -- 172.21.15.107:0/3258186392 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29e8007620 con 0x7f29ec100800 2023-08-10T10:47:45.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.421+0000 7f29e27fc700 1 -- 172.21.15.107:0/3258186392 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8010ea0 con 0x7f29ec100800 2023-08-10T10:47:45.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.421+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec19e570 con 0x7f29ec100800 2023-08-10T10:47:45.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.421+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec19ea20 con 0x7f29ec100800 2023-08-10T10:47:45.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.422+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec10bf00 con 0x7f29ec100800 2023-08-10T10:47:45.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.424+0000 7f29e27fc700 1 -- 172.21.15.107:0/3258186392 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f29e800bab0 con 0x7f29ec100800 2023-08-10T10:47:45.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.425+0000 7f29e27fc700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f29d80a1150 0x7f29d80a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:45.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.425+0000 7f29e27fc700 1 -- 172.21.15.107:0/3258186392 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f29e80cc520 con 0x7f29ec100800 2023-08-10T10:47:45.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.425+0000 7f29f0c20700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f29d80a1150 0x7f29d80a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:45.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.426+0000 7f29f0c20700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f29d80a1150 0x7f29d80a3610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f29dc000c00 tx=0x7f29dc005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:45.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.429+0000 7f29e27fc700 1 -- 172.21.15.107:0/3258186392 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f29e8096190 con 0x7f29ec100800 2023-08-10T10:47:45.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.622+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f29ec10c0f0 con 0x7f29ec100800 2023-08-10T10:47:45.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.623+0000 7f29e27fc700 1 -- 172.21.15.107:0/3258186392 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7f29e800bd60 con 0x7f29ec100800 2023-08-10T10:47:45.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:47:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f29d80a1150 msgr2=0x7f29d80a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f29d80a1150 0x7f29d80a3610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f29dc000c00 tx=0x7f29dc005a90 comp rx=0 tx=0).stop 2023-08-10T10:47:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec100800 msgr2=0x7f29ec196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec100800 0x7f29ec196430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f29e800d9b0 tx=0x7f29e800dcc0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 shutdown_connections 2023-08-10T10:47:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f29d80a1150 0x7f29d80a3610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f29ec1023a0 0x7f29ec19d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f29ec100800 0x7f29ec196430 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 --2- 172.21.15.107:0/3258186392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29ec101a00 0x7f29ec196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 >> 172.21.15.107:0/3258186392 conn(0x7f29ec0fbd60 msgr2=0x7f29ec0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 shutdown_connections 2023-08-10T10:47:45.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:45.625+0000 7f29f3685700 1 -- 172.21.15.107:0/3258186392 wait complete. 2023-08-10T10:47:45.708 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:45 smithi195 ceph-mon[129938]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:47:45.708 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:45 smithi195 ceph-mon[129938]: osdmap e79: 12 total, 11 up, 12 in 2023-08-10T10:47:45.708 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:45 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:45.708 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:45 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:45.708 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:45 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3258186392' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T10:47:46.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:45 smithi157 ceph-mon[129604]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:47:46.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:45 smithi157 ceph-mon[129604]: osdmap e79: 12 total, 11 up, 12 in 2023-08-10T10:47:46.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:45 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:46.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:45 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:46.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:45 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3258186392' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T10:47:46.045 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:45 smithi107 ceph-mon[127953]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-08-10T10:47:46.046 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:45 smithi107 ceph-mon[127953]: osdmap e79: 12 total, 11 up, 12 in 2023-08-10T10:47:46.046 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:45 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:46.046 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:45 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:46.046 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:45 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3258186392' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T10:47:46.095 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1691664438,"num_in_osds":12,"osd_in_since":1691664444,"num_remapped_pgs":0} 2023-08-10T10:47:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: purged_snaps scrub starts 2023-08-10T10:47:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: purged_snaps scrub ok 2023-08-10T10:47:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: osd.11 [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] boot 2023-08-10T10:47:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: osdmap e80: 12 total, 12 up, 12 in 2023-08-10T10:47:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: Detected new or changed devices on smithi195 2023-08-10T10:47:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:46.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi195 to 4316M 2023-08-10T10:47:46.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:46.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:46.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:46.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:47.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: purged_snaps scrub starts 2023-08-10T10:47:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: purged_snaps scrub ok 2023-08-10T10:47:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: osd.11 [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] boot 2023-08-10T10:47:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: osdmap e80: 12 total, 12 up, 12 in 2023-08-10T10:47:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:47.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: Detected new or changed devices on smithi195 2023-08-10T10:47:47.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:47.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:47.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:47.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:47.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:47.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:47.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi195 to 4316M 2023-08-10T10:47:47.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:47.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:47.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:47.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: purged_snaps scrub starts 2023-08-10T10:47:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: purged_snaps scrub ok 2023-08-10T10:47:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-08-10T10:47:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: osd.11 [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] boot 2023-08-10T10:47:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: osdmap e80: 12 total, 12 up, 12 in 2023-08-10T10:47:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:47:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: Detected new or changed devices on smithi195 2023-08-10T10:47:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:47:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi195 to 4316M 2023-08-10T10:47:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:47:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:47:47.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:47.096 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd stat -f json 2023-08-10T10:47:47.827 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:47:47.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:47 smithi195 ceph-mon[129938]: osdmap e81: 12 total, 12 up, 12 in 2023-08-10T10:47:48.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:47 smithi157 ceph-mon[129604]: osdmap e81: 12 total, 12 up, 12 in 2023-08-10T10:47:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:47 smithi107 ceph-mon[127953]: osdmap e81: 12 total, 12 up, 12 in 2023-08-10T10:47:48.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:48 smithi195 ceph-mon[129938]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:49.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:48 smithi157 ceph-mon[129604]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:49.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:48 smithi107 ceph-mon[127953]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:49.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.318+0000 7ff29794e700 1 -- 172.21.15.107:0/340801920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2901023a0 msgr2=0x7ff290108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:49.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.318+0000 7ff29794e700 1 --2- 172.21.15.107:0/340801920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2901023a0 0x7ff290108c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff28800b0d0 tx=0x7ff28800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.318+0000 7ff29794e700 1 -- 172.21.15.107:0/340801920 shutdown_connections 2023-08-10T10:47:49.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.318+0000 7ff29794e700 1 --2- 172.21.15.107:0/340801920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff290100800 0x7ff290100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.318+0000 7ff29794e700 1 --2- 172.21.15.107:0/340801920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2901023a0 0x7ff290108c50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.318+0000 7ff29794e700 1 --2- 172.21.15.107:0/340801920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290101a00 0x7ff290101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.318+0000 7ff29794e700 1 -- 172.21.15.107:0/340801920 >> 172.21.15.107:0/340801920 conn(0x7ff2900fbd60 msgr2=0x7ff2900fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:49.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.318+0000 7ff29794e700 1 -- 172.21.15.107:0/340801920 shutdown_connections 2023-08-10T10:47:49.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.318+0000 7ff29794e700 1 -- 172.21.15.107:0/340801920 wait complete. 2023-08-10T10:47:49.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.319+0000 7ff29794e700 1 Processor -- start 2023-08-10T10:47:49.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.319+0000 7ff29794e700 1 -- start start 2023-08-10T10:47:49.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.319+0000 7ff29794e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff290100800 0x7ff290074510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:49.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.319+0000 7ff29794e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290101a00 0x7ff290072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:49.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.319+0000 7ff29794e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2901023a0 0x7ff2900730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:49.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.319+0000 7ff29794e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff290073820 con 0x7ff2901023a0 2023-08-10T10:47:49.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.319+0000 7ff29794e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff290073990 con 0x7ff290100800 2023-08-10T10:47:49.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.319+0000 7ff29794e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2901a0510 con 0x7ff290101a00 2023-08-10T10:47:49.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff2956ea700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff290100800 0x7ff290074510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:49.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff295eeb700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2901023a0 0x7ff2900730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:49.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff2956ea700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff290100800 0x7ff290074510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:48370/0 (socket says 172.21.15.107:48370) 2023-08-10T10:47:49.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff2956ea700 1 -- 172.21.15.107:0/118273302 learned_addr learned my addr 172.21.15.107:0/118273302 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:47:49.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff294ee9700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290101a00 0x7ff290072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:49.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff295eeb700 1 -- 172.21.15.107:0/118273302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290101a00 msgr2=0x7ff290072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:49.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff295eeb700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290101a00 0x7ff290072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff295eeb700 1 -- 172.21.15.107:0/118273302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff290100800 msgr2=0x7ff290074510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:49.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff295eeb700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff290100800 0x7ff290074510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff295eeb700 1 -- 172.21.15.107:0/118273302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff288009d00 con 0x7ff2901023a0 2023-08-10T10:47:49.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.320+0000 7ff295eeb700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2901023a0 0x7ff2900730a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff28800b820 tx=0x7ff2880126a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:49.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.321+0000 7ff2867fc700 1 -- 172.21.15.107:0/118273302 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800e040 con 0x7ff2901023a0 2023-08-10T10:47:49.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.321+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2901a0790 con 0x7ff2901023a0 2023-08-10T10:47:49.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.321+0000 7ff2867fc700 1 -- 172.21.15.107:0/118273302 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff28800ceb0 con 0x7ff2901023a0 2023-08-10T10:47:49.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.321+0000 7ff2867fc700 1 -- 172.21.15.107:0/118273302 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880054f0 con 0x7ff2901023a0 2023-08-10T10:47:49.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.321+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2901a0c80 con 0x7ff2901023a0 2023-08-10T10:47:49.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.322+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29010bf30 con 0x7ff2901023a0 2023-08-10T10:47:49.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.324+0000 7ff2867fc700 1 -- 172.21.15.107:0/118273302 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff288004c60 con 0x7ff2901023a0 2023-08-10T10:47:49.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.325+0000 7ff2867fc700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff27c0a1150 0x7ff27c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:49.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.325+0000 7ff2867fc700 1 -- 172.21.15.107:0/118273302 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff2880cdef0 con 0x7ff2901023a0 2023-08-10T10:47:49.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.325+0000 7ff2956ea700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff27c0a1150 0x7ff27c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:49.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.326+0000 7ff2956ea700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff27c0a1150 0x7ff27c0a3610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00ace0 tx=0x7ff28c00a430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:49.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.329+0000 7ff2867fc700 1 -- 172.21.15.107:0/118273302 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff288097ad0 con 0x7ff2901023a0 2023-08-10T10:47:49.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.524+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff29010c0f0 con 0x7ff2901023a0 2023-08-10T10:47:49.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.525+0000 7ff2867fc700 1 -- 172.21.15.107:0/118273302 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7ff28809b0f0 con 0x7ff2901023a0 2023-08-10T10:47:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:47:49.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff27c0a1150 msgr2=0x7ff27c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:49.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff27c0a1150 0x7ff27c0a3610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00ace0 tx=0x7ff28c00a430 comp rx=0 tx=0).stop 2023-08-10T10:47:49.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2901023a0 msgr2=0x7ff2900730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2901023a0 0x7ff2900730a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff28800b820 tx=0x7ff2880126a0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 shutdown_connections 2023-08-10T10:47:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff27c0a1150 0x7ff27c0a3610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff290100800 0x7ff290074510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2901023a0 0x7ff2900730a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 --2- 172.21.15.107:0/118273302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff290101a00 0x7ff290072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.527+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 >> 172.21.15.107:0/118273302 conn(0x7ff2900fbd60 msgr2=0x7ff2900fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:49.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.528+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 shutdown_connections 2023-08-10T10:47:49.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:49.528+0000 7ff29794e700 1 -- 172.21.15.107:0/118273302 wait complete. 2023-08-10T10:47:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:49 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/118273302' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T10:47:50.000 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1691664465,"num_in_osds":12,"osd_in_since":1691664444,"num_remapped_pgs":0} 2023-08-10T10:47:50.000 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd dump --format=json 2023-08-10T10:47:50.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:49 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/118273302' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T10:47:50.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:49 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/118273302' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-08-10T10:47:50.725 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:47:50.986 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:50 smithi107 ceph-mon[127953]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:51.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:50 smithi157 ceph-mon[129604]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:51.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:50 smithi195 ceph-mon[129938]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:52.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.226+0000 7fedd3d5f700 1 -- 172.21.15.107:0/1114857976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc101150 msgr2=0x7fedcc10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:52.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.226+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/1114857976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc101150 0x7fedcc10d660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b0a0 tx=0x7fedc400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.226+0000 7fedd3d5f700 1 -- 172.21.15.107:0/1114857976 shutdown_connections 2023-08-10T10:47:52.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.226+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/1114857976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc101150 0x7fedcc10d660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.226+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/1114857976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedcc106790 0x7fedcc106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.226+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/1114857976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedcc100790 0x7fedcc100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.226+0000 7fedd3d5f700 1 -- 172.21.15.107:0/1114857976 >> 172.21.15.107:0/1114857976 conn(0x7fedcc0fc260 msgr2=0x7fedcc0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:52.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.226+0000 7fedd3d5f700 1 -- 172.21.15.107:0/1114857976 shutdown_connections 2023-08-10T10:47:52.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.226+0000 7fedd3d5f700 1 -- 172.21.15.107:0/1114857976 wait complete. 2023-08-10T10:47:52.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.227+0000 7fedd3d5f700 1 Processor -- start 2023-08-10T10:47:52.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd3d5f700 1 -- start start 2023-08-10T10:47:52.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd3d5f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc100790 0x7fedcc19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:52.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd3d5f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedcc101150 0x7fedcc19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:52.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd3d5f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedcc106790 0x7fedcc1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:52.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd3d5f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc199030 con 0x7fedcc100790 2023-08-10T10:47:52.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd3d5f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1991a0 con 0x7fedcc106790 2023-08-10T10:47:52.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd3d5f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc199360 con 0x7fedcc101150 2023-08-10T10:47:52.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd1afb700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc100790 0x7fedcc19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:52.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd1afb700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc100790 0x7fedcc19e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60840/0 (socket says 172.21.15.107:60840) 2023-08-10T10:47:52.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd1afb700 1 -- 172.21.15.107:0/3390249858 learned_addr learned my addr 172.21.15.107:0/3390249858 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:47:52.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.228+0000 7fedd22fc700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedcc106790 0x7fedcc1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:52.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedd12fa700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedcc101150 0x7fedcc19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:52.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedd1afb700 1 -- 172.21.15.107:0/3390249858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedcc101150 msgr2=0x7fedcc19ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:52.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedd1afb700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedcc101150 0x7fedcc19ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedd1afb700 1 -- 172.21.15.107:0/3390249858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedcc106790 msgr2=0x7fedcc1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:52.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedd1afb700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedcc106790 0x7fedcc1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedd1afb700 1 -- 172.21.15.107:0/3390249858 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4009d00 con 0x7fedcc100790 2023-08-10T10:47:52.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedd1afb700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc100790 0x7fedcc19e940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fedc800d980 tx=0x7fedc800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:52.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedc2ffd700 1 -- 172.21.15.107:0/3390249858 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8004220 con 0x7fedcc100790 2023-08-10T10:47:52.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedc2ffd700 1 -- 172.21.15.107:0/3390249858 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedc8007640 con 0x7fedcc100790 2023-08-10T10:47:52.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc199640 con 0x7fedcc100790 2023-08-10T10:47:52.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedc2ffd700 1 -- 172.21.15.107:0/3390249858 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc80055e0 con 0x7fedcc100790 2023-08-10T10:47:52.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.229+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc1a5930 con 0x7fedcc100790 2023-08-10T10:47:52.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.230+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc04e470 con 0x7fedcc100790 2023-08-10T10:47:52.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.232+0000 7fedc2ffd700 1 -- 172.21.15.107:0/3390249858 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fedc8004750 con 0x7fedcc100790 2023-08-10T10:47:52.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.234+0000 7fedc2ffd700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fedb80a1150 0x7fedb80a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:52.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.234+0000 7fedc2ffd700 1 -- 172.21.15.107:0/3390249858 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fedc80cc7b0 con 0x7fedcc100790 2023-08-10T10:47:52.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.234+0000 7fedd12fa700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fedb80a1150 0x7fedb80a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:52.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.234+0000 7fedd12fa700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fedb80a1150 0x7fedb80a3610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fedbc005ea0 tx=0x7fedbc005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:52.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.236+0000 7fedc2ffd700 1 -- 172.21.15.107:0/3390249858 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fedc8096300 con 0x7fedcc100790 2023-08-10T10:47:52.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.430+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedcc1a5b20 con 0x7fedcc100790 2023-08-10T10:47:52.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.431+0000 7fedc2ffd700 1 -- 172.21.15.107:0/3390249858 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18479 (secure 0 0 0) 0x7fedc8099920 con 0x7fedcc100790 2023-08-10T10:47:52.433 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:47:52.433 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":81,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:47:46.643997+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:52.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fedb80a1150 msgr2=0x7fedb80a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:52.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fedb80a1150 0x7fedb80a3610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fedbc005ea0 tx=0x7fedbc005e30 comp rx=0 tx=0).stop 2023-08-10T10:47:52.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc100790 msgr2=0x7fedcc19e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:52.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc100790 0x7fedcc19e940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fedc800d980 tx=0x7fedc800dc90 comp rx=0 tx=0).stop 2023-08-10T10:47:52.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 shutdown_connections 2023-08-10T10:47:52.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fedb80a1150 0x7fedb80a3610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedcc106790 0x7fedcc1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fedcc100790 0x7fedcc19e940 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 --2- 172.21.15.107:0/3390249858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedcc101150 0x7fedcc19ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:52.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 >> 172.21.15.107:0/3390249858 conn(0x7fedcc0fc260 msgr2=0x7fedcc10bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:52.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 shutdown_connections 2023-08-10T10:47:52.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:52.434+0000 7fedd3d5f700 1 -- 172.21.15.107:0/3390249858 wait complete. 2023-08-10T10:47:52.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:52 smithi107 ceph-mon[127953]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:52.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:52 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3390249858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:47:52.903 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:47:52.904 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd pool get .mgr pg_num 2023-08-10T10:47:53.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:52 smithi157 ceph-mon[129604]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:53.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:52 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3390249858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:47:53.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:52 smithi195 ceph-mon[129938]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:53.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:52 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3390249858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:47:53.624 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:47:54.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:54 smithi107 ceph-mon[127953]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:55.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:54 smithi157 ceph-mon[129604]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:55.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:54 smithi195 ceph-mon[129938]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:55.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.209+0000 7f539e701700 1 -- 172.21.15.107:0/1355915680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398101150 msgr2=0x7f539810d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:55.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.209+0000 7f539e701700 1 --2- 172.21.15.107:0/1355915680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398101150 0x7f539810d660 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f539000b0a0 tx=0x7f539000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.209+0000 7f539e701700 1 -- 172.21.15.107:0/1355915680 shutdown_connections 2023-08-10T10:47:55.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.209+0000 7f539e701700 1 --2- 172.21.15.107:0/1355915680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5398106790 0x7f5398106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.209+0000 7f539e701700 1 --2- 172.21.15.107:0/1355915680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398101150 0x7f539810d660 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.209+0000 7f539e701700 1 --2- 172.21.15.107:0/1355915680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5398100790 0x7f5398100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.209+0000 7f539e701700 1 -- 172.21.15.107:0/1355915680 >> 172.21.15.107:0/1355915680 conn(0x7f53980fc260 msgr2=0x7f53980fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:55.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.209+0000 7f539e701700 1 -- 172.21.15.107:0/1355915680 shutdown_connections 2023-08-10T10:47:55.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.210+0000 7f539e701700 1 -- 172.21.15.107:0/1355915680 wait complete. 2023-08-10T10:47:55.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.210+0000 7f539e701700 1 Processor -- start 2023-08-10T10:47:55.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f539e701700 1 -- start start 2023-08-10T10:47:55.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f539e701700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398100790 0x7f53981076e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:55.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f539e701700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5398101150 0x7f5398107c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:55.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f539e701700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5398106790 0x7f5398108160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:55.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f539e701700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53981a9180 con 0x7f5398100790 2023-08-10T10:47:55.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f539e701700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53981a92f0 con 0x7f5398101150 2023-08-10T10:47:55.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f539e701700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53981a94b0 con 0x7f5398106790 2023-08-10T10:47:55.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f5397fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398100790 0x7f53981076e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:55.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f5397fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398100790 0x7f53981076e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55716/0 (socket says 172.21.15.107:55716) 2023-08-10T10:47:55.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.211+0000 7f5397fff700 1 -- 172.21.15.107:0/3698107803 learned_addr learned my addr 172.21.15.107:0/3698107803 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:47:55.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f53977fe700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5398101150 0x7f5398107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:55.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f5397fff700 1 -- 172.21.15.107:0/3698107803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5398106790 msgr2=0x7f5398108160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:55.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f5397fff700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5398106790 0x7f5398108160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f5397fff700 1 -- 172.21.15.107:0/3698107803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5398101150 msgr2=0x7f5398107c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:55.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f5397fff700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5398101150 0x7f5398107c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f5397fff700 1 -- 172.21.15.107:0/3698107803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390009d00 con 0x7f5398100790 2023-08-10T10:47:55.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f5397fff700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398100790 0x7f53981076e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f538800d950 tx=0x7f538800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:55.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f53957fa700 1 -- 172.21.15.107:0/3698107803 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388009b40 con 0x7f5398100790 2023-08-10T10:47:55.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53981a9790 con 0x7f5398100790 2023-08-10T10:47:55.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f53957fa700 1 -- 172.21.15.107:0/3698107803 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5388009ca0 con 0x7f5398100790 2023-08-10T10:47:55.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f53957fa700 1 -- 172.21.15.107:0/3698107803 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800f620 con 0x7f5398100790 2023-08-10T10:47:55.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.212+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53981a9c90 con 0x7f5398100790 2023-08-10T10:47:55.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.213+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539804e470 con 0x7f5398100790 2023-08-10T10:47:55.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.215+0000 7f53957fa700 1 -- 172.21.15.107:0/3698107803 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5388010460 con 0x7f5398100790 2023-08-10T10:47:55.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.217+0000 7f53957fa700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f53800a1150 0x7f53800a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:55.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.217+0000 7f53957fa700 1 -- 172.21.15.107:0/3698107803 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f53880cc810 con 0x7f5398100790 2023-08-10T10:47:55.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.217+0000 7f53977fe700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f53800a1150 0x7f53800a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:55.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.217+0000 7f53977fe700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f53800a1150 0x7f53800a3610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f538c005950 tx=0x7f538c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:55.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.221+0000 7f53957fa700 1 -- 172.21.15.107:0/3698107803 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5388096360 con 0x7f5398100790 2023-08-10T10:47:55.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.412+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53981aa040 con 0x7f5398100790 2023-08-10T10:47:55.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.413+0000 7f53957fa700 1 -- 172.21.15.107:0/3698107803 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5388099980 con 0x7f5398100790 2023-08-10T10:47:55.414 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:47:55.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f53800a1150 msgr2=0x7f53800a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:55.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f53800a1150 0x7f53800a3610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f538c005950 tx=0x7f538c0058e0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398100790 msgr2=0x7f53981076e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:55.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398100790 0x7f53981076e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f538800d950 tx=0x7f538800dd10 comp rx=0 tx=0).stop 2023-08-10T10:47:55.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 shutdown_connections 2023-08-10T10:47:55.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f53800a1150 0x7f53800a3610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5398106790 0x7f5398108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5398100790 0x7f53981076e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 --2- 172.21.15.107:0/3698107803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5398101150 0x7f5398107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:55.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 >> 172.21.15.107:0/3698107803 conn(0x7f53980fc260 msgr2=0x7f539810bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:55.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.415+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 shutdown_connections 2023-08-10T10:47:55.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:55.416+0000 7f539e701700 1 -- 172.21.15.107:0/3698107803 wait complete. 2023-08-10T10:47:55.826 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:55 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3698107803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:47:55.897 INFO:tasks.cephadm:Adding mds.a on smithi107 2023-08-10T10:47:55.898 INFO:tasks.cephadm:Adding mds.d on smithi107 2023-08-10T10:47:55.898 INFO:tasks.cephadm:Adding mds.g on smithi107 2023-08-10T10:47:55.898 INFO:tasks.cephadm:Adding mds.j on smithi107 2023-08-10T10:47:55.899 INFO:tasks.cephadm:Adding mds.b on smithi157 2023-08-10T10:47:55.899 INFO:tasks.cephadm:Adding mds.e on smithi157 2023-08-10T10:47:55.899 INFO:tasks.cephadm:Adding mds.h on smithi157 2023-08-10T10:47:55.899 INFO:tasks.cephadm:Adding mds.k on smithi157 2023-08-10T10:47:55.899 INFO:tasks.cephadm:Adding mds.c on smithi195 2023-08-10T10:47:55.900 INFO:tasks.cephadm:Adding mds.f on smithi195 2023-08-10T10:47:55.900 INFO:tasks.cephadm:Adding mds.i on smithi195 2023-08-10T10:47:55.900 INFO:tasks.cephadm:Adding mds.l on smithi195 2023-08-10T10:47:55.901 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph orch apply mds all '12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l' 2023-08-10T10:47:55.971 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:55 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3698107803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:47:56.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:55 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3698107803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:47:56.635 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T10:47:56.941 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:56 smithi195 ceph-mon[129938]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:57.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:56 smithi157 ceph-mon[129604]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:57.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:56 smithi107 ceph-mon[127953]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:58.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.126+0000 7f7a98c8b700 1 -- 172.21.15.195:0/3417146333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940747a0 msgr2=0x7f7a94072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:58.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.126+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/3417146333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940747a0 0x7f7a94072c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009990 tx=0x7f7a84009ca0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.126+0000 7f7a98c8b700 1 -- 172.21.15.195:0/3417146333 shutdown_connections 2023-08-10T10:47:58.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.126+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/3417146333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a941086d0 0x7f7a9410ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.126+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/3417146333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940747a0 0x7f7a94072c00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.128 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.126+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/3417146333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a940731d0 0x7f7a94073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.128 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.126+0000 7f7a98c8b700 1 -- 172.21.15.195:0/3417146333 >> 172.21.15.195:0/3417146333 conn(0x7f7a940fbd60 msgr2=0x7f7a940fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:58.128 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.126+0000 7f7a98c8b700 1 -- 172.21.15.195:0/3417146333 shutdown_connections 2023-08-10T10:47:58.128 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.126+0000 7f7a98c8b700 1 -- 172.21.15.195:0/3417146333 wait complete. 2023-08-10T10:47:58.129 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.127+0000 7f7a98c8b700 1 Processor -- start 2023-08-10T10:47:58.129 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.127+0000 7f7a98c8b700 1 -- start start 2023-08-10T10:47:58.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.127+0000 7f7a98c8b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940731d0 0x7f7a941986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:58.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a98c8b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a940747a0 0x7f7a94198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:58.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a98c8b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a941086d0 0x7f7a9419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:58.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a98c8b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941a0260 con 0x7f7a941086d0 2023-08-10T10:47:58.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a98c8b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941a03a0 con 0x7f7a940747a0 2023-08-10T10:47:58.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a98c8b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941a0530 con 0x7f7a940731d0 2023-08-10T10:47:58.131 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a9259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940731d0 0x7f7a941986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:58.131 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a9259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940731d0 0x7f7a941986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:60876/0 (socket says 172.21.15.195:60876) 2023-08-10T10:47:58.131 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a9259c700 1 -- 172.21.15.195:0/1861390374 learned_addr learned my addr 172.21.15.195:0/1861390374 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-08-10T10:47:58.131 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a92d9d700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a941086d0 0x7f7a9419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:58.131 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a91d9b700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a940747a0 0x7f7a94198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:58.132 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a9259c700 1 -- 172.21.15.195:0/1861390374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a940747a0 msgr2=0x7f7a94198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:58.132 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a9259c700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a940747a0 0x7f7a94198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.132 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a9259c700 1 -- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a941086d0 msgr2=0x7f7a9419fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:58.132 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a9259c700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a941086d0 0x7f7a9419fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.132 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.128+0000 7f7a9259c700 1 -- 172.21.15.195:0/1861390374 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a840095f0 con 0x7f7a940731d0 2023-08-10T10:47:58.132 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.129+0000 7f7a9259c700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940731d0 0x7f7a941986d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a840098e0 tx=0x7f7a84005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:58.132 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.129+0000 7f7a837fe700 1 -- 172.21.15.195:0/1861390374 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8401d070 con 0x7f7a940731d0 2023-08-10T10:47:58.133 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.129+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a941a07b0 con 0x7f7a940731d0 2023-08-10T10:47:58.133 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.129+0000 7f7a837fe700 1 -- 172.21.15.195:0/1861390374 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a8400bdb0 con 0x7f7a940731d0 2023-08-10T10:47:58.133 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.129+0000 7f7a837fe700 1 -- 172.21.15.195:0/1861390374 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84022d90 con 0x7f7a940731d0 2023-08-10T10:47:58.134 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.129+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a941a0c20 con 0x7f7a940731d0 2023-08-10T10:47:58.134 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.130+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a94106d80 con 0x7f7a940731d0 2023-08-10T10:47:58.134 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.132+0000 7f7a837fe700 1 -- 172.21.15.195:0/1861390374 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7a8400b920 con 0x7f7a940731d0 2023-08-10T10:47:58.134 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.133+0000 7f7a837fe700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7a7c0a11d0 0x7f7a7c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:58.134 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.133+0000 7f7a837fe700 1 -- 172.21.15.195:0/1861390374 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7a840ce150 con 0x7f7a940731d0 2023-08-10T10:47:58.135 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.134+0000 7f7a91d9b700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7a7c0a11d0 0x7f7a7c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:58.135 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.134+0000 7f7a91d9b700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7a7c0a11d0 0x7f7a7c0a3690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7a940744d0 tx=0x7f7a88009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:58.136 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.136+0000 7f7a837fe700 1 -- 172.21.15.195:0/1861390374 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7a84097d30 con 0x7f7a940731d0 2023-08-10T10:47:58.341 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.340+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a94060e70 con 0x7f7a7c0a11d0 2023-08-10T10:47:58.350 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.349+0000 7f7a837fe700 1 -- 172.21.15.195:0/1861390374 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f7a8801d030 con 0x7f7a7c0a11d0 2023-08-10T10:47:58.350 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mds.all update... 2023-08-10T10:47:58.352 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7a7c0a11d0 msgr2=0x7f7a7c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:58.353 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7a7c0a11d0 0x7f7a7c0a3690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7a940744d0 tx=0x7f7a88009260 comp rx=0 tx=0).stop 2023-08-10T10:47:58.353 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940731d0 msgr2=0x7f7a941986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:58.353 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940731d0 0x7f7a941986d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a840098e0 tx=0x7f7a84005740 comp rx=0 tx=0).stop 2023-08-10T10:47:58.353 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 shutdown_connections 2023-08-10T10:47:58.353 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7a7c0a11d0 0x7f7a7c0a3690 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.353 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a941086d0 0x7f7a9419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.353 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a940731d0 0x7f7a941986d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.354 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 --2- 172.21.15.195:0/1861390374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a940747a0 0x7f7a94198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:58.354 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 >> 172.21.15.195:0/1861390374 conn(0x7f7a940fbd60 msgr2=0x7f7a940fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:58.354 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 shutdown_connections 2023-08-10T10:47:58.354 INFO:teuthology.orchestra.run.smithi195.stderr:2023-08-10T10:47:58.352+0000 7f7a98c8b700 1 -- 172.21.15.195:0/1861390374 wait complete. 2023-08-10T10:47:58.923 DEBUG:teuthology.orchestra.run.smithi107:mds.a> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.a.service 2023-08-10T10:47:58.929 DEBUG:teuthology.orchestra.run.smithi107:mds.d> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.d.service 2023-08-10T10:47:58.975 DEBUG:teuthology.orchestra.run.smithi107:mds.g> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.g.service 2023-08-10T10:47:58.995 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:58 smithi107 ceph-mon[127953]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:58.996 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:58 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:58.996 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:58 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:58.998 DEBUG:teuthology.orchestra.run.smithi107:mds.j> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.j.service 2023-08-10T10:47:59.009 INFO:journalctl@ceph.mds.a.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:47:59.013 DEBUG:teuthology.orchestra.run.smithi157:mds.b> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.b.service 2023-08-10T10:47:59.020 DEBUG:teuthology.orchestra.run.smithi157:mds.e> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.e.service 2023-08-10T10:47:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:58 smithi157 ceph-mon[129604]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:58 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:58 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:59.041 DEBUG:teuthology.orchestra.run.smithi157:mds.h> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.h.service 2023-08-10T10:47:59.049 INFO:journalctl@ceph.mds.d.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:47:59.071 INFO:journalctl@ceph.mds.g.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:47:59.083 INFO:journalctl@ceph.mds.j.smithi107.stdout:-- Logs begin at Thu 2023-08-10 10:06:03 UTC. -- 2023-08-10T10:47:59.090 DEBUG:teuthology.orchestra.run.smithi157:mds.k> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.k.service 2023-08-10T10:47:59.104 INFO:journalctl@ceph.mds.b.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:47:59.108 DEBUG:teuthology.orchestra.run.smithi195:mds.c> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.c.service 2023-08-10T10:47:59.113 DEBUG:teuthology.orchestra.run.smithi195:mds.f> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.f.service 2023-08-10T10:47:59.121 INFO:journalctl@ceph.mds.e.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:47:59.158 DEBUG:teuthology.orchestra.run.smithi195:mds.i> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.i.service 2023-08-10T10:47:59.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:58 smithi195 ceph-mon[129938]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:47:59.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:58 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:47:59.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:58 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:47:59.164 INFO:journalctl@ceph.mds.h.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:47:59.167 DEBUG:teuthology.orchestra.run.smithi195:mds.l> sudo journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.l.service 2023-08-10T10:47:59.181 INFO:journalctl@ceph.mds.k.smithi157.stdout:-- Logs begin at Thu 2023-08-10 10:05:56 UTC. -- 2023-08-10T10:47:59.185 INFO:journalctl@ceph.mds.c.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:47:59.188 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-08-10T10:47:59.189 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:47:59.232 INFO:journalctl@ceph.mds.f.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:47:59.241 INFO:journalctl@ceph.mds.i.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:47:59.262 INFO:journalctl@ceph.mds.l.smithi195.stdout:-- Logs begin at Thu 2023-08-10 10:07:33 UTC. -- 2023-08-10T10:47:59.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.407+0000 7fad9c5ff700 1 -- 172.21.15.107:0/667897860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94101960 msgr2=0x7fad94101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:59.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.407+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/667897860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94101960 0x7fad94101dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad840099c0 tx=0x7fad84009cd0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.407+0000 7fad9c5ff700 1 -- 172.21.15.107:0/667897860 shutdown_connections 2023-08-10T10:47:59.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.407+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/667897860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad94100770 0x7fad94100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.407+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/667897860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad94102300 0x7fad94108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.407+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/667897860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94101960 0x7fad94101dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.407+0000 7fad9c5ff700 1 -- 172.21.15.107:0/667897860 >> 172.21.15.107:0/667897860 conn(0x7fad940fbca0 msgr2=0x7fad940fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:59.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.407+0000 7fad9c5ff700 1 -- 172.21.15.107:0/667897860 shutdown_connections 2023-08-10T10:47:59.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.408+0000 7fad9c5ff700 1 -- 172.21.15.107:0/667897860 wait complete. 2023-08-10T10:47:59.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.409+0000 7fad9c5ff700 1 Processor -- start 2023-08-10T10:47:59.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.409+0000 7fad9c5ff700 1 -- start start 2023-08-10T10:47:59.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9c5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94100770 0x7fad94074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:59.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9c5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad94101960 0x7fad94072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:59.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9c5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad94102300 0x7fad940730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:59.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9c5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94073840 con 0x7fad94100770 2023-08-10T10:47:59.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9c5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940739b0 con 0x7fad94101960 2023-08-10T10:47:59.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9c5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad941a0380 con 0x7fad94102300 2023-08-10T10:47:59.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9a39b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94100770 0x7fad94074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:59.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9a39b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94100770 0x7fad94074520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55730/0 (socket says 172.21.15.107:55730) 2023-08-10T10:47:59.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9a39b700 1 -- 172.21.15.107:0/1928924134 learned_addr learned my addr 172.21.15.107:0/1928924134 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:47:59.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9ab9c700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad94102300 0x7fad940730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:59.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad99b9a700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad94101960 0x7fad94072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:59.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9a39b700 1 -- 172.21.15.107:0/1928924134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad94102300 msgr2=0x7fad940730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:59.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9a39b700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad94102300 0x7fad940730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9a39b700 1 -- 172.21.15.107:0/1928924134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad94101960 msgr2=0x7fad94072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:59.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9a39b700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad94101960 0x7fad94072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9a39b700 1 -- 172.21.15.107:0/1928924134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840095f0 con 0x7fad94100770 2023-08-10T10:47:59.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad99b9a700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad94101960 0x7fad94072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:47:59.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.410+0000 7fad9a39b700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94100770 0x7fad94074520 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e970 tx=0x7fad9000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:59.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.411+0000 7fad8b7fe700 1 -- 172.21.15.107:0/1928924134 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90009790 con 0x7fad94100770 2023-08-10T10:47:59.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.411+0000 7fad8b7fe700 1 -- 172.21.15.107:0/1928924134 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad9000eec0 con 0x7fad94100770 2023-08-10T10:47:59.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.411+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad941a0660 con 0x7fad94100770 2023-08-10T10:47:59.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.411+0000 7fad8b7fe700 1 -- 172.21.15.107:0/1928924134 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90003c10 con 0x7fad94100770 2023-08-10T10:47:59.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.411+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad941a0bc0 con 0x7fad94100770 2023-08-10T10:47:59.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.412+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad941076f0 con 0x7fad94100770 2023-08-10T10:47:59.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.414+0000 7fad8b7fe700 1 -- 172.21.15.107:0/1928924134 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fad90003db0 con 0x7fad94100770 2023-08-10T10:47:59.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.415+0000 7fad8b7fe700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fad800a1220 0x7fad800a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:59.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.415+0000 7fad8b7fe700 1 -- 172.21.15.107:0/1928924134 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fad90014070 con 0x7fad94100770 2023-08-10T10:47:59.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.415+0000 7fad99b9a700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fad800a1220 0x7fad800a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:59.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.416+0000 7fad99b9a700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fad800a1220 0x7fad800a36e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad84006010 tx=0x7fad8400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:59.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.419+0000 7fad8b7fe700 1 -- 172.21.15.107:0/1928924134 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fad90096260 con 0x7fad94100770 2023-08-10T10:47:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.617+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad9402c970 con 0x7fad94100770 2023-08-10T10:47:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.618+0000 7fad8b7fe700 1 -- 172.21.15.107:0/1928924134 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18479 (secure 0 0 0) 0x7fad90099880 con 0x7fad94100770 2023-08-10T10:47:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:47:59.620 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":81,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:47:46.643997+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:47:59.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.620+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fad800a1220 msgr2=0x7fad800a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:59.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.620+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fad800a1220 0x7fad800a36e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad84006010 tx=0x7fad8400b540 comp rx=0 tx=0).stop 2023-08-10T10:47:59.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.620+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94100770 msgr2=0x7fad94074520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:59.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.620+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94100770 0x7fad94074520 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e970 tx=0x7fad9000ec80 comp rx=0 tx=0).stop 2023-08-10T10:47:59.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.621+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 shutdown_connections 2023-08-10T10:47:59.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.621+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fad800a1220 0x7fad800a36e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.621+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad94102300 0x7fad940730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.621+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad94100770 0x7fad94074520 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.621+0000 7fad9c5ff700 1 --2- 172.21.15.107:0/1928924134 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad94101960 0x7fad94072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.621+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 >> 172.21.15.107:0/1928924134 conn(0x7fad940fbca0 msgr2=0x7fad940fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:59.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.621+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 shutdown_connections 2023-08-10T10:47:59.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.621+0000 7fad9c5ff700 1 -- 172.21.15.107:0/1928924134 wait complete. 2023-08-10T10:47:59.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:47:59.642 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:47:59.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.843+0000 7f5500fff700 1 -- 172.21.15.107:0/3346686468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54fc101950 msgr2=0x7f54fc101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:59.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.843+0000 7f5500fff700 1 --2- 172.21.15.107:0/3346686468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54fc101950 0x7f54fc101db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f54e40099c0 tx=0x7f54e4009cd0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.843+0000 7f5500fff700 1 -- 172.21.15.107:0/3346686468 shutdown_connections 2023-08-10T10:47:59.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.843+0000 7f5500fff700 1 --2- 172.21.15.107:0/3346686468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54fc1022f0 0x7f54fc108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.843+0000 7f5500fff700 1 --2- 172.21.15.107:0/3346686468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54fc100760 0x7f54fc100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.843+0000 7f5500fff700 1 --2- 172.21.15.107:0/3346686468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54fc101950 0x7f54fc101db0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.843+0000 7f5500fff700 1 -- 172.21.15.107:0/3346686468 >> 172.21.15.107:0/3346686468 conn(0x7f54fc0fbcb0 msgr2=0x7f54fc0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:47:59.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.843+0000 7f5500fff700 1 -- 172.21.15.107:0/3346686468 shutdown_connections 2023-08-10T10:47:59.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.843+0000 7f5500fff700 1 -- 172.21.15.107:0/3346686468 wait complete. 2023-08-10T10:47:59.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.844+0000 7f5500fff700 1 Processor -- start 2023-08-10T10:47:59.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.844+0000 7f5500fff700 1 -- start start 2023-08-10T10:47:59.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.844+0000 7f5500fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54fc100760 0x7f54fc1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:59.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.844+0000 7f5500fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54fc101950 0x7f54fc198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:59.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.844+0000 7f5500fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54fc1022f0 0x7f54fc19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:59.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.844+0000 7f5500fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1a0140 con 0x7f54fc1022f0 2023-08-10T10:47:59.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.844+0000 7f5500fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1a0280 con 0x7f54fc101950 2023-08-10T10:47:59.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.844+0000 7f5500fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1a0410 con 0x7f54fc100760 2023-08-10T10:47:59.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fa59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54fc100760 0x7f54fc1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:59.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fa59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54fc100760 0x7f54fc1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:44166/0 (socket says 172.21.15.107:44166) 2023-08-10T10:47:59.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fa59c700 1 -- 172.21.15.107:0/1298836609 learned_addr learned my addr 172.21.15.107:0/1298836609 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:47:59.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54fc1022f0 0x7f54fc19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:59.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54f3fff700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54fc101950 0x7f54fc198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:59.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fa59c700 1 -- 172.21.15.107:0/1298836609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54fc101950 msgr2=0x7f54fc198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:59.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fa59c700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54fc101950 0x7f54fc198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fa59c700 1 -- 172.21.15.107:0/1298836609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54fc1022f0 msgr2=0x7f54fc19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:47:59.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fa59c700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54fc1022f0 0x7f54fc19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:47:59.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fa59c700 1 -- 172.21.15.107:0/1298836609 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e40095f0 con 0x7f54fc100760 2023-08-10T10:47:59.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.845+0000 7f54fa59c700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54fc100760 0x7f54fc1985c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00e970 tx=0x7f54ec00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:59.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.846+0000 7f54f37fe700 1 -- 172.21.15.107:0/1298836609 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec009790 con 0x7f54fc100760 2023-08-10T10:47:59.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.846+0000 7f54f37fe700 1 -- 172.21.15.107:0/1298836609 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54ec00c7e0 con 0x7f54fc100760 2023-08-10T10:47:59.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.846+0000 7f54f37fe700 1 -- 172.21.15.107:0/1298836609 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec003bd0 con 0x7f54fc100760 2023-08-10T10:47:59.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.846+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc1a06f0 con 0x7f54fc100760 2023-08-10T10:47:59.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.846+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc1a0bb0 con 0x7f54fc100760 2023-08-10T10:47:59.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.847+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc10be80 con 0x7f54fc100760 2023-08-10T10:47:59.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.849+0000 7f54f37fe700 1 -- 172.21.15.107:0/1298836609 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f54ec00c950 con 0x7f54fc100760 2023-08-10T10:47:59.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.850+0000 7f54f37fe700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f54e80a11d0 0x7f54e80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:47:59.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.850+0000 7f54f37fe700 1 -- 172.21.15.107:0/1298836609 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f54ec014070 con 0x7f54fc100760 2023-08-10T10:47:59.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.850+0000 7f54f3fff700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f54e80a11d0 0x7f54e80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:47:59.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.851+0000 7f54f3fff700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f54e80a11d0 0x7f54e80a3690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f54e4000c00 tx=0x7f54e4005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:47:59.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:47:59.857+0000 7f54f37fe700 1 -- 172.21.15.107:0/1298836609 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f54ec096760 con 0x7f54fc100760 2023-08-10T10:48:00.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:59 smithi157 ceph-mon[129604]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:48:00.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:59 smithi157 ceph-mon[129604]: Saving service mds.all spec with placement smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-08-10T10:48:00.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:00.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:48:00.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:00.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:00.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:00.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:59 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:00.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:47:59 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1928924134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:00.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.053+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54fc1a1250 con 0x7f54fc100760 2023-08-10T10:48:00.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.053+0000 7f54f37fe700 1 -- 172.21.15.107:0/1298836609 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54ec099d80 con 0x7f54fc100760 2023-08-10T10:48:00.054 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:48:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f54e80a11d0 msgr2=0x7f54e80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f54e80a11d0 0x7f54e80a3690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f54e4000c00 tx=0x7f54e4005a90 comp rx=0 tx=0).stop 2023-08-10T10:48:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54fc100760 msgr2=0x7f54fc1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54fc100760 0x7f54fc1985c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00e970 tx=0x7f54ec00ec80 comp rx=0 tx=0).stop 2023-08-10T10:48:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 shutdown_connections 2023-08-10T10:48:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f54e80a11d0 0x7f54e80a3690 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54fc1022f0 0x7f54fc19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54fc100760 0x7f54fc1985c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 --2- 172.21.15.107:0/1298836609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54fc101950 0x7f54fc198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 >> 172.21.15.107:0/1298836609 conn(0x7f54fc0fbcb0 msgr2=0x7f54fc0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:00.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 shutdown_connections 2023-08-10T10:48:00.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.056+0000 7f5500fff700 1 -- 172.21.15.107:0/1298836609 wait complete. 2023-08-10T10:48:00.074 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:59 smithi107 ceph-mon[127953]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:48:00.074 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:59 smithi107 ceph-mon[127953]: Saving service mds.all spec with placement smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-08-10T10:48:00.074 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:00.074 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:48:00.075 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:00.075 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:00.075 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:00.075 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:59 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:00.075 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:47:59 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1928924134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:00.076 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:59 smithi195 ceph-mon[129938]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:48:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:59 smithi195 ceph-mon[129938]: Saving service mds.all spec with placement smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-08-10T10:48:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:48:00.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:00.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:00.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:00.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:59 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:00.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:47:59 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1928924134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:00.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.273+0000 7f6b9ffff700 1 -- 172.21.15.107:0/4228300242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98101960 msgr2=0x7f6b98101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:00.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.273+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/4228300242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98101960 0x7f6b98101dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b880099c0 tx=0x7f6b88009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.273+0000 7f6b9ffff700 1 -- 172.21.15.107:0/4228300242 shutdown_connections 2023-08-10T10:48:00.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.273+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/4228300242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b98100770 0x7f6b98100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.273+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/4228300242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b98102300 0x7f6b98108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.273+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/4228300242 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98101960 0x7f6b98101dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.273+0000 7f6b9ffff700 1 -- 172.21.15.107:0/4228300242 >> 172.21.15.107:0/4228300242 conn(0x7f6b980fbca0 msgr2=0x7f6b980fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:00.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.273+0000 7f6b9ffff700 1 -- 172.21.15.107:0/4228300242 shutdown_connections 2023-08-10T10:48:00.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.273+0000 7f6b9ffff700 1 -- 172.21.15.107:0/4228300242 wait complete. 2023-08-10T10:48:00.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.274+0000 7f6b9ffff700 1 Processor -- start 2023-08-10T10:48:00.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.274+0000 7f6b9ffff700 1 -- start start 2023-08-10T10:48:00.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b98100770 0x7f6b98198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:00.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b98101960 0x7f6b98198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98102300 0x7f6b9819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9ffff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b981a0110 con 0x7f6b98102300 2023-08-10T10:48:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9ffff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b981a0250 con 0x7f6b98101960 2023-08-10T10:48:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9ffff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b981a03e0 con 0x7f6b98100770 2023-08-10T10:48:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98102300 0x7f6b9819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98102300 0x7f6b9819fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55786/0 (socket says 172.21.15.107:55786) 2023-08-10T10:48:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9e59c700 1 -- 172.21.15.107:0/2919862941 learned_addr learned my addr 172.21.15.107:0/2919862941 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9dd9b700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b98100770 0x7f6b98198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9d59a700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b98101960 0x7f6b98198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9e59c700 1 -- 172.21.15.107:0/2919862941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b98100770 msgr2=0x7f6b98198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9e59c700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b98100770 0x7f6b98198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9e59c700 1 -- 172.21.15.107:0/2919862941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b98101960 msgr2=0x7f6b98198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9e59c700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b98101960 0x7f6b98198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9e59c700 1 -- 172.21.15.107:0/2919862941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880095f0 con 0x7f6b98102300 2023-08-10T10:48:00.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.275+0000 7f6b9d59a700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b98101960 0x7f6b98198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:48:00.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.276+0000 7f6b9e59c700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98102300 0x7f6b9819fb40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000ef30 tx=0x7f6b9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:00.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.276+0000 7f6b8effd700 1 -- 172.21.15.107:0/2919862941 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90018070 con 0x7f6b98102300 2023-08-10T10:48:00.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.276+0000 7f6b8effd700 1 -- 172.21.15.107:0/2919862941 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b9000f040 con 0x7f6b98102300 2023-08-10T10:48:00.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.276+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b981a0660 con 0x7f6b98102300 2023-08-10T10:48:00.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.276+0000 7f6b8effd700 1 -- 172.21.15.107:0/2919862941 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000cc70 con 0x7f6b98102300 2023-08-10T10:48:00.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.276+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b981a0b70 con 0x7f6b98102300 2023-08-10T10:48:00.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.277+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9810be90 con 0x7f6b98102300 2023-08-10T10:48:00.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.279+0000 7f6b8effd700 1 -- 172.21.15.107:0/2919862941 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6b90003a00 con 0x7f6b98102300 2023-08-10T10:48:00.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.280+0000 7f6b8effd700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6b840a1220 0x7f6b840a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:00.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.280+0000 7f6b8effd700 1 -- 172.21.15.107:0/2919862941 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6b900cc610 con 0x7f6b98102300 2023-08-10T10:48:00.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.281+0000 7f6b9dd9b700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6b840a1220 0x7f6b840a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:00.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.281+0000 7f6b9dd9b700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6b840a1220 0x7f6b840a36e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6b981017c0 tx=0x7f6b94009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:00.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.282+0000 7f6b8effd700 1 -- 172.21.15.107:0/2919862941 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6b900961f0 con 0x7f6b98102300 2023-08-10T10:48:00.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.525+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b9810c0b0 con 0x7f6b98102300 2023-08-10T10:48:00.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.526+0000 7f6b8effd700 1 -- 172.21.15.107:0/2919862941 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f6b90099810 con 0x7f6b98102300 2023-08-10T10:48:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:00.527 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-08-10T10:48:00.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6b840a1220 msgr2=0x7f6b840a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:00.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6b840a1220 0x7f6b840a36e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6b981017c0 tx=0x7f6b94009260 comp rx=0 tx=0).stop 2023-08-10T10:48:00.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98102300 msgr2=0x7f6b9819fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:00.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98102300 0x7f6b9819fb40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000ef30 tx=0x7f6b9000c3a0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 shutdown_connections 2023-08-10T10:48:00.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6b840a1220 0x7f6b840a36e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b98102300 0x7f6b9819fb40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b98100770 0x7f6b98198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 --2- 172.21.15.107:0/2919862941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b98101960 0x7f6b98198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:00.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 >> 172.21.15.107:0/2919862941 conn(0x7f6b980fbca0 msgr2=0x7f6b980fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:00.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 shutdown_connections 2023-08-10T10:48:00.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:00.528+0000 7f6b9ffff700 1 -- 172.21.15.107:0/2919862941 wait complete. 2023-08-10T10:48:00.534 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 1 2023-08-10T10:48:00.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:00 smithi107 ceph-mon[127953]: Deploying daemon mds.l on smithi195 2023-08-10T10:48:00.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:00 smithi107 ceph-mon[127953]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:00.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1298836609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:48:00.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2919862941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:00.829 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:00 smithi195 ceph-mon[129938]: Deploying daemon mds.l on smithi195 2023-08-10T10:48:00.829 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:00 smithi195 ceph-mon[129938]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:00.830 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:00 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1298836609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:48:00.830 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:00 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2919862941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:01.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:00 smithi157 ceph-mon[129604]: Deploying daemon mds.l on smithi195 2023-08-10T10:48:01.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:00 smithi157 ceph-mon[129604]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:00 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1298836609' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:48:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:00 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2919862941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:01.913 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 10:48:01 smithi195 systemd[1]: Starting Ceph mds.l for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:02.317 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 10:48:02 smithi195 podman[155087]: 2023-08-10T10:48:02.317 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 10:48:02 smithi195 bash[155087]: 3a0b439108afeabfdbd7467f07bf68f6135025b1583fefa0c49e3677dcd08ff5 2023-08-10T10:48:02.317 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mds[155127]: -- 172.21.15.195:0/2876682324 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556cc8b831e0 con 0x556cc8b58c00 2023-08-10T10:48:02.317 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-l[155103]: starting mds.l at 2023-08-10T10:48:02.548 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:02.662 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 10:48:02 smithi195 systemd[1]: Started Ceph mds.l for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:02.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.754+0000 7fe4a59ff700 1 -- 172.21.15.107:0/2321054064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0100770 msgr2=0x7fe4a0100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:02.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.754+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/2321054064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0100770 0x7fe4a0100b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe4900099c0 tx=0x7fe490009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:02.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.754+0000 7fe4a59ff700 1 -- 172.21.15.107:0/2321054064 shutdown_connections 2023-08-10T10:48:02.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.754+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/2321054064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a0102300 0x7fe4a0108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:02.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.754+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/2321054064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0100770 0x7fe4a0100b90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:02.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.754+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/2321054064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a0101960 0x7fe4a0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:02.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.754+0000 7fe4a59ff700 1 -- 172.21.15.107:0/2321054064 >> 172.21.15.107:0/2321054064 conn(0x7fe4a00fbca0 msgr2=0x7fe4a00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:02.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.754+0000 7fe4a59ff700 1 -- 172.21.15.107:0/2321054064 shutdown_connections 2023-08-10T10:48:02.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.754+0000 7fe4a59ff700 1 -- 172.21.15.107:0/2321054064 wait complete. 2023-08-10T10:48:02.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.755+0000 7fe4a59ff700 1 Processor -- start 2023-08-10T10:48:02.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.755+0000 7fe4a59ff700 1 -- start start 2023-08-10T10:48:02.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.755+0000 7fe4a59ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a0100770 0x7fe4a01963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:02.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.755+0000 7fe4a59ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0101960 0x7fe4a01968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:02.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe4a59ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a0102300 0x7fe4a019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:02.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe4a59ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a019df20 con 0x7fe4a0101960 2023-08-10T10:48:02.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe4a59ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a019e060 con 0x7fe4a0102300 2023-08-10T10:48:02.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe4a59ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a019e1f0 con 0x7fe4a0100770 2023-08-10T10:48:02.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49e7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0101960 0x7fe4a01968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:02.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49e7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0101960 0x7fe4a01968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55798/0 (socket says 172.21.15.107:55798) 2023-08-10T10:48:02.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49e7fc700 1 -- 172.21.15.107:0/3349782623 learned_addr learned my addr 172.21.15.107:0/3349782623 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:02.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49f7fe700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a0102300 0x7fe4a019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:02.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49effd700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a0100770 0x7fe4a01963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:02.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49e7fc700 1 -- 172.21.15.107:0/3349782623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a0100770 msgr2=0x7fe4a01963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:02.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49e7fc700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a0100770 0x7fe4a01963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:02.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49e7fc700 1 -- 172.21.15.107:0/3349782623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a0102300 msgr2=0x7fe4a019d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:02.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49e7fc700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a0102300 0x7fe4a019d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:02.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49e7fc700 1 -- 172.21.15.107:0/3349782623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900095f0 con 0x7fe4a0101960 2023-08-10T10:48:02.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.756+0000 7fe49e7fc700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0101960 0x7fe4a01968e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe49400e9a0 tx=0x7fe49400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:02.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.757+0000 7fe4a49fd700 1 -- 172.21.15.107:0/3349782623 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494009790 con 0x7fe4a0101960 2023-08-10T10:48:02.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.757+0000 7fe4a49fd700 1 -- 172.21.15.107:0/3349782623 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe494010430 con 0x7fe4a0101960 2023-08-10T10:48:02.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.757+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a019e4d0 con 0x7fe4a0101960 2023-08-10T10:48:02.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.757+0000 7fe4a49fd700 1 -- 172.21.15.107:0/3349782623 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400cea0 con 0x7fe4a0101960 2023-08-10T10:48:02.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.757+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a019ea30 con 0x7fe4a0101960 2023-08-10T10:48:02.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.758+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a01076f0 con 0x7fe4a0101960 2023-08-10T10:48:02.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.759+0000 7fe4a49fd700 1 -- 172.21.15.107:0/3349782623 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe4940105a0 con 0x7fe4a0101960 2023-08-10T10:48:02.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.761+0000 7fe4a49fd700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe4880a1220 0x7fe4880a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:02.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.761+0000 7fe4a49fd700 1 -- 172.21.15.107:0/3349782623 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe494014070 con 0x7fe4a0101960 2023-08-10T10:48:02.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.761+0000 7fe49effd700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe4880a1220 0x7fe4880a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:02.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.762+0000 7fe49effd700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe4880a1220 0x7fe4880a36e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe490000c00 tx=0x7fe4900058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:02.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:02.764+0000 7fe4a49fd700 1 -- 172.21.15.107:0/3349782623 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe494051790 con 0x7fe4a0101960 2023-08-10T10:48:03.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.009+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4a002c970 con 0x7fe4a0101960 2023-08-10T10:48:03.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.009+0000 7fe4a49fd700 1 -- 172.21.15.107:0/3349782623 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7fe4940961f0 con 0x7fe4a0101960 2023-08-10T10:48:03.010 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:03.010 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-08-10T10:48:03.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.011+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe4880a1220 msgr2=0x7fe4880a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:03.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.011+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe4880a1220 0x7fe4880a36e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe490000c00 tx=0x7fe4900058e0 comp rx=0 tx=0).stop 2023-08-10T10:48:03.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.011+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0101960 msgr2=0x7fe4a01968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:03.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.011+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0101960 0x7fe4a01968e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe49400e9a0 tx=0x7fe49400ecb0 comp rx=0 tx=0).stop 2023-08-10T10:48:03.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.011+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 shutdown_connections 2023-08-10T10:48:03.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.011+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe4880a1220 0x7fe4880a36e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:03.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.011+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a0102300 0x7fe4a019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:03.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.011+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a0100770 0x7fe4a01963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:03.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.011+0000 7fe4a59ff700 1 --2- 172.21.15.107:0/3349782623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe4a0101960 0x7fe4a01968e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:03.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.012+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 >> 172.21.15.107:0/3349782623 conn(0x7fe4a00fbca0 msgr2=0x7fe4a00fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:03.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.012+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 shutdown_connections 2023-08-10T10:48:03.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:03.012+0000 7fe4a59ff700 1 -- 172.21.15.107:0/3349782623 wait complete. 2023-08-10T10:48:03.014 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 2 2023-08-10T10:48:03.030 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:03.030 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] up:boot 2023-08-10T10:48:03.030 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: fsmap 1 up:standby 2023-08-10T10:48:03.030 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T10:48:03.030 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:03.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:03.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:03.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:03.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:03.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:03.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:03.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] up:boot 2023-08-10T10:48:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: fsmap 1 up:standby 2023-08-10T10:48:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T10:48:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:03.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:03.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] up:boot 2023-08-10T10:48:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: fsmap 1 up:standby 2023-08-10T10:48:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T10:48:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:03.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:03.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:03.966 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:03 smithi157 ceph-mon[129604]: Deploying daemon mds.k on smithi157 2023-08-10T10:48:03.966 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:03 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3349782623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:04.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:03 smithi107 ceph-mon[127953]: Deploying daemon mds.k on smithi157 2023-08-10T10:48:04.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:03 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3349782623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:03 smithi195 ceph-mon[129938]: Deploying daemon mds.k on smithi157 2023-08-10T10:48:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:03 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3349782623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:04.701 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 10:48:04 smithi157 systemd[1]: Starting Ceph mds.k for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:05.033 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:05.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:04 smithi157 ceph-mon[129604]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:04 smithi107 ceph-mon[127953]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:05.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:04 smithi195 ceph-mon[129938]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:05.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.239+0000 7f81747ff700 1 -- 172.21.15.107:0/2241878196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c100780 msgr2=0x7f816c100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:05.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.239+0000 7f81747ff700 1 --2- 172.21.15.107:0/2241878196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c100780 0x7f816c100ba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f81680099c0 tx=0x7f8168009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.239+0000 7f81747ff700 1 -- 172.21.15.107:0/2241878196 shutdown_connections 2023-08-10T10:48:05.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.239+0000 7f81747ff700 1 --2- 172.21.15.107:0/2241878196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f816c102310 0x7f816c108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.239+0000 7f81747ff700 1 --2- 172.21.15.107:0/2241878196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c100780 0x7f816c100ba0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.239+0000 7f81747ff700 1 --2- 172.21.15.107:0/2241878196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f816c101970 0x7f816c101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.239+0000 7f81747ff700 1 -- 172.21.15.107:0/2241878196 >> 172.21.15.107:0/2241878196 conn(0x7f816c0fbcb0 msgr2=0x7f816c0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:05.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.239+0000 7f81747ff700 1 -- 172.21.15.107:0/2241878196 shutdown_connections 2023-08-10T10:48:05.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.239+0000 7f81747ff700 1 -- 172.21.15.107:0/2241878196 wait complete. 2023-08-10T10:48:05.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.240+0000 7f81747ff700 1 Processor -- start 2023-08-10T10:48:05.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.240+0000 7f81747ff700 1 -- start start 2023-08-10T10:48:05.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f81747ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f816c100780 0x7f816c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:05.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f81747ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f816c101970 0x7f816c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:05.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f81747ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c102310 0x7f816c19fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:05.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f81747ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c1a00f0 con 0x7f816c102310 2023-08-10T10:48:05.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f81747ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c1a0230 con 0x7f816c101970 2023-08-10T10:48:05.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f81747ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c1a03c0 con 0x7f816c100780 2023-08-10T10:48:05.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f8172d9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c102310 0x7f816c19fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:05.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f8172d9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c102310 0x7f816c19fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53110/0 (socket says 172.21.15.107:53110) 2023-08-10T10:48:05.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f817259b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f816c100780 0x7f816c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:05.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f8172d9c700 1 -- 172.21.15.107:0/2264621644 learned_addr learned my addr 172.21.15.107:0/2264621644 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:05.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f8171d9a700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f816c101970 0x7f816c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:05.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f8172d9c700 1 -- 172.21.15.107:0/2264621644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f816c100780 msgr2=0x7f816c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:05.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f8172d9c700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f816c100780 0x7f816c198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f8172d9c700 1 -- 172.21.15.107:0/2264621644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f816c101970 msgr2=0x7f816c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:05.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f8172d9c700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f816c101970 0x7f816c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.241+0000 7f8172d9c700 1 -- 172.21.15.107:0/2264621644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680095f0 con 0x7f816c102310 2023-08-10T10:48:05.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.242+0000 7f8172d9c700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c102310 0x7f816c19fb20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f816400ef30 tx=0x7f816400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:05.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.242+0000 7f81637fe700 1 -- 172.21.15.107:0/2264621644 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164018070 con 0x7f816c102310 2023-08-10T10:48:05.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.242+0000 7f81637fe700 1 -- 172.21.15.107:0/2264621644 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f816400f040 con 0x7f816c102310 2023-08-10T10:48:05.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.242+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816c1a0640 con 0x7f816c102310 2023-08-10T10:48:05.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.242+0000 7f81637fe700 1 -- 172.21.15.107:0/2264621644 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816400cbc0 con 0x7f816c102310 2023-08-10T10:48:05.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.242+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c1a0b50 con 0x7f816c102310 2023-08-10T10:48:05.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.243+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816c192c90 con 0x7f816c102310 2023-08-10T10:48:05.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.245+0000 7f81637fe700 1 -- 172.21.15.107:0/2264621644 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8164007500 con 0x7f816c102310 2023-08-10T10:48:05.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.246+0000 7f81637fe700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f81580a1220 0x7f81580a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:05.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.246+0000 7f81637fe700 1 -- 172.21.15.107:0/2264621644 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f81640cbf70 con 0x7f816c102310 2023-08-10T10:48:05.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.246+0000 7f817259b700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f81580a1220 0x7f81580a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:05.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.247+0000 7f817259b700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f81580a1220 0x7f81580a36e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8168009990 tx=0x7f816800b9b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:05.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.250+0000 7f81637fe700 1 -- 172.21.15.107:0/2264621644 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8164095b50 con 0x7f816c102310 2023-08-10T10:48:05.349 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 10:48:05 smithi157 podman[154018]: 2023-08-10T10:48:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.493+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f816c02c970 con 0x7f816c102310 2023-08-10T10:48:05.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.493+0000 7f81637fe700 1 -- 172.21.15.107:0/2264621644 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f8164099170 con 0x7f816c102310 2023-08-10T10:48:05.494 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:05.495 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-08-10T10:48:05.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f81580a1220 msgr2=0x7f81580a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:05.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f81580a1220 0x7f81580a36e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8168009990 tx=0x7f816800b9b0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c102310 msgr2=0x7f816c19fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:05.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c102310 0x7f816c19fb20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f816400ef30 tx=0x7f816400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 shutdown_connections 2023-08-10T10:48:05.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f81580a1220 0x7f81580a36e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f816c102310 0x7f816c19fb20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f816c100780 0x7f816c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 --2- 172.21.15.107:0/2264621644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f816c101970 0x7f816c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:05.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 >> 172.21.15.107:0/2264621644 conn(0x7f816c0fbcb0 msgr2=0x7f816c1072f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:05.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 shutdown_connections 2023-08-10T10:48:05.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:05.496+0000 7f81747ff700 1 -- 172.21.15.107:0/2264621644 wait complete. 2023-08-10T10:48:05.499 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 2 2023-08-10T10:48:05.788 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 10:48:05 smithi157 bash[154018]: 4f4309c16dcb3538a36c4e09e83710b1f824e6379b78f67cffc9a6d6f9a85157 2023-08-10T10:48:05.788 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 10:48:05 smithi157 ceph-mds[154058]: -- 172.21.15.157:0/1366131437 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557c9f57d1e0 con 0x557c9f552800 2023-08-10T10:48:05.789 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 10:48:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-k[154034]: starting mds.k at 2023-08-10T10:48:05.789 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 10:48:05 smithi157 systemd[1]: Started Ceph mds.k for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:06.696 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:06.697 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:06.697 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:06.697 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:06.697 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:06.697 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:06.698 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: Deploying daemon mds.j on smithi107 2023-08-10T10:48:06.698 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2264621644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:06.698 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:06.698 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.157:6832/699889592,v1:172.21.15.157:6833/699889592] up:boot 2023-08-10T10:48:06.698 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: fsmap 2 up:standby 2023-08-10T10:48:06.698 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:06 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T10:48:06.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:06.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: Deploying daemon mds.j on smithi107 2023-08-10T10:48:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2264621644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:06.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.157:6832/699889592,v1:172.21.15.157:6833/699889592] up:boot 2023-08-10T10:48:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: fsmap 2 up:standby 2023-08-10T10:48:06.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:06 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T10:48:06.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: Deploying daemon mds.j on smithi107 2023-08-10T10:48:06.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2264621644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:06.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:06.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.157:6832/699889592,v1:172.21.15.157:6833/699889592] up:boot 2023-08-10T10:48:06.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: fsmap 2 up:standby 2023-08-10T10:48:06.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:06 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T10:48:07.517 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:07.585 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 10:48:07 smithi107 systemd[1]: Starting Ceph mds.j for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:07.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.760+0000 7f28b2bff700 1 -- 172.21.15.107:0/1659803487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 msgr2=0x7f28ac1035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:07.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.760+0000 7f28b2bff700 1 --2- 172.21.15.107:0/1659803487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 0x7f28ac1035d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009990 tx=0x7f28a0009ca0 comp rx=0 tx=0).stop 2023-08-10T10:48:07.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.760+0000 7f28b2bff700 1 -- 172.21.15.107:0/1659803487 shutdown_connections 2023-08-10T10:48:07.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.760+0000 7f28b2bff700 1 --2- 172.21.15.107:0/1659803487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac106440 0x7f28ac1088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:07.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.760+0000 7f28b2bff700 1 --2- 172.21.15.107:0/1659803487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 0x7f28ac1035d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:07.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.760+0000 7f28b2bff700 1 --2- 172.21.15.107:0/1659803487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28ac103b10 0x7f28ac105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:07.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.760+0000 7f28b2bff700 1 -- 172.21.15.107:0/1659803487 >> 172.21.15.107:0/1659803487 conn(0x7f28ac0fabd0 msgr2=0x7f28ac0fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:07.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.760+0000 7f28b2bff700 1 -- 172.21.15.107:0/1659803487 shutdown_connections 2023-08-10T10:48:07.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.760+0000 7f28b2bff700 1 -- 172.21.15.107:0/1659803487 wait complete. 2023-08-10T10:48:07.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.762+0000 7f28b2bff700 1 Processor -- start 2023-08-10T10:48:07.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.762+0000 7f28b2bff700 1 -- start start 2023-08-10T10:48:07.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.762+0000 7f28b2bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 0x7f28ac196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:07.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.762+0000 7f28b2bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28ac103b10 0x7f28ac196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:07.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.762+0000 7f28b2bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac106440 0x7f28ac19d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:07.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.762+0000 7f28b2bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac19deb0 con 0x7f28ac1011e0 2023-08-10T10:48:07.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.762+0000 7f28b2bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac19dff0 con 0x7f28ac106440 2023-08-10T10:48:07.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.762+0000 7f28b2bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac19e180 con 0x7f28ac103b10 2023-08-10T10:48:07.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b099b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 0x7f28ac196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:07.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b099b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 0x7f28ac196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53120/0 (socket says 172.21.15.107:53120) 2023-08-10T10:48:07.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b099b700 1 -- 172.21.15.107:0/137146905 learned_addr learned my addr 172.21.15.107:0/137146905 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:07.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b119c700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac106440 0x7f28ac19d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:07.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28abfff700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28ac103b10 0x7f28ac196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:07.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b099b700 1 -- 172.21.15.107:0/137146905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28ac103b10 msgr2=0x7f28ac196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:07.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b099b700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28ac103b10 0x7f28ac196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:07.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b099b700 1 -- 172.21.15.107:0/137146905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac106440 msgr2=0x7f28ac19d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:07.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b099b700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac106440 0x7f28ac19d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:07.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b099b700 1 -- 172.21.15.107:0/137146905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00095f0 con 0x7f28ac1011e0 2023-08-10T10:48:07.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.763+0000 7f28b099b700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 0x7f28ac196330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f28a0005910 tx=0x7f28a0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:07.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.764+0000 7f28a9ffb700 1 -- 172.21.15.107:0/137146905 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a001d070 con 0x7f28ac1011e0 2023-08-10T10:48:07.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.764+0000 7f28a9ffb700 1 -- 172.21.15.107:0/137146905 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28a000be70 con 0x7f28ac1011e0 2023-08-10T10:48:07.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.764+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac19e400 con 0x7f28ac1011e0 2023-08-10T10:48:07.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.764+0000 7f28a9ffb700 1 -- 172.21.15.107:0/137146905 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0022ea0 con 0x7f28ac1011e0 2023-08-10T10:48:07.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.764+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac19e880 con 0x7f28ac1011e0 2023-08-10T10:48:07.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.765+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac0fc750 con 0x7f28ac1011e0 2023-08-10T10:48:07.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.767+0000 7f28a9ffb700 1 -- 172.21.15.107:0/137146905 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f28a0022670 con 0x7f28ac1011e0 2023-08-10T10:48:07.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.768+0000 7f28a9ffb700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f289c0a1220 0x7f289c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:07.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.768+0000 7f28a9ffb700 1 -- 172.21.15.107:0/137146905 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f28a00cd820 con 0x7f28ac1011e0 2023-08-10T10:48:07.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.769+0000 7f28abfff700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f289c0a1220 0x7f289c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:07.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.769+0000 7f28abfff700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f289c0a1220 0x7f289c0a36e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2898009bf0 tx=0x7f2898009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:07.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:07.772+0000 7f28a9ffb700 1 -- 172.21.15.107:0/137146905 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f28a005c790 con 0x7f28ac1011e0 2023-08-10T10:48:08.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.046+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28ac02c970 con 0x7f28ac1011e0 2023-08-10T10:48:08.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.046+0000 7f28a9ffb700 1 -- 172.21.15.107:0/137146905 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2017 (secure 0 0 0) 0x7f28a0027800 con 0x7f28ac1011e0 2023-08-10T10:48:08.047 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:08.048 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-08-10T10:48:08.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.048+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f289c0a1220 msgr2=0x7f289c0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:08.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.048+0000 7f28b2bff700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f289c0a1220 0x7f289c0a36e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2898009bf0 tx=0x7f2898009260 comp rx=0 tx=0).stop 2023-08-10T10:48:08.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.048+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 msgr2=0x7f28ac196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:08.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.048+0000 7f28b2bff700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 0x7f28ac196330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f28a0005910 tx=0x7f28a0005740 comp rx=0 tx=0).stop 2023-08-10T10:48:08.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.049+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 shutdown_connections 2023-08-10T10:48:08.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.049+0000 7f28b2bff700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f289c0a1220 0x7f289c0a36e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:08.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.049+0000 7f28b2bff700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28ac106440 0x7f28ac19d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:08.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.049+0000 7f28b2bff700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28ac1011e0 0x7f28ac196330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:08.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.049+0000 7f28b2bff700 1 --2- 172.21.15.107:0/137146905 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28ac103b10 0x7f28ac196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:08.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.049+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 >> 172.21.15.107:0/137146905 conn(0x7f28ac0fabd0 msgr2=0x7f28ac101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:08.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.049+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 shutdown_connections 2023-08-10T10:48:08.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:08.049+0000 7f28b2bff700 1 -- 172.21.15.107:0/137146905 wait complete. 2023-08-10T10:48:08.052 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 3 2023-08-10T10:48:08.327 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 10:48:08 smithi107 podman[160772]: 2023-08-10T10:48:08.624 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 10:48:08 smithi107 bash[160772]: 61e43924c9771d2a3e95ff58cec9808f20e123b1efaa1136705f787021aa1290 2023-08-10T10:48:08.624 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-mds[160815]: -- 172.21.15.107:0/1335202725 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558c752951e0 con 0x558c7526a800 2023-08-10T10:48:08.624 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 10:48:08 smithi107 systemd[1]: Started Ceph mds.j for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:08.624 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-j[160790]: starting mds.j at 2023-08-10T10:48:08.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:08 smithi195 ceph-mon[129938]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:08.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:08 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/137146905' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:08.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:08.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:08.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:08.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:08.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:08.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:08 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:09.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:08 smithi157 ceph-mon[129604]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:08 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/137146905' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:08 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:09.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-mon[127953]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:09.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/137146905' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:09.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:09.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:09.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:09.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:09.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:09.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:08 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:09.687 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:09 smithi107 ceph-mon[127953]: Deploying daemon mds.d on smithi107 2023-08-10T10:48:09.688 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:09 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.107:6834/1837769086,v1:172.21.15.107:6835/1837769086] up:boot 2023-08-10T10:48:09.688 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:09 smithi107 ceph-mon[127953]: fsmap 3 up:standby 2023-08-10T10:48:09.689 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:09 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T10:48:09.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:09 smithi195 ceph-mon[129938]: Deploying daemon mds.d on smithi107 2023-08-10T10:48:09.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:09 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.107:6834/1837769086,v1:172.21.15.107:6835/1837769086] up:boot 2023-08-10T10:48:09.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:09 smithi195 ceph-mon[129938]: fsmap 3 up:standby 2023-08-10T10:48:09.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:09 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T10:48:10.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:09 smithi157 ceph-mon[129604]: Deploying daemon mds.d on smithi107 2023-08-10T10:48:10.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:09 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.107:6834/1837769086,v1:172.21.15.107:6835/1837769086] up:boot 2023-08-10T10:48:10.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:09 smithi157 ceph-mon[129604]: fsmap 3 up:standby 2023-08-10T10:48:10.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:09 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T10:48:10.069 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:10.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.395+0000 7fe943dff700 1 -- 172.21.15.107:0/3288458346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c100770 msgr2=0x7fe93c100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:10.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.395+0000 7fe943dff700 1 --2- 172.21.15.107:0/3288458346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c100770 0x7fe93c100b90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe9380099c0 tx=0x7fe938009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.395+0000 7fe943dff700 1 -- 172.21.15.107:0/3288458346 shutdown_connections 2023-08-10T10:48:10.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.395+0000 7fe943dff700 1 --2- 172.21.15.107:0/3288458346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c102300 0x7fe93c108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.395+0000 7fe943dff700 1 --2- 172.21.15.107:0/3288458346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c100770 0x7fe93c100b90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.395+0000 7fe943dff700 1 --2- 172.21.15.107:0/3288458346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe93c101960 0x7fe93c101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.395+0000 7fe943dff700 1 -- 172.21.15.107:0/3288458346 >> 172.21.15.107:0/3288458346 conn(0x7fe93c0fbca0 msgr2=0x7fe93c0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.395+0000 7fe943dff700 1 -- 172.21.15.107:0/3288458346 shutdown_connections 2023-08-10T10:48:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.395+0000 7fe943dff700 1 -- 172.21.15.107:0/3288458346 wait complete. 2023-08-10T10:48:10.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.396+0000 7fe943dff700 1 Processor -- start 2023-08-10T10:48:10.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.396+0000 7fe943dff700 1 -- start start 2023-08-10T10:48:10.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe943dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe93c100770 0x7fe93c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:10.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe943dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c101960 0x7fe93c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:10.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe943dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c102300 0x7fe93c19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:10.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe943dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c1a0130 con 0x7fe93c102300 2023-08-10T10:48:10.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe943dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c1a0270 con 0x7fe93c100770 2023-08-10T10:48:10.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe943dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c1a0400 con 0x7fe93c101960 2023-08-10T10:48:10.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94239c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c102300 0x7fe93c19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:10.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94239c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c102300 0x7fe93c19fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53166/0 (socket says 172.21.15.107:53166) 2023-08-10T10:48:10.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94239c700 1 -- 172.21.15.107:0/1037173850 learned_addr learned my addr 172.21.15.107:0/1037173850 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:10.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe941b9b700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe93c100770 0x7fe93c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:10.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94139a700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c101960 0x7fe93c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:10.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94239c700 1 -- 172.21.15.107:0/1037173850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c101960 msgr2=0x7fe93c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:10.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94239c700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c101960 0x7fe93c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94239c700 1 -- 172.21.15.107:0/1037173850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe93c100770 msgr2=0x7fe93c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:10.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94239c700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe93c100770 0x7fe93c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94239c700 1 -- 172.21.15.107:0/1037173850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9380095f0 con 0x7fe93c102300 2023-08-10T10:48:10.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.397+0000 7fe94139a700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c101960 0x7fe93c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:48:10.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.398+0000 7fe94239c700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c102300 0x7fe93c19fb60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe93400ef30 tx=0x7fe93400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:10.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.398+0000 7fe932ffd700 1 -- 172.21.15.107:0/1037173850 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934018070 con 0x7fe93c102300 2023-08-10T10:48:10.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.398+0000 7fe932ffd700 1 -- 172.21.15.107:0/1037173850 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe93400f040 con 0x7fe93c102300 2023-08-10T10:48:10.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.398+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c1a0680 con 0x7fe93c102300 2023-08-10T10:48:10.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.398+0000 7fe932ffd700 1 -- 172.21.15.107:0/1037173850 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93400cc70 con 0x7fe93c102300 2023-08-10T10:48:10.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.398+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c1a0b90 con 0x7fe93c102300 2023-08-10T10:48:10.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.399+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c10be90 con 0x7fe93c102300 2023-08-10T10:48:10.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.401+0000 7fe932ffd700 1 -- 172.21.15.107:0/1037173850 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe934007500 con 0x7fe93c102300 2023-08-10T10:48:10.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.403+0000 7fe932ffd700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe9280a1220 0x7fe9280a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:10.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.403+0000 7fe932ffd700 1 -- 172.21.15.107:0/1037173850 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe9340cbf90 con 0x7fe93c102300 2023-08-10T10:48:10.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.403+0000 7fe941b9b700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe9280a1220 0x7fe9280a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:10.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.404+0000 7fe941b9b700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe9280a1220 0x7fe9280a36e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe938009990 tx=0x7fe93800b9b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:10.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.407+0000 7fe932ffd700 1 -- 172.21.15.107:0/1037173850 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe934095b70 con 0x7fe93c102300 2023-08-10T10:48:10.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.660+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe93c10c050 con 0x7fe93c102300 2023-08-10T10:48:10.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.661+0000 7fe932ffd700 1 -- 172.21.15.107:0/1037173850 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7fe934099190 con 0x7fe93c102300 2023-08-10T10:48:10.662 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:10.663 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-08-10T10:48:10.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe9280a1220 msgr2=0x7fe9280a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:10.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe9280a1220 0x7fe9280a36e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe938009990 tx=0x7fe93800b9b0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c102300 msgr2=0x7fe93c19fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:10.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c102300 0x7fe93c19fb60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe93400ef30 tx=0x7fe93400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 shutdown_connections 2023-08-10T10:48:10.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe9280a1220 0x7fe9280a36e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe93c100770 0x7fe93c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe93c102300 0x7fe93c19fb60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 --2- 172.21.15.107:0/1037173850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe93c101960 0x7fe93c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:10.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 >> 172.21.15.107:0/1037173850 conn(0x7fe93c0fbca0 msgr2=0x7fe93c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:10.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.664+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 shutdown_connections 2023-08-10T10:48:10.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:10.665+0000 7fe943dff700 1 -- 172.21.15.107:0/1037173850 wait complete. 2023-08-10T10:48:10.667 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 4 2023-08-10T10:48:10.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:10 smithi195 ceph-mon[129938]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:11.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:10 smithi157 ceph-mon[129604]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:10 smithi107 ceph-mon[127953]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:11.077 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 10:48:10 smithi107 systemd[1]: Starting Ceph mds.d for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:11.359 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 10:48:11 smithi107 podman[161161]: 2023-08-10T10:48:11.360 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 10:48:11 smithi107 bash[161161]: f55095a96c3619b21b7804b399c71e3d180763069a6a25d03509ef3019eafe6b 2023-08-10T10:48:11.639 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 10:48:11 smithi107 systemd[1]: Started Ceph mds.d for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:11.639 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 10:48:11 smithi107 ceph-mds[161201]: -- 172.21.15.107:0/2678028121 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f0d39d11e0 con 0x55f0d39a6c00 2023-08-10T10:48:11.639 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 10:48:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-d[161177]: starting mds.d at 2023-08-10T10:48:11.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:11 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1037173850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:11.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:11 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1037173850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:11 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1037173850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:12.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:12.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:12 smithi157 ceph-mon[129604]: Deploying daemon mds.e on smithi157 2023-08-10T10:48:12.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:12 smithi157 ceph-mon[129604]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:12.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:12 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.107:6836/1989272471,v1:172.21.15.107:6837/1989272471] up:boot 2023-08-10T10:48:12.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:12 smithi157 ceph-mon[129604]: fsmap 4 up:standby 2023-08-10T10:48:12.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T10:48:12.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.898+0000 7f65e51ff700 1 -- 172.21.15.107:0/258204780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0102300 msgr2=0x7f65e0108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:12.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.898+0000 7f65e51ff700 1 --2- 172.21.15.107:0/258204780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0102300 0x7f65e0108bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f65d800b0d0 tx=0x7f65d800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:48:12.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.898+0000 7f65e51ff700 1 -- 172.21.15.107:0/258204780 shutdown_connections 2023-08-10T10:48:12.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.898+0000 7f65e51ff700 1 --2- 172.21.15.107:0/258204780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65e0100770 0x7f65e0100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:12.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.898+0000 7f65e51ff700 1 --2- 172.21.15.107:0/258204780 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0102300 0x7f65e0108bb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:12.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.898+0000 7f65e51ff700 1 --2- 172.21.15.107:0/258204780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65e0101960 0x7f65e0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:12.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.898+0000 7f65e51ff700 1 -- 172.21.15.107:0/258204780 >> 172.21.15.107:0/258204780 conn(0x7f65e00fbca0 msgr2=0x7f65e00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:12.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.898+0000 7f65e51ff700 1 -- 172.21.15.107:0/258204780 shutdown_connections 2023-08-10T10:48:12.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.898+0000 7f65e51ff700 1 -- 172.21.15.107:0/258204780 wait complete. 2023-08-10T10:48:12.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.899+0000 7f65e51ff700 1 Processor -- start 2023-08-10T10:48:12.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65e51ff700 1 -- start start 2023-08-10T10:48:12.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65e51ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65e0100770 0x7f65e0198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:12.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65e51ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0101960 0x7f65e0198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:12.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65e51ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65e0102300 0x7f65e019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:12.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65e51ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e01a01c0 con 0x7f65e0101960 2023-08-10T10:48:12.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65e51ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e01a0300 con 0x7f65e0102300 2023-08-10T10:48:12.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65e51ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e01a0490 con 0x7f65e0100770 2023-08-10T10:48:12.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65de59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0101960 0x7f65e0198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:12.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65de59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0101960 0x7f65e0198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53198/0 (socket says 172.21.15.107:53198) 2023-08-10T10:48:12.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65de59c700 1 -- 172.21.15.107:0/442748991 learned_addr learned my addr 172.21.15.107:0/442748991 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:12.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.900+0000 7f65ded9d700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65e0100770 0x7f65e0198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:12.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65de59c700 1 -- 172.21.15.107:0/442748991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65e0100770 msgr2=0x7f65e0198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:12.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65de59c700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65e0100770 0x7f65e0198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:12.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65de59c700 1 -- 172.21.15.107:0/442748991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65e0102300 msgr2=0x7f65e019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:12.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65df59e700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65e0102300 0x7f65e019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:12.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65de59c700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65e0102300 0x7f65e019fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:12.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65de59c700 1 -- 172.21.15.107:0/442748991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d8009d00 con 0x7f65e0101960 2023-08-10T10:48:12.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65de59c700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0101960 0x7f65e0198b80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f65d400d950 tx=0x7f65d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:12.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65c7fff700 1 -- 172.21.15.107:0/442748991 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4009940 con 0x7f65e0101960 2023-08-10T10:48:12.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e01a0770 con 0x7f65e0101960 2023-08-10T10:48:12.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65c7fff700 1 -- 172.21.15.107:0/442748991 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65d4010460 con 0x7f65e0101960 2023-08-10T10:48:12.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65c7fff700 1 -- 172.21.15.107:0/442748991 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d400f620 con 0x7f65e0101960 2023-08-10T10:48:12.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.901+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e01a0c80 con 0x7f65e0101960 2023-08-10T10:48:12.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.902+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e010be90 con 0x7f65e0101960 2023-08-10T10:48:12.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.904+0000 7f65c7fff700 1 -- 172.21.15.107:0/442748991 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f65d40105d0 con 0x7f65e0101960 2023-08-10T10:48:12.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.905+0000 7f65c7fff700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f65c80a11a0 0x7f65c80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:12.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.906+0000 7f65c7fff700 1 -- 172.21.15.107:0/442748991 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f65d40cc300 con 0x7f65e0101960 2023-08-10T10:48:12.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.906+0000 7f65ded9d700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f65c80a11a0 0x7f65c80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:12.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.906+0000 7f65ded9d700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f65c80a11a0 0x7f65c80a3660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f65e01017c0 tx=0x7f65d000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:12.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:12.908+0000 7f65c7fff700 1 -- 172.21.15.107:0/442748991 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f65d4095e50 con 0x7f65e0101960 2023-08-10T10:48:12.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:12 smithi195 ceph-mon[129938]: Deploying daemon mds.e on smithi157 2023-08-10T10:48:12.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:12 smithi195 ceph-mon[129938]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:12 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.107:6836/1989272471,v1:172.21.15.107:6837/1989272471] up:boot 2023-08-10T10:48:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:12 smithi195 ceph-mon[129938]: fsmap 4 up:standby 2023-08-10T10:48:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T10:48:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:12 smithi107 ceph-mon[127953]: Deploying daemon mds.e on smithi157 2023-08-10T10:48:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:12 smithi107 ceph-mon[127953]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:12 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.107:6836/1989272471,v1:172.21.15.107:6837/1989272471] up:boot 2023-08-10T10:48:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:12 smithi107 ceph-mon[127953]: fsmap 4 up:standby 2023-08-10T10:48:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T10:48:13.151 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.150+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65e010c080 con 0x7f65e0101960 2023-08-10T10:48:13.151 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.150+0000 7f65c7fff700 1 -- 172.21.15.107:0/442748991 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3537 (secure 0 0 0) 0x7f65d4016df0 con 0x7f65e0101960 2023-08-10T10:48:13.152 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:13.152 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-08-10T10:48:13.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.152+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f65c80a11a0 msgr2=0x7f65c80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:13.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.152+0000 7f65e51ff700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f65c80a11a0 0x7f65c80a3660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f65e01017c0 tx=0x7f65d000b410 comp rx=0 tx=0).stop 2023-08-10T10:48:13.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.152+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0101960 msgr2=0x7f65e0198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:13.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.152+0000 7f65e51ff700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0101960 0x7f65e0198b80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f65d400d950 tx=0x7f65d400dc60 comp rx=0 tx=0).stop 2023-08-10T10:48:13.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.153+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 shutdown_connections 2023-08-10T10:48:13.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.153+0000 7f65e51ff700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f65c80a11a0 0x7f65c80a3660 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:13.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.153+0000 7f65e51ff700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65e0102300 0x7f65e019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:13.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.153+0000 7f65e51ff700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65e0100770 0x7f65e0198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:13.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.153+0000 7f65e51ff700 1 --2- 172.21.15.107:0/442748991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65e0101960 0x7f65e0198b80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:13.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.153+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 >> 172.21.15.107:0/442748991 conn(0x7f65e00fbca0 msgr2=0x7f65e01071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:13.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.153+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 shutdown_connections 2023-08-10T10:48:13.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:13.153+0000 7f65e51ff700 1 -- 172.21.15.107:0/442748991 wait complete. 2023-08-10T10:48:13.157 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 5 2023-08-10T10:48:13.876 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:13 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/442748991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:13.876 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 10:48:13 smithi157 systemd[1]: Starting Ceph mds.e for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:13.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:13 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/442748991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:13 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/442748991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:14.616 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 10:48:14 smithi157 podman[154369]: 2023-08-10T10:48:14.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:14 smithi195 ceph-mon[129938]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:15.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:14 smithi157 ceph-mon[129604]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:15.039 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 10:48:14 smithi157 bash[154369]: f45f05f32182cd5f7f31479690dfc9487a6400dd1bdc479a3af5a184a7a3a3f1 2023-08-10T10:48:15.039 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 10:48:14 smithi157 ceph-mds[154409]: -- 172.21.15.157:0/2270793873 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c388e911e0 con 0x55c388e66c00 2023-08-10T10:48:15.039 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 10:48:14 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-e[154385]: starting mds.e at 2023-08-10T10:48:15.039 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 10:48:14 smithi157 systemd[1]: Started Ceph mds.e for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:14 smithi107 ceph-mon[127953]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:15.173 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:15.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.382+0000 7f8a399ff700 1 -- 172.21.15.107:0/3877940153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a34100770 msgr2=0x7f8a34100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:15.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.382+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3877940153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a34100770 0x7f8a34100b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8a240099c0 tx=0x7f8a24009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.382+0000 7f8a399ff700 1 -- 172.21.15.107:0/3877940153 shutdown_connections 2023-08-10T10:48:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.382+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3877940153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a34102300 0x7f8a34108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.382+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3877940153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a34100770 0x7f8a34100b90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.382+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3877940153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34101960 0x7f8a34101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.382+0000 7f8a399ff700 1 -- 172.21.15.107:0/3877940153 >> 172.21.15.107:0/3877940153 conn(0x7f8a340fbca0 msgr2=0x7f8a340fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.382+0000 7f8a399ff700 1 -- 172.21.15.107:0/3877940153 shutdown_connections 2023-08-10T10:48:15.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.382+0000 7f8a399ff700 1 -- 172.21.15.107:0/3877940153 wait complete. 2023-08-10T10:48:15.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.383+0000 7f8a399ff700 1 Processor -- start 2023-08-10T10:48:15.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a399ff700 1 -- start start 2023-08-10T10:48:15.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a399ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a34100770 0x7f8a34196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:15.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a399ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a34101960 0x7f8a34196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:15.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a399ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34102300 0x7f8a3419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:15.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a399ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3419dfc0 con 0x7f8a34101960 2023-08-10T10:48:15.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a399ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3419e100 con 0x7f8a34100770 2023-08-10T10:48:15.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a399ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3419e290 con 0x7f8a34102300 2023-08-10T10:48:15.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a32ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a34100770 0x7f8a34196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:15.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a32ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a34100770 0x7f8a34196440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57386/0 (socket says 172.21.15.107:57386) 2023-08-10T10:48:15.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a327fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a34101960 0x7f8a34196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:15.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a32ffd700 1 -- 172.21.15.107:0/3684607076 learned_addr learned my addr 172.21.15.107:0/3684607076 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:15.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.384+0000 7f8a337fe700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34102300 0x7f8a3419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:15.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a327fc700 1 -- 172.21.15.107:0/3684607076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34102300 msgr2=0x7f8a3419d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:15.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a327fc700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34102300 0x7f8a3419d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a327fc700 1 -- 172.21.15.107:0/3684607076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a34100770 msgr2=0x7f8a34196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:15.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a327fc700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a34100770 0x7f8a34196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a327fc700 1 -- 172.21.15.107:0/3684607076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240095f0 con 0x7f8a34101960 2023-08-10T10:48:15.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a337fe700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34102300 0x7f8a3419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:15.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a32ffd700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a34100770 0x7f8a34196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:15.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a327fc700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a34101960 0x7f8a34196980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800b450 tx=0x7f8a2800b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:15.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a389fd700 1 -- 172.21.15.107:0/3684607076 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28011830 con 0x7f8a34101960 2023-08-10T10:48:15.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a389fd700 1 -- 172.21.15.107:0/3684607076 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a2800be60 con 0x7f8a34101960 2023-08-10T10:48:15.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3419e570 con 0x7f8a34101960 2023-08-10T10:48:15.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.385+0000 7f8a389fd700 1 -- 172.21.15.107:0/3684607076 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28010ca0 con 0x7f8a34101960 2023-08-10T10:48:15.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.386+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3419ead0 con 0x7f8a34101960 2023-08-10T10:48:15.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.387+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3410bf00 con 0x7f8a34101960 2023-08-10T10:48:15.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.388+0000 7f8a389fd700 1 -- 172.21.15.107:0/3684607076 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8a28011990 con 0x7f8a34101960 2023-08-10T10:48:15.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.390+0000 7f8a389fd700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8a1c0a1220 0x7f8a1c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:15.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.390+0000 7f8a389fd700 1 -- 172.21.15.107:0/3684607076 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8a280cbdb0 con 0x7f8a34101960 2023-08-10T10:48:15.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.390+0000 7f8a32ffd700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8a1c0a1220 0x7f8a1c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:15.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.391+0000 7f8a32ffd700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8a1c0a1220 0x7f8a1c0a36e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400c010 tx=0x7f8a24009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:15.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.394+0000 7f8a389fd700 1 -- 172.21.15.107:0/3684607076 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8a280d0070 con 0x7f8a34101960 2023-08-10T10:48:15.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.635+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a3410c0f0 con 0x7f8a34101960 2023-08-10T10:48:15.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.636+0000 7f8a389fd700 1 -- 172.21.15.107:0/3684607076 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4297 (secure 0 0 0) 0x7f8a28095900 con 0x7f8a34101960 2023-08-10T10:48:15.637 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:15.637 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-08-10T10:48:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8a1c0a1220 msgr2=0x7f8a1c0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8a1c0a1220 0x7f8a1c0a36e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400c010 tx=0x7f8a24009f10 comp rx=0 tx=0).stop 2023-08-10T10:48:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a34101960 msgr2=0x7f8a34196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a34101960 0x7f8a34196980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800b450 tx=0x7f8a2800b760 comp rx=0 tx=0).stop 2023-08-10T10:48:15.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 shutdown_connections 2023-08-10T10:48:15.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8a1c0a1220 0x7f8a1c0a36e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a34100770 0x7f8a34196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a34102300 0x7f8a3419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 --2- 172.21.15.107:0/3684607076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a34101960 0x7f8a34196980 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:15.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 >> 172.21.15.107:0/3684607076 conn(0x7f8a340fbca0 msgr2=0x7f8a340fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:15.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 shutdown_connections 2023-08-10T10:48:15.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:15.638+0000 7f8a399ff700 1 -- 172.21.15.107:0/3684607076 wait complete. 2023-08-10T10:48:15.641 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 6 2023-08-10T10:48:15.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] up:boot 2023-08-10T10:48:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: fsmap 5 up:standby 2023-08-10T10:48:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T10:48:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:15.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:15.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:15.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:15.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: Deploying daemon mds.f on smithi195 2023-08-10T10:48:15.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:15 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3684607076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] up:boot 2023-08-10T10:48:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: fsmap 5 up:standby 2023-08-10T10:48:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T10:48:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:16.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:16.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:16.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:16.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: Deploying daemon mds.f on smithi195 2023-08-10T10:48:16.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:15 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3684607076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] up:boot 2023-08-10T10:48:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: fsmap 5 up:standby 2023-08-10T10:48:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T10:48:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: Deploying daemon mds.f on smithi195 2023-08-10T10:48:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:15 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3684607076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:16.950 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:16 smithi195 ceph-mon[129938]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:16.950 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 10:48:16 smithi195 systemd[1]: Starting Ceph mds.f for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:16 smithi157 ceph-mon[129604]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:16 smithi107 ceph-mon[127953]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:17.652 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 10:48:17 smithi195 podman[155431]: 2023-08-10T10:48:17.659 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:17.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.874+0000 7fca84dff700 1 -- 172.21.15.107:0/2660723260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 msgr2=0x7fca80100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:17.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.874+0000 7fca84dff700 1 --2- 172.21.15.107:0/2660723260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 0x7fca80100b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fca700099c0 tx=0x7fca70009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:17.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.874+0000 7fca84dff700 1 -- 172.21.15.107:0/2660723260 shutdown_connections 2023-08-10T10:48:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.874+0000 7fca84dff700 1 --2- 172.21.15.107:0/2660723260 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80102300 0x7fca80108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.874+0000 7fca84dff700 1 --2- 172.21.15.107:0/2660723260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 0x7fca80100b90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.874+0000 7fca84dff700 1 --2- 172.21.15.107:0/2660723260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca80101960 0x7fca80101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.874+0000 7fca84dff700 1 -- 172.21.15.107:0/2660723260 >> 172.21.15.107:0/2660723260 conn(0x7fca800fbca0 msgr2=0x7fca800fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.874+0000 7fca84dff700 1 -- 172.21.15.107:0/2660723260 shutdown_connections 2023-08-10T10:48:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.874+0000 7fca84dff700 1 -- 172.21.15.107:0/2660723260 wait complete. 2023-08-10T10:48:17.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.875+0000 7fca84dff700 1 Processor -- start 2023-08-10T10:48:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.875+0000 7fca84dff700 1 -- start start 2023-08-10T10:48:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.875+0000 7fca84dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 0x7fca80198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca84dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca80101960 0x7fca80198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:17.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca84dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80102300 0x7fca8019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:17.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca84dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca801a0100 con 0x7fca80100770 2023-08-10T10:48:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca84dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca801a0240 con 0x7fca80102300 2023-08-10T10:48:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca84dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca801a03d0 con 0x7fca80101960 2023-08-10T10:48:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 0x7fca80198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 0x7fca80198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52278/0 (socket says 172.21.15.107:52278) 2023-08-10T10:48:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7e59c700 1 -- 172.21.15.107:0/3410345651 learned_addr learned my addr 172.21.15.107:0/3410345651 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:17.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7dd9b700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca80101960 0x7fca80198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:17.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7ed9d700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80102300 0x7fca8019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:17.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7e59c700 1 -- 172.21.15.107:0/3410345651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca80101960 msgr2=0x7fca80198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:17.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7e59c700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca80101960 0x7fca80198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:17.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7e59c700 1 -- 172.21.15.107:0/3410345651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80102300 msgr2=0x7fca8019fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:17.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7e59c700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80102300 0x7fca8019fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:17.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7e59c700 1 -- 172.21.15.107:0/3410345651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700095f0 con 0x7fca80100770 2023-08-10T10:48:17.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7ed9d700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80102300 0x7fca8019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:48:17.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.876+0000 7fca7e59c700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 0x7fca80198580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca70009f50 tx=0x7fca70003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.877+0000 7fca6f7fe700 1 -- 172.21.15.107:0/3410345651 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7001d070 con 0x7fca80100770 2023-08-10T10:48:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.877+0000 7fca6f7fe700 1 -- 172.21.15.107:0/3410345651 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca7000bda0 con 0x7fca80100770 2023-08-10T10:48:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.877+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca801a0650 con 0x7fca80100770 2023-08-10T10:48:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.877+0000 7fca6f7fe700 1 -- 172.21.15.107:0/3410345651 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70022dd0 con 0x7fca80100770 2023-08-10T10:48:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.877+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca801a0a70 con 0x7fca80100770 2023-08-10T10:48:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.878+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca80192c80 con 0x7fca80100770 2023-08-10T10:48:17.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.880+0000 7fca6f7fe700 1 -- 172.21.15.107:0/3410345651 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fca70022570 con 0x7fca80100770 2023-08-10T10:48:17.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.881+0000 7fca6f7fe700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fca680a11a0 0x7fca680a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.881+0000 7fca6f7fe700 1 -- 172.21.15.107:0/3410345651 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fca700cd970 con 0x7fca80100770 2023-08-10T10:48:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.881+0000 7fca7dd9b700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fca680a11a0 0x7fca680a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.882+0000 7fca7dd9b700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fca680a11a0 0x7fca680a3660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca74007c60 tx=0x7fca740073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:17.885+0000 7fca6f7fe700 1 -- 172.21.15.107:0/3410345651 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fca70097550 con 0x7fca80100770 2023-08-10T10:48:17.912 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 10:48:17 smithi195 bash[155431]: 3d917812b19df59bbde1ae4d93a130143da66012035a0009fa29e0ef9a6cb249 2023-08-10T10:48:17.913 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 10:48:17 smithi195 ceph-mds[155471]: -- 172.21.15.195:0/1580336959 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5647196f11e0 con 0x5647196c6800 2023-08-10T10:48:17.913 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 10:48:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-f[155447]: starting mds.f at 2023-08-10T10:48:17.913 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 10:48:17 smithi195 systemd[1]: Started Ceph mds.f for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:18.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.126+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca8002c970 con 0x7fca80100770 2023-08-10T10:48:18.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.126+0000 7fca6f7fe700 1 -- 172.21.15.107:0/3410345651 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5057 (secure 0 0 0) 0x7fca7009ab70 con 0x7fca80100770 2023-08-10T10:48:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:18.127 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-08-10T10:48:18.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fca680a11a0 msgr2=0x7fca680a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:18.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fca680a11a0 0x7fca680a3660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca74007c60 tx=0x7fca740073d0 comp rx=0 tx=0).stop 2023-08-10T10:48:18.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 msgr2=0x7fca80198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:18.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 0x7fca80198580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca70009f50 tx=0x7fca70003a50 comp rx=0 tx=0).stop 2023-08-10T10:48:18.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 shutdown_connections 2023-08-10T10:48:18.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fca680a11a0 0x7fca680a3660 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:18.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca80102300 0x7fca8019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:18.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fca80100770 0x7fca80198580 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:18.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 --2- 172.21.15.107:0/3410345651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca80101960 0x7fca80198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:18.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.128+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 >> 172.21.15.107:0/3410345651 conn(0x7fca800fbca0 msgr2=0x7fca80107280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:18.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.129+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 shutdown_connections 2023-08-10T10:48:18.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:18.129+0000 7fca84dff700 1 -- 172.21.15.107:0/3410345651 wait complete. 2023-08-10T10:48:18.132 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 7 2023-08-10T10:48:19.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] up:boot 2023-08-10T10:48:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: fsmap 6 up:standby 2023-08-10T10:48:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T10:48:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: Deploying daemon mds.c on smithi195 2023-08-10T10:48:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:18 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3410345651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] up:boot 2023-08-10T10:48:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: fsmap 6 up:standby 2023-08-10T10:48:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T10:48:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:19.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:19.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:19.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:19.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:19.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: Deploying daemon mds.c on smithi195 2023-08-10T10:48:19.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:18 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3410345651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:19.120 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:19.120 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] up:boot 2023-08-10T10:48:19.120 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: fsmap 6 up:standby 2023-08-10T10:48:19.120 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T10:48:19.121 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:19.121 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:19.121 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:19.121 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:19.121 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:19.121 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:19.121 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: Deploying daemon mds.c on smithi195 2023-08-10T10:48:19.121 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:18 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3410345651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:20.148 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:20.158 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 10:48:20 smithi195 systemd[1]: Starting Ceph mds.c for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:20.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.355+0000 7feb3c9ff700 1 -- 172.21.15.107:0/2086021263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 msgr2=0x7feb38101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:20.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.355+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/2086021263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 0x7feb38101dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0099c0 tx=0x7feb2c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.355+0000 7feb3c9ff700 1 -- 172.21.15.107:0/2086021263 shutdown_connections 2023-08-10T10:48:20.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.355+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/2086021263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb38100770 0x7feb38100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.355+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/2086021263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb38102300 0x7feb38108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.355+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/2086021263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 0x7feb38101dc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.355+0000 7feb3c9ff700 1 -- 172.21.15.107:0/2086021263 >> 172.21.15.107:0/2086021263 conn(0x7feb380fbca0 msgr2=0x7feb380fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:20.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.355+0000 7feb3c9ff700 1 -- 172.21.15.107:0/2086021263 shutdown_connections 2023-08-10T10:48:20.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.355+0000 7feb3c9ff700 1 -- 172.21.15.107:0/2086021263 wait complete. 2023-08-10T10:48:20.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.356+0000 7feb3c9ff700 1 Processor -- start 2023-08-10T10:48:20.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.356+0000 7feb3c9ff700 1 -- start start 2023-08-10T10:48:20.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.356+0000 7feb3c9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb38100770 0x7feb38074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:20.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.356+0000 7feb3c9ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 0x7feb38072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:20.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.356+0000 7feb3c9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb38102300 0x7feb380730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:20.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.356+0000 7feb3c9ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb38073840 con 0x7feb38101960 2023-08-10T10:48:20.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.356+0000 7feb3c9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb380739b0 con 0x7feb38102300 2023-08-10T10:48:20.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.356+0000 7feb3c9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb381a0410 con 0x7feb38100770 2023-08-10T10:48:20.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb35d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 0x7feb38072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:20.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb35d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 0x7feb38072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52304/0 (socket says 172.21.15.107:52304) 2023-08-10T10:48:20.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb35d9b700 1 -- 172.21.15.107:0/575502383 learned_addr learned my addr 172.21.15.107:0/575502383 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:20.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb36d9d700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb38102300 0x7feb380730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:20.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb3659c700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb38100770 0x7feb38074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:20.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb35d9b700 1 -- 172.21.15.107:0/575502383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb38100770 msgr2=0x7feb38074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:20.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb35d9b700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb38100770 0x7feb38074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb35d9b700 1 -- 172.21.15.107:0/575502383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb38102300 msgr2=0x7feb380730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:20.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb35d9b700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb38102300 0x7feb380730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb35d9b700 1 -- 172.21.15.107:0/575502383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0095f0 con 0x7feb38101960 2023-08-10T10:48:20.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.357+0000 7feb35d9b700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 0x7feb38072b60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb2c000c00 tx=0x7feb2c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:20.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.358+0000 7feb277fe700 1 -- 172.21.15.107:0/575502383 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c01d070 con 0x7feb38101960 2023-08-10T10:48:20.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.358+0000 7feb277fe700 1 -- 172.21.15.107:0/575502383 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb2c00fe70 con 0x7feb38101960 2023-08-10T10:48:20.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.358+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb381a0690 con 0x7feb38101960 2023-08-10T10:48:20.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.358+0000 7feb277fe700 1 -- 172.21.15.107:0/575502383 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0173f0 con 0x7feb38101960 2023-08-10T10:48:20.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.358+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb381a0b10 con 0x7feb38101960 2023-08-10T10:48:20.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.359+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3810be90 con 0x7feb38101960 2023-08-10T10:48:20.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.361+0000 7feb277fe700 1 -- 172.21.15.107:0/575502383 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7feb2c022470 con 0x7feb38101960 2023-08-10T10:48:20.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.363+0000 7feb277fe700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feb200a1220 0x7feb200a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:20.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.363+0000 7feb277fe700 1 -- 172.21.15.107:0/575502383 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7feb2c0cd850 con 0x7feb38101960 2023-08-10T10:48:20.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.363+0000 7feb3659c700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feb200a1220 0x7feb200a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:20.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.364+0000 7feb3659c700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feb200a1220 0x7feb200a36e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb381017c0 tx=0x7feb2800b5b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:20.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.365+0000 7feb277fe700 1 -- 172.21.15.107:0/575502383 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7feb2c097430 con 0x7feb38101960 2023-08-10T10:48:20.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.606+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb381076e0 con 0x7feb38101960 2023-08-10T10:48:20.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.607+0000 7feb277fe700 1 -- 172.21.15.107:0/575502383 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5057 (secure 0 0 0) 0x7feb2c09aa50 con 0x7feb38101960 2023-08-10T10:48:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:20.608 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-08-10T10:48:20.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feb200a1220 msgr2=0x7feb200a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:20.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feb200a1220 0x7feb200a36e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb381017c0 tx=0x7feb2800b5b0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 msgr2=0x7feb38072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:20.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 0x7feb38072b60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb2c000c00 tx=0x7feb2c00fa00 comp rx=0 tx=0).stop 2023-08-10T10:48:20.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 shutdown_connections 2023-08-10T10:48:20.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7feb200a1220 0x7feb200a36e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb38102300 0x7feb380730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb38100770 0x7feb38074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 --2- 172.21.15.107:0/575502383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb38101960 0x7feb38072b60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:20.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 >> 172.21.15.107:0/575502383 conn(0x7feb380fbca0 msgr2=0x7feb380fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:20.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.609+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 shutdown_connections 2023-08-10T10:48:20.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:20.610+0000 7feb3c9ff700 1 -- 172.21.15.107:0/575502383 wait complete. 2023-08-10T10:48:20.613 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 7 2023-08-10T10:48:20.892 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:20 smithi195 ceph-mon[129938]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:20.893 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:20 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/575502383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:20.893 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 10:48:20 smithi195 podman[155777]: 2023-08-10T10:48:21.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:20 smithi157 ceph-mon[129604]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:20 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/575502383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:20 smithi107 ceph-mon[127953]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:20 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/575502383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:21.162 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 10:48:20 smithi195 bash[155777]: b7cab99e727de88585ec985b6483eb0aaa52fdd2631f99ff912da4a49a60674f 2023-08-10T10:48:21.163 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 10:48:20 smithi195 ceph-mds[155817]: -- 172.21.15.195:0/2408888835 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5602f36591e0 con 0x5602f362ec00 2023-08-10T10:48:21.163 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 10:48:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-c[155793]: starting mds.c at 2023-08-10T10:48:21.163 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 10:48:20 smithi195 systemd[1]: Started Ceph mds.c for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:22.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:22.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:22.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:22.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:22.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:22.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: Deploying daemon mds.h on smithi157 2023-08-10T10:48:22.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.195:6836/2175306413,v1:172.21.15.195:6837/2175306413] up:boot 2023-08-10T10:48:22.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: fsmap 7 up:standby 2023-08-10T10:48:22.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:21 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T10:48:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:22.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:22.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:22.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:22.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: Deploying daemon mds.h on smithi157 2023-08-10T10:48:22.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.195:6836/2175306413,v1:172.21.15.195:6837/2175306413] up:boot 2023-08-10T10:48:22.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: fsmap 7 up:standby 2023-08-10T10:48:22.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:21 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T10:48:22.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:22.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:22.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:22.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:22.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:22.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:22.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: Deploying daemon mds.h on smithi157 2023-08-10T10:48:22.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.195:6836/2175306413,v1:172.21.15.195:6837/2175306413] up:boot 2023-08-10T10:48:22.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: fsmap 7 up:standby 2023-08-10T10:48:22.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:21 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T10:48:22.629 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:22.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.836+0000 7fa881dff700 1 -- 172.21.15.107:0/4014978231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c101970 msgr2=0x7fa87c101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:22.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.836+0000 7fa881dff700 1 --2- 172.21.15.107:0/4014978231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c101970 0x7fa87c101dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa8700099c0 tx=0x7fa870009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:22.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.836+0000 7fa881dff700 1 -- 172.21.15.107:0/4014978231 shutdown_connections 2023-08-10T10:48:22.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.836+0000 7fa881dff700 1 --2- 172.21.15.107:0/4014978231 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa87c100780 0x7fa87c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:22.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.836+0000 7fa881dff700 1 --2- 172.21.15.107:0/4014978231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa87c102310 0x7fa87c108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:22.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.836+0000 7fa881dff700 1 --2- 172.21.15.107:0/4014978231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c101970 0x7fa87c101dd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:22.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.836+0000 7fa881dff700 1 -- 172.21.15.107:0/4014978231 >> 172.21.15.107:0/4014978231 conn(0x7fa87c0fbcb0 msgr2=0x7fa87c0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:22.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.836+0000 7fa881dff700 1 -- 172.21.15.107:0/4014978231 shutdown_connections 2023-08-10T10:48:22.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.837+0000 7fa881dff700 1 -- 172.21.15.107:0/4014978231 wait complete. 2023-08-10T10:48:22.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.837+0000 7fa881dff700 1 Processor -- start 2023-08-10T10:48:22.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa881dff700 1 -- start start 2023-08-10T10:48:22.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa881dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa87c100780 0x7fa87c074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:22.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa881dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa87c101970 0x7fa87c072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:22.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa881dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c102310 0x7fa87c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:22.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa881dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c073840 con 0x7fa87c102310 2023-08-10T10:48:22.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa881dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0739b0 con 0x7fa87c100780 2023-08-10T10:48:22.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa881dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c1a03f0 con 0x7fa87c101970 2023-08-10T10:48:22.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa87bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c102310 0x7fa87c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:22.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa87bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c102310 0x7fa87c0730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52326/0 (socket says 172.21.15.107:52326) 2023-08-10T10:48:22.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa87bfff700 1 -- 172.21.15.107:0/1880320355 learned_addr learned my addr 172.21.15.107:0/1880320355 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:22.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.838+0000 7fa87b7fe700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa87c100780 0x7fa87c074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:22.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa87affd700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa87c101970 0x7fa87c072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:22.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa87bfff700 1 -- 172.21.15.107:0/1880320355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa87c101970 msgr2=0x7fa87c072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:22.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa87bfff700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa87c101970 0x7fa87c072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:22.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa87bfff700 1 -- 172.21.15.107:0/1880320355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa87c100780 msgr2=0x7fa87c074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:22.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa87bfff700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa87c100780 0x7fa87c074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:22.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa87bfff700 1 -- 172.21.15.107:0/1880320355 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700095f0 con 0x7fa87c102310 2023-08-10T10:48:22.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa87affd700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa87c101970 0x7fa87c072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:48:22.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa87bfff700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c102310 0x7fa87c0730a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa874007ee0 tx=0x7fa87400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:22.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa878ff9700 1 -- 172.21.15.107:0/1880320355 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874017070 con 0x7fa87c102310 2023-08-10T10:48:22.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa878ff9700 1 -- 172.21.15.107:0/1880320355 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa87400f040 con 0x7fa87c102310 2023-08-10T10:48:22.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c1a06d0 con 0x7fa87c102310 2023-08-10T10:48:22.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa878ff9700 1 -- 172.21.15.107:0/1880320355 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874005710 con 0x7fa87c102310 2023-08-10T10:48:22.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.839+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c1a0be0 con 0x7fa87c102310 2023-08-10T10:48:22.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.840+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c10bea0 con 0x7fa87c102310 2023-08-10T10:48:22.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.842+0000 7fa878ff9700 1 -- 172.21.15.107:0/1880320355 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fa874005870 con 0x7fa87c102310 2023-08-10T10:48:22.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.843+0000 7fa878ff9700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa8640a1220 0x7fa8640a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:22.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.844+0000 7fa878ff9700 1 -- 172.21.15.107:0/1880320355 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa8740cbcb0 con 0x7fa87c102310 2023-08-10T10:48:22.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.844+0000 7fa87b7fe700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa8640a1220 0x7fa8640a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:22.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.844+0000 7fa87b7fe700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa8640a1220 0x7fa8640a36e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa87c1017d0 tx=0x7fa86c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:22.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:22.848+0000 7fa878ff9700 1 -- 172.21.15.107:0/1880320355 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa874095800 con 0x7fa87c102310 2023-08-10T10:48:23.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.091+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa87c10c0c0 con 0x7fa87c102310 2023-08-10T10:48:23.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.091+0000 7fa878ff9700 1 -- 172.21.15.107:0/1880320355 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5817 (secure 0 0 0) 0x7fa874098e20 con 0x7fa87c102310 2023-08-10T10:48:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:23.092 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-08-10T10:48:23.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa8640a1220 msgr2=0x7fa8640a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:23.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa8640a1220 0x7fa8640a36e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa87c1017d0 tx=0x7fa86c009260 comp rx=0 tx=0).stop 2023-08-10T10:48:23.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c102310 msgr2=0x7fa87c0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:23.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c102310 0x7fa87c0730a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa874007ee0 tx=0x7fa87400d3b0 comp rx=0 tx=0).stop 2023-08-10T10:48:23.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 shutdown_connections 2023-08-10T10:48:23.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa8640a1220 0x7fa8640a36e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:23.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa87c100780 0x7fa87c074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:23.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa87c102310 0x7fa87c0730a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:23.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 --2- 172.21.15.107:0/1880320355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa87c101970 0x7fa87c072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:23.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 >> 172.21.15.107:0/1880320355 conn(0x7fa87c0fbcb0 msgr2=0x7fa87c0fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:23.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 shutdown_connections 2023-08-10T10:48:23.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:23.094+0000 7fa881dff700 1 -- 172.21.15.107:0/1880320355 wait complete. 2023-08-10T10:48:23.095 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2023-08-10T10:48:23.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:23 smithi157 ceph-mon[129604]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:23.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:23 smithi107 ceph-mon[127953]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:23.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:23 smithi195 ceph-mon[129938]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:23.788 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 10:48:23 smithi157 systemd[1]: Starting Ceph mds.h for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:24.071 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:24 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1880320355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:24.072 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 10:48:23 smithi157 podman[154712]: 2023-08-10T10:48:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:24 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1880320355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:24.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:24 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1880320355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:24.538 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 10:48:24 smithi157 bash[154712]: 7bcc35bf42d3f0fb36b491a4abbc9bdf8306c2af9ca6f3bbf0131a21a90798dd 2023-08-10T10:48:24.538 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 10:48:24 smithi157 ceph-mds[154752]: -- 172.21.15.157:0/1446373999 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a8ea93d1e0 con 0x55a8ea912c00 2023-08-10T10:48:24.538 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 10:48:24 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-h[154728]: starting mds.h at 2023-08-10T10:48:24.539 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 10:48:24 smithi157 systemd[1]: Started Ceph mds.h for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:25.113 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:25.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.322+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/2443804994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 msgr2=0x7f9f98101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:25.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.322+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/2443804994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 0x7f9f98101dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009920 tx=0x7f9f80009c30 comp rx=0 tx=0).stop 2023-08-10T10:48:25.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.322+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/2443804994 shutdown_connections 2023-08-10T10:48:25.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.322+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/2443804994 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f98102300 0x7f9f98108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:25.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.322+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/2443804994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f98100770 0x7f9f98100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:25.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.322+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/2443804994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 0x7f9f98101dc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:25.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.322+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/2443804994 >> 172.21.15.107:0/2443804994 conn(0x7f9f980fbca0 msgr2=0x7f9f980fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:25.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.322+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/2443804994 shutdown_connections 2023-08-10T10:48:25.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.322+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/2443804994 wait complete. 2023-08-10T10:48:25.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.323+0000 7f9f9d7ff700 1 Processor -- start 2023-08-10T10:48:25.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.323+0000 7f9f9d7ff700 1 -- start start 2023-08-10T10:48:25.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f9d7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f98100770 0x7f9f98196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:25.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f9d7ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 0x7f9f98196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:25.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f9d7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f98102300 0x7f9f9819d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:25.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f9d7ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9819df90 con 0x7f9f98101960 2023-08-10T10:48:25.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f9d7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9819e0d0 con 0x7f9f98102300 2023-08-10T10:48:25.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f9d7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9819e260 con 0x7f9f98100770 2023-08-10T10:48:25.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f8ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 0x7f9f98196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:25.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f8ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 0x7f9f98196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37296/0 (socket says 172.21.15.107:37296) 2023-08-10T10:48:25.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f8ffff700 1 -- 172.21.15.107:0/3401536776 learned_addr learned my addr 172.21.15.107:0/3401536776 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:25.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f96ffd700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f98100770 0x7f9f98196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:25.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f977fe700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f98102300 0x7f9f9819d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:25.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f8ffff700 1 -- 172.21.15.107:0/3401536776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f98100770 msgr2=0x7f9f98196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:25.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f8ffff700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f98100770 0x7f9f98196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:25.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f8ffff700 1 -- 172.21.15.107:0/3401536776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f98102300 msgr2=0x7f9f9819d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:25.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f8ffff700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f98102300 0x7f9f9819d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:25.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f8ffff700 1 -- 172.21.15.107:0/3401536776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f880095f0 con 0x7f9f98101960 2023-08-10T10:48:25.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.324+0000 7f9f977fe700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f98102300 0x7f9f9819d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:48:25.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.325+0000 7f9f8ffff700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 0x7f9f98196950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009230 tx=0x7f9f8000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:25.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.325+0000 7f9f94ff9700 1 -- 172.21.15.107:0/3401536776 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8001c070 con 0x7f9f98101960 2023-08-10T10:48:25.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.325+0000 7f9f94ff9700 1 -- 172.21.15.107:0/3401536776 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f8000f7d0 con 0x7f9f98101960 2023-08-10T10:48:25.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.325+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f80009520 con 0x7f9f98101960 2023-08-10T10:48:25.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.325+0000 7f9f94ff9700 1 -- 172.21.15.107:0/3401536776 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80003970 con 0x7f9f98101960 2023-08-10T10:48:25.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.325+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9819e720 con 0x7f9f98101960 2023-08-10T10:48:25.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.326+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9810be90 con 0x7f9f98101960 2023-08-10T10:48:25.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.328+0000 7f9f94ff9700 1 -- 172.21.15.107:0/3401536776 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f9f80020030 con 0x7f9f98101960 2023-08-10T10:48:25.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.329+0000 7f9f94ff9700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9f840a11a0 0x7f9f840a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:25.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.329+0000 7f9f94ff9700 1 -- 172.21.15.107:0/3401536776 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9f800cd480 con 0x7f9f98101960 2023-08-10T10:48:25.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.329+0000 7f9f96ffd700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9f840a11a0 0x7f9f840a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:25.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.330+0000 7f9f96ffd700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9f840a11a0 0x7f9f840a3660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9f981017c0 tx=0x7f9f88009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:25.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.333+0000 7f9f94ff9700 1 -- 172.21.15.107:0/3401536776 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9f800970a0 con 0x7f9f98101960 2023-08-10T10:48:25.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:25.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:25.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:25.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:25.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:25.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:25.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:25.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.157:6836/2089201911,v1:172.21.15.157:6837/2089201911] up:boot 2023-08-10T10:48:25.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: fsmap 8 up:standby 2023-08-10T10:48:25.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:25 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T10:48:25.553 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:25.553 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:25.554 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:25.554 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:25.554 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:25.554 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:25.555 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:25.555 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.157:6836/2089201911,v1:172.21.15.157:6837/2089201911] up:boot 2023-08-10T10:48:25.555 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: fsmap 8 up:standby 2023-08-10T10:48:25.555 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:25 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T10:48:25.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:25.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:25.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:25.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:25.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:25.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:25.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:25.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.157:6836/2089201911,v1:172.21.15.157:6837/2089201911] up:boot 2023-08-10T10:48:25.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: fsmap 8 up:standby 2023-08-10T10:48:25.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:25 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T10:48:25.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.578+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f98107740 con 0x7f9f98101960 2023-08-10T10:48:25.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.579+0000 7f9f94ff9700 1 -- 172.21.15.107:0/3401536776 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6577 (secure 0 0 0) 0x7f9f8009a6c0 con 0x7f9f98101960 2023-08-10T10:48:25.580 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:25.580 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-08-10T10:48:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9f840a11a0 msgr2=0x7f9f840a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9f840a11a0 0x7f9f840a3660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9f981017c0 tx=0x7f9f88009310 comp rx=0 tx=0).stop 2023-08-10T10:48:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 msgr2=0x7f9f98196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:25.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 0x7f9f98196950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009230 tx=0x7f9f8000b790 comp rx=0 tx=0).stop 2023-08-10T10:48:25.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 shutdown_connections 2023-08-10T10:48:25.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9f840a11a0 0x7f9f840a3660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:25.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f98102300 0x7f9f9819d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:25.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f98100770 0x7f9f98196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:25.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 --2- 172.21.15.107:0/3401536776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9f98101960 0x7f9f98196950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:25.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 >> 172.21.15.107:0/3401536776 conn(0x7f9f980fbca0 msgr2=0x7f9f980fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:25.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 shutdown_connections 2023-08-10T10:48:25.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:25.581+0000 7f9f9d7ff700 1 -- 172.21.15.107:0/3401536776 wait complete. 2023-08-10T10:48:25.584 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 9 2023-08-10T10:48:26.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:26 smithi157 ceph-mon[129604]: Deploying daemon mds.i on smithi195 2023-08-10T10:48:26.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:26 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3401536776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:26.559 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:26 smithi195 ceph-mon[129938]: Deploying daemon mds.i on smithi195 2023-08-10T10:48:26.559 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:26 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3401536776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:26.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:26 smithi107 ceph-mon[127953]: Deploying daemon mds.i on smithi195 2023-08-10T10:48:26.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:26 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3401536776' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:26.912 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 10:48:26 smithi195 systemd[1]: Starting Ceph mds.i for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:27.335 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 10:48:27 smithi195 podman[156122]: 2023-08-10T10:48:27.335 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 10:48:27 smithi195 bash[156122]: fc9d9f7ed2a688a1b78d6a6bc37b561438dea411fb480885e5ce145dffc7aa41 2023-08-10T10:48:27.335 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:27 smithi195 ceph-mon[129938]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:27.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:27 smithi157 ceph-mon[129604]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:27.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:27 smithi107 ceph-mon[127953]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:27.601 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:27.662 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 10:48:27 smithi195 ceph-mds[156162]: -- 172.21.15.195:0/1282761136 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558bafeef1e0 con 0x558bafec4800 2023-08-10T10:48:27.663 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 10:48:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-i[156138]: starting mds.i at 2023-08-10T10:48:27.663 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 10:48:27 smithi195 systemd[1]: Started Ceph mds.i for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:27.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.805+0000 7fa8631ff700 1 -- 172.21.15.107:0/3949935904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa85c101970 msgr2=0x7fa85c101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:27.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.805+0000 7fa8631ff700 1 --2- 172.21.15.107:0/3949935904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa85c101970 0x7fa85c101dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8480099c0 tx=0x7fa848009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:27.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.805+0000 7fa8631ff700 1 -- 172.21.15.107:0/3949935904 shutdown_connections 2023-08-10T10:48:27.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.805+0000 7fa8631ff700 1 --2- 172.21.15.107:0/3949935904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa85c100780 0x7fa85c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:27.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.805+0000 7fa8631ff700 1 --2- 172.21.15.107:0/3949935904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa85c102310 0x7fa85c108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:27.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.805+0000 7fa8631ff700 1 --2- 172.21.15.107:0/3949935904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa85c101970 0x7fa85c101dd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:27.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.805+0000 7fa8631ff700 1 -- 172.21.15.107:0/3949935904 >> 172.21.15.107:0/3949935904 conn(0x7fa85c0fbcb0 msgr2=0x7fa85c0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:27.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.805+0000 7fa8631ff700 1 -- 172.21.15.107:0/3949935904 shutdown_connections 2023-08-10T10:48:27.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.805+0000 7fa8631ff700 1 -- 172.21.15.107:0/3949935904 wait complete. 2023-08-10T10:48:27.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.806+0000 7fa8631ff700 1 Processor -- start 2023-08-10T10:48:27.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.806+0000 7fa8631ff700 1 -- start start 2023-08-10T10:48:27.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.806+0000 7fa8631ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa85c100780 0x7fa85c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:27.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.806+0000 7fa8631ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa85c101970 0x7fa85c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:27.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.806+0000 7fa8631ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa85c102310 0x7fa85c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:27.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.806+0000 7fa8631ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c1a0090 con 0x7fa85c102310 2023-08-10T10:48:27.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.806+0000 7fa8631ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c1a01d0 con 0x7fa85c100780 2023-08-10T10:48:27.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.806+0000 7fa8631ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c1a0360 con 0x7fa85c101970 2023-08-10T10:48:27.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa86179c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa85c102310 0x7fa85c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:27.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa860f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa85c100780 0x7fa85c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:27.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa860f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa85c100780 0x7fa85c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:50608/0 (socket says 172.21.15.107:50608) 2023-08-10T10:48:27.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa860f9b700 1 -- 172.21.15.107:0/2795947870 learned_addr learned my addr 172.21.15.107:0/2795947870 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:27.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa85bfff700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa85c101970 0x7fa85c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:27.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa860f9b700 1 -- 172.21.15.107:0/2795947870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa85c101970 msgr2=0x7fa85c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:27.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa860f9b700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa85c101970 0x7fa85c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:27.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa860f9b700 1 -- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa85c102310 msgr2=0x7fa85c19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:27.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa860f9b700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa85c102310 0x7fa85c19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:27.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa860f9b700 1 -- 172.21.15.107:0/2795947870 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480095f0 con 0x7fa85c100780 2023-08-10T10:48:27.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa86179c700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa85c102310 0x7fa85c19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:27.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.807+0000 7fa860f9b700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa85c100780 0x7fa85c198510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa85000e970 tx=0x7fa85000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:27.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.808+0000 7fa859ffb700 1 -- 172.21.15.107:0/2795947870 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850009790 con 0x7fa85c100780 2023-08-10T10:48:27.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.808+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85c1a0640 con 0x7fa85c100780 2023-08-10T10:48:27.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.808+0000 7fa859ffb700 1 -- 172.21.15.107:0/2795947870 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa85000c7e0 con 0x7fa85c100780 2023-08-10T10:48:27.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.808+0000 7fa859ffb700 1 -- 172.21.15.107:0/2795947870 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850003bd0 con 0x7fa85c100780 2023-08-10T10:48:27.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.808+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c1a0ba0 con 0x7fa85c100780 2023-08-10T10:48:27.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.809+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c192c90 con 0x7fa85c100780 2023-08-10T10:48:27.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.811+0000 7fa859ffb700 1 -- 172.21.15.107:0/2795947870 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fa85000c950 con 0x7fa85c100780 2023-08-10T10:48:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.812+0000 7fa859ffb700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa84c0a1220 0x7fa84c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.812+0000 7fa859ffb700 1 -- 172.21.15.107:0/2795947870 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa850014070 con 0x7fa85c100780 2023-08-10T10:48:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.813+0000 7fa85bfff700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa84c0a1220 0x7fa84c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.813+0000 7fa85bfff700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa84c0a1220 0x7fa84c0a36e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa848006010 tx=0x7fa8480058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:27.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:27.815+0000 7fa859ffb700 1 -- 172.21.15.107:0/2795947870 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa8500967f0 con 0x7fa85c100780 2023-08-10T10:48:28.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.096+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa85c02c970 con 0x7fa85c100780 2023-08-10T10:48:28.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.097+0000 7fa859ffb700 1 -- 172.21.15.107:0/2795947870 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6577 (secure 0 0 0) 0x7fa850099e10 con 0x7fa85c100780 2023-08-10T10:48:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:28.099 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-08-10T10:48:28.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa84c0a1220 msgr2=0x7fa84c0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:28.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa84c0a1220 0x7fa84c0a36e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa848006010 tx=0x7fa8480058e0 comp rx=0 tx=0).stop 2023-08-10T10:48:28.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa85c100780 msgr2=0x7fa85c198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:28.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa85c100780 0x7fa85c198510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa85000e970 tx=0x7fa85000ec80 comp rx=0 tx=0).stop 2023-08-10T10:48:28.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 shutdown_connections 2023-08-10T10:48:28.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa84c0a1220 0x7fa84c0a36e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:28.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa85c100780 0x7fa85c198510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:28.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa85c102310 0x7fa85c19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:28.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 --2- 172.21.15.107:0/2795947870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa85c101970 0x7fa85c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:28.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 >> 172.21.15.107:0/2795947870 conn(0x7fa85c0fbcb0 msgr2=0x7fa85c107250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:28.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 shutdown_connections 2023-08-10T10:48:28.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:28.100+0000 7fa8631ff700 1 -- 172.21.15.107:0/2795947870 wait complete. 2023-08-10T10:48:28.103 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 9 2023-08-10T10:48:28.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:28.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:28.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:28.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:28.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:28.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:28.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: Deploying daemon mds.g on smithi107 2023-08-10T10:48:28.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:28.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2795947870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:28.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] up:boot 2023-08-10T10:48:28.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: fsmap 9 up:standby 2023-08-10T10:48:28.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:28 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T10:48:28.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:28.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:28.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:28.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:28.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:28.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:28.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: Deploying daemon mds.g on smithi107 2023-08-10T10:48:28.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:28.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2795947870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:28.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] up:boot 2023-08-10T10:48:28.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: fsmap 9 up:standby 2023-08-10T10:48:28.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:28 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T10:48:28.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:28.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: Deploying daemon mds.g on smithi107 2023-08-10T10:48:28.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:28.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2795947870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:28.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] up:boot 2023-08-10T10:48:28.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: fsmap 9 up:standby 2023-08-10T10:48:28.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:28 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T10:48:29.770 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 10:48:29 smithi107 systemd[1]: Starting Ceph mds.g for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:30.121 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:30.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.328+0000 7ff692fff700 1 -- 172.21.15.107:0/3164931588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff68c100770 msgr2=0x7ff68c100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:30.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.328+0000 7ff692fff700 1 --2- 172.21.15.107:0/3164931588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff68c100770 0x7ff68c100b90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6800099c0 tx=0x7ff680009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.328+0000 7ff692fff700 1 -- 172.21.15.107:0/3164931588 shutdown_connections 2023-08-10T10:48:30.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.328+0000 7ff692fff700 1 --2- 172.21.15.107:0/3164931588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff68c102300 0x7ff68c108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.328+0000 7ff692fff700 1 --2- 172.21.15.107:0/3164931588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff68c100770 0x7ff68c100b90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.328+0000 7ff692fff700 1 --2- 172.21.15.107:0/3164931588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff68c101960 0x7ff68c101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.328+0000 7ff692fff700 1 -- 172.21.15.107:0/3164931588 >> 172.21.15.107:0/3164931588 conn(0x7ff68c0fbca0 msgr2=0x7ff68c0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:30.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.328+0000 7ff692fff700 1 -- 172.21.15.107:0/3164931588 shutdown_connections 2023-08-10T10:48:30.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.328+0000 7ff692fff700 1 -- 172.21.15.107:0/3164931588 wait complete. 2023-08-10T10:48:30.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.329+0000 7ff692fff700 1 Processor -- start 2023-08-10T10:48:30.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff692fff700 1 -- start start 2023-08-10T10:48:30.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff692fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff68c100770 0x7ff68c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:30.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff692fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff68c101960 0x7ff68c1968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:30.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff692fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff68c102300 0x7ff68c19d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:30.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff692fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c19df20 con 0x7ff68c102300 2023-08-10T10:48:30.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff692fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c19e060 con 0x7ff68c100770 2023-08-10T10:48:30.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff692fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c19e1f0 con 0x7ff68c101960 2023-08-10T10:48:30.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff690d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff68c100770 0x7ff68c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:30.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff69159c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff68c102300 0x7ff68c19d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:30.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff690d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff68c100770 0x7ff68c1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:50618/0 (socket says 172.21.15.107:50618) 2023-08-10T10:48:30.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff690d9b700 1 -- 172.21.15.107:0/4218344258 learned_addr learned my addr 172.21.15.107:0/4218344258 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:30.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.330+0000 7ff68bfff700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff68c101960 0x7ff68c1968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:30.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff69159c700 1 -- 172.21.15.107:0/4218344258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff68c101960 msgr2=0x7ff68c1968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:30.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff69159c700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff68c101960 0x7ff68c1968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff69159c700 1 -- 172.21.15.107:0/4218344258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff68c100770 msgr2=0x7ff68c1963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:30.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff69159c700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff68c100770 0x7ff68c1963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff69159c700 1 -- 172.21.15.107:0/4218344258 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6800095f0 con 0x7ff68c102300 2023-08-10T10:48:30.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff690d9b700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff68c100770 0x7ff68c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:30.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff69159c700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff68c102300 0x7ff68c19d950 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff684007f10 tx=0x7ff68400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:30.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff689ffb700 1 -- 172.21.15.107:0/4218344258 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684004db0 con 0x7ff68c102300 2023-08-10T10:48:30.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68c19e4d0 con 0x7ff68c102300 2023-08-10T10:48:30.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff689ffb700 1 -- 172.21.15.107:0/4218344258 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff68400f040 con 0x7ff68c102300 2023-08-10T10:48:30.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff689ffb700 1 -- 172.21.15.107:0/4218344258 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684005960 con 0x7ff68c102300 2023-08-10T10:48:30.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.331+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68c19e990 con 0x7ff68c102300 2023-08-10T10:48:30.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.333+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68c10be90 con 0x7ff68c102300 2023-08-10T10:48:30.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.335+0000 7ff689ffb700 1 -- 172.21.15.107:0/4218344258 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff68400db20 con 0x7ff68c102300 2023-08-10T10:48:30.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.336+0000 7ff689ffb700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff67c0a11a0 0x7ff67c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:30.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.336+0000 7ff689ffb700 1 -- 172.21.15.107:0/4218344258 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff6840cbf70 con 0x7ff68c102300 2023-08-10T10:48:30.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.336+0000 7ff690d9b700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff67c0a11a0 0x7ff67c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:30.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.337+0000 7ff690d9b700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff67c0a11a0 0x7ff67c0a3660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff68000c010 tx=0x7ff68000bd00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:30.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.338+0000 7ff689ffb700 1 -- 172.21.15.107:0/4218344258 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff684095ac0 con 0x7ff68c102300 2023-08-10T10:48:30.436 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 10:48:30 smithi107 podman[161827]: 2023-08-10T10:48:30.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.597+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff68c107770 con 0x7ff68c102300 2023-08-10T10:48:30.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.597+0000 7ff689ffb700 1 -- 172.21.15.107:0/4218344258 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8100 (secure 0 0 0) 0x7ff6840990e0 con 0x7ff68c102300 2023-08-10T10:48:30.599 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:30.599 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14670,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24571,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-08-10T10:48:30.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff67c0a11a0 msgr2=0x7ff67c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:30.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff67c0a11a0 0x7ff67c0a3660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff68000c010 tx=0x7ff68000bd00 comp rx=0 tx=0).stop 2023-08-10T10:48:30.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff68c102300 msgr2=0x7ff68c19d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:30.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff68c102300 0x7ff68c19d950 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff684007f10 tx=0x7ff68400d3b0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 shutdown_connections 2023-08-10T10:48:30.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff67c0a11a0 0x7ff67c0a3660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff68c100770 0x7ff68c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff68c102300 0x7ff68c19d950 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 --2- 172.21.15.107:0/4218344258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff68c101960 0x7ff68c1968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:30.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 >> 172.21.15.107:0/4218344258 conn(0x7ff68c0fbca0 msgr2=0x7ff68c0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:30.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 shutdown_connections 2023-08-10T10:48:30.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:30.600+0000 7ff692fff700 1 -- 172.21.15.107:0/4218344258 wait complete. 2023-08-10T10:48:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 11 2023-08-10T10:48:30.826 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:30 smithi107 ceph-mon[127953]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:30.827 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 10:48:30 smithi107 ceph-mds[161910]: -- 172.21.15.107:0/1753894809 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556204b611e0 con 0x556204b36800 2023-08-10T10:48:30.827 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 10:48:30 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-g[161886]: starting mds.g at 2023-08-10T10:48:30.827 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 10:48:30 smithi107 bash[161827]: 1940a3bf22d4b04dc41d1b37da17eb7715a864f03fb650dc7c7fc6ceaadcb6ec 2023-08-10T10:48:30.827 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 10:48:30 smithi107 systemd[1]: Started Ceph mds.g for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:30.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:30 smithi195 ceph-mon[129938]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:30 smithi157 ceph-mon[129604]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:31.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.107:6838/1945342668,v1:172.21.15.107:6839/1945342668] up:boot 2023-08-10T10:48:31.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: fsmap 10 up:standby 2023-08-10T10:48:31.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T10:48:31.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4218344258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:31.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:31.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:31.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:31.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:31.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:31.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:31.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:31 smithi107 ceph-mon[127953]: Deploying daemon mds.a on smithi107 2023-08-10T10:48:31.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.107:6838/1945342668,v1:172.21.15.107:6839/1945342668] up:boot 2023-08-10T10:48:31.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: fsmap 10 up:standby 2023-08-10T10:48:31.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T10:48:31.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4218344258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:31.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:31.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:31.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:31.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:31.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:31.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:31.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:31 smithi195 ceph-mon[129938]: Deploying daemon mds.a on smithi107 2023-08-10T10:48:32.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.107:6838/1945342668,v1:172.21.15.107:6839/1945342668] up:boot 2023-08-10T10:48:32.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: fsmap 10 up:standby 2023-08-10T10:48:32.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T10:48:32.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4218344258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:32.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:32.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:32.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:32.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:32.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:32.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:32.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:31 smithi157 ceph-mon[129604]: Deploying daemon mds.a on smithi107 2023-08-10T10:48:32.622 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:32.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.857+0000 7f1f515ff700 1 -- 172.21.15.107:0/3969642647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c100770 msgr2=0x7f1f4c100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:32.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.857+0000 7f1f515ff700 1 --2- 172.21.15.107:0/3969642647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c100770 0x7f1f4c100b90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0099c0 tx=0x7f1f3c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:32.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.857+0000 7f1f515ff700 1 -- 172.21.15.107:0/3969642647 shutdown_connections 2023-08-10T10:48:32.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.857+0000 7f1f515ff700 1 --2- 172.21.15.107:0/3969642647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c102300 0x7f1f4c108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:32.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.857+0000 7f1f515ff700 1 --2- 172.21.15.107:0/3969642647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c100770 0x7f1f4c100b90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:32.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.857+0000 7f1f515ff700 1 --2- 172.21.15.107:0/3969642647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f4c101960 0x7f1f4c101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:32.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.857+0000 7f1f515ff700 1 -- 172.21.15.107:0/3969642647 >> 172.21.15.107:0/3969642647 conn(0x7f1f4c0fbca0 msgr2=0x7f1f4c0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:32.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.857+0000 7f1f515ff700 1 -- 172.21.15.107:0/3969642647 shutdown_connections 2023-08-10T10:48:32.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.857+0000 7f1f515ff700 1 -- 172.21.15.107:0/3969642647 wait complete. 2023-08-10T10:48:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.858+0000 7f1f515ff700 1 Processor -- start 2023-08-10T10:48:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.858+0000 7f1f515ff700 1 -- start start 2023-08-10T10:48:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.858+0000 7f1f515ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c100770 0x7f1f4c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.858+0000 7f1f515ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c101960 0x7f1f4c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.858+0000 7f1f515ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f4c102300 0x7f1f4c19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.858+0000 7f1f515ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1a0130 con 0x7f1f4c101960 2023-08-10T10:48:32.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.858+0000 7f1f515ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1a0270 con 0x7f1f4c100770 2023-08-10T10:48:32.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.858+0000 7f1f515ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1a0400 con 0x7f1f4c102300 2023-08-10T10:48:32.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4a7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c101960 0x7f1f4c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:32.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c100770 0x7f1f4c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:32.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c100770 0x7f1f4c1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:50642/0 (socket says 172.21.15.107:50642) 2023-08-10T10:48:32.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4affd700 1 -- 172.21.15.107:0/2664462362 learned_addr learned my addr 172.21.15.107:0/2664462362 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:32.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4b7fe700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f4c102300 0x7f1f4c19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4a7fc700 1 -- 172.21.15.107:0/2664462362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f4c102300 msgr2=0x7f1f4c19fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4a7fc700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f4c102300 0x7f1f4c19fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4a7fc700 1 -- 172.21.15.107:0/2664462362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c100770 msgr2=0x7f1f4c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4a7fc700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c100770 0x7f1f4c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4a7fc700 1 -- 172.21.15.107:0/2664462362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0095f0 con 0x7f1f4c101960 2023-08-10T10:48:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4affd700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c100770 0x7f1f4c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.859+0000 7f1f4a7fc700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c101960 0x7f1f4c198af0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000d950 tx=0x7f1f4000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.860+0000 7f1f33fff700 1 -- 172.21.15.107:0/2664462362 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000f890 con 0x7f1f4c101960 2023-08-10T10:48:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.860+0000 7f1f33fff700 1 -- 172.21.15.107:0/2664462362 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f4000fe80 con 0x7f1f4c101960 2023-08-10T10:48:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.860+0000 7f1f33fff700 1 -- 172.21.15.107:0/2664462362 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000e3b0 con 0x7f1f4c101960 2023-08-10T10:48:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.860+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c1a06e0 con 0x7f1f4c101960 2023-08-10T10:48:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.860+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c1a0bf0 con 0x7f1f4c101960 2023-08-10T10:48:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.861+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c192c80 con 0x7f1f4c101960 2023-08-10T10:48:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.863+0000 7f1f33fff700 1 -- 172.21.15.107:0/2664462362 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f1f4000f9f0 con 0x7f1f4c101960 2023-08-10T10:48:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.864+0000 7f1f33fff700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f340a1220 0x7f1f340a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.864+0000 7f1f33fff700 1 -- 172.21.15.107:0/2664462362 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1f400cc190 con 0x7f1f4c101960 2023-08-10T10:48:32.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.864+0000 7f1f4affd700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f340a1220 0x7f1f340a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:32.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.865+0000 7f1f4affd700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f340a1220 0x7f1f340a36e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c010 tx=0x7f1f3c009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:32.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:32.868+0000 7f1f33fff700 1 -- 172.21.15.107:0/2664462362 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1f40095ce0 con 0x7f1f4c101960 2023-08-10T10:48:32.973 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:32 smithi107 ceph-mon[127953]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:33.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:32 smithi157 ceph-mon[129604]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:33.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.123+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f4c02c970 con 0x7f1f4c101960 2023-08-10T10:48:33.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.124+0000 7f1f33fff700 1 -- 172.21.15.107:0/2664462362 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8100 (secure 0 0 0) 0x7f1f40099300 con 0x7f1f4c101960 2023-08-10T10:48:33.126 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:33.126 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14670,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24571,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-08-10T10:48:33.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f340a1220 msgr2=0x7f1f340a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:33.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f340a1220 0x7f1f340a36e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c010 tx=0x7f1f3c009f10 comp rx=0 tx=0).stop 2023-08-10T10:48:33.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c101960 msgr2=0x7f1f4c198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c101960 0x7f1f4c198af0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000d950 tx=0x7f1f4000dc60 comp rx=0 tx=0).stop 2023-08-10T10:48:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 shutdown_connections 2023-08-10T10:48:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f340a1220 0x7f1f340a36e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c100770 0x7f1f4c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:33.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f4c102300 0x7f1f4c19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:33.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 --2- 172.21.15.107:0/2664462362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f4c101960 0x7f1f4c198af0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:33.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 >> 172.21.15.107:0/2664462362 conn(0x7f1f4c0fbca0 msgr2=0x7f1f4c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:33.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 shutdown_connections 2023-08-10T10:48:33.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:33.128+0000 7f1f515ff700 1 -- 172.21.15.107:0/2664462362 wait complete. 2023-08-10T10:48:33.133 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 11 2023-08-10T10:48:33.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:32 smithi195 ceph-mon[129938]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:33.327 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 10:48:32 smithi107 systemd[1]: Starting Ceph mds.a for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:33.715 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 10:48:33 smithi107 podman[162259]: 2023-08-10T10:48:33.715 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 10:48:33 smithi107 bash[162259]: f70181fcdfd84382295a066b14634e715822a5367d040b5ece2e59cabf6a508f 2023-08-10T10:48:34.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:33 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2664462362' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:33 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2664462362' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:34.078 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 10:48:33 smithi107 ceph-mds[162299]: -- 172.21.15.107:0/3477083424 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a0bd1731e0 con 0x55a0bd148c00 2023-08-10T10:48:34.078 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 10:48:33 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-a[162275]: starting mds.a at 2023-08-10T10:48:34.078 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 10:48:33 smithi107 systemd[1]: Started Ceph mds.a for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:34.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:33 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2664462362' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:35.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:35.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:35.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:35.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:35.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:35.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:35.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:35.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: Deploying daemon mds.b on smithi157 2023-08-10T10:48:35.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.107:6840/718281985,v1:172.21.15.107:6841/718281985] up:boot 2023-08-10T10:48:35.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: fsmap 11 up:standby 2023-08-10T10:48:35.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:34 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T10:48:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:35.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:35.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:35.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: Deploying daemon mds.b on smithi157 2023-08-10T10:48:35.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.107:6840/718281985,v1:172.21.15.107:6841/718281985] up:boot 2023-08-10T10:48:35.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: fsmap 11 up:standby 2023-08-10T10:48:35.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:34 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T10:48:35.149 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:35.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-08-10T10:48:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-08-10T10:48:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:35.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: Deploying daemon mds.b on smithi157 2023-08-10T10:48:35.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.107:6840/718281985,v1:172.21.15.107:6841/718281985] up:boot 2023-08-10T10:48:35.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: fsmap 11 up:standby 2023-08-10T10:48:35.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:34 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T10:48:35.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.360+0000 7fa28abff700 1 -- 172.21.15.107:0/3095252757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 msgr2=0x7fa284101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:35.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.360+0000 7fa28abff700 1 --2- 172.21.15.107:0/3095252757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 0x7fa284101dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa2700099c0 tx=0x7fa270009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.360+0000 7fa28abff700 1 -- 172.21.15.107:0/3095252757 shutdown_connections 2023-08-10T10:48:35.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.360+0000 7fa28abff700 1 --2- 172.21.15.107:0/3095252757 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa284102300 0x7fa284108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.360+0000 7fa28abff700 1 --2- 172.21.15.107:0/3095252757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa284100770 0x7fa284100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.360+0000 7fa28abff700 1 --2- 172.21.15.107:0/3095252757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 0x7fa284101dc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.360+0000 7fa28abff700 1 -- 172.21.15.107:0/3095252757 >> 172.21.15.107:0/3095252757 conn(0x7fa2840fbca0 msgr2=0x7fa2840fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.360+0000 7fa28abff700 1 -- 172.21.15.107:0/3095252757 shutdown_connections 2023-08-10T10:48:35.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.360+0000 7fa28abff700 1 -- 172.21.15.107:0/3095252757 wait complete. 2023-08-10T10:48:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.361+0000 7fa28abff700 1 Processor -- start 2023-08-10T10:48:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.361+0000 7fa28abff700 1 -- start start 2023-08-10T10:48:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa28abff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa284100770 0x7fa284198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa28abff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 0x7fa284198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:35.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa28abff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa284102300 0x7fa28419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:35.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa28abff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2841a0100 con 0x7fa284101960 2023-08-10T10:48:35.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa28abff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2841a0240 con 0x7fa284100770 2023-08-10T10:48:35.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa28abff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2841a03d0 con 0x7fa284102300 2023-08-10T10:48:35.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa283fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 0x7fa284198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:35.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa283fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 0x7fa284198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52168/0 (socket says 172.21.15.107:52168) 2023-08-10T10:48:35.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa283fff700 1 -- 172.21.15.107:0/2993527904 learned_addr learned my addr 172.21.15.107:0/2993527904 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:35.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa28899b700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa284100770 0x7fa284198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:35.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa28919c700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa284102300 0x7fa28419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:35.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa283fff700 1 -- 172.21.15.107:0/2993527904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa284102300 msgr2=0x7fa28419fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:35.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa283fff700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa284102300 0x7fa28419fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa283fff700 1 -- 172.21.15.107:0/2993527904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa284100770 msgr2=0x7fa284198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:35.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa283fff700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa284100770 0x7fa284198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa283fff700 1 -- 172.21.15.107:0/2993527904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2700095f0 con 0x7fa284101960 2023-08-10T10:48:35.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.362+0000 7fa283fff700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 0x7fa284198ac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa270005910 tx=0x7fa270003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:35.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.363+0000 7fa281ffb700 1 -- 172.21.15.107:0/2993527904 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27001d070 con 0x7fa284101960 2023-08-10T10:48:35.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.363+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2841a0650 con 0x7fa284101960 2023-08-10T10:48:35.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.363+0000 7fa281ffb700 1 -- 172.21.15.107:0/2993527904 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa27000bd30 con 0x7fa284101960 2023-08-10T10:48:35.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.363+0000 7fa281ffb700 1 -- 172.21.15.107:0/2993527904 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270022cb0 con 0x7fa284101960 2023-08-10T10:48:35.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.363+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2841a0a70 con 0x7fa284101960 2023-08-10T10:48:35.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.364+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa284192c80 con 0x7fa284101960 2023-08-10T10:48:35.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.366+0000 7fa281ffb700 1 -- 172.21.15.107:0/2993527904 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fa270022470 con 0x7fa284101960 2023-08-10T10:48:35.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.367+0000 7fa281ffb700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa2740a11a0 0x7fa2740a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:35.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.367+0000 7fa281ffb700 1 -- 172.21.15.107:0/2993527904 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa2700ce210 con 0x7fa284101960 2023-08-10T10:48:35.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.367+0000 7fa28899b700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa2740a11a0 0x7fa2740a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.368+0000 7fa28899b700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa2740a11a0 0x7fa2740a3660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2841017c0 tx=0x7fa278007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.369+0000 7fa281ffb700 1 -- 172.21.15.107:0/2993527904 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa270097df0 con 0x7fa284101960 2023-08-10T10:48:35.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.609+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa28402c970 con 0x7fa284101960 2023-08-10T10:48:35.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.610+0000 7fa281ffb700 1 -- 172.21.15.107:0/2993527904 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8858 (secure 0 0 0) 0x7fa27009b410 con 0x7fa284101960 2023-08-10T10:48:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:35.611 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14670,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24571,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-08-10T10:48:35.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa2740a11a0 msgr2=0x7fa2740a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:35.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa2740a11a0 0x7fa2740a3660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa2841017c0 tx=0x7fa278007400 comp rx=0 tx=0).stop 2023-08-10T10:48:35.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 msgr2=0x7fa284198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:35.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 0x7fa284198ac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa270005910 tx=0x7fa270003a50 comp rx=0 tx=0).stop 2023-08-10T10:48:35.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 shutdown_connections 2023-08-10T10:48:35.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa2740a11a0 0x7fa2740a3660 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa284100770 0x7fa284198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa284102300 0x7fa28419fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 --2- 172.21.15.107:0/2993527904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa284101960 0x7fa284198ac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:35.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 >> 172.21.15.107:0/2993527904 conn(0x7fa2840fbca0 msgr2=0x7fa284107280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:35.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 shutdown_connections 2023-08-10T10:48:35.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:35.612+0000 7fa28abff700 1 -- 172.21.15.107:0/2993527904 wait complete. 2023-08-10T10:48:35.615 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 12 2023-08-10T10:48:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:35 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2993527904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:36.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:35 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2993527904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:36.164 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:35 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2993527904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:36.538 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:48:36 smithi157 systemd[1]: Starting Ceph mds.b for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T10:48:36.903 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:36 smithi157 ceph-mon[129604]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:36.903 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:48:36 smithi157 podman[155051]: 2023-08-10T10:48:36.904 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:48:36 smithi157 bash[155051]: 82b9b8bd815c318b87262d762589d3f5207f54e4f7197732b357199f400d7ce3 2023-08-10T10:48:37.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:36 smithi195 ceph-mon[129938]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:37.288 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:48:36 smithi157 ceph-mds[155091]: -- 172.21.15.157:0/4020821532 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56521ec071e0 con 0x56521ebdd000 2023-08-10T10:48:37.289 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:48:36 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-b[155067]: starting mds.b at 2023-08-10T10:48:37.289 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:48:36 smithi157 systemd[1]: Started Ceph mds.b for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T10:48:37.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:36 smithi107 ceph-mon[127953]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:37.633 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:37.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.837+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2106523379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 msgr2=0x7fe0a8105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:37.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.837+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2106523379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 0x7fe0a8105fc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe0980098f0 tx=0x7fe098009c00 comp rx=0 tx=0).stop 2023-08-10T10:48:37.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.837+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2106523379 shutdown_connections 2023-08-10T10:48:37.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.837+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2106523379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a81012a0 0x7fe0a8103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:37.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.837+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2106523379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0a8106500 0x7fe0a81088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:37.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.837+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2106523379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 0x7fe0a8105fc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:37.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.837+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2106523379 >> 172.21.15.107:0/2106523379 conn(0x7fe0a80fabd0 msgr2=0x7fe0a80fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:37.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.837+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2106523379 shutdown_connections 2023-08-10T10:48:37.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.837+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2106523379 wait complete. 2023-08-10T10:48:37.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.838+0000 7fe0b01ff700 1 Processor -- start 2023-08-10T10:48:37.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.838+0000 7fe0b01ff700 1 -- start start 2023-08-10T10:48:37.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.838+0000 7fe0b01ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a81012a0 0x7fe0a8198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:37.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.838+0000 7fe0b01ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 0x7fe0a8198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:37.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.838+0000 7fe0b01ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0a8106500 0x7fe0a819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:37.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.838+0000 7fe0b01ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81a0110 con 0x7fe0a8103bd0 2023-08-10T10:48:37.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.838+0000 7fe0b01ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81a0250 con 0x7fe0a81012a0 2023-08-10T10:48:37.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.838+0000 7fe0b01ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81a03e0 con 0x7fe0a8106500 2023-08-10T10:48:37.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0ad79a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 0x7fe0a8198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:37.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0ad79a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 0x7fe0a8198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52186/0 (socket says 172.21.15.107:52186) 2023-08-10T10:48:37.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0ad79a700 1 -- 172.21.15.107:0/2539333623 learned_addr learned my addr 172.21.15.107:0/2539333623 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:37.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0adf9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a81012a0 0x7fe0a8198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:37.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0ad79a700 1 -- 172.21.15.107:0/2539333623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0a8106500 msgr2=0x7fe0a819fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:37.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0ad79a700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0a8106500 0x7fe0a819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:37.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0ad79a700 1 -- 172.21.15.107:0/2539333623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a81012a0 msgr2=0x7fe0a8198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:37.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0ad79a700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a81012a0 0x7fe0a8198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:37.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0ad79a700 1 -- 172.21.15.107:0/2539333623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40095f0 con 0x7fe0a8103bd0 2023-08-10T10:48:37.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe0ad79a700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 0x7fe0a8198ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe098009fd0 tx=0x7fe09800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:37.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe09effd700 1 -- 172.21.15.107:0/2539333623 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09801c070 con 0x7fe0a8103bd0 2023-08-10T10:48:37.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.839+0000 7fe09effd700 1 -- 172.21.15.107:0/2539333623 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe09800f7b0 con 0x7fe0a8103bd0 2023-08-10T10:48:37.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.840+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe098009520 con 0x7fe0a8103bd0 2023-08-10T10:48:37.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.840+0000 7fe09effd700 1 -- 172.21.15.107:0/2539333623 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980049c0 con 0x7fe0a8103bd0 2023-08-10T10:48:37.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.840+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a81a0950 con 0x7fe0a8103bd0 2023-08-10T10:48:37.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.841+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a8108080 con 0x7fe0a8103bd0 2023-08-10T10:48:37.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.842+0000 7fe09effd700 1 -- 172.21.15.107:0/2539333623 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe098020070 con 0x7fe0a8103bd0 2023-08-10T10:48:37.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.844+0000 7fe09effd700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0940a1220 0x7fe0940a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:37.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.844+0000 7fe09effd700 1 -- 172.21.15.107:0/2539333623 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe0980cd1d0 con 0x7fe0a8103bd0 2023-08-10T10:48:37.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.844+0000 7fe0adf9b700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0940a1220 0x7fe0940a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:37.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.844+0000 7fe0adf9b700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0940a1220 0x7fe0940a36e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4005fd0 tx=0x7fe0a4009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:37.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:37.847+0000 7fe09effd700 1 -- 172.21.15.107:0/2539333623 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe098096db0 con 0x7fe0a8103bd0 2023-08-10T10:48:38.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.103+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0a802ce00 con 0x7fe0a8103bd0 2023-08-10T10:48:38.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.103+0000 7fe09effd700 1 -- 172.21.15.107:0/2539333623 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9619 (secure 0 0 0) 0x7fe09809a3d0 con 0x7fe0a8103bd0 2023-08-10T10:48:38.105 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:38.105 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14670,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24571,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24575,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-08-10T10:48:38.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0940a1220 msgr2=0x7fe0940a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0940a1220 0x7fe0940a36e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4005fd0 tx=0x7fe0a4009310 comp rx=0 tx=0).stop 2023-08-10T10:48:38.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 msgr2=0x7fe0a8198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 0x7fe0a8198ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe098009fd0 tx=0x7fe09800b790 comp rx=0 tx=0).stop 2023-08-10T10:48:38.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 shutdown_connections 2023-08-10T10:48:38.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe0940a1220 0x7fe0940a36e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0a81012a0 0x7fe0a8198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0a8106500 0x7fe0a819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 --2- 172.21.15.107:0/2539333623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0a8103bd0 0x7fe0a8198ad0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.106+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 >> 172.21.15.107:0/2539333623 conn(0x7fe0a80fabd0 msgr2=0x7fe0a80ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.107+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 shutdown_connections 2023-08-10T10:48:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.107+0000 7fe0b01ff700 1 -- 172.21.15.107:0/2539333623 wait complete. 2023-08-10T10:48:38.109 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 13 2023-08-10T10:48:38.128 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:48:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:38 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:38 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:38 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:38 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:38 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:38 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:48:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:38 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] up:boot 2023-08-10T10:48:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:38 smithi157 ceph-mon[129604]: fsmap 12 up:standby 2023-08-10T10:48:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:38 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T10:48:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:38 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:38 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:38 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:38 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:38 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:38 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:48:38.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:38 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] up:boot 2023-08-10T10:48:38.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:38 smithi107 ceph-mon[127953]: fsmap 12 up:standby 2023-08-10T10:48:38.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:38 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T10:48:38.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.338+0000 7fd5f5bff700 1 -- 172.21.15.107:0/4104511346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f010eff0 msgr2=0x7fd5f01113e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.338+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/4104511346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f010eff0 0x7fd5f01113e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800b0a0 tx=0x7fd5e800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.338+0000 7fd5f5bff700 1 -- 172.21.15.107:0/4104511346 shutdown_connections 2023-08-10T10:48:38.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.338+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/4104511346 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f0107770 0x7fd5f0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.338+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/4104511346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f010eff0 0x7fd5f01113e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.338+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/4104511346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5f01080d0 0x7fd5f010eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.338+0000 7fd5f5bff700 1 -- 172.21.15.107:0/4104511346 >> 172.21.15.107:0/4104511346 conn(0x7fd5f006d910 msgr2=0x7fd5f006fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:38.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.338+0000 7fd5f5bff700 1 -- 172.21.15.107:0/4104511346 shutdown_connections 2023-08-10T10:48:38.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.338+0000 7fd5f5bff700 1 -- 172.21.15.107:0/4104511346 wait complete. 2023-08-10T10:48:38.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.339+0000 7fd5f5bff700 1 Processor -- start 2023-08-10T10:48:38.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.339+0000 7fd5f5bff700 1 -- start start 2023-08-10T10:48:38.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.339+0000 7fd5f5bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f0107770 0x7fd5f01a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:38.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.339+0000 7fd5f5bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f01080d0 0x7fd5f01a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:38.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.339+0000 7fd5f5bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5f010eff0 0x7fd5f01a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:38.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.339+0000 7fd5f5bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01a8a00 con 0x7fd5f01080d0 2023-08-10T10:48:38.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.339+0000 7fd5f5bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01a8b40 con 0x7fd5f0107770 2023-08-10T10:48:38.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.339+0000 7fd5f5bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01a8cd0 con 0x7fd5f010eff0 2023-08-10T10:48:38.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5eeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f01080d0 0x7fd5f01a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:38.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5ef7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f0107770 0x7fd5f01a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:38.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5ef7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f0107770 0x7fd5f01a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:56498/0 (socket says 172.21.15.107:56498) 2023-08-10T10:48:38.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5ef7fe700 1 -- 172.21.15.107:0/1114905220 learned_addr learned my addr 172.21.15.107:0/1114905220 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:38.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5effff700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5f010eff0 0x7fd5f01a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:38.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5ef7fe700 1 -- 172.21.15.107:0/1114905220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5f010eff0 msgr2=0x7fd5f01a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5ef7fe700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5f010eff0 0x7fd5f01a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5ef7fe700 1 -- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f01080d0 msgr2=0x7fd5f01a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5ef7fe700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f01080d0 0x7fd5f01a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5ef7fe700 1 -- 172.21.15.107:0/1114905220 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e8009d00 con 0x7fd5f0107770 2023-08-10T10:48:38.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5eeffd700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f01080d0 0x7fd5f01a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:38.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.340+0000 7fd5ef7fe700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f0107770 0x7fd5f01a0e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000e9a0 tx=0x7fd5e000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:38.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.341+0000 7fd5ecff9700 1 -- 172.21.15.107:0/1114905220 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0009790 con 0x7fd5f0107770 2023-08-10T10:48:38.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.341+0000 7fd5ecff9700 1 -- 172.21.15.107:0/1114905220 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5e0010430 con 0x7fd5f0107770 2023-08-10T10:48:38.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.341+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f01a8fb0 con 0x7fd5f0107770 2023-08-10T10:48:38.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.341+0000 7fd5ecff9700 1 -- 172.21.15.107:0/1114905220 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000cea0 con 0x7fd5f0107770 2023-08-10T10:48:38.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.341+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f01a9450 con 0x7fd5f0107770 2023-08-10T10:48:38.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.342+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f0114680 con 0x7fd5f0107770 2023-08-10T10:48:38.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.344+0000 7fd5ecff9700 1 -- 172.21.15.107:0/1114905220 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd5e00105a0 con 0x7fd5f0107770 2023-08-10T10:48:38.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.346+0000 7fd5ecff9700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd5d80a11a0 0x7fd5d80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:38.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.346+0000 7fd5ecff9700 1 -- 172.21.15.107:0/1114905220 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd5e0014070 con 0x7fd5f0107770 2023-08-10T10:48:38.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.347+0000 7fd5eeffd700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd5d80a11a0 0x7fd5d80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:38.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.347+0000 7fd5eeffd700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd5d80a11a0 0x7fd5d80a3660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009de0 tx=0x7fd5e4009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:38.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.348+0000 7fd5ecff9700 1 -- 172.21.15.107:0/1114905220 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd5e0096180 con 0x7fd5f0107770 2023-08-10T10:48:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:38 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:38 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:38 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:38 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:38 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:38.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:38 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:48:38.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:38 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] up:boot 2023-08-10T10:48:38.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:38 smithi195 ceph-mon[129938]: fsmap 12 up:standby 2023-08-10T10:48:38.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:38 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T10:48:38.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.566+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5f01a9a60 con 0x7fd5f0107770 2023-08-10T10:48:38.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.567+0000 7fd5ecff9700 1 -- 172.21.15.107:0/1114905220 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18479 (secure 0 0 0) 0x7fd5e00997a0 con 0x7fd5f0107770 2023-08-10T10:48:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:38.569 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":81,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:47:46.643997+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:48:38.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd5d80a11a0 msgr2=0x7fd5d80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd5d80a11a0 0x7fd5d80a3660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009de0 tx=0x7fd5e4009190 comp rx=0 tx=0).stop 2023-08-10T10:48:38.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f0107770 msgr2=0x7fd5f01a0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f0107770 0x7fd5f01a0e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000e9a0 tx=0x7fd5e000ecb0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 shutdown_connections 2023-08-10T10:48:38.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd5d80a11a0 0x7fd5d80a3660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f0107770 0x7fd5f01a0e80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5f010eff0 0x7fd5f01a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 --2- 172.21.15.107:0/1114905220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd5f01080d0 0x7fd5f01a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 >> 172.21.15.107:0/1114905220 conn(0x7fd5f006d910 msgr2=0x7fd5f006fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:38.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 shutdown_connections 2023-08-10T10:48:38.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.570+0000 7fd5f5bff700 1 -- 172.21.15.107:0/1114905220 wait complete. 2023-08-10T10:48:38.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:48:38.590 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:48:38.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.810+0000 7f1a3259d700 1 -- 172.21.15.107:0/149167530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a2c1017d0 msgr2=0x7f1a2c101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.810+0000 7f1a3259d700 1 --2- 172.21.15.107:0/149167530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a2c1017d0 0x7f1a2c101c30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0099c0 tx=0x7f1a1c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.811+0000 7f1a3259d700 1 -- 172.21.15.107:0/149167530 shutdown_connections 2023-08-10T10:48:38.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.811+0000 7f1a3259d700 1 --2- 172.21.15.107:0/149167530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c1005e0 0x7f1a2c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.811+0000 7f1a3259d700 1 --2- 172.21.15.107:0/149167530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a2c102170 0x7f1a2c108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.811+0000 7f1a3259d700 1 --2- 172.21.15.107:0/149167530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a2c1017d0 0x7f1a2c101c30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.811+0000 7f1a3259d700 1 -- 172.21.15.107:0/149167530 >> 172.21.15.107:0/149167530 conn(0x7f1a2c0fbb50 msgr2=0x7f1a2c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:38.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.811+0000 7f1a3259d700 1 -- 172.21.15.107:0/149167530 shutdown_connections 2023-08-10T10:48:38.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.811+0000 7f1a3259d700 1 -- 172.21.15.107:0/149167530 wait complete. 2023-08-10T10:48:38.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3259d700 1 Processor -- start 2023-08-10T10:48:38.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3259d700 1 -- start start 2023-08-10T10:48:38.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3259d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a2c1005e0 0x7f1a2c196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:38.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3259d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c1017d0 0x7f1a2c196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:38.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3259d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a2c102170 0x7f1a2c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:38.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3259d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c19dcd0 con 0x7f1a2c1005e0 2023-08-10T10:48:38.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3259d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c19de10 con 0x7f1a2c1017d0 2023-08-10T10:48:38.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3259d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c19dfa0 con 0x7f1a2c102170 2023-08-10T10:48:38.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3159b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a2c1005e0 0x7f1a2c196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:38.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.812+0000 7f1a3159b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a2c1005e0 0x7f1a2c196150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52230/0 (socket says 172.21.15.107:52230) 2023-08-10T10:48:38.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a30d9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c1017d0 0x7f1a2c196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:38.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a31d9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a2c102170 0x7f1a2c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:38.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a3159b700 1 -- 172.21.15.107:0/22836490 learned_addr learned my addr 172.21.15.107:0/22836490 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:38.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a31d9c700 1 -- 172.21.15.107:0/22836490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c1017d0 msgr2=0x7f1a2c196690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a31d9c700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c1017d0 0x7f1a2c196690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a31d9c700 1 -- 172.21.15.107:0/22836490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a2c1005e0 msgr2=0x7f1a2c196150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:38.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a31d9c700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a2c1005e0 0x7f1a2c196150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:38.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a31d9c700 1 -- 172.21.15.107:0/22836490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c0095f0 con 0x7f1a2c102170 2023-08-10T10:48:38.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a31d9c700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a2c102170 0x7f1a2c19d700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400efc0 tx=0x7f1a2400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:38.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a227fc700 1 -- 172.21.15.107:0/22836490 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24018070 con 0x7f1a2c102170 2023-08-10T10:48:38.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a227fc700 1 -- 172.21.15.107:0/22836490 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a2400f040 con 0x7f1a2c102170 2023-08-10T10:48:38.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.813+0000 7f1a227fc700 1 -- 172.21.15.107:0/22836490 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400cba0 con 0x7f1a2c102170 2023-08-10T10:48:38.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.814+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c19e220 con 0x7f1a2c102170 2023-08-10T10:48:38.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.814+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c19e6e0 con 0x7f1a2c102170 2023-08-10T10:48:38.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.815+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c10bd00 con 0x7f1a2c102170 2023-08-10T10:48:38.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.818+0000 7f1a227fc700 1 -- 172.21.15.107:0/22836490 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f1a24003a00 con 0x7f1a2c102170 2023-08-10T10:48:38.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.819+0000 7f1a227fc700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a180a1270 0x7f1a180a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:38.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.819+0000 7f1a227fc700 1 -- 172.21.15.107:0/22836490 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1a240cbf50 con 0x7f1a2c102170 2023-08-10T10:48:38.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.820+0000 7f1a3159b700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a180a1270 0x7f1a180a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:38.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.820+0000 7f1a3159b700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a180a1270 0x7f1a180a3730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a28005950 tx=0x7f1a28009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:38.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:38.824+0000 7f1a227fc700 1 -- 172.21.15.107:0/22836490 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1a24095b30 con 0x7f1a2c102170 2023-08-10T10:48:39.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.036+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a2c19ed20 con 0x7f1a2c102170 2023-08-10T10:48:39.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.036+0000 7f1a227fc700 1 -- 172.21.15.107:0/22836490 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a24099150 con 0x7f1a2c102170 2023-08-10T10:48:39.037 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:48:39.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a180a1270 msgr2=0x7f1a180a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a180a1270 0x7f1a180a3730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a28005950 tx=0x7f1a28009260 comp rx=0 tx=0).stop 2023-08-10T10:48:39.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a2c102170 msgr2=0x7f1a2c19d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a2c102170 0x7f1a2c19d700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400efc0 tx=0x7f1a2400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 shutdown_connections 2023-08-10T10:48:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a180a1270 0x7f1a180a3730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a2c102170 0x7f1a2c19d700 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a2c1005e0 0x7f1a2c196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 --2- 172.21.15.107:0/22836490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a2c1017d0 0x7f1a2c196690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 >> 172.21.15.107:0/22836490 conn(0x7f1a2c0fbb50 msgr2=0x7f1a2c0fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 shutdown_connections 2023-08-10T10:48:39.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.039+0000 7f1a3259d700 1 -- 172.21.15.107:0/22836490 wait complete. 2023-08-10T10:48:39.058 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:48:39.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.266+0000 7fe8265ff700 1 -- 172.21.15.107:0/302235621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe820102980 msgr2=0x7fe820102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.266+0000 7fe8265ff700 1 --2- 172.21.15.107:0/302235621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe820102980 0x7fe820102da0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8100099c0 tx=0x7fe810009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.266+0000 7fe8265ff700 1 -- 172.21.15.107:0/302235621 shutdown_connections 2023-08-10T10:48:39.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.266+0000 7fe8265ff700 1 --2- 172.21.15.107:0/302235621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe820102980 0x7fe820102da0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.266+0000 7fe8265ff700 1 --2- 172.21.15.107:0/302235621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe820104510 0x7fe82010adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.266+0000 7fe8265ff700 1 --2- 172.21.15.107:0/302235621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe820103b70 0x7fe820103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.266+0000 7fe8265ff700 1 -- 172.21.15.107:0/302235621 >> 172.21.15.107:0/302235621 conn(0x7fe8200fdef0 msgr2=0x7fe820100330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:39.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.267+0000 7fe8265ff700 1 -- 172.21.15.107:0/302235621 shutdown_connections 2023-08-10T10:48:39.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.267+0000 7fe8265ff700 1 -- 172.21.15.107:0/302235621 wait complete. 2023-08-10T10:48:39.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.267+0000 7fe8265ff700 1 Processor -- start 2023-08-10T10:48:39.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe8265ff700 1 -- start start 2023-08-10T10:48:39.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe8265ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe820102980 0x7fe820198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:39.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe8265ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe820103b70 0x7fe820198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:39.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe8265ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe820104510 0x7fe82019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:39.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe8265ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8201a01e0 con 0x7fe820102980 2023-08-10T10:48:39.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe8265ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8201a0320 con 0x7fe820103b70 2023-08-10T10:48:39.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe8265ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8201a04b0 con 0x7fe820104510 2023-08-10T10:48:39.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe820102980 0x7fe820198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:39.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe81ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe820102980 0x7fe820198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52260/0 (socket says 172.21.15.107:52260) 2023-08-10T10:48:39.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe81ffff700 1 -- 172.21.15.107:0/4212615096 learned_addr learned my addr 172.21.15.107:0/4212615096 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:39.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe81f7fe700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe820103b70 0x7fe820198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:39.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.268+0000 7fe824b9c700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe820104510 0x7fe82019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:39.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe81ffff700 1 -- 172.21.15.107:0/4212615096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe820104510 msgr2=0x7fe82019fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe81ffff700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe820104510 0x7fe82019fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe81ffff700 1 -- 172.21.15.107:0/4212615096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe820103b70 msgr2=0x7fe820198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe81ffff700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe820103b70 0x7fe820198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe81ffff700 1 -- 172.21.15.107:0/4212615096 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009c40 con 0x7fe820102980 2023-08-10T10:48:39.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe81ffff700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe820102980 0x7fe820198660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe810000c00 tx=0x7fe81000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:39.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe81d7fa700 1 -- 172.21.15.107:0/4212615096 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81001d070 con 0x7fe820102980 2023-08-10T10:48:39.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8100095f0 con 0x7fe820102980 2023-08-10T10:48:39.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe81d7fa700 1 -- 172.21.15.107:0/4212615096 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe81000fe70 con 0x7fe820102980 2023-08-10T10:48:39.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe81d7fa700 1 -- 172.21.15.107:0/4212615096 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810004b30 con 0x7fe820102980 2023-08-10T10:48:39.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.269+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8201a0a20 con 0x7fe820102980 2023-08-10T10:48:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.270+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82010a010 con 0x7fe820102980 2023-08-10T10:48:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.272+0000 7fe81d7fa700 1 -- 172.21.15.107:0/4212615096 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe810004c90 con 0x7fe820102980 2023-08-10T10:48:39.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.273+0000 7fe81d7fa700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8080a11a0 0x7fe8080a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:39.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.274+0000 7fe81d7fa700 1 -- 172.21.15.107:0/4212615096 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe8100cd230 con 0x7fe820102980 2023-08-10T10:48:39.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.274+0000 7fe81f7fe700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8080a11a0 0x7fe8080a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:39.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.274+0000 7fe81f7fe700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8080a11a0 0x7fe8080a3660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe814009c60 tx=0x7fe814009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:39.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.277+0000 7fe81d7fa700 1 -- 172.21.15.107:0/4212615096 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe810096e10 con 0x7fe820102980 2023-08-10T10:48:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:39 smithi107 ceph-mon[127953]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:39 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2539333623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:39 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1114905220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:39 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/22836490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:48:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:39 smithi195 ceph-mon[129938]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:39 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2539333623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:39 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1114905220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:39 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/22836490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:48:39.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.499+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe82002c970 con 0x7fe820102980 2023-08-10T10:48:39.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.500+0000 7fe81d7fa700 1 -- 172.21.15.107:0/4212615096 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe81009a430 con 0x7fe820102980 2023-08-10T10:48:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:39.502 INFO:teuthology.orchestra.run.smithi107.stdout:[ 2023-08-10T10:48:39.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T10:48:39.503 INFO:teuthology.orchestra.run.smithi107.stdout: "poolnum": 1, 2023-08-10T10:48:39.503 INFO:teuthology.orchestra.run.smithi107.stdout: "poolname": ".mgr" 2023-08-10T10:48:39.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:48:39.503 INFO:teuthology.orchestra.run.smithi107.stdout:] 2023-08-10T10:48:39.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.502+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8080a11a0 msgr2=0x7fe8080a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.502+0000 7fe8265ff700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8080a11a0 0x7fe8080a3660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe814009c60 tx=0x7fe814009260 comp rx=0 tx=0).stop 2023-08-10T10:48:39.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.502+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe820102980 msgr2=0x7fe820198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.502+0000 7fe8265ff700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe820102980 0x7fe820198660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe810000c00 tx=0x7fe81000fa00 comp rx=0 tx=0).stop 2023-08-10T10:48:39.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.502+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 shutdown_connections 2023-08-10T10:48:39.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.502+0000 7fe8265ff700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8080a11a0 0x7fe8080a3660 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.502+0000 7fe8265ff700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe820104510 0x7fe82019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.503+0000 7fe8265ff700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe820102980 0x7fe820198660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.503+0000 7fe8265ff700 1 --2- 172.21.15.107:0/4212615096 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe820103b70 0x7fe820198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.503+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 >> 172.21.15.107:0/4212615096 conn(0x7fe8200fdef0 msgr2=0x7fe820107150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:39.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.503+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 shutdown_connections 2023-08-10T10:48:39.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.503+0000 7fe8265ff700 1 -- 172.21.15.107:0/4212615096 wait complete. 2023-08-10T10:48:39.523 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:48:39.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:48:39.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:39 smithi157 ceph-mon[129604]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:39.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:39 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2539333623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:39 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1114905220' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:39 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/22836490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:48:39.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.735+0000 7eff3ebff700 1 -- 172.21.15.107:0/2363582128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff38101970 msgr2=0x7eff38101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.735+0000 7eff3ebff700 1 --2- 172.21.15.107:0/2363582128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff38101970 0x7eff38101dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff240099c0 tx=0x7eff24009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.735+0000 7eff3ebff700 1 -- 172.21.15.107:0/2363582128 shutdown_connections 2023-08-10T10:48:39.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.735+0000 7eff3ebff700 1 --2- 172.21.15.107:0/2363582128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff38100780 0x7eff38100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.735+0000 7eff3ebff700 1 --2- 172.21.15.107:0/2363582128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff38102310 0x7eff38108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.735+0000 7eff3ebff700 1 --2- 172.21.15.107:0/2363582128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff38101970 0x7eff38101dd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.735+0000 7eff3ebff700 1 -- 172.21.15.107:0/2363582128 >> 172.21.15.107:0/2363582128 conn(0x7eff380fbcf0 msgr2=0x7eff380fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:39.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.735+0000 7eff3ebff700 1 -- 172.21.15.107:0/2363582128 shutdown_connections 2023-08-10T10:48:39.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.735+0000 7eff3ebff700 1 -- 172.21.15.107:0/2363582128 wait complete. 2023-08-10T10:48:39.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.736+0000 7eff3ebff700 1 Processor -- start 2023-08-10T10:48:39.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.737+0000 7eff3ebff700 1 -- start start 2023-08-10T10:48:39.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.737+0000 7eff3ebff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff38100780 0x7eff38074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:39.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.737+0000 7eff3ebff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff38101970 0x7eff38072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:39.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.737+0000 7eff3ebff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff38102310 0x7eff380730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:39.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.737+0000 7eff3ebff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38073840 con 0x7eff38100780 2023-08-10T10:48:39.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.737+0000 7eff3ebff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380739b0 con 0x7eff38101970 2023-08-10T10:48:39.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.737+0000 7eff3ebff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff381a0420 con 0x7eff38102310 2023-08-10T10:48:39.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.737+0000 7eff3c99b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff38100780 0x7eff38074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:39.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff3c99b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff38100780 0x7eff38074520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52280/0 (socket says 172.21.15.107:52280) 2023-08-10T10:48:39.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff3c99b700 1 -- 172.21.15.107:0/1682312401 learned_addr learned my addr 172.21.15.107:0/1682312401 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:39.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff37fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff38101970 0x7eff38072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:39.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff3d19c700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff38102310 0x7eff380730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:39.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff37fff700 1 -- 172.21.15.107:0/1682312401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff38102310 msgr2=0x7eff380730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff37fff700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff38102310 0x7eff380730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff37fff700 1 -- 172.21.15.107:0/1682312401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff38100780 msgr2=0x7eff38074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff37fff700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff38100780 0x7eff38074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff37fff700 1 -- 172.21.15.107:0/1682312401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff240095f0 con 0x7eff38101970 2023-08-10T10:48:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.738+0000 7eff37fff700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff38101970 0x7eff38072b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff24009f50 tx=0x7eff24003a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:39.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.739+0000 7eff35ffb700 1 -- 172.21.15.107:0/1682312401 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2401d070 con 0x7eff38101970 2023-08-10T10:48:39.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.739+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff381a06a0 con 0x7eff38101970 2023-08-10T10:48:39.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.739+0000 7eff35ffb700 1 -- 172.21.15.107:0/1682312401 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff24004220 con 0x7eff38101970 2023-08-10T10:48:39.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.739+0000 7eff35ffb700 1 -- 172.21.15.107:0/1682312401 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24022bf0 con 0x7eff38101970 2023-08-10T10:48:39.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.739+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff381a0b20 con 0x7eff38101970 2023-08-10T10:48:39.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.740+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff38107760 con 0x7eff38101970 2023-08-10T10:48:39.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.742+0000 7eff35ffb700 1 -- 172.21.15.107:0/1682312401 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7eff24022d50 con 0x7eff38101970 2023-08-10T10:48:39.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.743+0000 7eff35ffb700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff280a1150 0x7eff280a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:39.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.743+0000 7eff35ffb700 1 -- 172.21.15.107:0/1682312401 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7eff240cd6e0 con 0x7eff38101970 2023-08-10T10:48:39.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.743+0000 7eff3c99b700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff280a1150 0x7eff280a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:39.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.744+0000 7eff3c99b700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff280a1150 0x7eff280a3610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00bd70 tx=0x7eff2c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.747+0000 7eff35ffb700 1 -- 172.21.15.107:0/1682312401 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7eff240972c0 con 0x7eff38101970 2023-08-10T10:48:39.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:39.955+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7eff3802cd60 con 0x7eff38101970 2023-08-10T10:48:40.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.552+0000 7eff35ffb700 1 -- 172.21.15.107:0/1682312401 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7eff2409a8e0 con 0x7eff38101970 2023-08-10T10:48:40.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.557+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff280a1150 msgr2=0x7eff280a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:40.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.557+0000 7eff3ebff700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff280a1150 0x7eff280a3610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00bd70 tx=0x7eff2c00b4a0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.557+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff38101970 msgr2=0x7eff38072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:40.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.557+0000 7eff3ebff700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff38101970 0x7eff38072b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff24009f50 tx=0x7eff24003a50 comp rx=0 tx=0).stop 2023-08-10T10:48:40.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.558+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 shutdown_connections 2023-08-10T10:48:40.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.558+0000 7eff3ebff700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7eff280a1150 0x7eff280a3610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.558+0000 7eff3ebff700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff38102310 0x7eff380730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.558+0000 7eff3ebff700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7eff38100780 0x7eff38074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.558+0000 7eff3ebff700 1 --2- 172.21.15.107:0/1682312401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff38101970 0x7eff38072b60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.558+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 >> 172.21.15.107:0/1682312401 conn(0x7eff380fbcf0 msgr2=0x7eff380fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:40.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.558+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 shutdown_connections 2023-08-10T10:48:40.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.558+0000 7eff3ebff700 1 -- 172.21.15.107:0/1682312401 wait complete. 2023-08-10T10:48:40.563 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' created 2023-08-10T10:48:40.579 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-08-10T10:48:40.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:40 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4212615096' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-08-10T10:48:40.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.788+0000 7f63a23ff700 1 -- 172.21.15.107:0/1998665102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c102310 msgr2=0x7f639c108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:40.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.788+0000 7f63a23ff700 1 --2- 172.21.15.107:0/1998665102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c102310 0x7f639c108bc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f639400b0d0 tx=0x7f639400b3e0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.788+0000 7f63a23ff700 1 -- 172.21.15.107:0/1998665102 shutdown_connections 2023-08-10T10:48:40.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.788+0000 7f63a23ff700 1 --2- 172.21.15.107:0/1998665102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c102310 0x7f639c108bc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.788+0000 7f63a23ff700 1 --2- 172.21.15.107:0/1998665102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c100780 0x7f639c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.788+0000 7f63a23ff700 1 --2- 172.21.15.107:0/1998665102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f639c101970 0x7f639c101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.788+0000 7f63a23ff700 1 -- 172.21.15.107:0/1998665102 >> 172.21.15.107:0/1998665102 conn(0x7f639c0fbcf0 msgr2=0x7f639c0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:40.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.788+0000 7f63a23ff700 1 -- 172.21.15.107:0/1998665102 shutdown_connections 2023-08-10T10:48:40.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.788+0000 7f63a23ff700 1 -- 172.21.15.107:0/1998665102 wait complete. 2023-08-10T10:48:40.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.789+0000 7f63a23ff700 1 Processor -- start 2023-08-10T10:48:40.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.789+0000 7f63a23ff700 1 -- start start 2023-08-10T10:48:40.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f63a23ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c100780 0x7f639c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:40.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f63a23ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c101970 0x7f639c196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:40.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f63a23ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f639c102310 0x7f639c19d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:40.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f63a23ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c19dfb0 con 0x7f639c100780 2023-08-10T10:48:40.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f63a23ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c19e0f0 con 0x7f639c102310 2023-08-10T10:48:40.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f63a23ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c19e280 con 0x7f639c101970 2023-08-10T10:48:40.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f639bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c100780 0x7f639c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:40.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f639bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c100780 0x7f639c196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52290/0 (socket says 172.21.15.107:52290) 2023-08-10T10:48:40.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f639bfff700 1 -- 172.21.15.107:0/2244164232 learned_addr learned my addr 172.21.15.107:0/2244164232 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:40.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f639b7fe700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c101970 0x7f639c196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:40.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f63a099c700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f639c102310 0x7f639c19d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:40.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f639bfff700 1 -- 172.21.15.107:0/2244164232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c101970 msgr2=0x7f639c196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:40.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f639bfff700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c101970 0x7f639c196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f639bfff700 1 -- 172.21.15.107:0/2244164232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f639c102310 msgr2=0x7f639c19d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:40.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f639bfff700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f639c102310 0x7f639c19d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:40.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.790+0000 7f639bfff700 1 -- 172.21.15.107:0/2244164232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390009520 con 0x7f639c100780 2023-08-10T10:48:40.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.791+0000 7f639bfff700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c100780 0x7f639c196430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f638c00e970 tx=0x7f638c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:40.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.791+0000 7f63997fa700 1 -- 172.21.15.107:0/2244164232 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c009790 con 0x7f639c100780 2023-08-10T10:48:40.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.791+0000 7f63997fa700 1 -- 172.21.15.107:0/2244164232 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f638c00c7e0 con 0x7f639c100780 2023-08-10T10:48:40.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.791+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6394009d00 con 0x7f639c100780 2023-08-10T10:48:40.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.791+0000 7f63997fa700 1 -- 172.21.15.107:0/2244164232 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c003bd0 con 0x7f639c100780 2023-08-10T10:48:40.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.791+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639c19e8e0 con 0x7f639c100780 2023-08-10T10:48:40.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.792+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639c10be50 con 0x7f639c100780 2023-08-10T10:48:40.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.796+0000 7f63997fa700 1 -- 172.21.15.107:0/2244164232 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f638c00c950 con 0x7f639c100780 2023-08-10T10:48:40.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.798+0000 7f63997fa700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f63840a1150 0x7f63840a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:40.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.798+0000 7f63997fa700 1 -- 172.21.15.107:0/2244164232 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f638c014070 con 0x7f639c100780 2023-08-10T10:48:40.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.799+0000 7f639b7fe700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f63840a1150 0x7f63840a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:40.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.799+0000 7f639b7fe700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f63840a1150 0x7f63840a3610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6390009df0 tx=0x7f6390009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:40.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:40.800+0000 7f63997fa700 1 -- 172.21.15.107:0/2244164232 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f638c096390 con 0x7f639c100780 2023-08-10T10:48:40.826 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:40 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4212615096' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-08-10T10:48:40.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:40 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4212615096' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-08-10T10:48:41.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.017+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f639c107680 con 0x7f639c100780 2023-08-10T10:48:41.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.567+0000 7f63997fa700 1 -- 172.21.15.107:0/2244164232 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) v1 ==== 171+0+0 (secure 0 0 0) 0x7f638c0999b0 con 0x7f639c100780 2023-08-10T10:48:41.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.576+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f63840a1150 msgr2=0x7f63840a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:41.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.576+0000 7f63a23ff700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f63840a1150 0x7f63840a3610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6390009df0 tx=0x7f6390009260 comp rx=0 tx=0).stop 2023-08-10T10:48:41.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.576+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c100780 msgr2=0x7f639c196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:41.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.576+0000 7f63a23ff700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c100780 0x7f639c196430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f638c00e970 tx=0x7f638c00ec80 comp rx=0 tx=0).stop 2023-08-10T10:48:41.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.584+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 shutdown_connections 2023-08-10T10:48:41.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.584+0000 7f63a23ff700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f63840a1150 0x7f63840a3610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.584+0000 7f63a23ff700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f639c102310 0x7f639c19d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.584+0000 7f63a23ff700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f639c100780 0x7f639c196430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.584+0000 7f63a23ff700 1 --2- 172.21.15.107:0/2244164232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f639c101970 0x7f639c196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.584+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 >> 172.21.15.107:0/2244164232 conn(0x7f639c0fbcf0 msgr2=0x7f639c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:41.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.588+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 shutdown_connections 2023-08-10T10:48:41.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.590+0000 7f63a23ff700 1 -- 172.21.15.107:0/2244164232 wait complete. 2023-08-10T10:48:41.651 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' created 2023-08-10T10:48:41.652 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:48:41.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:41.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1682312401' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-10T10:48:41.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-10T10:48:41.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-08-10T10:48:41.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: osdmap e82: 12 total, 12 up, 12 in 2023-08-10T10:48:41.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:41 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.872+0000 7f21f49ff700 1 -- 172.21.15.107:0/118514290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 msgr2=0x7f21f0103fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:41.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.872+0000 7f21f49ff700 1 --2- 172.21.15.107:0/118514290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 0x7f21f0103fe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f21e40099c0 tx=0x7f21e4009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.872+0000 7f21f49ff700 1 -- 172.21.15.107:0/118514290 shutdown_connections 2023-08-10T10:48:41.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.872+0000 7f21f49ff700 1 --2- 172.21.15.107:0/118514290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f0102990 0x7f21f0102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.872+0000 7f21f49ff700 1 --2- 172.21.15.107:0/118514290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21f0104520 0x7f21f010add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.872+0000 7f21f49ff700 1 --2- 172.21.15.107:0/118514290 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 0x7f21f0103fe0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.872+0000 7f21f49ff700 1 -- 172.21.15.107:0/118514290 >> 172.21.15.107:0/118514290 conn(0x7f21f00fdf20 msgr2=0x7f21f0100340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:41.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.872+0000 7f21f49ff700 1 -- 172.21.15.107:0/118514290 shutdown_connections 2023-08-10T10:48:41.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.872+0000 7f21f49ff700 1 -- 172.21.15.107:0/118514290 wait complete. 2023-08-10T10:48:41.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.873+0000 7f21f49ff700 1 Processor -- start 2023-08-10T10:48:41.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.873+0000 7f21f49ff700 1 -- start start 2023-08-10T10:48:41.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21f49ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f0102990 0x7f21f01985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:41.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21f49ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 0x7f21f0198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:41.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21f49ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21f0104520 0x7f21f019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:41.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21f49ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f01a0150 con 0x7f21f0103b80 2023-08-10T10:48:41.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21f49ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f01a0290 con 0x7f21f0102990 2023-08-10T10:48:41.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21f49ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f01a0420 con 0x7f21f0104520 2023-08-10T10:48:41.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21edd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 0x7f21f0198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:41.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21edd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 0x7f21f0198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52308/0 (socket says 172.21.15.107:52308) 2023-08-10T10:48:41.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21edd9b700 1 -- 172.21.15.107:0/3750652505 learned_addr learned my addr 172.21.15.107:0/3750652505 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:41.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21eed9d700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21f0104520 0x7f21f019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:41.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21edd9b700 1 -- 172.21.15.107:0/3750652505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21f0104520 msgr2=0x7f21f019fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:41.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21edd9b700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21f0104520 0x7f21f019fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21edd9b700 1 -- 172.21.15.107:0/3750652505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f0102990 msgr2=0x7f21f01985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:41.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21edd9b700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f0102990 0x7f21f01985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:41.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.874+0000 7f21edd9b700 1 -- 172.21.15.107:0/3750652505 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e40095f0 con 0x7f21f0103b80 2023-08-10T10:48:41.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.875+0000 7f21edd9b700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 0x7f21f0198b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000c00 tx=0x7f21e400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:41.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.875+0000 7f21df7fe700 1 -- 172.21.15.107:0/3750652505 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e401d070 con 0x7f21f0103b80 2023-08-10T10:48:41.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.875+0000 7f21df7fe700 1 -- 172.21.15.107:0/3750652505 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21e400fe70 con 0x7f21f0103b80 2023-08-10T10:48:41.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.875+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f01a06a0 con 0x7f21f0103b80 2023-08-10T10:48:41.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.875+0000 7f21df7fe700 1 -- 172.21.15.107:0/3750652505 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e40173f0 con 0x7f21f0103b80 2023-08-10T10:48:41.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.875+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f01a0ac0 con 0x7f21f0103b80 2023-08-10T10:48:41.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.876+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f010e0a0 con 0x7f21f0103b80 2023-08-10T10:48:41.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.878+0000 7f21df7fe700 1 -- 172.21.15.107:0/3750652505 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f21e4022470 con 0x7f21f0103b80 2023-08-10T10:48:41.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.880+0000 7f21df7fe700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f21d80a1150 0x7f21d80a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:41.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.881+0000 7f21df7fe700 1 -- 172.21.15.107:0/3750652505 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f21e40cdb80 con 0x7f21f0103b80 2023-08-10T10:48:41.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.881+0000 7f21ee59c700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f21d80a1150 0x7f21d80a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:41.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.881+0000 7f21ee59c700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f21d80a1150 0x7f21d80a3610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21f01039e0 tx=0x7f21e00096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:41.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:41.883+0000 7f21df7fe700 1 -- 172.21.15.107:0/3750652505 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f21e4097470 con 0x7f21f0103b80 2023-08-10T10:48:41.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:41.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1682312401' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-10T10:48:41.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-10T10:48:41.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-08-10T10:48:41.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: osdmap e82: 12 total, 12 up, 12 in 2023-08-10T10:48:41.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:41.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:41 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1682312401' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-10T10:48:42.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-08-10T10:48:42.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-08-10T10:48:42.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: osdmap e82: 12 total, 12 up, 12 in 2023-08-10T10:48:42.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:41 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.133+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f21f0109930 con 0x7f21f0103b80 2023-08-10T10:48:42.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2244164232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-08-10T10:48:42.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2244164232' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-08-10T10:48:42.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: osdmap e83: 12 total, 12 up, 12 in 2023-08-10T10:48:42.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: pgmap v298: 97 pgs: 6 creating+peering, 1 active+clean, 90 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:42.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:42.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:48:42.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3750652505' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-10T10:48:42.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-08-10T10:48:42.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:42 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:48:42.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.892+0000 7f21df7fe700 1 -- 172.21.15.107:0/3750652505 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f21e409aa90 con 0x7f21f0103b80 2023-08-10T10:48:42.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f21d80a1150 msgr2=0x7f21d80a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:42.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f21d80a1150 0x7f21d80a3610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21f01039e0 tx=0x7f21e00096c0 comp rx=0 tx=0).stop 2023-08-10T10:48:42.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 msgr2=0x7f21f0198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:42.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 0x7f21f0198b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000c00 tx=0x7f21e400fa00 comp rx=0 tx=0).stop 2023-08-10T10:48:42.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 shutdown_connections 2023-08-10T10:48:42.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f21d80a1150 0x7f21d80a3610 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:42.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21f0102990 0x7f21f01985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:42.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21f0104520 0x7f21f019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:42.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 --2- 172.21.15.107:0/3750652505 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f0103b80 0x7f21f0198b10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:42.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.894+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 >> 172.21.15.107:0/3750652505 conn(0x7f21f00fdf20 msgr2=0x7f21f0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:42.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.895+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 shutdown_connections 2023-08-10T10:48:42.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:42.895+0000 7f21f49ff700 1 -- 172.21.15.107:0/3750652505 wait complete. 2023-08-10T10:48:42.898 INFO:teuthology.orchestra.run.smithi107.stderr:new fs with metadata pool 2 and data pool 3 2023-08-10T10:48:42.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2244164232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-08-10T10:48:42.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2244164232' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-08-10T10:48:42.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: osdmap e83: 12 total, 12 up, 12 in 2023-08-10T10:48:42.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: pgmap v298: 97 pgs: 6 creating+peering, 1 active+clean, 90 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:42.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:42.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:48:42.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:42.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3750652505' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-10T10:48:42.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-08-10T10:48:42.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:42 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:48:42.918 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-08-10T10:48:42.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-08-10T10:48:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2244164232' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-08-10T10:48:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2244164232' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-08-10T10:48:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: osdmap e83: 12 total, 12 up, 12 in 2023-08-10T10:48:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: pgmap v298: 97 pgs: 6 creating+peering, 1 active+clean, 90 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:48:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:48:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:43.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3750652505' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-08-10T10:48:43.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-08-10T10:48:43.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:42 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:48:43.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.134+0000 7f5c0fbff700 1 -- 172.21.15.107:0/1400905982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c08104520 msgr2=0x7f5c0810add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:43.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.134+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/1400905982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c08104520 0x7f5c0810add0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009fc0 tx=0x7f5c0000b330 comp rx=0 tx=0).stop 2023-08-10T10:48:43.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.134+0000 7f5c0fbff700 1 -- 172.21.15.107:0/1400905982 shutdown_connections 2023-08-10T10:48:43.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.134+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/1400905982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c08104520 0x7f5c0810add0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.134+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/1400905982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c08102990 0x7f5c08102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.134+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/1400905982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c08103b80 0x7f5c08103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.134+0000 7f5c0fbff700 1 -- 172.21.15.107:0/1400905982 >> 172.21.15.107:0/1400905982 conn(0x7f5c080fdf20 msgr2=0x7f5c08100340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:43.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.135+0000 7f5c0fbff700 1 -- 172.21.15.107:0/1400905982 shutdown_connections 2023-08-10T10:48:43.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.135+0000 7f5c0fbff700 1 -- 172.21.15.107:0/1400905982 wait complete. 2023-08-10T10:48:43.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.136+0000 7f5c0fbff700 1 Processor -- start 2023-08-10T10:48:43.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.136+0000 7f5c0fbff700 1 -- start start 2023-08-10T10:48:43.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0fbff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c08102990 0x7f5c081986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:43.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0fbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c08103b80 0x7f5c08198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:43.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0fbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c08104520 0x7f5c0819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0fbff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c081a0260 con 0x7f5c08102990 2023-08-10T10:48:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0fbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c081a03a0 con 0x7f5c08103b80 2023-08-10T10:48:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0fbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c081a0530 con 0x7f5c08104520 2023-08-10T10:48:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d99b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c08102990 0x7f5c081986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d19a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c08103b80 0x7f5c08198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d99b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c08102990 0x7f5c081986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44760/0 (socket says 172.21.15.107:44760) 2023-08-10T10:48:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d99b700 1 -- 172.21.15.107:0/2921495784 learned_addr learned my addr 172.21.15.107:0/2921495784 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:43.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0e19c700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c08104520 0x7f5c0819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:43.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d99b700 1 -- 172.21.15.107:0/2921495784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c08104520 msgr2=0x7f5c0819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:43.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d99b700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c08104520 0x7f5c0819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d99b700 1 -- 172.21.15.107:0/2921495784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c08103b80 msgr2=0x7f5c08198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:43.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d99b700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c08103b80 0x7f5c08198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d99b700 1 -- 172.21.15.107:0/2921495784 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c00009c40 con 0x7f5c08102990 2023-08-10T10:48:43.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.137+0000 7f5c0d19a700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c08103b80 0x7f5c08198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:43.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.138+0000 7f5c0d99b700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c08102990 0x7f5c081986e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400e970 tx=0x7f5c0400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:43.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.138+0000 7f5bfeffd700 1 -- 172.21.15.107:0/2921495784 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04009790 con 0x7f5c08102990 2023-08-10T10:48:43.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.138+0000 7f5bfeffd700 1 -- 172.21.15.107:0/2921495784 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c0400c7c0 con 0x7f5c08102990 2023-08-10T10:48:43.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.138+0000 7f5bfeffd700 1 -- 172.21.15.107:0/2921495784 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04003b40 con 0x7f5c08102990 2023-08-10T10:48:43.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.138+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c081a0810 con 0x7f5c08102990 2023-08-10T10:48:43.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.138+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c081a0d20 con 0x7f5c08102990 2023-08-10T10:48:43.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.139+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0810e0b0 con 0x7f5c08102990 2023-08-10T10:48:43.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.141+0000 7f5bfeffd700 1 -- 172.21.15.107:0/2921495784 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5c0400c930 con 0x7f5c08102990 2023-08-10T10:48:43.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.143+0000 7f5bfeffd700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5bf40a11d0 0x7f5bf40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:43.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.143+0000 7f5bfeffd700 1 -- 172.21.15.107:0/2921495784 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5c04014070 con 0x7f5c08102990 2023-08-10T10:48:43.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.143+0000 7f5c0d19a700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5bf40a11d0 0x7f5bf40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:43.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.144+0000 7f5c0d19a700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5bf40a11d0 0x7f5bf40a3690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8005fd0 tx=0x7f5bf8009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:43.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.146+0000 7f5bfeffd700 1 -- 172.21.15.107:0/2921495784 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5c04096160 con 0x7f5c08102990 2023-08-10T10:48:43.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.389+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f5c08109890 con 0x7f5c08102990 2023-08-10T10:48:43.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.560+0000 7f5bfeffd700 1 -- 172.21.15.107:0/2921495784 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) v1 ==== 157+0+0 (secure 0 0 0) 0x7f5c04099780 con 0x7f5c08102990 2023-08-10T10:48:43.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5bf40a11d0 msgr2=0x7f5bf40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:43.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5bf40a11d0 0x7f5bf40a3690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8005fd0 tx=0x7f5bf8009310 comp rx=0 tx=0).stop 2023-08-10T10:48:43.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c08102990 msgr2=0x7f5c081986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:43.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c08102990 0x7f5c081986e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400e970 tx=0x7f5c0400ec80 comp rx=0 tx=0).stop 2023-08-10T10:48:43.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 shutdown_connections 2023-08-10T10:48:43.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5bf40a11d0 0x7f5bf40a3690 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c08104520 0x7f5c0819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5c08102990 0x7f5c081986e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 --2- 172.21.15.107:0/2921495784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c08103b80 0x7f5c08198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.563+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 >> 172.21.15.107:0/2921495784 conn(0x7f5c080fdf20 msgr2=0x7f5c081001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:43.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.564+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 shutdown_connections 2023-08-10T10:48:43.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.564+0000 7f5c0fbff700 1 -- 172.21.15.107:0/2921495784 wait complete. 2023-08-10T10:48:43.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:48:43.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.816+0000 7f42481ff700 1 -- 172.21.15.107:0/449842365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4240100780 msgr2=0x7f4240100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:43.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.816+0000 7f42481ff700 1 --2- 172.21.15.107:0/449842365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4240100780 0x7f4240100ba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f423c0098f0 tx=0x7f423c009c00 comp rx=0 tx=0).stop 2023-08-10T10:48:43.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.816+0000 7f42481ff700 1 -- 172.21.15.107:0/449842365 shutdown_connections 2023-08-10T10:48:43.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.816+0000 7f42481ff700 1 --2- 172.21.15.107:0/449842365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4240102310 0x7f4240108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.816+0000 7f42481ff700 1 --2- 172.21.15.107:0/449842365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4240100780 0x7f4240100ba0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.816+0000 7f42481ff700 1 --2- 172.21.15.107:0/449842365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4240101970 0x7f4240101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.816+0000 7f42481ff700 1 -- 172.21.15.107:0/449842365 >> 172.21.15.107:0/449842365 conn(0x7f42400fbcb0 msgr2=0x7f42400fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:43.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.816+0000 7f42481ff700 1 -- 172.21.15.107:0/449842365 shutdown_connections 2023-08-10T10:48:43.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.816+0000 7f42481ff700 1 -- 172.21.15.107:0/449842365 wait complete. 2023-08-10T10:48:43.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.818+0000 7f42481ff700 1 Processor -- start 2023-08-10T10:48:43.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.818+0000 7f42481ff700 1 -- start start 2023-08-10T10:48:43.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.818+0000 7f42481ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4240100780 0x7f4240074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:43.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.818+0000 7f42481ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4240101970 0x7f4240072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:43.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.818+0000 7f42481ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4240102310 0x7f42400730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:43.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.818+0000 7f42481ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4240073840 con 0x7f4240101970 2023-08-10T10:48:43.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.818+0000 7f42481ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42400739b0 con 0x7f4240100780 2023-08-10T10:48:43.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.818+0000 7f42481ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42401a0360 con 0x7f4240102310 2023-08-10T10:48:43.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f4245f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4240100780 0x7f4240074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:43.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424679c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4240102310 0x7f42400730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:43.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424579a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4240101970 0x7f4240072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:43.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424679c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4240102310 0x7f42400730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58804/0 (socket says 172.21.15.107:58804) 2023-08-10T10:48:43.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424679c700 1 -- 172.21.15.107:0/3503813049 learned_addr learned my addr 172.21.15.107:0/3503813049 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:43.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424579a700 1 -- 172.21.15.107:0/3503813049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4240102310 msgr2=0x7f42400730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:43.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424579a700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4240102310 0x7f42400730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424579a700 1 -- 172.21.15.107:0/3503813049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4240100780 msgr2=0x7f4240074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:43.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424579a700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4240100780 0x7f4240074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:43.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424579a700 1 -- 172.21.15.107:0/3503813049 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300095f0 con 0x7f4240101970 2023-08-10T10:48:43.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f4245f9b700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4240100780 0x7f4240074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:43.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f424579a700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4240101970 0x7f4240072b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f423000eb90 tx=0x7f423000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:43.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.819+0000 7f4236ffd700 1 -- 172.21.15.107:0/3503813049 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230009970 con 0x7f4240101970 2023-08-10T10:48:43.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.820+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c009520 con 0x7f4240101970 2023-08-10T10:48:43.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.820+0000 7f4236ffd700 1 -- 172.21.15.107:0/3503813049 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42300044b0 con 0x7f4240101970 2023-08-10T10:48:43.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.820+0000 7f4236ffd700 1 -- 172.21.15.107:0/3503813049 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230003d70 con 0x7f4240101970 2023-08-10T10:48:43.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.820+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42401a0a10 con 0x7f4240101970 2023-08-10T10:48:43.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.821+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424010be50 con 0x7f4240101970 2023-08-10T10:48:43.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.823+0000 7f4236ffd700 1 -- 172.21.15.107:0/3503813049 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4230003f10 con 0x7f4240101970 2023-08-10T10:48:43.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.824+0000 7f4236ffd700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f422c0a11f0 0x7f422c0a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:43.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.824+0000 7f4236ffd700 1 -- 172.21.15.107:0/3503813049 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8205+0+0 (secure 0 0 0) 0x7f4230014070 con 0x7f4240101970 2023-08-10T10:48:43.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.824+0000 7f4245f9b700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f422c0a11f0 0x7f422c0a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:43.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.825+0000 7f4245f9b700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f422c0a11f0 0x7f422c0a36b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f423c005e90 tx=0x7f423c01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:43.826 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:43 smithi107 ceph-mon[127953]: osdmap e84: 12 total, 12 up, 12 in 2023-08-10T10:48:43.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:43 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3750652505' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-08-10T10:48:43.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:43 smithi107 ceph-mon[127953]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-08-10T10:48:43.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:43 smithi107 ceph-mon[127953]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-08-10T10:48:43.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:43 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2921495784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-08-10T10:48:43.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:43.829+0000 7f4236ffd700 1 -- 172.21.15.107:0/3503813049 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4230096490 con 0x7f4240101970 2023-08-10T10:48:43.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:43 smithi195 ceph-mon[129938]: osdmap e84: 12 total, 12 up, 12 in 2023-08-10T10:48:43.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:43 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3750652505' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-08-10T10:48:43.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:43 smithi195 ceph-mon[129938]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-08-10T10:48:43.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:43 smithi195 ceph-mon[129938]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-08-10T10:48:43.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:43 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2921495784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-08-10T10:48:44.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:43 smithi157 ceph-mon[129604]: osdmap e84: 12 total, 12 up, 12 in 2023-08-10T10:48:44.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:43 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3750652505' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-08-10T10:48:44.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:43 smithi157 ceph-mon[129604]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-08-10T10:48:44.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:43 smithi157 ceph-mon[129604]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-08-10T10:48:44.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:43 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2921495784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-08-10T10:48:44.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:44.068+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f42401a1160 con 0x7f4240101970 2023-08-10T10:48:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:44 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2921495784' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-08-10T10:48:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:44 smithi107 ceph-mon[127953]: osdmap e85: 12 total, 12 up, 12 in 2023-08-10T10:48:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:44 smithi107 ceph-mon[127953]: pgmap v301: 97 pgs: 8 creating+activating, 18 creating+peering, 24 active+clean, 47 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2023-08-10T10:48:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:44 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] up:active 2023-08-10T10:48:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:44 smithi107 ceph-mon[127953]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:48:44.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:44 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3503813049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-10T10:48:44.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:44 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2921495784' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-08-10T10:48:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:44 smithi195 ceph-mon[129938]: osdmap e85: 12 total, 12 up, 12 in 2023-08-10T10:48:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:44 smithi195 ceph-mon[129938]: pgmap v301: 97 pgs: 8 creating+activating, 18 creating+peering, 24 active+clean, 47 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2023-08-10T10:48:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:44 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] up:active 2023-08-10T10:48:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:44 smithi195 ceph-mon[129938]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:48:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:44 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3503813049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-10T10:48:45.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:44 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2921495784' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-08-10T10:48:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:44 smithi157 ceph-mon[129604]: osdmap e85: 12 total, 12 up, 12 in 2023-08-10T10:48:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:44 smithi157 ceph-mon[129604]: pgmap v301: 97 pgs: 8 creating+activating, 18 creating+peering, 24 active+clean, 47 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2023-08-10T10:48:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:44 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] up:active 2023-08-10T10:48:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:44 smithi157 ceph-mon[129604]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:48:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:44 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3503813049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-08-10T10:48:45.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.610+0000 7f4236ffd700 1 -- 172.21.15.107:0/3503813049 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) v1 ==== 228+0+0 (secure 0 0 0) 0x7f4230099ab0 con 0x7f4240101970 2023-08-10T10:48:45.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f422c0a11f0 msgr2=0x7f422c0a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:45.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f422c0a11f0 0x7f422c0a36b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f423c005e90 tx=0x7f423c01a040 comp rx=0 tx=0).stop 2023-08-10T10:48:45.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4240101970 msgr2=0x7f4240072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:45.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4240101970 0x7f4240072b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f423000eb90 tx=0x7f423000eea0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 shutdown_connections 2023-08-10T10:48:45.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f422c0a11f0 0x7f422c0a36b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4240100780 0x7f4240074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4240102310 0x7f42400730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 --2- 172.21.15.107:0/3503813049 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4240101970 0x7f4240072b60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 >> 172.21.15.107:0/3503813049 conn(0x7f42400fbcb0 msgr2=0x7f42400fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:45.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 shutdown_connections 2023-08-10T10:48:45.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.617+0000 7f42481ff700 1 -- 172.21.15.107:0/3503813049 wait complete. 2023-08-10T10:48:45.620 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data_ec' created 2023-08-10T10:48:45.646 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-08-10T10:48:45.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.862+0000 7f05df3ff700 1 -- 172.21.15.107:0/3164976568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d80747b0 msgr2=0x7f05d8072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:45.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.862+0000 7f05df3ff700 1 --2- 172.21.15.107:0/3164976568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d80747b0 0x7f05d8072c00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009990 tx=0x7f05d4009ca0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.862+0000 7f05df3ff700 1 -- 172.21.15.107:0/3164976568 shutdown_connections 2023-08-10T10:48:45.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.862+0000 7f05df3ff700 1 --2- 172.21.15.107:0/3164976568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05d810cd50 0x7f05d810f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.862+0000 7f05df3ff700 1 --2- 172.21.15.107:0/3164976568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d80747b0 0x7f05d8072c00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.862+0000 7f05df3ff700 1 --2- 172.21.15.107:0/3164976568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05d80731d0 0x7f05d8073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.862+0000 7f05df3ff700 1 -- 172.21.15.107:0/3164976568 >> 172.21.15.107:0/3164976568 conn(0x7f05d80fbcf0 msgr2=0x7f05d80fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:45.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.862+0000 7f05df3ff700 1 -- 172.21.15.107:0/3164976568 shutdown_connections 2023-08-10T10:48:45.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.862+0000 7f05df3ff700 1 -- 172.21.15.107:0/3164976568 wait complete. 2023-08-10T10:48:45.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.863+0000 7f05df3ff700 1 Processor -- start 2023-08-10T10:48:45.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.863+0000 7f05df3ff700 1 -- start start 2023-08-10T10:48:45.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.863+0000 7f05df3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05d80731d0 0x7f05d819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:45.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.863+0000 7f05df3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05d80747b0 0x7f05d819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:45.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.863+0000 7f05df3ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d810cd50 0x7f05d81a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:45.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.863+0000 7f05df3ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d81a4520 con 0x7f05d810cd50 2023-08-10T10:48:45.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.863+0000 7f05df3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d81a4660 con 0x7f05d80747b0 2023-08-10T10:48:45.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.863+0000 7f05df3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d81a47f0 con 0x7f05d80731d0 2023-08-10T10:48:45.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dc99a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05d80747b0 0x7f05d819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:45.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dd99c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d810cd50 0x7f05d81a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:45.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dd19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05d80731d0 0x7f05d819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:45.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dc99a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05d80747b0 0x7f05d819cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:54174/0 (socket says 172.21.15.107:54174) 2023-08-10T10:48:45.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dc99a700 1 -- 172.21.15.107:0/2869267127 learned_addr learned my addr 172.21.15.107:0/2869267127 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:45.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dc99a700 1 -- 172.21.15.107:0/2869267127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05d80731d0 msgr2=0x7f05d819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:45.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dc99a700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05d80731d0 0x7f05d819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dc99a700 1 -- 172.21.15.107:0/2869267127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d810cd50 msgr2=0x7f05d81a3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:45.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dc99a700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d810cd50 0x7f05d81a3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:45.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dc99a700 1 -- 172.21.15.107:0/2869267127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40095f0 con 0x7f05d80747b0 2023-08-10T10:48:45.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dd19b700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05d80731d0 0x7f05d819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:45.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05dc99a700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05d80747b0 0x7f05d819cee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f05c800e970 tx=0x7f05c800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:45.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.864+0000 7f05ce7fc700 1 -- 172.21.15.107:0/2869267127 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8009790 con 0x7f05d80747b0 2023-08-10T10:48:45.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.865+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d81a4ad0 con 0x7f05d80747b0 2023-08-10T10:48:45.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.865+0000 7f05ce7fc700 1 -- 172.21.15.107:0/2869267127 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05c800c7e0 con 0x7f05d80747b0 2023-08-10T10:48:45.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.865+0000 7f05ce7fc700 1 -- 172.21.15.107:0/2869267127 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8003bd0 con 0x7f05d80747b0 2023-08-10T10:48:45.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.865+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d81a5030 con 0x7f05d80747b0 2023-08-10T10:48:45.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.866+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d81028a0 con 0x7f05d80747b0 2023-08-10T10:48:45.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.867+0000 7f05ce7fc700 1 -- 172.21.15.107:0/2869267127 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f05c800c950 con 0x7f05d80747b0 2023-08-10T10:48:45.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.869+0000 7f05ce7fc700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c40a11d0 0x7f05c40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:45.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.869+0000 7f05ce7fc700 1 -- 172.21.15.107:0/2869267127 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f05c8014070 con 0x7f05d80747b0 2023-08-10T10:48:45.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.869+0000 7f05dd19b700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c40a11d0 0x7f05c40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:45.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.870+0000 7f05dd19b700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c40a11d0 0x7f05c40a3690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f05d40059d0 tx=0x7f05d4005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:45.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:45.873+0000 7f05ce7fc700 1 -- 172.21.15.107:0/2869267127 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f05c8096150 con 0x7f05d80747b0 2023-08-10T10:48:45.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:45 smithi195 ceph-mon[129938]: osdmap e86: 12 total, 12 up, 12 in 2023-08-10T10:48:46.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:45 smithi157 ceph-mon[129604]: osdmap e86: 12 total, 12 up, 12 in 2023-08-10T10:48:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:45 smithi107 ceph-mon[127953]: osdmap e86: 12 total, 12 up, 12 in 2023-08-10T10:48:46.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.079+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f05d8061490 con 0x7f05d80747b0 2023-08-10T10:48:46.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.610+0000 7f05ce7fc700 1 -- 172.21.15.107:0/2869267127 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f05c8016330 con 0x7f05d80747b0 2023-08-10T10:48:46.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.617+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c40a11d0 msgr2=0x7f05c40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:46.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.617+0000 7f05df3ff700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c40a11d0 0x7f05c40a3690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f05d40059d0 tx=0x7f05d4005960 comp rx=0 tx=0).stop 2023-08-10T10:48:46.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.617+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05d80747b0 msgr2=0x7f05d819cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:46.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.617+0000 7f05df3ff700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05d80747b0 0x7f05d819cee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f05c800e970 tx=0x7f05c800ec80 comp rx=0 tx=0).stop 2023-08-10T10:48:46.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.619+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 shutdown_connections 2023-08-10T10:48:46.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.619+0000 7f05df3ff700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c40a11d0 0x7f05c40a3690 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.619+0000 7f05df3ff700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05d810cd50 0x7f05d81a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.619+0000 7f05df3ff700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05d80731d0 0x7f05d819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.619+0000 7f05df3ff700 1 --2- 172.21.15.107:0/2869267127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05d80747b0 0x7f05d819cee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.619+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 >> 172.21.15.107:0/2869267127 conn(0x7f05d80fbcf0 msgr2=0x7f05d80fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:46.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.620+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 shutdown_connections 2023-08-10T10:48:46.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.620+0000 7f05df3ff700 1 -- 172.21.15.107:0/2869267127 wait complete. 2023-08-10T10:48:46.633 INFO:teuthology.orchestra.run.smithi107.stderr:set pool 4 allow_ec_overwrites to true 2023-08-10T10:48:46.652 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-08-10T10:48:46.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.849+0000 7f26a25ff700 1 -- 172.21.15.107:0/1103476935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c100760 msgr2=0x7f269c100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:46.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.849+0000 7f26a25ff700 1 --2- 172.21.15.107:0/1103476935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c100760 0x7f269c100b80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f268c0099c0 tx=0x7f268c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.849+0000 7f26a25ff700 1 -- 172.21.15.107:0/1103476935 shutdown_connections 2023-08-10T10:48:46.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.849+0000 7f26a25ff700 1 --2- 172.21.15.107:0/1103476935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c1022f0 0x7f269c108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.849+0000 7f26a25ff700 1 --2- 172.21.15.107:0/1103476935 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c100760 0x7f269c100b80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.849+0000 7f26a25ff700 1 --2- 172.21.15.107:0/1103476935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f269c101950 0x7f269c101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.849+0000 7f26a25ff700 1 -- 172.21.15.107:0/1103476935 >> 172.21.15.107:0/1103476935 conn(0x7f269c0fbcb0 msgr2=0x7f269c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:46.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.849+0000 7f26a25ff700 1 -- 172.21.15.107:0/1103476935 shutdown_connections 2023-08-10T10:48:46.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.849+0000 7f26a25ff700 1 -- 172.21.15.107:0/1103476935 wait complete. 2023-08-10T10:48:46.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.850+0000 7f26a25ff700 1 Processor -- start 2023-08-10T10:48:46.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.850+0000 7f26a25ff700 1 -- start start 2023-08-10T10:48:46.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a25ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f269c100760 0x7f269c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:46.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a25ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c101950 0x7f269c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:46.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a25ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c1022f0 0x7f269c19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:46.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a25ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c1a0170 con 0x7f269c1022f0 2023-08-10T10:48:46.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a25ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c1a02b0 con 0x7f269c100760 2023-08-10T10:48:46.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a25ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c1a0440 con 0x7f269c101950 2023-08-10T10:48:46.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a0b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c1022f0 0x7f269c19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:46.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a0b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c1022f0 0x7f269c19fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44810/0 (socket says 172.21.15.107:44810) 2023-08-10T10:48:46.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a0b9c700 1 -- 172.21.15.107:0/3637416822 learned_addr learned my addr 172.21.15.107:0/3637416822 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:46.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f269b7fe700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c101950 0x7f269c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:46.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f269bfff700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f269c100760 0x7f269c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:46.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a0b9c700 1 -- 172.21.15.107:0/3637416822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c101950 msgr2=0x7f269c198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:46.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a0b9c700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c101950 0x7f269c198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a0b9c700 1 -- 172.21.15.107:0/3637416822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f269c100760 msgr2=0x7f269c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:46.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a0b9c700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f269c100760 0x7f269c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:46.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.851+0000 7f26a0b9c700 1 -- 172.21.15.107:0/3637416822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0095f0 con 0x7f269c1022f0 2023-08-10T10:48:46.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.852+0000 7f26a0b9c700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c1022f0 0x7f269c19fba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f269400ef30 tx=0x7f269400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:46.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.852+0000 7f26997fa700 1 -- 172.21.15.107:0/3637416822 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694018070 con 0x7f269c1022f0 2023-08-10T10:48:46.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.852+0000 7f26997fa700 1 -- 172.21.15.107:0/3637416822 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f269400f040 con 0x7f269c1022f0 2023-08-10T10:48:46.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.852+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c1a06c0 con 0x7f269c1022f0 2023-08-10T10:48:46.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.852+0000 7f26997fa700 1 -- 172.21.15.107:0/3637416822 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400cbc0 con 0x7f269c1022f0 2023-08-10T10:48:46.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.852+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c1a0bd0 con 0x7f269c1022f0 2023-08-10T10:48:46.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.853+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c192c70 con 0x7f269c1022f0 2023-08-10T10:48:46.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.855+0000 7f26997fa700 1 -- 172.21.15.107:0/3637416822 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f269400cd80 con 0x7f269c1022f0 2023-08-10T10:48:46.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.856+0000 7f26997fa700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f26840a11d0 0x7f26840a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:46.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.857+0000 7f26997fa700 1 -- 172.21.15.107:0/3637416822 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f26940ccb80 con 0x7f269c1022f0 2023-08-10T10:48:46.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.857+0000 7f269bfff700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f26840a11d0 0x7f26840a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.857+0000 7f269bfff700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f26840a11d0 0x7f26840a3690 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f268c009990 tx=0x7f268c00b9b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:46.859+0000 7f26997fa700 1 -- 172.21.15.107:0/3637416822 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2694096130 con 0x7f269c1022f0 2023-08-10T10:48:46.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: pgmap v303: 97 pgs: 8 creating+activating, 18 creating+peering, 52 active+clean, 19 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-08-10T10:48:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3503813049' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-08-10T10:48:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: osdmap e87: 12 total, 12 up, 12 in 2023-08-10T10:48:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:46.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:46.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:46.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:46.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:46.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:48:46.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:46.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2869267127' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-10T10:48:46.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:46 smithi195 ceph-mon[129938]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-10T10:48:47.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: pgmap v303: 97 pgs: 8 creating+activating, 18 creating+peering, 52 active+clean, 19 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-08-10T10:48:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3503813049' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-08-10T10:48:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: osdmap e87: 12 total, 12 up, 12 in 2023-08-10T10:48:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:48:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2869267127' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-10T10:48:47.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:46 smithi157 ceph-mon[129604]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-10T10:48:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: pgmap v303: 97 pgs: 8 creating+activating, 18 creating+peering, 52 active+clean, 19 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-08-10T10:48:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3503813049' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-08-10T10:48:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: osdmap e87: 12 total, 12 up, 12 in 2023-08-10T10:48:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:48:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:48:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:48:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2869267127' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-10T10:48:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:46 smithi107 ceph-mon[127953]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-08-10T10:48:47.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.108+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f269c02c970 con 0x7f269c1022f0 2023-08-10T10:48:47.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.629+0000 7f26997fa700 1 -- 172.21.15.107:0/3637416822 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2694099750 con 0x7f269c1022f0 2023-08-10T10:48:47.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f26840a11d0 msgr2=0x7f26840a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:47.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f26840a11d0 0x7f26840a3690 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f268c009990 tx=0x7f268c00b9b0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c1022f0 msgr2=0x7f269c19fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:47.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c1022f0 0x7f269c19fba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f269400ef30 tx=0x7f269400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 shutdown_connections 2023-08-10T10:48:47.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f26840a11d0 0x7f26840a3690 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f269c100760 0x7f269c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f269c1022f0 0x7f269c19fba0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 --2- 172.21.15.107:0/3637416822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f269c101950 0x7f269c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.631+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 >> 172.21.15.107:0/3637416822 conn(0x7f269c0fbcb0 msgr2=0x7f269c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:47.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.632+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 shutdown_connections 2023-08-10T10:48:47.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.632+0000 7f26a25ff700 1 -- 172.21.15.107:0/3637416822 wait complete. 2023-08-10T10:48:47.636 INFO:teuthology.orchestra.run.smithi107.stderr:added data pool 4 to fsmap 2023-08-10T10:48:47.652 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:47.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.852+0000 7fce79bff700 1 -- 172.21.15.107:0/4055139764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74100780 msgr2=0x7fce74100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:47.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.852+0000 7fce79bff700 1 --2- 172.21.15.107:0/4055139764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74100780 0x7fce74100ba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fce640099c0 tx=0x7fce64009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.852+0000 7fce79bff700 1 -- 172.21.15.107:0/4055139764 shutdown_connections 2023-08-10T10:48:47.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.852+0000 7fce79bff700 1 --2- 172.21.15.107:0/4055139764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74102310 0x7fce74108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.852+0000 7fce79bff700 1 --2- 172.21.15.107:0/4055139764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74100780 0x7fce74100ba0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.852+0000 7fce79bff700 1 --2- 172.21.15.107:0/4055139764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce74101970 0x7fce74101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.852+0000 7fce79bff700 1 -- 172.21.15.107:0/4055139764 >> 172.21.15.107:0/4055139764 conn(0x7fce740fbcb0 msgr2=0x7fce740fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:47.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.852+0000 7fce79bff700 1 -- 172.21.15.107:0/4055139764 shutdown_connections 2023-08-10T10:48:47.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.852+0000 7fce79bff700 1 -- 172.21.15.107:0/4055139764 wait complete. 2023-08-10T10:48:47.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.853+0000 7fce79bff700 1 Processor -- start 2023-08-10T10:48:47.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.853+0000 7fce79bff700 1 -- start start 2023-08-10T10:48:47.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.853+0000 7fce79bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74100780 0x7fce74074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:47.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.853+0000 7fce79bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce74101970 0x7fce74072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:47.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.853+0000 7fce79bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74102310 0x7fce740730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:47.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.853+0000 7fce79bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce74073840 con 0x7fce74102310 2023-08-10T10:48:47.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.853+0000 7fce79bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740739b0 con 0x7fce74101970 2023-08-10T10:48:47.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.853+0000 7fce79bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce741a02e0 con 0x7fce74100780 2023-08-10T10:48:47.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce73fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74102310 0x7fce740730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:47.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce737fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74100780 0x7fce74074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:47.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce73fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74102310 0x7fce740730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44826/0 (socket says 172.21.15.107:44826) 2023-08-10T10:48:47.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce73fff700 1 -- 172.21.15.107:0/3999130098 learned_addr learned my addr 172.21.15.107:0/3999130098 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:47.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce72ffd700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce74101970 0x7fce74072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:47.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce73fff700 1 -- 172.21.15.107:0/3999130098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74100780 msgr2=0x7fce74074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:47.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce73fff700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74100780 0x7fce74074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce73fff700 1 -- 172.21.15.107:0/3999130098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce74101970 msgr2=0x7fce74072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:47.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce73fff700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce74101970 0x7fce74072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:47.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce73fff700 1 -- 172.21.15.107:0/3999130098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce640095f0 con 0x7fce74102310 2023-08-10T10:48:47.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce72ffd700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce74101970 0x7fce74072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:48:47.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.854+0000 7fce73fff700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74102310 0x7fce740730a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fce6c007d70 tx=0x7fce6c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:47.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.855+0000 7fce70ff9700 1 -- 172.21.15.107:0/3999130098 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00ad40 con 0x7fce74102310 2023-08-10T10:48:47.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.855+0000 7fce70ff9700 1 -- 172.21.15.107:0/3999130098 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce6c0128b0 con 0x7fce74102310 2023-08-10T10:48:47.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.855+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce741a05c0 con 0x7fce74102310 2023-08-10T10:48:47.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.855+0000 7fce70ff9700 1 -- 172.21.15.107:0/3999130098 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c0115a0 con 0x7fce74102310 2023-08-10T10:48:47.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.855+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce741a0ad0 con 0x7fce74102310 2023-08-10T10:48:47.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.856+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7410bea0 con 0x7fce74102310 2023-08-10T10:48:47.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.858+0000 7fce70ff9700 1 -- 172.21.15.107:0/3999130098 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fce6c012a20 con 0x7fce74102310 2023-08-10T10:48:47.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.859+0000 7fce70ff9700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce5c0a1220 0x7fce5c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:47.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.859+0000 7fce70ff9700 1 -- 172.21.15.107:0/3999130098 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fce6c0ccd50 con 0x7fce74102310 2023-08-10T10:48:47.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.859+0000 7fce737fe700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce5c0a1220 0x7fce5c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:47.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.860+0000 7fce737fe700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce5c0a1220 0x7fce5c0a36e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fce64006010 tx=0x7fce64005bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:47.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:47.863+0000 7fce70ff9700 1 -- 172.21.15.107:0/3999130098 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fce6c096250 con 0x7fce74102310 2023-08-10T10:48:47.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:47 smithi195 ceph-mon[129938]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-08-10T10:48:47.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:47 smithi195 ceph-mon[129938]: osdmap e88: 12 total, 12 up, 12 in 2023-08-10T10:48:47.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:47 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3637416822' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-08-10T10:48:48.038 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:48:47 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-b[155067]: 2023-08-10T10:48:47.836+0000 7f4c04b5c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:48:48.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:47 smithi157 ceph-mon[129604]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-08-10T10:48:48.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:47 smithi157 ceph-mon[129604]: osdmap e88: 12 total, 12 up, 12 in 2023-08-10T10:48:48.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:47 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3637416822' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-08-10T10:48:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:47 smithi107 ceph-mon[127953]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-08-10T10:48:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:47 smithi107 ceph-mon[127953]: osdmap e88: 12 total, 12 up, 12 in 2023-08-10T10:48:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:47 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3637416822' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-08-10T10:48:48.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.103+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce7410c090 con 0x7fce74102310 2023-08-10T10:48:48.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.103+0000 7fce70ff9700 1 -- 172.21.15.107:0/3999130098 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+10803 (secure 0 0 0) 0x7fce6c016090 con 0x7fce74102310 2023-08-10T10:48:48.105 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:48.105 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14670,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24571,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:48:47.619795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-10T10:48:48.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce5c0a1220 msgr2=0x7fce5c0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce5c0a1220 0x7fce5c0a36e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fce64006010 tx=0x7fce64005bc0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74102310 msgr2=0x7fce740730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74102310 0x7fce740730a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fce6c007d70 tx=0x7fce6c00a340 comp rx=0 tx=0).stop 2023-08-10T10:48:48.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 shutdown_connections 2023-08-10T10:48:48.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce5c0a1220 0x7fce5c0a36e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce74102310 0x7fce740730a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce74100780 0x7fce74074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 --2- 172.21.15.107:0/3999130098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce74101970 0x7fce74072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 >> 172.21.15.107:0/3999130098 conn(0x7fce740fbcb0 msgr2=0x7fce740fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:48.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 shutdown_connections 2023-08-10T10:48:48.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.106+0000 7fce79bff700 1 -- 172.21.15.107:0/3999130098 wait complete. 2023-08-10T10:48:48.109 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 16 2023-08-10T10:48:48.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:48:48.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.323+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/3718990171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 msgr2=0x7f6a08108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.323+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/3718990171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 0x7f6a08108bb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000b0d0 tx=0x7f6a0000b3e0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.323+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/3718990171 shutdown_connections 2023-08-10T10:48:48.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.323+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/3718990171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a08100770 0x7f6a08100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.323+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/3718990171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 0x7f6a08108bb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.323+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/3718990171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a08101960 0x7f6a08101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.323+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/3718990171 >> 172.21.15.107:0/3718990171 conn(0x7f6a080fbca0 msgr2=0x7f6a080fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:48.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.323+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/3718990171 shutdown_connections 2023-08-10T10:48:48.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.323+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/3718990171 wait complete. 2023-08-10T10:48:48.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.324+0000 7f6a0f7ff700 1 Processor -- start 2023-08-10T10:48:48.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.324+0000 7f6a0f7ff700 1 -- start start 2023-08-10T10:48:48.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0f7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a08100770 0x7f6a081963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:48.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0f7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a08101960 0x7f6a08196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:48.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0f7ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 0x7f6a0819d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:48.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0f7ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0819df70 con 0x7f6a08102300 2023-08-10T10:48:48.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0f7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0819e0b0 con 0x7f6a08101960 2023-08-10T10:48:48.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0f7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0819e240 con 0x7f6a08100770 2023-08-10T10:48:48.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0dd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 0x7f6a0819d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:48.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0dd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 0x7f6a0819d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44844/0 (socket says 172.21.15.107:44844) 2023-08-10T10:48:48.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0dd9c700 1 -- 172.21.15.107:0/2286075560 learned_addr learned my addr 172.21.15.107:0/2286075560 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:48.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0d59b700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a08100770 0x7f6a081963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:48.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0cd9a700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a08101960 0x7f6a08196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:48.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0dd9c700 1 -- 172.21.15.107:0/2286075560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a08100770 msgr2=0x7f6a081963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0dd9c700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a08100770 0x7f6a081963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0dd9c700 1 -- 172.21.15.107:0/2286075560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a08101960 msgr2=0x7f6a08196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0dd9c700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a08101960 0x7f6a08196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0dd9c700 1 -- 172.21.15.107:0/2286075560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00009d00 con 0x7f6a08102300 2023-08-10T10:48:48.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.325+0000 7f6a0dd9c700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 0x7f6a0819d9a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6a00007870 tx=0x7f6a000078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:48.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.326+0000 7f69fe7fc700 1 -- 172.21.15.107:0/2286075560 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000e040 con 0x7f6a08102300 2023-08-10T10:48:48.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.326+0000 7f69fe7fc700 1 -- 172.21.15.107:0/2286075560 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a00003e90 con 0x7f6a08102300 2023-08-10T10:48:48.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.326+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0819e4c0 con 0x7f6a08102300 2023-08-10T10:48:48.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.326+0000 7f69fe7fc700 1 -- 172.21.15.107:0/2286075560 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0001b6c0 con 0x7f6a08102300 2023-08-10T10:48:48.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.326+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0819e940 con 0x7f6a08102300 2023-08-10T10:48:48.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.327+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0810bde0 con 0x7f6a08102300 2023-08-10T10:48:48.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.329+0000 7f69fe7fc700 1 -- 172.21.15.107:0/2286075560 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6a00003a00 con 0x7f6a08102300 2023-08-10T10:48:48.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.330+0000 7f69fe7fc700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f69f40a1220 0x7f69f40a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:48.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.330+0000 7f69fe7fc700 1 -- 172.21.15.107:0/2286075560 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6a000cdb10 con 0x7f6a08102300 2023-08-10T10:48:48.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.330+0000 7f6a0d59b700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f69f40a1220 0x7f69f40a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:48.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.331+0000 7f6a0d59b700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f69f40a1220 0x7f69f40a36e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a081017c0 tx=0x7f6a04009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:48.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.334+0000 7f69fe7fc700 1 -- 172.21.15.107:0/2286075560 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6a000970a0 con 0x7f6a08102300 2023-08-10T10:48:48.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.535+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a081076b0 con 0x7f6a08102300 2023-08-10T10:48:48.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.537+0000 7f69fe7fc700 1 -- 172.21.15.107:0/2286075560 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24017 (secure 0 0 0) 0x7f6a0009a6c0 con 0x7f6a08102300 2023-08-10T10:48:48.538 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:48.539 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":89,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:48:47.109986+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:48:48.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f69f40a1220 msgr2=0x7f69f40a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f69f40a1220 0x7f69f40a36e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a081017c0 tx=0x7f6a04009260 comp rx=0 tx=0).stop 2023-08-10T10:48:48.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 msgr2=0x7f6a0819d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 0x7f6a0819d9a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6a00007870 tx=0x7f6a000078a0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 shutdown_connections 2023-08-10T10:48:48.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f69f40a1220 0x7f69f40a36e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a08102300 0x7f6a0819d9a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a08100770 0x7f6a081963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 --2- 172.21.15.107:0/2286075560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a08101960 0x7f6a08196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 >> 172.21.15.107:0/2286075560 conn(0x7f6a080fbca0 msgr2=0x7f6a080fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:48.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 shutdown_connections 2023-08-10T10:48:48.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.540+0000 7f6a0f7ff700 1 -- 172.21.15.107:0/2286075560 wait complete. 2023-08-10T10:48:48.561 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:48:48.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.760+0000 7f2b0abff700 1 -- 172.21.15.107:0/1333949500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04102300 msgr2=0x7f2b04108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.760+0000 7f2b0abff700 1 --2- 172.21.15.107:0/1333949500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04102300 0x7f2b04108bb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00b0d0 tx=0x7f2afc00b3e0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.760+0000 7f2b0abff700 1 -- 172.21.15.107:0/1333949500 shutdown_connections 2023-08-10T10:48:48.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.760+0000 7f2b0abff700 1 --2- 172.21.15.107:0/1333949500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04102300 0x7f2b04108bb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.760+0000 7f2b0abff700 1 --2- 172.21.15.107:0/1333949500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04100770 0x7f2b04100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.760+0000 7f2b0abff700 1 --2- 172.21.15.107:0/1333949500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b04101960 0x7f2b04101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.760+0000 7f2b0abff700 1 -- 172.21.15.107:0/1333949500 >> 172.21.15.107:0/1333949500 conn(0x7f2b040fbca0 msgr2=0x7f2b040fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:48.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.760+0000 7f2b0abff700 1 -- 172.21.15.107:0/1333949500 shutdown_connections 2023-08-10T10:48:48.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.760+0000 7f2b0abff700 1 -- 172.21.15.107:0/1333949500 wait complete. 2023-08-10T10:48:48.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.761+0000 7f2b0abff700 1 Processor -- start 2023-08-10T10:48:48.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.761+0000 7f2b0abff700 1 -- start start 2023-08-10T10:48:48.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0abff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04100770 0x7f2b04196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:48.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0abff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04101960 0x7f2b04196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:48.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0abff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b04102300 0x7f2b0419d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:48.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0abff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0419df90 con 0x7f2b04100770 2023-08-10T10:48:48.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0abff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0419e0d0 con 0x7f2b04102300 2023-08-10T10:48:48.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0abff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0419e260 con 0x7f2b04101960 2023-08-10T10:48:48.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0899b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04100770 0x7f2b04196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:48.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0899b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04100770 0x7f2b04196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44862/0 (socket says 172.21.15.107:44862) 2023-08-10T10:48:48.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0899b700 1 -- 172.21.15.107:0/3114208255 learned_addr learned my addr 172.21.15.107:0/3114208255 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:48.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0919c700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b04102300 0x7f2b0419d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:48.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0899b700 1 -- 172.21.15.107:0/3114208255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04101960 msgr2=0x7f2b04196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0899b700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04101960 0x7f2b04196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0899b700 1 -- 172.21.15.107:0/3114208255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b04102300 msgr2=0x7f2b0419d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0899b700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b04102300 0x7f2b0419d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0899b700 1 -- 172.21.15.107:0/3114208255 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009d00 con 0x7f2b04100770 2023-08-10T10:48:48.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.762+0000 7f2b0919c700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b04102300 0x7f2b0419d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:48:48.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.763+0000 7f2b0899b700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04100770 0x7f2b04196410 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2af800e970 tx=0x7f2af800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:48.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.763+0000 7f2b01ffb700 1 -- 172.21.15.107:0/3114208255 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8009790 con 0x7f2b04100770 2023-08-10T10:48:48.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.763+0000 7f2b01ffb700 1 -- 172.21.15.107:0/3114208255 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2af80044b0 con 0x7f2b04100770 2023-08-10T10:48:48.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.763+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0419e540 con 0x7f2b04100770 2023-08-10T10:48:48.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.763+0000 7f2b01ffb700 1 -- 172.21.15.107:0/3114208255 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8003dd0 con 0x7f2b04100770 2023-08-10T10:48:48.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.763+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0419ea50 con 0x7f2b04100770 2023-08-10T10:48:48.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.764+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b04107d00 con 0x7f2b04100770 2023-08-10T10:48:48.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.766+0000 7f2b01ffb700 1 -- 172.21.15.107:0/3114208255 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2af8004000 con 0x7f2b04100770 2023-08-10T10:48:48.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.767+0000 7f2b01ffb700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2af40a11a0 0x7f2af40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:48.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.767+0000 7f2b01ffb700 1 -- 172.21.15.107:0/3114208255 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2af8014070 con 0x7f2b04100770 2023-08-10T10:48:48.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.768+0000 7f2b03fff700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2af40a11a0 0x7f2af40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:48.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.768+0000 7f2b03fff700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2af40a11a0 0x7f2af40a3660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2af0005fd0 tx=0x7f2af0005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:48.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.771+0000 7f2b01ffb700 1 -- 172.21.15.107:0/3114208255 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2af80963c0 con 0x7f2b04100770 2023-08-10T10:48:48.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:48 smithi107 ceph-mon[127953]: pgmap v306: 129 pgs: 6 creating+peering, 103 active+clean, 20 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 8 op/s 2023-08-10T10:48:48.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:48 smithi107 ceph-mon[127953]: osdmap e89: 12 total, 12 up, 12 in 2023-08-10T10:48:48.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:48 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3637416822' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-08-10T10:48:48.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:48 smithi107 ceph-mon[127953]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:48:48.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:48 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3999130098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:48.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:48 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2286075560' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:48.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:48 smithi195 ceph-mon[129938]: pgmap v306: 129 pgs: 6 creating+peering, 103 active+clean, 20 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 8 op/s 2023-08-10T10:48:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:48 smithi195 ceph-mon[129938]: osdmap e89: 12 total, 12 up, 12 in 2023-08-10T10:48:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:48 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3637416822' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-08-10T10:48:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:48 smithi195 ceph-mon[129938]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:48:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:48 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3999130098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:48.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:48 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2286075560' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:48.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.971+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b0402c970 con 0x7f2b04100770 2023-08-10T10:48:48.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.973+0000 7f2b01ffb700 1 -- 172.21.15.107:0/3114208255 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24017 (secure 0 0 0) 0x7f2af80999e0 con 0x7f2b04100770 2023-08-10T10:48:48.974 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:48.974 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":89,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:48:47.109986+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:48:48.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2af40a11a0 msgr2=0x7f2af40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2af40a11a0 0x7f2af40a3660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2af0005fd0 tx=0x7f2af0005f60 comp rx=0 tx=0).stop 2023-08-10T10:48:48.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04100770 msgr2=0x7f2b04196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:48.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04100770 0x7f2b04196410 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2af800e970 tx=0x7f2af800ed30 comp rx=0 tx=0).stop 2023-08-10T10:48:48.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 shutdown_connections 2023-08-10T10:48:48.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2af40a11a0 0x7f2af40a3660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b04102300 0x7f2b0419d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2b04100770 0x7f2b04196410 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 --2- 172.21.15.107:0/3114208255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04101960 0x7f2b04196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:48.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 >> 172.21.15.107:0/3114208255 conn(0x7f2b040fbca0 msgr2=0x7f2b04104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:48.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 shutdown_connections 2023-08-10T10:48:48.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:48.975+0000 7f2b0abff700 1 -- 172.21.15.107:0/3114208255 wait complete. 2023-08-10T10:48:49.011 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:48:49.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:48 smithi157 ceph-mon[129604]: pgmap v306: 129 pgs: 6 creating+peering, 103 active+clean, 20 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 8 op/s 2023-08-10T10:48:49.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:48 smithi157 ceph-mon[129604]: osdmap e89: 12 total, 12 up, 12 in 2023-08-10T10:48:49.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:48 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3637416822' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-08-10T10:48:49.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:48 smithi157 ceph-mon[129604]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:48:49.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:48 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3999130098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:49.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:48 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2286075560' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.207+0000 7fe024fff700 1 -- 172.21.15.107:0/3548529827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 msgr2=0x7fe020108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.207+0000 7fe024fff700 1 --2- 172.21.15.107:0/3548529827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 0x7fe020108bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b0d0 tx=0x7fe01800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.207+0000 7fe024fff700 1 -- 172.21.15.107:0/3548529827 shutdown_connections 2023-08-10T10:48:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.207+0000 7fe024fff700 1 --2- 172.21.15.107:0/3548529827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe020100770 0x7fe020100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.207+0000 7fe024fff700 1 --2- 172.21.15.107:0/3548529827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 0x7fe020108bb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.207+0000 7fe024fff700 1 --2- 172.21.15.107:0/3548529827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe020101960 0x7fe020101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.207+0000 7fe024fff700 1 -- 172.21.15.107:0/3548529827 >> 172.21.15.107:0/3548529827 conn(0x7fe0200fbca0 msgr2=0x7fe0200fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.207+0000 7fe024fff700 1 -- 172.21.15.107:0/3548529827 shutdown_connections 2023-08-10T10:48:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.207+0000 7fe024fff700 1 -- 172.21.15.107:0/3548529827 wait complete. 2023-08-10T10:48:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.208+0000 7fe024fff700 1 Processor -- start 2023-08-10T10:48:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.208+0000 7fe024fff700 1 -- start start 2023-08-10T10:48:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.208+0000 7fe024fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe020100770 0x7fe020198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.208+0000 7fe024fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe020101960 0x7fe020198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe024fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 0x7fe02019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe024fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201a0190 con 0x7fe020102300 2023-08-10T10:48:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe024fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201a02d0 con 0x7fe020100770 2023-08-10T10:48:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe024fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201a0460 con 0x7fe020101960 2023-08-10T10:48:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 0x7fe02019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 0x7fe02019fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44886/0 (socket says 172.21.15.107:44886) 2023-08-10T10:48:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01ed9d700 1 -- 172.21.15.107:0/2489653736 learned_addr learned my addr 172.21.15.107:0/2489653736 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01e59c700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe020100770 0x7fe020198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01ed9d700 1 -- 172.21.15.107:0/2489653736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe020101960 msgr2=0x7fe020198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01ed9d700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe020101960 0x7fe020198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01ed9d700 1 -- 172.21.15.107:0/2489653736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe020100770 msgr2=0x7fe020198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01ed9d700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe020100770 0x7fe020198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01ed9d700 1 -- 172.21.15.107:0/2489653736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018009d00 con 0x7fe020102300 2023-08-10T10:48:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.209+0000 7fe01ed9d700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 0x7fe02019fbc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe018009fd0 tx=0x7fe01800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.210+0000 7fe0177fe700 1 -- 172.21.15.107:0/2489653736 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01800e040 con 0x7fe020102300 2023-08-10T10:48:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.210+0000 7fe0177fe700 1 -- 172.21.15.107:0/2489653736 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe01800ce80 con 0x7fe020102300 2023-08-10T10:48:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.210+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0201a06e0 con 0x7fe020102300 2023-08-10T10:48:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.210+0000 7fe0177fe700 1 -- 172.21.15.107:0/2489653736 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0180052a0 con 0x7fe020102300 2023-08-10T10:48:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.210+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0201a0bb0 con 0x7fe020102300 2023-08-10T10:48:49.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.211+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe020192c20 con 0x7fe020102300 2023-08-10T10:48:49.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.213+0000 7fe0177fe700 1 -- 172.21.15.107:0/2489653736 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe01801b450 con 0x7fe020102300 2023-08-10T10:48:49.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.214+0000 7fe0177fe700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe00c0a1220 0x7fe00c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:49.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.214+0000 7fe0177fe700 1 -- 172.21.15.107:0/2489653736 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe0180cdff0 con 0x7fe020102300 2023-08-10T10:48:49.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.214+0000 7fe01e59c700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe00c0a1220 0x7fe00c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:49.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.215+0000 7fe01e59c700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe00c0a1220 0x7fe00c0a36e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe0201017c0 tx=0x7fe010009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:49.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.218+0000 7fe0177fe700 1 -- 172.21.15.107:0/2489653736 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe0180975e0 con 0x7fe020102300 2023-08-10T10:48:49.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.462+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe02002c970 con 0x7fe020102300 2023-08-10T10:48:49.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.462+0000 7fe0177fe700 1 -- 172.21.15.107:0/2489653736 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+10803 (secure 0 0 0) 0x7fe01809ac00 con 0x7fe020102300 2023-08-10T10:48:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:49.464 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14670,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24532,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24536,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24571,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:48:47.619795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-10T10:48:49.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe00c0a1220 msgr2=0x7fe00c0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe00c0a1220 0x7fe00c0a36e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe0201017c0 tx=0x7fe010009260 comp rx=0 tx=0).stop 2023-08-10T10:48:49.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 msgr2=0x7fe02019fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 0x7fe02019fbc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe018009fd0 tx=0x7fe01800cab0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 shutdown_connections 2023-08-10T10:48:49.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe00c0a1220 0x7fe00c0a36e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe020100770 0x7fe020198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe020102300 0x7fe02019fbc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 --2- 172.21.15.107:0/2489653736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe020101960 0x7fe020198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 >> 172.21.15.107:0/2489653736 conn(0x7fe0200fbca0 msgr2=0x7fe020107240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:49.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 shutdown_connections 2023-08-10T10:48:49.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.465+0000 7fe024fff700 1 -- 172.21.15.107:0/2489653736 wait complete. 2023-08-10T10:48:49.468 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 16 2023-08-10T10:48:49.484 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:48:49.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.686+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3775737056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 msgr2=0x7fc1e0108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.686+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3775737056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 0x7fc1e0108bb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800b0d0 tx=0x7fc1d800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.686+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3775737056 shutdown_connections 2023-08-10T10:48:49.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.686+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3775737056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 0x7fc1e0108bb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.686+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3775737056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e0100770 0x7fc1e0100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.686+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3775737056 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e0101960 0x7fc1e0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.686+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3775737056 >> 172.21.15.107:0/3775737056 conn(0x7fc1e00fbca0 msgr2=0x7fc1e00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:49.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.686+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3775737056 shutdown_connections 2023-08-10T10:48:49.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.686+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3775737056 wait complete. 2023-08-10T10:48:49.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.687+0000 7fc1e4bff700 1 Processor -- start 2023-08-10T10:48:49.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1e4bff700 1 -- start start 2023-08-10T10:48:49.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1e4bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e0100770 0x7fc1e0196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:49.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1e4bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e0101960 0x7fc1e01969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:49.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1e4bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 0x7fc1e019da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:49.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1e4bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e019dfe0 con 0x7fc1e0102300 2023-08-10T10:48:49.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1e4bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e019e120 con 0x7fc1e0100770 2023-08-10T10:48:49.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1e4bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e019e2b0 con 0x7fc1e0101960 2023-08-10T10:48:49.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1ded9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 0x7fc1e019da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:49.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1ded9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 0x7fc1e019da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44910/0 (socket says 172.21.15.107:44910) 2023-08-10T10:48:49.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1ded9d700 1 -- 172.21.15.107:0/3602969987 learned_addr learned my addr 172.21.15.107:0/3602969987 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:49.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.688+0000 7fc1ddd9b700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e0101960 0x7fc1e01969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:49.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1de59c700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e0100770 0x7fc1e0196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:49.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1ded9d700 1 -- 172.21.15.107:0/3602969987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e0101960 msgr2=0x7fc1e01969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1ded9d700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e0101960 0x7fc1e01969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1ded9d700 1 -- 172.21.15.107:0/3602969987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e0100770 msgr2=0x7fc1e0196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1ded9d700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e0100770 0x7fc1e0196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1ded9d700 1 -- 172.21.15.107:0/3602969987 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8009d00 con 0x7fc1e0102300 2023-08-10T10:48:49.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1ded9d700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 0x7fc1e019da10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009440 tx=0x7fc1d8009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:49.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1cf7fe700 1 -- 172.21.15.107:0/3602969987 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800e040 con 0x7fc1e0102300 2023-08-10T10:48:49.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1cf7fe700 1 -- 172.21.15.107:0/3602969987 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1d8012e10 con 0x7fc1e0102300 2023-08-10T10:48:49.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e019e530 con 0x7fc1e0102300 2023-08-10T10:48:49.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1cf7fe700 1 -- 172.21.15.107:0/3602969987 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d801b450 con 0x7fc1e0102300 2023-08-10T10:48:49.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.689+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e019e9b0 con 0x7fc1e0102300 2023-08-10T10:48:49.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.690+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e0107cb0 con 0x7fc1e0102300 2023-08-10T10:48:49.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.692+0000 7fc1cf7fe700 1 -- 172.21.15.107:0/3602969987 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc1d8012980 con 0x7fc1e0102300 2023-08-10T10:48:49.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.693+0000 7fc1cf7fe700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1c80a11a0 0x7fc1c80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:49.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.694+0000 7fc1cf7fe700 1 -- 172.21.15.107:0/3602969987 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc1d80cea20 con 0x7fc1e0102300 2023-08-10T10:48:49.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.694+0000 7fc1de59c700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1c80a11a0 0x7fc1c80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:49.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.694+0000 7fc1de59c700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1c80a11a0 0x7fc1c80a3660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0005950 tx=0x7fc1d00058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:49.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.698+0000 7fc1cf7fe700 1 -- 172.21.15.107:0/3602969987 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc1d8097fb0 con 0x7fc1e0102300 2023-08-10T10:48:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:49 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3114208255' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:49.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:49 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2489653736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:49.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.898+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1e002c970 con 0x7fc1e0102300 2023-08-10T10:48:49.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.900+0000 7fc1cf7fe700 1 -- 172.21.15.107:0/3602969987 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24017 (secure 0 0 0) 0x7fc1d809b5d0 con 0x7fc1e0102300 2023-08-10T10:48:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:49.902 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":89,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:48:47.109986+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:48:49.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1c80a11a0 msgr2=0x7fc1c80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1c80a11a0 0x7fc1c80a3660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0005950 tx=0x7fc1d00058e0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 msgr2=0x7fc1e019da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:49.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 0x7fc1e019da10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009440 tx=0x7fc1d8009470 comp rx=0 tx=0).stop 2023-08-10T10:48:49.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 shutdown_connections 2023-08-10T10:48:49.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1c80a11a0 0x7fc1c80a3660 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1e0100770 0x7fc1e0196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1e0102300 0x7fc1e019da10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 --2- 172.21.15.107:0/3602969987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1e0101960 0x7fc1e01969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:49.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.902+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 >> 172.21.15.107:0/3602969987 conn(0x7fc1e00fbca0 msgr2=0x7fc1e0104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:49.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.903+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 shutdown_connections 2023-08-10T10:48:49.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:49.903+0000 7fc1e4bff700 1 -- 172.21.15.107:0/3602969987 wait complete. 2023-08-10T10:48:49.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:49 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3114208255' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:49.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:49 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2489653736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:49.923 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:48:42.135183+0000', 'modified': '2023-08-10T10:48:47.619795+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24575}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6839/2476404740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 2476404740}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 2476404740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-08-10T10:48:49.924 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:48:49.925 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-10T10:48:50.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:49 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3114208255' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:50.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:49 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2489653736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:48:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.125+0000 7f66b6dff700 1 -- 172.21.15.107:0/3074339012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b0101950 msgr2=0x7f66b0101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.125+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3074339012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b0101950 0x7f66b0101db0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f669c0099c0 tx=0x7f669c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.125+0000 7f66b6dff700 1 -- 172.21.15.107:0/3074339012 shutdown_connections 2023-08-10T10:48:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.125+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3074339012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b0100760 0x7f66b0100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.125+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3074339012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b01022f0 0x7f66b0108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.125+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3074339012 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b0101950 0x7f66b0101db0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.125+0000 7f66b6dff700 1 -- 172.21.15.107:0/3074339012 >> 172.21.15.107:0/3074339012 conn(0x7f66b00fbcb0 msgr2=0x7f66b00fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.125+0000 7f66b6dff700 1 -- 172.21.15.107:0/3074339012 shutdown_connections 2023-08-10T10:48:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.125+0000 7f66b6dff700 1 -- 172.21.15.107:0/3074339012 wait complete. 2023-08-10T10:48:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.126+0000 7f66b6dff700 1 Processor -- start 2023-08-10T10:48:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.126+0000 7f66b6dff700 1 -- start start 2023-08-10T10:48:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.126+0000 7f66b6dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b0100760 0x7f66b0074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.126+0000 7f66b6dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b0101950 0x7f66b0072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.126+0000 7f66b6dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b01022f0 0x7f66b00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.126+0000 7f66b6dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b0073840 con 0x7f66b01022f0 2023-08-10T10:48:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.126+0000 7f66b6dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b00739b0 con 0x7f66b0101950 2023-08-10T10:48:50.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.126+0000 7f66b6dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b01a03a0 con 0x7f66b0100760 2023-08-10T10:48:50.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.126+0000 7f66b539c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b01022f0 0x7f66b00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b0100760 0x7f66b0074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b539c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b01022f0 0x7f66b00730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44930/0 (socket says 172.21.15.107:44930) 2023-08-10T10:48:50.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b539c700 1 -- 172.21.15.107:0/3936243972 learned_addr learned my addr 172.21.15.107:0/3936243972 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66affff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b0101950 0x7f66b0072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b539c700 1 -- 172.21.15.107:0/3936243972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b0100760 msgr2=0x7f66b0074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b539c700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b0100760 0x7f66b0074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b539c700 1 -- 172.21.15.107:0/3936243972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b0101950 msgr2=0x7f66b0072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b539c700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b0101950 0x7f66b0072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b539c700 1 -- 172.21.15.107:0/3936243972 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0095f0 con 0x7f66b01022f0 2023-08-10T10:48:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66affff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b0101950 0x7f66b0072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:48:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b539c700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b01022f0 0x7f66b00730a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f66a800b970 tx=0x7f66a800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66adffb700 1 -- 172.21.15.107:0/3936243972 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a800c930 con 0x7f66b01022f0 2023-08-10T10:48:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66adffb700 1 -- 172.21.15.107:0/3936243972 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66a8014440 con 0x7f66b01022f0 2023-08-10T10:48:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b6dff700 1 -- 172.21.15.107:0/3936243972 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b01a0680 con 0x7f66b01022f0 2023-08-10T10:48:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66adffb700 1 -- 172.21.15.107:0/3936243972 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a80075d0 con 0x7f66b01022f0 2023-08-10T10:48:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.127+0000 7f66b6dff700 1 -- 172.21.15.107:0/3936243972 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b01a0b90 con 0x7f66b01022f0 2023-08-10T10:48:50.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.131+0000 7f66adffb700 1 -- 172.21.15.107:0/3936243972 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f66a80145b0 con 0x7f66b01022f0 2023-08-10T10:48:50.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66ca743b80 1 Processor -- start 2023-08-10T10:48:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66adffb700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f66a00a11d0 0x7f66a00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66ca743b80 1 -- start start 2023-08-10T10:48:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66adffb700 1 -- 172.21.15.107:0/3936243972 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f66a8006e40 con 0x7f66b01022f0 2023-08-10T10:48:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66affff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f66a00a11d0 0x7f66a00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 0x557545968910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x557545969380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 0x557545969da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66ca743b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575458e3d70 con 0x557545968e50 2023-08-10T10:48:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66ca743b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575458c0540 con 0x5575459684f0 2023-08-10T10:48:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.132+0000 7f66ca743b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575458bde60 con 0x557545969910 2023-08-10T10:48:50.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x557545969380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x557545969380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44938/0 (socket says 172.21.15.107:44938) 2023-08-10T10:48:50.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 -- 172.21.15.107:0/5936466 learned_addr learned my addr 172.21.15.107:0/5936466 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66b539c700 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 0x557545969da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 0x557545968910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 -- 172.21.15.107:0/5936466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 msgr2=0x557545969da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:48:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 0x557545969da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 -- 172.21.15.107:0/5936466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 msgr2=0x557545968910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:48:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 0x557545968910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 -- 172.21.15.107:0/5936466 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55754573a5e0 con 0x557545968e50 2023-08-10T10:48:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66b539c700 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 0x557545969da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:48:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f66a00a11d0 0x7f66a00a3690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f669c006010 tx=0x7f669c00ba10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.133+0000 7f66affff700 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x557545969380 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f669c004800 tx=0x7f669c02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2043bdfdfdce482b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f669affd700 1 -- 172.21.15.107:0/5936466 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c003dc0 con 0x557545968e50 2023-08-10T10:48:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f669affd700 1 -- 172.21.15.107:0/5936466 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f669c003f20 con 0x557545968e50 2023-08-10T10:48:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f669affd700 1 -- 172.21.15.107:0/5936466 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c029690 con 0x557545968e50 2023-08-10T10:48:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f66ca743b80 1 -- 172.21.15.107:0/5936466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 msgr2=0x557545969380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:50.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f66ca743b80 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x557545969380 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f669c004800 tx=0x7f669c02a000 comp rx=0 tx=0).stop 2023-08-10T10:48:50.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f66ca743b80 1 -- 172.21.15.107:0/5936466 shutdown_connections 2023-08-10T10:48:50.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f66ca743b80 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 0x557545968910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f66ca743b80 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 0x557545969da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f66ca743b80 1 --2- 172.21.15.107:0/5936466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x557545969380 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.134+0000 7f66ca743b80 1 -- 172.21.15.107:0/5936466 >> 172.21.15.107:0/5936466 conn(0x5575458c5c80 msgr2=0x557545963280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:50.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.135+0000 7f66ca743b80 1 -- 172.21.15.107:0/5936466 shutdown_connections 2023-08-10T10:48:50.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.135+0000 7f66ca743b80 1 -- 172.21.15.107:0/5936466 wait complete. 2023-08-10T10:48:50.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.135+0000 7f66ca743b80 1 -- start start 2023-08-10T10:48:50.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.135+0000 7f66ca743b80 1 Processor -- start 2023-08-10T10:48:50.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 0x557545971e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545968e50 0x557545972360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545969910 0x5575459793a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66ca743b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575458b9750 con 0x557545969910 2023-08-10T10:48:50.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66ca743b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557545858a70 con 0x5575459684f0 2023-08-10T10:48:50.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66ca743b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557545858770 con 0x557545968e50 2023-08-10T10:48:50.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66ca743b80 10 client.0 _ll_register_callbacks cb 0x557545856630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:48:50.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66b539c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545969910 0x5575459793a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66b539c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545969910 0x5575459793a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44944/0 (socket says 172.21.15.107:44944) 2023-08-10T10:48:50.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66b539c700 1 -- 172.21.15.107:0/3275506991 learned_addr learned my addr 172.21.15.107:0/3275506991 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:50.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 0x557545971e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66affff700 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545968e50 0x557545972360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66b539c700 1 -- 172.21.15.107:0/3275506991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545968e50 msgr2=0x557545972360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:48:50.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66b539c700 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545968e50 0x557545972360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66b539c700 1 -- 172.21.15.107:0/3275506991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 msgr2=0x557545971e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:48:50.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66b539c700 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 0x557545971e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.136+0000 7f66b539c700 1 -- 172.21.15.107:0/3275506991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b01a0b90 con 0x557545969910 2023-08-10T10:48:50.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66b539c700 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545969910 0x5575459793a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f66a80c9cc0 tx=0x7f66a8084390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9236762a223807a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:50.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f668ffff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:48:50.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f668ffff700 1 -- 172.21.15.107:0/3275506991 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8099110 con 0x557545969910 2023-08-10T10:48:50.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66ca743b80 1 -- 172.21.15.107:0/3275506991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55754595b420 con 0x557545969910 2023-08-10T10:48:50.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f668ffff700 1 -- 172.21.15.107:0/3275506991 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f66a80a1a20 con 0x557545969910 2023-08-10T10:48:50.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f668ffff700 1 -- 172.21.15.107:0/3275506991 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66a8097970 con 0x557545969910 2023-08-10T10:48:50.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66ca743b80 10 client.14802 fetch_fsmap learned FSMap version 16 2023-08-10T10:48:50.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66ca743b80 1 -- 172.21.15.107:0/3275506991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) v3 -- 0x7f66b01094f0 con 0x557545969910 2023-08-10T10:48:50.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f668ffff700 1 -- 172.21.15.107:0/3275506991 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55754595b420 con 0x557545969910 2023-08-10T10:48:50.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f668ffff700 1 -- 172.21.15.107:0/3275506991 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 16) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f66a809d170 con 0x557545969910 2023-08-10T10:48:50.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66ca743b80 10 client.14802 fetch_fsmap finished waiting for FSMap version 16 2023-08-10T10:48:50.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66ca743b80 10 client.14802 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:48:50.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66ca743b80 20 client.14802 populate_metadata read hostname 'smithi107' 2023-08-10T10:48:50.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66ca743b80 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55754597d0a0 0x55754597c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66ca743b80 4 client.14802 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:48:50.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.137+0000 7f66ca743b80 1 -- 172.21.15.107:0/3275506991 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557545937980 con 0x55754597d0a0 2023-08-10T10:48:50.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.138+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55754597d0a0 0x55754597c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.139+0000 7f668ffff700 10 client.14802 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:48:50.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.139+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55754597d0a0 0x55754597c550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a11185ba86828ed server_cookie=95599ebc08247b15 in_seq=0 out_seq=0 2023-08-10T10:48:50.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.139+0000 7f668ffff700 1 -- 172.21.15.107:0/3275506991 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557545937980 con 0x55754597d0a0 2023-08-10T10:48:50.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.139+0000 7f668ffff700 10 client.14802 handle_command_reply: tid=0 2023-08-10T10:48:50.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 client.14802 shutdown 2023-08-10T10:48:50.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 -- 172.21.15.107:0/3275506991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545969910 msgr2=0x5575459793a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:50.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545969910 0x5575459793a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f66a80c9cc0 tx=0x7f66a8084390 comp rx=0 tx=0).stop 2023-08-10T10:48:50.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 -- 172.21.15.107:0/3275506991 shutdown_connections 2023-08-10T10:48:50.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55754597d0a0 0x55754597c550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5575459684f0 0x557545971e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545969910 0x5575459793a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f668ffff700 0 client.14802 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:48:50.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 --2- 172.21.15.107:0/3275506991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545968e50 0x557545972360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 -- 172.21.15.107:0/3275506991 >> 172.21.15.107:0/3275506991 conn(0x5575458c5c80 msgr2=0x557545962960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:50.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 -- 172.21.15.107:0/3275506991 shutdown_connections 2023-08-10T10:48:50.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 1 -- 172.21.15.107:0/3275506991 wait complete. 2023-08-10T10:48:50.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.140+0000 7f66ca743b80 20 client.14802 trim_cache size 0 max 16384 2023-08-10T10:48:50.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.158+0000 7f66ca743b80 1 Processor -- start 2023-08-10T10:48:50.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.158+0000 7f66ca743b80 1 -- start start 2023-08-10T10:48:50.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.158+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575459684f0 0x55754596c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.158+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545968e50 0x55754596cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.158+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 0x557545979360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.158+0000 7f66ca743b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754573c8d0 con 0x5575459684f0 2023-08-10T10:48:50.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.158+0000 7f66ca743b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754596a190 con 0x557545968e50 2023-08-10T10:48:50.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.158+0000 7f66ca743b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55754595d810 con 0x557545969910 2023-08-10T10:48:50.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b4b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575459684f0 0x55754596c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b4b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575459684f0 0x55754596c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44948/0 (socket says 172.21.15.107:44948) 2023-08-10T10:48:50.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b4b9b700 1 -- 172.21.15.107:0/1275158650 learned_addr learned my addr 172.21.15.107:0/1275158650 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:50.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b539c700 1 --2- 172.21.15.107:0/1275158650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 0x557545979360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66affff700 1 --2- 172.21.15.107:0/1275158650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545968e50 0x55754596cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b4b9b700 1 -- 172.21.15.107:0/1275158650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 msgr2=0x557545979360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:48:50.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/1275158650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 0x557545979360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b4b9b700 1 -- 172.21.15.107:0/1275158650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545968e50 msgr2=0x55754596cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:48:50.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/1275158650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545968e50 0x55754596cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b4b9b700 1 -- 172.21.15.107:0/1275158650 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575456e6d90 con 0x5575459684f0 2023-08-10T10:48:50.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/1275158650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575459684f0 0x55754596c880 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f66b01017b0 tx=0x7f66a400a3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff2e6ffe86e2533 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:50.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f669b7fe700 1 -- 172.21.15.107:0/1275158650 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4015070 con 0x5575459684f0 2023-08-10T10:48:50.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f669b7fe700 1 -- 172.21.15.107:0/1275158650 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66a4016040 con 0x5575459684f0 2023-08-10T10:48:50.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.159+0000 7f669b7fe700 1 -- 172.21.15.107:0/1275158650 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4003c90 con 0x5575459684f0 2023-08-10T10:48:50.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.160+0000 7f66ca743b80 1 -- 172.21.15.107:0/1275158650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575459684f0 msgr2=0x55754596c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:50.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.160+0000 7f66ca743b80 1 --2- 172.21.15.107:0/1275158650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575459684f0 0x55754596c880 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f66b01017b0 tx=0x7f66a400a3b0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.160+0000 7f66ca743b80 1 -- 172.21.15.107:0/1275158650 shutdown_connections 2023-08-10T10:48:50.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.160+0000 7f66ca743b80 1 --2- 172.21.15.107:0/1275158650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557545969910 0x557545979360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.160+0000 7f66ca743b80 1 --2- 172.21.15.107:0/1275158650 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5575459684f0 0x55754596c880 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.160+0000 7f66ca743b80 1 --2- 172.21.15.107:0/1275158650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545968e50 0x55754596cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.160+0000 7f66ca743b80 1 -- 172.21.15.107:0/1275158650 >> 172.21.15.107:0/1275158650 conn(0x5575458c5c80 msgr2=0x557545970a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:50.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.160+0000 7f66ca743b80 1 -- 172.21.15.107:0/1275158650 shutdown_connections 2023-08-10T10:48:50.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.160+0000 7f66ca743b80 1 -- 172.21.15.107:0/1275158650 wait complete. 2023-08-10T10:48:50.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.161+0000 7f66ca743b80 1 -- start start 2023-08-10T10:48:50.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.161+0000 7f66ca743b80 1 Processor -- start 2023-08-10T10:48:50.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.161+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5575459684f0 0x5575459742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.161+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x5575459747f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66ca743b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545969910 0x5575459d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66ca743b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575459d1240 con 0x557545968e50 2023-08-10T10:48:50.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66ca743b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575459d1380 con 0x557545969910 2023-08-10T10:48:50.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66ca743b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575459d14c0 con 0x5575459684f0 2023-08-10T10:48:50.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66ca743b80 10 client.0 _ll_register_callbacks cb 0x557545856630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:48:50.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66affff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x5575459747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66affff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x5575459747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44950/0 (socket says 172.21.15.107:44950) 2023-08-10T10:48:50.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66affff700 1 -- 172.21.15.107:0/154238643 learned_addr learned my addr 172.21.15.107:0/154238643 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:50.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5575459684f0 0x5575459742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66b539c700 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545969910 0x5575459d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66affff700 1 -- 172.21.15.107:0/154238643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5575459684f0 msgr2=0x5575459742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:48:50.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66affff700 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5575459684f0 0x5575459742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66affff700 1 -- 172.21.15.107:0/154238643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545969910 msgr2=0x5575459d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:48:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66affff700 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545969910 0x5575459d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66affff700 1 -- 172.21.15.107:0/154238643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a400ac10 con 0x557545968e50 2023-08-10T10:48:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f66affff700 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x5575459747f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x557545969250 tx=0x7f669c0094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29abdb687cf493c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.162+0000 7f668ffff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:48:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f668ffff700 1 -- 172.21.15.107:0/154238643 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c003dc0 con 0x557545968e50 2023-08-10T10:48:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f66ca743b80 1 -- 172.21.15.107:0/154238643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f669c003f20 con 0x557545968e50 2023-08-10T10:48:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f668ffff700 1 -- 172.21.15.107:0/154238643 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f669c029430 con 0x557545968e50 2023-08-10T10:48:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f668ffff700 1 -- 172.21.15.107:0/154238643 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f669c0295f0 con 0x557545968e50 2023-08-10T10:48:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f66ca743b80 10 client.14808 fetch_fsmap learned FSMap version 16 2023-08-10T10:48:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f66ca743b80 1 -- 172.21.15.107:0/154238643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) v3 -- 0x5575456cfc10 con 0x557545968e50 2023-08-10T10:48:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f668ffff700 1 -- 172.21.15.107:0/154238643 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f669c051080 con 0x557545968e50 2023-08-10T10:48:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f668ffff700 1 -- 172.21.15.107:0/154238643 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 16) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f669c044030 con 0x557545968e50 2023-08-10T10:48:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f66ca743b80 10 client.14808 fetch_fsmap finished waiting for FSMap version 16 2023-08-10T10:48:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f66ca743b80 10 client.14808 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:48:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f66ca743b80 20 client.14808 populate_metadata read hostname 'smithi107' 2023-08-10T10:48:50.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f66ca743b80 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5575459d5e30 0x5575459d2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:50.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f66ca743b80 4 client.14808 mds_command: new command op to 24575 tid=0[{"prefix": "status"}] 2023-08-10T10:48:50.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.163+0000 7f66ca743b80 1 -- 172.21.15.107:0/154238643 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5575458b2730 con 0x5575459d5e30 2023-08-10T10:48:50.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.164+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5575459d5e30 0x5575459d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:50.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.164+0000 7f66b4b9b700 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5575459d5e30 0x5575459d2760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51fa9bfb704423e3 server_cookie=cb5e412c049bbbd0 in_seq=0 out_seq=0 2023-08-10T10:48:50.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.164+0000 7f668ffff700 10 client.14808 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:48:50.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f668ffff700 1 -- 172.21.15.107:0/154238643 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5575458b2730 con 0x5575459d5e30 2023-08-10T10:48:50.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f668ffff700 10 client.14808 handle_command_reply: tid=0 2023-08-10T10:48:50.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 client.14808 shutdown 2023-08-10T10:48:50.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 -- 172.21.15.107:0/154238643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 msgr2=0x5575459747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:50.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x5575459747f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x557545969250 tx=0x7f669c0094b0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 -- 172.21.15.107:0/154238643 shutdown_connections 2023-08-10T10:48:50.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5575459d5e30 0x5575459d2760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557545969910 0x5575459d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5575459684f0 0x5575459742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 --2- 172.21.15.107:0/154238643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557545968e50 0x5575459747f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 -- 172.21.15.107:0/154238643 >> 172.21.15.107:0/154238643 conn(0x5575458c5c80 msgr2=0x55754596c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:50.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f668ffff700 0 client.14808 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:48:50.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 -- 172.21.15.107:0/154238643 shutdown_connections 2023-08-10T10:48:50.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 1 -- 172.21.15.107:0/154238643 wait complete. 2023-08-10T10:48:50.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.165+0000 7f66ca743b80 20 client.14808 trim_cache size 0 max 16384 2023-08-10T10:48:50.175 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:48:50.175 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:48:50.175 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2023-08-10T10:48:50.175 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24575, 2023-08-10T10:48:50.175 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:48:50.175 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:48:50.175 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:48:50.176 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 7.2740214539999997, 2023-08-10T10:48:50.176 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 16, 2023-08-10T10:48:50.176 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 89, 2023-08-10T10:48:50.176 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 89, 2023-08-10T10:48:50.176 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 13.257413573999999 2023-08-10T10:48:50.176 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:48:50.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 -- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f66a00a11d0 msgr2=0x7f66a00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:50.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f66a00a11d0 0x7f66a00a3690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f669c006010 tx=0x7f669c00ba10 comp rx=0 tx=0).stop 2023-08-10T10:48:50.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 -- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b01022f0 msgr2=0x7f66b00730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:50.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b01022f0 0x7f66b00730a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f66a800b970 tx=0x7f66a800bc80 comp rx=0 tx=0).stop 2023-08-10T10:48:50.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 -- 172.21.15.107:0/3936243972 shutdown_connections 2023-08-10T10:48:50.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f66a00a11d0 0x7f66a00a3690 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f66b01022f0 0x7f66b00730a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b0100760 0x7f66b0074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 --2- 172.21.15.107:0/3936243972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66b0101950 0x7f66b0072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:50.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 -- 172.21.15.107:0/3936243972 >> 172.21.15.107:0/3936243972 conn(0x7f66b00fbcb0 msgr2=0x7f66b00fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:50.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 -- 172.21.15.107:0/3936243972 shutdown_connections 2023-08-10T10:48:50.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:50.166+0000 7f66b6dff700 1 -- 172.21.15.107:0/3936243972 wait complete. 2023-08-10T10:48:50.184 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:48:50.185 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:48:50.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph fs ls 2023-08-10T10:48:50.900 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:48:50.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:50 smithi195 ceph-mon[129938]: pgmap v308: 129 pgs: 6 creating+peering, 119 active+clean, 4 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s wr, 5 op/s 2023-08-10T10:48:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:50 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3602969987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:51.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:50 smithi157 ceph-mon[129604]: pgmap v308: 129 pgs: 6 creating+peering, 119 active+clean, 4 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s wr, 5 op/s 2023-08-10T10:48:51.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:50 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3602969987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:51.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:50 smithi107 ceph-mon[127953]: pgmap v308: 129 pgs: 6 creating+peering, 119 active+clean, 4 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s wr, 5 op/s 2023-08-10T10:48:51.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:50 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3602969987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:52.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.729+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1791770859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78101150 msgr2=0x7f5a7810d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:52.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.729+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1791770859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78101150 0x7f5a7810d660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b0a0 tx=0x7f5a7000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.729+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1791770859 shutdown_connections 2023-08-10T10:48:52.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.729+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1791770859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78106790 0x7f5a78106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.729+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1791770859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78101150 0x7f5a7810d660 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.729+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1791770859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a78100790 0x7f5a78100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.729+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1791770859 >> 172.21.15.107:0/1791770859 conn(0x7f5a780fc260 msgr2=0x7f5a780fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:52.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.729+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1791770859 shutdown_connections 2023-08-10T10:48:52.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.729+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1791770859 wait complete. 2023-08-10T10:48:52.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.730+0000 7f5a7ce60700 1 Processor -- start 2023-08-10T10:48:52.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.730+0000 7f5a7ce60700 1 -- start start 2023-08-10T10:48:52.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7ce60700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78100790 0x7f5a7819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:52.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7ce60700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a78101150 0x7f5a7819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:52.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7ce60700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78106790 0x7f5a78196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:52.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7ce60700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78196d90 con 0x7f5a78100790 2023-08-10T10:48:52.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7ce60700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78196f00 con 0x7f5a78106790 2023-08-10T10:48:52.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7ce60700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a781970c0 con 0x7f5a78101150 2023-08-10T10:48:52.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78100790 0x7f5a7819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:52.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78100790 0x7f5a7819c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44972/0 (socket says 172.21.15.107:44972) 2023-08-10T10:48:52.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7659c700 1 -- 172.21.15.107:0/1890401120 learned_addr learned my addr 172.21.15.107:0/1890401120 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:52.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a75d9b700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a78101150 0x7f5a7819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:52.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7659c700 1 -- 172.21.15.107:0/1890401120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a78101150 msgr2=0x7f5a7819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:52.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a76d9d700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78106790 0x7f5a78196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:52.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7659c700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a78101150 0x7f5a7819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7659c700 1 -- 172.21.15.107:0/1890401120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78106790 msgr2=0x7f5a78196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:52.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7659c700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78106790 0x7f5a78196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a7659c700 1 -- 172.21.15.107:0/1890401120 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70009d00 con 0x7f5a78100790 2023-08-10T10:48:52.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a75d9b700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a78101150 0x7f5a7819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:48:52.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.731+0000 7f5a76d9d700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78106790 0x7f5a78196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:48:52.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.732+0000 7f5a7659c700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78100790 0x7f5a7819c6a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800d950 tx=0x7f5a6800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:52.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.732+0000 7f5a677fe700 1 -- 172.21.15.107:0/1890401120 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68009b40 con 0x7f5a78100790 2023-08-10T10:48:52.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.732+0000 7f5a677fe700 1 -- 172.21.15.107:0/1890401120 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a68009ca0 con 0x7f5a78100790 2023-08-10T10:48:52.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.732+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a781973a0 con 0x7f5a78100790 2023-08-10T10:48:52.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.732+0000 7f5a677fe700 1 -- 172.21.15.107:0/1890401120 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800f620 con 0x7f5a78100790 2023-08-10T10:48:52.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.732+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a781a3690 con 0x7f5a78100790 2023-08-10T10:48:52.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.733+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7804e470 con 0x7f5a78100790 2023-08-10T10:48:52.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.735+0000 7f5a677fe700 1 -- 172.21.15.107:0/1890401120 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5a68010460 con 0x7f5a78100790 2023-08-10T10:48:52.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.736+0000 7f5a677fe700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5a600a1150 0x7f5a600a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:52.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.736+0000 7f5a677fe700 1 -- 172.21.15.107:0/1890401120 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5a680cce60 con 0x7f5a78100790 2023-08-10T10:48:52.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.736+0000 7f5a75d9b700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5a600a1150 0x7f5a600a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:52.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.737+0000 7f5a75d9b700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5a600a1150 0x7f5a600a3610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c005fd0 tx=0x7f5a6c005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:52.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.740+0000 7f5a677fe700 1 -- 172.21.15.107:0/1890401120 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5a68096360 con 0x7f5a78100790 2023-08-10T10:48:52.826 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:52 smithi107 ceph-mon[127953]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2023-08-10T10:48:52.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:52 smithi195 ceph-mon[129938]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2023-08-10T10:48:52.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.981+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a781a39e0 con 0x7f5a78100790 2023-08-10T10:48:52.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.981+0000 7f5a677fe700 1 -- 172.21.15.107:0/1890401120 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5a68020070 con 0x7f5a78100790 2023-08-10T10:48:52.983 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-10T10:48:52.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5a600a1150 msgr2=0x7f5a600a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:52.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5a600a1150 0x7f5a600a3610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c005fd0 tx=0x7f5a6c005ee0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78100790 msgr2=0x7f5a7819c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:52.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78100790 0x7f5a7819c6a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800d950 tx=0x7f5a6800dd10 comp rx=0 tx=0).stop 2023-08-10T10:48:52.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 shutdown_connections 2023-08-10T10:48:52.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5a600a1150 0x7f5a600a3610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a78106790 0x7f5a78196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5a78100790 0x7f5a7819c6a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 --2- 172.21.15.107:0/1890401120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a78101150 0x7f5a7819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:52.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 >> 172.21.15.107:0/1890401120 conn(0x7f5a780fc260 msgr2=0x7f5a780fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:52.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 shutdown_connections 2023-08-10T10:48:52.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:52.984+0000 7f5a7ce60700 1 -- 172.21.15.107:0/1890401120 wait complete. 2023-08-10T10:48:53.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:52 smithi157 ceph-mon[129604]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2023-08-10T10:48:53.478 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:48:53.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:48:53.479 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2023-08-10T10:48:53.479 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-08-10T10:48:53.479 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:48:53.479 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:48:53.480 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:48:53.480 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:48:53.480 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-08-10T10:48:53.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:53.481 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2023-08-10T10:48:53.526 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:48:53.526 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:48:53.527 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:48:53.527 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:48:53.527 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2023-08-10T10:48:53.527 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:48:53.527 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:48:53.527 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:48:53.527 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2023-08-10T10:48:53.528 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:48:53.528 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:48:53.528 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2023-08-10T10:48:53.528 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:48:53.528 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2023-08-10T10:48:53.528 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:48:53.529 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2023-08-10T10:48:53.529 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:48:53.529 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 40648sec preferred_lft 40648sec 2023-08-10T10:48:53.529 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::3b9b:a750:7172:f772/64 scope link noprefixroute 2023-08-10T10:48:53.529 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:48:53.531 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T10:48:53.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:53.531 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:48:53.532 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:48:53.532 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2023-08-10T10:48:53.532 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2023-08-10T10:48:53.533 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2023-08-10T10:48:53.533 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T10:48:53.533 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:48:53.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:53 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1890401120' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-10T10:48:53.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:53 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1890401120' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-10T10:48:54.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:54.000 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:48:54.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:53 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1890401120' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-10T10:48:54.072 INFO:teuthology.orchestra.run.smithi107.stdout:1 2023-08-10T10:48:54.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:54.077 DEBUG:teuthology.orchestra.run.smithi107:> route 2023-08-10T10:48:54.136 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2023-08-10T10:48:54.136 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:48:54.137 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:48:54.137 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:48:54.138 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:48:54.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:54.139 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:48:54.139 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:48:54.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:48:54.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:48:54.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:48:54.141 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:48:54.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:54 smithi107 ceph-mon[127953]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 128 B/s wr, 3 op/s 2023-08-10T10:48:54.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:54.908 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2023-08-10T10:48:54.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:54 smithi195 ceph-mon[129938]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 128 B/s wr, 3 op/s 2023-08-10T10:48:54.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:54.955 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2023-08-10T10:48:55.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:55.038 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:48:55.038 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:48:55.039 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-10T10:48:55.039 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-08-10T10:48:55.039 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:48:55.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:54 smithi157 ceph-mon[129604]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 128 B/s wr, 3 op/s 2023-08-10T10:48:55.223 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-08-10T10:48:55.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:55.224 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:48:55.225 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:48:55.225 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-08-10T10:48:55.225 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T10:48:55.225 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-08-10T10:48:55.226 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-08-10T10:48:55.226 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-08-10T10:48:55.226 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:48:55.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:55.510 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:48:55.510 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:48:55.510 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2023-08-10T10:48:55.511 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T10:48:55.511 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:48:55.686 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-08-10T10:48:55.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:48:55.687 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:48:55.730 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-08-10T10:48:55.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:48:55.731 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:48:55.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-08-10T10:48:55.923 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-10T10:48:55.923 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-10T10:48:55.991 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-10T10:48:55.994 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-10T10:48:55.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:55.995 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-08-10T10:48:56.038 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-10T10:48:56.039 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-08-10T10:48:56.083 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-08-10T10:48:56.153 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-10T10:48:56.154 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-10T10:48:56.224 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-10T10:48:56.226 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-10T10:48:56.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:56.227 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-08-10T10:48:56.319 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi107.stderr:2023-08-10T10:48:56.319+0000 7f7103b505c0 -1 init, newargv = 0x55aa1ec1e4f0 newargc=15 2023-08-10T10:48:56.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi107.stderr:ceph-fuse[164852]: starting ceph client 2023-08-10T10:48:56.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi107.stderr:ceph-fuse[164852]: starting fuse 2023-08-10T10:48:56.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:56 smithi195 ceph-mon[129938]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-10T10:48:57.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:56 smithi157 ceph-mon[129604]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-10T10:48:57.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:56 smithi107 ceph-mon[127953]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-10T10:48:57.371 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-08-10T10:48:57.450 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-10T10:48:57.450 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-10T10:48:57.519 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-10T10:48:57.522 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-10T10:48:57.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:57.523 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-08-10T10:48:57.566 INFO:teuthology.orchestra.run.smithi107.stdout:121 2023-08-10T10:48:57.566 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-08-10T10:48:57.567 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:48:57.567 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2023-08-10T10:48:57.567 DEBUG:teuthology.orchestra.run.smithi107:> import re 2023-08-10T10:48:57.568 DEBUG:teuthology.orchestra.run.smithi107:> import os 2023-08-10T10:48:57.568 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2023-08-10T10:48:57.568 DEBUG:teuthology.orchestra.run.smithi107:> 2023-08-10T10:48:57.569 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2023-08-10T10:48:57.569 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-08-10T10:48:57.569 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2023-08-10T10:48:57.569 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-08-10T10:48:57.570 DEBUG:teuthology.orchestra.run.smithi107:> 2023-08-10T10:48:57.570 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2023-08-10T10:48:57.570 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2023-08-10T10:48:57.570 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2023-08-10T10:48:57.571 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2023-08-10T10:48:57.571 DEBUG:teuthology.orchestra.run.smithi107:> 2023-08-10T10:48:57.571 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2023-08-10T10:48:57.572 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-10T10:48:57.572 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-10T10:48:57.572 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-10T10:48:57.572 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2023-08-10T10:48:57.573 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2023-08-10T10:48:57.573 DEBUG:teuthology.orchestra.run.smithi107:> return f 2023-08-10T10:48:57.573 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-10T10:48:57.574 DEBUG:teuthology.orchestra.run.smithi107:> 2023-08-10T10:48:57.574 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.admin")) 2023-08-10T10:48:57.574 DEBUG:teuthology.orchestra.run.smithi107:> ' 2023-08-10T10:48:57.751 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.admin.164852.asok 2023-08-10T10:48:57.929 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.164852.asok 2023-08-10T10:48:57.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:57.930 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.164852.asok status 2023-08-10T10:48:58.154 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:48:58.154 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2023-08-10T10:48:58.154 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "a8bf445f2d27d8e12e060dff0fd151d481b5290b", 2023-08-10T10:48:58.154 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev)", 2023-08-10T10:48:58.154 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "admin", 2023-08-10T10:48:58.155 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2023-08-10T10:48:58.155 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-08-10T10:48:58.155 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "164852", 2023-08-10T10:48:58.155 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/" 2023-08-10T10:48:58.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T10:48:58.155 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2023-08-10T10:48:58.156 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2023-08-10T10:48:58.156 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 14820, 2023-08-10T10:48:58.156 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2023-08-10T10:48:58.156 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2023-08-10T10:48:58.156 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2023-08-10T10:48:58.156 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 14820 2023-08-10T10:48:58.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T10:48:58.157 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2023-08-10T10:48:58.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2023-08-10T10:48:58.157 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-08-10T10:48:58.157 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 4280412459 2023-08-10T10:48:58.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:48:58.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T10:48:58.157 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2023-08-10T10:48:58.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2023-08-10T10:48:58.158 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-08-10T10:48:58.158 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 4280412459 2023-08-10T10:48:58.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T10:48:58.158 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.14820 172.21.15.107:0/4280412459", 2023-08-10T10:48:58.158 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "172.21.15.107:0/4280412459", 2023-08-10T10:48:58.158 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 1, 2023-08-10T10:48:58.158 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 16, 2023-08-10T10:48:58.159 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 89, 2023-08-10T10:48:58.159 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2023-08-10T10:48:58.159 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2023-08-10T10:48:58.159 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs" 2023-08-10T10:48:58.159 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:48:58.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:58.169 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2023-08-10T10:48:58.169 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:48:58.213 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2023-08-10T10:48:58.214 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:48:58.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:58.214 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:48:58.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:48:58.325 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-08-10T10:48:58.470 INFO:teuthology.orchestra.run.smithi107.stdout:# file: . 2023-08-10T10:48:58.470 INFO:teuthology.orchestra.run.smithi107.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-08-10T10:48:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:58.471 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:48:58.472 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:48:58.515 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:48:58.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.756+0000 7f60b7fff700 1 -- 172.21.15.107:0/372959151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0100780 msgr2=0x7f60b0100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:58.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.756+0000 7f60b7fff700 1 --2- 172.21.15.107:0/372959151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0100780 0x7f60b0100ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0099c0 tx=0x7f60ac009cd0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.756+0000 7f60b7fff700 1 -- 172.21.15.107:0/372959151 shutdown_connections 2023-08-10T10:48:58.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.756+0000 7f60b7fff700 1 --2- 172.21.15.107:0/372959151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0102310 0x7f60b0108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.756+0000 7f60b7fff700 1 --2- 172.21.15.107:0/372959151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0100780 0x7f60b0100ba0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.756+0000 7f60b7fff700 1 --2- 172.21.15.107:0/372959151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60b0101970 0x7f60b0101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.756+0000 7f60b7fff700 1 -- 172.21.15.107:0/372959151 >> 172.21.15.107:0/372959151 conn(0x7f60b00fbcb0 msgr2=0x7f60b00fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:58.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.756+0000 7f60b7fff700 1 -- 172.21.15.107:0/372959151 shutdown_connections 2023-08-10T10:48:58.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.756+0000 7f60b7fff700 1 -- 172.21.15.107:0/372959151 wait complete. 2023-08-10T10:48:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.757+0000 7f60b7fff700 1 Processor -- start 2023-08-10T10:48:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.757+0000 7f60b7fff700 1 -- start start 2023-08-10T10:48:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.757+0000 7f60b7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60b0100780 0x7f60b0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.757+0000 7f60b7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0101970 0x7f60b0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:58.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.757+0000 7f60b7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0102310 0x7f60b019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.757+0000 7f60b7fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01a0110 con 0x7f60b0102310 2023-08-10T10:48:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.757+0000 7f60b7fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01a0250 con 0x7f60b0100780 2023-08-10T10:48:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.757+0000 7f60b7fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01a03e0 con 0x7f60b0101970 2023-08-10T10:48:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0102310 0x7f60b019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0102310 0x7f60b019fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50712/0 (socket says 172.21.15.107:50712) 2023-08-10T10:48:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b659c700 1 -- 172.21.15.107:0/996112349 learned_addr learned my addr 172.21.15.107:0/996112349 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b559a700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0101970 0x7f60b0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b5d9b700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60b0100780 0x7f60b0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:58.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b659c700 1 -- 172.21.15.107:0/996112349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0101970 msgr2=0x7f60b0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:58.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b659c700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0101970 0x7f60b0198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b659c700 1 -- 172.21.15.107:0/996112349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60b0100780 msgr2=0x7f60b0198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:58.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b659c700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60b0100780 0x7f60b0198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b659c700 1 -- 172.21.15.107:0/996112349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0095f0 con 0x7f60b0102310 2023-08-10T10:48:58.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b659c700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0102310 0x7f60b019fb40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f60a800ef30 tx=0x7f60a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:58.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60a6ffd700 1 -- 172.21.15.107:0/996112349 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8018070 con 0x7f60b0102310 2023-08-10T10:48:58.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60a6ffd700 1 -- 172.21.15.107:0/996112349 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60a800f040 con 0x7f60b0102310 2023-08-10T10:48:58.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b01a0660 con 0x7f60b0102310 2023-08-10T10:48:58.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.758+0000 7f60a6ffd700 1 -- 172.21.15.107:0/996112349 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a800cc70 con 0x7f60b0102310 2023-08-10T10:48:58.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.759+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b01a0b20 con 0x7f60b0102310 2023-08-10T10:48:58.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.759+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b0192c90 con 0x7f60b0102310 2023-08-10T10:48:58.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.763+0000 7f60a6ffd700 1 -- 172.21.15.107:0/996112349 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f60a8003a00 con 0x7f60b0102310 2023-08-10T10:48:58.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.764+0000 7f60a6ffd700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f609c0a11a0 0x7f609c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:58.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.764+0000 7f60a6ffd700 1 -- 172.21.15.107:0/996112349 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f60a80ccc00 con 0x7f60b0102310 2023-08-10T10:48:58.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.765+0000 7f60b5d9b700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f609c0a11a0 0x7f609c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:58.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.765+0000 7f60b5d9b700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f609c0a11a0 0x7f609c0a3660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009990 tx=0x7f60ac01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:58.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.767+0000 7f60a6ffd700 1 -- 172.21.15.107:0/996112349 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f60a80961f0 con 0x7f60b0102310 2023-08-10T10:48:58.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:58 smithi195 ceph-mon[129938]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-10T10:48:58.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.965+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60b002c970 con 0x7f60b0102310 2023-08-10T10:48:58.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.967+0000 7f60a6ffd700 1 -- 172.21.15.107:0/996112349 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24017 (secure 0 0 0) 0x7f60a8099810 con 0x7f60b0102310 2023-08-10T10:48:58.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:48:58.968 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":89,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:48:47.109986+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:48:58.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f609c0a11a0 msgr2=0x7f609c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:58.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f609c0a11a0 0x7f609c0a3660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009990 tx=0x7f60ac01a040 comp rx=0 tx=0).stop 2023-08-10T10:48:58.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0102310 msgr2=0x7f60b019fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:58.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0102310 0x7f60b019fb40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f60a800ef30 tx=0x7f60a800c3a0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 shutdown_connections 2023-08-10T10:48:58.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f609c0a11a0 0x7f609c0a3660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f60b0100780 0x7f60b0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60b0102310 0x7f60b019fb40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 --2- 172.21.15.107:0/996112349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b0101970 0x7f60b0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:58.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 >> 172.21.15.107:0/996112349 conn(0x7f60b00fbcb0 msgr2=0x7f60b0107290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:58.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 shutdown_connections 2023-08-10T10:48:58.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:58.969+0000 7f60b7fff700 1 -- 172.21.15.107:0/996112349 wait complete. 2023-08-10T10:48:58.986 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:58 smithi107 ceph-mon[127953]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-10T10:48:58.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:48:58.989 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:48:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:58 smithi157 ceph-mon[129604]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-08-10T10:48:59.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.189+0000 7f6f73dff700 1 -- 172.21.15.107:0/3333765624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f6c100760 msgr2=0x7f6f6c100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.189+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3333765624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f6c100760 0x7f6f6c100b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009990 tx=0x7f6f68009ca0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.189+0000 7f6f73dff700 1 -- 172.21.15.107:0/3333765624 shutdown_connections 2023-08-10T10:48:59.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.189+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3333765624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c1022f0 0x7f6f6c108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.189+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3333765624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f6c100760 0x7f6f6c100b80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.189+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3333765624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f6c101950 0x7f6f6c101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.189+0000 7f6f73dff700 1 -- 172.21.15.107:0/3333765624 >> 172.21.15.107:0/3333765624 conn(0x7f6f6c0fbcb0 msgr2=0x7f6f6c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:59.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.189+0000 7f6f73dff700 1 -- 172.21.15.107:0/3333765624 shutdown_connections 2023-08-10T10:48:59.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.189+0000 7f6f73dff700 1 -- 172.21.15.107:0/3333765624 wait complete. 2023-08-10T10:48:59.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.190+0000 7f6f73dff700 1 Processor -- start 2023-08-10T10:48:59.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.190+0000 7f6f73dff700 1 -- start start 2023-08-10T10:48:59.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.190+0000 7f6f73dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c100760 0x7f6f6c196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:59.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.190+0000 7f6f73dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f6c101950 0x7f6f6c196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:59.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.190+0000 7f6f73dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f6c1022f0 0x7f6f6c19d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:59.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.190+0000 7f6f73dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c19df90 con 0x7f6f6c1022f0 2023-08-10T10:48:59.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.190+0000 7f6f73dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c19e0d0 con 0x7f6f6c100760 2023-08-10T10:48:59.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.190+0000 7f6f73dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c19e260 con 0x7f6f6c101950 2023-08-10T10:48:59.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f71b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c100760 0x7f6f6c196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:59.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7239c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f6c1022f0 0x7f6f6c19d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:59.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7239c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f6c1022f0 0x7f6f6c19d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50720/0 (socket says 172.21.15.107:50720) 2023-08-10T10:48:59.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7239c700 1 -- 172.21.15.107:0/3903474280 learned_addr learned my addr 172.21.15.107:0/3903474280 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:59.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7139a700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f6c101950 0x7f6f6c196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:59.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f71b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c100760 0x7f6f6c196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:60820/0 (socket says 172.21.15.107:60820) 2023-08-10T10:48:59.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7239c700 1 -- 172.21.15.107:0/3903474280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f6c101950 msgr2=0x7f6f6c196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7239c700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f6c101950 0x7f6f6c196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7239c700 1 -- 172.21.15.107:0/3903474280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c100760 msgr2=0x7f6f6c196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7239c700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c100760 0x7f6f6c196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7239c700 1 -- 172.21.15.107:0/3903474280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c009520 con 0x7f6f6c1022f0 2023-08-10T10:48:59.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.191+0000 7f6f7239c700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f6c1022f0 0x7f6f6c19d9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400ada0 tx=0x7f6f6400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:59.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.192+0000 7f6f62ffd700 1 -- 172.21.15.107:0/3903474280 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400f070 con 0x7f6f6c1022f0 2023-08-10T10:48:59.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.192+0000 7f6f62ffd700 1 -- 172.21.15.107:0/3903474280 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6f64007b30 con 0x7f6f6c1022f0 2023-08-10T10:48:59.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.192+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f680095f0 con 0x7f6f6c1022f0 2023-08-10T10:48:59.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.192+0000 7f6f62ffd700 1 -- 172.21.15.107:0/3903474280 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64005280 con 0x7f6f6c1022f0 2023-08-10T10:48:59.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.192+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c072d30 con 0x7f6f6c1022f0 2023-08-10T10:48:59.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.193+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c107e20 con 0x7f6f6c1022f0 2023-08-10T10:48:59.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.195+0000 7f6f62ffd700 1 -- 172.21.15.107:0/3903474280 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6f6400a090 con 0x7f6f6c1022f0 2023-08-10T10:48:59.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.196+0000 7f6f62ffd700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6f580a1150 0x7f6f580a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:59.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.196+0000 7f6f62ffd700 1 -- 172.21.15.107:0/3903474280 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6f640cc6a0 con 0x7f6f6c1022f0 2023-08-10T10:48:59.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.196+0000 7f6f71b9b700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6f580a1150 0x7f6f580a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:59.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.197+0000 7f6f71b9b700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6f580a1150 0x7f6f580a3610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6f68000c00 tx=0x7f6f6800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:59.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.198+0000 7f6f62ffd700 1 -- 172.21.15.107:0/3903474280 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6f64095c30 con 0x7f6f6c1022f0 2023-08-10T10:48:59.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.396+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f6c02cbc0 con 0x7f6f6c1022f0 2023-08-10T10:48:59.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.396+0000 7f6f62ffd700 1 -- 172.21.15.107:0/3903474280 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f64099250 con 0x7f6f6c1022f0 2023-08-10T10:48:59.397 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:48:59.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6f580a1150 msgr2=0x7f6f580a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6f580a1150 0x7f6f580a3610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6f68000c00 tx=0x7f6f6800b260 comp rx=0 tx=0).stop 2023-08-10T10:48:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f6c1022f0 msgr2=0x7f6f6c19d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f6c1022f0 0x7f6f6c19d9c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400ada0 tx=0x7f6f6400c330 comp rx=0 tx=0).stop 2023-08-10T10:48:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 shutdown_connections 2023-08-10T10:48:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6f580a1150 0x7f6f580a3610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f6c100760 0x7f6f6c196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6f6c1022f0 0x7f6f6c19d9c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 --2- 172.21.15.107:0/3903474280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f6c101950 0x7f6f6c196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.398+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 >> 172.21.15.107:0/3903474280 conn(0x7f6f6c0fbcb0 msgr2=0x7f6f6c104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.399+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 shutdown_connections 2023-08-10T10:48:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.399+0000 7f6f73dff700 1 -- 172.21.15.107:0/3903474280 wait complete. 2023-08-10T10:48:59.418 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:48:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.616+0000 7f23a8fff700 1 -- 172.21.15.107:0/399555662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a41022f0 msgr2=0x7f23a4108ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.616+0000 7f23a8fff700 1 --2- 172.21.15.107:0/399555662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a41022f0 0x7f23a4108ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f239c00b0d0 tx=0x7f239c00b3e0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.616+0000 7f23a8fff700 1 -- 172.21.15.107:0/399555662 shutdown_connections 2023-08-10T10:48:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.616+0000 7f23a8fff700 1 --2- 172.21.15.107:0/399555662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23a4100760 0x7f23a4100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.616+0000 7f23a8fff700 1 --2- 172.21.15.107:0/399555662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a41022f0 0x7f23a4108ba0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.616+0000 7f23a8fff700 1 --2- 172.21.15.107:0/399555662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23a4101950 0x7f23a4101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.616+0000 7f23a8fff700 1 -- 172.21.15.107:0/399555662 >> 172.21.15.107:0/399555662 conn(0x7f23a40fbcb0 msgr2=0x7f23a40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:59.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.616+0000 7f23a8fff700 1 -- 172.21.15.107:0/399555662 shutdown_connections 2023-08-10T10:48:59.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.616+0000 7f23a8fff700 1 -- 172.21.15.107:0/399555662 wait complete. 2023-08-10T10:48:59.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.618+0000 7f23a8fff700 1 Processor -- start 2023-08-10T10:48:59.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.618+0000 7f23a8fff700 1 -- start start 2023-08-10T10:48:59.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.618+0000 7f23a8fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a4100760 0x7f23a4074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:59.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.618+0000 7f23a8fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23a4101950 0x7f23a4072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:59.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.618+0000 7f23a8fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23a41022f0 0x7f23a40730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:59.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a8fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4073840 con 0x7f23a4100760 2023-08-10T10:48:59.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a8fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a40739b0 con 0x7f23a4101950 2023-08-10T10:48:59.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a8fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41a0520 con 0x7f23a41022f0 2023-08-10T10:48:59.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a4100760 0x7f23a4074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:59.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a4100760 0x7f23a4074520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50742/0 (socket says 172.21.15.107:50742) 2023-08-10T10:48:59.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a259c700 1 -- 172.21.15.107:0/400995038 learned_addr learned my addr 172.21.15.107:0/400995038 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:48:59.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a2d9d700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23a41022f0 0x7f23a40730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:59.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a259c700 1 -- 172.21.15.107:0/400995038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23a41022f0 msgr2=0x7f23a40730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a1d9b700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23a4101950 0x7f23a4072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:59.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a259c700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23a41022f0 0x7f23a40730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a259c700 1 -- 172.21.15.107:0/400995038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23a4101950 msgr2=0x7f23a4072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a259c700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23a4101950 0x7f23a4072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a259c700 1 -- 172.21.15.107:0/400995038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c009d00 con 0x7f23a4100760 2023-08-10T10:48:59.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a2d9d700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23a41022f0 0x7f23a40730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:48:59.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a1d9b700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23a4101950 0x7f23a4072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:48:59.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.619+0000 7f23a259c700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a4100760 0x7f23a4074520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f239400d980 tx=0x7f239400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:59.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.620+0000 7f23937fe700 1 -- 172.21.15.107:0/400995038 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239400bb60 con 0x7f23a4100760 2023-08-10T10:48:59.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.620+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a41a0800 con 0x7f23a4100760 2023-08-10T10:48:59.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.620+0000 7f23937fe700 1 -- 172.21.15.107:0/400995038 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2394007620 con 0x7f23a4100760 2023-08-10T10:48:59.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.620+0000 7f23937fe700 1 -- 172.21.15.107:0/400995038 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239400f3c0 con 0x7f23a4100760 2023-08-10T10:48:59.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.620+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a41a0d10 con 0x7f23a4100760 2023-08-10T10:48:59.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.621+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a4107d40 con 0x7f23a4100760 2023-08-10T10:48:59.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.623+0000 7f23937fe700 1 -- 172.21.15.107:0/400995038 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2394010460 con 0x7f23a4100760 2023-08-10T10:48:59.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.624+0000 7f23937fe700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f238c0a1150 0x7f238c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:48:59.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.625+0000 7f23937fe700 1 -- 172.21.15.107:0/400995038 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f23940ccdc0 con 0x7f23a4100760 2023-08-10T10:48:59.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.625+0000 7f23a1d9b700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f238c0a1150 0x7f238c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:48:59.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.625+0000 7f23a1d9b700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f238c0a1150 0x7f238c0a3610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2398005e90 tx=0x7f2398005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:48:59.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.628+0000 7f23937fe700 1 -- 172.21.15.107:0/400995038 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f23940962c0 con 0x7f23a4100760 2023-08-10T10:48:59.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:59 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/996112349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:59.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:48:59 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3903474280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:48:59.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.828+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23a4061380 con 0x7f23a4100760 2023-08-10T10:48:59.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.829+0000 7f23937fe700 1 -- 172.21.15.107:0/400995038 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2394016020 con 0x7f23a4100760 2023-08-10T10:48:59.829 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:48:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f238c0a1150 msgr2=0x7f238c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f238c0a1150 0x7f238c0a3610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2398005e90 tx=0x7f2398005d20 comp rx=0 tx=0).stop 2023-08-10T10:48:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a4100760 msgr2=0x7f23a4074520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:48:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a4100760 0x7f23a4074520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f239400d980 tx=0x7f239400dd40 comp rx=0 tx=0).stop 2023-08-10T10:48:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 shutdown_connections 2023-08-10T10:48:59.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f238c0a1150 0x7f238c0a3610 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23a41022f0 0x7f23a40730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23a4100760 0x7f23a4074520 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 --2- 172.21.15.107:0/400995038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23a4101950 0x7f23a4072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:48:59.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 >> 172.21.15.107:0/400995038 conn(0x7f23a40fbcb0 msgr2=0x7f23a4104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:48:59.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 shutdown_connections 2023-08-10T10:48:59.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:48:59.831+0000 7f23a8fff700 1 -- 172.21.15.107:0/400995038 wait complete. 2023-08-10T10:48:59.850 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:48:59.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:59 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/996112349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:48:59.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:48:59 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3903474280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:49:00.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:59 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/996112349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:00.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:48:59 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3903474280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:49:00.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.049+0000 7ff896bff700 1 -- 172.21.15.107:0/1988318937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890074750 msgr2=0x7ff890072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.049+0000 7ff896bff700 1 --2- 172.21.15.107:0/1988318937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890074750 0x7ff890072ba0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff884009990 tx=0x7ff884009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.049+0000 7ff896bff700 1 -- 172.21.15.107:0/1988318937 shutdown_connections 2023-08-10T10:49:00.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.049+0000 7ff896bff700 1 --2- 172.21.15.107:0/1988318937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff890108630 0x7ff89010aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.049+0000 7ff896bff700 1 --2- 172.21.15.107:0/1988318937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890074750 0x7ff890072ba0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.049+0000 7ff896bff700 1 --2- 172.21.15.107:0/1988318937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff890073170 0x7ff8900735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.049+0000 7ff896bff700 1 -- 172.21.15.107:0/1988318937 >> 172.21.15.107:0/1988318937 conn(0x7ff8900fbcb0 msgr2=0x7ff8900fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:00.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.049+0000 7ff896bff700 1 -- 172.21.15.107:0/1988318937 shutdown_connections 2023-08-10T10:49:00.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.049+0000 7ff896bff700 1 -- 172.21.15.107:0/1988318937 wait complete. 2023-08-10T10:49:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.050+0000 7ff896bff700 1 Processor -- start 2023-08-10T10:49:00.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.050+0000 7ff896bff700 1 -- start start 2023-08-10T10:49:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff896bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff890073170 0x7ff890198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff896bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff890074750 0x7ff890198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff896bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890108630 0x7ff89019faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff896bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8901a00c0 con 0x7ff890108630 2023-08-10T10:49:00.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff896bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8901a0200 con 0x7ff890074750 2023-08-10T10:49:00.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff896bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8901a0390 con 0x7ff890073170 2023-08-10T10:49:00.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff89519c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890108630 0x7ff89019faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff89519c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890108630 0x7ff89019faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50766/0 (socket says 172.21.15.107:50766) 2023-08-10T10:49:00.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff89519c700 1 -- 172.21.15.107:0/3713286397 learned_addr learned my addr 172.21.15.107:0/3713286397 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:00.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.051+0000 7ff88ffff700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff890074750 0x7ff890198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff89499b700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff890073170 0x7ff890198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff89519c700 1 -- 172.21.15.107:0/3713286397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff890073170 msgr2=0x7ff890198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff89519c700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff890073170 0x7ff890198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff89519c700 1 -- 172.21.15.107:0/3713286397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff890074750 msgr2=0x7ff890198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff89519c700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff890074750 0x7ff890198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff89519c700 1 -- 172.21.15.107:0/3713286397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840095f0 con 0x7ff890108630 2023-08-10T10:49:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff88ffff700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff890074750 0x7ff890198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:00.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff89499b700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff890073170 0x7ff890198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:00.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff89519c700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890108630 0x7ff89019faf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff888007ee0 tx=0x7ff88800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:00.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff88dffb700 1 -- 172.21.15.107:0/3713286397 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888017070 con 0x7ff890108630 2023-08-10T10:49:00.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff88dffb700 1 -- 172.21.15.107:0/3713286397 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff88800f040 con 0x7ff890108630 2023-08-10T10:49:00.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8901a0670 con 0x7ff890108630 2023-08-10T10:49:00.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff88dffb700 1 -- 172.21.15.107:0/3713286397 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888005710 con 0x7ff890108630 2023-08-10T10:49:00.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.052+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8901a0b80 con 0x7ff890108630 2023-08-10T10:49:00.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.053+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff890106d30 con 0x7ff890108630 2023-08-10T10:49:00.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.055+0000 7ff88dffb700 1 -- 172.21.15.107:0/3713286397 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff888005870 con 0x7ff890108630 2023-08-10T10:49:00.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.057+0000 7ff88dffb700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff8800a11d0 0x7ff8800a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.057+0000 7ff88dffb700 1 -- 172.21.15.107:0/3713286397 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff8880cc3a0 con 0x7ff890108630 2023-08-10T10:49:00.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.057+0000 7ff89499b700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff8800a11d0 0x7ff8800a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.058+0000 7ff89499b700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff8800a11d0 0x7ff8800a3690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff88400b5c0 tx=0x7ff884000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:00.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.060+0000 7ff88dffb700 1 -- 172.21.15.107:0/3713286397 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff8880958a0 con 0x7ff890108630 2023-08-10T10:49:00.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.256+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff890061420 con 0x7ff890108630 2023-08-10T10:49:00.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.256+0000 7ff88dffb700 1 -- 172.21.15.107:0/3713286397 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff888095020 con 0x7ff890108630 2023-08-10T10:49:00.258 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T10:49:00.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff8800a11d0 msgr2=0x7ff8800a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff8800a11d0 0x7ff8800a3690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff88400b5c0 tx=0x7ff884000bc0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890108630 msgr2=0x7ff89019faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890108630 0x7ff89019faf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff888007ee0 tx=0x7ff88800d3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 shutdown_connections 2023-08-10T10:49:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff8800a11d0 0x7ff8800a3690 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff890108630 0x7ff89019faf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff890073170 0x7ff890198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 --2- 172.21.15.107:0/3713286397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff890074750 0x7ff890198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 >> 172.21.15.107:0/3713286397 conn(0x7ff8900fbcb0 msgr2=0x7ff8900fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 shutdown_connections 2023-08-10T10:49:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.259+0000 7ff896bff700 1 -- 172.21.15.107:0/3713286397 wait complete. 2023-08-10T10:49:00.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:49:00.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.478+0000 7f11db5ff700 1 -- 172.21.15.107:0/2369754249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4101950 msgr2=0x7f11d4101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.478+0000 7f11db5ff700 1 --2- 172.21.15.107:0/2369754249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4101950 0x7f11d4101db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f11c40099c0 tx=0x7f11c4009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.478+0000 7f11db5ff700 1 -- 172.21.15.107:0/2369754249 shutdown_connections 2023-08-10T10:49:00.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.478+0000 7f11db5ff700 1 --2- 172.21.15.107:0/2369754249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d41022f0 0x7f11d4108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.478+0000 7f11db5ff700 1 --2- 172.21.15.107:0/2369754249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11d4100760 0x7f11d4100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.478+0000 7f11db5ff700 1 --2- 172.21.15.107:0/2369754249 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4101950 0x7f11d4101db0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.478+0000 7f11db5ff700 1 -- 172.21.15.107:0/2369754249 >> 172.21.15.107:0/2369754249 conn(0x7f11d40fbcb0 msgr2=0x7f11d40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.478+0000 7f11db5ff700 1 -- 172.21.15.107:0/2369754249 shutdown_connections 2023-08-10T10:49:00.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.478+0000 7f11db5ff700 1 -- 172.21.15.107:0/2369754249 wait complete. 2023-08-10T10:49:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.479+0000 7f11db5ff700 1 Processor -- start 2023-08-10T10:49:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.479+0000 7f11db5ff700 1 -- start start 2023-08-10T10:49:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.479+0000 7f11db5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4100760 0x7f11d41986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.479+0000 7f11db5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11d4101950 0x7f11d4198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.479+0000 7f11db5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d41022f0 0x7f11d419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.479+0000 7f11db5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41a0250 con 0x7f11d4100760 2023-08-10T10:49:00.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.479+0000 7f11db5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41a0390 con 0x7f11d41022f0 2023-08-10T10:49:00.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.479+0000 7f11db5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41a0520 con 0x7f11d4101950 2023-08-10T10:49:00.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.479+0000 7f11d939b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4100760 0x7f11d41986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d939b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4100760 0x7f11d41986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50796/0 (socket says 172.21.15.107:50796) 2023-08-10T10:49:00.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d939b700 1 -- 172.21.15.107:0/606966448 learned_addr learned my addr 172.21.15.107:0/606966448 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:00.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d8b9a700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11d4101950 0x7f11d4198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d9b9c700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d41022f0 0x7f11d419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d939b700 1 -- 172.21.15.107:0/606966448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11d4101950 msgr2=0x7f11d4198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d939b700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11d4101950 0x7f11d4198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d939b700 1 -- 172.21.15.107:0/606966448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d41022f0 msgr2=0x7f11d419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d939b700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d41022f0 0x7f11d419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d939b700 1 -- 172.21.15.107:0/606966448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40095f0 con 0x7f11d4100760 2023-08-10T10:49:00.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d9b9c700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d41022f0 0x7f11d419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:00.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11d939b700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4100760 0x7f11d41986d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f11d000b500 tx=0x7f11d000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:00.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11ca7fc700 1 -- 172.21.15.107:0/606966448 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0011830 con 0x7f11d4100760 2023-08-10T10:49:00.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d41a0800 con 0x7f11d4100760 2023-08-10T10:49:00.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11ca7fc700 1 -- 172.21.15.107:0/606966448 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11d0011e20 con 0x7f11d4100760 2023-08-10T10:49:00.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.480+0000 7f11ca7fc700 1 -- 172.21.15.107:0/606966448 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0010dd0 con 0x7f11d4100760 2023-08-10T10:49:00.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.481+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d41a0d90 con 0x7f11d4100760 2023-08-10T10:49:00.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.482+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d410bf90 con 0x7f11d4100760 2023-08-10T10:49:00.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.484+0000 7f11ca7fc700 1 -- 172.21.15.107:0/606966448 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f11d0011990 con 0x7f11d4100760 2023-08-10T10:49:00.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.485+0000 7f11ca7fc700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f11c00a1150 0x7f11c00a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.485+0000 7f11ca7fc700 1 -- 172.21.15.107:0/606966448 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f11d00ccac0 con 0x7f11d4100760 2023-08-10T10:49:00.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.485+0000 7f11d8b9a700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f11c00a1150 0x7f11c00a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.486+0000 7f11d8b9a700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f11c00a1150 0x7f11c00a3610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009f50 tx=0x7f11c4005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:00.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.487+0000 7f11ca7fc700 1 -- 172.21.15.107:0/606966448 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f11d0095fc0 con 0x7f11d4100760 2023-08-10T10:49:00.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.690+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f11d41a1750 con 0x7f11d4100760 2023-08-10T10:49:00.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.690+0000 7f11ca7fc700 1 -- 172.21.15.107:0/606966448 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f11d0015020 con 0x7f11d4100760 2023-08-10T10:49:00.692 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:49:00.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.692+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f11c00a1150 msgr2=0x7f11c00a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.692+0000 7f11db5ff700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f11c00a1150 0x7f11c00a3610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009f50 tx=0x7f11c4005c00 comp rx=0 tx=0).stop 2023-08-10T10:49:00.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.692+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4100760 msgr2=0x7f11d41986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.692+0000 7f11db5ff700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4100760 0x7f11d41986d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f11d000b500 tx=0x7f11d000b8c0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.693+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 shutdown_connections 2023-08-10T10:49:00.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.693+0000 7f11db5ff700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f11c00a1150 0x7f11c00a3610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.693+0000 7f11db5ff700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11d41022f0 0x7f11d419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.693+0000 7f11db5ff700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11d4100760 0x7f11d41986d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.693+0000 7f11db5ff700 1 --2- 172.21.15.107:0/606966448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11d4101950 0x7f11d4198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.693+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 >> 172.21.15.107:0/606966448 conn(0x7f11d40fbcb0 msgr2=0x7f11d40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:00.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.693+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 shutdown_connections 2023-08-10T10:49:00.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.693+0000 7f11db5ff700 1 -- 172.21.15.107:0/606966448 wait complete. 2023-08-10T10:49:00.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:49:00.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.908+0000 7f68307ff700 1 -- 172.21.15.107:0/2145635201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828101950 msgr2=0x7f6828101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.908+0000 7f68307ff700 1 --2- 172.21.15.107:0/2145635201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828101950 0x7f6828101db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68180098f0 tx=0x7f6818009c00 comp rx=0 tx=0).stop 2023-08-10T10:49:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.908+0000 7f68307ff700 1 -- 172.21.15.107:0/2145635201 shutdown_connections 2023-08-10T10:49:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.908+0000 7f68307ff700 1 --2- 172.21.15.107:0/2145635201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6828100760 0x7f6828100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.908+0000 7f68307ff700 1 --2- 172.21.15.107:0/2145635201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68281022f0 0x7f6828108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.908+0000 7f68307ff700 1 --2- 172.21.15.107:0/2145635201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828101950 0x7f6828101db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.908+0000 7f68307ff700 1 -- 172.21.15.107:0/2145635201 >> 172.21.15.107:0/2145635201 conn(0x7f68280fbcb0 msgr2=0x7f68280fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:00.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.909+0000 7f68307ff700 1 -- 172.21.15.107:0/2145635201 shutdown_connections 2023-08-10T10:49:00.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.909+0000 7f68307ff700 1 -- 172.21.15.107:0/2145635201 wait complete. 2023-08-10T10:49:00.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f68307ff700 1 Processor -- start 2023-08-10T10:49:00.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f68307ff700 1 -- start start 2023-08-10T10:49:00.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f68307ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828100760 0x7f6828196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f68307ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6828101950 0x7f6828196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f68307ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68281022f0 0x7f682819d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f68307ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682819df90 con 0x7f68281022f0 2023-08-10T10:49:00.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f68307ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682819e0d0 con 0x7f6828101950 2023-08-10T10:49:00.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f68307ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682819e260 con 0x7f6828100760 2023-08-10T10:49:00.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f682ed9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68281022f0 0x7f682819d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f682e59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828100760 0x7f6828196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f682e59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828100760 0x7f6828196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:39854/0 (socket says 172.21.15.107:39854) 2023-08-10T10:49:00.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.910+0000 7f682e59b700 1 -- 172.21.15.107:0/3835696508 learned_addr learned my addr 172.21.15.107:0/3835696508 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:00.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f682dd9a700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6828101950 0x7f6828196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f682e59b700 1 -- 172.21.15.107:0/3835696508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6828101950 msgr2=0x7f6828196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f682e59b700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6828101950 0x7f6828196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f682e59b700 1 -- 172.21.15.107:0/3835696508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68281022f0 msgr2=0x7f682819d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:00.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f682e59b700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68281022f0 0x7f682819d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:00.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f682e59b700 1 -- 172.21.15.107:0/3835696508 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820009c40 con 0x7f6828100760 2023-08-10T10:49:00.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f682dd9a700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6828101950 0x7f6828196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:00.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f682e59b700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828100760 0x7f6828196410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f682400e9f0 tx=0x7f682400edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:00.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f681f7fe700 1 -- 172.21.15.107:0/3835696508 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824009ea0 con 0x7f6828100760 2023-08-10T10:49:00.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f681f7fe700 1 -- 172.21.15.107:0/3835696508 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68240044b0 con 0x7f6828100760 2023-08-10T10:49:00.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6818009520 con 0x7f6828100760 2023-08-10T10:49:00.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f681f7fe700 1 -- 172.21.15.107:0/3835696508 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824003bd0 con 0x7f6828100760 2023-08-10T10:49:00.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.911+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682819e910 con 0x7f6828100760 2023-08-10T10:49:00.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:00 smithi195 ceph-mon[129938]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 342 B/s wr, 0 op/s 2023-08-10T10:49:00.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:00 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/400995038' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:49:00.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:00 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3713286397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:49:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.912+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682810be30 con 0x7f6828100760 2023-08-10T10:49:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.915+0000 7f681f7fe700 1 -- 172.21.15.107:0/3835696508 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6824003d30 con 0x7f6828100760 2023-08-10T10:49:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.916+0000 7f681f7fe700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68140a11d0 0x7f68140a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.916+0000 7f681f7fe700 1 -- 172.21.15.107:0/3835696508 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6824014070 con 0x7f6828100760 2023-08-10T10:49:00.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.917+0000 7f682dd9a700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68140a11d0 0x7f68140a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:00.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.917+0000 7f682dd9a700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68140a11d0 0x7f68140a3690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f681800fa00 tx=0x7f6818019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:00.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:00.919+0000 7f681f7fe700 1 -- 172.21.15.107:0/3835696508 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6824096270 con 0x7f6828100760 2023-08-10T10:49:01.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:00 smithi157 ceph-mon[129604]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 342 B/s wr, 0 op/s 2023-08-10T10:49:01.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:00 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/400995038' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:49:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:00 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3713286397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:49:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:00 smithi107 ceph-mon[127953]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 342 B/s wr, 0 op/s 2023-08-10T10:49:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/400995038' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:49:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3713286397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:49:01.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.137+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f68281077d0 con 0x7f6828100760 2023-08-10T10:49:01.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.138+0000 7f681f7fe700 1 -- 172.21.15.107:0/3835696508 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+599 (secure 0 0 0) 0x7f6824099890 con 0x7f6828100760 2023-08-10T10:49:01.139 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/294010818 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:01.139 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/294010818 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:01.140 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2325198765 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:01.140 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/4249017598 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:01.140 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/155446065 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:01.140 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2780861048 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:01.140 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/4026286774 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:01.140 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/4026286774 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:01.140 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2396317165 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:01.141 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2565207558 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:01.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68140a11d0 msgr2=0x7f68140a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68140a11d0 0x7f68140a3690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f681800fa00 tx=0x7f6818019040 comp rx=0 tx=0).stop 2023-08-10T10:49:01.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828100760 msgr2=0x7f6828196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828100760 0x7f6828196410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f682400e9f0 tx=0x7f682400edb0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 shutdown_connections 2023-08-10T10:49:01.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68140a11d0 0x7f68140a3690 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68281022f0 0x7f682819d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6828100760 0x7f6828196410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 --2- 172.21.15.107:0/3835696508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6828101950 0x7f6828196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.140+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 >> 172.21.15.107:0/3835696508 conn(0x7f68280fbcb0 msgr2=0x7f68280fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:01.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.141+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 shutdown_connections 2023-08-10T10:49:01.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.141+0000 7f68307ff700 1 -- 172.21.15.107:0/3835696508 wait complete. 2023-08-10T10:49:01.143 INFO:teuthology.orchestra.run.smithi107.stderr:listed 10 entries 2023-08-10T10:49:01.160 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:49:01.160 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:49:01.204 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:49:01.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.440+0000 7f05e69ff700 1 -- 172.21.15.107:0/4264649056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0101960 msgr2=0x7f05e0101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.440+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4264649056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0101960 0x7f05e0101dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f05d40099c0 tx=0x7f05d4009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.440+0000 7f05e69ff700 1 -- 172.21.15.107:0/4264649056 shutdown_connections 2023-08-10T10:49:01.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.440+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4264649056 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05e0100770 0x7f05e0100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.440+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4264649056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05e0102300 0x7f05e0108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.440+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4264649056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0101960 0x7f05e0101dc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.440+0000 7f05e69ff700 1 -- 172.21.15.107:0/4264649056 >> 172.21.15.107:0/4264649056 conn(0x7f05e00fbca0 msgr2=0x7f05e00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:01.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.440+0000 7f05e69ff700 1 -- 172.21.15.107:0/4264649056 shutdown_connections 2023-08-10T10:49:01.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.440+0000 7f05e69ff700 1 -- 172.21.15.107:0/4264649056 wait complete. 2023-08-10T10:49:01.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.441+0000 7f05e69ff700 1 Processor -- start 2023-08-10T10:49:01.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.441+0000 7f05e69ff700 1 -- start start 2023-08-10T10:49:01.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.441+0000 7f05e69ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05e0100770 0x7f05e0196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:01.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e69ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05e0101960 0x7f05e01968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:01.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e69ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0102300 0x7f05e019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:01.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e69ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e019df00 con 0x7f05e0102300 2023-08-10T10:49:01.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e69ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e019e040 con 0x7f05e0100770 2023-08-10T10:49:01.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e69ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e019e1d0 con 0x7f05e0101960 2023-08-10T10:49:01.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e4f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0102300 0x7f05e019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:01.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05dffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05e0100770 0x7f05e0196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:01.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05dffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05e0100770 0x7f05e0196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:60906/0 (socket says 172.21.15.107:60906) 2023-08-10T10:49:01.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e4f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0102300 0x7f05e019d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50842/0 (socket says 172.21.15.107:50842) 2023-08-10T10:49:01.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05dffff700 1 -- 172.21.15.107:0/4118742965 learned_addr learned my addr 172.21.15.107:0/4118742965 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:01.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05df7fe700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05e0101960 0x7f05e01968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:01.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e4f9c700 1 -- 172.21.15.107:0/4118742965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05e0101960 msgr2=0x7f05e01968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e4f9c700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05e0101960 0x7f05e01968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e4f9c700 1 -- 172.21.15.107:0/4118742965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05e0100770 msgr2=0x7f05e0196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e4f9c700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05e0100770 0x7f05e0196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05e4f9c700 1 -- 172.21.15.107:0/4118742965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40095f0 con 0x7f05e0102300 2023-08-10T10:49:01.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.442+0000 7f05dffff700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05e0100770 0x7f05e0196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:49:01.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.443+0000 7f05e4f9c700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0102300 0x7f05e019d930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05d8007f10 tx=0x7f05d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.443+0000 7f05dd7fa700 1 -- 172.21.15.107:0/4118742965 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8004db0 con 0x7f05e0102300 2023-08-10T10:49:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.443+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e019e4b0 con 0x7f05e0102300 2023-08-10T10:49:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.443+0000 7f05dd7fa700 1 -- 172.21.15.107:0/4118742965 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05d800f040 con 0x7f05e0102300 2023-08-10T10:49:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.443+0000 7f05dd7fa700 1 -- 172.21.15.107:0/4118742965 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8005960 con 0x7f05e0102300 2023-08-10T10:49:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.443+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e019e9c0 con 0x7f05e0102300 2023-08-10T10:49:01.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.444+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e010be90 con 0x7f05e0102300 2023-08-10T10:49:01.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.446+0000 7f05dd7fa700 1 -- 172.21.15.107:0/4118742965 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f05d800db20 con 0x7f05e0102300 2023-08-10T10:49:01.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.447+0000 7f05dd7fa700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c80a11a0 0x7f05c80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:01.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.447+0000 7f05dd7fa700 1 -- 172.21.15.107:0/4118742965 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f05d80cc420 con 0x7f05e0102300 2023-08-10T10:49:01.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.448+0000 7f05dffff700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c80a11a0 0x7f05c80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:01.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.448+0000 7f05dffff700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c80a11a0 0x7f05c80a3660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05d00105c0 tx=0x7f05d000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:01.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.451+0000 7f05dd7fa700 1 -- 172.21.15.107:0/4118742965 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f05d804e790 con 0x7f05e0102300 2023-08-10T10:49:01.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.651+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05e010c080 con 0x7f05e0102300 2023-08-10T10:49:01.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.653+0000 7f05dd7fa700 1 -- 172.21.15.107:0/4118742965 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24017 (secure 0 0 0) 0x7f05d8095920 con 0x7f05e0102300 2023-08-10T10:49:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:01.655 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":89,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:48:47.109986+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:01.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c80a11a0 msgr2=0x7f05c80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c80a11a0 0x7f05c80a3660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05d00105c0 tx=0x7f05d000b4a0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0102300 msgr2=0x7f05e019d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0102300 0x7f05e019d930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05d8007f10 tx=0x7f05d800d3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 shutdown_connections 2023-08-10T10:49:01.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f05c80a11a0 0x7f05c80a3660 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05e0100770 0x7f05e0196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05e0102300 0x7f05e019d930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 --2- 172.21.15.107:0/4118742965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05e0101960 0x7f05e01968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.655+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 >> 172.21.15.107:0/4118742965 conn(0x7f05e00fbca0 msgr2=0x7f05e00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.656+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 shutdown_connections 2023-08-10T10:49:01.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.656+0000 7f05e69ff700 1 -- 172.21.15.107:0/4118742965 wait complete. 2023-08-10T10:49:01.676 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:49:01.676 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:49:01.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.875+0000 7fce2c1ff700 1 -- 172.21.15.107:0/4290885281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24074750 msgr2=0x7fce24072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.875+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/4290885281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24074750 0x7fce24072ba0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce20009990 tx=0x7fce20009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.875+0000 7fce2c1ff700 1 -- 172.21.15.107:0/4290885281 shutdown_connections 2023-08-10T10:49:01.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.875+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/4290885281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce24108630 0x7fce2410aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.875+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/4290885281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24074750 0x7fce24072ba0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.875+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/4290885281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce24073170 0x7fce240735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.875+0000 7fce2c1ff700 1 -- 172.21.15.107:0/4290885281 >> 172.21.15.107:0/4290885281 conn(0x7fce240fbcb0 msgr2=0x7fce240fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:01.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.875+0000 7fce2c1ff700 1 -- 172.21.15.107:0/4290885281 shutdown_connections 2023-08-10T10:49:01.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.875+0000 7fce2c1ff700 1 -- 172.21.15.107:0/4290885281 wait complete. 2023-08-10T10:49:01.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce2c1ff700 1 Processor -- start 2023-08-10T10:49:01.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce2c1ff700 1 -- start start 2023-08-10T10:49:01.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce2c1ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24073170 0x7fce241985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:01.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce2c1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce24074750 0x7fce24198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:01.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce2c1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce24108630 0x7fce2419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:01.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce2c1ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce241a0120 con 0x7fce24073170 2023-08-10T10:49:01.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce2c1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce241a0260 con 0x7fce24074750 2023-08-10T10:49:01.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce2c1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce241a03f0 con 0x7fce24108630 2023-08-10T10:49:01.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce29f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24073170 0x7fce241985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:01.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce29f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24073170 0x7fce241985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50868/0 (socket says 172.21.15.107:50868) 2023-08-10T10:49:01.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.876+0000 7fce29f9b700 1 -- 172.21.15.107:0/3622018168 learned_addr learned my addr 172.21.15.107:0/3622018168 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:01.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce2979a700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce24074750 0x7fce24198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:01.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce2a79c700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce24108630 0x7fce2419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:01.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce29f9b700 1 -- 172.21.15.107:0/3622018168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce24108630 msgr2=0x7fce2419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce29f9b700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce24108630 0x7fce2419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce29f9b700 1 -- 172.21.15.107:0/3622018168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce24074750 msgr2=0x7fce24198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:01.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce29f9b700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce24074750 0x7fce24198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:01.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce29f9b700 1 -- 172.21.15.107:0/3622018168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce200095f0 con 0x7fce24073170 2023-08-10T10:49:01.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce2a79c700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce24108630 0x7fce2419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:01.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce29f9b700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24073170 0x7fce241985a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fce20005910 tx=0x7fce20005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:01.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce1affd700 1 -- 172.21.15.107:0/3622018168 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2001d070 con 0x7fce24073170 2023-08-10T10:49:01.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce241a0670 con 0x7fce24073170 2023-08-10T10:49:01.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce1affd700 1 -- 172.21.15.107:0/3622018168 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce2000be70 con 0x7fce24073170 2023-08-10T10:49:01.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.877+0000 7fce1affd700 1 -- 172.21.15.107:0/3622018168 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20022ea0 con 0x7fce24073170 2023-08-10T10:49:01.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.878+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce241a0af0 con 0x7fce24073170 2023-08-10T10:49:01.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.879+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce24106d30 con 0x7fce24073170 2023-08-10T10:49:01.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.880+0000 7fce1affd700 1 -- 172.21.15.107:0/3622018168 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fce20022670 con 0x7fce24073170 2023-08-10T10:49:01.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.882+0000 7fce1affd700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce100a1150 0x7fce100a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:01.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.882+0000 7fce1affd700 1 -- 172.21.15.107:0/3622018168 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fce200cdf20 con 0x7fce24073170 2023-08-10T10:49:01.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.882+0000 7fce2979a700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce100a1150 0x7fce100a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:01.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.882+0000 7fce2979a700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce100a1150 0x7fce100a3610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fce14009c60 tx=0x7fce14009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:01.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:01.885+0000 7fce1affd700 1 -- 172.21.15.107:0/3622018168 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fce2005c790 con 0x7fce24073170 2023-08-10T10:49:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:01 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/606966448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:49:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:01 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3835696508' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T10:49:02.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:01 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4118742965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:01 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/606966448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:49:02.122 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:01 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3835696508' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T10:49:02.122 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:01 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4118742965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:02.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.083+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce24061380 con 0x7fce24073170 2023-08-10T10:49:02.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.084+0000 7fce1affd700 1 -- 172.21.15.107:0/3622018168 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce200270a0 con 0x7fce24073170 2023-08-10T10:49:02.123 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:49:02.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce100a1150 msgr2=0x7fce100a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce100a1150 0x7fce100a3610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fce14009c60 tx=0x7fce14009260 comp rx=0 tx=0).stop 2023-08-10T10:49:02.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24073170 msgr2=0x7fce241985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24073170 0x7fce241985a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fce20005910 tx=0x7fce20005740 comp rx=0 tx=0).stop 2023-08-10T10:49:02.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 shutdown_connections 2023-08-10T10:49:02.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce100a1150 0x7fce100a3610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce24108630 0x7fce2419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce24073170 0x7fce241985a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 --2- 172.21.15.107:0/3622018168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce24074750 0x7fce24198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 >> 172.21.15.107:0/3622018168 conn(0x7fce240fbcb0 msgr2=0x7fce240fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:02.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 shutdown_connections 2023-08-10T10:49:02.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.086+0000 7fce2c1ff700 1 -- 172.21.15.107:0/3622018168 wait complete. 2023-08-10T10:49:02.128 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:49:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:01 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/606966448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:49:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:01 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3835696508' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T10:49:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:01 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4118742965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:02.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.326+0000 7ff2067ff700 1 -- 172.21.15.107:0/4090009338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 msgr2=0x7ff200108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.326+0000 7ff2067ff700 1 --2- 172.21.15.107:0/4090009338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 0x7ff200108bc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800b0d0 tx=0x7ff1f800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.326+0000 7ff2067ff700 1 -- 172.21.15.107:0/4090009338 shutdown_connections 2023-08-10T10:49:02.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.326+0000 7ff2067ff700 1 --2- 172.21.15.107:0/4090009338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 0x7ff200108bc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.326+0000 7ff2067ff700 1 --2- 172.21.15.107:0/4090009338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff200100780 0x7ff200100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.326+0000 7ff2067ff700 1 --2- 172.21.15.107:0/4090009338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff200101970 0x7ff200101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.326+0000 7ff2067ff700 1 -- 172.21.15.107:0/4090009338 >> 172.21.15.107:0/4090009338 conn(0x7ff2000fbcf0 msgr2=0x7ff2000fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:02.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.326+0000 7ff2067ff700 1 -- 172.21.15.107:0/4090009338 shutdown_connections 2023-08-10T10:49:02.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.326+0000 7ff2067ff700 1 -- 172.21.15.107:0/4090009338 wait complete. 2023-08-10T10:49:02.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.328+0000 7ff2067ff700 1 Processor -- start 2023-08-10T10:49:02.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.328+0000 7ff2067ff700 1 -- start start 2023-08-10T10:49:02.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.328+0000 7ff2067ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff200100780 0x7ff200196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:02.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.328+0000 7ff2067ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff200101970 0x7ff2001969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:02.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.328+0000 7ff2067ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 0x7ff20019da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:02.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.328+0000 7ff2067ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20019dfe0 con 0x7ff200102310 2023-08-10T10:49:02.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.328+0000 7ff2067ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20019e120 con 0x7ff200101970 2023-08-10T10:49:02.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.328+0000 7ff2067ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20019e2b0 con 0x7ff200100780 2023-08-10T10:49:02.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff204d9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 0x7ff20019da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:02.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff204d9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 0x7ff20019da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50900/0 (socket says 172.21.15.107:50900) 2023-08-10T10:49:02.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff204d9c700 1 -- 172.21.15.107:0/710703930 learned_addr learned my addr 172.21.15.107:0/710703930 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:02.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff1fffff700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff200100780 0x7ff200196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:02.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff1ff7fe700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff200101970 0x7ff2001969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:02.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff204d9c700 1 -- 172.21.15.107:0/710703930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff200100780 msgr2=0x7ff200196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff204d9c700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff200100780 0x7ff200196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff204d9c700 1 -- 172.21.15.107:0/710703930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff200101970 msgr2=0x7ff2001969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff204d9c700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff200101970 0x7ff2001969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff204d9c700 1 -- 172.21.15.107:0/710703930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f4009520 con 0x7ff200102310 2023-08-10T10:49:02.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff1ff7fe700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff200101970 0x7ff2001969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:02.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff204d9c700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 0x7ff20019da10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8007850 tx=0x7ff1f8007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:02.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff1fd7fa700 1 -- 172.21.15.107:0/710703930 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800e040 con 0x7ff200102310 2023-08-10T10:49:02.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff1fd7fa700 1 -- 172.21.15.107:0/710703930 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1f8003c00 con 0x7ff200102310 2023-08-10T10:49:02.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f8009d00 con 0x7ff200102310 2023-08-10T10:49:02.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.329+0000 7ff1fd7fa700 1 -- 172.21.15.107:0/710703930 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f801b6c0 con 0x7ff200102310 2023-08-10T10:49:02.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.330+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20019e820 con 0x7ff200102310 2023-08-10T10:49:02.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.331+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff200107d90 con 0x7ff200102310 2023-08-10T10:49:02.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.332+0000 7ff1fd7fa700 1 -- 172.21.15.107:0/710703930 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff1f8024410 con 0x7ff200102310 2023-08-10T10:49:02.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.334+0000 7ff1fd7fa700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff1e80a11d0 0x7ff1e80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:02.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.334+0000 7ff1fd7fa700 1 -- 172.21.15.107:0/710703930 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff1f80cdd30 con 0x7ff200102310 2023-08-10T10:49:02.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.334+0000 7ff1fffff700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff1e80a11d0 0x7ff1e80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:02.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.335+0000 7ff1fffff700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff1e80a11d0 0x7ff1e80a3690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff2001017d0 tx=0x7ff1f000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:02.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.337+0000 7ff1fd7fa700 1 -- 172.21.15.107:0/710703930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff1f80972c0 con 0x7ff200102310 2023-08-10T10:49:02.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.538+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff200061420 con 0x7ff200102310 2023-08-10T10:49:02.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.539+0000 7ff1fd7fa700 1 -- 172.21.15.107:0/710703930 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1f809a8e0 con 0x7ff200102310 2023-08-10T10:49:02.540 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:49:02.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff1e80a11d0 msgr2=0x7ff1e80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff1e80a11d0 0x7ff1e80a3690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff2001017d0 tx=0x7ff1f000b410 comp rx=0 tx=0).stop 2023-08-10T10:49:02.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 msgr2=0x7ff20019da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 0x7ff20019da10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8007850 tx=0x7ff1f8007880 comp rx=0 tx=0).stop 2023-08-10T10:49:02.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 shutdown_connections 2023-08-10T10:49:02.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff1e80a11d0 0x7ff1e80a3690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff200102310 0x7ff20019da10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff200100780 0x7ff200196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 --2- 172.21.15.107:0/710703930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff200101970 0x7ff2001969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 >> 172.21.15.107:0/710703930 conn(0x7ff2000fbcf0 msgr2=0x7ff200104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:02.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 shutdown_connections 2023-08-10T10:49:02.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.541+0000 7ff2067ff700 1 -- 172.21.15.107:0/710703930 wait complete. 2023-08-10T10:49:02.560 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:49:02.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.763+0000 7f0146fff700 1 -- 172.21.15.107:0/1163900845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0140101950 msgr2=0x7f0140101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.763+0000 7f0146fff700 1 --2- 172.21.15.107:0/1163900845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0140101950 0x7f0140101db0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f012c0099c0 tx=0x7f012c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.763+0000 7f0146fff700 1 -- 172.21.15.107:0/1163900845 shutdown_connections 2023-08-10T10:49:02.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.764+0000 7f0146fff700 1 --2- 172.21.15.107:0/1163900845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0140100760 0x7f0140100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.764+0000 7f0146fff700 1 --2- 172.21.15.107:0/1163900845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01401022f0 0x7f0140108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.764+0000 7f0146fff700 1 --2- 172.21.15.107:0/1163900845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0140101950 0x7f0140101db0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.764+0000 7f0146fff700 1 -- 172.21.15.107:0/1163900845 >> 172.21.15.107:0/1163900845 conn(0x7f01400fbcb0 msgr2=0x7f01400fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:02.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.764+0000 7f0146fff700 1 -- 172.21.15.107:0/1163900845 shutdown_connections 2023-08-10T10:49:02.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.764+0000 7f0146fff700 1 -- 172.21.15.107:0/1163900845 wait complete. 2023-08-10T10:49:02.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f0146fff700 1 Processor -- start 2023-08-10T10:49:02.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f0146fff700 1 -- start start 2023-08-10T10:49:02.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f0146fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140100760 0x7f0140074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:02.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f0146fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0140101950 0x7f0140072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:02.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f0146fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01401022f0 0x7f01400730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:02.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f0146fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140073840 con 0x7f01401022f0 2023-08-10T10:49:02.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f0146fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01400739b0 con 0x7f0140101950 2023-08-10T10:49:02.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f0146fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01401a03d0 con 0x7f0140100760 2023-08-10T10:49:02.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f014559c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01401022f0 0x7f01400730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:02.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f014559c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01401022f0 0x7f01400730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50914/0 (socket says 172.21.15.107:50914) 2023-08-10T10:49:02.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f014559c700 1 -- 172.21.15.107:0/3029717011 learned_addr learned my addr 172.21.15.107:0/3029717011 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:02.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.765+0000 7f013ffff700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0140101950 0x7f0140072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:02.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f0144d9b700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140100760 0x7f0140074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:02.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f014559c700 1 -- 172.21.15.107:0/3029717011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140100760 msgr2=0x7f0140074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f014559c700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140100760 0x7f0140074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f014559c700 1 -- 172.21.15.107:0/3029717011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0140101950 msgr2=0x7f0140072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f014559c700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0140101950 0x7f0140072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f014559c700 1 -- 172.21.15.107:0/3029717011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0095f0 con 0x7f01401022f0 2023-08-10T10:49:02.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f014559c700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01401022f0 0x7f01400730a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0138007ee0 tx=0x7f013800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:02.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f013dffb700 1 -- 172.21.15.107:0/3029717011 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138017070 con 0x7f01401022f0 2023-08-10T10:49:02.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f013dffb700 1 -- 172.21.15.107:0/3029717011 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f013800f040 con 0x7f01401022f0 2023-08-10T10:49:02.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01401a06b0 con 0x7f01401022f0 2023-08-10T10:49:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f013dffb700 1 -- 172.21.15.107:0/3029717011 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138005710 con 0x7f01401022f0 2023-08-10T10:49:02.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.766+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01401a0bc0 con 0x7f01401022f0 2023-08-10T10:49:02.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.767+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140107740 con 0x7f01401022f0 2023-08-10T10:49:02.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.769+0000 7f013dffb700 1 -- 172.21.15.107:0/3029717011 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f0138005870 con 0x7f01401022f0 2023-08-10T10:49:02.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.771+0000 7f013dffb700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01300a11d0 0x7f01300a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:02.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.771+0000 7f013dffb700 1 -- 172.21.15.107:0/3029717011 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f01380cc940 con 0x7f01401022f0 2023-08-10T10:49:02.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.771+0000 7f0144d9b700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01300a11d0 0x7f01300a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:02.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.771+0000 7f0144d9b700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01300a11d0 0x7f01300a3690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01401017b0 tx=0x7f0134009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:02.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.772+0000 7f013dffb700 1 -- 172.21.15.107:0/3029717011 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0138095e40 con 0x7f01401022f0 2023-08-10T10:49:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:02 smithi107 ceph-mon[127953]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:02 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3622018168' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:49:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:02 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/710703930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:49:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.973+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f014002cb00 con 0x7f01401022f0 2023-08-10T10:49:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.974+0000 7f013dffb700 1 -- 172.21.15.107:0/3029717011 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0138099460 con 0x7f01401022f0 2023-08-10T10:49:02.975 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T10:49:02.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01300a11d0 msgr2=0x7f01300a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01300a11d0 0x7f01300a3690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01401017b0 tx=0x7f0134009260 comp rx=0 tx=0).stop 2023-08-10T10:49:02.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01401022f0 msgr2=0x7f01400730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:02.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01401022f0 0x7f01400730a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0138007ee0 tx=0x7f013800d3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 shutdown_connections 2023-08-10T10:49:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01300a11d0 0x7f01300a3690 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01401022f0 0x7f01400730a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0140100760 0x7f0140074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 --2- 172.21.15.107:0/3029717011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0140101950 0x7f0140072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 >> 172.21.15.107:0/3029717011 conn(0x7f01400fbcb0 msgr2=0x7f01400fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 shutdown_connections 2023-08-10T10:49:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:02.976+0000 7f0146fff700 1 -- 172.21.15.107:0/3029717011 wait complete. 2023-08-10T10:49:02.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:49:03.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:02 smithi157 ceph-mon[129604]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:03.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:02 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3622018168' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:49:03.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:02 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/710703930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:49:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:02 smithi195 ceph-mon[129938]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:02 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3622018168' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:49:03.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:02 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/710703930' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:49:03.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.196+0000 7f4866dff700 1 -- 172.21.15.107:0/1101019183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860100760 msgr2=0x7f4860100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.196+0000 7f4866dff700 1 --2- 172.21.15.107:0/1101019183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860100760 0x7f4860100b80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f48540099c0 tx=0x7f4854009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.196+0000 7f4866dff700 1 -- 172.21.15.107:0/1101019183 shutdown_connections 2023-08-10T10:49:03.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.196+0000 7f4866dff700 1 --2- 172.21.15.107:0/1101019183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48601022f0 0x7f4860108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.196+0000 7f4866dff700 1 --2- 172.21.15.107:0/1101019183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860100760 0x7f4860100b80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.196+0000 7f4866dff700 1 --2- 172.21.15.107:0/1101019183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4860101950 0x7f4860101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.196+0000 7f4866dff700 1 -- 172.21.15.107:0/1101019183 >> 172.21.15.107:0/1101019183 conn(0x7f48600fbcb0 msgr2=0x7f48600fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:03.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.196+0000 7f4866dff700 1 -- 172.21.15.107:0/1101019183 shutdown_connections 2023-08-10T10:49:03.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.196+0000 7f4866dff700 1 -- 172.21.15.107:0/1101019183 wait complete. 2023-08-10T10:49:03.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.197+0000 7f4866dff700 1 Processor -- start 2023-08-10T10:49:03.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.197+0000 7f4866dff700 1 -- start start 2023-08-10T10:49:03.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.197+0000 7f4866dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4860100760 0x7f4860196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:03.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.197+0000 7f4866dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860101950 0x7f4860196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:03.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.197+0000 7f4866dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48601022f0 0x7f486019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:03.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.197+0000 7f4866dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486019dfa0 con 0x7f4860101950 2023-08-10T10:49:03.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.197+0000 7f4866dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486019e0e0 con 0x7f4860100760 2023-08-10T10:49:03.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.197+0000 7f4866dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486019e270 con 0x7f48601022f0 2023-08-10T10:49:03.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f485ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860101950 0x7f4860196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:03.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f485ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860101950 0x7f4860196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43954/0 (socket says 172.21.15.107:43954) 2023-08-10T10:49:03.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f485ffff700 1 -- 172.21.15.107:0/4008088993 learned_addr learned my addr 172.21.15.107:0/4008088993 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:03.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f4864b9b700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4860100760 0x7f4860196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:03.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f486539c700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48601022f0 0x7f486019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:03.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f485ffff700 1 -- 172.21.15.107:0/4008088993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48601022f0 msgr2=0x7f486019d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f485ffff700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48601022f0 0x7f486019d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f485ffff700 1 -- 172.21.15.107:0/4008088993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4860100760 msgr2=0x7f4860196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f485ffff700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4860100760 0x7f4860196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f485ffff700 1 -- 172.21.15.107:0/4008088993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540095f0 con 0x7f4860101950 2023-08-10T10:49:03.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.198+0000 7f485ffff700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860101950 0x7f4860196960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f484c00d950 tx=0x7f484c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:03.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.199+0000 7f485dffb700 1 -- 172.21.15.107:0/4008088993 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c009940 con 0x7f4860101950 2023-08-10T10:49:03.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.199+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486019e550 con 0x7f4860101950 2023-08-10T10:49:03.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.199+0000 7f485dffb700 1 -- 172.21.15.107:0/4008088993 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f484c010460 con 0x7f4860101950 2023-08-10T10:49:03.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.199+0000 7f485dffb700 1 -- 172.21.15.107:0/4008088993 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c00f620 con 0x7f4860101950 2023-08-10T10:49:03.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.199+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486019ea60 con 0x7f4860101950 2023-08-10T10:49:03.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.200+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486010be80 con 0x7f4860101950 2023-08-10T10:49:03.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.202+0000 7f485dffb700 1 -- 172.21.15.107:0/4008088993 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f484c0105d0 con 0x7f4860101950 2023-08-10T10:49:03.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.203+0000 7f485dffb700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48500a1150 0x7f48500a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:03.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.203+0000 7f485dffb700 1 -- 172.21.15.107:0/4008088993 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f484c0cc9b0 con 0x7f4860101950 2023-08-10T10:49:03.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.203+0000 7f4864b9b700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48500a1150 0x7f48500a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:03.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.204+0000 7f4864b9b700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48500a1150 0x7f48500a3610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4854006010 tx=0x7f4854005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:03.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.207+0000 7f485dffb700 1 -- 172.21.15.107:0/4008088993 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f484c095eb0 con 0x7f4860101950 2023-08-10T10:49:03.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.407+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4860107740 con 0x7f4860101950 2023-08-10T10:49:03.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.407+0000 7f485dffb700 1 -- 172.21.15.107:0/4008088993 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7f484c0160a0 con 0x7f4860101950 2023-08-10T10:49:03.409 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:49:03.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.409+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48500a1150 msgr2=0x7f48500a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.409+0000 7f4866dff700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48500a1150 0x7f48500a3610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4854006010 tx=0x7f4854005e80 comp rx=0 tx=0).stop 2023-08-10T10:49:03.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.409+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860101950 msgr2=0x7f4860196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.409+0000 7f4866dff700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860101950 0x7f4860196960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f484c00d950 tx=0x7f484c00dc60 comp rx=0 tx=0).stop 2023-08-10T10:49:03.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.410+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 shutdown_connections 2023-08-10T10:49:03.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.410+0000 7f4866dff700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48500a1150 0x7f48500a3610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.410+0000 7f4866dff700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4860100760 0x7f4860196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.410+0000 7f4866dff700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48601022f0 0x7f486019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.410+0000 7f4866dff700 1 --2- 172.21.15.107:0/4008088993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4860101950 0x7f4860196960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.410+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 >> 172.21.15.107:0/4008088993 conn(0x7f48600fbcb0 msgr2=0x7f48600fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:03.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.410+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 shutdown_connections 2023-08-10T10:49:03.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.410+0000 7f4866dff700 1 -- 172.21.15.107:0/4008088993 wait complete. 2023-08-10T10:49:03.429 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:49:03.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.627+0000 7f6862bff700 1 -- 172.21.15.107:0/1041556743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 msgr2=0x7f685c1035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.627+0000 7f6862bff700 1 --2- 172.21.15.107:0/1041556743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 0x7f685c1035d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6850009990 tx=0x7f6850009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.627+0000 7f6862bff700 1 -- 172.21.15.107:0/1041556743 shutdown_connections 2023-08-10T10:49:03.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.627+0000 7f6862bff700 1 --2- 172.21.15.107:0/1041556743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c106440 0x7f685c1088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.627+0000 7f6862bff700 1 --2- 172.21.15.107:0/1041556743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 0x7f685c1035d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.627+0000 7f6862bff700 1 --2- 172.21.15.107:0/1041556743 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f685c103b10 0x7f685c105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.627+0000 7f6862bff700 1 -- 172.21.15.107:0/1041556743 >> 172.21.15.107:0/1041556743 conn(0x7f685c0fabd0 msgr2=0x7f685c0fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:03.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.627+0000 7f6862bff700 1 -- 172.21.15.107:0/1041556743 shutdown_connections 2023-08-10T10:49:03.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.627+0000 7f6862bff700 1 -- 172.21.15.107:0/1041556743 wait complete. 2023-08-10T10:49:03.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.628+0000 7f6862bff700 1 Processor -- start 2023-08-10T10:49:03.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f6862bff700 1 -- start start 2023-08-10T10:49:03.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f6862bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 0x7f685c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:03.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f6862bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c103b10 0x7f685c1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:03.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f6862bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f685c106440 0x7f685c19d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:03.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f6862bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c19df30 con 0x7f685c1011e0 2023-08-10T10:49:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f6862bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c19e070 con 0x7f685c106440 2023-08-10T10:49:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f6862bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c19e200 con 0x7f685c103b10 2023-08-10T10:49:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f686099b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 0x7f685c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f686099b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 0x7f685c1963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43974/0 (socket says 172.21.15.107:43974) 2023-08-10T10:49:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.629+0000 7f686099b700 1 -- 172.21.15.107:0/2388234718 learned_addr learned my addr 172.21.15.107:0/2388234718 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f685bfff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c103b10 0x7f685c1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f686119c700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f685c106440 0x7f685c19d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:03.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f686099b700 1 -- 172.21.15.107:0/2388234718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c103b10 msgr2=0x7f685c1968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f686099b700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c103b10 0x7f685c1968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f686099b700 1 -- 172.21.15.107:0/2388234718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f685c106440 msgr2=0x7f685c19d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f686099b700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f685c106440 0x7f685c19d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f686099b700 1 -- 172.21.15.107:0/2388234718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500095f0 con 0x7f685c1011e0 2023-08-10T10:49:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f685bfff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c103b10 0x7f685c1968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:03.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f686119c700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f685c106440 0x7f685c19d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:03.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f686099b700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 0x7f685c1963b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6850005910 tx=0x7f68500057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:03.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f6859ffb700 1 -- 172.21.15.107:0/2388234718 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685001d070 con 0x7f685c1011e0 2023-08-10T10:49:03.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f6859ffb700 1 -- 172.21.15.107:0/2388234718 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6850022470 con 0x7f685c1011e0 2023-08-10T10:49:03.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c19e480 con 0x7f685c1011e0 2023-08-10T10:49:03.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f6859ffb700 1 -- 172.21.15.107:0/2388234718 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685000f6c0 con 0x7f685c1011e0 2023-08-10T10:49:03.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.630+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c19e900 con 0x7f685c1011e0 2023-08-10T10:49:03.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.631+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c0fc750 con 0x7f685c1011e0 2023-08-10T10:49:03.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.633+0000 7f6859ffb700 1 -- 172.21.15.107:0/2388234718 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f68500225e0 con 0x7f685c1011e0 2023-08-10T10:49:03.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.634+0000 7f6859ffb700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f684c0a11d0 0x7f684c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:03.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.635+0000 7f6859ffb700 1 -- 172.21.15.107:0/2388234718 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f68500ce0b0 con 0x7f685c1011e0 2023-08-10T10:49:03.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.635+0000 7f685bfff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f684c0a11d0 0x7f684c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:03.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.635+0000 7f685bfff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f684c0a11d0 0x7f684c0a3690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6848009cb0 tx=0x7f6848009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:03.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.638+0000 7f6859ffb700 1 -- 172.21.15.107:0/2388234718 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6850097640 con 0x7f685c1011e0 2023-08-10T10:49:03.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:03 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3029717011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:49:03.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:03 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4008088993' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:49:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.857+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f685c02c970 con 0x7f685c1011e0 2023-08-10T10:49:03.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.857+0000 7f6859ffb700 1 -- 172.21.15.107:0/2388234718 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) v1 ==== 81+0+599 (secure 0 0 0) 0x7f685009ac60 con 0x7f685c1011e0 2023-08-10T10:49:03.858 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/294010818 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:03.859 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/294010818 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:03.859 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2325198765 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:03.859 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/4249017598 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:03.859 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/155446065 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:03.859 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2780861048 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:03.860 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/4026286774 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:03.860 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/4026286774 2023-08-11T10:40:45.031723+0000 2023-08-10T10:49:03.860 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2396317165 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:03.860 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2565207558 2023-08-11T10:41:11.475754+0000 2023-08-10T10:49:03.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f684c0a11d0 msgr2=0x7f684c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f684c0a11d0 0x7f684c0a3690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6848009cb0 tx=0x7f6848009260 comp rx=0 tx=0).stop 2023-08-10T10:49:03.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 msgr2=0x7f685c1963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:03.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 0x7f685c1963b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6850005910 tx=0x7f68500057d0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 shutdown_connections 2023-08-10T10:49:03.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f684c0a11d0 0x7f684c0a3690 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f685c106440 0x7f685c19d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f685c1011e0 0x7f685c1963b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 --2- 172.21.15.107:0/2388234718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c103b10 0x7f685c1968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:03.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 >> 172.21.15.107:0/2388234718 conn(0x7f685c0fabd0 msgr2=0x7f685c101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:03.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 shutdown_connections 2023-08-10T10:49:03.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:03.860+0000 7f6862bff700 1 -- 172.21.15.107:0/2388234718 wait complete. 2023-08-10T10:49:03.864 INFO:teuthology.orchestra.run.smithi107.stderr:listed 10 entries 2023-08-10T10:49:03.878 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com... 2023-08-10T10:49:03.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:49:03.879 DEBUG:teuthology.orchestra.run.smithi107:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:49:03.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi107.stderr:ceph-fuse[164852]: fuse finished with error 0 and tester_r 0 2023-08-10T10:49:03.949 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:49:04.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:03 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3029717011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:49:04.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:03 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4008088993' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:49:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:03 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3029717011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:49:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:03 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4008088993' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:49:05.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:04 smithi157 ceph-mon[129604]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:05.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:04 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2388234718' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T10:49:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:04 smithi107 ceph-mon[127953]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:04 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2388234718' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T10:49:05.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:04 smithi195 ceph-mon[129938]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:05.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:04 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2388234718' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T10:49:07.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:06 smithi157 ceph-mon[129604]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:07.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:06 smithi107 ceph-mon[127953]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:07.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:06 smithi195 ceph-mon[129938]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:09.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:08 smithi157 ceph-mon[129604]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:09.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:08 smithi107 ceph-mon[127953]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:08 smithi195 ceph-mon[129938]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-08-10T10:49:10.051 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T10:49:10.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:49:10.052 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-08-10T10:49:10.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:49:10.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.316+0000 7f15945ff700 1 -- 172.21.15.107:0/3760944342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 msgr2=0x7f158c101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.316+0000 7f15945ff700 1 --2- 172.21.15.107:0/3760944342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 0x7f158c101dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f157c0099c0 tx=0x7f157c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.316+0000 7f15945ff700 1 -- 172.21.15.107:0/3760944342 shutdown_connections 2023-08-10T10:49:10.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.316+0000 7f15945ff700 1 --2- 172.21.15.107:0/3760944342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c102300 0x7f158c108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.316+0000 7f15945ff700 1 --2- 172.21.15.107:0/3760944342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f158c100770 0x7f158c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.316+0000 7f15945ff700 1 --2- 172.21.15.107:0/3760944342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 0x7f158c101dc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.316+0000 7f15945ff700 1 -- 172.21.15.107:0/3760944342 >> 172.21.15.107:0/3760944342 conn(0x7f158c0fbca0 msgr2=0x7f158c0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:10.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.316+0000 7f15945ff700 1 -- 172.21.15.107:0/3760944342 shutdown_connections 2023-08-10T10:49:10.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.316+0000 7f15945ff700 1 -- 172.21.15.107:0/3760944342 wait complete. 2023-08-10T10:49:10.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.317+0000 7f15945ff700 1 Processor -- start 2023-08-10T10:49:10.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.317+0000 7f15945ff700 1 -- start start 2023-08-10T10:49:10.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f15945ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c100770 0x7f158c196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:10.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f15945ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 0x7f158c196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:10.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f15945ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f158c102300 0x7f158c19d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:10.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f15945ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c19dea0 con 0x7f158c101960 2023-08-10T10:49:10.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f15945ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c19dfe0 con 0x7f158c100770 2023-08-10T10:49:10.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f15945ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c19e170 con 0x7f158c102300 2023-08-10T10:49:10.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1591b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 0x7f158c196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:10.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1591b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 0x7f158c196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43992/0 (socket says 172.21.15.107:43992) 2023-08-10T10:49:10.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1591b9a700 1 -- 172.21.15.107:0/2635463608 learned_addr learned my addr 172.21.15.107:0/2635463608 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:10.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f159239b700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c100770 0x7f158c196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:10.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1592b9c700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f158c102300 0x7f158c19d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:10.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1591b9a700 1 -- 172.21.15.107:0/2635463608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f158c102300 msgr2=0x7f158c19d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1591b9a700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f158c102300 0x7f158c19d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1591b9a700 1 -- 172.21.15.107:0/2635463608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c100770 msgr2=0x7f158c196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1591b9a700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c100770 0x7f158c196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1591b9a700 1 -- 172.21.15.107:0/2635463608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0095f0 con 0x7f158c101960 2023-08-10T10:49:10.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.318+0000 7f1592b9c700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f158c102300 0x7f158c19d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:10.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.319+0000 7f1591b9a700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 0x7f158c196860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f157c009f50 tx=0x7f157c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:10.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.319+0000 7f15837fe700 1 -- 172.21.15.107:0/2635463608 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c01d070 con 0x7f158c101960 2023-08-10T10:49:10.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.319+0000 7f15837fe700 1 -- 172.21.15.107:0/2635463608 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f157c00bda0 con 0x7f158c101960 2023-08-10T10:49:10.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.319+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c19e3f0 con 0x7f158c101960 2023-08-10T10:49:10.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.319+0000 7f15837fe700 1 -- 172.21.15.107:0/2635463608 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c005280 con 0x7f158c101960 2023-08-10T10:49:10.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.319+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c19e810 con 0x7f158c101960 2023-08-10T10:49:10.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.320+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c107d10 con 0x7f158c101960 2023-08-10T10:49:10.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.322+0000 7f15837fe700 1 -- 172.21.15.107:0/2635463608 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f157c003ec0 con 0x7f158c101960 2023-08-10T10:49:10.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.323+0000 7f15837fe700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f15780a1220 0x7f15780a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:10.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.323+0000 7f15837fe700 1 -- 172.21.15.107:0/2635463608 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f157c0cdbe0 con 0x7f158c101960 2023-08-10T10:49:10.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.323+0000 7f159239b700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f15780a1220 0x7f15780a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:10.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.324+0000 7f159239b700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f15780a1220 0x7f15780a36e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f158c1017c0 tx=0x7f158800a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:10.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.327+0000 7f15837fe700 1 -- 172.21.15.107:0/2635463608 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f157c097170 con 0x7f158c101960 2023-08-10T10:49:10.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.524+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f158c02c970 con 0x7f158c101960 2023-08-10T10:49:10.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.525+0000 7f15837fe700 1 -- 172.21.15.107:0/2635463608 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24017 (secure 0 0 0) 0x7f157c09a790 con 0x7f158c101960 2023-08-10T10:49:10.527 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:10.527 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":89,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:48:47.109986+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:10.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f15780a1220 msgr2=0x7f15780a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f15780a1220 0x7f15780a36e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f158c1017c0 tx=0x7f158800a3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 msgr2=0x7f158c196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 0x7f158c196860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f157c009f50 tx=0x7f157c003a50 comp rx=0 tx=0).stop 2023-08-10T10:49:10.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 shutdown_connections 2023-08-10T10:49:10.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f15780a1220 0x7f15780a36e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f158c100770 0x7f158c196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f158c102300 0x7f158c19d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 --2- 172.21.15.107:0/2635463608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f158c101960 0x7f158c196860 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 >> 172.21.15.107:0/2635463608 conn(0x7f158c0fbca0 msgr2=0x7f158c104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:10.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 shutdown_connections 2023-08-10T10:49:10.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.528+0000 7f15945ff700 1 -- 172.21.15.107:0/2635463608 wait complete. 2023-08-10T10:49:10.548 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:49:10.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.748+0000 7ffbe69ff700 1 -- 172.21.15.107:0/1629390360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 msgr2=0x7ffbe0108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.748+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/1629390360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 0x7ffbe0108bb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800b0d0 tx=0x7ffbd800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.748+0000 7ffbe69ff700 1 -- 172.21.15.107:0/1629390360 shutdown_connections 2023-08-10T10:49:10.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.748+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/1629390360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 0x7ffbe0108bb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.748+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/1629390360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbe0100770 0x7ffbe0100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.748+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/1629390360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbe0101960 0x7ffbe0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.748+0000 7ffbe69ff700 1 -- 172.21.15.107:0/1629390360 >> 172.21.15.107:0/1629390360 conn(0x7ffbe00fbca0 msgr2=0x7ffbe00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:10.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.748+0000 7ffbe69ff700 1 -- 172.21.15.107:0/1629390360 shutdown_connections 2023-08-10T10:49:10.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.748+0000 7ffbe69ff700 1 -- 172.21.15.107:0/1629390360 wait complete. 2023-08-10T10:49:10.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.750+0000 7ffbe69ff700 1 Processor -- start 2023-08-10T10:49:10.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.750+0000 7ffbe69ff700 1 -- start start 2023-08-10T10:49:10.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.750+0000 7ffbe69ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbe0100770 0x7ffbe0196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:10.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.750+0000 7ffbe69ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbe0101960 0x7ffbe0196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:10.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.750+0000 7ffbe69ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 0x7ffbe019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:10.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.750+0000 7ffbe69ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe019dfa0 con 0x7ffbe0102300 2023-08-10T10:49:10.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.750+0000 7ffbe69ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe019e0e0 con 0x7ffbe0100770 2023-08-10T10:49:10.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.750+0000 7ffbe69ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe019e270 con 0x7ffbe0101960 2023-08-10T10:49:10.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbe4f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 0x7ffbe019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:10.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbe4f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 0x7ffbe019d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44006/0 (socket says 172.21.15.107:44006) 2023-08-10T10:49:10.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbe4f9c700 1 -- 172.21.15.107:0/2991934261 learned_addr learned my addr 172.21.15.107:0/2991934261 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:10.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbdf7fe700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbe0101960 0x7ffbe0196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:10.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbdffff700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbe0100770 0x7ffbe0196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:10.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbe4f9c700 1 -- 172.21.15.107:0/2991934261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbe0101960 msgr2=0x7ffbe0196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbe4f9c700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbe0101960 0x7ffbe0196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbe4f9c700 1 -- 172.21.15.107:0/2991934261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbe0100770 msgr2=0x7ffbe0196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbe4f9c700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbe0100770 0x7ffbe0196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbe4f9c700 1 -- 172.21.15.107:0/2991934261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd8009d00 con 0x7ffbe0102300 2023-08-10T10:49:10.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.751+0000 7ffbe4f9c700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 0x7ffbe019d9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009fd0 tx=0x7ffbd800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:10.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.752+0000 7ffbdd7fa700 1 -- 172.21.15.107:0/2991934261 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800e040 con 0x7ffbe0102300 2023-08-10T10:49:10.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.752+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe019e4f0 con 0x7ffbe0102300 2023-08-10T10:49:10.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.752+0000 7ffbdd7fa700 1 -- 172.21.15.107:0/2991934261 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbd80094c0 con 0x7ffbe0102300 2023-08-10T10:49:10.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.752+0000 7ffbdd7fa700 1 -- 172.21.15.107:0/2991934261 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80052a0 con 0x7ffbe0102300 2023-08-10T10:49:10.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.752+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe019e9c0 con 0x7ffbe0102300 2023-08-10T10:49:10.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.753+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe010be30 con 0x7ffbe0102300 2023-08-10T10:49:10.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.755+0000 7ffbdd7fa700 1 -- 172.21.15.107:0/2991934261 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ffbd8005400 con 0x7ffbe0102300 2023-08-10T10:49:10.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.756+0000 7ffbdd7fa700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ffbc80a11a0 0x7ffbc80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:10.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.756+0000 7ffbdd7fa700 1 -- 172.21.15.107:0/2991934261 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ffbd80ce070 con 0x7ffbe0102300 2023-08-10T10:49:10.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.756+0000 7ffbdffff700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ffbc80a11a0 0x7ffbc80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:10.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.757+0000 7ffbdffff700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ffbc80a11a0 0x7ffbc80a3660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffbe01017c0 tx=0x7ffbd000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:10.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.760+0000 7ffbdd7fa700 1 -- 172.21.15.107:0/2991934261 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ffbd8100790 con 0x7ffbe0102300 2023-08-10T10:49:10.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:10 smithi107 ceph-mon[127953]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-08-10T10:49:10.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:10 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2635463608' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:10.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.960+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbe010bff0 con 0x7ffbe0102300 2023-08-10T10:49:10.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.962+0000 7ffbdd7fa700 1 -- 172.21.15.107:0/2991934261 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24017 (secure 0 0 0) 0x7ffbd8097600 con 0x7ffbe0102300 2023-08-10T10:49:10.964 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:10.964 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":89,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:48:47.109986+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:10.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.964+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ffbc80a11a0 msgr2=0x7ffbc80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.964+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ffbc80a11a0 0x7ffbc80a3660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffbe01017c0 tx=0x7ffbd000b410 comp rx=0 tx=0).stop 2023-08-10T10:49:10.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.964+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 msgr2=0x7ffbe019d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:10.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.964+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 0x7ffbe019d9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009fd0 tx=0x7ffbd800ccc0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.965+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 shutdown_connections 2023-08-10T10:49:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.965+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ffbc80a11a0 0x7ffbc80a3660 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.965+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbe0100770 0x7ffbe0196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.965+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbe0102300 0x7ffbe019d9d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.965+0000 7ffbe69ff700 1 --2- 172.21.15.107:0/2991934261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbe0101960 0x7ffbe0196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.965+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 >> 172.21.15.107:0/2991934261 conn(0x7ffbe00fbca0 msgr2=0x7ffbe00fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.965+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 shutdown_connections 2023-08-10T10:49:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:10.965+0000 7ffbe69ff700 1 -- 172.21.15.107:0/2991934261 wait complete. 2023-08-10T10:49:10.984 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:49:11.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:10 smithi157 ceph-mon[129604]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-08-10T10:49:11.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:10 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2635463608' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:11.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:10 smithi195 ceph-mon[129938]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-08-10T10:49:11.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:10 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2635463608' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:11.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.182+0000 7f8bb91ff700 1 -- 172.21.15.107:0/2352409001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4102310 msgr2=0x7f8bb4108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:11.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.182+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/2352409001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4102310 0x7f8bb4108bc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00b0d0 tx=0x7f8bac00b3e0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.182+0000 7f8bb91ff700 1 -- 172.21.15.107:0/2352409001 shutdown_connections 2023-08-10T10:49:11.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.182+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/2352409001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb4100780 0x7f8bb4100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.182+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/2352409001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4102310 0x7f8bb4108bc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.182+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/2352409001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb4101970 0x7f8bb4101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.182+0000 7f8bb91ff700 1 -- 172.21.15.107:0/2352409001 >> 172.21.15.107:0/2352409001 conn(0x7f8bb40fbcf0 msgr2=0x7f8bb40fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:11.185 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.182+0000 7f8bb91ff700 1 -- 172.21.15.107:0/2352409001 shutdown_connections 2023-08-10T10:49:11.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.182+0000 7f8bb91ff700 1 -- 172.21.15.107:0/2352409001 wait complete. 2023-08-10T10:49:11.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.183+0000 7f8bb91ff700 1 Processor -- start 2023-08-10T10:49:11.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.183+0000 7f8bb91ff700 1 -- start start 2023-08-10T10:49:11.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.183+0000 7f8bb91ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4100780 0x7f8bb4074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:11.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.183+0000 7f8bb91ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb4101970 0x7f8bb4072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:11.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb91ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb4102310 0x7f8bb40730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:11.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb91ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4073840 con 0x7f8bb4100780 2023-08-10T10:49:11.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb91ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40739b0 con 0x7f8bb4101970 2023-08-10T10:49:11.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb91ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41a0510 con 0x7f8bb4102310 2023-08-10T10:49:11.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb2d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4100780 0x7f8bb4074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:11.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb2d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4100780 0x7f8bb4074520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44018/0 (socket says 172.21.15.107:44018) 2023-08-10T10:49:11.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb2d9d700 1 -- 172.21.15.107:0/3342830463 learned_addr learned my addr 172.21.15.107:0/3342830463 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:11.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8babfff700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb4101970 0x7f8bb4072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:11.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb359e700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb4102310 0x7f8bb40730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:11.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb2d9d700 1 -- 172.21.15.107:0/3342830463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb4102310 msgr2=0x7f8bb40730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:11.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb2d9d700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb4102310 0x7f8bb40730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb2d9d700 1 -- 172.21.15.107:0/3342830463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb4101970 msgr2=0x7f8bb4072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:11.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb2d9d700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb4101970 0x7f8bb4072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb2d9d700 1 -- 172.21.15.107:0/3342830463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac009d00 con 0x7f8bb4100780 2023-08-10T10:49:11.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.184+0000 7f8bb2d9d700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4100780 0x7f8bb4074520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400d980 tx=0x7f8ba400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:11.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.185+0000 7f8bb0d99700 1 -- 172.21.15.107:0/3342830463 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4004020 con 0x7f8bb4100780 2023-08-10T10:49:11.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.185+0000 7f8bb0d99700 1 -- 172.21.15.107:0/3342830463 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ba4009730 con 0x7f8bb4100780 2023-08-10T10:49:11.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.185+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb41a07f0 con 0x7f8bb4100780 2023-08-10T10:49:11.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.185+0000 7f8bb0d99700 1 -- 172.21.15.107:0/3342830463 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4003a00 con 0x7f8bb4100780 2023-08-10T10:49:11.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.185+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb41a0d50 con 0x7f8bb4100780 2023-08-10T10:49:11.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.186+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4107d60 con 0x7f8bb4100780 2023-08-10T10:49:11.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.188+0000 7f8bb0d99700 1 -- 172.21.15.107:0/3342830463 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8ba40098a0 con 0x7f8bb4100780 2023-08-10T10:49:11.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.189+0000 7f8bb0d99700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8ba00a11d0 0x7f8ba00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:11.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.189+0000 7f8bb0d99700 1 -- 172.21.15.107:0/3342830463 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8ba40cc7d0 con 0x7f8bb4100780 2023-08-10T10:49:11.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.189+0000 7f8babfff700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8ba00a11d0 0x7f8ba00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:11.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.190+0000 7f8babfff700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8ba00a11d0 0x7f8ba00a3690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c005950 tx=0x7f8b9c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:11.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.193+0000 7f8bb0d99700 1 -- 172.21.15.107:0/3342830463 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8ba4095cd0 con 0x7f8bb4100780 2023-08-10T10:49:11.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.438+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8bb402c970 con 0x7f8bb4100780 2023-08-10T10:49:11.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.701+0000 7f8bb0d99700 1 -- 172.21.15.107:0/3342830463 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8ba40232f0 con 0x7f8bb4100780 2023-08-10T10:49:11.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.706+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8ba00a11d0 msgr2=0x7f8ba00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:11.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.706+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8ba00a11d0 0x7f8ba00a3690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c005950 tx=0x7f8b9c00b410 comp rx=0 tx=0).stop 2023-08-10T10:49:11.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.706+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4100780 msgr2=0x7f8bb4074520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:11.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.706+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4100780 0x7f8bb4074520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400d980 tx=0x7f8ba400dc90 comp rx=0 tx=0).stop 2023-08-10T10:49:11.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.707+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 shutdown_connections 2023-08-10T10:49:11.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.707+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8ba00a11d0 0x7f8ba00a3690 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.707+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8bb4102310 0x7f8bb40730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.707+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bb4100780 0x7f8bb4074520 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.707+0000 7f8bb91ff700 1 --2- 172.21.15.107:0/3342830463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb4101970 0x7f8bb4072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.707+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 >> 172.21.15.107:0/3342830463 conn(0x7f8bb40fbcf0 msgr2=0x7f8bb4104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:11.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.707+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 shutdown_connections 2023-08-10T10:49:11.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.707+0000 7f8bb91ff700 1 -- 172.21.15.107:0/3342830463 wait complete. 2023-08-10T10:49:11.727 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-08-10T10:49:11.727 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-08-10T10:49:11.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.928+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/1251999572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 msgr2=0x7f7f0810aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:11.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.928+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/1251999572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 0x7f7f0810aaa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000b0a0 tx=0x7f7f0000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.928+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/1251999572 shutdown_connections 2023-08-10T10:49:11.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.928+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/1251999572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 0x7f7f0810aaa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.928+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/1251999572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f08074750 0x7f7f08072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.928+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/1251999572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f08073170 0x7f7f080735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.928+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/1251999572 >> 172.21.15.107:0/1251999572 conn(0x7f7f080fbcb0 msgr2=0x7f7f080fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:11.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.928+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/1251999572 shutdown_connections 2023-08-10T10:49:11.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.928+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/1251999572 wait complete. 2023-08-10T10:49:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.929+0000 7f7f0d5ff700 1 Processor -- start 2023-08-10T10:49:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.929+0000 7f7f0d5ff700 1 -- start start 2023-08-10T10:49:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.929+0000 7f7f0d5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f08073170 0x7f7f08198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.929+0000 7f7f0d5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f08074750 0x7f7f08198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.929+0000 7f7f0d5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 0x7f7f0819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.929+0000 7f7f0d5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f081a01b0 con 0x7f7f08108630 2023-08-10T10:49:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.929+0000 7f7f0d5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f081a02f0 con 0x7f7f08074750 2023-08-10T10:49:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.929+0000 7f7f0d5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f081a0480 con 0x7f7f08073170 2023-08-10T10:49:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 0x7f7f0819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 0x7f7f0819fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44048/0 (socket says 172.21.15.107:44048) 2023-08-10T10:49:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f077fe700 1 -- 172.21.15.107:0/2504469550 learned_addr learned my addr 172.21.15.107:0/2504469550 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7efffff700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f08074750 0x7f7f08198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f06ffd700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f08073170 0x7f7f08198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f077fe700 1 -- 172.21.15.107:0/2504469550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f08073170 msgr2=0x7f7f08198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f077fe700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f08073170 0x7f7f08198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f077fe700 1 -- 172.21.15.107:0/2504469550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f08074750 msgr2=0x7f7f08198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f077fe700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f08074750 0x7f7f08198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f077fe700 1 -- 172.21.15.107:0/2504469550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00009d00 con 0x7f7f08108630 2023-08-10T10:49:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7efffff700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f08074750 0x7f7f08198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:11.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f077fe700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 0x7f7f0819fbe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000d010 tx=0x7f7f0000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:11.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f04ff9700 1 -- 172.21.15.107:0/2504469550 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000e040 con 0x7f7f08108630 2023-08-10T10:49:11.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f081a0700 con 0x7f7f08108630 2023-08-10T10:49:11.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f04ff9700 1 -- 172.21.15.107:0/2504469550 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f00003e10 con 0x7f7f08108630 2023-08-10T10:49:11.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.930+0000 7f7f04ff9700 1 -- 172.21.15.107:0/2504469550 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f000053c0 con 0x7f7f08108630 2023-08-10T10:49:11.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.931+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f081a0b20 con 0x7f7f08108630 2023-08-10T10:49:11.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.932+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f08106d30 con 0x7f7f08108630 2023-08-10T10:49:11.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.934+0000 7f7f04ff9700 1 -- 172.21.15.107:0/2504469550 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7f0001db10 con 0x7f7f08108630 2023-08-10T10:49:11.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.936+0000 7f7f04ff9700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7ef40a1150 0x7f7ef40a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:11.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.936+0000 7f7f04ff9700 1 -- 172.21.15.107:0/2504469550 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f7f000ce520 con 0x7f7f08108630 2023-08-10T10:49:11.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.936+0000 7f7f06ffd700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7ef40a1150 0x7f7ef40a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:11.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.937+0000 7f7f06ffd700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7ef40a1150 0x7f7ef40a3610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8005fd0 tx=0x7f7ef8005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:11.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:11.938+0000 7f7f04ff9700 1 -- 172.21.15.107:0/2504469550 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7f000979a0 con 0x7f7f08108630 2023-08-10T10:49:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2991934261' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3342830463' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-08-10T10:49:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-08-10T10:49:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-08-10T10:49:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-08-10T10:49:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]: dispatch 2023-08-10T10:49:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-08-10T10:49:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8, 5, 9]}]: dispatch 2023-08-10T10:49:12.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]: dispatch 2023-08-10T10:49:12.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-08-10T10:49:12.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:11 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2023-08-10T10:49:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2991934261' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3342830463' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-08-10T10:49:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-08-10T10:49:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-08-10T10:49:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-08-10T10:49:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]: dispatch 2023-08-10T10:49:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-08-10T10:49:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8, 5, 9]}]: dispatch 2023-08-10T10:49:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]: dispatch 2023-08-10T10:49:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-08-10T10:49:12.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:11 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2023-08-10T10:49:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2991934261' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3342830463' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-08-10T10:49:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-08-10T10:49:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-08-10T10:49:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-08-10T10:49:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]: dispatch 2023-08-10T10:49:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-08-10T10:49:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8, 5, 9]}]: dispatch 2023-08-10T10:49:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]: dispatch 2023-08-10T10:49:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-08-10T10:49:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:11 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2023-08-10T10:49:12.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.180+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f7f0802cb00 con 0x7f7f08108630 2023-08-10T10:49:12.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.709+0000 7f7f04ff9700 1 -- 172.21.15.107:0/2504469550 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f7f0009afc0 con 0x7f7f08108630 2023-08-10T10:49:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.714+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7ef40a1150 msgr2=0x7f7ef40a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.714+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7ef40a1150 0x7f7ef40a3610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8005fd0 tx=0x7f7ef8005f60 comp rx=0 tx=0).stop 2023-08-10T10:49:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.714+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 msgr2=0x7f7f0819fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.714+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 0x7f7f0819fbe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000d010 tx=0x7f7f0000bd70 comp rx=0 tx=0).stop 2023-08-10T10:49:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.715+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 shutdown_connections 2023-08-10T10:49:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.715+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f7ef40a1150 0x7f7ef40a3610 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.715+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f08108630 0x7f7f0819fbe0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.715+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f08073170 0x7f7f08198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.715+0000 7f7f0d5ff700 1 --2- 172.21.15.107:0/2504469550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7f08074750 0x7f7f08198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.715+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 >> 172.21.15.107:0/2504469550 conn(0x7f7f080fbcb0 msgr2=0x7f7f080fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:12.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.715+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 shutdown_connections 2023-08-10T10:49:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.716+0000 7f7f0d5ff700 1 -- 172.21.15.107:0/2504469550 wait complete. 2023-08-10T10:49:12.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-08-10T10:49:12.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.947+0000 7f277d9ff700 1 -- 172.21.15.107:0/3935061063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 msgr2=0x7f2778108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:12.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.947+0000 7f277d9ff700 1 --2- 172.21.15.107:0/3935061063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 0x7f2778108bc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f277000b0d0 tx=0x7f277000b3e0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.947+0000 7f277d9ff700 1 -- 172.21.15.107:0/3935061063 shutdown_connections 2023-08-10T10:49:12.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.947+0000 7f277d9ff700 1 --2- 172.21.15.107:0/3935061063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2778100780 0x7f2778100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.947+0000 7f277d9ff700 1 --2- 172.21.15.107:0/3935061063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 0x7f2778108bc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.947+0000 7f277d9ff700 1 --2- 172.21.15.107:0/3935061063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778101970 0x7f2778101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.947+0000 7f277d9ff700 1 -- 172.21.15.107:0/3935061063 >> 172.21.15.107:0/3935061063 conn(0x7f27780fbcf0 msgr2=0x7f27780fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:12.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.947+0000 7f277d9ff700 1 -- 172.21.15.107:0/3935061063 shutdown_connections 2023-08-10T10:49:12.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.947+0000 7f277d9ff700 1 -- 172.21.15.107:0/3935061063 wait complete. 2023-08-10T10:49:12.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.948+0000 7f277d9ff700 1 Processor -- start 2023-08-10T10:49:12.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.948+0000 7f277d9ff700 1 -- start start 2023-08-10T10:49:12.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f277d9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2778100780 0x7f2778074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:12.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f277d9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778101970 0x7f2778072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:12.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f277d9ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 0x7f27780730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:12.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f277d9ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778073840 con 0x7f2778102310 2023-08-10T10:49:12.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f277d9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780739b0 con 0x7f2778100780 2023-08-10T10:49:12.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f277d9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27781a04a0 con 0x7f2778101970 2023-08-10T10:49:12.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f27777fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 0x7f27780730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:12.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f27777fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 0x7f27780730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57548/0 (socket says 172.21.15.107:57548) 2023-08-10T10:49:12.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f27777fe700 1 -- 172.21.15.107:0/115075919 learned_addr learned my addr 172.21.15.107:0/115075919 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:12.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f2776ffd700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2778100780 0x7f2778074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:12.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f27767fc700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778101970 0x7f2778072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:12.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f27777fe700 1 -- 172.21.15.107:0/115075919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778101970 msgr2=0x7f2778072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:12.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f27777fe700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778101970 0x7f2778072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f27777fe700 1 -- 172.21.15.107:0/115075919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2778100780 msgr2=0x7f2778074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:12.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f27777fe700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2778100780 0x7f2778074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:12.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f27777fe700 1 -- 172.21.15.107:0/115075919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009d00 con 0x7f2778102310 2023-08-10T10:49:12.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.949+0000 7f2776ffd700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2778100780 0x7f2778074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:12.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.950+0000 7f27777fe700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 0x7f27780730a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2770009fd0 tx=0x7f277000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:12.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.950+0000 7f277c9fd700 1 -- 172.21.15.107:0/115075919 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000e040 con 0x7f2778102310 2023-08-10T10:49:12.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.950+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27781a0720 con 0x7f2778102310 2023-08-10T10:49:12.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.950+0000 7f277c9fd700 1 -- 172.21.15.107:0/115075919 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2770003e10 con 0x7f2778102310 2023-08-10T10:49:12.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.950+0000 7f277c9fd700 1 -- 172.21.15.107:0/115075919 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700052a0 con 0x7f2778102310 2023-08-10T10:49:12.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.950+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27781a0bf0 con 0x7f2778102310 2023-08-10T10:49:12.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.951+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27781076b0 con 0x7f2778102310 2023-08-10T10:49:12.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.953+0000 7f277c9fd700 1 -- 172.21.15.107:0/115075919 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f277001b450 con 0x7f2778102310 2023-08-10T10:49:12.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.954+0000 7f277c9fd700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f27600a11d0 0x7f27600a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:12.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.954+0000 7f277c9fd700 1 -- 172.21.15.107:0/115075919 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f27700ce390 con 0x7f2778102310 2023-08-10T10:49:12.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.954+0000 7f2776ffd700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f27600a11d0 0x7f27600a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:12.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.955+0000 7f2776ffd700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f27600a11d0 0x7f27600a3690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2768005950 tx=0x7f27680058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:12.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:12.958+0000 7f277c9fd700 1 -- 172.21.15.107:0/115075919 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2770097810 con 0x7f2778102310 2023-08-10T10:49:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2023-08-10T10:49:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-08-10T10:49:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-08-10T10:49:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-08-10T10:49:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]': finished 2023-08-10T10:49:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-08-10T10:49:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8, 5, 9]}]': finished 2023-08-10T10:49:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]': finished 2023-08-10T10:49:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-08-10T10:49:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2023-08-10T10:49:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: osdmap e90: 12 total, 12 up, 12 in 2023-08-10T10:49:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3342830463' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-08-10T10:49:13.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:49:13.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:12 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2504469550' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-08-10T10:49:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2023-08-10T10:49:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-08-10T10:49:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-08-10T10:49:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-08-10T10:49:13.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]': finished 2023-08-10T10:49:13.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-08-10T10:49:13.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8, 5, 9]}]': finished 2023-08-10T10:49:13.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]': finished 2023-08-10T10:49:13.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-08-10T10:49:13.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2023-08-10T10:49:13.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: osdmap e90: 12 total, 12 up, 12 in 2023-08-10T10:49:13.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3342830463' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-08-10T10:49:13.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:49:13.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:12 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2504469550' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-08-10T10:49:13.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2023-08-10T10:49:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-08-10T10:49:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-08-10T10:49:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-08-10T10:49:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]': finished 2023-08-10T10:49:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-08-10T10:49:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8, 5, 9]}]': finished 2023-08-10T10:49:13.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]': finished 2023-08-10T10:49:13.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-08-10T10:49:13.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2023-08-10T10:49:13.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: osdmap e90: 12 total, 12 up, 12 in 2023-08-10T10:49:13.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3342830463' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-08-10T10:49:13.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:49:13.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:12 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2504469550' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-08-10T10:49:13.204 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.203+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f277802c970 con 0x7f2778102310 2023-08-10T10:49:13.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.601+0000 7f277c9fd700 1 -- 172.21.15.107:0/115075919 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f277009ae30 con 0x7f2778102310 2023-08-10T10:49:13.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.603+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f27600a11d0 msgr2=0x7f27600a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:13.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.603+0000 7f277d9ff700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f27600a11d0 0x7f27600a3690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2768005950 tx=0x7f27680058e0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.603+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 msgr2=0x7f27780730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:13.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.603+0000 7f277d9ff700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 0x7f27780730a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2770009fd0 tx=0x7f277000cd70 comp rx=0 tx=0).stop 2023-08-10T10:49:13.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.603+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 shutdown_connections 2023-08-10T10:49:13.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.603+0000 7f277d9ff700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f27600a11d0 0x7f27600a3690 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.604+0000 7f277d9ff700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2778100780 0x7f2778074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.604+0000 7f277d9ff700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2778102310 0x7f27780730a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.604+0000 7f277d9ff700 1 --2- 172.21.15.107:0/115075919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778101970 0x7f2778072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.604+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 >> 172.21.15.107:0/115075919 conn(0x7f27780fbcf0 msgr2=0x7f27780fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:13.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.604+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 shutdown_connections 2023-08-10T10:49:13.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.604+0000 7f277d9ff700 1 -- 172.21.15.107:0/115075919 wait complete. 2023-08-10T10:49:13.627 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-08-10T10:49:13.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.828+0000 7fb2f7dff700 1 -- 172.21.15.107:0/3962060467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0101970 msgr2=0x7fb2f0101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:13.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.828+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/3962060467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0101970 0x7fb2f0101dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00099c0 tx=0x7fb2e0009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.828+0000 7fb2f7dff700 1 -- 172.21.15.107:0/3962060467 shutdown_connections 2023-08-10T10:49:13.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.828+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/3962060467 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f0102310 0x7fb2f0108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.828+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/3962060467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2f0100780 0x7fb2f0100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.828+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/3962060467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0101970 0x7fb2f0101dd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.828+0000 7fb2f7dff700 1 -- 172.21.15.107:0/3962060467 >> 172.21.15.107:0/3962060467 conn(0x7fb2f00fbcf0 msgr2=0x7fb2f00fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:13.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.828+0000 7fb2f7dff700 1 -- 172.21.15.107:0/3962060467 shutdown_connections 2023-08-10T10:49:13.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.828+0000 7fb2f7dff700 1 -- 172.21.15.107:0/3962060467 wait complete. 2023-08-10T10:49:13.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.829+0000 7fb2f7dff700 1 Processor -- start 2023-08-10T10:49:13.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f7dff700 1 -- start start 2023-08-10T10:49:13.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f7dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0100780 0x7fb2f0074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:13.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f7dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f0101970 0x7fb2f0072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:13.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f7dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2f0102310 0x7fb2f00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:13.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f7dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0073840 con 0x7fb2f0100780 2023-08-10T10:49:13.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f7dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00739b0 con 0x7fb2f0101970 2023-08-10T10:49:13.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f7dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f01a03c0 con 0x7fb2f0102310 2023-08-10T10:49:13.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f5b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0100780 0x7fb2f0074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:13.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f5b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0100780 0x7fb2f0074520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57566/0 (socket says 172.21.15.107:57566) 2023-08-10T10:49:13.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f5b9b700 1 -- 172.21.15.107:0/1630563640 learned_addr learned my addr 172.21.15.107:0/1630563640 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:13.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.830+0000 7fb2f539a700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f0101970 0x7fb2f0072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:13.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2f639c700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2f0102310 0x7fb2f00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:13.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2f5b9b700 1 -- 172.21.15.107:0/1630563640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2f0102310 msgr2=0x7fb2f00730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:13.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2f5b9b700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2f0102310 0x7fb2f00730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2f5b9b700 1 -- 172.21.15.107:0/1630563640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f0101970 msgr2=0x7fb2f0072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:13.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2f5b9b700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f0101970 0x7fb2f0072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:13.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2f5b9b700 1 -- 172.21.15.107:0/1630563640 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00095f0 con 0x7fb2f0100780 2023-08-10T10:49:13.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2f5b9b700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0100780 0x7fb2f0074520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00e970 tx=0x7fb2ec00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:13.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2e6ffd700 1 -- 172.21.15.107:0/1630563640 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec009790 con 0x7fb2f0100780 2023-08-10T10:49:13.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2e6ffd700 1 -- 172.21.15.107:0/1630563640 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2ec00eec0 con 0x7fb2f0100780 2023-08-10T10:49:13.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2e6ffd700 1 -- 172.21.15.107:0/1630563640 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec003c10 con 0x7fb2f0100780 2023-08-10T10:49:13.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f01a06a0 con 0x7fb2f0100780 2023-08-10T10:49:13.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.831+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f01a0b60 con 0x7fb2f0100780 2023-08-10T10:49:13.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.832+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f0107700 con 0x7fb2f0100780 2023-08-10T10:49:13.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.834+0000 7fb2e6ffd700 1 -- 172.21.15.107:0/1630563640 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb2ec003db0 con 0x7fb2f0100780 2023-08-10T10:49:13.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.836+0000 7fb2e6ffd700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb2dc0a1150 0x7fb2dc0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:13.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.837+0000 7fb2e6ffd700 1 -- 172.21.15.107:0/1630563640 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fb2ec014070 con 0x7fb2f0100780 2023-08-10T10:49:13.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.837+0000 7fb2f539a700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb2dc0a1150 0x7fb2dc0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:13.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.837+0000 7fb2f539a700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb2dc0a1150 0x7fb2dc0a3610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009990 tx=0x7fb2e0005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:13.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:13.841+0000 7fb2e6ffd700 1 -- 172.21.15.107:0/1630563640 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb2ec0962b0 con 0x7fb2f0100780 2023-08-10T10:49:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-08-10T10:49:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2504469550' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-08-10T10:49:14.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-08-10T10:49:14.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:49:14.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: osdmap e91: 12 total, 12 up, 12 in 2023-08-10T10:49:14.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-08-10T10:49:14.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-08-10T10:49:14.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/115075919' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-08-10T10:49:14.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] up:active 2023-08-10T10:49:14.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/115075919' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-08-10T10:49:14.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-08-10T10:49:14.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-08-10T10:49:14.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-08-10T10:49:14.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:13 smithi157 ceph-mon[129604]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-08-10T10:49:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-08-10T10:49:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2504469550' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-08-10T10:49:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-08-10T10:49:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:49:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: osdmap e91: 12 total, 12 up, 12 in 2023-08-10T10:49:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-08-10T10:49:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-08-10T10:49:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/115075919' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-08-10T10:49:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] up:active 2023-08-10T10:49:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/115075919' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-08-10T10:49:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-08-10T10:49:14.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-08-10T10:49:14.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-08-10T10:49:14.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:13 smithi107 ceph-mon[127953]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-08-10T10:49:14.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.086+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fb2f002c970 con 0x7fb2f0100780 2023-08-10T10:49:14.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-08-10T10:49:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2504469550' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-08-10T10:49:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-08-10T10:49:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-08-10T10:49:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: osdmap e91: 12 total, 12 up, 12 in 2023-08-10T10:49:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-08-10T10:49:14.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-08-10T10:49:14.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/115075919' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-08-10T10:49:14.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] up:active 2023-08-10T10:49:14.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/115075919' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-08-10T10:49:14.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-08-10T10:49:14.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-08-10T10:49:14.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2023-08-10T10:49:14.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:13 smithi195 ceph-mon[129938]: daemon mds.f is now active in filesystem cephfs as rank 2 2023-08-10T10:49:14.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.610+0000 7fb2e6ffd700 1 -- 172.21.15.107:0/1630563640 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb2ec0998d0 con 0x7fb2f0100780 2023-08-10T10:49:14.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb2dc0a1150 msgr2=0x7fb2dc0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:14.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb2dc0a1150 0x7fb2dc0a3610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009990 tx=0x7fb2e0005be0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0100780 msgr2=0x7fb2f0074520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:14.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0100780 0x7fb2f0074520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00e970 tx=0x7fb2ec00ec80 comp rx=0 tx=0).stop 2023-08-10T10:49:14.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 shutdown_connections 2023-08-10T10:49:14.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb2dc0a1150 0x7fb2dc0a3610 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2f0102310 0x7fb2f00730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2f0100780 0x7fb2f0074520 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 --2- 172.21.15.107:0/1630563640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f0101970 0x7fb2f0072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.613+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 >> 172.21.15.107:0/1630563640 conn(0x7fb2f00fbcf0 msgr2=0x7fb2f00fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:14.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.614+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 shutdown_connections 2023-08-10T10:49:14.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.614+0000 7fb2f7dff700 1 -- 172.21.15.107:0/1630563640 wait complete. 2023-08-10T10:49:14.638 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2023-08-10T10:49:14.638 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-08-10T10:49:14.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.842+0000 7fba179ff700 1 -- 172.21.15.107:0/2651757601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10101970 msgr2=0x7fba10101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:14.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.842+0000 7fba179ff700 1 --2- 172.21.15.107:0/2651757601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10101970 0x7fba10101dd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fba000099c0 tx=0x7fba00009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.842+0000 7fba179ff700 1 -- 172.21.15.107:0/2651757601 shutdown_connections 2023-08-10T10:49:14.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.842+0000 7fba179ff700 1 --2- 172.21.15.107:0/2651757601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba10102310 0x7fba10108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.842+0000 7fba179ff700 1 --2- 172.21.15.107:0/2651757601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba10100780 0x7fba10100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.842+0000 7fba179ff700 1 --2- 172.21.15.107:0/2651757601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10101970 0x7fba10101dd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.842+0000 7fba179ff700 1 -- 172.21.15.107:0/2651757601 >> 172.21.15.107:0/2651757601 conn(0x7fba100fbcf0 msgr2=0x7fba100fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:14.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.842+0000 7fba179ff700 1 -- 172.21.15.107:0/2651757601 shutdown_connections 2023-08-10T10:49:14.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.842+0000 7fba179ff700 1 -- 172.21.15.107:0/2651757601 wait complete. 2023-08-10T10:49:14.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.843+0000 7fba179ff700 1 Processor -- start 2023-08-10T10:49:14.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.843+0000 7fba179ff700 1 -- start start 2023-08-10T10:49:14.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba179ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10100780 0x7fba10196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:14.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba179ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba10101970 0x7fba10196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:14.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba179ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba10102310 0x7fba1019da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:14.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba179ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1019dfd0 con 0x7fba10100780 2023-08-10T10:49:14.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba179ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1019e110 con 0x7fba10101970 2023-08-10T10:49:14.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba179ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1019e2a0 con 0x7fba10102310 2023-08-10T10:49:14.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba1579b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10100780 0x7fba10196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:14.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba1579b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10100780 0x7fba10196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57594/0 (socket says 172.21.15.107:57594) 2023-08-10T10:49:14.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba1579b700 1 -- 172.21.15.107:0/4194253397 learned_addr learned my addr 172.21.15.107:0/4194253397 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:14.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba1579b700 1 -- 172.21.15.107:0/4194253397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba10102310 msgr2=0x7fba1019da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:14.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba1579b700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba10102310 0x7fba1019da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba14f9a700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba10101970 0x7fba10196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:14.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba1579b700 1 -- 172.21.15.107:0/4194253397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba10101970 msgr2=0x7fba10196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:14.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba1579b700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba10101970 0x7fba10196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:14.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba1579b700 1 -- 172.21.15.107:0/4194253397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000095f0 con 0x7fba10100780 2023-08-10T10:49:14.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.844+0000 7fba1579b700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10100780 0x7fba10196450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00d980 tx=0x7fba0c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:14.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.845+0000 7fba067fc700 1 -- 172.21.15.107:0/4194253397 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00bb60 con 0x7fba10100780 2023-08-10T10:49:14.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.845+0000 7fba067fc700 1 -- 172.21.15.107:0/4194253397 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba0c007620 con 0x7fba10100780 2023-08-10T10:49:14.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.845+0000 7fba067fc700 1 -- 172.21.15.107:0/4194253397 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00f3c0 con 0x7fba10100780 2023-08-10T10:49:14.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.845+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1019e580 con 0x7fba10100780 2023-08-10T10:49:14.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.845+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1019ea40 con 0x7fba10100780 2023-08-10T10:49:14.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.846+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba10107e40 con 0x7fba10100780 2023-08-10T10:49:14.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.848+0000 7fba067fc700 1 -- 172.21.15.107:0/4194253397 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fba0c010460 con 0x7fba10100780 2023-08-10T10:49:14.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.849+0000 7fba067fc700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9fc0a1150 0x7fb9fc0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:14.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.849+0000 7fba067fc700 1 -- 172.21.15.107:0/4194253397 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fba0c0cced0 con 0x7fba10100780 2023-08-10T10:49:14.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.849+0000 7fba14f9a700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9fc0a1150 0x7fb9fc0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:14.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.850+0000 7fba14f9a700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9fc0a1150 0x7fb9fc0a3610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba00009fd0 tx=0x7fba00000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:14.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:14.853+0000 7fba067fc700 1 -- 172.21.15.107:0/4194253397 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fba0c0962c0 con 0x7fba10100780 2023-08-10T10:49:15.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:14 smithi157 ceph-mon[129604]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s wr, 0 op/s 2023-08-10T10:49:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:14 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1630563640' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-08-10T10:49:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:14 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] up:active 2023-08-10T10:49:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:14 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1630563640' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-08-10T10:49:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:14 smithi157 ceph-mon[129604]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-08-10T10:49:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:14 smithi157 ceph-mon[129604]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-08-10T10:49:15.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:14 smithi157 ceph-mon[129604]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-08-10T10:49:15.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:14 smithi157 ceph-mon[129604]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-08-10T10:49:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:14 smithi107 ceph-mon[127953]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s wr, 0 op/s 2023-08-10T10:49:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:14 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1630563640' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-08-10T10:49:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:14 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] up:active 2023-08-10T10:49:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:14 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1630563640' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-08-10T10:49:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:14 smithi107 ceph-mon[127953]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-08-10T10:49:15.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:14 smithi107 ceph-mon[127953]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-08-10T10:49:15.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:14 smithi107 ceph-mon[127953]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-08-10T10:49:15.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:14 smithi107 ceph-mon[127953]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-08-10T10:49:15.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.087+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fba10060c40 con 0x7fb9fc0a1150 2023-08-10T10:49:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:14 smithi195 ceph-mon[129938]: pgmap v322: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s wr, 0 op/s 2023-08-10T10:49:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:14 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1630563640' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-08-10T10:49:15.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:14 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] up:active 2023-08-10T10:49:15.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:14 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1630563640' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-08-10T10:49:15.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:14 smithi195 ceph-mon[129938]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-08-10T10:49:15.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:14 smithi195 ceph-mon[129938]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2023-08-10T10:49:15.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:14 smithi195 ceph-mon[129938]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-08-10T10:49:15.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:14 smithi195 ceph-mon[129938]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-08-10T10:49:15.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:49:15.093+0000 7f1a30701700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:49:15.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:49:15.093+0000 7f1a30701700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:49:15.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:49:15.093+0000 7f1a30701700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:49:15.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:49:15.093+0000 7f1a30701700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:49:15.578 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:49:15.093+0000 7f1a30701700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:49:15.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.665+0000 7fba067fc700 1 -- 172.21.15.107:0/4194253397 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fba10060c40 con 0x7fb9fc0a1150 2023-08-10T10:49:15.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.667+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9fc0a1150 msgr2=0x7fb9fc0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:15.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.667+0000 7fba179ff700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9fc0a1150 0x7fb9fc0a3610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba00009fd0 tx=0x7fba00000bc0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.667+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10100780 msgr2=0x7fba10196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:15.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.667+0000 7fba179ff700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10100780 0x7fba10196450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00d980 tx=0x7fba0c00dd40 comp rx=0 tx=0).stop 2023-08-10T10:49:15.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.668+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 shutdown_connections 2023-08-10T10:49:15.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.668+0000 7fba179ff700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9fc0a1150 0x7fb9fc0a3610 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.668+0000 7fba179ff700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba10102310 0x7fba1019da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.668+0000 7fba179ff700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba10100780 0x7fba10196450 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.668+0000 7fba179ff700 1 --2- 172.21.15.107:0/4194253397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba10101970 0x7fba10196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.668+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 >> 172.21.15.107:0/4194253397 conn(0x7fba100fbcf0 msgr2=0x7fba10104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:15.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.668+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 shutdown_connections 2023-08-10T10:49:15.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.668+0000 7fba179ff700 1 -- 172.21.15.107:0/4194253397 wait complete. 2023-08-10T10:49:15.689 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-08-10T10:49:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.890+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2120287431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44101970 msgr2=0x7f4e44101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.890+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2120287431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44101970 0x7f4e44101dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e340099c0 tx=0x7f4e34009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.890+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2120287431 shutdown_connections 2023-08-10T10:49:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.890+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2120287431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e44102310 0x7f4e44108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.890+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2120287431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e44100780 0x7f4e44100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.890+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2120287431 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44101970 0x7f4e44101dd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.890+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2120287431 >> 172.21.15.107:0/2120287431 conn(0x7f4e440fbcf0 msgr2=0x7f4e440fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.890+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2120287431 shutdown_connections 2023-08-10T10:49:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.890+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2120287431 wait complete. 2023-08-10T10:49:15.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.891+0000 7f4e4b9ff700 1 Processor -- start 2023-08-10T10:49:15.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.891+0000 7f4e4b9ff700 1 -- start start 2023-08-10T10:49:15.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.891+0000 7f4e4b9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e44100780 0x7f4e441985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:15.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.891+0000 7f4e4b9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e44101970 0x7f4e44198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:15.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.891+0000 7f4e4b9ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44102310 0x7f4e4419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.891+0000 7f4e4b9ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441a0140 con 0x7f4e44102310 2023-08-10T10:49:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.891+0000 7f4e4b9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441a0280 con 0x7f4e44100780 2023-08-10T10:49:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.891+0000 7f4e4b9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e441a0410 con 0x7f4e44101970 2023-08-10T10:49:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e49f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44102310 0x7f4e4419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e49f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44102310 0x7f4e4419fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57620/0 (socket says 172.21.15.107:57620) 2023-08-10T10:49:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e49f9c700 1 -- 172.21.15.107:0/2437771337 learned_addr learned my addr 172.21.15.107:0/2437771337 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e4979b700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e44100780 0x7f4e441985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e48f9a700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e44101970 0x7f4e44198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:15.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e49f9c700 1 -- 172.21.15.107:0/2437771337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e44101970 msgr2=0x7f4e44198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:15.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e49f9c700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e44101970 0x7f4e44198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e49f9c700 1 -- 172.21.15.107:0/2437771337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e44100780 msgr2=0x7f4e441985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:15.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e49f9c700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e44100780 0x7f4e441985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:15.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e49f9c700 1 -- 172.21.15.107:0/2437771337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340095f0 con 0x7f4e44102310 2023-08-10T10:49:15.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e49f9c700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44102310 0x7f4e4419fb70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007ee0 tx=0x7f4e3c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:15.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.892+0000 7f4e3a7fc700 1 -- 172.21.15.107:0/2437771337 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c017070 con 0x7f4e44102310 2023-08-10T10:49:15.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.893+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e441a06f0 con 0x7f4e44102310 2023-08-10T10:49:15.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.893+0000 7f4e3a7fc700 1 -- 172.21.15.107:0/2437771337 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e3c00f040 con 0x7f4e44102310 2023-08-10T10:49:15.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.893+0000 7f4e3a7fc700 1 -- 172.21.15.107:0/2437771337 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c005570 con 0x7f4e44102310 2023-08-10T10:49:15.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.893+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e441a0c00 con 0x7f4e44102310 2023-08-10T10:49:15.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.894+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e44192c60 con 0x7f4e44102310 2023-08-10T10:49:15.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.895+0000 7f4e3a7fc700 1 -- 172.21.15.107:0/2437771337 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4e3c00db20 con 0x7f4e44102310 2023-08-10T10:49:15.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.897+0000 7f4e3a7fc700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4e300a1150 0x7f4e300a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:15.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.897+0000 7f4e3a7fc700 1 -- 172.21.15.107:0/2437771337 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f4e3c0cc420 con 0x7f4e44102310 2023-08-10T10:49:15.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.897+0000 7f4e4979b700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4e300a1150 0x7f4e300a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:15.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.898+0000 7f4e4979b700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4e300a1150 0x7f4e300a3610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e441017d0 tx=0x7f4e40009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:15.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:15.901+0000 7f4e3a7fc700 1 -- 172.21.15.107:0/2437771337 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4e3c095810 con 0x7f4e44102310 2023-08-10T10:49:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:15 smithi157 ceph-mon[129604]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:15 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] up:active 2023-08-10T10:49:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:15 smithi157 ceph-mon[129604]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-08-10T10:49:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:15 smithi157 ceph-mon[129604]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-08-10T10:49:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:15 smithi157 ceph-mon[129604]: Cluster is now healthy 2023-08-10T10:49:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:15 smithi157 ceph-mon[129604]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-08-10T10:49:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:15 smithi157 ceph-mon[129604]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-08-10T10:49:16.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:15 smithi157 ceph-mon[129604]: daemon mds.l is now active in filesystem cephfs as rank 4 2023-08-10T10:49:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-mon[127953]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] up:active 2023-08-10T10:49:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-mon[127953]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-08-10T10:49:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-mon[127953]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-08-10T10:49:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-mon[127953]: Cluster is now healthy 2023-08-10T10:49:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-mon[127953]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-08-10T10:49:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-mon[127953]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-08-10T10:49:16.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:15 smithi107 ceph-mon[127953]: daemon mds.l is now active in filesystem cephfs as rank 4 2023-08-10T10:49:16.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.135+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e44060bb0 con 0x7f4e300a1150 2023-08-10T10:49:16.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.139+0000 7f4e3a7fc700 1 -- 172.21.15.107:0/2437771337 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f4e44060bb0 con 0x7f4e300a1150 2023-08-10T10:49:16.140 INFO:teuthology.orchestra.run.smithi107.stdout:/volumes/_nogroup/sv_0/90b5c840-6bb9-47ad-86f6-f390c1888057 2023-08-10T10:49:16.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4e300a1150 msgr2=0x7f4e300a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4e300a1150 0x7f4e300a3610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e441017d0 tx=0x7f4e40009260 comp rx=0 tx=0).stop 2023-08-10T10:49:16.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44102310 msgr2=0x7f4e4419fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44102310 0x7f4e4419fb70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007ee0 tx=0x7f4e3c00d3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 shutdown_connections 2023-08-10T10:49:16.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4e300a1150 0x7f4e300a3610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e44100780 0x7f4e441985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e44102310 0x7f4e4419fb70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 --2- 172.21.15.107:0/2437771337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e44101970 0x7f4e44198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 >> 172.21.15.107:0/2437771337 conn(0x7f4e440fbcf0 msgr2=0x7f4e44107310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:16.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 shutdown_connections 2023-08-10T10:49:16.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.142+0000 7f4e4b9ff700 1 -- 172.21.15.107:0/2437771337 wait complete. 2023-08-10T10:49:16.161 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-08-10T10:49:16.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:15 smithi195 ceph-mon[129938]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:16.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:15 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] up:active 2023-08-10T10:49:16.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:15 smithi195 ceph-mon[129938]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-08-10T10:49:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:15 smithi195 ceph-mon[129938]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-08-10T10:49:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:15 smithi195 ceph-mon[129938]: Cluster is now healthy 2023-08-10T10:49:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:15 smithi195 ceph-mon[129938]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-08-10T10:49:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:15 smithi195 ceph-mon[129938]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-08-10T10:49:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:15 smithi195 ceph-mon[129938]: daemon mds.l is now active in filesystem cephfs as rank 4 2023-08-10T10:49:16.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.364+0000 7f24423ff700 1 -- 172.21.15.107:0/1554841840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f243c100760 msgr2=0x7f243c100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.364+0000 7f24423ff700 1 --2- 172.21.15.107:0/1554841840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f243c100760 0x7f243c100b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f242c0099c0 tx=0x7f242c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.364+0000 7f24423ff700 1 -- 172.21.15.107:0/1554841840 shutdown_connections 2023-08-10T10:49:16.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.364+0000 7f24423ff700 1 --2- 172.21.15.107:0/1554841840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243c1022f0 0x7f243c108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.364+0000 7f24423ff700 1 --2- 172.21.15.107:0/1554841840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f243c100760 0x7f243c100b80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.364+0000 7f24423ff700 1 --2- 172.21.15.107:0/1554841840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f243c101950 0x7f243c101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.364+0000 7f24423ff700 1 -- 172.21.15.107:0/1554841840 >> 172.21.15.107:0/1554841840 conn(0x7f243c0fbcb0 msgr2=0x7f243c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:16.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.364+0000 7f24423ff700 1 -- 172.21.15.107:0/1554841840 shutdown_connections 2023-08-10T10:49:16.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.365+0000 7f24423ff700 1 -- 172.21.15.107:0/1554841840 wait complete. 2023-08-10T10:49:16.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.365+0000 7f24423ff700 1 Processor -- start 2023-08-10T10:49:16.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f24423ff700 1 -- start start 2023-08-10T10:49:16.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f24423ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f243c100760 0x7f243c196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:16.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f24423ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243c101950 0x7f243c196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:16.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f24423ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f243c1022f0 0x7f243c19d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:16.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f24423ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c19de80 con 0x7f243c1022f0 2023-08-10T10:49:16.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f24423ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c19dfc0 con 0x7f243c100760 2023-08-10T10:49:16.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f24423ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c19e150 con 0x7f243c101950 2023-08-10T10:49:16.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f244099c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f243c1022f0 0x7f243c19d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:16.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f243b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243c101950 0x7f243c196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:16.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f243b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243c101950 0x7f243c196840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:60514/0 (socket says 172.21.15.107:60514) 2023-08-10T10:49:16.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f243b7fe700 1 -- 172.21.15.107:0/2000072219 learned_addr learned my addr 172.21.15.107:0/2000072219 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:16.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.366+0000 7f243bfff700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f243c100760 0x7f243c196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:16.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f244099c700 1 -- 172.21.15.107:0/2000072219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243c101950 msgr2=0x7f243c196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f244099c700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243c101950 0x7f243c196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f244099c700 1 -- 172.21.15.107:0/2000072219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f243c100760 msgr2=0x7f243c196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f244099c700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f243c100760 0x7f243c196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f244099c700 1 -- 172.21.15.107:0/2000072219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c0095f0 con 0x7f243c1022f0 2023-08-10T10:49:16.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f244099c700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f243c1022f0 0x7f243c19d8b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f243400cc50 tx=0x7f243400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:16.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f24397fa700 1 -- 172.21.15.107:0/2000072219 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243400aa90 con 0x7f243c1022f0 2023-08-10T10:49:16.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243c19e430 con 0x7f243c1022f0 2023-08-10T10:49:16.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f24397fa700 1 -- 172.21.15.107:0/2000072219 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f243400abf0 con 0x7f243c1022f0 2023-08-10T10:49:16.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f24397fa700 1 -- 172.21.15.107:0/2000072219 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24340115e0 con 0x7f243c1022f0 2023-08-10T10:49:16.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.367+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243c19e8f0 con 0x7f243c1022f0 2023-08-10T10:49:16.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.368+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243c107ca0 con 0x7f243c1022f0 2023-08-10T10:49:16.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.370+0000 7f24397fa700 1 -- 172.21.15.107:0/2000072219 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2434012420 con 0x7f243c1022f0 2023-08-10T10:49:16.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.372+0000 7f24397fa700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24240a1150 0x7f24240a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:16.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.372+0000 7f24397fa700 1 -- 172.21.15.107:0/2000072219 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f24340ccd90 con 0x7f243c1022f0 2023-08-10T10:49:16.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.372+0000 7f243bfff700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24240a1150 0x7f24240a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:16.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.373+0000 7f243bfff700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24240a1150 0x7f24240a3610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f242c000c00 tx=0x7f242c009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:16.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.376+0000 7f24397fa700 1 -- 172.21.15.107:0/2000072219 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2434096180 con 0x7f243c1022f0 2023-08-10T10:49:16.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.606+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f243c060bb0 con 0x7f24240a1150 2023-08-10T10:49:16.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.637+0000 7f24397fa700 1 -- 172.21.15.107:0/2000072219 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f24340126d0 con 0x7f243c1022f0 2023-08-10T10:49:16.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.638+0000 7f24397fa700 1 -- 172.21.15.107:0/2000072219 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f243c060bb0 con 0x7f24240a1150 2023-08-10T10:49:16.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24240a1150 msgr2=0x7f24240a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24240a1150 0x7f24240a3610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f242c000c00 tx=0x7f242c009f10 comp rx=0 tx=0).stop 2023-08-10T10:49:16.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f243c1022f0 msgr2=0x7f243c19d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f243c1022f0 0x7f243c19d8b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f243400cc50 tx=0x7f243400cf60 comp rx=0 tx=0).stop 2023-08-10T10:49:16.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 shutdown_connections 2023-08-10T10:49:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24240a1150 0x7f24240a3610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f243c100760 0x7f243c196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f243c1022f0 0x7f243c19d8b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 --2- 172.21.15.107:0/2000072219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f243c101950 0x7f243c196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 >> 172.21.15.107:0/2000072219 conn(0x7f243c0fbcb0 msgr2=0x7f243c104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 shutdown_connections 2023-08-10T10:49:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.641+0000 7f24423ff700 1 -- 172.21.15.107:0/2000072219 wait complete. 2023-08-10T10:49:16.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-08-10T10:49:16.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.865+0000 7fae68bff700 1 -- 172.21.15.107:0/3413542419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64100780 msgr2=0x7fae64100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.865+0000 7fae68bff700 1 --2- 172.21.15.107:0/3413542419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64100780 0x7fae64100ba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fae540099c0 tx=0x7fae54009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.865+0000 7fae68bff700 1 -- 172.21.15.107:0/3413542419 shutdown_connections 2023-08-10T10:49:16.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.865+0000 7fae68bff700 1 --2- 172.21.15.107:0/3413542419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae64102310 0x7fae64108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.865+0000 7fae68bff700 1 --2- 172.21.15.107:0/3413542419 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64100780 0x7fae64100ba0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.865+0000 7fae68bff700 1 --2- 172.21.15.107:0/3413542419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae64101970 0x7fae64101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.865+0000 7fae68bff700 1 -- 172.21.15.107:0/3413542419 >> 172.21.15.107:0/3413542419 conn(0x7fae640fbcf0 msgr2=0x7fae640fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:16.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.865+0000 7fae68bff700 1 -- 172.21.15.107:0/3413542419 shutdown_connections 2023-08-10T10:49:16.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.865+0000 7fae68bff700 1 -- 172.21.15.107:0/3413542419 wait complete. 2023-08-10T10:49:16.869 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.866+0000 7fae68bff700 1 Processor -- start 2023-08-10T10:49:16.869 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae68bff700 1 -- start start 2023-08-10T10:49:16.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae68bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae64100780 0x7fae64074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:16.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae68bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae64101970 0x7fae64072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:16.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae68bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64102310 0x7fae640730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:16.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae68bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64073840 con 0x7fae64102310 2023-08-10T10:49:16.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae68bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae640739b0 con 0x7fae64101970 2023-08-10T10:49:16.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae68bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae641a03c0 con 0x7fae64100780 2023-08-10T10:49:16.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae62d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64102310 0x7fae640730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:16.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae62d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64102310 0x7fae640730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57660/0 (socket says 172.21.15.107:57660) 2023-08-10T10:49:16.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae62d9d700 1 -- 172.21.15.107:0/1720727497 learned_addr learned my addr 172.21.15.107:0/1720727497 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:16.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae6259c700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae64100780 0x7fae64074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:16.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.867+0000 7fae61d9b700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae64101970 0x7fae64072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:16.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae62d9d700 1 -- 172.21.15.107:0/1720727497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae64100780 msgr2=0x7fae64074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae62d9d700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae64100780 0x7fae64074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae62d9d700 1 -- 172.21.15.107:0/1720727497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae64101970 msgr2=0x7fae64072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:16.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae62d9d700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae64101970 0x7fae64072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:16.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae62d9d700 1 -- 172.21.15.107:0/1720727497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae540095f0 con 0x7fae64102310 2023-08-10T10:49:16.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae62d9d700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64102310 0x7fae640730a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae5c007ee0 tx=0x7fae5c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:16.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae537fe700 1 -- 172.21.15.107:0/1720727497 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00dd20 con 0x7fae64102310 2023-08-10T10:49:16.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae537fe700 1 -- 172.21.15.107:0/1720727497 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae5c00f040 con 0x7fae64102310 2023-08-10T10:49:16.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae641a06a0 con 0x7fae64102310 2023-08-10T10:49:16.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae537fe700 1 -- 172.21.15.107:0/1720727497 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c004750 con 0x7fae64102310 2023-08-10T10:49:16.872 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.868+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae641a0bb0 con 0x7fae64102310 2023-08-10T10:49:16.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.869+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae64107700 con 0x7fae64102310 2023-08-10T10:49:16.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.871+0000 7fae537fe700 1 -- 172.21.15.107:0/1720727497 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fae5c003a00 con 0x7fae64102310 2023-08-10T10:49:16.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.872+0000 7fae537fe700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fae4c0a1260 0x7fae4c0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:16.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.873+0000 7fae537fe700 1 -- 172.21.15.107:0/1720727497 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fae5c0cc620 con 0x7fae64102310 2023-08-10T10:49:16.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.873+0000 7fae6259c700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fae4c0a1260 0x7fae4c0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:16.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.873+0000 7fae6259c700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fae4c0a1260 0x7fae4c0a3720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae54000c00 tx=0x7fae54009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:16.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:16.876+0000 7fae537fe700 1 -- 172.21.15.107:0/1720727497 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fae5c04e790 con 0x7fae64102310 2023-08-10T10:49:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:16 smithi157 ceph-mon[129604]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2023-08-10T10:49:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:16 smithi157 ceph-mon[129604]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:16 smithi157 ceph-mon[129604]: mgrmap e17: x(active, since 8m), standbys: z, y 2023-08-10T10:49:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:16 smithi157 ceph-mon[129604]: mds.? [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] up:active 2023-08-10T10:49:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:16 smithi157 ceph-mon[129604]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-08-10T10:49:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:16 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:49:17.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:16 smithi107 ceph-mon[127953]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2023-08-10T10:49:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:16 smithi107 ceph-mon[127953]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:16 smithi107 ceph-mon[127953]: mgrmap e17: x(active, since 8m), standbys: z, y 2023-08-10T10:49:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:16 smithi107 ceph-mon[127953]: mds.? [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] up:active 2023-08-10T10:49:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:16 smithi107 ceph-mon[127953]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-08-10T10:49:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:16 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:49:17.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.113+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fae64060bb0 con 0x7fae4c0a1260 2023-08-10T10:49:17.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.117+0000 7fae537fe700 1 -- 172.21.15.107:0/1720727497 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fae64060bb0 con 0x7fae4c0a1260 2023-08-10T10:49:17.118 INFO:teuthology.orchestra.run.smithi107.stdout:/volumes/_nogroup/sv_1/0b5a79b0-6331-4335-a6e6-2ca05ce74910 2023-08-10T10:49:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fae4c0a1260 msgr2=0x7fae4c0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fae4c0a1260 0x7fae4c0a3720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae54000c00 tx=0x7fae54009f10 comp rx=0 tx=0).stop 2023-08-10T10:49:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64102310 msgr2=0x7fae640730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64102310 0x7fae640730a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae5c007ee0 tx=0x7fae5c00d3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 shutdown_connections 2023-08-10T10:49:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fae4c0a1260 0x7fae4c0a3720 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae64102310 0x7fae640730a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae64100780 0x7fae64074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 --2- 172.21.15.107:0/1720727497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae64101970 0x7fae64072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 >> 172.21.15.107:0/1720727497 conn(0x7fae640fbcf0 msgr2=0x7fae640fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:17.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 shutdown_connections 2023-08-10T10:49:17.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.120+0000 7fae68bff700 1 -- 172.21.15.107:0/1720727497 wait complete. 2023-08-10T10:49:17.139 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:49:17.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:16 smithi195 ceph-mon[129938]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2023-08-10T10:49:17.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:16 smithi195 ceph-mon[129938]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:17.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:16 smithi195 ceph-mon[129938]: mgrmap e17: x(active, since 8m), standbys: z, y 2023-08-10T10:49:17.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:16 smithi195 ceph-mon[129938]: mds.? [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] up:active 2023-08-10T10:49:17.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:16 smithi195 ceph-mon[129938]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-08-10T10:49:17.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:16 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:49:17.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.334+0000 7f01955ff700 1 -- 172.21.15.107:0/245763978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190102300 msgr2=0x7f0190108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.334+0000 7f01955ff700 1 --2- 172.21.15.107:0/245763978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190102300 0x7f0190108bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f018800b0d0 tx=0x7f018800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.334+0000 7f01955ff700 1 -- 172.21.15.107:0/245763978 shutdown_connections 2023-08-10T10:49:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.334+0000 7f01955ff700 1 --2- 172.21.15.107:0/245763978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190102300 0x7f0190108bb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.334+0000 7f01955ff700 1 --2- 172.21.15.107:0/245763978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190100770 0x7f0190100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.334+0000 7f01955ff700 1 --2- 172.21.15.107:0/245763978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0190101960 0x7f0190101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.334+0000 7f01955ff700 1 -- 172.21.15.107:0/245763978 >> 172.21.15.107:0/245763978 conn(0x7f01900fbca0 msgr2=0x7f01900fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.334+0000 7f01955ff700 1 -- 172.21.15.107:0/245763978 shutdown_connections 2023-08-10T10:49:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.334+0000 7f01955ff700 1 -- 172.21.15.107:0/245763978 wait complete. 2023-08-10T10:49:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.335+0000 7f01955ff700 1 Processor -- start 2023-08-10T10:49:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.335+0000 7f01955ff700 1 -- start start 2023-08-10T10:49:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.335+0000 7f01955ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0190100770 0x7f0190196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.335+0000 7f01955ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190101960 0x7f01901969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.335+0000 7f01955ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190102300 0x7f019019da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f01955ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019019e010 con 0x7f0190101960 2023-08-10T10:49:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f01955ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019019e150 con 0x7f0190100770 2023-08-10T10:49:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f01955ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019019e2e0 con 0x7f0190102300 2023-08-10T10:49:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018e7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190101960 0x7f01901969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018e7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190101960 0x7f01901969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57670/0 (socket says 172.21.15.107:57670) 2023-08-10T10:49:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018e7fc700 1 -- 172.21.15.107:0/175487854 learned_addr learned my addr 172.21.15.107:0/175487854 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018effd700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0190100770 0x7f0190196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018f7fe700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190102300 0x7f019019da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018e7fc700 1 -- 172.21.15.107:0/175487854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190102300 msgr2=0x7f019019da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018e7fc700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190102300 0x7f019019da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018e7fc700 1 -- 172.21.15.107:0/175487854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0190100770 msgr2=0x7f0190196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018e7fc700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0190100770 0x7f0190196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018e7fc700 1 -- 172.21.15.107:0/175487854 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188009d00 con 0x7f0190101960 2023-08-10T10:49:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018f7fe700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190102300 0x7f019019da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018effd700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0190100770 0x7f0190196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.336+0000 7f018e7fc700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190101960 0x7f01901969d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f018400e9a0 tx=0x7f018400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.337+0000 7f0177fff700 1 -- 172.21.15.107:0/175487854 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184009790 con 0x7f0190101960 2023-08-10T10:49:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.337+0000 7f0177fff700 1 -- 172.21.15.107:0/175487854 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f018400cbd0 con 0x7f0190101960 2023-08-10T10:49:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.337+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019019e5c0 con 0x7f0190101960 2023-08-10T10:49:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.337+0000 7f0177fff700 1 -- 172.21.15.107:0/175487854 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184018680 con 0x7f0190101960 2023-08-10T10:49:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.337+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019019eb20 con 0x7f0190101960 2023-08-10T10:49:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.338+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0190107d10 con 0x7f0190101960 2023-08-10T10:49:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.340+0000 7f0177fff700 1 -- 172.21.15.107:0/175487854 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f018400cd40 con 0x7f0190101960 2023-08-10T10:49:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.341+0000 7f0177fff700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01780a12a0 0x7f01780a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.341+0000 7f0177fff700 1 -- 172.21.15.107:0/175487854 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f0184014070 con 0x7f0190101960 2023-08-10T10:49:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.341+0000 7f018effd700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01780a12a0 0x7f01780a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.342+0000 7f018effd700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01780a12a0 0x7f01780a3760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f01901017c0 tx=0x7f0180009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:17.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.345+0000 7f0177fff700 1 -- 172.21.15.107:0/175487854 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0184051790 con 0x7f0190101960 2023-08-10T10:49:17.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.588+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f019002c970 con 0x7f0190101960 2023-08-10T10:49:17.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.589+0000 7f0177fff700 1 -- 172.21.15.107:0/175487854 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10914 (secure 0 0 0) 0x7f0184099da0 con 0x7f0190101960 2023-08-10T10:49:17.590 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:17.590 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:49:16.643966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:49:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01780a12a0 msgr2=0x7f01780a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01780a12a0 0x7f01780a3760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f01901017c0 tx=0x7f0180009260 comp rx=0 tx=0).stop 2023-08-10T10:49:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190101960 msgr2=0x7f01901969d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190101960 0x7f01901969d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f018400e9a0 tx=0x7f018400ed60 comp rx=0 tx=0).stop 2023-08-10T10:49:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 shutdown_connections 2023-08-10T10:49:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f01780a12a0 0x7f01780a3760 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0190100770 0x7f0190196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190102300 0x7f019019da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 --2- 172.21.15.107:0/175487854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0190101960 0x7f01901969d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 >> 172.21.15.107:0/175487854 conn(0x7f01900fbca0 msgr2=0x7f0190104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.591+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 shutdown_connections 2023-08-10T10:49:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.592+0000 7f01955ff700 1 -- 172.21.15.107:0/175487854 wait complete. 2023-08-10T10:49:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:49:17.611 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:49:17.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.810+0000 7fd1463ff700 1 -- 172.21.15.107:0/1463562271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140102310 msgr2=0x7fd140108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.810+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1463562271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140102310 0x7fd140108bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd13800b0d0 tx=0x7fd13800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.810+0000 7fd1463ff700 1 -- 172.21.15.107:0/1463562271 shutdown_connections 2023-08-10T10:49:17.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.810+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1463562271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140102310 0x7fd140108bc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.810+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1463562271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd140100780 0x7fd140100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.810+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1463562271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd140101970 0x7fd140101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.810+0000 7fd1463ff700 1 -- 172.21.15.107:0/1463562271 >> 172.21.15.107:0/1463562271 conn(0x7fd1400fbcb0 msgr2=0x7fd1400fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:17.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.810+0000 7fd1463ff700 1 -- 172.21.15.107:0/1463562271 shutdown_connections 2023-08-10T10:49:17.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.810+0000 7fd1463ff700 1 -- 172.21.15.107:0/1463562271 wait complete. 2023-08-10T10:49:17.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.811+0000 7fd1463ff700 1 Processor -- start 2023-08-10T10:49:17.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.811+0000 7fd1463ff700 1 -- start start 2023-08-10T10:49:17.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd1463ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd140100780 0x7fd140074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:17.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd1463ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140101970 0x7fd140072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:17.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd1463ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd140102310 0x7fd1400730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:17.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd1463ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140073840 con 0x7fd140101970 2023-08-10T10:49:17.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd1463ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400739b0 con 0x7fd140100780 2023-08-10T10:49:17.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd1463ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401a0450 con 0x7fd140102310 2023-08-10T10:49:17.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140101970 0x7fd140072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:17.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140101970 0x7fd140072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57678/0 (socket says 172.21.15.107:57678) 2023-08-10T10:49:17.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13f7fe700 1 -- 172.21.15.107:0/1665150912 learned_addr learned my addr 172.21.15.107:0/1665150912 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:17.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd14499c700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd140102310 0x7fd1400730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:17.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13ffff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd140100780 0x7fd140074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:17.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13f7fe700 1 -- 172.21.15.107:0/1665150912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd140102310 msgr2=0x7fd1400730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13f7fe700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd140102310 0x7fd1400730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13f7fe700 1 -- 172.21.15.107:0/1665150912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd140100780 msgr2=0x7fd140074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:17.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13f7fe700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd140100780 0x7fd140074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:17.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13f7fe700 1 -- 172.21.15.107:0/1665150912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd138009d00 con 0x7fd140101970 2023-08-10T10:49:17.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd14499c700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd140102310 0x7fd1400730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:17.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.812+0000 7fd13ffff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd140100780 0x7fd140074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:17.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.813+0000 7fd13f7fe700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140101970 0x7fd140072b60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd13400d950 tx=0x7fd13400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:17.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.813+0000 7fd13d7fa700 1 -- 172.21.15.107:0/1665150912 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134009b40 con 0x7fd140101970 2023-08-10T10:49:17.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.813+0000 7fd13d7fa700 1 -- 172.21.15.107:0/1665150912 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd134009ca0 con 0x7fd140101970 2023-08-10T10:49:17.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.813+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1401a0730 con 0x7fd140101970 2023-08-10T10:49:17.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.813+0000 7fd13d7fa700 1 -- 172.21.15.107:0/1665150912 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400f620 con 0x7fd140101970 2023-08-10T10:49:17.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.813+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1401a0c40 con 0x7fd140101970 2023-08-10T10:49:17.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.814+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd140107cd0 con 0x7fd140101970 2023-08-10T10:49:17.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.816+0000 7fd13d7fa700 1 -- 172.21.15.107:0/1665150912 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fd134010460 con 0x7fd140101970 2023-08-10T10:49:17.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.818+0000 7fd13d7fa700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1280a1220 0x7fd1280a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:17.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.818+0000 7fd13d7fa700 1 -- 172.21.15.107:0/1665150912 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fd1340cd1b0 con 0x7fd140101970 2023-08-10T10:49:17.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.818+0000 7fd13ffff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1280a1220 0x7fd1280a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:17.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.818+0000 7fd13ffff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1280a1220 0x7fd1280a36e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1401017d0 tx=0x7fd130009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:17.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:17.821+0000 7fd13d7fa700 1 -- 172.21.15.107:0/1665150912 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd134096440 con 0x7fd140101970 2023-08-10T10:49:18.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.023+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd14002c970 con 0x7fd140101970 2023-08-10T10:49:18.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.024+0000 7fd13d7fa700 1 -- 172.21.15.107:0/1665150912 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24517 (secure 0 0 0) 0x7fd134099a60 con 0x7fd140101970 2023-08-10T10:49:18.026 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:18.026 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":91,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:49:12.696718+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:18.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1280a1220 msgr2=0x7fd1280a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1280a1220 0x7fd1280a36e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1401017d0 tx=0x7fd130009260 comp rx=0 tx=0).stop 2023-08-10T10:49:18.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140101970 msgr2=0x7fd140072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140101970 0x7fd140072b60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd13400d950 tx=0x7fd13400dd10 comp rx=0 tx=0).stop 2023-08-10T10:49:18.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 shutdown_connections 2023-08-10T10:49:18.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1280a1220 0x7fd1280a36e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd140100780 0x7fd140074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd140102310 0x7fd1400730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 --2- 172.21.15.107:0/1665150912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd140101970 0x7fd140072b60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 >> 172.21.15.107:0/1665150912 conn(0x7fd1400fbcb0 msgr2=0x7fd140104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:18.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 shutdown_connections 2023-08-10T10:49:18.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.027+0000 7fd1463ff700 1 -- 172.21.15.107:0/1665150912 wait complete. 2023-08-10T10:49:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:17 smithi157 ceph-mon[129604]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:18.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:17 smithi157 ceph-mon[129604]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:18.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:17 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/175487854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:49:18.039 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:49:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-b[155067]: 2023-08-10T10:49:17.839+0000 7f4c04b5c700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-08-10T10:49:18.040 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:49:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-b[155067]: 2023-08-10T10:49:17.839+0000 7f4c04b5c700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-08-10T10:49:18.040 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:49:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-b[155067]: 2023-08-10T10:49:17.839+0000 7f4c04b5c700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-08-10T10:49:18.041 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 10:49:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-b[155067]: 2023-08-10T10:49:17.839+0000 7f4c04b5c700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-08-10T10:49:18.044 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:17 smithi107 ceph-mon[127953]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:18.044 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:17 smithi107 ceph-mon[127953]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:18.045 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:17 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/175487854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:49:18.047 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:49:18.048 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:49:18.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:17 smithi195 ceph-mon[129938]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:17 smithi195 ceph-mon[129938]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:49:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:17 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/175487854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:49:18.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.244+0000 7fa4f5fff700 1 -- 172.21.15.107:0/1214406677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0102310 msgr2=0x7fa4f0108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.244+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/1214406677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0102310 0x7fa4f0108bc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800b0d0 tx=0x7fa4e800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.244+0000 7fa4f5fff700 1 -- 172.21.15.107:0/1214406677 shutdown_connections 2023-08-10T10:49:18.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.244+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/1214406677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0102310 0x7fa4f0108bc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.244+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/1214406677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4f0100780 0x7fa4f0100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.244+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/1214406677 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f0101970 0x7fa4f0101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.244+0000 7fa4f5fff700 1 -- 172.21.15.107:0/1214406677 >> 172.21.15.107:0/1214406677 conn(0x7fa4f00fbcb0 msgr2=0x7fa4f00fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:18.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.244+0000 7fa4f5fff700 1 -- 172.21.15.107:0/1214406677 shutdown_connections 2023-08-10T10:49:18.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.244+0000 7fa4f5fff700 1 -- 172.21.15.107:0/1214406677 wait complete. 2023-08-10T10:49:18.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.245+0000 7fa4f5fff700 1 Processor -- start 2023-08-10T10:49:18.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4f5fff700 1 -- start start 2023-08-10T10:49:18.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4f5fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f0100780 0x7fa4f0198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:18.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4f5fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0101970 0x7fa4f0198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:18.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4f5fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4f0102310 0x7fa4f019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:18.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4f5fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f01a0180 con 0x7fa4f0101970 2023-08-10T10:49:18.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4f5fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f01a02c0 con 0x7fa4f0100780 2023-08-10T10:49:18.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4f5fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f01a0450 con 0x7fa4f0102310 2023-08-10T10:49:18.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4eeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0101970 0x7fa4f0198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:18.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4eeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0101970 0x7fa4f0198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57692/0 (socket says 172.21.15.107:57692) 2023-08-10T10:49:18.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4eeffd700 1 -- 172.21.15.107:0/718651173 learned_addr learned my addr 172.21.15.107:0/718651173 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:18.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4effff700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4f0102310 0x7fa4f019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:18.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.246+0000 7fa4ef7fe700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f0100780 0x7fa4f0198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:18.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4eeffd700 1 -- 172.21.15.107:0/718651173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4f0102310 msgr2=0x7fa4f019fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4eeffd700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4f0102310 0x7fa4f019fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4eeffd700 1 -- 172.21.15.107:0/718651173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f0100780 msgr2=0x7fa4f0198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4eeffd700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f0100780 0x7fa4f0198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4eeffd700 1 -- 172.21.15.107:0/718651173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e8009d00 con 0x7fa4f0101970 2023-08-10T10:49:18.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4ef7fe700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f0100780 0x7fa4f0198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:18.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4eeffd700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0101970 0x7fa4f0198b40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400d980 tx=0x7fa4e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:18.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4ecff9700 1 -- 172.21.15.107:0/718651173 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4004220 con 0x7fa4f0101970 2023-08-10T10:49:18.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4ecff9700 1 -- 172.21.15.107:0/718651173 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4e4007640 con 0x7fa4f0101970 2023-08-10T10:49:18.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f01a0730 con 0x7fa4f0101970 2023-08-10T10:49:18.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4ecff9700 1 -- 172.21.15.107:0/718651173 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40055e0 con 0x7fa4f0101970 2023-08-10T10:49:18.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.247+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f01a0c90 con 0x7fa4f0101970 2023-08-10T10:49:18.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.248+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f0192c40 con 0x7fa4f0101970 2023-08-10T10:49:18.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.250+0000 7fa4ecff9700 1 -- 172.21.15.107:0/718651173 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa4e4004750 con 0x7fa4f0101970 2023-08-10T10:49:18.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.251+0000 7fa4ecff9700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4d80a12a0 0x7fa4d80a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:18.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.252+0000 7fa4ecff9700 1 -- 172.21.15.107:0/718651173 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fa4e40ccb60 con 0x7fa4f0101970 2023-08-10T10:49:18.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.252+0000 7fa4ef7fe700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4d80a12a0 0x7fa4d80a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:18.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.252+0000 7fa4ef7fe700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4d80a12a0 0x7fa4d80a3760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa4f01017d0 tx=0x7fa4e0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:18.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.255+0000 7fa4ecff9700 1 -- 172.21.15.107:0/718651173 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa4e4095df0 con 0x7fa4f0101970 2023-08-10T10:49:18.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.452+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4f0060bb0 con 0x7fa4d80a12a0 2023-08-10T10:49:18.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.467+0000 7fa4ecff9700 1 -- 172.21.15.107:0/718651173 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+421490 (secure 0 0 0) 0x7fa4f0060bb0 con 0x7fa4d80a12a0 2023-08-10T10:49:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:18.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.471+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4d80a12a0 msgr2=0x7fa4d80a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.471+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4d80a12a0 0x7fa4d80a3760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa4f01017d0 tx=0x7fa4e0009260 comp rx=0 tx=0).stop 2023-08-10T10:49:18.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.471+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0101970 msgr2=0x7fa4f0198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.471+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0101970 0x7fa4f0198b40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400d980 tx=0x7fa4e400dc90 comp rx=0 tx=0).stop 2023-08-10T10:49:18.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.472+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 shutdown_connections 2023-08-10T10:49:18.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.472+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4d80a12a0 0x7fa4d80a3760 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.472+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4f0100780 0x7fa4f0198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.472+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4f0102310 0x7fa4f019fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.472+0000 7fa4f5fff700 1 --2- 172.21.15.107:0/718651173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4f0101970 0x7fa4f0198b40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.472+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 >> 172.21.15.107:0/718651173 conn(0x7fa4f00fbcb0 msgr2=0x7fa4f0107230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:18.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.472+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 shutdown_connections 2023-08-10T10:49:18.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.472+0000 7fa4f5fff700 1 -- 172.21.15.107:0/718651173 wait complete. 2023-08-10T10:49:18.478 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-08-10T10:49:18.492 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2023-08-10T10:49:17.582542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597920,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":154,"num_read_kb":137,"num_write":330,"num_write_kb":2996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":418,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336176,"kb_used_data":11944,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605648,"statfs":{"total":1151940427776,"available":1151596183552,"internally_reserved":0,"allocated":12230656,"data_stored":7746402,"data_compressed":316512,"data_compressed_allocated":425984,"data_compressed_original":2351104,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2960,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":100,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002418"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714060+0000","last_change":"2023-08-10T10:48:42.585259+0000","last_active":"2023-08-10T10:49:12.714060+0000","last_peered":"2023-08-10T10:49:12.714060+0000","last_clean":"2023-08-10T10:49:12.714060+0000","last_became_active":"2023-08-10T10:48:42.584501+0000","last_became_peered":"2023-08-10T10:48:42.584501+0000","last_unstale":"2023-08-10T10:49:12.714060+0000","last_undegraded":"2023-08-10T10:49:12.714060+0000","last_fullsized":"2023-08-10T10:49:12.714060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:31.281761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731723+0000","last_change":"2023-08-10T10:48:42.577812+0000","last_active":"2023-08-10T10:49:12.731723+0000","last_peered":"2023-08-10T10:49:12.731723+0000","last_clean":"2023-08-10T10:49:12.731723+0000","last_became_active":"2023-08-10T10:48:42.577499+0000","last_became_peered":"2023-08-10T10:48:42.577499+0000","last_unstale":"2023-08-10T10:49:12.731723+0000","last_undegraded":"2023-08-10T10:49:12.731723+0000","last_fullsized":"2023-08-10T10:49:12.731723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:32.054997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731226+0000","last_change":"2023-08-10T10:48:42.577302+0000","last_active":"2023-08-10T10:49:12.731226+0000","last_peered":"2023-08-10T10:49:12.731226+0000","last_clean":"2023-08-10T10:49:12.731226+0000","last_became_active":"2023-08-10T10:48:42.577022+0000","last_became_peered":"2023-08-10T10:48:42.577022+0000","last_unstale":"2023-08-10T10:49:12.731226+0000","last_undegraded":"2023-08-10T10:49:12.731226+0000","last_fullsized":"2023-08-10T10:49:12.731226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:19.509385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707930+0000","last_change":"2023-08-10T10:48:42.577198+0000","last_active":"2023-08-10T10:49:12.707930+0000","last_peered":"2023-08-10T10:49:12.707930+0000","last_clean":"2023-08-10T10:49:12.707930+0000","last_became_active":"2023-08-10T10:48:42.576887+0000","last_became_peered":"2023-08-10T10:48:42.576887+0000","last_unstale":"2023-08-10T10:49:12.707930+0000","last_undegraded":"2023-08-10T10:49:12.707930+0000","last_fullsized":"2023-08-10T10:49:12.707930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:13.115193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712407+0000","last_change":"2023-08-10T10:48:42.587532+0000","last_active":"2023-08-10T10:49:12.712407+0000","last_peered":"2023-08-10T10:49:12.712407+0000","last_clean":"2023-08-10T10:49:12.712407+0000","last_became_active":"2023-08-10T10:48:42.587199+0000","last_became_peered":"2023-08-10T10:48:42.587199+0000","last_unstale":"2023-08-10T10:49:12.712407+0000","last_undegraded":"2023-08-10T10:49:12.712407+0000","last_fullsized":"2023-08-10T10:49:12.712407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:39.740129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711152+0000","last_change":"2023-08-10T10:48:42.581998+0000","last_active":"2023-08-10T10:49:12.711152+0000","last_peered":"2023-08-10T10:49:12.711152+0000","last_clean":"2023-08-10T10:49:12.711152+0000","last_became_active":"2023-08-10T10:48:42.581683+0000","last_became_peered":"2023-08-10T10:48:42.581683+0000","last_unstale":"2023-08-10T10:49:12.711152+0000","last_undegraded":"2023-08-10T10:49:12.711152+0000","last_fullsized":"2023-08-10T10:49:12.711152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:19.796398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717754+0000","last_change":"2023-08-10T10:48:42.578452+0000","last_active":"2023-08-10T10:49:12.717754+0000","last_peered":"2023-08-10T10:49:12.717754+0000","last_clean":"2023-08-10T10:49:12.717754+0000","last_became_active":"2023-08-10T10:48:42.577456+0000","last_became_peered":"2023-08-10T10:48:42.577456+0000","last_unstale":"2023-08-10T10:49:12.717754+0000","last_undegraded":"2023-08-10T10:49:12.717754+0000","last_fullsized":"2023-08-10T10:49:12.717754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:17:35.823145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717028+0000","last_change":"2023-08-10T10:48:42.578839+0000","last_active":"2023-08-10T10:49:12.717028+0000","last_peered":"2023-08-10T10:49:12.717028+0000","last_clean":"2023-08-10T10:49:12.717028+0000","last_became_active":"2023-08-10T10:48:42.578450+0000","last_became_peered":"2023-08-10T10:48:42.578450+0000","last_unstale":"2023-08-10T10:49:12.717028+0000","last_undegraded":"2023-08-10T10:49:12.717028+0000","last_fullsized":"2023-08-10T10:49:12.717028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:29:39.316129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708298+0000","last_change":"2023-08-10T10:48:42.588533+0000","last_active":"2023-08-10T10:49:12.708298+0000","last_peered":"2023-08-10T10:49:12.708298+0000","last_clean":"2023-08-10T10:49:12.708298+0000","last_became_active":"2023-08-10T10:48:42.588205+0000","last_became_peered":"2023-08-10T10:48:42.588205+0000","last_unstale":"2023-08-10T10:49:12.708298+0000","last_undegraded":"2023-08-10T10:49:12.708298+0000","last_fullsized":"2023-08-10T10:49:12.708298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:27.853522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711349+0000","last_change":"2023-08-10T10:48:42.588606+0000","last_active":"2023-08-10T10:49:12.711349+0000","last_peered":"2023-08-10T10:49:12.711349+0000","last_clean":"2023-08-10T10:49:12.711349+0000","last_became_active":"2023-08-10T10:48:42.588261+0000","last_became_peered":"2023-08-10T10:48:42.588261+0000","last_unstale":"2023-08-10T10:49:12.711349+0000","last_undegraded":"2023-08-10T10:49:12.711349+0000","last_fullsized":"2023-08-10T10:49:12.711349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:08:25.435478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718340+0000","last_change":"2023-08-10T10:48:42.577245+0000","last_active":"2023-08-10T10:49:12.718340+0000","last_peered":"2023-08-10T10:49:12.718340+0000","last_clean":"2023-08-10T10:49:12.718340+0000","last_became_active":"2023-08-10T10:48:42.576512+0000","last_became_peered":"2023-08-10T10:48:42.576512+0000","last_unstale":"2023-08-10T10:49:12.718340+0000","last_undegraded":"2023-08-10T10:49:12.718340+0000","last_fullsized":"2023-08-10T10:49:12.718340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:41.419282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707744+0000","last_change":"2023-08-10T10:48:42.590704+0000","last_active":"2023-08-10T10:49:12.707744+0000","last_peered":"2023-08-10T10:49:12.707744+0000","last_clean":"2023-08-10T10:49:12.707744+0000","last_became_active":"2023-08-10T10:48:42.590360+0000","last_became_peered":"2023-08-10T10:48:42.590360+0000","last_unstale":"2023-08-10T10:49:12.707744+0000","last_undegraded":"2023-08-10T10:49:12.707744+0000","last_fullsized":"2023-08-10T10:49:12.707744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:27.858538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712842+0000","last_change":"2023-08-10T10:48:42.580072+0000","last_active":"2023-08-10T10:49:12.712842+0000","last_peered":"2023-08-10T10:49:12.712842+0000","last_clean":"2023-08-10T10:49:12.712842+0000","last_became_active":"2023-08-10T10:48:42.579745+0000","last_became_peered":"2023-08-10T10:48:42.579745+0000","last_unstale":"2023-08-10T10:49:12.712842+0000","last_undegraded":"2023-08-10T10:49:12.712842+0000","last_fullsized":"2023-08-10T10:49:12.712842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:58.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730013+0000","last_change":"2023-08-10T10:48:42.577050+0000","last_active":"2023-08-10T10:49:12.730013+0000","last_peered":"2023-08-10T10:49:12.730013+0000","last_clean":"2023-08-10T10:49:12.730013+0000","last_became_active":"2023-08-10T10:48:42.576686+0000","last_became_peered":"2023-08-10T10:48:42.576686+0000","last_unstale":"2023-08-10T10:49:12.730013+0000","last_undegraded":"2023-08-10T10:49:12.730013+0000","last_fullsized":"2023-08-10T10:49:12.730013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:20:27.181934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730451+0000","last_change":"2023-08-10T10:48:42.582939+0000","last_active":"2023-08-10T10:49:12.730451+0000","last_peered":"2023-08-10T10:49:12.730451+0000","last_clean":"2023-08-10T10:49:12.730451+0000","last_became_active":"2023-08-10T10:48:42.582560+0000","last_became_peered":"2023-08-10T10:48:42.582560+0000","last_unstale":"2023-08-10T10:49:12.730451+0000","last_undegraded":"2023-08-10T10:49:12.730451+0000","last_fullsized":"2023-08-10T10:49:12.730451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:36:49.334857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.706881+0000","last_change":"2023-08-10T10:48:42.577163+0000","last_active":"2023-08-10T10:49:12.706881+0000","last_peered":"2023-08-10T10:49:12.706881+0000","last_clean":"2023-08-10T10:49:12.706881+0000","last_became_active":"2023-08-10T10:48:42.576866+0000","last_became_peered":"2023-08-10T10:48:42.576866+0000","last_unstale":"2023-08-10T10:49:12.706881+0000","last_undegraded":"2023-08-10T10:49:12.706881+0000","last_fullsized":"2023-08-10T10:49:12.706881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:50:27.812527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713970+0000","last_change":"2023-08-10T10:48:42.585496+0000","last_active":"2023-08-10T10:49:12.713970+0000","last_peered":"2023-08-10T10:49:12.713970+0000","last_clean":"2023-08-10T10:49:12.713970+0000","last_became_active":"2023-08-10T10:48:42.584963+0000","last_became_peered":"2023-08-10T10:48:42.584963+0000","last_unstale":"2023-08-10T10:49:12.713970+0000","last_undegraded":"2023-08-10T10:49:12.713970+0000","last_fullsized":"2023-08-10T10:49:12.713970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:05.902933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709523+0000","last_change":"2023-08-10T10:48:42.576038+0000","last_active":"2023-08-10T10:49:12.709523+0000","last_peered":"2023-08-10T10:49:12.709523+0000","last_clean":"2023-08-10T10:49:12.709523+0000","last_became_active":"2023-08-10T10:48:42.575660+0000","last_became_peered":"2023-08-10T10:48:42.575660+0000","last_unstale":"2023-08-10T10:49:12.709523+0000","last_undegraded":"2023-08-10T10:49:12.709523+0000","last_fullsized":"2023-08-10T10:49:12.709523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:17.443396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717536+0000","last_change":"2023-08-10T10:48:42.573855+0000","last_active":"2023-08-10T10:49:12.717536+0000","last_peered":"2023-08-10T10:49:12.717536+0000","last_clean":"2023-08-10T10:49:12.717536+0000","last_became_active":"2023-08-10T10:48:42.573475+0000","last_became_peered":"2023-08-10T10:48:42.573475+0000","last_unstale":"2023-08-10T10:49:12.717536+0000","last_undegraded":"2023-08-10T10:49:12.717536+0000","last_fullsized":"2023-08-10T10:49:12.717536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:13:36.282148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719366+0000","last_change":"2023-08-10T10:48:46.628005+0000","last_active":"2023-08-10T10:49:12.719366+0000","last_peered":"2023-08-10T10:49:12.719366+0000","last_clean":"2023-08-10T10:49:12.719366+0000","last_became_active":"2023-08-10T10:48:46.627558+0000","last_became_peered":"2023-08-10T10:48:46.627558+0000","last_unstale":"2023-08-10T10:49:12.719366+0000","last_undegraded":"2023-08-10T10:49:12.719366+0000","last_fullsized":"2023-08-10T10:49:12.719366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:33:01.121958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'4","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709270+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:49:12.709270+0000","last_peered":"2023-08-10T10:49:12.709270+0000","last_clean":"2023-08-10T10:49:12.709270+0000","last_became_active":"2023-08-10T10:48:41.585341+0000","last_became_peered":"2023-08-10T10:48:41.585341+0000","last_unstale":"2023-08-10T10:49:12.709270+0000","last_undegraded":"2023-08-10T10:49:12.709270+0000","last_fullsized":"2023-08-10T10:49:12.709270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:34.374039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717943+0000","last_change":"2023-08-10T10:48:42.580893+0000","last_active":"2023-08-10T10:49:12.717943+0000","last_peered":"2023-08-10T10:49:12.717943+0000","last_clean":"2023-08-10T10:49:12.717943+0000","last_became_active":"2023-08-10T10:48:42.580591+0000","last_became_peered":"2023-08-10T10:48:42.580591+0000","last_unstale":"2023-08-10T10:49:12.717943+0000","last_undegraded":"2023-08-10T10:49:12.717943+0000","last_fullsized":"2023-08-10T10:49:12.717943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:32.998434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707054+0000","last_change":"2023-08-10T10:48:46.635407+0000","last_active":"2023-08-10T10:49:12.707054+0000","last_peered":"2023-08-10T10:49:12.707054+0000","last_clean":"2023-08-10T10:49:12.707054+0000","last_became_active":"2023-08-10T10:48:46.634936+0000","last_became_peered":"2023-08-10T10:48:46.634936+0000","last_unstale":"2023-08-10T10:49:12.707054+0000","last_undegraded":"2023-08-10T10:49:12.707054+0000","last_fullsized":"2023-08-10T10:49:12.707054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:17:41.129674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718213+0000","last_change":"2023-08-10T10:48:41.588054+0000","last_active":"2023-08-10T10:49:12.718213+0000","last_peered":"2023-08-10T10:49:12.718213+0000","last_clean":"2023-08-10T10:49:12.718213+0000","last_became_active":"2023-08-10T10:48:41.587764+0000","last_became_peered":"2023-08-10T10:48:41.587764+0000","last_unstale":"2023-08-10T10:49:12.718213+0000","last_undegraded":"2023-08-10T10:49:12.718213+0000","last_fullsized":"2023-08-10T10:49:12.718213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:07:17.541181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731849+0000","last_change":"2023-08-10T10:48:42.581834+0000","last_active":"2023-08-10T10:49:12.731849+0000","last_peered":"2023-08-10T10:49:12.731849+0000","last_clean":"2023-08-10T10:49:12.731849+0000","last_became_active":"2023-08-10T10:48:42.581438+0000","last_became_peered":"2023-08-10T10:48:42.581438+0000","last_unstale":"2023-08-10T10:49:12.731849+0000","last_undegraded":"2023-08-10T10:49:12.731849+0000","last_fullsized":"2023-08-10T10:49:12.731849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:05:46.899608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.737051+0000","last_change":"2023-08-10T10:49:12.737051+0000","last_active":"2023-08-10T10:49:12.737051+0000","last_peered":"2023-08-10T10:49:12.737051+0000","last_clean":"2023-08-10T10:49:12.737051+0000","last_became_active":"2023-08-10T10:49:12.736586+0000","last_became_peered":"2023-08-10T10:49:12.736586+0000","last_unstale":"2023-08-10T10:49:12.737051+0000","last_undegraded":"2023-08-10T10:49:12.737051+0000","last_fullsized":"2023-08-10T10:49:12.737051+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:41.900139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'11","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.638028+0000","last_change":"2023-08-10T10:49:12.734942+0000","last_active":"2023-08-10T10:49:15.638028+0000","last_peered":"2023-08-10T10:49:15.638028+0000","last_clean":"2023-08-10T10:49:15.638028+0000","last_became_active":"2023-08-10T10:49:12.720078+0000","last_became_peered":"2023-08-10T10:49:12.720078+0000","last_unstale":"2023-08-10T10:49:15.638028+0000","last_undegraded":"2023-08-10T10:49:15.638028+0000","last_fullsized":"2023-08-10T10:49:15.638028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:02.059905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707771+0000","last_change":"2023-08-10T10:48:42.581222+0000","last_active":"2023-08-10T10:49:12.707771+0000","last_peered":"2023-08-10T10:49:12.707771+0000","last_clean":"2023-08-10T10:49:12.707771+0000","last_became_active":"2023-08-10T10:48:42.580885+0000","last_became_peered":"2023-08-10T10:48:42.580885+0000","last_unstale":"2023-08-10T10:49:12.707771+0000","last_undegraded":"2023-08-10T10:49:12.707771+0000","last_fullsized":"2023-08-10T10:49:12.707771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:44:10.016090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707604+0000","last_change":"2023-08-10T10:48:46.626985+0000","last_active":"2023-08-10T10:49:12.707604+0000","last_peered":"2023-08-10T10:49:12.707604+0000","last_clean":"2023-08-10T10:49:12.707604+0000","last_became_active":"2023-08-10T10:48:46.626292+0000","last_became_peered":"2023-08-10T10:48:46.626292+0000","last_unstale":"2023-08-10T10:49:12.707604+0000","last_undegraded":"2023-08-10T10:49:12.707604+0000","last_fullsized":"2023-08-10T10:49:12.707604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:17.994796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636981+0000","last_change":"2023-08-10T10:48:41.588563+0000","last_active":"2023-08-10T10:49:15.636981+0000","last_peered":"2023-08-10T10:49:15.636981+0000","last_clean":"2023-08-10T10:49:15.636981+0000","last_became_active":"2023-08-10T10:48:41.588250+0000","last_became_peered":"2023-08-10T10:48:41.588250+0000","last_unstale":"2023-08-10T10:49:15.636981+0000","last_undegraded":"2023-08-10T10:49:15.636981+0000","last_fullsized":"2023-08-10T10:49:15.636981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:12.146812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715313+0000","last_change":"2023-08-10T10:49:12.714641+0000","last_active":"2023-08-10T10:49:12.715313+0000","last_peered":"2023-08-10T10:49:12.715313+0000","last_clean":"2023-08-10T10:49:12.715313+0000","last_became_active":"2023-08-10T10:49:12.714185+0000","last_became_peered":"2023-08-10T10:49:12.714185+0000","last_unstale":"2023-08-10T10:49:12.715313+0000","last_undegraded":"2023-08-10T10:49:12.715313+0000","last_fullsized":"2023-08-10T10:49:12.715313+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:34:26.821493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717311+0000","last_change":"2023-08-10T10:48:46.630641+0000","last_active":"2023-08-10T10:49:12.717311+0000","last_peered":"2023-08-10T10:49:12.717311+0000","last_clean":"2023-08-10T10:49:12.717311+0000","last_became_active":"2023-08-10T10:48:46.630231+0000","last_became_peered":"2023-08-10T10:48:46.630231+0000","last_unstale":"2023-08-10T10:49:12.717311+0000","last_undegraded":"2023-08-10T10:49:12.717311+0000","last_fullsized":"2023-08-10T10:49:12.717311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:57:59.187279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.611065+0000","last_change":"2023-08-10T10:48:41.586083+0000","last_active":"2023-08-10T10:49:13.611065+0000","last_peered":"2023-08-10T10:49:13.611065+0000","last_clean":"2023-08-10T10:49:13.611065+0000","last_became_active":"2023-08-10T10:48:41.585714+0000","last_became_peered":"2023-08-10T10:48:41.585714+0000","last_unstale":"2023-08-10T10:49:13.611065+0000","last_undegraded":"2023-08-10T10:49:13.611065+0000","last_fullsized":"2023-08-10T10:49:13.611065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:28.992239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712459+0000","last_change":"2023-08-10T10:48:42.578007+0000","last_active":"2023-08-10T10:49:12.712459+0000","last_peered":"2023-08-10T10:49:12.712459+0000","last_clean":"2023-08-10T10:49:12.712459+0000","last_became_active":"2023-08-10T10:48:42.577687+0000","last_became_peered":"2023-08-10T10:48:42.577687+0000","last_unstale":"2023-08-10T10:49:12.712459+0000","last_undegraded":"2023-08-10T10:49:12.712459+0000","last_fullsized":"2023-08-10T10:49:12.712459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:23.114738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719097+0000","last_change":"2023-08-10T10:48:46.633618+0000","last_active":"2023-08-10T10:49:12.719097+0000","last_peered":"2023-08-10T10:49:12.719097+0000","last_clean":"2023-08-10T10:49:12.719097+0000","last_became_active":"2023-08-10T10:48:46.633223+0000","last_became_peered":"2023-08-10T10:48:46.633223+0000","last_unstale":"2023-08-10T10:49:12.719097+0000","last_undegraded":"2023-08-10T10:49:12.719097+0000","last_fullsized":"2023-08-10T10:49:12.719097+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:03.852150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.619031+0000","last_change":"2023-08-10T10:48:41.591262+0000","last_active":"2023-08-10T10:49:13.619031+0000","last_peered":"2023-08-10T10:49:13.619031+0000","last_clean":"2023-08-10T10:49:13.619031+0000","last_became_active":"2023-08-10T10:48:41.590879+0000","last_became_peered":"2023-08-10T10:48:41.590879+0000","last_unstale":"2023-08-10T10:49:13.619031+0000","last_undegraded":"2023-08-10T10:49:13.619031+0000","last_fullsized":"2023-08-10T10:49:13.619031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:32:51.331831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730883+0000","last_change":"2023-08-10T10:48:42.581852+0000","last_active":"2023-08-10T10:49:12.730883+0000","last_peered":"2023-08-10T10:49:12.730883+0000","last_clean":"2023-08-10T10:49:12.730883+0000","last_became_active":"2023-08-10T10:48:42.581516+0000","last_became_peered":"2023-08-10T10:48:42.581516+0000","last_unstale":"2023-08-10T10:49:12.730883+0000","last_undegraded":"2023-08-10T10:49:12.730883+0000","last_fullsized":"2023-08-10T10:49:12.730883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:10.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713879+0000","last_change":"2023-08-10T10:48:46.629922+0000","last_active":"2023-08-10T10:49:12.713879+0000","last_peered":"2023-08-10T10:49:12.713879+0000","last_clean":"2023-08-10T10:49:12.713879+0000","last_became_active":"2023-08-10T10:48:46.629079+0000","last_became_peered":"2023-08-10T10:48:46.629079+0000","last_unstale":"2023-08-10T10:49:12.713879+0000","last_undegraded":"2023-08-10T10:49:12.713879+0000","last_fullsized":"2023-08-10T10:49:12.713879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:31:34.256668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.619783+0000","last_change":"2023-08-10T10:48:41.580410+0000","last_active":"2023-08-10T10:49:13.619783+0000","last_peered":"2023-08-10T10:49:13.619783+0000","last_clean":"2023-08-10T10:49:13.619783+0000","last_became_active":"2023-08-10T10:48:41.580032+0000","last_became_peered":"2023-08-10T10:48:41.580032+0000","last_unstale":"2023-08-10T10:49:13.619783+0000","last_undegraded":"2023-08-10T10:49:13.619783+0000","last_fullsized":"2023-08-10T10:49:13.619783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:46.503559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717834+0000","last_change":"2023-08-10T10:48:42.582297+0000","last_active":"2023-08-10T10:49:12.717834+0000","last_peered":"2023-08-10T10:49:12.717834+0000","last_clean":"2023-08-10T10:49:12.717834+0000","last_became_active":"2023-08-10T10:48:42.581966+0000","last_became_peered":"2023-08-10T10:48:42.581966+0000","last_unstale":"2023-08-10T10:49:12.717834+0000","last_undegraded":"2023-08-10T10:49:12.717834+0000","last_fullsized":"2023-08-10T10:49:12.717834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:48:05.595908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731000+0000","last_change":"2023-08-10T10:48:46.622376+0000","last_active":"2023-08-10T10:49:12.731000+0000","last_peered":"2023-08-10T10:49:12.731000+0000","last_clean":"2023-08-10T10:49:12.731000+0000","last_became_active":"2023-08-10T10:48:46.621872+0000","last_became_peered":"2023-08-10T10:48:46.621872+0000","last_unstale":"2023-08-10T10:49:12.731000+0000","last_undegraded":"2023-08-10T10:49:12.731000+0000","last_fullsized":"2023-08-10T10:49:12.731000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:06:48.430562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.736262+0000","last_change":"2023-08-10T10:48:41.585309+0000","last_active":"2023-08-10T10:49:12.736262+0000","last_peered":"2023-08-10T10:49:12.736262+0000","last_clean":"2023-08-10T10:49:12.736262+0000","last_became_active":"2023-08-10T10:48:41.585007+0000","last_became_peered":"2023-08-10T10:48:41.585007+0000","last_unstale":"2023-08-10T10:49:12.736262+0000","last_undegraded":"2023-08-10T10:49:12.736262+0000","last_fullsized":"2023-08-10T10:49:12.736262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:23.129389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708400+0000","last_change":"2023-08-10T10:48:42.575404+0000","last_active":"2023-08-10T10:49:12.708400+0000","last_peered":"2023-08-10T10:49:12.708400+0000","last_clean":"2023-08-10T10:49:12.708400+0000","last_became_active":"2023-08-10T10:48:42.575072+0000","last_became_peered":"2023-08-10T10:48:42.575072+0000","last_unstale":"2023-08-10T10:49:12.708400+0000","last_undegraded":"2023-08-10T10:49:12.708400+0000","last_fullsized":"2023-08-10T10:49:12.708400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:48:47.730243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718109+0000","last_change":"2023-08-10T10:48:46.627175+0000","last_active":"2023-08-10T10:49:12.718109+0000","last_peered":"2023-08-10T10:49:12.718109+0000","last_clean":"2023-08-10T10:49:12.718109+0000","last_became_active":"2023-08-10T10:48:46.626639+0000","last_became_peered":"2023-08-10T10:48:46.626639+0000","last_unstale":"2023-08-10T10:49:12.718109+0000","last_undegraded":"2023-08-10T10:49:12.718109+0000","last_fullsized":"2023-08-10T10:49:12.718109+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:34:37.354808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.735422+0000","last_change":"2023-08-10T10:48:41.585185+0000","last_active":"2023-08-10T10:49:12.735422+0000","last_peered":"2023-08-10T10:49:12.735422+0000","last_clean":"2023-08-10T10:49:12.735422+0000","last_became_active":"2023-08-10T10:48:41.584834+0000","last_became_peered":"2023-08-10T10:48:41.584834+0000","last_unstale":"2023-08-10T10:49:12.735422+0000","last_undegraded":"2023-08-10T10:49:12.735422+0000","last_fullsized":"2023-08-10T10:49:12.735422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:10.581491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708214+0000","last_change":"2023-08-10T10:48:42.574634+0000","last_active":"2023-08-10T10:49:12.708214+0000","last_peered":"2023-08-10T10:49:12.708214+0000","last_clean":"2023-08-10T10:49:12.708214+0000","last_became_active":"2023-08-10T10:48:42.574290+0000","last_became_peered":"2023-08-10T10:48:42.574290+0000","last_unstale":"2023-08-10T10:49:12.708214+0000","last_undegraded":"2023-08-10T10:49:12.708214+0000","last_fullsized":"2023-08-10T10:49:12.708214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:32.688234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708363+0000","last_change":"2023-08-10T10:48:46.627158+0000","last_active":"2023-08-10T10:49:12.708363+0000","last_peered":"2023-08-10T10:49:12.708363+0000","last_clean":"2023-08-10T10:49:12.708363+0000","last_became_active":"2023-08-10T10:48:46.626686+0000","last_became_peered":"2023-08-10T10:48:46.626686+0000","last_unstale":"2023-08-10T10:49:12.708363+0000","last_undegraded":"2023-08-10T10:49:12.708363+0000","last_fullsized":"2023-08-10T10:49:12.708363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:44:14.440163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733637+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:49:12.733637+0000","last_peered":"2023-08-10T10:49:12.733637+0000","last_clean":"2023-08-10T10:49:12.733637+0000","last_became_active":"2023-08-10T10:48:41.586573+0000","last_became_peered":"2023-08-10T10:48:41.586573+0000","last_unstale":"2023-08-10T10:49:12.733637+0000","last_undegraded":"2023-08-10T10:49:12.733637+0000","last_fullsized":"2023-08-10T10:49:12.733637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:12.186283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731695+0000","last_change":"2023-08-10T10:48:42.584454+0000","last_active":"2023-08-10T10:49:12.731695+0000","last_peered":"2023-08-10T10:49:12.731695+0000","last_clean":"2023-08-10T10:49:12.731695+0000","last_became_active":"2023-08-10T10:48:42.584098+0000","last_became_peered":"2023-08-10T10:48:42.584098+0000","last_unstale":"2023-08-10T10:49:12.731695+0000","last_undegraded":"2023-08-10T10:49:12.731695+0000","last_fullsized":"2023-08-10T10:49:12.731695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:06.825290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708091+0000","last_change":"2023-08-10T10:48:46.635451+0000","last_active":"2023-08-10T10:49:12.708091+0000","last_peered":"2023-08-10T10:49:12.708091+0000","last_clean":"2023-08-10T10:49:12.708091+0000","last_became_active":"2023-08-10T10:48:46.634768+0000","last_became_peered":"2023-08-10T10:48:46.634768+0000","last_unstale":"2023-08-10T10:49:12.708091+0000","last_undegraded":"2023-08-10T10:49:12.708091+0000","last_fullsized":"2023-08-10T10:49:12.708091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:18.826421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.609913+0000","last_change":"2023-08-10T10:48:41.586720+0000","last_active":"2023-08-10T10:49:13.609913+0000","last_peered":"2023-08-10T10:49:13.609913+0000","last_clean":"2023-08-10T10:49:13.609913+0000","last_became_active":"2023-08-10T10:48:41.586365+0000","last_became_peered":"2023-08-10T10:48:41.586365+0000","last_unstale":"2023-08-10T10:49:13.609913+0000","last_undegraded":"2023-08-10T10:49:13.609913+0000","last_fullsized":"2023-08-10T10:49:13.609913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:18.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715509+0000","last_change":"2023-08-10T10:49:12.715509+0000","last_active":"2023-08-10T10:49:12.715509+0000","last_peered":"2023-08-10T10:49:12.715509+0000","last_clean":"2023-08-10T10:49:12.715509+0000","last_became_active":"2023-08-10T10:49:12.714785+0000","last_became_peered":"2023-08-10T10:49:12.714785+0000","last_unstale":"2023-08-10T10:49:12.715509+0000","last_undegraded":"2023-08-10T10:49:12.715509+0000","last_fullsized":"2023-08-10T10:49:12.715509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:02:27.185255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708443+0000","last_change":"2023-08-10T10:48:46.630613+0000","last_active":"2023-08-10T10:49:12.708443+0000","last_peered":"2023-08-10T10:49:12.708443+0000","last_clean":"2023-08-10T10:49:12.708443+0000","last_became_active":"2023-08-10T10:48:46.630152+0000","last_became_peered":"2023-08-10T10:48:46.630152+0000","last_unstale":"2023-08-10T10:49:12.708443+0000","last_undegraded":"2023-08-10T10:49:12.708443+0000","last_fullsized":"2023-08-10T10:49:12.708443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:18.733177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.610012+0000","last_change":"2023-08-10T10:48:41.583291+0000","last_active":"2023-08-10T10:49:13.610012+0000","last_peered":"2023-08-10T10:49:13.610012+0000","last_clean":"2023-08-10T10:49:13.610012+0000","last_became_active":"2023-08-10T10:48:41.582894+0000","last_became_peered":"2023-08-10T10:48:41.582894+0000","last_unstale":"2023-08-10T10:49:13.610012+0000","last_undegraded":"2023-08-10T10:49:13.610012+0000","last_fullsized":"2023-08-10T10:49:13.610012+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:47.694100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713000+0000","last_change":"2023-08-10T10:48:42.582097+0000","last_active":"2023-08-10T10:49:12.713000+0000","last_peered":"2023-08-10T10:49:12.713000+0000","last_clean":"2023-08-10T10:49:12.713000+0000","last_became_active":"2023-08-10T10:48:42.581622+0000","last_became_peered":"2023-08-10T10:48:42.581622+0000","last_unstale":"2023-08-10T10:49:12.713000+0000","last_undegraded":"2023-08-10T10:49:12.713000+0000","last_fullsized":"2023-08-10T10:49:12.713000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:01.359438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731717+0000","last_change":"2023-08-10T10:48:46.628850+0000","last_active":"2023-08-10T10:49:12.731717+0000","last_peered":"2023-08-10T10:49:12.731717+0000","last_clean":"2023-08-10T10:49:12.731717+0000","last_became_active":"2023-08-10T10:48:46.628060+0000","last_became_peered":"2023-08-10T10:48:46.628060+0000","last_unstale":"2023-08-10T10:49:12.731717+0000","last_undegraded":"2023-08-10T10:49:12.731717+0000","last_fullsized":"2023-08-10T10:49:12.731717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:22.729040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.637700+0000","last_change":"2023-08-10T10:49:12.726708+0000","last_active":"2023-08-10T10:49:15.637700+0000","last_peered":"2023-08-10T10:49:15.637700+0000","last_clean":"2023-08-10T10:49:15.637700+0000","last_became_active":"2023-08-10T10:49:12.718963+0000","last_became_peered":"2023-08-10T10:49:12.718963+0000","last_unstale":"2023-08-10T10:49:15.637700+0000","last_undegraded":"2023-08-10T10:49:15.637700+0000","last_fullsized":"2023-08-10T10:49:15.637700+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:42.202471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712953+0000","last_change":"2023-08-10T10:48:42.583174+0000","last_active":"2023-08-10T10:49:12.712953+0000","last_peered":"2023-08-10T10:49:12.712953+0000","last_clean":"2023-08-10T10:49:12.712953+0000","last_became_active":"2023-08-10T10:48:42.582869+0000","last_became_peered":"2023-08-10T10:48:42.582869+0000","last_unstale":"2023-08-10T10:49:12.712953+0000","last_undegraded":"2023-08-10T10:49:12.712953+0000","last_fullsized":"2023-08-10T10:49:12.712953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:25:22.404203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713733+0000","last_change":"2023-08-10T10:48:46.629285+0000","last_active":"2023-08-10T10:49:12.713733+0000","last_peered":"2023-08-10T10:49:12.713733+0000","last_clean":"2023-08-10T10:49:12.713733+0000","last_became_active":"2023-08-10T10:48:46.628849+0000","last_became_peered":"2023-08-10T10:48:46.628849+0000","last_unstale":"2023-08-10T10:49:12.713733+0000","last_undegraded":"2023-08-10T10:49:12.713733+0000","last_fullsized":"2023-08-10T10:49:12.713733+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:19.082444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.737661+0000","last_change":"2023-08-10T10:48:41.592802+0000","last_active":"2023-08-10T10:49:12.737661+0000","last_peered":"2023-08-10T10:49:12.737661+0000","last_clean":"2023-08-10T10:49:12.737661+0000","last_became_active":"2023-08-10T10:48:41.592443+0000","last_became_peered":"2023-08-10T10:48:41.592443+0000","last_unstale":"2023-08-10T10:49:12.737661+0000","last_undegraded":"2023-08-10T10:49:12.737661+0000","last_fullsized":"2023-08-10T10:49:12.737661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:29:59.847912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718046+0000","last_change":"2023-08-10T10:48:42.586447+0000","last_active":"2023-08-10T10:49:12.718046+0000","last_peered":"2023-08-10T10:49:12.718046+0000","last_clean":"2023-08-10T10:49:12.718046+0000","last_became_active":"2023-08-10T10:48:42.586138+0000","last_became_peered":"2023-08-10T10:48:42.586138+0000","last_unstale":"2023-08-10T10:49:12.718046+0000","last_undegraded":"2023-08-10T10:49:12.718046+0000","last_fullsized":"2023-08-10T10:49:12.718046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:46.349690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733732+0000","last_change":"2023-08-10T10:49:12.732915+0000","last_active":"2023-08-10T10:49:12.733732+0000","last_peered":"2023-08-10T10:49:12.733732+0000","last_clean":"2023-08-10T10:49:12.733732+0000","last_became_active":"2023-08-10T10:49:12.732428+0000","last_became_peered":"2023-08-10T10:49:12.732428+0000","last_unstale":"2023-08-10T10:49:12.733732+0000","last_undegraded":"2023-08-10T10:49:12.733732+0000","last_fullsized":"2023-08-10T10:49:12.733732+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:48.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707375+0000","last_change":"2023-08-10T10:48:41.588502+0000","last_active":"2023-08-10T10:49:12.707375+0000","last_peered":"2023-08-10T10:49:12.707375+0000","last_clean":"2023-08-10T10:49:12.707375+0000","last_became_active":"2023-08-10T10:48:41.588155+0000","last_became_peered":"2023-08-10T10:48:41.588155+0000","last_unstale":"2023-08-10T10:49:12.707375+0000","last_undegraded":"2023-08-10T10:49:12.707375+0000","last_fullsized":"2023-08-10T10:49:12.707375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:03.041234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717532+0000","last_change":"2023-08-10T10:48:42.578175+0000","last_active":"2023-08-10T10:49:12.717532+0000","last_peered":"2023-08-10T10:49:12.717532+0000","last_clean":"2023-08-10T10:49:12.717532+0000","last_became_active":"2023-08-10T10:48:42.577873+0000","last_became_peered":"2023-08-10T10:48:42.577873+0000","last_unstale":"2023-08-10T10:49:12.717532+0000","last_undegraded":"2023-08-10T10:49:12.717532+0000","last_fullsized":"2023-08-10T10:49:12.717532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:00:20.738100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719745+0000","last_change":"2023-08-10T10:49:12.719745+0000","last_active":"2023-08-10T10:49:12.719745+0000","last_peered":"2023-08-10T10:49:12.719745+0000","last_clean":"2023-08-10T10:49:12.719745+0000","last_became_active":"2023-08-10T10:49:12.719289+0000","last_became_peered":"2023-08-10T10:49:12.719289+0000","last_unstale":"2023-08-10T10:49:12.719745+0000","last_undegraded":"2023-08-10T10:49:12.719745+0000","last_fullsized":"2023-08-10T10:49:12.719745+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:06.026574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627774+0000","last_change":"2023-08-10T10:48:41.594170+0000","last_active":"2023-08-10T10:49:14.627774+0000","last_peered":"2023-08-10T10:49:14.627774+0000","last_clean":"2023-08-10T10:49:14.627774+0000","last_became_active":"2023-08-10T10:48:41.593776+0000","last_became_peered":"2023-08-10T10:48:41.593776+0000","last_unstale":"2023-08-10T10:49:14.627774+0000","last_undegraded":"2023-08-10T10:49:14.627774+0000","last_fullsized":"2023-08-10T10:49:14.627774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:58:00.968178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730226+0000","last_change":"2023-08-10T10:48:42.589149+0000","last_active":"2023-08-10T10:49:12.730226+0000","last_peered":"2023-08-10T10:49:12.730226+0000","last_clean":"2023-08-10T10:49:12.730226+0000","last_became_active":"2023-08-10T10:48:42.588466+0000","last_became_peered":"2023-08-10T10:48:42.588466+0000","last_unstale":"2023-08-10T10:49:12.730226+0000","last_undegraded":"2023-08-10T10:49:12.730226+0000","last_fullsized":"2023-08-10T10:49:12.730226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:16:06.271764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730078+0000","last_change":"2023-08-10T10:48:46.629070+0000","last_active":"2023-08-10T10:49:12.730078+0000","last_peered":"2023-08-10T10:49:12.730078+0000","last_clean":"2023-08-10T10:49:12.730078+0000","last_became_active":"2023-08-10T10:48:46.626045+0000","last_became_peered":"2023-08-10T10:48:46.626045+0000","last_unstale":"2023-08-10T10:49:12.730078+0000","last_undegraded":"2023-08-10T10:49:12.730078+0000","last_fullsized":"2023-08-10T10:49:12.730078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:07:15.985024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712622+0000","last_change":"2023-08-10T10:48:41.590670+0000","last_active":"2023-08-10T10:49:12.712622+0000","last_peered":"2023-08-10T10:49:12.712622+0000","last_clean":"2023-08-10T10:49:12.712622+0000","last_became_active":"2023-08-10T10:48:41.589958+0000","last_became_peered":"2023-08-10T10:48:41.589958+0000","last_unstale":"2023-08-10T10:49:12.712622+0000","last_undegraded":"2023-08-10T10:49:12.712622+0000","last_fullsized":"2023-08-10T10:49:12.712622+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:39:18.603399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714523+0000","last_change":"2023-08-10T10:48:42.581041+0000","last_active":"2023-08-10T10:49:12.714523+0000","last_peered":"2023-08-10T10:49:12.714523+0000","last_clean":"2023-08-10T10:49:12.714523+0000","last_became_active":"2023-08-10T10:48:42.580311+0000","last_became_peered":"2023-08-10T10:48:42.580311+0000","last_unstale":"2023-08-10T10:49:12.714523+0000","last_undegraded":"2023-08-10T10:49:12.714523+0000","last_fullsized":"2023-08-10T10:49:12.714523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:58:22.239730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712329+0000","last_change":"2023-08-10T10:48:46.907496+0000","last_active":"2023-08-10T10:49:12.712329+0000","last_peered":"2023-08-10T10:49:12.712329+0000","last_clean":"2023-08-10T10:49:12.712329+0000","last_became_active":"2023-08-10T10:48:46.907098+0000","last_became_peered":"2023-08-10T10:48:46.907098+0000","last_unstale":"2023-08-10T10:49:12.712329+0000","last_undegraded":"2023-08-10T10:49:12.712329+0000","last_fullsized":"2023-08-10T10:49:12.712329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:32.578901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708694+0000","last_change":"2023-08-10T10:48:41.585252+0000","last_active":"2023-08-10T10:49:12.708694+0000","last_peered":"2023-08-10T10:49:12.708694+0000","last_clean":"2023-08-10T10:49:12.708694+0000","last_became_active":"2023-08-10T10:48:41.583599+0000","last_became_peered":"2023-08-10T10:48:41.583599+0000","last_unstale":"2023-08-10T10:49:12.708694+0000","last_undegraded":"2023-08-10T10:49:12.708694+0000","last_fullsized":"2023-08-10T10:49:12.708694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:05.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711390+0000","last_change":"2023-08-10T10:48:42.581317+0000","last_active":"2023-08-10T10:49:12.711390+0000","last_peered":"2023-08-10T10:49:12.711390+0000","last_clean":"2023-08-10T10:49:12.711390+0000","last_became_active":"2023-08-10T10:48:42.581012+0000","last_became_peered":"2023-08-10T10:48:42.581012+0000","last_unstale":"2023-08-10T10:49:12.711390+0000","last_undegraded":"2023-08-10T10:49:12.711390+0000","last_fullsized":"2023-08-10T10:49:12.711390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:06.685943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713749+0000","last_change":"2023-08-10T10:48:46.623489+0000","last_active":"2023-08-10T10:49:12.713749+0000","last_peered":"2023-08-10T10:49:12.713749+0000","last_clean":"2023-08-10T10:49:12.713749+0000","last_became_active":"2023-08-10T10:48:46.621968+0000","last_became_peered":"2023-08-10T10:48:46.621968+0000","last_unstale":"2023-08-10T10:49:12.713749+0000","last_undegraded":"2023-08-10T10:49:12.713749+0000","last_fullsized":"2023-08-10T10:49:12.713749+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:46:18.848816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718458+0000","last_change":"2023-08-10T10:48:41.579828+0000","last_active":"2023-08-10T10:49:12.718458+0000","last_peered":"2023-08-10T10:49:12.718458+0000","last_clean":"2023-08-10T10:49:12.718458+0000","last_became_active":"2023-08-10T10:48:41.579340+0000","last_became_peered":"2023-08-10T10:48:41.579340+0000","last_unstale":"2023-08-10T10:49:12.718458+0000","last_undegraded":"2023-08-10T10:49:12.718458+0000","last_fullsized":"2023-08-10T10:49:12.718458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:37.616654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733771+0000","last_change":"2023-08-10T10:49:12.733771+0000","last_active":"2023-08-10T10:49:12.733771+0000","last_peered":"2023-08-10T10:49:12.733771+0000","last_clean":"2023-08-10T10:49:12.733771+0000","last_became_active":"2023-08-10T10:49:12.733357+0000","last_became_peered":"2023-08-10T10:49:12.733357+0000","last_unstale":"2023-08-10T10:49:12.733771+0000","last_undegraded":"2023-08-10T10:49:12.733771+0000","last_fullsized":"2023-08-10T10:49:12.733771+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:42.675113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713322+0000","last_change":"2023-08-10T10:48:46.907982+0000","last_active":"2023-08-10T10:49:12.713322+0000","last_peered":"2023-08-10T10:49:12.713322+0000","last_clean":"2023-08-10T10:49:12.713322+0000","last_became_active":"2023-08-10T10:48:46.907184+0000","last_became_peered":"2023-08-10T10:48:46.907184+0000","last_unstale":"2023-08-10T10:49:12.713322+0000","last_undegraded":"2023-08-10T10:49:12.713322+0000","last_fullsized":"2023-08-10T10:49:12.713322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:10.496532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731622+0000","last_change":"2023-08-10T10:48:42.582808+0000","last_active":"2023-08-10T10:49:12.731622+0000","last_peered":"2023-08-10T10:49:12.731622+0000","last_clean":"2023-08-10T10:49:12.731622+0000","last_became_active":"2023-08-10T10:48:42.582517+0000","last_became_peered":"2023-08-10T10:48:42.582517+0000","last_unstale":"2023-08-10T10:49:12.731622+0000","last_undegraded":"2023-08-10T10:49:12.731622+0000","last_fullsized":"2023-08-10T10:49:12.731622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:03:17.102214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:16.652169+0000","last_change":"2023-08-10T10:48:41.594873+0000","last_active":"2023-08-10T10:49:16.652169+0000","last_peered":"2023-08-10T10:49:16.652169+0000","last_clean":"2023-08-10T10:49:16.652169+0000","last_became_active":"2023-08-10T10:48:41.594550+0000","last_became_peered":"2023-08-10T10:48:41.594550+0000","last_unstale":"2023-08-10T10:49:16.652169+0000","last_undegraded":"2023-08-10T10:49:16.652169+0000","last_fullsized":"2023-08-10T10:49:16.652169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:12.288533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718058+0000","last_change":"2023-08-10T10:48:46.626960+0000","last_active":"2023-08-10T10:49:12.718058+0000","last_peered":"2023-08-10T10:49:12.718058+0000","last_clean":"2023-08-10T10:49:12.718058+0000","last_became_active":"2023-08-10T10:48:46.626519+0000","last_became_peered":"2023-08-10T10:48:46.626519+0000","last_unstale":"2023-08-10T10:49:12.718058+0000","last_undegraded":"2023-08-10T10:49:12.718058+0000","last_fullsized":"2023-08-10T10:49:12.718058+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:12.352223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717207+0000","last_change":"2023-08-10T10:48:42.578921+0000","last_active":"2023-08-10T10:49:12.717207+0000","last_peered":"2023-08-10T10:49:12.717207+0000","last_clean":"2023-08-10T10:49:12.717207+0000","last_became_active":"2023-08-10T10:48:42.578322+0000","last_became_peered":"2023-08-10T10:48:42.578322+0000","last_unstale":"2023-08-10T10:49:12.717207+0000","last_undegraded":"2023-08-10T10:49:12.717207+0000","last_fullsized":"2023-08-10T10:49:12.717207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:39.453887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730667+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:49:12.730667+0000","last_peered":"2023-08-10T10:49:12.730667+0000","last_clean":"2023-08-10T10:49:12.730667+0000","last_became_active":"2023-08-10T10:48:41.585217+0000","last_became_peered":"2023-08-10T10:48:41.585217+0000","last_unstale":"2023-08-10T10:49:12.730667+0000","last_undegraded":"2023-08-10T10:49:12.730667+0000","last_fullsized":"2023-08-10T10:49:12.730667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:01:10.279255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":357,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717157+0000","last_change":"2023-08-10T10:47:22.594211+0000","last_active":"2023-08-10T10:49:12.717157+0000","last_peered":"2023-08-10T10:49:12.717157+0000","last_clean":"2023-08-10T10:49:12.717157+0000","last_became_active":"2023-08-10T10:47:22.593742+0000","last_became_peered":"2023-08-10T10:47:22.593742+0000","last_unstale":"2023-08-10T10:49:12.717157+0000","last_undegraded":"2023-08-10T10:49:12.717157+0000","last_fullsized":"2023-08-10T10:49:12.717157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_clean_scrub_stamp":"2023-08-10T10:43:44.512037+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:23.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730745+0000","last_change":"2023-08-10T10:48:46.907769+0000","last_active":"2023-08-10T10:49:12.730745+0000","last_peered":"2023-08-10T10:49:12.730745+0000","last_clean":"2023-08-10T10:49:12.730745+0000","last_became_active":"2023-08-10T10:48:46.907241+0000","last_became_peered":"2023-08-10T10:48:46.907241+0000","last_unstale":"2023-08-10T10:49:12.730745+0000","last_undegraded":"2023-08-10T10:49:12.730745+0000","last_fullsized":"2023-08-10T10:49:12.730745+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:37:49.077753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712543+0000","last_change":"2023-08-10T10:48:42.587277+0000","last_active":"2023-08-10T10:49:12.712543+0000","last_peered":"2023-08-10T10:49:12.712543+0000","last_clean":"2023-08-10T10:49:12.712543+0000","last_became_active":"2023-08-10T10:48:42.586308+0000","last_became_peered":"2023-08-10T10:48:42.586308+0000","last_unstale":"2023-08-10T10:49:12.712543+0000","last_undegraded":"2023-08-10T10:49:12.712543+0000","last_fullsized":"2023-08-10T10:49:12.712543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:23.894942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'3","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.620570+0000","last_change":"2023-08-10T10:48:41.587116+0000","last_active":"2023-08-10T10:49:13.620570+0000","last_peered":"2023-08-10T10:49:13.620570+0000","last_clean":"2023-08-10T10:49:13.620570+0000","last_became_active":"2023-08-10T10:48:41.586771+0000","last_became_peered":"2023-08-10T10:48:41.586771+0000","last_unstale":"2023-08-10T10:49:13.620570+0000","last_undegraded":"2023-08-10T10:49:13.620570+0000","last_fullsized":"2023-08-10T10:49:13.620570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:30.371131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714841+0000","last_change":"2023-08-10T10:48:46.625140+0000","last_active":"2023-08-10T10:49:12.714841+0000","last_peered":"2023-08-10T10:49:12.714841+0000","last_clean":"2023-08-10T10:49:12.714841+0000","last_became_active":"2023-08-10T10:48:46.624615+0000","last_became_peered":"2023-08-10T10:48:46.624615+0000","last_unstale":"2023-08-10T10:49:12.714841+0000","last_undegraded":"2023-08-10T10:49:12.714841+0000","last_fullsized":"2023-08-10T10:49:12.714841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:42.063440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627974+0000","last_change":"2023-08-10T10:48:41.589435+0000","last_active":"2023-08-10T10:49:14.627974+0000","last_peered":"2023-08-10T10:49:14.627974+0000","last_clean":"2023-08-10T10:49:14.627974+0000","last_became_active":"2023-08-10T10:48:41.589070+0000","last_became_peered":"2023-08-10T10:48:41.589070+0000","last_unstale":"2023-08-10T10:49:14.627974+0000","last_undegraded":"2023-08-10T10:49:14.627974+0000","last_fullsized":"2023-08-10T10:49:14.627974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:22:03.215196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713488+0000","last_change":"2023-08-10T10:48:42.586352+0000","last_active":"2023-08-10T10:49:12.713488+0000","last_peered":"2023-08-10T10:49:12.713488+0000","last_clean":"2023-08-10T10:49:12.713488+0000","last_became_active":"2023-08-10T10:48:42.585955+0000","last_became_peered":"2023-08-10T10:48:42.585955+0000","last_unstale":"2023-08-10T10:49:12.713488+0000","last_undegraded":"2023-08-10T10:49:12.713488+0000","last_fullsized":"2023-08-10T10:49:12.713488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:45.529054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717201+0000","last_change":"2023-08-10T10:48:46.907519+0000","last_active":"2023-08-10T10:49:12.717201+0000","last_peered":"2023-08-10T10:49:12.717201+0000","last_clean":"2023-08-10T10:49:12.717201+0000","last_became_active":"2023-08-10T10:48:46.907087+0000","last_became_peered":"2023-08-10T10:48:46.907087+0000","last_unstale":"2023-08-10T10:49:12.717201+0000","last_undegraded":"2023-08-10T10:49:12.717201+0000","last_fullsized":"2023-08-10T10:49:12.717201+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:03.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709427+0000","last_change":"2023-08-10T10:48:41.583746+0000","last_active":"2023-08-10T10:49:12.709427+0000","last_peered":"2023-08-10T10:49:12.709427+0000","last_clean":"2023-08-10T10:49:12.709427+0000","last_became_active":"2023-08-10T10:48:41.583321+0000","last_became_peered":"2023-08-10T10:48:41.583321+0000","last_unstale":"2023-08-10T10:49:12.709427+0000","last_undegraded":"2023-08-10T10:49:12.709427+0000","last_fullsized":"2023-08-10T10:49:12.709427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:53:25.620711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717495+0000","last_change":"2023-08-10T10:48:42.579942+0000","last_active":"2023-08-10T10:49:12.717495+0000","last_peered":"2023-08-10T10:49:12.717495+0000","last_clean":"2023-08-10T10:49:12.717495+0000","last_became_active":"2023-08-10T10:48:42.579561+0000","last_became_peered":"2023-08-10T10:48:42.579561+0000","last_unstale":"2023-08-10T10:49:12.717495+0000","last_undegraded":"2023-08-10T10:49:12.717495+0000","last_fullsized":"2023-08-10T10:49:12.717495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:22.447394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718242+0000","last_change":"2023-08-10T10:48:46.621499+0000","last_active":"2023-08-10T10:49:12.718242+0000","last_peered":"2023-08-10T10:49:12.718242+0000","last_clean":"2023-08-10T10:49:12.718242+0000","last_became_active":"2023-08-10T10:48:46.621076+0000","last_became_peered":"2023-08-10T10:48:46.621076+0000","last_unstale":"2023-08-10T10:49:12.718242+0000","last_undegraded":"2023-08-10T10:49:12.718242+0000","last_fullsized":"2023-08-10T10:49:12.718242+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:34.844650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'4","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731194+0000","last_change":"2023-08-10T10:48:41.585574+0000","last_active":"2023-08-10T10:49:12.731194+0000","last_peered":"2023-08-10T10:49:12.731194+0000","last_clean":"2023-08-10T10:49:12.731194+0000","last_became_active":"2023-08-10T10:48:41.585254+0000","last_became_peered":"2023-08-10T10:48:41.585254+0000","last_unstale":"2023-08-10T10:49:12.731194+0000","last_undegraded":"2023-08-10T10:49:12.731194+0000","last_fullsized":"2023-08-10T10:49:12.731194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:25:52.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731219+0000","last_change":"2023-08-10T10:48:42.584003+0000","last_active":"2023-08-10T10:49:12.731219+0000","last_peered":"2023-08-10T10:49:12.731219+0000","last_clean":"2023-08-10T10:49:12.731219+0000","last_became_active":"2023-08-10T10:48:42.583712+0000","last_became_peered":"2023-08-10T10:48:42.583712+0000","last_unstale":"2023-08-10T10:49:12.731219+0000","last_undegraded":"2023-08-10T10:49:12.731219+0000","last_fullsized":"2023-08-10T10:49:12.731219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:52.543954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707184+0000","last_change":"2023-08-10T10:48:46.908113+0000","last_active":"2023-08-10T10:49:12.707184+0000","last_peered":"2023-08-10T10:49:12.707184+0000","last_clean":"2023-08-10T10:49:12.707184+0000","last_became_active":"2023-08-10T10:48:46.907552+0000","last_became_peered":"2023-08-10T10:48:46.907552+0000","last_unstale":"2023-08-10T10:49:12.707184+0000","last_undegraded":"2023-08-10T10:49:12.707184+0000","last_fullsized":"2023-08-10T10:49:12.707184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:48:47.326917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.732470+0000","last_change":"2023-08-10T10:48:41.584254+0000","last_active":"2023-08-10T10:49:12.732470+0000","last_peered":"2023-08-10T10:49:12.732470+0000","last_clean":"2023-08-10T10:49:12.732470+0000","last_became_active":"2023-08-10T10:48:41.583129+0000","last_became_peered":"2023-08-10T10:48:41.583129+0000","last_unstale":"2023-08-10T10:49:12.732470+0000","last_undegraded":"2023-08-10T10:49:12.732470+0000","last_fullsized":"2023-08-10T10:49:12.732470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:23.183495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712107+0000","last_change":"2023-08-10T10:48:42.582264+0000","last_active":"2023-08-10T10:49:12.712107+0000","last_peered":"2023-08-10T10:49:12.712107+0000","last_clean":"2023-08-10T10:49:12.712107+0000","last_became_active":"2023-08-10T10:48:42.581542+0000","last_became_peered":"2023-08-10T10:48:42.581542+0000","last_unstale":"2023-08-10T10:49:12.712107+0000","last_undegraded":"2023-08-10T10:49:12.712107+0000","last_fullsized":"2023-08-10T10:49:12.712107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:30:57.631202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709384+0000","last_change":"2023-08-10T10:48:46.632019+0000","last_active":"2023-08-10T10:49:12.709384+0000","last_peered":"2023-08-10T10:49:12.709384+0000","last_clean":"2023-08-10T10:49:12.709384+0000","last_became_active":"2023-08-10T10:48:46.631510+0000","last_became_peered":"2023-08-10T10:48:46.631510+0000","last_unstale":"2023-08-10T10:49:12.709384+0000","last_undegraded":"2023-08-10T10:49:12.709384+0000","last_fullsized":"2023-08-10T10:49:12.709384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:55.720402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635631+0000","last_change":"2023-08-10T10:48:41.591206+0000","last_active":"2023-08-10T10:49:15.635631+0000","last_peered":"2023-08-10T10:49:15.635631+0000","last_clean":"2023-08-10T10:49:15.635631+0000","last_became_active":"2023-08-10T10:48:41.590897+0000","last_became_peered":"2023-08-10T10:48:41.590897+0000","last_unstale":"2023-08-10T10:49:15.635631+0000","last_undegraded":"2023-08-10T10:49:15.635631+0000","last_fullsized":"2023-08-10T10:49:15.635631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:30.418971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713681+0000","last_change":"2023-08-10T10:48:42.586470+0000","last_active":"2023-08-10T10:49:12.713681+0000","last_peered":"2023-08-10T10:49:12.713681+0000","last_clean":"2023-08-10T10:49:12.713681+0000","last_became_active":"2023-08-10T10:48:42.586109+0000","last_became_peered":"2023-08-10T10:48:42.586109+0000","last_unstale":"2023-08-10T10:49:12.713681+0000","last_undegraded":"2023-08-10T10:49:12.713681+0000","last_fullsized":"2023-08-10T10:49:12.713681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:12.453665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707246+0000","last_change":"2023-08-10T10:48:46.629886+0000","last_active":"2023-08-10T10:49:12.707246+0000","last_peered":"2023-08-10T10:49:12.707246+0000","last_clean":"2023-08-10T10:49:12.707246+0000","last_became_active":"2023-08-10T10:48:46.629403+0000","last_became_peered":"2023-08-10T10:48:46.629403+0000","last_unstale":"2023-08-10T10:49:12.707246+0000","last_undegraded":"2023-08-10T10:49:12.707246+0000","last_fullsized":"2023-08-10T10:49:12.707246+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:11.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718868+0000","last_change":"2023-08-10T10:48:41.593231+0000","last_active":"2023-08-10T10:49:12.718868+0000","last_peered":"2023-08-10T10:49:12.718868+0000","last_clean":"2023-08-10T10:49:12.718868+0000","last_became_active":"2023-08-10T10:48:41.592893+0000","last_became_peered":"2023-08-10T10:48:41.592893+0000","last_unstale":"2023-08-10T10:49:12.718868+0000","last_undegraded":"2023-08-10T10:49:12.718868+0000","last_fullsized":"2023-08-10T10:49:12.718868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:41.661067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.734525+0000","last_change":"2023-08-10T10:49:12.732774+0000","last_active":"2023-08-10T10:49:12.734525+0000","last_peered":"2023-08-10T10:49:12.734525+0000","last_clean":"2023-08-10T10:49:12.734525+0000","last_became_active":"2023-08-10T10:49:12.732277+0000","last_became_peered":"2023-08-10T10:49:12.732277+0000","last_unstale":"2023-08-10T10:49:12.734525+0000","last_undegraded":"2023-08-10T10:49:12.734525+0000","last_fullsized":"2023-08-10T10:49:12.734525+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:06.334205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707420+0000","last_change":"2023-08-10T10:48:46.908347+0000","last_active":"2023-08-10T10:49:12.707420+0000","last_peered":"2023-08-10T10:49:12.707420+0000","last_clean":"2023-08-10T10:49:12.707420+0000","last_became_active":"2023-08-10T10:48:46.907266+0000","last_became_peered":"2023-08-10T10:48:46.907266+0000","last_unstale":"2023-08-10T10:49:12.707420+0000","last_undegraded":"2023-08-10T10:49:12.707420+0000","last_fullsized":"2023-08-10T10:49:12.707420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:52.767489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.734388+0000","last_change":"2023-08-10T10:48:41.585055+0000","last_active":"2023-08-10T10:49:12.734388+0000","last_peered":"2023-08-10T10:49:12.734388+0000","last_clean":"2023-08-10T10:49:12.734388+0000","last_became_active":"2023-08-10T10:48:41.584676+0000","last_became_peered":"2023-08-10T10:48:41.584676+0000","last_unstale":"2023-08-10T10:49:12.734388+0000","last_undegraded":"2023-08-10T10:49:12.734388+0000","last_fullsized":"2023-08-10T10:49:12.734388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:14:29.461100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718623+0000","last_change":"2023-08-10T10:48:42.586764+0000","last_active":"2023-08-10T10:49:12.718623+0000","last_peered":"2023-08-10T10:49:12.718623+0000","last_clean":"2023-08-10T10:49:12.718623+0000","last_became_active":"2023-08-10T10:48:42.586177+0000","last_became_peered":"2023-08-10T10:48:42.586177+0000","last_unstale":"2023-08-10T10:49:12.718623+0000","last_undegraded":"2023-08-10T10:49:12.718623+0000","last_fullsized":"2023-08-10T10:49:12.718623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:34.472956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707294+0000","last_change":"2023-08-10T10:48:46.626872+0000","last_active":"2023-08-10T10:49:12.707294+0000","last_peered":"2023-08-10T10:49:12.707294+0000","last_clean":"2023-08-10T10:49:12.707294+0000","last_became_active":"2023-08-10T10:48:46.626354+0000","last_became_peered":"2023-08-10T10:48:46.626354+0000","last_unstale":"2023-08-10T10:49:12.707294+0000","last_undegraded":"2023-08-10T10:49:12.707294+0000","last_fullsized":"2023-08-10T10:49:12.707294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:10:12.332212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719235+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:49:12.719235+0000","last_peered":"2023-08-10T10:49:12.719235+0000","last_clean":"2023-08-10T10:49:12.719235+0000","last_became_active":"2023-08-10T10:48:41.586311+0000","last_became_peered":"2023-08-10T10:48:41.586311+0000","last_unstale":"2023-08-10T10:49:12.719235+0000","last_undegraded":"2023-08-10T10:49:12.719235+0000","last_fullsized":"2023-08-10T10:49:12.719235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:57.983205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718513+0000","last_change":"2023-08-10T10:48:42.577290+0000","last_active":"2023-08-10T10:49:12.718513+0000","last_peered":"2023-08-10T10:49:12.718513+0000","last_clean":"2023-08-10T10:49:12.718513+0000","last_became_active":"2023-08-10T10:48:42.576928+0000","last_became_peered":"2023-08-10T10:48:42.576928+0000","last_unstale":"2023-08-10T10:49:12.718513+0000","last_undegraded":"2023-08-10T10:49:12.718513+0000","last_fullsized":"2023-08-10T10:49:12.718513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:20.491056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730204+0000","last_change":"2023-08-10T10:48:46.627842+0000","last_active":"2023-08-10T10:49:12.730204+0000","last_peered":"2023-08-10T10:49:12.730204+0000","last_clean":"2023-08-10T10:49:12.730204+0000","last_became_active":"2023-08-10T10:48:46.627472+0000","last_became_peered":"2023-08-10T10:48:46.627472+0000","last_unstale":"2023-08-10T10:49:12.730204+0000","last_undegraded":"2023-08-10T10:49:12.730204+0000","last_fullsized":"2023-08-10T10:49:12.730204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:23.103275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.606352+0000","last_change":"2023-08-10T10:48:41.592742+0000","last_active":"2023-08-10T10:49:13.606352+0000","last_peered":"2023-08-10T10:49:13.606352+0000","last_clean":"2023-08-10T10:49:13.606352+0000","last_became_active":"2023-08-10T10:48:41.592409+0000","last_became_peered":"2023-08-10T10:48:41.592409+0000","last_unstale":"2023-08-10T10:49:13.606352+0000","last_undegraded":"2023-08-10T10:49:13.606352+0000","last_fullsized":"2023-08-10T10:49:13.606352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:38:45.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717859+0000","last_change":"2023-08-10T10:48:42.583444+0000","last_active":"2023-08-10T10:49:12.717859+0000","last_peered":"2023-08-10T10:49:12.717859+0000","last_clean":"2023-08-10T10:49:12.717859+0000","last_became_active":"2023-08-10T10:48:42.583073+0000","last_became_peered":"2023-08-10T10:48:42.583073+0000","last_unstale":"2023-08-10T10:49:12.717859+0000","last_undegraded":"2023-08-10T10:49:12.717859+0000","last_fullsized":"2023-08-10T10:49:12.717859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:40.712897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730483+0000","last_change":"2023-08-10T10:48:46.626340+0000","last_active":"2023-08-10T10:49:12.730483+0000","last_peered":"2023-08-10T10:49:12.730483+0000","last_clean":"2023-08-10T10:49:12.730483+0000","last_became_active":"2023-08-10T10:48:46.625867+0000","last_became_peered":"2023-08-10T10:48:46.625867+0000","last_unstale":"2023-08-10T10:49:12.730483+0000","last_undegraded":"2023-08-10T10:49:12.730483+0000","last_fullsized":"2023-08-10T10:49:12.730483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:50:35.707438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635911+0000","last_change":"2023-08-10T10:48:41.590734+0000","last_active":"2023-08-10T10:49:15.635911+0000","last_peered":"2023-08-10T10:49:15.635911+0000","last_clean":"2023-08-10T10:49:15.635911+0000","last_became_active":"2023-08-10T10:48:41.590433+0000","last_became_peered":"2023-08-10T10:48:41.590433+0000","last_unstale":"2023-08-10T10:49:15.635911+0000","last_undegraded":"2023-08-10T10:49:15.635911+0000","last_fullsized":"2023-08-10T10:49:15.635911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:07.269605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718071+0000","last_change":"2023-08-10T10:48:42.576628+0000","last_active":"2023-08-10T10:49:12.718071+0000","last_peered":"2023-08-10T10:49:12.718071+0000","last_clean":"2023-08-10T10:49:12.718071+0000","last_became_active":"2023-08-10T10:48:42.576285+0000","last_became_peered":"2023-08-10T10:48:42.576285+0000","last_unstale":"2023-08-10T10:49:12.718071+0000","last_undegraded":"2023-08-10T10:49:12.718071+0000","last_fullsized":"2023-08-10T10:49:12.718071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:36.534268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713896+0000","last_change":"2023-08-10T10:48:42.579615+0000","last_active":"2023-08-10T10:49:12.713896+0000","last_peered":"2023-08-10T10:49:12.713896+0000","last_clean":"2023-08-10T10:49:12.713896+0000","last_became_active":"2023-08-10T10:48:42.579291+0000","last_became_peered":"2023-08-10T10:48:42.579291+0000","last_unstale":"2023-08-10T10:49:12.713896+0000","last_undegraded":"2023-08-10T10:49:12.713896+0000","last_fullsized":"2023-08-10T10:49:12.713896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:20.879001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718573+0000","last_change":"2023-08-10T10:48:42.581358+0000","last_active":"2023-08-10T10:49:12.718573+0000","last_peered":"2023-08-10T10:49:12.718573+0000","last_clean":"2023-08-10T10:49:12.718573+0000","last_became_active":"2023-08-10T10:48:42.580942+0000","last_became_peered":"2023-08-10T10:48:42.580942+0000","last_unstale":"2023-08-10T10:49:12.718573+0000","last_undegraded":"2023-08-10T10:49:12.718573+0000","last_fullsized":"2023-08-10T10:49:12.718573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:45.675996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718718+0000","last_change":"2023-08-10T10:48:42.574494+0000","last_active":"2023-08-10T10:49:12.718718+0000","last_peered":"2023-08-10T10:49:12.718718+0000","last_clean":"2023-08-10T10:49:12.718718+0000","last_became_active":"2023-08-10T10:48:42.574203+0000","last_became_peered":"2023-08-10T10:48:42.574203+0000","last_unstale":"2023-08-10T10:49:12.718718+0000","last_undegraded":"2023-08-10T10:49:12.718718+0000","last_fullsized":"2023-08-10T10:49:12.718718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:10:10.406920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731545+0000","last_change":"2023-08-10T10:48:42.587557+0000","last_active":"2023-08-10T10:49:12.731545+0000","last_peered":"2023-08-10T10:49:12.731545+0000","last_clean":"2023-08-10T10:49:12.731545+0000","last_became_active":"2023-08-10T10:48:42.587133+0000","last_became_peered":"2023-08-10T10:48:42.587133+0000","last_unstale":"2023-08-10T10:49:12.731545+0000","last_undegraded":"2023-08-10T10:49:12.731545+0000","last_fullsized":"2023-08-10T10:49:12.731545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:45:35.005412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713339+0000","last_change":"2023-08-10T10:48:42.587283+0000","last_active":"2023-08-10T10:49:12.713339+0000","last_peered":"2023-08-10T10:49:12.713339+0000","last_clean":"2023-08-10T10:49:12.713339+0000","last_became_active":"2023-08-10T10:48:42.586118+0000","last_became_peered":"2023-08-10T10:48:42.586118+0000","last_unstale":"2023-08-10T10:49:12.713339+0000","last_undegraded":"2023-08-10T10:49:12.713339+0000","last_fullsized":"2023-08-10T10:49:12.713339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:10:50.868060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715015+0000","last_change":"2023-08-10T10:48:42.580843+0000","last_active":"2023-08-10T10:49:12.715015+0000","last_peered":"2023-08-10T10:49:12.715015+0000","last_clean":"2023-08-10T10:49:12.715015+0000","last_became_active":"2023-08-10T10:48:42.579735+0000","last_became_peered":"2023-08-10T10:48:42.579735+0000","last_unstale":"2023-08-10T10:49:12.715015+0000","last_undegraded":"2023-08-10T10:49:12.715015+0000","last_fullsized":"2023-08-10T10:49:12.715015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:24.025912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717927+0000","last_change":"2023-08-10T10:48:42.580250+0000","last_active":"2023-08-10T10:49:12.717927+0000","last_peered":"2023-08-10T10:49:12.717927+0000","last_clean":"2023-08-10T10:49:12.717927+0000","last_became_active":"2023-08-10T10:48:42.579962+0000","last_became_peered":"2023-08-10T10:48:42.579962+0000","last_unstale":"2023-08-10T10:49:12.717927+0000","last_undegraded":"2023-08-10T10:49:12.717927+0000","last_fullsized":"2023-08-10T10:49:12.717927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:03:04.269405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717788+0000","last_change":"2023-08-10T10:48:42.582699+0000","last_active":"2023-08-10T10:49:12.717788+0000","last_peered":"2023-08-10T10:49:12.717788+0000","last_clean":"2023-08-10T10:49:12.717788+0000","last_became_active":"2023-08-10T10:48:42.582426+0000","last_became_peered":"2023-08-10T10:48:42.582426+0000","last_unstale":"2023-08-10T10:49:12.717788+0000","last_undegraded":"2023-08-10T10:49:12.717788+0000","last_fullsized":"2023-08-10T10:49:12.717788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:40.237741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731459+0000","last_change":"2023-08-10T10:48:42.577483+0000","last_active":"2023-08-10T10:49:12.731459+0000","last_peered":"2023-08-10T10:49:12.731459+0000","last_clean":"2023-08-10T10:49:12.731459+0000","last_became_active":"2023-08-10T10:48:42.577195+0000","last_became_peered":"2023-08-10T10:48:42.577195+0000","last_unstale":"2023-08-10T10:49:12.731459+0000","last_undegraded":"2023-08-10T10:49:12.731459+0000","last_fullsized":"2023-08-10T10:49:12.731459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:59:56.657695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717888+0000","last_change":"2023-08-10T10:48:42.581129+0000","last_active":"2023-08-10T10:49:12.717888+0000","last_peered":"2023-08-10T10:49:12.717888+0000","last_clean":"2023-08-10T10:49:12.717888+0000","last_became_active":"2023-08-10T10:48:42.579350+0000","last_became_peered":"2023-08-10T10:48:42.579350+0000","last_unstale":"2023-08-10T10:49:12.717888+0000","last_undegraded":"2023-08-10T10:49:12.717888+0000","last_fullsized":"2023-08-10T10:49:12.717888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:27.669242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707581+0000","last_change":"2023-08-10T10:48:42.578167+0000","last_active":"2023-08-10T10:49:12.707581+0000","last_peered":"2023-08-10T10:49:12.707581+0000","last_clean":"2023-08-10T10:49:12.707581+0000","last_became_active":"2023-08-10T10:48:42.577571+0000","last_became_peered":"2023-08-10T10:48:42.577571+0000","last_unstale":"2023-08-10T10:49:12.707581+0000","last_undegraded":"2023-08-10T10:49:12.707581+0000","last_fullsized":"2023-08-10T10:49:12.707581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:54:14.264193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712579+0000","last_change":"2023-08-10T10:48:42.587207+0000","last_active":"2023-08-10T10:49:12.712579+0000","last_peered":"2023-08-10T10:49:12.712579+0000","last_clean":"2023-08-10T10:49:12.712579+0000","last_became_active":"2023-08-10T10:48:42.586848+0000","last_became_peered":"2023-08-10T10:48:42.586848+0000","last_unstale":"2023-08-10T10:49:12.712579+0000","last_undegraded":"2023-08-10T10:49:12.712579+0000","last_fullsized":"2023-08-10T10:49:12.712579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:34:50.994727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714173+0000","last_change":"2023-08-10T10:48:42.580785+0000","last_active":"2023-08-10T10:49:12.714173+0000","last_peered":"2023-08-10T10:49:12.714173+0000","last_clean":"2023-08-10T10:49:12.714173+0000","last_became_active":"2023-08-10T10:48:42.580395+0000","last_became_peered":"2023-08-10T10:48:42.580395+0000","last_unstale":"2023-08-10T10:49:12.714173+0000","last_undegraded":"2023-08-10T10:49:12.714173+0000","last_fullsized":"2023-08-10T10:49:12.714173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:17:41.679781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250142,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7552,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":149,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":61329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383700,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":496767,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.75}]},{"osd":1,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.622},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.996}]},{"osd":6,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1659999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":9,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.071}]},{"osd":10,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.095}]}]},{"osd":10,"up_from":72,"seq":309237645337,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1090342,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.624}]},{"osd":3,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.53000000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.92500000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.96399999999999997}]},{"osd":11,"last update":"Thu Aug 10 10:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.028},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0069999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808862,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":486613,"data_compressed":14619,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.436},{"interface":"front","average":{"1min":0.501,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79200000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83199999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.84599999999999997,"15min":0.88300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90800000000000003,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.501,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.83199999999999996,"5min":1.077,"15min":1.077},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0049999999999999,"5min":1.167,"15min":1.167},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98699999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.502}]},{"osd":4,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.873,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.82499999999999996,"15min":0.84899999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88700000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.83999999999999997,"15min":0.86099999999999999},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.84799999999999998,"15min":0.86699999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92000000000000004,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.081}]},{"osd":7,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.88600000000000001,"15min":0.91200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":1.607,"15min":1.607},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.871,"15min":0.89000000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92200000000000004,"5min":1.236,"15min":1.236},"last":0.74399999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1899999999999999,"5min":1.319,"15min":1.319},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.93200000000000005,"15min":0.95599999999999996},"min":{"1min":0.57799999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0149999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Thu Aug 10 10:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.95299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]},{"osd":8,"up_from":59,"seq":253403070500,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":495962,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86399999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95399999999999996,"5min":1.079,"15min":1.079},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.748,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.65700000000000003,"15min":0.67400000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94199999999999995,"5min":1.103,"15min":1.103},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.90700000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91200000000000003,"5min":1.113,"15min":1.113},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.502,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.115,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.83299999999999996,"15min":0.84699999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96799999999999997,"5min":1.238,"15min":1.238},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.85399999999999998,"15min":0.87},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.98599999999999999,"5min":1.214,"15min":1.214},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79300000000000004,"15min":0.81799999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0640000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.79700000000000004,"15min":0.82599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0049999999999999,"5min":1.236,"15min":1.236},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.875,"15min":0.89600000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1359999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.028},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":0.91900000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.92700000000000005,"15min":0.94799999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1759999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0309999999999999,"5min":1.29,"15min":1.29},"last":1.014}]},{"osd":9,"last update":"Thu Aug 10 10:48:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1919999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88100000000000001,"15min":0.88300000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.341,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.995}]},{"osd":10,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":1.179},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0489999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332136,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":1086748,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0489999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99299999999999999,"5min":1.466,"15min":1.466},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.82199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.81200000000000006,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88200000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65400000000000003,"15min":0.67100000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81299999999999994,"15min":0.82399999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.194,"15min":1.194},"last":0.754},{"interface":"front","average":{"1min":0.755,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0329999999999999,"5min":1.409,"15min":1.409},"last":0.98699999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:48:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.878,"15min":0.86899999999999999},"min":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.89100000000000001}]},{"osd":9,"last update":"Thu Aug 10 10:48:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.93300000000000005,"15min":0.95099999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.113,"5min":1.341,"15min":1.341},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1459999999999999,"5min":1.329,"15min":1.329},"last":1.0049999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495663,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":496229,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.435},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90600000000000003,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":1.077,"15min":1.077},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67300000000000004,"15min":0.68700000000000006},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":1.089,"15min":1.089},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1,"5min":1.173,"15min":1.173},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.62,"15min":0.64400000000000002},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.751},"min":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0509999999999999,"5min":1.258,"15min":1.258},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0149999999999999,"5min":1.139,"15min":1.139},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:49:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.95599999999999996,"5min":1.016,"15min":1.016},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98999999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.754}]},{"osd":8,"last update":"Thu Aug 10 10:48:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0549999999999999,"5min":1.056,"15min":1.056},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.075,"5min":1.101,"15min":1.101},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Aug 10 10:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.04,"5min":1.145,"15min":1.145},"last":0.87}]},{"osd":10,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.91300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":518434,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60599999999999998,"15min":0.57399999999999995},"min":{"1min":0.433,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.65100000000000002,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.63800000000000001,"15min":0.58999999999999997},"min":{"1min":0.503,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91300000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.67000000000000004,"15min":0.63100000000000001},"min":{"1min":0.52400000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.68700000000000006,"15min":0.65100000000000002},"min":{"1min":0.59599999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1,"5min":1,"15min":1},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.47399999999999998},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.74199999999999999,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.72999999999999998,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.60699999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1499999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.76000000000000001,"15min":0.73099999999999998},"min":{"1min":0.56399999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.052,"5min":1.268,"15min":1.268},"last":0.752}]},{"osd":7,"last update":"Thu Aug 10 10:49:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69499999999999995,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.80600000000000005,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.77800000000000002}]},{"osd":8,"last update":"Thu Aug 10 10:48:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.872,"15min":0.86799999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.83599999999999997,"15min":0.82899999999999996},"min":{"1min":0.63700000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.155,"5min":1.169,"15min":1.169},"last":0.83899999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:48:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83699999999999997,"15min":0.83399999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92600000000000005,"15min":0.92000000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.97399999999999998}]},{"osd":10,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.91000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":498075,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.60899999999999999,"15min":0.58899999999999997},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.624,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.56200000000000006,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.71199999999999997,"15min":0.70199999999999996},"min":{"1min":0.621,"5min":0.434,"15min":0.434},"max":{"1min":1.071,"5min":1.095,"15min":1.095},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.307},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:48:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.502},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92900000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.52500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90700000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70999999999999996,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:48:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.57799999999999996},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84599999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59599999999999997,"15min":0.57499999999999996},"min":{"1min":0.38,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90400000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.437}]},{"osd":7,"last update":"Thu Aug 10 10:48:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.78400000000000003,"15min":0.77100000000000002},"min":{"1min":0.60599999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.55900000000000005}]},{"osd":8,"last update":"Thu Aug 10 10:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.98599999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83699999999999997,"15min":0.83899999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.80700000000000005}]},{"osd":9,"last update":"Thu Aug 10 10:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.56899999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0900000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.014,"5min":1.121,"15min":1.121},"last":0.46300000000000002}]},{"osd":10,"last update":"Thu Aug 10 10:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63700000000000001}]},{"osd":11,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.87},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.747}]}]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":498981,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65100000000000002,"15min":0.60699999999999998},"min":{"1min":0.47899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64700000000000002,"15min":0.60699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91400000000000003,"5min":1.052,"15min":1.052},"last":0.89700000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68700000000000006,"15min":0.68799999999999994},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.41399999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.67500000000000004,"15min":0.65900000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56299999999999994,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0189999999999999,"5min":1.488,"15min":1.488},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.57799999999999996,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92100000000000004,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:48:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70299999999999996,"15min":0.67900000000000005},"min":{"1min":0.51200000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":1.123,"15min":1.123},"last":1.04},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0029999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:48:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0169999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.01},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.55400000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.0920000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.997,"15min":0.997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.05,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.075}]},{"osd":9,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.63100000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0249999999999999,"5min":1.177,"15min":1.177},"last":1.171}]},{"osd":10,"last update":"Thu Aug 10 10:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.1930000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":3,"up_from":25,"seq":107374182462,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":495654,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.42999999999999999,"15min":0.41299999999999998},"min":{"1min":0.34300000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70299999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45700000000000002,"15min":0.436},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65700000000000003,"15min":0.64300000000000002},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.47799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:48:21 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":0.73099999999999998,"15min":0.66500000000000004},"min":{"1min":0.503,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.367,"5min":6.367,"15min":6.367},"last":0.879},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.66500000000000004},"min":{"1min":0.48599999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.999,"5min":1.004,"15min":1.004},"last":0.88900000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.022,"15min":1.022},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.399,"5min":0.84199999999999997,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":6.2969999999999997,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.76500000000000001,"15min":0.71499999999999997},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85699999999999998,"5min":6.3410000000000002,"15min":6.3410000000000002},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.59499999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94299999999999995,"5min":1.054,"15min":1.054},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:48:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65800000000000003,"15min":0.63100000000000001},"min":{"1min":0.49299999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.94399999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.0820000000000001,"5min":1.095,"15min":1.095},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79400000000000004,"15min":0.76800000000000002},"min":{"1min":0.59299999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.032,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78400000000000003,"15min":0.754},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0249999999999999,"5min":1.327,"15min":1.327},"last":0.76300000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.04,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.85799999999999998},"min":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.0880000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.753}]},{"osd":9,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.85299999999999998,"15min":0.87},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97599999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82899999999999996,"15min":0.83799999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1279999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.81000000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.98299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]}]},{"osd":4,"up_from":33,"seq":141733920824,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":495577,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.77600000000000002,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.505,"15min":0.48599999999999999},"min":{"1min":0.36799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69899999999999995,"15min":0.69499999999999995},"min":{"1min":0.503,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86799999999999999,"5min":1.421,"15min":1.421},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.752,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95399999999999996,"5min":1.377,"15min":1.377},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.59499999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91600000000000004,"5min":0.999,"15min":0.999},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:48:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.47199999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.753,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.004,"5min":1.089,"15min":1.089},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.006,"5min":1.071,"15min":1.071},"last":1.02},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.751,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.88900000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.86499999999999999,"15min":0.85799999999999998},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.056,"5min":1.135,"15min":1.135},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.75600000000000001,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.034,"5min":1.115,"15min":1.115},"last":1.044}]},{"osd":9,"last update":"Thu Aug 10 10:48:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.077,"5min":1.175,"15min":1.175},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.874,"15min":0.86899999999999999},"min":{"1min":0.73999999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.0960000000000001,"5min":1.161,"15min":1.161},"last":0.93100000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:48:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.111},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":1.1299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":5,"up_from":38,"seq":163208757300,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1060864,"data_stored":1087020,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.93500000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.92400000000000004,"5min":1.073,"15min":1.073},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.014,"15min":1.014},"last":0.95699999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.497},"min":{"1min":0.374,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.499},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.82799999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70199999999999996,"15min":0.68600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88500000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90200000000000002,"5min":1.145,"15min":1.145},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.753,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85999999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:48:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.012,"15min":1.012},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.49299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91200000000000003,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":9,"last update":"Thu Aug 10 10:48:56 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.82599999999999996,"15min":0.83899999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88800000000000001,"5min":1.173,"15min":1.173},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82699999999999996,"15min":0.83099999999999996},"min":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.006,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.94299999999999995}]},{"osd":10,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.97699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":40219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:49:18.504 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:49:18.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.736+0000 7f0c371ff700 1 -- 172.21.15.107:0/3200160177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 msgr2=0x7f0c30108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.736+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3200160177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 0x7f0c30108bc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800b0d0 tx=0x7f0c2800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.737+0000 7f0c371ff700 1 -- 172.21.15.107:0/3200160177 shutdown_connections 2023-08-10T10:49:18.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.737+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3200160177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 0x7f0c30108bc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.737+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3200160177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c30100780 0x7f0c30100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.737+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3200160177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c30101970 0x7f0c30101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.737+0000 7f0c371ff700 1 -- 172.21.15.107:0/3200160177 >> 172.21.15.107:0/3200160177 conn(0x7f0c300fbcb0 msgr2=0x7f0c300fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:18.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.737+0000 7f0c371ff700 1 -- 172.21.15.107:0/3200160177 shutdown_connections 2023-08-10T10:49:18.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.737+0000 7f0c371ff700 1 -- 172.21.15.107:0/3200160177 wait complete. 2023-08-10T10:49:18.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.738+0000 7f0c371ff700 1 Processor -- start 2023-08-10T10:49:18.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.738+0000 7f0c371ff700 1 -- start start 2023-08-10T10:49:18.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c371ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c30100780 0x7f0c30196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:18.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c371ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c30101970 0x7f0c30196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:18.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c371ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 0x7f0c3019d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:18.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c371ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3019df80 con 0x7f0c30102310 2023-08-10T10:49:18.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c371ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3019e0c0 con 0x7f0c30100780 2023-08-10T10:49:18.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c371ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3019e250 con 0x7f0c30101970 2023-08-10T10:49:18.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c3579c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 0x7f0c3019d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:18.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c3579c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 0x7f0c3019d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57724/0 (socket says 172.21.15.107:57724) 2023-08-10T10:49:18.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c3579c700 1 -- 172.21.15.107:0/3833730582 learned_addr learned my addr 172.21.15.107:0/3833730582 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:18.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c34f9b700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c30100780 0x7f0c30196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:18.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c2ffff700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c30101970 0x7f0c30196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:18.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c3579c700 1 -- 172.21.15.107:0/3833730582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c30101970 msgr2=0x7f0c30196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c3579c700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c30101970 0x7f0c30196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c3579c700 1 -- 172.21.15.107:0/3833730582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c30100780 msgr2=0x7f0c30196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.739+0000 7f0c3579c700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c30100780 0x7f0c30196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.740+0000 7f0c3579c700 1 -- 172.21.15.107:0/3833730582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28009d00 con 0x7f0c30102310 2023-08-10T10:49:18.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.740+0000 7f0c3579c700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 0x7f0c3019d9b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c28007870 tx=0x7f0c280078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:18.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.740+0000 7f0c2dffb700 1 -- 172.21.15.107:0/3833730582 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800e040 con 0x7f0c30102310 2023-08-10T10:49:18.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.740+0000 7f0c2dffb700 1 -- 172.21.15.107:0/3833730582 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c2800be30 con 0x7f0c30102310 2023-08-10T10:49:18.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.740+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3019e4d0 con 0x7f0c30102310 2023-08-10T10:49:18.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.740+0000 7f0c2dffb700 1 -- 172.21.15.107:0/3833730582 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2801b6c0 con 0x7f0c30102310 2023-08-10T10:49:18.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.740+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3019e950 con 0x7f0c30102310 2023-08-10T10:49:18.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.741+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c30107d30 con 0x7f0c30102310 2023-08-10T10:49:18.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.743+0000 7f0c2dffb700 1 -- 172.21.15.107:0/3833730582 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f0c28024410 con 0x7f0c30102310 2023-08-10T10:49:18.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.744+0000 7f0c2dffb700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0c200a12a0 0x7f0c200a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:18.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.745+0000 7f0c2dffb700 1 -- 172.21.15.107:0/3833730582 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f0c280cdea0 con 0x7f0c30102310 2023-08-10T10:49:18.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.745+0000 7f0c34f9b700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0c200a12a0 0x7f0c200a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:18.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.745+0000 7f0c34f9b700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0c200a12a0 0x7f0c200a3760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c301017d0 tx=0x7f0c24009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:18.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.748+0000 7f0c2dffb700 1 -- 172.21.15.107:0/3833730582 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0c280971c0 con 0x7f0c30102310 2023-08-10T10:49:18.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:18 smithi107 ceph-mon[127953]: pgmap v324: 129 pgs: 129 active+clean; 584 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.9 KiB/s wr, 14 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2023-08-10T10:49:18.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:18 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1665150912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:18.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.946+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c30060bb0 con 0x7f0c200a12a0 2023-08-10T10:49:18.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.958+0000 7f0c2dffb700 1 -- 172.21.15.107:0/3833730582 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+421490 (secure 0 0 0) 0x7f0c30060bb0 con 0x7f0c200a12a0 2023-08-10T10:49:18.964 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:18.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.963+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0c200a12a0 msgr2=0x7f0c200a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.963+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0c200a12a0 0x7f0c200a3760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c301017d0 tx=0x7f0c24009260 comp rx=0 tx=0).stop 2023-08-10T10:49:18.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.963+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 msgr2=0x7f0c3019d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:18.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.963+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 0x7f0c3019d9b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c28007870 tx=0x7f0c280078a0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.964+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 shutdown_connections 2023-08-10T10:49:18.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.964+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0c200a12a0 0x7f0c200a3760 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.964+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c30100780 0x7f0c30196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.964+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c30102310 0x7f0c3019d9b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.964+0000 7f0c371ff700 1 --2- 172.21.15.107:0/3833730582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c30101970 0x7f0c30196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:18.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.964+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 >> 172.21.15.107:0/3833730582 conn(0x7f0c300fbcb0 msgr2=0x7f0c30104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:18.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.964+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 shutdown_connections 2023-08-10T10:49:18.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:18.964+0000 7f0c371ff700 1 -- 172.21.15.107:0/3833730582 wait complete. 2023-08-10T10:49:18.968 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-08-10T10:49:18.983 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2023-08-10T10:49:17.582542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597920,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":154,"num_read_kb":137,"num_write":330,"num_write_kb":2996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":418,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336176,"kb_used_data":11944,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605648,"statfs":{"total":1151940427776,"available":1151596183552,"internally_reserved":0,"allocated":12230656,"data_stored":7746402,"data_compressed":316512,"data_compressed_allocated":425984,"data_compressed_original":2351104,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2960,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":100,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002418"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714060+0000","last_change":"2023-08-10T10:48:42.585259+0000","last_active":"2023-08-10T10:49:12.714060+0000","last_peered":"2023-08-10T10:49:12.714060+0000","last_clean":"2023-08-10T10:49:12.714060+0000","last_became_active":"2023-08-10T10:48:42.584501+0000","last_became_peered":"2023-08-10T10:48:42.584501+0000","last_unstale":"2023-08-10T10:49:12.714060+0000","last_undegraded":"2023-08-10T10:49:12.714060+0000","last_fullsized":"2023-08-10T10:49:12.714060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:31.281761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731723+0000","last_change":"2023-08-10T10:48:42.577812+0000","last_active":"2023-08-10T10:49:12.731723+0000","last_peered":"2023-08-10T10:49:12.731723+0000","last_clean":"2023-08-10T10:49:12.731723+0000","last_became_active":"2023-08-10T10:48:42.577499+0000","last_became_peered":"2023-08-10T10:48:42.577499+0000","last_unstale":"2023-08-10T10:49:12.731723+0000","last_undegraded":"2023-08-10T10:49:12.731723+0000","last_fullsized":"2023-08-10T10:49:12.731723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:32.054997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731226+0000","last_change":"2023-08-10T10:48:42.577302+0000","last_active":"2023-08-10T10:49:12.731226+0000","last_peered":"2023-08-10T10:49:12.731226+0000","last_clean":"2023-08-10T10:49:12.731226+0000","last_became_active":"2023-08-10T10:48:42.577022+0000","last_became_peered":"2023-08-10T10:48:42.577022+0000","last_unstale":"2023-08-10T10:49:12.731226+0000","last_undegraded":"2023-08-10T10:49:12.731226+0000","last_fullsized":"2023-08-10T10:49:12.731226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:19.509385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707930+0000","last_change":"2023-08-10T10:48:42.577198+0000","last_active":"2023-08-10T10:49:12.707930+0000","last_peered":"2023-08-10T10:49:12.707930+0000","last_clean":"2023-08-10T10:49:12.707930+0000","last_became_active":"2023-08-10T10:48:42.576887+0000","last_became_peered":"2023-08-10T10:48:42.576887+0000","last_unstale":"2023-08-10T10:49:12.707930+0000","last_undegraded":"2023-08-10T10:49:12.707930+0000","last_fullsized":"2023-08-10T10:49:12.707930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:13.115193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712407+0000","last_change":"2023-08-10T10:48:42.587532+0000","last_active":"2023-08-10T10:49:12.712407+0000","last_peered":"2023-08-10T10:49:12.712407+0000","last_clean":"2023-08-10T10:49:12.712407+0000","last_became_active":"2023-08-10T10:48:42.587199+0000","last_became_peered":"2023-08-10T10:48:42.587199+0000","last_unstale":"2023-08-10T10:49:12.712407+0000","last_undegraded":"2023-08-10T10:49:12.712407+0000","last_fullsized":"2023-08-10T10:49:12.712407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:39.740129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711152+0000","last_change":"2023-08-10T10:48:42.581998+0000","last_active":"2023-08-10T10:49:12.711152+0000","last_peered":"2023-08-10T10:49:12.711152+0000","last_clean":"2023-08-10T10:49:12.711152+0000","last_became_active":"2023-08-10T10:48:42.581683+0000","last_became_peered":"2023-08-10T10:48:42.581683+0000","last_unstale":"2023-08-10T10:49:12.711152+0000","last_undegraded":"2023-08-10T10:49:12.711152+0000","last_fullsized":"2023-08-10T10:49:12.711152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:19.796398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717754+0000","last_change":"2023-08-10T10:48:42.578452+0000","last_active":"2023-08-10T10:49:12.717754+0000","last_peered":"2023-08-10T10:49:12.717754+0000","last_clean":"2023-08-10T10:49:12.717754+0000","last_became_active":"2023-08-10T10:48:42.577456+0000","last_became_peered":"2023-08-10T10:48:42.577456+0000","last_unstale":"2023-08-10T10:49:12.717754+0000","last_undegraded":"2023-08-10T10:49:12.717754+0000","last_fullsized":"2023-08-10T10:49:12.717754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:17:35.823145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717028+0000","last_change":"2023-08-10T10:48:42.578839+0000","last_active":"2023-08-10T10:49:12.717028+0000","last_peered":"2023-08-10T10:49:12.717028+0000","last_clean":"2023-08-10T10:49:12.717028+0000","last_became_active":"2023-08-10T10:48:42.578450+0000","last_became_peered":"2023-08-10T10:48:42.578450+0000","last_unstale":"2023-08-10T10:49:12.717028+0000","last_undegraded":"2023-08-10T10:49:12.717028+0000","last_fullsized":"2023-08-10T10:49:12.717028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:29:39.316129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708298+0000","last_change":"2023-08-10T10:48:42.588533+0000","last_active":"2023-08-10T10:49:12.708298+0000","last_peered":"2023-08-10T10:49:12.708298+0000","last_clean":"2023-08-10T10:49:12.708298+0000","last_became_active":"2023-08-10T10:48:42.588205+0000","last_became_peered":"2023-08-10T10:48:42.588205+0000","last_unstale":"2023-08-10T10:49:12.708298+0000","last_undegraded":"2023-08-10T10:49:12.708298+0000","last_fullsized":"2023-08-10T10:49:12.708298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:27.853522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711349+0000","last_change":"2023-08-10T10:48:42.588606+0000","last_active":"2023-08-10T10:49:12.711349+0000","last_peered":"2023-08-10T10:49:12.711349+0000","last_clean":"2023-08-10T10:49:12.711349+0000","last_became_active":"2023-08-10T10:48:42.588261+0000","last_became_peered":"2023-08-10T10:48:42.588261+0000","last_unstale":"2023-08-10T10:49:12.711349+0000","last_undegraded":"2023-08-10T10:49:12.711349+0000","last_fullsized":"2023-08-10T10:49:12.711349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:08:25.435478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718340+0000","last_change":"2023-08-10T10:48:42.577245+0000","last_active":"2023-08-10T10:49:12.718340+0000","last_peered":"2023-08-10T10:49:12.718340+0000","last_clean":"2023-08-10T10:49:12.718340+0000","last_became_active":"2023-08-10T10:48:42.576512+0000","last_became_peered":"2023-08-10T10:48:42.576512+0000","last_unstale":"2023-08-10T10:49:12.718340+0000","last_undegraded":"2023-08-10T10:49:12.718340+0000","last_fullsized":"2023-08-10T10:49:12.718340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:41.419282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707744+0000","last_change":"2023-08-10T10:48:42.590704+0000","last_active":"2023-08-10T10:49:12.707744+0000","last_peered":"2023-08-10T10:49:12.707744+0000","last_clean":"2023-08-10T10:49:12.707744+0000","last_became_active":"2023-08-10T10:48:42.590360+0000","last_became_peered":"2023-08-10T10:48:42.590360+0000","last_unstale":"2023-08-10T10:49:12.707744+0000","last_undegraded":"2023-08-10T10:49:12.707744+0000","last_fullsized":"2023-08-10T10:49:12.707744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:27.858538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712842+0000","last_change":"2023-08-10T10:48:42.580072+0000","last_active":"2023-08-10T10:49:12.712842+0000","last_peered":"2023-08-10T10:49:12.712842+0000","last_clean":"2023-08-10T10:49:12.712842+0000","last_became_active":"2023-08-10T10:48:42.579745+0000","last_became_peered":"2023-08-10T10:48:42.579745+0000","last_unstale":"2023-08-10T10:49:12.712842+0000","last_undegraded":"2023-08-10T10:49:12.712842+0000","last_fullsized":"2023-08-10T10:49:12.712842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:58.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730013+0000","last_change":"2023-08-10T10:48:42.577050+0000","last_active":"2023-08-10T10:49:12.730013+0000","last_peered":"2023-08-10T10:49:12.730013+0000","last_clean":"2023-08-10T10:49:12.730013+0000","last_became_active":"2023-08-10T10:48:42.576686+0000","last_became_peered":"2023-08-10T10:48:42.576686+0000","last_unstale":"2023-08-10T10:49:12.730013+0000","last_undegraded":"2023-08-10T10:49:12.730013+0000","last_fullsized":"2023-08-10T10:49:12.730013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:20:27.181934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730451+0000","last_change":"2023-08-10T10:48:42.582939+0000","last_active":"2023-08-10T10:49:12.730451+0000","last_peered":"2023-08-10T10:49:12.730451+0000","last_clean":"2023-08-10T10:49:12.730451+0000","last_became_active":"2023-08-10T10:48:42.582560+0000","last_became_peered":"2023-08-10T10:48:42.582560+0000","last_unstale":"2023-08-10T10:49:12.730451+0000","last_undegraded":"2023-08-10T10:49:12.730451+0000","last_fullsized":"2023-08-10T10:49:12.730451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:36:49.334857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.706881+0000","last_change":"2023-08-10T10:48:42.577163+0000","last_active":"2023-08-10T10:49:12.706881+0000","last_peered":"2023-08-10T10:49:12.706881+0000","last_clean":"2023-08-10T10:49:12.706881+0000","last_became_active":"2023-08-10T10:48:42.576866+0000","last_became_peered":"2023-08-10T10:48:42.576866+0000","last_unstale":"2023-08-10T10:49:12.706881+0000","last_undegraded":"2023-08-10T10:49:12.706881+0000","last_fullsized":"2023-08-10T10:49:12.706881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:50:27.812527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713970+0000","last_change":"2023-08-10T10:48:42.585496+0000","last_active":"2023-08-10T10:49:12.713970+0000","last_peered":"2023-08-10T10:49:12.713970+0000","last_clean":"2023-08-10T10:49:12.713970+0000","last_became_active":"2023-08-10T10:48:42.584963+0000","last_became_peered":"2023-08-10T10:48:42.584963+0000","last_unstale":"2023-08-10T10:49:12.713970+0000","last_undegraded":"2023-08-10T10:49:12.713970+0000","last_fullsized":"2023-08-10T10:49:12.713970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:05.902933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709523+0000","last_change":"2023-08-10T10:48:42.576038+0000","last_active":"2023-08-10T10:49:12.709523+0000","last_peered":"2023-08-10T10:49:12.709523+0000","last_clean":"2023-08-10T10:49:12.709523+0000","last_became_active":"2023-08-10T10:48:42.575660+0000","last_became_peered":"2023-08-10T10:48:42.575660+0000","last_unstale":"2023-08-10T10:49:12.709523+0000","last_undegraded":"2023-08-10T10:49:12.709523+0000","last_fullsized":"2023-08-10T10:49:12.709523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:17.443396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717536+0000","last_change":"2023-08-10T10:48:42.573855+0000","last_active":"2023-08-10T10:49:12.717536+0000","last_peered":"2023-08-10T10:49:12.717536+0000","last_clean":"2023-08-10T10:49:12.717536+0000","last_became_active":"2023-08-10T10:48:42.573475+0000","last_became_peered":"2023-08-10T10:48:42.573475+0000","last_unstale":"2023-08-10T10:49:12.717536+0000","last_undegraded":"2023-08-10T10:49:12.717536+0000","last_fullsized":"2023-08-10T10:49:12.717536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:13:36.282148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719366+0000","last_change":"2023-08-10T10:48:46.628005+0000","last_active":"2023-08-10T10:49:12.719366+0000","last_peered":"2023-08-10T10:49:12.719366+0000","last_clean":"2023-08-10T10:49:12.719366+0000","last_became_active":"2023-08-10T10:48:46.627558+0000","last_became_peered":"2023-08-10T10:48:46.627558+0000","last_unstale":"2023-08-10T10:49:12.719366+0000","last_undegraded":"2023-08-10T10:49:12.719366+0000","last_fullsized":"2023-08-10T10:49:12.719366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:33:01.121958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'4","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709270+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:49:12.709270+0000","last_peered":"2023-08-10T10:49:12.709270+0000","last_clean":"2023-08-10T10:49:12.709270+0000","last_became_active":"2023-08-10T10:48:41.585341+0000","last_became_peered":"2023-08-10T10:48:41.585341+0000","last_unstale":"2023-08-10T10:49:12.709270+0000","last_undegraded":"2023-08-10T10:49:12.709270+0000","last_fullsized":"2023-08-10T10:49:12.709270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:34.374039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717943+0000","last_change":"2023-08-10T10:48:42.580893+0000","last_active":"2023-08-10T10:49:12.717943+0000","last_peered":"2023-08-10T10:49:12.717943+0000","last_clean":"2023-08-10T10:49:12.717943+0000","last_became_active":"2023-08-10T10:48:42.580591+0000","last_became_peered":"2023-08-10T10:48:42.580591+0000","last_unstale":"2023-08-10T10:49:12.717943+0000","last_undegraded":"2023-08-10T10:49:12.717943+0000","last_fullsized":"2023-08-10T10:49:12.717943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:32.998434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707054+0000","last_change":"2023-08-10T10:48:46.635407+0000","last_active":"2023-08-10T10:49:12.707054+0000","last_peered":"2023-08-10T10:49:12.707054+0000","last_clean":"2023-08-10T10:49:12.707054+0000","last_became_active":"2023-08-10T10:48:46.634936+0000","last_became_peered":"2023-08-10T10:48:46.634936+0000","last_unstale":"2023-08-10T10:49:12.707054+0000","last_undegraded":"2023-08-10T10:49:12.707054+0000","last_fullsized":"2023-08-10T10:49:12.707054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:17:41.129674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718213+0000","last_change":"2023-08-10T10:48:41.588054+0000","last_active":"2023-08-10T10:49:12.718213+0000","last_peered":"2023-08-10T10:49:12.718213+0000","last_clean":"2023-08-10T10:49:12.718213+0000","last_became_active":"2023-08-10T10:48:41.587764+0000","last_became_peered":"2023-08-10T10:48:41.587764+0000","last_unstale":"2023-08-10T10:49:12.718213+0000","last_undegraded":"2023-08-10T10:49:12.718213+0000","last_fullsized":"2023-08-10T10:49:12.718213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:07:17.541181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731849+0000","last_change":"2023-08-10T10:48:42.581834+0000","last_active":"2023-08-10T10:49:12.731849+0000","last_peered":"2023-08-10T10:49:12.731849+0000","last_clean":"2023-08-10T10:49:12.731849+0000","last_became_active":"2023-08-10T10:48:42.581438+0000","last_became_peered":"2023-08-10T10:48:42.581438+0000","last_unstale":"2023-08-10T10:49:12.731849+0000","last_undegraded":"2023-08-10T10:49:12.731849+0000","last_fullsized":"2023-08-10T10:49:12.731849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:05:46.899608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.737051+0000","last_change":"2023-08-10T10:49:12.737051+0000","last_active":"2023-08-10T10:49:12.737051+0000","last_peered":"2023-08-10T10:49:12.737051+0000","last_clean":"2023-08-10T10:49:12.737051+0000","last_became_active":"2023-08-10T10:49:12.736586+0000","last_became_peered":"2023-08-10T10:49:12.736586+0000","last_unstale":"2023-08-10T10:49:12.737051+0000","last_undegraded":"2023-08-10T10:49:12.737051+0000","last_fullsized":"2023-08-10T10:49:12.737051+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:41.900139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'11","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.638028+0000","last_change":"2023-08-10T10:49:12.734942+0000","last_active":"2023-08-10T10:49:15.638028+0000","last_peered":"2023-08-10T10:49:15.638028+0000","last_clean":"2023-08-10T10:49:15.638028+0000","last_became_active":"2023-08-10T10:49:12.720078+0000","last_became_peered":"2023-08-10T10:49:12.720078+0000","last_unstale":"2023-08-10T10:49:15.638028+0000","last_undegraded":"2023-08-10T10:49:15.638028+0000","last_fullsized":"2023-08-10T10:49:15.638028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:02.059905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707771+0000","last_change":"2023-08-10T10:48:42.581222+0000","last_active":"2023-08-10T10:49:12.707771+0000","last_peered":"2023-08-10T10:49:12.707771+0000","last_clean":"2023-08-10T10:49:12.707771+0000","last_became_active":"2023-08-10T10:48:42.580885+0000","last_became_peered":"2023-08-10T10:48:42.580885+0000","last_unstale":"2023-08-10T10:49:12.707771+0000","last_undegraded":"2023-08-10T10:49:12.707771+0000","last_fullsized":"2023-08-10T10:49:12.707771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:44:10.016090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707604+0000","last_change":"2023-08-10T10:48:46.626985+0000","last_active":"2023-08-10T10:49:12.707604+0000","last_peered":"2023-08-10T10:49:12.707604+0000","last_clean":"2023-08-10T10:49:12.707604+0000","last_became_active":"2023-08-10T10:48:46.626292+0000","last_became_peered":"2023-08-10T10:48:46.626292+0000","last_unstale":"2023-08-10T10:49:12.707604+0000","last_undegraded":"2023-08-10T10:49:12.707604+0000","last_fullsized":"2023-08-10T10:49:12.707604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:17.994796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636981+0000","last_change":"2023-08-10T10:48:41.588563+0000","last_active":"2023-08-10T10:49:15.636981+0000","last_peered":"2023-08-10T10:49:15.636981+0000","last_clean":"2023-08-10T10:49:15.636981+0000","last_became_active":"2023-08-10T10:48:41.588250+0000","last_became_peered":"2023-08-10T10:48:41.588250+0000","last_unstale":"2023-08-10T10:49:15.636981+0000","last_undegraded":"2023-08-10T10:49:15.636981+0000","last_fullsized":"2023-08-10T10:49:15.636981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:12.146812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715313+0000","last_change":"2023-08-10T10:49:12.714641+0000","last_active":"2023-08-10T10:49:12.715313+0000","last_peered":"2023-08-10T10:49:12.715313+0000","last_clean":"2023-08-10T10:49:12.715313+0000","last_became_active":"2023-08-10T10:49:12.714185+0000","last_became_peered":"2023-08-10T10:49:12.714185+0000","last_unstale":"2023-08-10T10:49:12.715313+0000","last_undegraded":"2023-08-10T10:49:12.715313+0000","last_fullsized":"2023-08-10T10:49:12.715313+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:34:26.821493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717311+0000","last_change":"2023-08-10T10:48:46.630641+0000","last_active":"2023-08-10T10:49:12.717311+0000","last_peered":"2023-08-10T10:49:12.717311+0000","last_clean":"2023-08-10T10:49:12.717311+0000","last_became_active":"2023-08-10T10:48:46.630231+0000","last_became_peered":"2023-08-10T10:48:46.630231+0000","last_unstale":"2023-08-10T10:49:12.717311+0000","last_undegraded":"2023-08-10T10:49:12.717311+0000","last_fullsized":"2023-08-10T10:49:12.717311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:57:59.187279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.611065+0000","last_change":"2023-08-10T10:48:41.586083+0000","last_active":"2023-08-10T10:49:13.611065+0000","last_peered":"2023-08-10T10:49:13.611065+0000","last_clean":"2023-08-10T10:49:13.611065+0000","last_became_active":"2023-08-10T10:48:41.585714+0000","last_became_peered":"2023-08-10T10:48:41.585714+0000","last_unstale":"2023-08-10T10:49:13.611065+0000","last_undegraded":"2023-08-10T10:49:13.611065+0000","last_fullsized":"2023-08-10T10:49:13.611065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:28.992239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712459+0000","last_change":"2023-08-10T10:48:42.578007+0000","last_active":"2023-08-10T10:49:12.712459+0000","last_peered":"2023-08-10T10:49:12.712459+0000","last_clean":"2023-08-10T10:49:12.712459+0000","last_became_active":"2023-08-10T10:48:42.577687+0000","last_became_peered":"2023-08-10T10:48:42.577687+0000","last_unstale":"2023-08-10T10:49:12.712459+0000","last_undegraded":"2023-08-10T10:49:12.712459+0000","last_fullsized":"2023-08-10T10:49:12.712459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:23.114738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719097+0000","last_change":"2023-08-10T10:48:46.633618+0000","last_active":"2023-08-10T10:49:12.719097+0000","last_peered":"2023-08-10T10:49:12.719097+0000","last_clean":"2023-08-10T10:49:12.719097+0000","last_became_active":"2023-08-10T10:48:46.633223+0000","last_became_peered":"2023-08-10T10:48:46.633223+0000","last_unstale":"2023-08-10T10:49:12.719097+0000","last_undegraded":"2023-08-10T10:49:12.719097+0000","last_fullsized":"2023-08-10T10:49:12.719097+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:03.852150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.619031+0000","last_change":"2023-08-10T10:48:41.591262+0000","last_active":"2023-08-10T10:49:13.619031+0000","last_peered":"2023-08-10T10:49:13.619031+0000","last_clean":"2023-08-10T10:49:13.619031+0000","last_became_active":"2023-08-10T10:48:41.590879+0000","last_became_peered":"2023-08-10T10:48:41.590879+0000","last_unstale":"2023-08-10T10:49:13.619031+0000","last_undegraded":"2023-08-10T10:49:13.619031+0000","last_fullsized":"2023-08-10T10:49:13.619031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:32:51.331831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730883+0000","last_change":"2023-08-10T10:48:42.581852+0000","last_active":"2023-08-10T10:49:12.730883+0000","last_peered":"2023-08-10T10:49:12.730883+0000","last_clean":"2023-08-10T10:49:12.730883+0000","last_became_active":"2023-08-10T10:48:42.581516+0000","last_became_peered":"2023-08-10T10:48:42.581516+0000","last_unstale":"2023-08-10T10:49:12.730883+0000","last_undegraded":"2023-08-10T10:49:12.730883+0000","last_fullsized":"2023-08-10T10:49:12.730883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:10.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713879+0000","last_change":"2023-08-10T10:48:46.629922+0000","last_active":"2023-08-10T10:49:12.713879+0000","last_peered":"2023-08-10T10:49:12.713879+0000","last_clean":"2023-08-10T10:49:12.713879+0000","last_became_active":"2023-08-10T10:48:46.629079+0000","last_became_peered":"2023-08-10T10:48:46.629079+0000","last_unstale":"2023-08-10T10:49:12.713879+0000","last_undegraded":"2023-08-10T10:49:12.713879+0000","last_fullsized":"2023-08-10T10:49:12.713879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:31:34.256668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.619783+0000","last_change":"2023-08-10T10:48:41.580410+0000","last_active":"2023-08-10T10:49:13.619783+0000","last_peered":"2023-08-10T10:49:13.619783+0000","last_clean":"2023-08-10T10:49:13.619783+0000","last_became_active":"2023-08-10T10:48:41.580032+0000","last_became_peered":"2023-08-10T10:48:41.580032+0000","last_unstale":"2023-08-10T10:49:13.619783+0000","last_undegraded":"2023-08-10T10:49:13.619783+0000","last_fullsized":"2023-08-10T10:49:13.619783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:46.503559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717834+0000","last_change":"2023-08-10T10:48:42.582297+0000","last_active":"2023-08-10T10:49:12.717834+0000","last_peered":"2023-08-10T10:49:12.717834+0000","last_clean":"2023-08-10T10:49:12.717834+0000","last_became_active":"2023-08-10T10:48:42.581966+0000","last_became_peered":"2023-08-10T10:48:42.581966+0000","last_unstale":"2023-08-10T10:49:12.717834+0000","last_undegraded":"2023-08-10T10:49:12.717834+0000","last_fullsized":"2023-08-10T10:49:12.717834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:48:05.595908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731000+0000","last_change":"2023-08-10T10:48:46.622376+0000","last_active":"2023-08-10T10:49:12.731000+0000","last_peered":"2023-08-10T10:49:12.731000+0000","last_clean":"2023-08-10T10:49:12.731000+0000","last_became_active":"2023-08-10T10:48:46.621872+0000","last_became_peered":"2023-08-10T10:48:46.621872+0000","last_unstale":"2023-08-10T10:49:12.731000+0000","last_undegraded":"2023-08-10T10:49:12.731000+0000","last_fullsized":"2023-08-10T10:49:12.731000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:06:48.430562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.736262+0000","last_change":"2023-08-10T10:48:41.585309+0000","last_active":"2023-08-10T10:49:12.736262+0000","last_peered":"2023-08-10T10:49:12.736262+0000","last_clean":"2023-08-10T10:49:12.736262+0000","last_became_active":"2023-08-10T10:48:41.585007+0000","last_became_peered":"2023-08-10T10:48:41.585007+0000","last_unstale":"2023-08-10T10:49:12.736262+0000","last_undegraded":"2023-08-10T10:49:12.736262+0000","last_fullsized":"2023-08-10T10:49:12.736262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:23.129389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708400+0000","last_change":"2023-08-10T10:48:42.575404+0000","last_active":"2023-08-10T10:49:12.708400+0000","last_peered":"2023-08-10T10:49:12.708400+0000","last_clean":"2023-08-10T10:49:12.708400+0000","last_became_active":"2023-08-10T10:48:42.575072+0000","last_became_peered":"2023-08-10T10:48:42.575072+0000","last_unstale":"2023-08-10T10:49:12.708400+0000","last_undegraded":"2023-08-10T10:49:12.708400+0000","last_fullsized":"2023-08-10T10:49:12.708400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:48:47.730243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718109+0000","last_change":"2023-08-10T10:48:46.627175+0000","last_active":"2023-08-10T10:49:12.718109+0000","last_peered":"2023-08-10T10:49:12.718109+0000","last_clean":"2023-08-10T10:49:12.718109+0000","last_became_active":"2023-08-10T10:48:46.626639+0000","last_became_peered":"2023-08-10T10:48:46.626639+0000","last_unstale":"2023-08-10T10:49:12.718109+0000","last_undegraded":"2023-08-10T10:49:12.718109+0000","last_fullsized":"2023-08-10T10:49:12.718109+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:34:37.354808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.735422+0000","last_change":"2023-08-10T10:48:41.585185+0000","last_active":"2023-08-10T10:49:12.735422+0000","last_peered":"2023-08-10T10:49:12.735422+0000","last_clean":"2023-08-10T10:49:12.735422+0000","last_became_active":"2023-08-10T10:48:41.584834+0000","last_became_peered":"2023-08-10T10:48:41.584834+0000","last_unstale":"2023-08-10T10:49:12.735422+0000","last_undegraded":"2023-08-10T10:49:12.735422+0000","last_fullsized":"2023-08-10T10:49:12.735422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:10.581491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708214+0000","last_change":"2023-08-10T10:48:42.574634+0000","last_active":"2023-08-10T10:49:12.708214+0000","last_peered":"2023-08-10T10:49:12.708214+0000","last_clean":"2023-08-10T10:49:12.708214+0000","last_became_active":"2023-08-10T10:48:42.574290+0000","last_became_peered":"2023-08-10T10:48:42.574290+0000","last_unstale":"2023-08-10T10:49:12.708214+0000","last_undegraded":"2023-08-10T10:49:12.708214+0000","last_fullsized":"2023-08-10T10:49:12.708214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:32.688234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708363+0000","last_change":"2023-08-10T10:48:46.627158+0000","last_active":"2023-08-10T10:49:12.708363+0000","last_peered":"2023-08-10T10:49:12.708363+0000","last_clean":"2023-08-10T10:49:12.708363+0000","last_became_active":"2023-08-10T10:48:46.626686+0000","last_became_peered":"2023-08-10T10:48:46.626686+0000","last_unstale":"2023-08-10T10:49:12.708363+0000","last_undegraded":"2023-08-10T10:49:12.708363+0000","last_fullsized":"2023-08-10T10:49:12.708363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:44:14.440163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733637+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:49:12.733637+0000","last_peered":"2023-08-10T10:49:12.733637+0000","last_clean":"2023-08-10T10:49:12.733637+0000","last_became_active":"2023-08-10T10:48:41.586573+0000","last_became_peered":"2023-08-10T10:48:41.586573+0000","last_unstale":"2023-08-10T10:49:12.733637+0000","last_undegraded":"2023-08-10T10:49:12.733637+0000","last_fullsized":"2023-08-10T10:49:12.733637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:12.186283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731695+0000","last_change":"2023-08-10T10:48:42.584454+0000","last_active":"2023-08-10T10:49:12.731695+0000","last_peered":"2023-08-10T10:49:12.731695+0000","last_clean":"2023-08-10T10:49:12.731695+0000","last_became_active":"2023-08-10T10:48:42.584098+0000","last_became_peered":"2023-08-10T10:48:42.584098+0000","last_unstale":"2023-08-10T10:49:12.731695+0000","last_undegraded":"2023-08-10T10:49:12.731695+0000","last_fullsized":"2023-08-10T10:49:12.731695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:06.825290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708091+0000","last_change":"2023-08-10T10:48:46.635451+0000","last_active":"2023-08-10T10:49:12.708091+0000","last_peered":"2023-08-10T10:49:12.708091+0000","last_clean":"2023-08-10T10:49:12.708091+0000","last_became_active":"2023-08-10T10:48:46.634768+0000","last_became_peered":"2023-08-10T10:48:46.634768+0000","last_unstale":"2023-08-10T10:49:12.708091+0000","last_undegraded":"2023-08-10T10:49:12.708091+0000","last_fullsized":"2023-08-10T10:49:12.708091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:18.826421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.609913+0000","last_change":"2023-08-10T10:48:41.586720+0000","last_active":"2023-08-10T10:49:13.609913+0000","last_peered":"2023-08-10T10:49:13.609913+0000","last_clean":"2023-08-10T10:49:13.609913+0000","last_became_active":"2023-08-10T10:48:41.586365+0000","last_became_peered":"2023-08-10T10:48:41.586365+0000","last_unstale":"2023-08-10T10:49:13.609913+0000","last_undegraded":"2023-08-10T10:49:13.609913+0000","last_fullsized":"2023-08-10T10:49:13.609913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:18.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715509+0000","last_change":"2023-08-10T10:49:12.715509+0000","last_active":"2023-08-10T10:49:12.715509+0000","last_peered":"2023-08-10T10:49:12.715509+0000","last_clean":"2023-08-10T10:49:12.715509+0000","last_became_active":"2023-08-10T10:49:12.714785+0000","last_became_peered":"2023-08-10T10:49:12.714785+0000","last_unstale":"2023-08-10T10:49:12.715509+0000","last_undegraded":"2023-08-10T10:49:12.715509+0000","last_fullsized":"2023-08-10T10:49:12.715509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:02:27.185255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708443+0000","last_change":"2023-08-10T10:48:46.630613+0000","last_active":"2023-08-10T10:49:12.708443+0000","last_peered":"2023-08-10T10:49:12.708443+0000","last_clean":"2023-08-10T10:49:12.708443+0000","last_became_active":"2023-08-10T10:48:46.630152+0000","last_became_peered":"2023-08-10T10:48:46.630152+0000","last_unstale":"2023-08-10T10:49:12.708443+0000","last_undegraded":"2023-08-10T10:49:12.708443+0000","last_fullsized":"2023-08-10T10:49:12.708443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:18.733177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.610012+0000","last_change":"2023-08-10T10:48:41.583291+0000","last_active":"2023-08-10T10:49:13.610012+0000","last_peered":"2023-08-10T10:49:13.610012+0000","last_clean":"2023-08-10T10:49:13.610012+0000","last_became_active":"2023-08-10T10:48:41.582894+0000","last_became_peered":"2023-08-10T10:48:41.582894+0000","last_unstale":"2023-08-10T10:49:13.610012+0000","last_undegraded":"2023-08-10T10:49:13.610012+0000","last_fullsized":"2023-08-10T10:49:13.610012+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:47.694100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713000+0000","last_change":"2023-08-10T10:48:42.582097+0000","last_active":"2023-08-10T10:49:12.713000+0000","last_peered":"2023-08-10T10:49:12.713000+0000","last_clean":"2023-08-10T10:49:12.713000+0000","last_became_active":"2023-08-10T10:48:42.581622+0000","last_became_peered":"2023-08-10T10:48:42.581622+0000","last_unstale":"2023-08-10T10:49:12.713000+0000","last_undegraded":"2023-08-10T10:49:12.713000+0000","last_fullsized":"2023-08-10T10:49:12.713000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:01.359438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731717+0000","last_change":"2023-08-10T10:48:46.628850+0000","last_active":"2023-08-10T10:49:12.731717+0000","last_peered":"2023-08-10T10:49:12.731717+0000","last_clean":"2023-08-10T10:49:12.731717+0000","last_became_active":"2023-08-10T10:48:46.628060+0000","last_became_peered":"2023-08-10T10:48:46.628060+0000","last_unstale":"2023-08-10T10:49:12.731717+0000","last_undegraded":"2023-08-10T10:49:12.731717+0000","last_fullsized":"2023-08-10T10:49:12.731717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:22.729040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.637700+0000","last_change":"2023-08-10T10:49:12.726708+0000","last_active":"2023-08-10T10:49:15.637700+0000","last_peered":"2023-08-10T10:49:15.637700+0000","last_clean":"2023-08-10T10:49:15.637700+0000","last_became_active":"2023-08-10T10:49:12.718963+0000","last_became_peered":"2023-08-10T10:49:12.718963+0000","last_unstale":"2023-08-10T10:49:15.637700+0000","last_undegraded":"2023-08-10T10:49:15.637700+0000","last_fullsized":"2023-08-10T10:49:15.637700+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:42.202471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712953+0000","last_change":"2023-08-10T10:48:42.583174+0000","last_active":"2023-08-10T10:49:12.712953+0000","last_peered":"2023-08-10T10:49:12.712953+0000","last_clean":"2023-08-10T10:49:12.712953+0000","last_became_active":"2023-08-10T10:48:42.582869+0000","last_became_peered":"2023-08-10T10:48:42.582869+0000","last_unstale":"2023-08-10T10:49:12.712953+0000","last_undegraded":"2023-08-10T10:49:12.712953+0000","last_fullsized":"2023-08-10T10:49:12.712953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:25:22.404203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713733+0000","last_change":"2023-08-10T10:48:46.629285+0000","last_active":"2023-08-10T10:49:12.713733+0000","last_peered":"2023-08-10T10:49:12.713733+0000","last_clean":"2023-08-10T10:49:12.713733+0000","last_became_active":"2023-08-10T10:48:46.628849+0000","last_became_peered":"2023-08-10T10:48:46.628849+0000","last_unstale":"2023-08-10T10:49:12.713733+0000","last_undegraded":"2023-08-10T10:49:12.713733+0000","last_fullsized":"2023-08-10T10:49:12.713733+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:19.082444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.737661+0000","last_change":"2023-08-10T10:48:41.592802+0000","last_active":"2023-08-10T10:49:12.737661+0000","last_peered":"2023-08-10T10:49:12.737661+0000","last_clean":"2023-08-10T10:49:12.737661+0000","last_became_active":"2023-08-10T10:48:41.592443+0000","last_became_peered":"2023-08-10T10:48:41.592443+0000","last_unstale":"2023-08-10T10:49:12.737661+0000","last_undegraded":"2023-08-10T10:49:12.737661+0000","last_fullsized":"2023-08-10T10:49:12.737661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:29:59.847912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718046+0000","last_change":"2023-08-10T10:48:42.586447+0000","last_active":"2023-08-10T10:49:12.718046+0000","last_peered":"2023-08-10T10:49:12.718046+0000","last_clean":"2023-08-10T10:49:12.718046+0000","last_became_active":"2023-08-10T10:48:42.586138+0000","last_became_peered":"2023-08-10T10:48:42.586138+0000","last_unstale":"2023-08-10T10:49:12.718046+0000","last_undegraded":"2023-08-10T10:49:12.718046+0000","last_fullsized":"2023-08-10T10:49:12.718046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:46.349690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733732+0000","last_change":"2023-08-10T10:49:12.732915+0000","last_active":"2023-08-10T10:49:12.733732+0000","last_peered":"2023-08-10T10:49:12.733732+0000","last_clean":"2023-08-10T10:49:12.733732+0000","last_became_active":"2023-08-10T10:49:12.732428+0000","last_became_peered":"2023-08-10T10:49:12.732428+0000","last_unstale":"2023-08-10T10:49:12.733732+0000","last_undegraded":"2023-08-10T10:49:12.733732+0000","last_fullsized":"2023-08-10T10:49:12.733732+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:48.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707375+0000","last_change":"2023-08-10T10:48:41.588502+0000","last_active":"2023-08-10T10:49:12.707375+0000","last_peered":"2023-08-10T10:49:12.707375+0000","last_clean":"2023-08-10T10:49:12.707375+0000","last_became_active":"2023-08-10T10:48:41.588155+0000","last_became_peered":"2023-08-10T10:48:41.588155+0000","last_unstale":"2023-08-10T10:49:12.707375+0000","last_undegraded":"2023-08-10T10:49:12.707375+0000","last_fullsized":"2023-08-10T10:49:12.707375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:03.041234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717532+0000","last_change":"2023-08-10T10:48:42.578175+0000","last_active":"2023-08-10T10:49:12.717532+0000","last_peered":"2023-08-10T10:49:12.717532+0000","last_clean":"2023-08-10T10:49:12.717532+0000","last_became_active":"2023-08-10T10:48:42.577873+0000","last_became_peered":"2023-08-10T10:48:42.577873+0000","last_unstale":"2023-08-10T10:49:12.717532+0000","last_undegraded":"2023-08-10T10:49:12.717532+0000","last_fullsized":"2023-08-10T10:49:12.717532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:00:20.738100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719745+0000","last_change":"2023-08-10T10:49:12.719745+0000","last_active":"2023-08-10T10:49:12.719745+0000","last_peered":"2023-08-10T10:49:12.719745+0000","last_clean":"2023-08-10T10:49:12.719745+0000","last_became_active":"2023-08-10T10:49:12.719289+0000","last_became_peered":"2023-08-10T10:49:12.719289+0000","last_unstale":"2023-08-10T10:49:12.719745+0000","last_undegraded":"2023-08-10T10:49:12.719745+0000","last_fullsized":"2023-08-10T10:49:12.719745+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:06.026574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627774+0000","last_change":"2023-08-10T10:48:41.594170+0000","last_active":"2023-08-10T10:49:14.627774+0000","last_peered":"2023-08-10T10:49:14.627774+0000","last_clean":"2023-08-10T10:49:14.627774+0000","last_became_active":"2023-08-10T10:48:41.593776+0000","last_became_peered":"2023-08-10T10:48:41.593776+0000","last_unstale":"2023-08-10T10:49:14.627774+0000","last_undegraded":"2023-08-10T10:49:14.627774+0000","last_fullsized":"2023-08-10T10:49:14.627774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:58:00.968178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730226+0000","last_change":"2023-08-10T10:48:42.589149+0000","last_active":"2023-08-10T10:49:12.730226+0000","last_peered":"2023-08-10T10:49:12.730226+0000","last_clean":"2023-08-10T10:49:12.730226+0000","last_became_active":"2023-08-10T10:48:42.588466+0000","last_became_peered":"2023-08-10T10:48:42.588466+0000","last_unstale":"2023-08-10T10:49:12.730226+0000","last_undegraded":"2023-08-10T10:49:12.730226+0000","last_fullsized":"2023-08-10T10:49:12.730226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:16:06.271764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730078+0000","last_change":"2023-08-10T10:48:46.629070+0000","last_active":"2023-08-10T10:49:12.730078+0000","last_peered":"2023-08-10T10:49:12.730078+0000","last_clean":"2023-08-10T10:49:12.730078+0000","last_became_active":"2023-08-10T10:48:46.626045+0000","last_became_peered":"2023-08-10T10:48:46.626045+0000","last_unstale":"2023-08-10T10:49:12.730078+0000","last_undegraded":"2023-08-10T10:49:12.730078+0000","last_fullsized":"2023-08-10T10:49:12.730078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:07:15.985024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712622+0000","last_change":"2023-08-10T10:48:41.590670+0000","last_active":"2023-08-10T10:49:12.712622+0000","last_peered":"2023-08-10T10:49:12.712622+0000","last_clean":"2023-08-10T10:49:12.712622+0000","last_became_active":"2023-08-10T10:48:41.589958+0000","last_became_peered":"2023-08-10T10:48:41.589958+0000","last_unstale":"2023-08-10T10:49:12.712622+0000","last_undegraded":"2023-08-10T10:49:12.712622+0000","last_fullsized":"2023-08-10T10:49:12.712622+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:39:18.603399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714523+0000","last_change":"2023-08-10T10:48:42.581041+0000","last_active":"2023-08-10T10:49:12.714523+0000","last_peered":"2023-08-10T10:49:12.714523+0000","last_clean":"2023-08-10T10:49:12.714523+0000","last_became_active":"2023-08-10T10:48:42.580311+0000","last_became_peered":"2023-08-10T10:48:42.580311+0000","last_unstale":"2023-08-10T10:49:12.714523+0000","last_undegraded":"2023-08-10T10:49:12.714523+0000","last_fullsized":"2023-08-10T10:49:12.714523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:58:22.239730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712329+0000","last_change":"2023-08-10T10:48:46.907496+0000","last_active":"2023-08-10T10:49:12.712329+0000","last_peered":"2023-08-10T10:49:12.712329+0000","last_clean":"2023-08-10T10:49:12.712329+0000","last_became_active":"2023-08-10T10:48:46.907098+0000","last_became_peered":"2023-08-10T10:48:46.907098+0000","last_unstale":"2023-08-10T10:49:12.712329+0000","last_undegraded":"2023-08-10T10:49:12.712329+0000","last_fullsized":"2023-08-10T10:49:12.712329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:32.578901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708694+0000","last_change":"2023-08-10T10:48:41.585252+0000","last_active":"2023-08-10T10:49:12.708694+0000","last_peered":"2023-08-10T10:49:12.708694+0000","last_clean":"2023-08-10T10:49:12.708694+0000","last_became_active":"2023-08-10T10:48:41.583599+0000","last_became_peered":"2023-08-10T10:48:41.583599+0000","last_unstale":"2023-08-10T10:49:12.708694+0000","last_undegraded":"2023-08-10T10:49:12.708694+0000","last_fullsized":"2023-08-10T10:49:12.708694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:05.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711390+0000","last_change":"2023-08-10T10:48:42.581317+0000","last_active":"2023-08-10T10:49:12.711390+0000","last_peered":"2023-08-10T10:49:12.711390+0000","last_clean":"2023-08-10T10:49:12.711390+0000","last_became_active":"2023-08-10T10:48:42.581012+0000","last_became_peered":"2023-08-10T10:48:42.581012+0000","last_unstale":"2023-08-10T10:49:12.711390+0000","last_undegraded":"2023-08-10T10:49:12.711390+0000","last_fullsized":"2023-08-10T10:49:12.711390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:06.685943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713749+0000","last_change":"2023-08-10T10:48:46.623489+0000","last_active":"2023-08-10T10:49:12.713749+0000","last_peered":"2023-08-10T10:49:12.713749+0000","last_clean":"2023-08-10T10:49:12.713749+0000","last_became_active":"2023-08-10T10:48:46.621968+0000","last_became_peered":"2023-08-10T10:48:46.621968+0000","last_unstale":"2023-08-10T10:49:12.713749+0000","last_undegraded":"2023-08-10T10:49:12.713749+0000","last_fullsized":"2023-08-10T10:49:12.713749+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:46:18.848816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718458+0000","last_change":"2023-08-10T10:48:41.579828+0000","last_active":"2023-08-10T10:49:12.718458+0000","last_peered":"2023-08-10T10:49:12.718458+0000","last_clean":"2023-08-10T10:49:12.718458+0000","last_became_active":"2023-08-10T10:48:41.579340+0000","last_became_peered":"2023-08-10T10:48:41.579340+0000","last_unstale":"2023-08-10T10:49:12.718458+0000","last_undegraded":"2023-08-10T10:49:12.718458+0000","last_fullsized":"2023-08-10T10:49:12.718458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:37.616654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733771+0000","last_change":"2023-08-10T10:49:12.733771+0000","last_active":"2023-08-10T10:49:12.733771+0000","last_peered":"2023-08-10T10:49:12.733771+0000","last_clean":"2023-08-10T10:49:12.733771+0000","last_became_active":"2023-08-10T10:49:12.733357+0000","last_became_peered":"2023-08-10T10:49:12.733357+0000","last_unstale":"2023-08-10T10:49:12.733771+0000","last_undegraded":"2023-08-10T10:49:12.733771+0000","last_fullsized":"2023-08-10T10:49:12.733771+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:42.675113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713322+0000","last_change":"2023-08-10T10:48:46.907982+0000","last_active":"2023-08-10T10:49:12.713322+0000","last_peered":"2023-08-10T10:49:12.713322+0000","last_clean":"2023-08-10T10:49:12.713322+0000","last_became_active":"2023-08-10T10:48:46.907184+0000","last_became_peered":"2023-08-10T10:48:46.907184+0000","last_unstale":"2023-08-10T10:49:12.713322+0000","last_undegraded":"2023-08-10T10:49:12.713322+0000","last_fullsized":"2023-08-10T10:49:12.713322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:10.496532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731622+0000","last_change":"2023-08-10T10:48:42.582808+0000","last_active":"2023-08-10T10:49:12.731622+0000","last_peered":"2023-08-10T10:49:12.731622+0000","last_clean":"2023-08-10T10:49:12.731622+0000","last_became_active":"2023-08-10T10:48:42.582517+0000","last_became_peered":"2023-08-10T10:48:42.582517+0000","last_unstale":"2023-08-10T10:49:12.731622+0000","last_undegraded":"2023-08-10T10:49:12.731622+0000","last_fullsized":"2023-08-10T10:49:12.731622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:03:17.102214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:16.652169+0000","last_change":"2023-08-10T10:48:41.594873+0000","last_active":"2023-08-10T10:49:16.652169+0000","last_peered":"2023-08-10T10:49:16.652169+0000","last_clean":"2023-08-10T10:49:16.652169+0000","last_became_active":"2023-08-10T10:48:41.594550+0000","last_became_peered":"2023-08-10T10:48:41.594550+0000","last_unstale":"2023-08-10T10:49:16.652169+0000","last_undegraded":"2023-08-10T10:49:16.652169+0000","last_fullsized":"2023-08-10T10:49:16.652169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:12.288533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718058+0000","last_change":"2023-08-10T10:48:46.626960+0000","last_active":"2023-08-10T10:49:12.718058+0000","last_peered":"2023-08-10T10:49:12.718058+0000","last_clean":"2023-08-10T10:49:12.718058+0000","last_became_active":"2023-08-10T10:48:46.626519+0000","last_became_peered":"2023-08-10T10:48:46.626519+0000","last_unstale":"2023-08-10T10:49:12.718058+0000","last_undegraded":"2023-08-10T10:49:12.718058+0000","last_fullsized":"2023-08-10T10:49:12.718058+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:12.352223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717207+0000","last_change":"2023-08-10T10:48:42.578921+0000","last_active":"2023-08-10T10:49:12.717207+0000","last_peered":"2023-08-10T10:49:12.717207+0000","last_clean":"2023-08-10T10:49:12.717207+0000","last_became_active":"2023-08-10T10:48:42.578322+0000","last_became_peered":"2023-08-10T10:48:42.578322+0000","last_unstale":"2023-08-10T10:49:12.717207+0000","last_undegraded":"2023-08-10T10:49:12.717207+0000","last_fullsized":"2023-08-10T10:49:12.717207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:39.453887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730667+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:49:12.730667+0000","last_peered":"2023-08-10T10:49:12.730667+0000","last_clean":"2023-08-10T10:49:12.730667+0000","last_became_active":"2023-08-10T10:48:41.585217+0000","last_became_peered":"2023-08-10T10:48:41.585217+0000","last_unstale":"2023-08-10T10:49:12.730667+0000","last_undegraded":"2023-08-10T10:49:12.730667+0000","last_fullsized":"2023-08-10T10:49:12.730667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:01:10.279255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":357,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717157+0000","last_change":"2023-08-10T10:47:22.594211+0000","last_active":"2023-08-10T10:49:12.717157+0000","last_peered":"2023-08-10T10:49:12.717157+0000","last_clean":"2023-08-10T10:49:12.717157+0000","last_became_active":"2023-08-10T10:47:22.593742+0000","last_became_peered":"2023-08-10T10:47:22.593742+0000","last_unstale":"2023-08-10T10:49:12.717157+0000","last_undegraded":"2023-08-10T10:49:12.717157+0000","last_fullsized":"2023-08-10T10:49:12.717157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_clean_scrub_stamp":"2023-08-10T10:43:44.512037+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:23.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730745+0000","last_change":"2023-08-10T10:48:46.907769+0000","last_active":"2023-08-10T10:49:12.730745+0000","last_peered":"2023-08-10T10:49:12.730745+0000","last_clean":"2023-08-10T10:49:12.730745+0000","last_became_active":"2023-08-10T10:48:46.907241+0000","last_became_peered":"2023-08-10T10:48:46.907241+0000","last_unstale":"2023-08-10T10:49:12.730745+0000","last_undegraded":"2023-08-10T10:49:12.730745+0000","last_fullsized":"2023-08-10T10:49:12.730745+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:37:49.077753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712543+0000","last_change":"2023-08-10T10:48:42.587277+0000","last_active":"2023-08-10T10:49:12.712543+0000","last_peered":"2023-08-10T10:49:12.712543+0000","last_clean":"2023-08-10T10:49:12.712543+0000","last_became_active":"2023-08-10T10:48:42.586308+0000","last_became_peered":"2023-08-10T10:48:42.586308+0000","last_unstale":"2023-08-10T10:49:12.712543+0000","last_undegraded":"2023-08-10T10:49:12.712543+0000","last_fullsized":"2023-08-10T10:49:12.712543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:23.894942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'3","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.620570+0000","last_change":"2023-08-10T10:48:41.587116+0000","last_active":"2023-08-10T10:49:13.620570+0000","last_peered":"2023-08-10T10:49:13.620570+0000","last_clean":"2023-08-10T10:49:13.620570+0000","last_became_active":"2023-08-10T10:48:41.586771+0000","last_became_peered":"2023-08-10T10:48:41.586771+0000","last_unstale":"2023-08-10T10:49:13.620570+0000","last_undegraded":"2023-08-10T10:49:13.620570+0000","last_fullsized":"2023-08-10T10:49:13.620570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:30.371131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714841+0000","last_change":"2023-08-10T10:48:46.625140+0000","last_active":"2023-08-10T10:49:12.714841+0000","last_peered":"2023-08-10T10:49:12.714841+0000","last_clean":"2023-08-10T10:49:12.714841+0000","last_became_active":"2023-08-10T10:48:46.624615+0000","last_became_peered":"2023-08-10T10:48:46.624615+0000","last_unstale":"2023-08-10T10:49:12.714841+0000","last_undegraded":"2023-08-10T10:49:12.714841+0000","last_fullsized":"2023-08-10T10:49:12.714841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:42.063440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627974+0000","last_change":"2023-08-10T10:48:41.589435+0000","last_active":"2023-08-10T10:49:14.627974+0000","last_peered":"2023-08-10T10:49:14.627974+0000","last_clean":"2023-08-10T10:49:14.627974+0000","last_became_active":"2023-08-10T10:48:41.589070+0000","last_became_peered":"2023-08-10T10:48:41.589070+0000","last_unstale":"2023-08-10T10:49:14.627974+0000","last_undegraded":"2023-08-10T10:49:14.627974+0000","last_fullsized":"2023-08-10T10:49:14.627974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:22:03.215196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713488+0000","last_change":"2023-08-10T10:48:42.586352+0000","last_active":"2023-08-10T10:49:12.713488+0000","last_peered":"2023-08-10T10:49:12.713488+0000","last_clean":"2023-08-10T10:49:12.713488+0000","last_became_active":"2023-08-10T10:48:42.585955+0000","last_became_peered":"2023-08-10T10:48:42.585955+0000","last_unstale":"2023-08-10T10:49:12.713488+0000","last_undegraded":"2023-08-10T10:49:12.713488+0000","last_fullsized":"2023-08-10T10:49:12.713488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:45.529054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717201+0000","last_change":"2023-08-10T10:48:46.907519+0000","last_active":"2023-08-10T10:49:12.717201+0000","last_peered":"2023-08-10T10:49:12.717201+0000","last_clean":"2023-08-10T10:49:12.717201+0000","last_became_active":"2023-08-10T10:48:46.907087+0000","last_became_peered":"2023-08-10T10:48:46.907087+0000","last_unstale":"2023-08-10T10:49:12.717201+0000","last_undegraded":"2023-08-10T10:49:12.717201+0000","last_fullsized":"2023-08-10T10:49:12.717201+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:03.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709427+0000","last_change":"2023-08-10T10:48:41.583746+0000","last_active":"2023-08-10T10:49:12.709427+0000","last_peered":"2023-08-10T10:49:12.709427+0000","last_clean":"2023-08-10T10:49:12.709427+0000","last_became_active":"2023-08-10T10:48:41.583321+0000","last_became_peered":"2023-08-10T10:48:41.583321+0000","last_unstale":"2023-08-10T10:49:12.709427+0000","last_undegraded":"2023-08-10T10:49:12.709427+0000","last_fullsized":"2023-08-10T10:49:12.709427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:53:25.620711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717495+0000","last_change":"2023-08-10T10:48:42.579942+0000","last_active":"2023-08-10T10:49:12.717495+0000","last_peered":"2023-08-10T10:49:12.717495+0000","last_clean":"2023-08-10T10:49:12.717495+0000","last_became_active":"2023-08-10T10:48:42.579561+0000","last_became_peered":"2023-08-10T10:48:42.579561+0000","last_unstale":"2023-08-10T10:49:12.717495+0000","last_undegraded":"2023-08-10T10:49:12.717495+0000","last_fullsized":"2023-08-10T10:49:12.717495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:22.447394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718242+0000","last_change":"2023-08-10T10:48:46.621499+0000","last_active":"2023-08-10T10:49:12.718242+0000","last_peered":"2023-08-10T10:49:12.718242+0000","last_clean":"2023-08-10T10:49:12.718242+0000","last_became_active":"2023-08-10T10:48:46.621076+0000","last_became_peered":"2023-08-10T10:48:46.621076+0000","last_unstale":"2023-08-10T10:49:12.718242+0000","last_undegraded":"2023-08-10T10:49:12.718242+0000","last_fullsized":"2023-08-10T10:49:12.718242+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:34.844650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'4","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731194+0000","last_change":"2023-08-10T10:48:41.585574+0000","last_active":"2023-08-10T10:49:12.731194+0000","last_peered":"2023-08-10T10:49:12.731194+0000","last_clean":"2023-08-10T10:49:12.731194+0000","last_became_active":"2023-08-10T10:48:41.585254+0000","last_became_peered":"2023-08-10T10:48:41.585254+0000","last_unstale":"2023-08-10T10:49:12.731194+0000","last_undegraded":"2023-08-10T10:49:12.731194+0000","last_fullsized":"2023-08-10T10:49:12.731194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:25:52.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731219+0000","last_change":"2023-08-10T10:48:42.584003+0000","last_active":"2023-08-10T10:49:12.731219+0000","last_peered":"2023-08-10T10:49:12.731219+0000","last_clean":"2023-08-10T10:49:12.731219+0000","last_became_active":"2023-08-10T10:48:42.583712+0000","last_became_peered":"2023-08-10T10:48:42.583712+0000","last_unstale":"2023-08-10T10:49:12.731219+0000","last_undegraded":"2023-08-10T10:49:12.731219+0000","last_fullsized":"2023-08-10T10:49:12.731219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:52.543954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707184+0000","last_change":"2023-08-10T10:48:46.908113+0000","last_active":"2023-08-10T10:49:12.707184+0000","last_peered":"2023-08-10T10:49:12.707184+0000","last_clean":"2023-08-10T10:49:12.707184+0000","last_became_active":"2023-08-10T10:48:46.907552+0000","last_became_peered":"2023-08-10T10:48:46.907552+0000","last_unstale":"2023-08-10T10:49:12.707184+0000","last_undegraded":"2023-08-10T10:49:12.707184+0000","last_fullsized":"2023-08-10T10:49:12.707184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:48:47.326917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.732470+0000","last_change":"2023-08-10T10:48:41.584254+0000","last_active":"2023-08-10T10:49:12.732470+0000","last_peered":"2023-08-10T10:49:12.732470+0000","last_clean":"2023-08-10T10:49:12.732470+0000","last_became_active":"2023-08-10T10:48:41.583129+0000","last_became_peered":"2023-08-10T10:48:41.583129+0000","last_unstale":"2023-08-10T10:49:12.732470+0000","last_undegraded":"2023-08-10T10:49:12.732470+0000","last_fullsized":"2023-08-10T10:49:12.732470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:23.183495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712107+0000","last_change":"2023-08-10T10:48:42.582264+0000","last_active":"2023-08-10T10:49:12.712107+0000","last_peered":"2023-08-10T10:49:12.712107+0000","last_clean":"2023-08-10T10:49:12.712107+0000","last_became_active":"2023-08-10T10:48:42.581542+0000","last_became_peered":"2023-08-10T10:48:42.581542+0000","last_unstale":"2023-08-10T10:49:12.712107+0000","last_undegraded":"2023-08-10T10:49:12.712107+0000","last_fullsized":"2023-08-10T10:49:12.712107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:30:57.631202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709384+0000","last_change":"2023-08-10T10:48:46.632019+0000","last_active":"2023-08-10T10:49:12.709384+0000","last_peered":"2023-08-10T10:49:12.709384+0000","last_clean":"2023-08-10T10:49:12.709384+0000","last_became_active":"2023-08-10T10:48:46.631510+0000","last_became_peered":"2023-08-10T10:48:46.631510+0000","last_unstale":"2023-08-10T10:49:12.709384+0000","last_undegraded":"2023-08-10T10:49:12.709384+0000","last_fullsized":"2023-08-10T10:49:12.709384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:55.720402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635631+0000","last_change":"2023-08-10T10:48:41.591206+0000","last_active":"2023-08-10T10:49:15.635631+0000","last_peered":"2023-08-10T10:49:15.635631+0000","last_clean":"2023-08-10T10:49:15.635631+0000","last_became_active":"2023-08-10T10:48:41.590897+0000","last_became_peered":"2023-08-10T10:48:41.590897+0000","last_unstale":"2023-08-10T10:49:15.635631+0000","last_undegraded":"2023-08-10T10:49:15.635631+0000","last_fullsized":"2023-08-10T10:49:15.635631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:30.418971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713681+0000","last_change":"2023-08-10T10:48:42.586470+0000","last_active":"2023-08-10T10:49:12.713681+0000","last_peered":"2023-08-10T10:49:12.713681+0000","last_clean":"2023-08-10T10:49:12.713681+0000","last_became_active":"2023-08-10T10:48:42.586109+0000","last_became_peered":"2023-08-10T10:48:42.586109+0000","last_unstale":"2023-08-10T10:49:12.713681+0000","last_undegraded":"2023-08-10T10:49:12.713681+0000","last_fullsized":"2023-08-10T10:49:12.713681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:12.453665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707246+0000","last_change":"2023-08-10T10:48:46.629886+0000","last_active":"2023-08-10T10:49:12.707246+0000","last_peered":"2023-08-10T10:49:12.707246+0000","last_clean":"2023-08-10T10:49:12.707246+0000","last_became_active":"2023-08-10T10:48:46.629403+0000","last_became_peered":"2023-08-10T10:48:46.629403+0000","last_unstale":"2023-08-10T10:49:12.707246+0000","last_undegraded":"2023-08-10T10:49:12.707246+0000","last_fullsized":"2023-08-10T10:49:12.707246+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:11.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718868+0000","last_change":"2023-08-10T10:48:41.593231+0000","last_active":"2023-08-10T10:49:12.718868+0000","last_peered":"2023-08-10T10:49:12.718868+0000","last_clean":"2023-08-10T10:49:12.718868+0000","last_became_active":"2023-08-10T10:48:41.592893+0000","last_became_peered":"2023-08-10T10:48:41.592893+0000","last_unstale":"2023-08-10T10:49:12.718868+0000","last_undegraded":"2023-08-10T10:49:12.718868+0000","last_fullsized":"2023-08-10T10:49:12.718868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:41.661067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.734525+0000","last_change":"2023-08-10T10:49:12.732774+0000","last_active":"2023-08-10T10:49:12.734525+0000","last_peered":"2023-08-10T10:49:12.734525+0000","last_clean":"2023-08-10T10:49:12.734525+0000","last_became_active":"2023-08-10T10:49:12.732277+0000","last_became_peered":"2023-08-10T10:49:12.732277+0000","last_unstale":"2023-08-10T10:49:12.734525+0000","last_undegraded":"2023-08-10T10:49:12.734525+0000","last_fullsized":"2023-08-10T10:49:12.734525+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:06.334205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707420+0000","last_change":"2023-08-10T10:48:46.908347+0000","last_active":"2023-08-10T10:49:12.707420+0000","last_peered":"2023-08-10T10:49:12.707420+0000","last_clean":"2023-08-10T10:49:12.707420+0000","last_became_active":"2023-08-10T10:48:46.907266+0000","last_became_peered":"2023-08-10T10:48:46.907266+0000","last_unstale":"2023-08-10T10:49:12.707420+0000","last_undegraded":"2023-08-10T10:49:12.707420+0000","last_fullsized":"2023-08-10T10:49:12.707420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:52.767489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.734388+0000","last_change":"2023-08-10T10:48:41.585055+0000","last_active":"2023-08-10T10:49:12.734388+0000","last_peered":"2023-08-10T10:49:12.734388+0000","last_clean":"2023-08-10T10:49:12.734388+0000","last_became_active":"2023-08-10T10:48:41.584676+0000","last_became_peered":"2023-08-10T10:48:41.584676+0000","last_unstale":"2023-08-10T10:49:12.734388+0000","last_undegraded":"2023-08-10T10:49:12.734388+0000","last_fullsized":"2023-08-10T10:49:12.734388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:14:29.461100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718623+0000","last_change":"2023-08-10T10:48:42.586764+0000","last_active":"2023-08-10T10:49:12.718623+0000","last_peered":"2023-08-10T10:49:12.718623+0000","last_clean":"2023-08-10T10:49:12.718623+0000","last_became_active":"2023-08-10T10:48:42.586177+0000","last_became_peered":"2023-08-10T10:48:42.586177+0000","last_unstale":"2023-08-10T10:49:12.718623+0000","last_undegraded":"2023-08-10T10:49:12.718623+0000","last_fullsized":"2023-08-10T10:49:12.718623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:34.472956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707294+0000","last_change":"2023-08-10T10:48:46.626872+0000","last_active":"2023-08-10T10:49:12.707294+0000","last_peered":"2023-08-10T10:49:12.707294+0000","last_clean":"2023-08-10T10:49:12.707294+0000","last_became_active":"2023-08-10T10:48:46.626354+0000","last_became_peered":"2023-08-10T10:48:46.626354+0000","last_unstale":"2023-08-10T10:49:12.707294+0000","last_undegraded":"2023-08-10T10:49:12.707294+0000","last_fullsized":"2023-08-10T10:49:12.707294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:10:12.332212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719235+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:49:12.719235+0000","last_peered":"2023-08-10T10:49:12.719235+0000","last_clean":"2023-08-10T10:49:12.719235+0000","last_became_active":"2023-08-10T10:48:41.586311+0000","last_became_peered":"2023-08-10T10:48:41.586311+0000","last_unstale":"2023-08-10T10:49:12.719235+0000","last_undegraded":"2023-08-10T10:49:12.719235+0000","last_fullsized":"2023-08-10T10:49:12.719235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:57.983205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718513+0000","last_change":"2023-08-10T10:48:42.577290+0000","last_active":"2023-08-10T10:49:12.718513+0000","last_peered":"2023-08-10T10:49:12.718513+0000","last_clean":"2023-08-10T10:49:12.718513+0000","last_became_active":"2023-08-10T10:48:42.576928+0000","last_became_peered":"2023-08-10T10:48:42.576928+0000","last_unstale":"2023-08-10T10:49:12.718513+0000","last_undegraded":"2023-08-10T10:49:12.718513+0000","last_fullsized":"2023-08-10T10:49:12.718513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:20.491056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730204+0000","last_change":"2023-08-10T10:48:46.627842+0000","last_active":"2023-08-10T10:49:12.730204+0000","last_peered":"2023-08-10T10:49:12.730204+0000","last_clean":"2023-08-10T10:49:12.730204+0000","last_became_active":"2023-08-10T10:48:46.627472+0000","last_became_peered":"2023-08-10T10:48:46.627472+0000","last_unstale":"2023-08-10T10:49:12.730204+0000","last_undegraded":"2023-08-10T10:49:12.730204+0000","last_fullsized":"2023-08-10T10:49:12.730204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:23.103275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.606352+0000","last_change":"2023-08-10T10:48:41.592742+0000","last_active":"2023-08-10T10:49:13.606352+0000","last_peered":"2023-08-10T10:49:13.606352+0000","last_clean":"2023-08-10T10:49:13.606352+0000","last_became_active":"2023-08-10T10:48:41.592409+0000","last_became_peered":"2023-08-10T10:48:41.592409+0000","last_unstale":"2023-08-10T10:49:13.606352+0000","last_undegraded":"2023-08-10T10:49:13.606352+0000","last_fullsized":"2023-08-10T10:49:13.606352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:38:45.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717859+0000","last_change":"2023-08-10T10:48:42.583444+0000","last_active":"2023-08-10T10:49:12.717859+0000","last_peered":"2023-08-10T10:49:12.717859+0000","last_clean":"2023-08-10T10:49:12.717859+0000","last_became_active":"2023-08-10T10:48:42.583073+0000","last_became_peered":"2023-08-10T10:48:42.583073+0000","last_unstale":"2023-08-10T10:49:12.717859+0000","last_undegraded":"2023-08-10T10:49:12.717859+0000","last_fullsized":"2023-08-10T10:49:12.717859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:40.712897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730483+0000","last_change":"2023-08-10T10:48:46.626340+0000","last_active":"2023-08-10T10:49:12.730483+0000","last_peered":"2023-08-10T10:49:12.730483+0000","last_clean":"2023-08-10T10:49:12.730483+0000","last_became_active":"2023-08-10T10:48:46.625867+0000","last_became_peered":"2023-08-10T10:48:46.625867+0000","last_unstale":"2023-08-10T10:49:12.730483+0000","last_undegraded":"2023-08-10T10:49:12.730483+0000","last_fullsized":"2023-08-10T10:49:12.730483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:50:35.707438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635911+0000","last_change":"2023-08-10T10:48:41.590734+0000","last_active":"2023-08-10T10:49:15.635911+0000","last_peered":"2023-08-10T10:49:15.635911+0000","last_clean":"2023-08-10T10:49:15.635911+0000","last_became_active":"2023-08-10T10:48:41.590433+0000","last_became_peered":"2023-08-10T10:48:41.590433+0000","last_unstale":"2023-08-10T10:49:15.635911+0000","last_undegraded":"2023-08-10T10:49:15.635911+0000","last_fullsized":"2023-08-10T10:49:15.635911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:07.269605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718071+0000","last_change":"2023-08-10T10:48:42.576628+0000","last_active":"2023-08-10T10:49:12.718071+0000","last_peered":"2023-08-10T10:49:12.718071+0000","last_clean":"2023-08-10T10:49:12.718071+0000","last_became_active":"2023-08-10T10:48:42.576285+0000","last_became_peered":"2023-08-10T10:48:42.576285+0000","last_unstale":"2023-08-10T10:49:12.718071+0000","last_undegraded":"2023-08-10T10:49:12.718071+0000","last_fullsized":"2023-08-10T10:49:12.718071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:36.534268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713896+0000","last_change":"2023-08-10T10:48:42.579615+0000","last_active":"2023-08-10T10:49:12.713896+0000","last_peered":"2023-08-10T10:49:12.713896+0000","last_clean":"2023-08-10T10:49:12.713896+0000","last_became_active":"2023-08-10T10:48:42.579291+0000","last_became_peered":"2023-08-10T10:48:42.579291+0000","last_unstale":"2023-08-10T10:49:12.713896+0000","last_undegraded":"2023-08-10T10:49:12.713896+0000","last_fullsized":"2023-08-10T10:49:12.713896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:20.879001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718573+0000","last_change":"2023-08-10T10:48:42.581358+0000","last_active":"2023-08-10T10:49:12.718573+0000","last_peered":"2023-08-10T10:49:12.718573+0000","last_clean":"2023-08-10T10:49:12.718573+0000","last_became_active":"2023-08-10T10:48:42.580942+0000","last_became_peered":"2023-08-10T10:48:42.580942+0000","last_unstale":"2023-08-10T10:49:12.718573+0000","last_undegraded":"2023-08-10T10:49:12.718573+0000","last_fullsized":"2023-08-10T10:49:12.718573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:45.675996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718718+0000","last_change":"2023-08-10T10:48:42.574494+0000","last_active":"2023-08-10T10:49:12.718718+0000","last_peered":"2023-08-10T10:49:12.718718+0000","last_clean":"2023-08-10T10:49:12.718718+0000","last_became_active":"2023-08-10T10:48:42.574203+0000","last_became_peered":"2023-08-10T10:48:42.574203+0000","last_unstale":"2023-08-10T10:49:12.718718+0000","last_undegraded":"2023-08-10T10:49:12.718718+0000","last_fullsized":"2023-08-10T10:49:12.718718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:10:10.406920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731545+0000","last_change":"2023-08-10T10:48:42.587557+0000","last_active":"2023-08-10T10:49:12.731545+0000","last_peered":"2023-08-10T10:49:12.731545+0000","last_clean":"2023-08-10T10:49:12.731545+0000","last_became_active":"2023-08-10T10:48:42.587133+0000","last_became_peered":"2023-08-10T10:48:42.587133+0000","last_unstale":"2023-08-10T10:49:12.731545+0000","last_undegraded":"2023-08-10T10:49:12.731545+0000","last_fullsized":"2023-08-10T10:49:12.731545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:45:35.005412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713339+0000","last_change":"2023-08-10T10:48:42.587283+0000","last_active":"2023-08-10T10:49:12.713339+0000","last_peered":"2023-08-10T10:49:12.713339+0000","last_clean":"2023-08-10T10:49:12.713339+0000","last_became_active":"2023-08-10T10:48:42.586118+0000","last_became_peered":"2023-08-10T10:48:42.586118+0000","last_unstale":"2023-08-10T10:49:12.713339+0000","last_undegraded":"2023-08-10T10:49:12.713339+0000","last_fullsized":"2023-08-10T10:49:12.713339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:10:50.868060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715015+0000","last_change":"2023-08-10T10:48:42.580843+0000","last_active":"2023-08-10T10:49:12.715015+0000","last_peered":"2023-08-10T10:49:12.715015+0000","last_clean":"2023-08-10T10:49:12.715015+0000","last_became_active":"2023-08-10T10:48:42.579735+0000","last_became_peered":"2023-08-10T10:48:42.579735+0000","last_unstale":"2023-08-10T10:49:12.715015+0000","last_undegraded":"2023-08-10T10:49:12.715015+0000","last_fullsized":"2023-08-10T10:49:12.715015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:24.025912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717927+0000","last_change":"2023-08-10T10:48:42.580250+0000","last_active":"2023-08-10T10:49:12.717927+0000","last_peered":"2023-08-10T10:49:12.717927+0000","last_clean":"2023-08-10T10:49:12.717927+0000","last_became_active":"2023-08-10T10:48:42.579962+0000","last_became_peered":"2023-08-10T10:48:42.579962+0000","last_unstale":"2023-08-10T10:49:12.717927+0000","last_undegraded":"2023-08-10T10:49:12.717927+0000","last_fullsized":"2023-08-10T10:49:12.717927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:03:04.269405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717788+0000","last_change":"2023-08-10T10:48:42.582699+0000","last_active":"2023-08-10T10:49:12.717788+0000","last_peered":"2023-08-10T10:49:12.717788+0000","last_clean":"2023-08-10T10:49:12.717788+0000","last_became_active":"2023-08-10T10:48:42.582426+0000","last_became_peered":"2023-08-10T10:48:42.582426+0000","last_unstale":"2023-08-10T10:49:12.717788+0000","last_undegraded":"2023-08-10T10:49:12.717788+0000","last_fullsized":"2023-08-10T10:49:12.717788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:40.237741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731459+0000","last_change":"2023-08-10T10:48:42.577483+0000","last_active":"2023-08-10T10:49:12.731459+0000","last_peered":"2023-08-10T10:49:12.731459+0000","last_clean":"2023-08-10T10:49:12.731459+0000","last_became_active":"2023-08-10T10:48:42.577195+0000","last_became_peered":"2023-08-10T10:48:42.577195+0000","last_unstale":"2023-08-10T10:49:12.731459+0000","last_undegraded":"2023-08-10T10:49:12.731459+0000","last_fullsized":"2023-08-10T10:49:12.731459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:59:56.657695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717888+0000","last_change":"2023-08-10T10:48:42.581129+0000","last_active":"2023-08-10T10:49:12.717888+0000","last_peered":"2023-08-10T10:49:12.717888+0000","last_clean":"2023-08-10T10:49:12.717888+0000","last_became_active":"2023-08-10T10:48:42.579350+0000","last_became_peered":"2023-08-10T10:48:42.579350+0000","last_unstale":"2023-08-10T10:49:12.717888+0000","last_undegraded":"2023-08-10T10:49:12.717888+0000","last_fullsized":"2023-08-10T10:49:12.717888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:27.669242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707581+0000","last_change":"2023-08-10T10:48:42.578167+0000","last_active":"2023-08-10T10:49:12.707581+0000","last_peered":"2023-08-10T10:49:12.707581+0000","last_clean":"2023-08-10T10:49:12.707581+0000","last_became_active":"2023-08-10T10:48:42.577571+0000","last_became_peered":"2023-08-10T10:48:42.577571+0000","last_unstale":"2023-08-10T10:49:12.707581+0000","last_undegraded":"2023-08-10T10:49:12.707581+0000","last_fullsized":"2023-08-10T10:49:12.707581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:54:14.264193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712579+0000","last_change":"2023-08-10T10:48:42.587207+0000","last_active":"2023-08-10T10:49:12.712579+0000","last_peered":"2023-08-10T10:49:12.712579+0000","last_clean":"2023-08-10T10:49:12.712579+0000","last_became_active":"2023-08-10T10:48:42.586848+0000","last_became_peered":"2023-08-10T10:48:42.586848+0000","last_unstale":"2023-08-10T10:49:12.712579+0000","last_undegraded":"2023-08-10T10:49:12.712579+0000","last_fullsized":"2023-08-10T10:49:12.712579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:34:50.994727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714173+0000","last_change":"2023-08-10T10:48:42.580785+0000","last_active":"2023-08-10T10:49:12.714173+0000","last_peered":"2023-08-10T10:49:12.714173+0000","last_clean":"2023-08-10T10:49:12.714173+0000","last_became_active":"2023-08-10T10:48:42.580395+0000","last_became_peered":"2023-08-10T10:48:42.580395+0000","last_unstale":"2023-08-10T10:49:12.714173+0000","last_undegraded":"2023-08-10T10:49:12.714173+0000","last_fullsized":"2023-08-10T10:49:12.714173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:17:41.679781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250142,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7552,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":149,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":61329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383700,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":496767,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.75}]},{"osd":1,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.622},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.996}]},{"osd":6,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1659999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":9,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.071}]},{"osd":10,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.095}]}]},{"osd":10,"up_from":72,"seq":309237645337,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1090342,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.624}]},{"osd":3,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.53000000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.92500000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.96399999999999997}]},{"osd":11,"last update":"Thu Aug 10 10:48:46 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.028},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0069999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808862,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":486613,"data_compressed":14619,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.436},{"interface":"front","average":{"1min":0.501,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79200000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83199999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.84599999999999997,"15min":0.88300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90800000000000003,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.501,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.83199999999999996,"5min":1.077,"15min":1.077},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.48599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0049999999999999,"5min":1.167,"15min":1.167},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98699999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.502}]},{"osd":4,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.873,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.82499999999999996,"15min":0.84899999999999998},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88700000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.83999999999999997,"15min":0.86099999999999999},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.92100000000000004,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.84799999999999998,"15min":0.86699999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92000000000000004,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.081}]},{"osd":7,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.88600000000000001,"15min":0.91200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":1.607,"15min":1.607},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.871,"15min":0.89000000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.92200000000000004,"5min":1.236,"15min":1.236},"last":0.74399999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1899999999999999,"5min":1.319,"15min":1.319},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.93200000000000005,"15min":0.95599999999999996},"min":{"1min":0.57799999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0149999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Thu Aug 10 10:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.95299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]},{"osd":8,"up_from":59,"seq":253403070500,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":495962,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86399999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95399999999999996,"5min":1.079,"15min":1.079},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.748,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.65700000000000003,"15min":0.67400000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94199999999999995,"5min":1.103,"15min":1.103},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.90700000000000003,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91200000000000003,"5min":1.113,"15min":1.113},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.502,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.115,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.83299999999999996,"15min":0.84699999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96799999999999997,"5min":1.238,"15min":1.238},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.85399999999999998,"15min":0.87},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.98599999999999999,"5min":1.214,"15min":1.214},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79300000000000004,"15min":0.81799999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0640000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.79700000000000004,"15min":0.82599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0049999999999999,"5min":1.236,"15min":1.236},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.875,"15min":0.89600000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1359999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.028},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":0.91900000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.92700000000000005,"15min":0.94799999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1759999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0309999999999999,"5min":1.29,"15min":1.29},"last":1.014}]},{"osd":9,"last update":"Thu Aug 10 10:48:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1919999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88100000000000001,"15min":0.88300000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.341,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.995}]},{"osd":10,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":1.179},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.0489999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332136,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":1086748,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0489999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99299999999999999,"5min":1.466,"15min":1.466},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.82199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.81200000000000006,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88200000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65400000000000003,"15min":0.67100000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81299999999999994,"15min":0.82399999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.194,"15min":1.194},"last":0.754},{"interface":"front","average":{"1min":0.755,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0329999999999999,"5min":1.409,"15min":1.409},"last":0.98699999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:48:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.878,"15min":0.86899999999999999},"min":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.89100000000000001}]},{"osd":9,"last update":"Thu Aug 10 10:48:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.93300000000000005,"15min":0.95099999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.113,"5min":1.341,"15min":1.341},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1459999999999999,"5min":1.329,"15min":1.329},"last":1.0049999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495663,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":496229,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.435},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90600000000000003,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71999999999999997,"15min":0.70399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":1.077,"15min":1.077},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67300000000000004,"15min":0.68700000000000006},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":1.089,"15min":1.089},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1,"5min":1.173,"15min":1.173},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.62,"15min":0.64400000000000002},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.751},"min":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0509999999999999,"5min":1.258,"15min":1.258},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:48:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0149999999999999,"5min":1.139,"15min":1.139},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:49:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.95599999999999996,"5min":1.016,"15min":1.016},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98999999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.754}]},{"osd":8,"last update":"Thu Aug 10 10:48:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0549999999999999,"5min":1.056,"15min":1.056},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.075,"5min":1.101,"15min":1.101},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Aug 10 10:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.04,"5min":1.145,"15min":1.145},"last":0.87}]},{"osd":10,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.91300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":518434,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.61899999999999999,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60599999999999998,"15min":0.57399999999999995},"min":{"1min":0.433,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.65100000000000002,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.63800000000000001,"15min":0.58999999999999997},"min":{"1min":0.503,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91300000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.67000000000000004,"15min":0.63100000000000001},"min":{"1min":0.52400000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.68700000000000006,"15min":0.65100000000000002},"min":{"1min":0.59599999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1,"5min":1,"15min":1},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.47399999999999998},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.74199999999999999,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.72999999999999998,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:48:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.60699999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.1499999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.76000000000000001,"15min":0.73099999999999998},"min":{"1min":0.56399999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.052,"5min":1.268,"15min":1.268},"last":0.752}]},{"osd":7,"last update":"Thu Aug 10 10:49:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69499999999999995,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.80600000000000005,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.77800000000000002}]},{"osd":8,"last update":"Thu Aug 10 10:48:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.872,"15min":0.86799999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.83599999999999997,"15min":0.82899999999999996},"min":{"1min":0.63700000000000001,"5min":0.624,"15min":0.624},"max":{"1min":1.155,"5min":1.169,"15min":1.169},"last":0.83899999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:48:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.83699999999999997,"15min":0.83399999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.92600000000000005,"15min":0.92000000000000004},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.97399999999999998}]},{"osd":10,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.91000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":498075,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:48:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.60899999999999999,"15min":0.58899999999999997},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.624,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.56200000000000006,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.71199999999999997,"15min":0.70199999999999996},"min":{"1min":0.621,"5min":0.434,"15min":0.434},"max":{"1min":1.071,"5min":1.095,"15min":1.095},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.51100000000000001,"15min":0.49099999999999999},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.307},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.36399999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:48:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.502},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92900000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.52500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90700000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70999999999999996,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:48:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.57799999999999996},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84599999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59599999999999997,"15min":0.57499999999999996},"min":{"1min":0.38,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90400000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.437}]},{"osd":7,"last update":"Thu Aug 10 10:48:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.78400000000000003,"15min":0.77100000000000002},"min":{"1min":0.60599999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.55900000000000005}]},{"osd":8,"last update":"Thu Aug 10 10:48:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.98599999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83699999999999997,"15min":0.83899999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.80700000000000005}]},{"osd":9,"last update":"Thu Aug 10 10:48:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.56899999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0900000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.014,"5min":1.121,"15min":1.121},"last":0.46300000000000002}]},{"osd":10,"last update":"Thu Aug 10 10:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63700000000000001}]},{"osd":11,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.87},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.747}]}]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":498981,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61499999999999999,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:48:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65100000000000002,"15min":0.60699999999999998},"min":{"1min":0.47899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64700000000000002,"15min":0.60699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91400000000000003,"5min":1.052,"15min":1.052},"last":0.89700000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68700000000000006,"15min":0.68799999999999994},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.41399999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.67500000000000004,"15min":0.65900000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56299999999999994,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0189999999999999,"5min":1.488,"15min":1.488},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.57799999999999996,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92100000000000004,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:48:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70299999999999996,"15min":0.67900000000000005},"min":{"1min":0.51200000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":1.123,"15min":1.123},"last":1.04},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0029999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:48:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0169999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.01},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76800000000000002,"15min":0.76600000000000001},"min":{"1min":0.55400000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.0920000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:48:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.997,"15min":0.997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.05,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.075}]},{"osd":9,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.63100000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0249999999999999,"5min":1.177,"15min":1.177},"last":1.171}]},{"osd":10,"last update":"Thu Aug 10 10:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.1930000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":3,"up_from":25,"seq":107374182462,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":495654,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.42999999999999999,"15min":0.41299999999999998},"min":{"1min":0.34300000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70299999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45700000000000002,"15min":0.436},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59499999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65700000000000003,"15min":0.64300000000000002},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91000000000000003,"5min":1.133,"15min":1.133},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.47799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:48:21 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":0.73099999999999998,"15min":0.66500000000000004},"min":{"1min":0.503,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.367,"5min":6.367,"15min":6.367},"last":0.879},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.66500000000000004},"min":{"1min":0.48599999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.999,"5min":1.004,"15min":1.004},"last":0.88900000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.022,"15min":1.022},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.399,"5min":0.84199999999999997,"15min":0.73199999999999998},"min":{"1min":0.47799999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":6.2969999999999997,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.76500000000000001,"15min":0.71499999999999997},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85699999999999998,"5min":6.3410000000000002,"15min":6.3410000000000002},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.59499999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94299999999999995,"5min":1.054,"15min":1.054},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:48:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.65800000000000003,"15min":0.63100000000000001},"min":{"1min":0.49299999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.94399999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69599999999999995,"15min":0.70999999999999996},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.0820000000000001,"5min":1.095,"15min":1.095},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79400000000000004,"15min":0.76800000000000002},"min":{"1min":0.59299999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.032,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78400000000000003,"15min":0.754},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0249999999999999,"5min":1.327,"15min":1.327},"last":0.76300000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.04,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.85799999999999998},"min":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.0880000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.753}]},{"osd":9,"last update":"Thu Aug 10 10:48:54 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.85299999999999998,"15min":0.87},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97599999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82899999999999996,"15min":0.83799999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1279999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.81000000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:48:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.98299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]}]},{"osd":4,"up_from":33,"seq":141733920824,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":495577,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.77600000000000002,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.505,"15min":0.48599999999999999},"min":{"1min":0.36799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68500000000000005,"15min":0.68000000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69899999999999995,"15min":0.69499999999999995},"min":{"1min":0.503,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86799999999999999,"5min":1.421,"15min":1.421},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.752,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95399999999999996,"5min":1.377,"15min":1.377},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.59499999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91600000000000004,"5min":0.999,"15min":0.999},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:48:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.47199999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.753,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.004,"5min":1.089,"15min":1.089},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.006,"5min":1.071,"15min":1.071},"last":1.02},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.751,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.88900000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.86499999999999999,"15min":0.85799999999999998},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.056,"5min":1.135,"15min":1.135},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.75600000000000001,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.034,"5min":1.115,"15min":1.115},"last":1.044}]},{"osd":9,"last update":"Thu Aug 10 10:48:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.077,"5min":1.175,"15min":1.175},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.874,"15min":0.86899999999999999},"min":{"1min":0.73999999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.0960000000000001,"5min":1.161,"15min":1.161},"last":0.93100000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:48:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.111},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":1.1299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":5,"up_from":38,"seq":163208757300,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1060864,"data_stored":1087020,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.93500000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.44400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.92400000000000004,"5min":1.073,"15min":1.073},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.014,"15min":1.014},"last":0.95699999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.497},"min":{"1min":0.374,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.499},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.73799999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.82799999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70199999999999996,"15min":0.68600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:48:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88500000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90200000000000002,"5min":1.145,"15min":1.145},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.753,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85999999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:48:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.012,"15min":1.012},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70399999999999996,"15min":0.69799999999999995},"min":{"1min":0.49299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91200000000000003,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":9,"last update":"Thu Aug 10 10:48:56 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.82599999999999996,"15min":0.83899999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88800000000000001,"5min":1.173,"15min":1.173},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82699999999999996,"15min":0.83099999999999996},"min":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.006,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.94299999999999995}]},{"osd":10,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.97699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":40219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:49:18.993 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:49:18.993 INFO:tasks.cephadm:Setting up client nodes... 2023-08-10T10:49:18.994 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-08-10T10:49:19.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:18 smithi157 ceph-mon[129604]: pgmap v324: 129 pgs: 129 active+clean; 584 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.9 KiB/s wr, 14 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2023-08-10T10:49:19.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:18 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1665150912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:19.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:18 smithi195 ceph-mon[129938]: pgmap v324: 129 pgs: 129 active+clean; 584 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.9 KiB/s wr, 14 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2023-08-10T10:49:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:18 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1665150912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:19.746 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:20.017 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:19 smithi107 ceph-mon[127953]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:49:20.018 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:19 smithi107 ceph-mon[127953]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:49:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:19 smithi157 ceph-mon[129604]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:49:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:19 smithi157 ceph-mon[129604]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:49:20.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:19 smithi195 ceph-mon[129938]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:49:20.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:19 smithi195 ceph-mon[129938]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:49:21.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:20 smithi157 ceph-mon[129604]: pgmap v325: 129 pgs: 129 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 29 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2023-08-10T10:49:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:20 smithi107 ceph-mon[127953]: pgmap v325: 129 pgs: 129 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 29 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2023-08-10T10:49:21.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:20 smithi195 ceph-mon[129938]: pgmap v325: 129 pgs: 129 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 29 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2023-08-10T10:49:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.397+0000 7ff4fb985700 1 -- 172.21.15.107:0/1938761518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4103cb0 msgr2=0x7ff4f41060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.397+0000 7ff4fb985700 1 --2- 172.21.15.107:0/1938761518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4103cb0 0x7ff4f41060a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009990 tx=0x7ff4e4009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.397+0000 7ff4fb985700 1 -- 172.21.15.107:0/1938761518 shutdown_connections 2023-08-10T10:49:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.397+0000 7ff4fb985700 1 --2- 172.21.15.107:0/1938761518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4f4101380 0x7ff4f4103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.397+0000 7ff4fb985700 1 --2- 172.21.15.107:0/1938761518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f41065e0 0x7ff4f4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.397+0000 7ff4fb985700 1 --2- 172.21.15.107:0/1938761518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4103cb0 0x7ff4f41060a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.397+0000 7ff4fb985700 1 -- 172.21.15.107:0/1938761518 >> 172.21.15.107:0/1938761518 conn(0x7ff4f40fad70 msgr2=0x7ff4f40fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.397+0000 7ff4fb985700 1 -- 172.21.15.107:0/1938761518 shutdown_connections 2023-08-10T10:49:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.397+0000 7ff4fb985700 1 -- 172.21.15.107:0/1938761518 wait complete. 2023-08-10T10:49:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.398+0000 7ff4fb985700 1 Processor -- start 2023-08-10T10:49:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.398+0000 7ff4fb985700 1 -- start start 2023-08-10T10:49:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.398+0000 7ff4fb985700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4101380 0x7ff4f41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.398+0000 7ff4fb985700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4f4103cb0 0x7ff4f4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.398+0000 7ff4fb985700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f41065e0 0x7ff4f419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.398+0000 7ff4fb985700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41a0140 con 0x7ff4f4101380 2023-08-10T10:49:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.398+0000 7ff4fb985700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41a0280 con 0x7ff4f4103cb0 2023-08-10T10:49:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4fb985700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41a0410 con 0x7ff4f41065e0 2023-08-10T10:49:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9721700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4101380 0x7ff4f41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9721700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4101380 0x7ff4f41985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57742/0 (socket says 172.21.15.107:57742) 2023-08-10T10:49:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9721700 1 -- 172.21.15.107:0/4105276827 learned_addr learned my addr 172.21.15.107:0/4105276827 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f8f20700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4f4103cb0 0x7ff4f4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9f22700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f41065e0 0x7ff4f419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9721700 1 -- 172.21.15.107:0/4105276827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f41065e0 msgr2=0x7ff4f419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9721700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f41065e0 0x7ff4f419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9721700 1 -- 172.21.15.107:0/4105276827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4f4103cb0 msgr2=0x7ff4f4198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9721700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4f4103cb0 0x7ff4f4198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9721700 1 -- 172.21.15.107:0/4105276827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e40095f0 con 0x7ff4f4101380 2023-08-10T10:49:21.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f8f20700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4f4103cb0 0x7ff4f4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:21.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9f22700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f41065e0 0x7ff4f419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:21.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.399+0000 7ff4f9721700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4101380 0x7ff4f41985b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c9e0 tx=0x7ff4f000cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:21.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.400+0000 7ff4ea7fc700 1 -- 172.21.15.107:0/4105276827 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0007ac0 con 0x7ff4f4101380 2023-08-10T10:49:21.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.400+0000 7ff4ea7fc700 1 -- 172.21.15.107:0/4105276827 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4f0007c20 con 0x7ff4f4101380 2023-08-10T10:49:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.400+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f41a06f0 con 0x7ff4f4101380 2023-08-10T10:49:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.400+0000 7ff4ea7fc700 1 -- 172.21.15.107:0/4105276827 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0018660 con 0x7ff4f4101380 2023-08-10T10:49:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.400+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f41a0c40 con 0x7ff4f4101380 2023-08-10T10:49:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.401+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f41081a0 con 0x7ff4f4101380 2023-08-10T10:49:21.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.403+0000 7ff4ea7fc700 1 -- 172.21.15.107:0/4105276827 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7ff4f000f450 con 0x7ff4f4101380 2023-08-10T10:49:21.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.404+0000 7ff4ea7fc700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4e00a1260 0x7ff4e00a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:21.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.404+0000 7ff4ea7fc700 1 -- 172.21.15.107:0/4105276827 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7ff4f00ccd60 con 0x7ff4f4101380 2023-08-10T10:49:21.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.404+0000 7ff4f8f20700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4e00a1260 0x7ff4e00a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:21.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.405+0000 7ff4f8f20700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4e00a1260 0x7ff4e00a3720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400b5c0 tx=0x7ff4e4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.408+0000 7ff4ea7fc700 1 -- 172.21.15.107:0/4105276827 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff4f0095ff0 con 0x7ff4f4101380 2023-08-10T10:49:21.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.684+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff4f402c970 con 0x7ff4f4101380 2023-08-10T10:49:21.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.689+0000 7ff4ea7fc700 1 -- 172.21.15.107:0/4105276827 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff4f0099610 con 0x7ff4f4101380 2023-08-10T10:49:21.690 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2023-08-10T10:49:21.691 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCxwNRkrAThKBAA0J/OCmAqvZRTU1a6wS0Lhw== 2023-08-10T10:49:21.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4e00a1260 msgr2=0x7ff4e00a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:21.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4e00a1260 0x7ff4e00a3720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400b5c0 tx=0x7ff4e4000bc0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4101380 msgr2=0x7ff4f41985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:21.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4101380 0x7ff4f41985b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c9e0 tx=0x7ff4f000cda0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 shutdown_connections 2023-08-10T10:49:21.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4e00a1260 0x7ff4e00a3720 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4f41065e0 0x7ff4f419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f4101380 0x7ff4f41985b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 --2- 172.21.15.107:0/4105276827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4f4103cb0 0x7ff4f4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:21.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.691+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 >> 172.21.15.107:0/4105276827 conn(0x7ff4f40fad70 msgr2=0x7ff4f40ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.692+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 shutdown_connections 2023-08-10T10:49:21.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:21.692+0000 7ff4fb985700 1 -- 172.21.15.107:0/4105276827 wait complete. 2023-08-10T10:49:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:21 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4105276827' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-08-10T10:49:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:21 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4105276827' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-08-10T10:49:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:21 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4105276827' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-08-10T10:49:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:21 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4105276827' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-08-10T10:49:22.145 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T10:49:22.145 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-08-10T10:49:22.146 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-10T10:49:22.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:21 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4105276827' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-08-10T10:49:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:21 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4105276827' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-08-10T10:49:22.248 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-10T10:49:22.249 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-08-10T10:49:22.249 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph mgr dump --format=json 2023-08-10T10:49:23.008 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:23.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:22 smithi157 ceph-mon[129604]: pgmap v326: 129 pgs: 129 active+clean; 626 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 9.7 KiB/s wr, 25 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2023-08-10T10:49:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:22 smithi107 ceph-mon[127953]: pgmap v326: 129 pgs: 129 active+clean; 626 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 9.7 KiB/s wr, 25 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2023-08-10T10:49:23.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:22 smithi195 ceph-mon[129938]: pgmap v326: 129 pgs: 129 active+clean; 626 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 9.7 KiB/s wr, 25 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2023-08-10T10:49:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.530+0000 7fab5cbcd700 1 -- 172.21.15.107:0/3726907858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58100790 msgr2=0x7fab58100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:24.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.530+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/3726907858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58100790 0x7fab58100c10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009990 tx=0x7fab4c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.530+0000 7fab5cbcd700 1 -- 172.21.15.107:0/3726907858 shutdown_connections 2023-08-10T10:49:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.530+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/3726907858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab58101150 0x7fab5810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.530+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/3726907858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58106790 0x7fab58106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.530+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/3726907858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58100790 0x7fab58100c10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.530+0000 7fab5cbcd700 1 -- 172.21.15.107:0/3726907858 >> 172.21.15.107:0/3726907858 conn(0x7fab580fc260 msgr2=0x7fab580fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:24.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.530+0000 7fab5cbcd700 1 -- 172.21.15.107:0/3726907858 shutdown_connections 2023-08-10T10:49:24.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.530+0000 7fab5cbcd700 1 -- 172.21.15.107:0/3726907858 wait complete. 2023-08-10T10:49:24.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.531+0000 7fab5cbcd700 1 Processor -- start 2023-08-10T10:49:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.531+0000 7fab5cbcd700 1 -- start start 2023-08-10T10:49:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.531+0000 7fab5cbcd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab58100790 0x7fab5819c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:24.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.531+0000 7fab5cbcd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58101150 0x7fab5819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab5cbcd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58106790 0x7fab581965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab5cbcd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58196c20 con 0x7fab58106790 2023-08-10T10:49:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab5cbcd700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58196d90 con 0x7fab58100790 2023-08-10T10:49:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab5cbcd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58196f50 con 0x7fab58101150 2023-08-10T10:49:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab56d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58106790 0x7fab581965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab55d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58101150 0x7fab5819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:24.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab5659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab58100790 0x7fab5819c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab56d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58106790 0x7fab581965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56912/0 (socket says 172.21.15.107:56912) 2023-08-10T10:49:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab56d9d700 1 -- 172.21.15.107:0/2843441220 learned_addr learned my addr 172.21.15.107:0/2843441220 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab56d9d700 1 -- 172.21.15.107:0/2843441220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58101150 msgr2=0x7fab5819ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab56d9d700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58101150 0x7fab5819ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab56d9d700 1 -- 172.21.15.107:0/2843441220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab58100790 msgr2=0x7fab5819c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:24.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab56d9d700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab58100790 0x7fab5819c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab56d9d700 1 -- 172.21.15.107:0/2843441220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0095f0 con 0x7fab58106790 2023-08-10T10:49:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.532+0000 7fab55d9b700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58101150 0x7fab5819ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:49:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.533+0000 7fab56d9d700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58106790 0x7fab581965b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab50007ee0 tx=0x7fab5000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.533+0000 7fab477fe700 1 -- 172.21.15.107:0/2843441220 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50017070 con 0x7fab58106790 2023-08-10T10:49:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.533+0000 7fab477fe700 1 -- 172.21.15.107:0/2843441220 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab5000f040 con 0x7fab58106790 2023-08-10T10:49:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.533+0000 7fab477fe700 1 -- 172.21.15.107:0/2843441220 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50005570 con 0x7fab58106790 2023-08-10T10:49:24.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.533+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab58197230 con 0x7fab58106790 2023-08-10T10:49:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.533+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab581a3520 con 0x7fab58106790 2023-08-10T10:49:24.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.534+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5804e470 con 0x7fab58106790 2023-08-10T10:49:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.536+0000 7fab477fe700 1 -- 172.21.15.107:0/2843441220 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fab5000db20 con 0x7fab58106790 2023-08-10T10:49:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.537+0000 7fab477fe700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab400a12e0 0x7fab400a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.537+0000 7fab477fe700 1 -- 172.21.15.107:0/2843441220 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fab500cc520 con 0x7fab58106790 2023-08-10T10:49:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.538+0000 7fab5659c700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab400a12e0 0x7fab400a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:24.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.538+0000 7fab5659c700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab400a12e0 0x7fab400a37a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fab48005950 tx=0x7fab4800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:24.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.542+0000 7fab477fe700 1 -- 172.21.15.107:0/2843441220 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fab500957b0 con 0x7fab58106790 2023-08-10T10:49:24.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.799+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fab58197ac0 con 0x7fab58106790 2023-08-10T10:49:24.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.804+0000 7fab477fe700 1 -- 172.21.15.107:0/2843441220 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260132 (secure 0 0 0) 0x7fab50098dd0 con 0x7fab58106790 2023-08-10T10:49:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:24.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.808+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab400a12e0 msgr2=0x7fab400a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:24.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.808+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab400a12e0 0x7fab400a37a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fab48005950 tx=0x7fab4800b410 comp rx=0 tx=0).stop 2023-08-10T10:49:24.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.808+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58106790 msgr2=0x7fab581965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:24.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.808+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58106790 0x7fab581965b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab50007ee0 tx=0x7fab5000d3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.808+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 shutdown_connections 2023-08-10T10:49:24.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.809+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab400a12e0 0x7fab400a37a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.809+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab58100790 0x7fab5819c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.809+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab58106790 0x7fab581965b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.809+0000 7fab5cbcd700 1 --2- 172.21.15.107:0/2843441220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58101150 0x7fab5819ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:24.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.809+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 >> 172.21.15.107:0/2843441220 conn(0x7fab580fc260 msgr2=0x7fab580fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:24.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.809+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 shutdown_connections 2023-08-10T10:49:24.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:24.809+0000 7fab5cbcd700 1 -- 172.21.15.107:0/2843441220 wait complete. 2023-08-10T10:49:25.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:24 smithi157 ceph-mon[129604]: pgmap v327: 129 pgs: 129 active+clean; 626 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.9 KiB/s wr, 25 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2023-08-10T10:49:25.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:24 smithi107 ceph-mon[127953]: pgmap v327: 129 pgs: 129 active+clean; 626 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.9 KiB/s wr, 25 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2023-08-10T10:49:25.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:24 smithi195 ceph-mon[129938]: pgmap v327: 129 pgs: 129 active+clean; 626 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.9 KiB/s wr, 25 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2023-08-10T10:49:25.297 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":17,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":438388714},{"type":"v1","addr":"172.21.15.107:6801","nonce":438388714}]},"active_addr":"172.21.15.107:6801/438388714","active_change":"2023-08-10T10:41:11.475861+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.107:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1857104840}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3894575131}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":4083524194}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3715609072}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1529222748}]}]} 2023-08-10T10:49:25.304 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-08-10T10:49:25.304 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-08-10T10:49:25.304 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd dump --format=json 2023-08-10T10:49:26.028 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:25 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2843441220' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-08-10T10:49:26.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:25 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2843441220' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-08-10T10:49:26.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:25 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2843441220' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-08-10T10:49:26.902 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:26 smithi107 ceph-mon[127953]: pgmap v328: 129 pgs: 129 active+clean; 630 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 25 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2023-08-10T10:49:27.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:26 smithi157 ceph-mon[129604]: pgmap v328: 129 pgs: 129 active+clean; 630 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 25 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2023-08-10T10:49:27.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:26 smithi195 ceph-mon[129938]: pgmap v328: 129 pgs: 129 active+clean; 630 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 25 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2023-08-10T10:49:27.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.520+0000 7fab8495c700 1 -- 172.21.15.107:0/3677366861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80101950 msgr2=0x7fab80101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:27.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.520+0000 7fab8495c700 1 --2- 172.21.15.107:0/3677366861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80101950 0x7fab80101d30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab70009990 tx=0x7fab70009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.520+0000 7fab8495c700 1 -- 172.21.15.107:0/3677366861 shutdown_connections 2023-08-10T10:49:27.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.520+0000 7fab8495c700 1 --2- 172.21.15.107:0/3677366861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab8010ad80 0x7fab8010d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.520+0000 7fab8495c700 1 --2- 172.21.15.107:0/3677366861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80101950 0x7fab80101d30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.520+0000 7fab8495c700 1 --2- 172.21.15.107:0/3677366861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab80102270 0x7fab8010a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.520+0000 7fab8495c700 1 -- 172.21.15.107:0/3677366861 >> 172.21.15.107:0/3677366861 conn(0x7fab800fb1e0 msgr2=0x7fab800fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:27.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.520+0000 7fab8495c700 1 -- 172.21.15.107:0/3677366861 shutdown_connections 2023-08-10T10:49:27.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.520+0000 7fab8495c700 1 -- 172.21.15.107:0/3677366861 wait complete. 2023-08-10T10:49:27.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.521+0000 7fab8495c700 1 Processor -- start 2023-08-10T10:49:27.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.521+0000 7fab8495c700 1 -- start start 2023-08-10T10:49:27.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab8495c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab80101950 0x7fab800ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:27.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab8495c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80102270 0x7fab800ffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:27.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab8495c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab8010ad80 0x7fab80100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:27.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab8495c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab801a4bc0 con 0x7fab80102270 2023-08-10T10:49:27.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab8495c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab801a4d30 con 0x7fab80101950 2023-08-10T10:49:27.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab8495c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab801a4ef0 con 0x7fab8010ad80 2023-08-10T10:49:27.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80102270 0x7fab800ffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:27.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80102270 0x7fab800ffaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56928/0 (socket says 172.21.15.107:56928) 2023-08-10T10:49:27.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab7dd9b700 1 -- 172.21.15.107:0/1697371928 learned_addr learned my addr 172.21.15.107:0/1697371928 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:27.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab7ed9d700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab8010ad80 0x7fab80100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:27.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.522+0000 7fab7e59c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab80101950 0x7fab800ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:27.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab7dd9b700 1 -- 172.21.15.107:0/1697371928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab8010ad80 msgr2=0x7fab80100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:27.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab7dd9b700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab8010ad80 0x7fab80100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab7dd9b700 1 -- 172.21.15.107:0/1697371928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab80101950 msgr2=0x7fab800ff5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:27.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab7dd9b700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab80101950 0x7fab800ff5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab7dd9b700 1 -- 172.21.15.107:0/1697371928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700095f0 con 0x7fab80102270 2023-08-10T10:49:27.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab7e59c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab80101950 0x7fab800ff5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:27.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab7dd9b700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80102270 0x7fab800ffaf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c970 tx=0x7fab7400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:27.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab6f7fe700 1 -- 172.21.15.107:0/1697371928 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74007b00 con 0x7fab80102270 2023-08-10T10:49:27.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab801a51d0 con 0x7fab80102270 2023-08-10T10:49:27.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab6f7fe700 1 -- 172.21.15.107:0/1697371928 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab7400ce60 con 0x7fab80102270 2023-08-10T10:49:27.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab6f7fe700 1 -- 172.21.15.107:0/1697371928 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74018400 con 0x7fab80102270 2023-08-10T10:49:27.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.523+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab801a5720 con 0x7fab80102270 2023-08-10T10:49:27.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.524+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8004e470 con 0x7fab80102270 2023-08-10T10:49:27.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.526+0000 7fab6f7fe700 1 -- 172.21.15.107:0/1697371928 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fab7400f450 con 0x7fab80102270 2023-08-10T10:49:27.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.528+0000 7fab6f7fe700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab680a11e0 0x7fab680a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:27.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.528+0000 7fab6f7fe700 1 -- 172.21.15.107:0/1697371928 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fab740cccf0 con 0x7fab80102270 2023-08-10T10:49:27.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.528+0000 7fab7e59c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab680a11e0 0x7fab680a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:27.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.528+0000 7fab7e59c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab680a11e0 0x7fab680a36a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab7000b5c0 tx=0x7fab70005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:27.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.531+0000 7fab6f7fe700 1 -- 172.21.15.107:0/1697371928 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fab74095f80 con 0x7fab80102270 2023-08-10T10:49:27.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.730+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab801a59a0 con 0x7fab80102270 2023-08-10T10:49:27.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.731+0000 7fab6f7fe700 1 -- 172.21.15.107:0/1697371928 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24517 (secure 0 0 0) 0x7fab740995a0 con 0x7fab80102270 2023-08-10T10:49:27.733 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:27.733 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":91,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:49:12.696718+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:27.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab680a11e0 msgr2=0x7fab680a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:27.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab680a11e0 0x7fab680a36a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab7000b5c0 tx=0x7fab70005fb0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80102270 msgr2=0x7fab800ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:27.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80102270 0x7fab800ffaf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c970 tx=0x7fab7400cc80 comp rx=0 tx=0).stop 2023-08-10T10:49:27.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 shutdown_connections 2023-08-10T10:49:27.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fab680a11e0 0x7fab680a36a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab80101950 0x7fab800ff5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab8010ad80 0x7fab80100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 --2- 172.21.15.107:0/1697371928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab80102270 0x7fab800ffaf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:27.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 >> 172.21.15.107:0/1697371928 conn(0x7fab800fb1e0 msgr2=0x7fab8010cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:27.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 shutdown_connections 2023-08-10T10:49:27.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:27.734+0000 7fab8495c700 1 -- 172.21.15.107:0/1697371928 wait complete. 2023-08-10T10:49:28.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:27 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1697371928' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:27 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1697371928' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:28.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:27 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1697371928' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:28.221 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-08-10T10:49:28.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd dump --format=json 2023-08-10T10:49:28.945 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:29.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:28 smithi157 ceph-mon[129604]: pgmap v329: 129 pgs: 129 active+clean; 630 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.1 KiB/s wr, 22 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2023-08-10T10:49:29.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:28 smithi107 ceph-mon[127953]: pgmap v329: 129 pgs: 129 active+clean; 630 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.1 KiB/s wr, 22 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2023-08-10T10:49:29.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:28 smithi195 ceph-mon[129938]: pgmap v329: 129 pgs: 129 active+clean; 630 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.1 KiB/s wr, 22 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2023-08-10T10:49:30.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.434+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2953265991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4101150 msgr2=0x7f1fb410d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:30.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.434+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2953265991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4101150 0x7f1fb410d660 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00b0a0 tx=0x7f1fac00b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.434+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2953265991 shutdown_connections 2023-08-10T10:49:30.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.434+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2953265991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4101150 0x7f1fb410d660 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.434+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2953265991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb4106790 0x7f1fb4106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.434+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2953265991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fb4100790 0x7f1fb4100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.434+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2953265991 >> 172.21.15.107:0/2953265991 conn(0x7f1fb40fc260 msgr2=0x7f1fb40fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:30.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.434+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2953265991 shutdown_connections 2023-08-10T10:49:30.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.434+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2953265991 wait complete. 2023-08-10T10:49:30.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.435+0000 7f1fbbc87700 1 Processor -- start 2023-08-10T10:49:30.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.435+0000 7f1fbbc87700 1 -- start start 2023-08-10T10:49:30.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.435+0000 7f1fbbc87700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fb4100790 0x7f1fb4072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:30.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fbbc87700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb4101150 0x7f1fb4072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:30.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fbbc87700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4106790 0x7f1fb4073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:30.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fbbc87700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41a4d80 con 0x7f1fb4106790 2023-08-10T10:49:30.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fbbc87700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41a4ef0 con 0x7f1fb4100790 2023-08-10T10:49:30.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fbbc87700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41a50b0 con 0x7f1fb4101150 2023-08-10T10:49:30.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fba224700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4106790 0x7f1fb4073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:30.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fba224700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4106790 0x7f1fb4073530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56942/0 (socket says 172.21.15.107:56942) 2023-08-10T10:49:30.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fba224700 1 -- 172.21.15.107:0/2316521941 learned_addr learned my addr 172.21.15.107:0/2316521941 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:30.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fb9222700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb4101150 0x7f1fb4072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:30.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fb9a23700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fb4100790 0x7f1fb4072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:30.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fba224700 1 -- 172.21.15.107:0/2316521941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb4101150 msgr2=0x7f1fb4072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:30.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fba224700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb4101150 0x7f1fb4072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fba224700 1 -- 172.21.15.107:0/2316521941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fb4100790 msgr2=0x7f1fb4072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:30.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fba224700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fb4100790 0x7f1fb4072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.436+0000 7f1fba224700 1 -- 172.21.15.107:0/2316521941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac009d00 con 0x7f1fb4106790 2023-08-10T10:49:30.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.437+0000 7f1fba224700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4106790 0x7f1fb4073530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009fd0 tx=0x7f1fac004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:30.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.437+0000 7f1faaffd700 1 -- 172.21.15.107:0/2316521941 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00e040 con 0x7f1fb4106790 2023-08-10T10:49:30.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.437+0000 7f1faaffd700 1 -- 172.21.15.107:0/2316521941 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fac00ceb0 con 0x7f1fb4106790 2023-08-10T10:49:30.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.437+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb41a5330 con 0x7f1fb4106790 2023-08-10T10:49:30.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.437+0000 7f1faaffd700 1 -- 172.21.15.107:0/2316521941 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0055d0 con 0x7f1fb4106790 2023-08-10T10:49:30.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.437+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb41a57a0 con 0x7f1fb4106790 2023-08-10T10:49:30.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.438+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb404e470 con 0x7f1fb4106790 2023-08-10T10:49:30.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.440+0000 7f1faaffd700 1 -- 172.21.15.107:0/2316521941 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f1fac005730 con 0x7f1fb4106790 2023-08-10T10:49:30.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.441+0000 7f1faaffd700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1fa00a1260 0x7f1fa00a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:30.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.441+0000 7f1faaffd700 1 -- 172.21.15.107:0/2316521941 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f1fac0ce6d0 con 0x7f1fb4106790 2023-08-10T10:49:30.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.441+0000 7f1fb9a23700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1fa00a1260 0x7f1fa00a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:30.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.442+0000 7f1fb9a23700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1fa00a1260 0x7f1fa00a3720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0005950 tx=0x7f1fb000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:30.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.445+0000 7f1faaffd700 1 -- 172.21.15.107:0/2316521941 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1fac0979f0 con 0x7f1fb4106790 2023-08-10T10:49:30.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.646+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fb41a5a90 con 0x7f1fb4106790 2023-08-10T10:49:30.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.647+0000 7f1faaffd700 1 -- 172.21.15.107:0/2316521941 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24517 (secure 0 0 0) 0x7f1fac09b010 con 0x7f1fb4106790 2023-08-10T10:49:30.649 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:49:30.649 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":91,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:49:12.696718+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:49:30.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1fa00a1260 msgr2=0x7f1fa00a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:30.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1fa00a1260 0x7f1fa00a3720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0005950 tx=0x7f1fb000b410 comp rx=0 tx=0).stop 2023-08-10T10:49:30.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4106790 msgr2=0x7f1fb4073530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:30.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4106790 0x7f1fb4073530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009fd0 tx=0x7f1fac004c80 comp rx=0 tx=0).stop 2023-08-10T10:49:30.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 shutdown_connections 2023-08-10T10:49:30.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1fa00a1260 0x7f1fa00a3720 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fb4100790 0x7f1fb4072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fb4106790 0x7f1fb4073530 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 --2- 172.21.15.107:0/2316521941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb4101150 0x7f1fb4072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:30.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 >> 172.21.15.107:0/2316521941 conn(0x7f1fb40fc260 msgr2=0x7f1fb40fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:30.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 shutdown_connections 2023-08-10T10:49:30.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:30.650+0000 7f1fbbc87700 1 -- 172.21.15.107:0/2316521941 wait complete. 2023-08-10T10:49:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:30 smithi157 ceph-mon[129604]: pgmap v330: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 19 op/s 2023-08-10T10:49:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:30 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2316521941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:30 smithi107 ceph-mon[127953]: pgmap v330: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 19 op/s 2023-08-10T10:49:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:30 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2316521941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:31.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-08-10T10:49:31.137 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-08-10T10:49:31.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-08-10T10:49:31.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-08-10T10:49:31.139 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-08-10T10:49:31.139 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-08-10T10:49:31.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-08-10T10:49:31.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-08-10T10:49:31.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2023-08-10T10:49:31.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2023-08-10T10:49:31.142 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2023-08-10T10:49:31.143 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2023-08-10T10:49:31.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:30 smithi195 ceph-mon[129938]: pgmap v330: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 19 op/s 2023-08-10T10:49:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:30 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2316521941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:49:32.651 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:32.835 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:32.859 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:32.909 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:33.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:32 smithi157 ceph-mon[129604]: pgmap v331: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-08-10T10:49:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:32 smithi107 ceph-mon[127953]: pgmap v331: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-08-10T10:49:33.086 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:33.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:32 smithi195 ceph-mon[129938]: pgmap v331: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-08-10T10:49:33.334 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:34.940 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:34 smithi107 ceph-mon[127953]: pgmap v332: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-08-10T10:49:35.084 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:35.107 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:35.117 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:34 smithi195 ceph-mon[129938]: pgmap v332: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-08-10T10:49:35.169 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:35.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:34 smithi157 ceph-mon[129604]: pgmap v332: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-08-10T10:49:36.923 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:36 smithi107 ceph-mon[127953]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-08-10T10:49:37.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:36 smithi195 ceph-mon[129938]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-08-10T10:49:37.271 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:37.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:36 smithi157 ceph-mon[129604]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-08-10T10:49:37.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.450+0000 7f830f5f2700 1 -- 172.21.15.107:0/215066501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8308101150 msgr2=0x7f830810d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.450+0000 7f830f5f2700 1 --2- 172.21.15.107:0/215066501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8308101150 0x7f830810d660 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f830000b0a0 tx=0x7f830000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.451+0000 7f830f5f2700 1 -- 172.21.15.107:0/215066501 shutdown_connections 2023-08-10T10:49:37.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.451+0000 7f830f5f2700 1 --2- 172.21.15.107:0/215066501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8308101150 0x7f830810d660 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.451+0000 7f830f5f2700 1 --2- 172.21.15.107:0/215066501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8308106790 0x7f8308106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.451+0000 7f830f5f2700 1 --2- 172.21.15.107:0/215066501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8308100790 0x7f8308100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.451+0000 7f830f5f2700 1 -- 172.21.15.107:0/215066501 >> 172.21.15.107:0/215066501 conn(0x7f83080fc260 msgr2=0x7f83080fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:37.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.451+0000 7f830f5f2700 1 -- 172.21.15.107:0/215066501 shutdown_connections 2023-08-10T10:49:37.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.451+0000 7f830f5f2700 1 -- 172.21.15.107:0/215066501 wait complete. 2023-08-10T10:49:37.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.452+0000 7f830f5f2700 1 Processor -- start 2023-08-10T10:49:37.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.452+0000 7f830f5f2700 1 -- start start 2023-08-10T10:49:37.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.452+0000 7f830f5f2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8308100790 0x7f830810d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.452+0000 7f830f5f2700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8308101150 0x7f830810d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.452+0000 7f830f5f2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8308106790 0x7f830810a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.452+0000 7f830f5f2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830810ab00 con 0x7f8308100790 2023-08-10T10:49:37.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.452+0000 7f830f5f2700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830810ac70 con 0x7f8308101150 2023-08-10T10:49:37.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.452+0000 7f830f5f2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830810ae30 con 0x7f8308106790 2023-08-10T10:49:37.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830d38e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8308100790 0x7f830810d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830d38e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8308100790 0x7f830810d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50064/0 (socket says 172.21.15.107:50064) 2023-08-10T10:49:37.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830db8f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8308106790 0x7f830810a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830d38e700 1 -- 172.21.15.107:0/960748977 learned_addr learned my addr 172.21.15.107:0/960748977 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:37.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830cb8d700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8308101150 0x7f830810d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830db8f700 1 -- 172.21.15.107:0/960748977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8308101150 msgr2=0x7f830810d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830db8f700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8308101150 0x7f830810d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830db8f700 1 -- 172.21.15.107:0/960748977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8308100790 msgr2=0x7f830810d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830db8f700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8308100790 0x7f830810d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.453+0000 7f830db8f700 1 -- 172.21.15.107:0/960748977 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009d00 con 0x7f8308106790 2023-08-10T10:49:37.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.454+0000 7f830db8f700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8308106790 0x7f830810a330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8300009fd0 tx=0x7f830000bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:37.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.454+0000 7f82fe7fc700 1 -- 172.21.15.107:0/960748977 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000e040 con 0x7f8308106790 2023-08-10T10:49:37.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.454+0000 7f82fe7fc700 1 -- 172.21.15.107:0/960748977 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8300009480 con 0x7f8308106790 2023-08-10T10:49:37.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.454+0000 7f82fe7fc700 1 -- 172.21.15.107:0/960748977 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83000052a0 con 0x7f8308106790 2023-08-10T10:49:37.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.454+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83080711e0 con 0x7f8308106790 2023-08-10T10:49:37.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.454+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8308071600 con 0x7f8308106790 2023-08-10T10:49:37.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.456+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83080744c0 con 0x7f8308106790 2023-08-10T10:49:37.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.458+0000 7f82fe7fc700 1 -- 172.21.15.107:0/960748977 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8300005400 con 0x7f8308106790 2023-08-10T10:49:37.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.460+0000 7f82fe7fc700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82f40a1260 0x7f82f40a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.460+0000 7f82fe7fc700 1 -- 172.21.15.107:0/960748977 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f83000ce1c0 con 0x7f8308106790 2023-08-10T10:49:37.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.460+0000 7f830d38e700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82f40a1260 0x7f82f40a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.460+0000 7f82fe7fc700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] conn(0x7f82f40ac200 0x7f82f40ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.460+0000 7f82fe7fc700 1 -- 172.21.15.107:0/960748977 --> [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82f40aed70 con 0x7f82f40ac200 2023-08-10T10:49:37.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.460+0000 7f82fe7fc700 1 -- 172.21.15.107:0/960748977 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83000ce530 con 0x7f8308106790 2023-08-10T10:49:37.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.461+0000 7f830cb8d700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] conn(0x7f82f40ac200 0x7f82f40ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.461+0000 7f830d38e700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82f40a1260 0x7f82f40a3720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8304009ca0 tx=0x7f8304009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:37.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.461+0000 7f830cb8d700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] conn(0x7f82f40ac200 0x7f82f40ae6a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:37.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.462+0000 7f82fe7fc700 1 -- 172.21.15.107:0/960748977 <== osd.4 v2:172.21.15.157:6808/2085843494 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f82f40aed70 con 0x7f82f40ac200 2023-08-10T10:49:37.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.479+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 --> [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f830804e470 con 0x7f82f40ac200 2023-08-10T10:49:37.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f82fe7fc700 1 -- 172.21.15.107:0/960748977 <== osd.4 v2:172.21.15.157:6808/2085843494 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f830804e470 con 0x7f82f40ac200 2023-08-10T10:49:37.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 >> [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] conn(0x7f82f40ac200 msgr2=0x7f82f40ae6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] conn(0x7f82f40ac200 0x7f82f40ae6a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82f40a1260 msgr2=0x7f82f40a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82f40a1260 0x7f82f40a3720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8304009ca0 tx=0x7f8304009260 comp rx=0 tx=0).stop 2023-08-10T10:49:37.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8308106790 msgr2=0x7f830810a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 --2- 172.21.15.107:0/960748977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8308106790 0x7f830810a330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8300009fd0 tx=0x7f830000bce0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830db8f700 1 -- 172.21.15.107:0/960748977 reap_dead start 2023-08-10T10:49:37.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 shutdown_connections 2023-08-10T10:49:37.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 >> 172.21.15.107:0/960748977 conn(0x7f83080fc260 msgr2=0x7f830810ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:37.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 shutdown_connections 2023-08-10T10:49:37.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.480+0000 7f830f5f2700 1 -- 172.21.15.107:0/960748977 wait complete. 2023-08-10T10:49:37.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.548+0000 7ff582a0c700 1 -- 172.21.15.107:0/3599938020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c073430 msgr2=0x7ff57c111260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.548+0000 7ff582a0c700 1 --2- 172.21.15.107:0/3599938020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c073430 0x7ff57c111260 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff570009990 tx=0x7ff570009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.548+0000 7ff582a0c700 1 -- 172.21.15.107:0/3599938020 shutdown_connections 2023-08-10T10:49:37.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.548+0000 7ff582a0c700 1 --2- 172.21.15.107:0/3599938020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff57c1117a0 0x7ff57c113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.548+0000 7ff582a0c700 1 --2- 172.21.15.107:0/3599938020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff57c072b10 0x7ff57c072ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.548+0000 7ff582a0c700 1 --2- 172.21.15.107:0/3599938020 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c073430 0x7ff57c111260 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.548+0000 7ff582a0c700 1 -- 172.21.15.107:0/3599938020 >> 172.21.15.107:0/3599938020 conn(0x7ff57c0fc260 msgr2=0x7ff57c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:37.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.548+0000 7ff582a0c700 1 -- 172.21.15.107:0/3599938020 shutdown_connections 2023-08-10T10:49:37.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.549+0000 7ff582a0c700 1 -- 172.21.15.107:0/3599938020 wait complete. 2023-08-10T10:49:37.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.550+0000 7ff582a0c700 1 Processor -- start 2023-08-10T10:49:37.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.550+0000 7ff582a0c700 1 -- start start 2023-08-10T10:49:37.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff582a0c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff57c072b10 0x7ff57c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff582a0c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c073430 0x7ff57c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff582a0c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff57c1117a0 0x7ff57c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff582a0c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c1a1e20 con 0x7ff57c073430 2023-08-10T10:49:37.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff582a0c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c1a1f90 con 0x7ff57c072b10 2023-08-10T10:49:37.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff582a0c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c1a2150 con 0x7ff57c1117a0 2023-08-10T10:49:37.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff57b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c073430 0x7ff57c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff57b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c073430 0x7ff57c19d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50094/0 (socket says 172.21.15.107:50094) 2023-08-10T10:49:37.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff57b7fe700 1 -- 172.21.15.107:0/466935980 learned_addr learned my addr 172.21.15.107:0/466935980 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:37.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff57bfff700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff57c072b10 0x7ff57c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.551+0000 7ff580fa9700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff57c1117a0 0x7ff57c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff57b7fe700 1 -- 172.21.15.107:0/466935980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff57c1117a0 msgr2=0x7ff57c1a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff57b7fe700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff57c1117a0 0x7ff57c1a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff57b7fe700 1 -- 172.21.15.107:0/466935980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff57c072b10 msgr2=0x7ff57c19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff57b7fe700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff57c072b10 0x7ff57c19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff57b7fe700 1 -- 172.21.15.107:0/466935980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700095f0 con 0x7ff57c073430 2023-08-10T10:49:37.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff57b7fe700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c073430 0x7ff57c19d3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff5700036c0 tx=0x7ff570005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:37.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff5797fa700 1 -- 172.21.15.107:0/466935980 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57001d070 con 0x7ff57c073430 2023-08-10T10:49:37.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff5797fa700 1 -- 172.21.15.107:0/466935980 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff570003f40 con 0x7ff57c073430 2023-08-10T10:49:37.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c1a23d0 con 0x7ff57c073430 2023-08-10T10:49:37.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff5797fa700 1 -- 172.21.15.107:0/466935980 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570022c40 con 0x7ff57c073430 2023-08-10T10:49:37.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.552+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c1a9c90 con 0x7ff57c073430 2023-08-10T10:49:37.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.553+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff57c116f00 con 0x7ff57c073430 2023-08-10T10:49:37.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.557+0000 7ff5797fa700 1 -- 172.21.15.107:0/466935980 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7ff570022470 con 0x7ff57c073430 2023-08-10T10:49:37.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.558+0000 7ff5797fa700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff5640a1260 0x7ff5640a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.559+0000 7ff5797fa700 1 -- 172.21.15.107:0/466935980 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7ff5700cec50 con 0x7ff57c073430 2023-08-10T10:49:37.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.559+0000 7ff57bfff700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff5640a1260 0x7ff5640a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.559+0000 7ff5797fa700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] conn(0x7ff5640ac200 0x7ff5640ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:37.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.559+0000 7ff5797fa700 1 -- 172.21.15.107:0/466935980 --> [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5640aed70 con 0x7ff5640ac200 2023-08-10T10:49:37.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.559+0000 7ff5797fa700 1 -- 172.21.15.107:0/466935980 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5700cefc0 con 0x7ff57c073430 2023-08-10T10:49:37.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.559+0000 7ff57bfff700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff5640a1260 0x7ff5640a3720 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff56c005950 tx=0x7ff56c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:37.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.560+0000 7ff580fa9700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] conn(0x7ff5640ac200 0x7ff5640ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:37.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.560+0000 7ff580fa9700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] conn(0x7ff5640ac200 0x7ff5640ae6a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:37.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.561+0000 7ff5797fa700 1 -- 172.21.15.107:0/466935980 <== osd.2 v2:172.21.15.195:6800/3340307341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff5640aed70 con 0x7ff5640ac200 2023-08-10T10:49:37.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.581+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 --> [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff57c04e470 con 0x7ff5640ac200 2023-08-10T10:49:37.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.582+0000 7ff5797fa700 1 -- 172.21.15.107:0/466935980 <== osd.2 v2:172.21.15.195:6800/3340307341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff57c04e470 con 0x7ff5640ac200 2023-08-10T10:49:37.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 >> [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] conn(0x7ff5640ac200 msgr2=0x7ff5640ae6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff582a0c700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] conn(0x7ff5640ac200 0x7ff5640ae6a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff5640a1260 msgr2=0x7ff5640a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff582a0c700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff5640a1260 0x7ff5640a3720 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff56c005950 tx=0x7ff56c00b410 comp rx=0 tx=0).stop 2023-08-10T10:49:37.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c073430 msgr2=0x7ff57c19d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:37.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff582a0c700 1 --2- 172.21.15.107:0/466935980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff57c073430 0x7ff57c19d3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff5700036c0 tx=0x7ff570005740 comp rx=0 tx=0).stop 2023-08-10T10:49:37.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff580fa9700 1 -- 172.21.15.107:0/466935980 reap_dead start 2023-08-10T10:49:37.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 shutdown_connections 2023-08-10T10:49:37.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 >> 172.21.15.107:0/466935980 conn(0x7ff57c0fc260 msgr2=0x7ff57c0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:37.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.583+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 shutdown_connections 2023-08-10T10:49:37.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:37.584+0000 7ff582a0c700 1 -- 172.21.15.107:0/466935980 wait complete. 2023-08-10T10:49:38.523 INFO:teuthology.orchestra.run.smithi107.stdout:141733920829 2023-08-10T10:49:38.524 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-08-10T10:49:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:38 smithi107 ceph-mon[127953]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-08-10T10:49:39.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:38 smithi195 ceph-mon[129938]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-08-10T10:49:39.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:38 smithi157 ceph-mon[129604]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-08-10T10:49:39.359 INFO:teuthology.orchestra.run.smithi107.stdout:77309411400 2023-08-10T10:49:39.360 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-08-10T10:49:39.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.477+0000 7f8eb7678700 1 -- 172.21.15.107:0/2961391367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8eb0101150 msgr2=0x7f8eb010d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.477+0000 7f8eb7678700 1 --2- 172.21.15.107:0/2961391367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8eb0101150 0x7f8eb010d660 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800b0a0 tx=0x7f8ea800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.477+0000 7f8eb7678700 1 -- 172.21.15.107:0/2961391367 shutdown_connections 2023-08-10T10:49:39.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.477+0000 7f8eb7678700 1 --2- 172.21.15.107:0/2961391367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8eb0101150 0x7f8eb010d660 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.477+0000 7f8eb7678700 1 --2- 172.21.15.107:0/2961391367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8eb0106790 0x7f8eb0106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.477+0000 7f8eb7678700 1 --2- 172.21.15.107:0/2961391367 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb0100790 0x7f8eb0100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.477+0000 7f8eb7678700 1 -- 172.21.15.107:0/2961391367 >> 172.21.15.107:0/2961391367 conn(0x7f8eb00fc260 msgr2=0x7f8eb00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:39.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.477+0000 7f8eb7678700 1 -- 172.21.15.107:0/2961391367 shutdown_connections 2023-08-10T10:49:39.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.477+0000 7f8eb7678700 1 -- 172.21.15.107:0/2961391367 wait complete. 2023-08-10T10:49:39.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.479+0000 7f8eb7678700 1 Processor -- start 2023-08-10T10:49:39.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.479+0000 7f8eb7678700 1 -- start start 2023-08-10T10:49:39.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb7678700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8eb0100790 0x7f8eb019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb7678700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8eb0101150 0x7f8eb019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb7678700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb0106790 0x7f8eb01988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb7678700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0198f20 con 0x7f8eb0101150 2023-08-10T10:49:39.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb7678700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0199090 con 0x7f8eb0106790 2023-08-10T10:49:39.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb7678700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0199250 con 0x7f8eb0100790 2023-08-10T10:49:39.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb4c13700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8eb0101150 0x7f8eb019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb4c13700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8eb0101150 0x7f8eb019ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50108/0 (socket says 172.21.15.107:50108) 2023-08-10T10:49:39.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb4c13700 1 -- 172.21.15.107:0/3213525127 learned_addr learned my addr 172.21.15.107:0/3213525127 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:39.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb5414700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8eb0100790 0x7f8eb019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.480+0000 7f8eb5c15700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb0106790 0x7f8eb01988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8eb4c13700 1 -- 172.21.15.107:0/3213525127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8eb0100790 msgr2=0x7f8eb019e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8eb4c13700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8eb0100790 0x7f8eb019e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8eb4c13700 1 -- 172.21.15.107:0/3213525127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb0106790 msgr2=0x7f8eb01988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8eb4c13700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb0106790 0x7f8eb01988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8eb4c13700 1 -- 172.21.15.107:0/3213525127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8009d00 con 0x7f8eb0101150 2023-08-10T10:49:39.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8eb5c15700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8eb0106790 0x7f8eb01988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:39.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8eb4c13700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8eb0101150 0x7f8eb019ed70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d950 tx=0x7f8ea000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:39.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8ea67fc700 1 -- 172.21.15.107:0/3213525127 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0009940 con 0x7f8eb0101150 2023-08-10T10:49:39.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb0199530 con 0x7f8eb0101150 2023-08-10T10:49:39.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.481+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb01a5820 con 0x7f8eb0101150 2023-08-10T10:49:39.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.482+0000 7f8ea67fc700 1 -- 172.21.15.107:0/3213525127 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ea0010460 con 0x7f8eb0101150 2023-08-10T10:49:39.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.482+0000 7f8ea67fc700 1 -- 172.21.15.107:0/3213525127 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000f620 con 0x7f8eb0101150 2023-08-10T10:49:39.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.482+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e94000ff0 con 0x7f8eb0101150 2023-08-10T10:49:39.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.485+0000 7f8ea67fc700 1 -- 172.21.15.107:0/3213525127 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8ea0009aa0 con 0x7f8eb0101150 2023-08-10T10:49:39.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.487+0000 7f8ea67fc700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8e9c0a1260 0x7f8e9c0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.487+0000 7f8ea67fc700 1 -- 172.21.15.107:0/3213525127 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f8ea00cd070 con 0x7f8eb0101150 2023-08-10T10:49:39.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.487+0000 7f8eb5414700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8e9c0a1260 0x7f8e9c0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.487+0000 7f8ea67fc700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] conn(0x7f8e9c0ac200 0x7f8e9c0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.487+0000 7f8ea67fc700 1 -- 172.21.15.107:0/3213525127 --> [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e9c0aed70 con 0x7f8e9c0ac200 2023-08-10T10:49:39.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.487+0000 7f8ea67fc700 1 -- 172.21.15.107:0/3213525127 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ea00cd480 con 0x7f8eb0101150 2023-08-10T10:49:39.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.488+0000 7f8eb5414700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8e9c0a1260 0x7f8e9c0a3720 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009be0 tx=0x7f8eac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:39.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.488+0000 7f8eb5c15700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] conn(0x7f8e9c0ac200 0x7f8e9c0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.489+0000 7f8eb5c15700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] conn(0x7f8e9c0ac200 0x7f8e9c0ae6a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:39.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.490+0000 7f8ea67fc700 1 -- 172.21.15.107:0/3213525127 <== osd.10 v2:172.21.15.157:6824/1583160453 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8e9c0aed70 con 0x7f8e9c0ac200 2023-08-10T10:49:39.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.513+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 --> [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e94002d70 con 0x7f8e9c0ac200 2023-08-10T10:49:39.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.514+0000 7f8ea67fc700 1 -- 172.21.15.107:0/3213525127 <== osd.10 v2:172.21.15.157:6824/1583160453 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8e94002d70 con 0x7f8e9c0ac200 2023-08-10T10:49:39.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.514+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 >> [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] conn(0x7f8e9c0ac200 msgr2=0x7f8e9c0ae6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.514+0000 7f8eb7678700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] conn(0x7f8e9c0ac200 0x7f8e9c0ae6a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.514+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8e9c0a1260 msgr2=0x7f8e9c0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.514+0000 7f8eb7678700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8e9c0a1260 0x7f8e9c0a3720 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009be0 tx=0x7f8eac009260 comp rx=0 tx=0).stop 2023-08-10T10:49:39.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.514+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8eb0101150 msgr2=0x7f8eb019ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.514+0000 7f8eb7678700 1 --2- 172.21.15.107:0/3213525127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8eb0101150 0x7f8eb019ed70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d950 tx=0x7f8ea000dc60 comp rx=0 tx=0).stop 2023-08-10T10:49:39.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.515+0000 7f8eb5c15700 1 -- 172.21.15.107:0/3213525127 reap_dead start 2023-08-10T10:49:39.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.515+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 shutdown_connections 2023-08-10T10:49:39.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.515+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 >> 172.21.15.107:0/3213525127 conn(0x7f8eb00fc260 msgr2=0x7f8eb010ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:39.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.515+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 shutdown_connections 2023-08-10T10:49:39.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.515+0000 7f8eb7678700 1 -- 172.21.15.107:0/3213525127 wait complete. 2023-08-10T10:49:39.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.611+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3218475185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a8111540 msgr2=0x7f36a8113930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.611+0000 7f36ae8c5700 1 --2- 172.21.15.107:0/3218475185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a8111540 0x7f36a8113930 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f36a000b0a0 tx=0x7f36a000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.611+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3218475185 shutdown_connections 2023-08-10T10:49:39.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.611+0000 7f36ae8c5700 1 --2- 172.21.15.107:0/3218475185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a8111540 0x7f36a8113930 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.611+0000 7f36ae8c5700 1 --2- 172.21.15.107:0/3218475185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36a80fe820 0x7f36a80fec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.611+0000 7f36ae8c5700 1 --2- 172.21.15.107:0/3218475185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36a80ff140 0x7f36a8111000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.611+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3218475185 >> 172.21.15.107:0/3218475185 conn(0x7f36a80767e0 msgr2=0x7f36a80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:39.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.611+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3218475185 shutdown_connections 2023-08-10T10:49:39.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.611+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3218475185 wait complete. 2023-08-10T10:49:39.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.613+0000 7f36ae8c5700 1 Processor -- start 2023-08-10T10:49:39.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.613+0000 7f36ae8c5700 1 -- start start 2023-08-10T10:49:39.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f36ae8c5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36a80fe820 0x7f36a810e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f36ae8c5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a80ff140 0x7f36a810e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f36ae8c5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36a8111540 0x7f36a81072d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f36ae8c5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8107a50 con 0x7f36a80ff140 2023-08-10T10:49:39.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f36ae8c5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8107bc0 con 0x7f36a8111540 2023-08-10T10:49:39.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f36ae8c5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8107d80 con 0x7f36a80fe820 2023-08-10T10:49:39.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f369f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a80ff140 0x7f36a810e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f369f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a80ff140 0x7f36a810e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50114/0 (socket says 172.21.15.107:50114) 2023-08-10T10:49:39.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f369f7fe700 1 -- 172.21.15.107:0/3923421775 learned_addr learned my addr 172.21.15.107:0/3923421775 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:39.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f36a7fff700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36a80fe820 0x7f36a810e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.614+0000 7f36ace62700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36a8111540 0x7f36a81072d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.615+0000 7f369f7fe700 1 -- 172.21.15.107:0/3923421775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36a80fe820 msgr2=0x7f36a810e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.615+0000 7f369f7fe700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36a80fe820 0x7f36a810e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.615+0000 7f369f7fe700 1 -- 172.21.15.107:0/3923421775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36a8111540 msgr2=0x7f36a81072d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.615+0000 7f369f7fe700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36a8111540 0x7f36a81072d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.615+0000 7f369f7fe700 1 -- 172.21.15.107:0/3923421775 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0009d00 con 0x7f36a80ff140 2023-08-10T10:49:39.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.615+0000 7f369f7fe700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a80ff140 0x7f36a810e830 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f369000e9a0 tx=0x7f369000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:39.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.615+0000 7f36a5ffb700 1 -- 172.21.15.107:0/3923421775 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690009790 con 0x7f36a80ff140 2023-08-10T10:49:39.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.615+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a8108060 con 0x7f36a80ff140 2023-08-10T10:49:39.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.616+0000 7f36a5ffb700 1 -- 172.21.15.107:0/3923421775 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3690010430 con 0x7f36a80ff140 2023-08-10T10:49:39.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.616+0000 7f36a5ffb700 1 -- 172.21.15.107:0/3923421775 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369000cea0 con 0x7f36a80ff140 2023-08-10T10:49:39.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.616+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a810c130 con 0x7f36a80ff140 2023-08-10T10:49:39.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.617+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36a8116df0 con 0x7f36a80ff140 2023-08-10T10:49:39.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.621+0000 7f36a5ffb700 1 -- 172.21.15.107:0/3923421775 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f36900105a0 con 0x7f36a80ff140 2023-08-10T10:49:39.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.622+0000 7f36a5ffb700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f36940a1260 0x7f36940a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.622+0000 7f36a5ffb700 1 -- 172.21.15.107:0/3923421775 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f3690014070 con 0x7f36a80ff140 2023-08-10T10:49:39.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.623+0000 7f36a5ffb700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] conn(0x7f36940ac200 0x7f36940ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:39.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.623+0000 7f36a5ffb700 1 -- 172.21.15.107:0/3923421775 --> [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36940aed70 con 0x7f36940ac200 2023-08-10T10:49:39.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.623+0000 7f36a5ffb700 1 -- 172.21.15.107:0/3923421775 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36900cd510 con 0x7f36a80ff140 2023-08-10T10:49:39.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.623+0000 7f36a7fff700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f36940a1260 0x7f36940a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.623+0000 7f36ace62700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] conn(0x7f36940ac200 0x7f36940ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:39.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.624+0000 7f36a7fff700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f36940a1260 0x7f36940a3720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3698007be0 tx=0x7f36980073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:39.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.624+0000 7f36ace62700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] conn(0x7f36940ac200 0x7f36940ae6a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:39.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.625+0000 7f36a5ffb700 1 -- 172.21.15.107:0/3923421775 <== osd.0 v2:172.21.15.107:6802/3090277820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f36940aed70 con 0x7f36940ac200 2023-08-10T10:49:39.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.654+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 --> [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36a804e470 con 0x7f36940ac200 2023-08-10T10:49:39.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36a5ffb700 1 -- 172.21.15.107:0/3923421775 <== osd.0 v2:172.21.15.107:6802/3090277820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36a804e470 con 0x7f36940ac200 2023-08-10T10:49:39.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] conn(0x7f36940ac200 msgr2=0x7f36940ae6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36ae8c5700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] conn(0x7f36940ac200 0x7f36940ae6a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f36940a1260 msgr2=0x7f36940a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36ae8c5700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f36940a1260 0x7f36940a3720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3698007be0 tx=0x7f36980073d0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a80ff140 msgr2=0x7f36a810e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:39.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36ae8c5700 1 --2- 172.21.15.107:0/3923421775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36a80ff140 0x7f36a810e830 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f369000e9a0 tx=0x7f369000ecb0 comp rx=0 tx=0).stop 2023-08-10T10:49:39.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36ace62700 1 -- 172.21.15.107:0/3923421775 reap_dead start 2023-08-10T10:49:39.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 shutdown_connections 2023-08-10T10:49:39.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.655+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 >> 172.21.15.107:0/3923421775 conn(0x7f36a80767e0 msgr2=0x7f36a81100a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:39.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.656+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 shutdown_connections 2023-08-10T10:49:39.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:39.656+0000 7f36ae8c5700 1 -- 172.21.15.107:0/3923421775 wait complete. 2023-08-10T10:49:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.052+0000 7f098cb29700 1 -- 172.21.15.107:0/178361871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09880ffee0 msgr2=0x7f098810cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.052+0000 7f098cb29700 1 --2- 172.21.15.107:0/178361871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09880ffee0 0x7f098810cba0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f097c009990 tx=0x7f097c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.052+0000 7f098cb29700 1 -- 172.21.15.107:0/178361871 shutdown_connections 2023-08-10T10:49:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.052+0000 7f098cb29700 1 --2- 172.21.15.107:0/178361871 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f098810d0e0 0x7f098810f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.052+0000 7f098cb29700 1 --2- 172.21.15.107:0/178361871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09880ff530 0x7f09880ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.052+0000 7f098cb29700 1 --2- 172.21.15.107:0/178361871 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09880ffee0 0x7f098810cba0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.052+0000 7f098cb29700 1 -- 172.21.15.107:0/178361871 >> 172.21.15.107:0/178361871 conn(0x7f09880fb130 msgr2=0x7f09880fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.052+0000 7f098cb29700 1 -- 172.21.15.107:0/178361871 shutdown_connections 2023-08-10T10:49:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.052+0000 7f098cb29700 1 -- 172.21.15.107:0/178361871 wait complete. 2023-08-10T10:49:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.053+0000 7f098cb29700 1 Processor -- start 2023-08-10T10:49:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.053+0000 7f098cb29700 1 -- start start 2023-08-10T10:49:40.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098cb29700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09880ff530 0x7f0988198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098cb29700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09880ffee0 0x7f0988198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098cb29700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f098810d0e0 0x7f098819d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098cb29700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098819d920 con 0x7f09880ff530 2023-08-10T10:49:40.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098cb29700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098819da90 con 0x7f09880ffee0 2023-08-10T10:49:40.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098cb29700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098819dc50 con 0x7f098810d0e0 2023-08-10T10:49:40.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09880ff530 0x7f0988198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:40.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09880ff530 0x7f0988198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50132/0 (socket says 172.21.15.107:50132) 2023-08-10T10:49:40.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098659c700 1 -- 172.21.15.107:0/3110008869 learned_addr learned my addr 172.21.15.107:0/3110008869 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:40.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f0985d9b700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09880ffee0 0x7f0988198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:40.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098659c700 1 -- 172.21.15.107:0/3110008869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f098810d0e0 msgr2=0x7f098819d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098659c700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f098810d0e0 0x7f098819d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098659c700 1 -- 172.21.15.107:0/3110008869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09880ffee0 msgr2=0x7f0988198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098659c700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09880ffee0 0x7f0988198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f098659c700 1 -- 172.21.15.107:0/3110008869 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0095f0 con 0x7f09880ff530 2023-08-10T10:49:40.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.054+0000 7f0985d9b700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09880ffee0 0x7f0988198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:40.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.055+0000 7f098659c700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09880ff530 0x7f0988198970 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f097800d950 tx=0x7f097800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:40.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.055+0000 7f09777fe700 1 -- 172.21.15.107:0/3110008869 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978009b40 con 0x7f09880ff530 2023-08-10T10:49:40.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.055+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098819df30 con 0x7f09880ff530 2023-08-10T10:49:40.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.055+0000 7f09777fe700 1 -- 172.21.15.107:0/3110008869 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0978009ca0 con 0x7f09880ff530 2023-08-10T10:49:40.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.055+0000 7f09777fe700 1 -- 172.21.15.107:0/3110008869 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800f620 con 0x7f09880ff530 2023-08-10T10:49:40.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.055+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09881a57d0 con 0x7f09880ff530 2023-08-10T10:49:40.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.056+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0988112ae0 con 0x7f09880ff530 2023-08-10T10:49:40.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.058+0000 7f09777fe700 1 -- 172.21.15.107:0/3110008869 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f0978010460 con 0x7f09880ff530 2023-08-10T10:49:40.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.059+0000 7f09777fe700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09700a11e0 0x7f09700a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.060+0000 7f09777fe700 1 -- 172.21.15.107:0/3110008869 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f09780cd2a0 con 0x7f09880ff530 2023-08-10T10:49:40.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.060+0000 7f0985d9b700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09700a11e0 0x7f09700a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:40.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.060+0000 7f09777fe700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] conn(0x7f09700ac180 0x7f09700ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.060+0000 7f09777fe700 1 -- 172.21.15.107:0/3110008869 --> [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09700aecf0 con 0x7f09700ac180 2023-08-10T10:49:40.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.060+0000 7f09777fe700 1 -- 172.21.15.107:0/3110008869 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09780cd610 con 0x7f09880ff530 2023-08-10T10:49:40.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.060+0000 7f0986d9d700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] conn(0x7f09700ac180 0x7f09700ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:40.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.060+0000 7f0985d9b700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09700a11e0 0x7f09700a36a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0988199f90 tx=0x7f097c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:40.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.061+0000 7f0986d9d700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] conn(0x7f09700ac180 0x7f09700ae620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:40.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.062+0000 7f09777fe700 1 -- 172.21.15.107:0/3110008869 <== osd.1 v2:172.21.15.157:6800/3276667831 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f09700aecf0 con 0x7f09700ac180 2023-08-10T10:49:40.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.082+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 --> [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f098804e470 con 0x7f09700ac180 2023-08-10T10:49:40.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.083+0000 7f09777fe700 1 -- 172.21.15.107:0/3110008869 <== osd.1 v2:172.21.15.157:6800/3276667831 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f098804e470 con 0x7f09700ac180 2023-08-10T10:49:40.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.083+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 >> [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] conn(0x7f09700ac180 msgr2=0x7f09700ae620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.083+0000 7f098cb29700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] conn(0x7f09700ac180 0x7f09700ae620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.083+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09700a11e0 msgr2=0x7f09700a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.083+0000 7f098cb29700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09700a11e0 0x7f09700a36a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0988199f90 tx=0x7f097c005fb0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.083+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09880ff530 msgr2=0x7f0988198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.083+0000 7f098cb29700 1 --2- 172.21.15.107:0/3110008869 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09880ff530 0x7f0988198970 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f097800d950 tx=0x7f097800dd10 comp rx=0 tx=0).stop 2023-08-10T10:49:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.083+0000 7f0986d9d700 1 -- 172.21.15.107:0/3110008869 reap_dead start 2023-08-10T10:49:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.084+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 shutdown_connections 2023-08-10T10:49:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.084+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 >> 172.21.15.107:0/3110008869 conn(0x7f09880fb130 msgr2=0x7f098810e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.084+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 shutdown_connections 2023-08-10T10:49:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.084+0000 7f098cb29700 1 -- 172.21.15.107:0/3110008869 wait complete. 2023-08-10T10:49:40.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.085+0000 7f1eead5a700 1 -- 172.21.15.107:0/1587349009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4072a90 msgr2=0x7f1ee4072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.085+0000 7f1eead5a700 1 --2- 172.21.15.107:0/1587349009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4072a90 0x7f1ee4072e70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009990 tx=0x7f1ed8009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.085+0000 7f1eead5a700 1 -- 172.21.15.107:0/1587349009 shutdown_connections 2023-08-10T10:49:40.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.085+0000 7f1eead5a700 1 --2- 172.21.15.107:0/1587349009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4072a90 0x7f1ee4072e70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.085+0000 7f1eead5a700 1 --2- 172.21.15.107:0/1587349009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee410d060 0x7f1ee410f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.085+0000 7f1eead5a700 1 --2- 172.21.15.107:0/1587349009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee40733b0 0x7f1ee410cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.085+0000 7f1eead5a700 1 -- 172.21.15.107:0/1587349009 >> 172.21.15.107:0/1587349009 conn(0x7f1ee40fc290 msgr2=0x7f1ee40fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:40.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.085+0000 7f1eead5a700 1 -- 172.21.15.107:0/1587349009 shutdown_connections 2023-08-10T10:49:40.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.086+0000 7f1eead5a700 1 -- 172.21.15.107:0/1587349009 wait complete. 2023-08-10T10:49:40.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.086+0000 7f1eead5a700 1 Processor -- start 2023-08-10T10:49:40.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1eead5a700 1 -- start start 2023-08-10T10:49:40.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1eead5a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4072a90 0x7f1ee419e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1eead5a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee40733b0 0x7f1ee419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1eead5a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee410d060 0x7f1ee4198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1eead5a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4198e70 con 0x7f1ee410d060 2023-08-10T10:49:40.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1eead5a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4198fe0 con 0x7f1ee4072a90 2023-08-10T10:49:40.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1eead5a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee41991a0 con 0x7f1ee40733b0 2023-08-10T10:49:40.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1ee92f7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee410d060 0x7f1ee4198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:40.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1ee92f7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee410d060 0x7f1ee4198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50160/0 (socket says 172.21.15.107:50160) 2023-08-10T10:49:40.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.087+0000 7f1ee92f7700 1 -- 172.21.15.107:0/1820593190 learned_addr learned my addr 172.21.15.107:0/1820593190 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:40.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.088+0000 7f1ee3fff700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee40733b0 0x7f1ee419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:40.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.088+0000 7f1ee8af6700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4072a90 0x7f1ee419e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:40.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.088+0000 7f1ee92f7700 1 -- 172.21.15.107:0/1820593190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee40733b0 msgr2=0x7f1ee419ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.088+0000 7f1ee92f7700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee40733b0 0x7f1ee419ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.088+0000 7f1ee92f7700 1 -- 172.21.15.107:0/1820593190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4072a90 msgr2=0x7f1ee419e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.088+0000 7f1ee92f7700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4072a90 0x7f1ee419e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.088+0000 7f1ee92f7700 1 -- 172.21.15.107:0/1820593190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80095f0 con 0x7f1ee410d060 2023-08-10T10:49:40.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.088+0000 7f1ee8af6700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ee4072a90 0x7f1ee419e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:49:40.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.088+0000 7f1ee92f7700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee410d060 0x7f1ee4198800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00ef30 tx=0x7f1edc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:40.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.089+0000 7f1ee1ffb700 1 -- 172.21.15.107:0/1820593190 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc018070 con 0x7f1ee410d060 2023-08-10T10:49:40.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.089+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee4199420 con 0x7f1ee410d060 2023-08-10T10:49:40.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.089+0000 7f1ee1ffb700 1 -- 172.21.15.107:0/1820593190 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1edc00f040 con 0x7f1ee410d060 2023-08-10T10:49:40.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.089+0000 7f1ee1ffb700 1 -- 172.21.15.107:0/1820593190 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00cbc0 con 0x7f1ee410d060 2023-08-10T10:49:40.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.089+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee41a5770 con 0x7f1ee410d060 2023-08-10T10:49:40.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.090+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ee404e470 con 0x7f1ee410d060 2023-08-10T10:49:40.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.092+0000 7f1ee1ffb700 1 -- 172.21.15.107:0/1820593190 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f1edc00cd40 con 0x7f1ee410d060 2023-08-10T10:49:40.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.093+0000 7f1ee1ffb700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1ed40a11e0 0x7f1ed40a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.093+0000 7f1ee1ffb700 1 -- 172.21.15.107:0/1820593190 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f1edc0cd160 con 0x7f1ee410d060 2023-08-10T10:49:40.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.094+0000 7f1ee8af6700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1ed40a11e0 0x7f1ed40a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:40.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.094+0000 7f1ee1ffb700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] conn(0x7f1ed40ac180 0x7f1ed40ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:40.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.094+0000 7f1ee1ffb700 1 -- 172.21.15.107:0/1820593190 --> [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ed40aecf0 con 0x7f1ed40ac180 2023-08-10T10:49:40.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.094+0000 7f1ee1ffb700 1 -- 172.21.15.107:0/1820593190 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1edc0cd570 con 0x7f1ee410d060 2023-08-10T10:49:40.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.094+0000 7f1ee3fff700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] conn(0x7f1ed40ac180 0x7f1ed40ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:40.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.094+0000 7f1ee8af6700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1ed40a11e0 0x7f1ed40a36a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8006010 tx=0x7f1ed800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:40.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.095+0000 7f1ee3fff700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] conn(0x7f1ed40ac180 0x7f1ed40ae620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:40.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.096+0000 7f1ee1ffb700 1 -- 172.21.15.107:0/1820593190 <== osd.6 v2:172.21.15.107:6818/2967097574 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1ed40aecf0 con 0x7f1ed40ac180 2023-08-10T10:49:40.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.114+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 --> [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ee4112ad0 con 0x7f1ed40ac180 2023-08-10T10:49:40.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1ee1ffb700 1 -- 172.21.15.107:0/1820593190 <== osd.6 v2:172.21.15.107:6818/2967097574 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1ed0009990 con 0x7f1ed40ac180 2023-08-10T10:49:40.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] conn(0x7f1ed40ac180 msgr2=0x7f1ed40ae620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1eead5a700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] conn(0x7f1ed40ac180 0x7f1ed40ae620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1ed40a11e0 msgr2=0x7f1ed40a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1eead5a700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1ed40a11e0 0x7f1ed40a36a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8006010 tx=0x7f1ed800b260 comp rx=0 tx=0).stop 2023-08-10T10:49:40.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee410d060 msgr2=0x7f1ee4198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:40.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1eead5a700 1 --2- 172.21.15.107:0/1820593190 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee410d060 0x7f1ee4198800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00ef30 tx=0x7f1edc00c3a0 comp rx=0 tx=0).stop 2023-08-10T10:49:40.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1ee92f7700 1 -- 172.21.15.107:0/1820593190 reap_dead start 2023-08-10T10:49:40.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 shutdown_connections 2023-08-10T10:49:40.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.115+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 >> 172.21.15.107:0/1820593190 conn(0x7f1ee40fc290 msgr2=0x7f1ee410f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:40.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.116+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 shutdown_connections 2023-08-10T10:49:40.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.116+0000 7f1eead5a700 1 -- 172.21.15.107:0/1820593190 wait complete. 2023-08-10T10:49:41.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:40 smithi107 ceph-mon[127953]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-08-10T10:49:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:40 smithi195 ceph-mon[129938]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-08-10T10:49:41.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:40 smithi157 ceph-mon[129604]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-08-10T10:49:41.363 INFO:teuthology.orchestra.run.smithi107.stdout:34359738452 2023-08-10T10:49:41.364 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-08-10T10:49:41.443 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:41.846 INFO:teuthology.orchestra.run.smithi107.stdout:309237645343 2023-08-10T10:49:41.847 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.10 2023-08-10T10:49:42.057 INFO:teuthology.orchestra.run.smithi107.stdout:197568495668 2023-08-10T10:49:42.058 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-08-10T10:49:42.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.807+0000 7f3169023700 1 -- 172.21.15.107:0/1945734200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3164106790 msgr2=0x7f3164106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:42.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.807+0000 7f3169023700 1 --2- 172.21.15.107:0/1945734200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3164106790 0x7f3164106b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3154009990 tx=0x7f3154009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:42.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.807+0000 7f3169023700 1 -- 172.21.15.107:0/1945734200 shutdown_connections 2023-08-10T10:49:42.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.807+0000 7f3169023700 1 --2- 172.21.15.107:0/1945734200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3164101150 0x7f316410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:42.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.807+0000 7f3169023700 1 --2- 172.21.15.107:0/1945734200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3164106790 0x7f3164106b70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:42.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.807+0000 7f3169023700 1 --2- 172.21.15.107:0/1945734200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3164100790 0x7f3164100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:42.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.807+0000 7f3169023700 1 -- 172.21.15.107:0/1945734200 >> 172.21.15.107:0/1945734200 conn(0x7f31640fc260 msgr2=0x7f31640fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:42.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.807+0000 7f3169023700 1 -- 172.21.15.107:0/1945734200 shutdown_connections 2023-08-10T10:49:42.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.807+0000 7f3169023700 1 -- 172.21.15.107:0/1945734200 wait complete. 2023-08-10T10:49:42.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.808+0000 7f3169023700 1 Processor -- start 2023-08-10T10:49:42.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.808+0000 7f3169023700 1 -- start start 2023-08-10T10:49:42.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.808+0000 7f3169023700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3164100790 0x7f316419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:42.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.808+0000 7f3169023700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3164101150 0x7f316419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:42.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.808+0000 7f3169023700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3164106790 0x7f3164198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:42.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.808+0000 7f3169023700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164199030 con 0x7f3164106790 2023-08-10T10:49:42.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.808+0000 7f3169023700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31641991a0 con 0x7f3164100790 2023-08-10T10:49:42.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.808+0000 7f3169023700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164199360 con 0x7f3164101150 2023-08-10T10:49:42.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3164106790 0x7f3164198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:42.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3164106790 0x7f3164198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50176/0 (socket says 172.21.15.107:50176) 2023-08-10T10:49:42.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316359e700 1 -- 172.21.15.107:0/1877062721 learned_addr learned my addr 172.21.15.107:0/1877062721 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:42.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f3162d9d700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3164100790 0x7f316419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:42.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316359e700 1 -- 172.21.15.107:0/1877062721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3164101150 msgr2=0x7f316419edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:42.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316259c700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3164101150 0x7f316419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:42.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316359e700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3164101150 0x7f316419edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:42.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316359e700 1 -- 172.21.15.107:0/1877062721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3164100790 msgr2=0x7f316419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:42.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316359e700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3164100790 0x7f316419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:42.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316359e700 1 -- 172.21.15.107:0/1877062721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540095f0 con 0x7f3164106790 2023-08-10T10:49:42.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f3162d9d700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3164100790 0x7f316419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:42.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f316359e700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3164106790 0x7f3164198880 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f315c007ee0 tx=0x7f315c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:42.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.809+0000 7f314bfff700 1 -- 172.21.15.107:0/1877062721 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c017070 con 0x7f3164106790 2023-08-10T10:49:42.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.810+0000 7f314bfff700 1 -- 172.21.15.107:0/1877062721 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f315c00f040 con 0x7f3164106790 2023-08-10T10:49:42.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.810+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3164199640 con 0x7f3164106790 2023-08-10T10:49:42.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.810+0000 7f314bfff700 1 -- 172.21.15.107:0/1877062721 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c005710 con 0x7f3164106790 2023-08-10T10:49:42.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.810+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31641a5810 con 0x7f3164106790 2023-08-10T10:49:42.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.810+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f316404e470 con 0x7f3164106790 2023-08-10T10:49:42.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.812+0000 7f314bfff700 1 -- 172.21.15.107:0/1877062721 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f315c005870 con 0x7f3164106790 2023-08-10T10:49:42.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.814+0000 7f314bfff700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f314c0a1260 0x7f314c0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:42.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.814+0000 7f314bfff700 1 -- 172.21.15.107:0/1877062721 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f315c0ccd20 con 0x7f3164106790 2023-08-10T10:49:42.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.814+0000 7f3162d9d700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f314c0a1260 0x7f314c0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:42.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.814+0000 7f314bfff700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] conn(0x7f314c0ac200 0x7f314c0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:42.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.814+0000 7f314bfff700 1 -- 172.21.15.107:0/1877062721 --> [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f314c0aed70 con 0x7f314c0ac200 2023-08-10T10:49:42.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.814+0000 7f314bfff700 1 -- 172.21.15.107:0/1877062721 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f315c0cd090 con 0x7f3164106790 2023-08-10T10:49:42.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.815+0000 7f3162d9d700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f314c0a1260 0x7f314c0a3720 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f315400b5c0 tx=0x7f3154005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:42.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.815+0000 7f316259c700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] conn(0x7f314c0ac200 0x7f314c0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:42.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.815+0000 7f316259c700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] conn(0x7f314c0ac200 0x7f314c0ae6a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:42.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.816+0000 7f314bfff700 1 -- 172.21.15.107:0/1877062721 <== osd.11 v2:172.21.15.195:6824/3972031939 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f314c0aed70 con 0x7f314c0ac200 2023-08-10T10:49:42.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.833+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 --> [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3164110980 con 0x7f314c0ac200 2023-08-10T10:49:42.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f314bfff700 1 -- 172.21.15.107:0/1877062721 <== osd.11 v2:172.21.15.195:6824/3972031939 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f315800a9a0 con 0x7f314c0ac200 2023-08-10T10:49:42.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 >> [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] conn(0x7f314c0ac200 msgr2=0x7f314c0ae6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:42.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] conn(0x7f314c0ac200 0x7f314c0ae6a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:42.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f314c0a1260 msgr2=0x7f314c0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:42.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f314c0a1260 0x7f314c0a3720 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f315400b5c0 tx=0x7f3154005fb0 comp rx=0 tx=0).stop 2023-08-10T10:49:42.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3164106790 msgr2=0x7f3164198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:42.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 --2- 172.21.15.107:0/1877062721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3164106790 0x7f3164198880 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f315c007ee0 tx=0x7f315c00d3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:42.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f316359e700 1 -- 172.21.15.107:0/1877062721 reap_dead start 2023-08-10T10:49:42.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 shutdown_connections 2023-08-10T10:49:42.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 >> 172.21.15.107:0/1877062721 conn(0x7f31640fc260 msgr2=0x7f316410bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:42.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 shutdown_connections 2023-08-10T10:49:42.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:40.834+0000 7f3169023700 1 -- 172.21.15.107:0/1877062721 wait complete. 2023-08-10T10:49:43.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:42 smithi107 ceph-mon[127953]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-08-10T10:49:43.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:42 smithi195 ceph-mon[129938]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-08-10T10:49:43.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:42 smithi157 ceph-mon[129604]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-08-10T10:49:43.863 INFO:teuthology.orchestra.run.smithi107.stdout:55834574927 2023-08-10T10:49:43.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-08-10T10:49:44.279 INFO:teuthology.orchestra.run.smithi107.stdout:343597383706 2023-08-10T10:49:44.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.11 2023-08-10T10:49:44.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.453+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2090233024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20bc100790 msgr2=0x7f20bc100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.453+0000 7f20c2bc6700 1 --2- 172.21.15.107:0/2090233024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20bc100790 0x7f20bc100c10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009990 tx=0x7f20a8009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.453+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2090233024 shutdown_connections 2023-08-10T10:49:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.453+0000 7f20c2bc6700 1 --2- 172.21.15.107:0/2090233024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20bc101150 0x7f20bc10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.453+0000 7f20c2bc6700 1 --2- 172.21.15.107:0/2090233024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc106790 0x7f20bc106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.453+0000 7f20c2bc6700 1 --2- 172.21.15.107:0/2090233024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20bc100790 0x7f20bc100c10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.453+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2090233024 >> 172.21.15.107:0/2090233024 conn(0x7f20bc0fc260 msgr2=0x7f20bc0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:44.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.453+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2090233024 shutdown_connections 2023-08-10T10:49:44.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.453+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2090233024 wait complete. 2023-08-10T10:49:44.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.455+0000 7f20c2bc6700 1 Processor -- start 2023-08-10T10:49:44.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.455+0000 7f20c2bc6700 1 -- start start 2023-08-10T10:49:44.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c2bc6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc100790 0x7f20bc19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c2bc6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20bc101150 0x7f20bc19ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c2bc6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20bc106790 0x7f20bc1965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c2bc6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc196c30 con 0x7f20bc106790 2023-08-10T10:49:44.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c2bc6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc196da0 con 0x7f20bc101150 2023-08-10T10:49:44.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c2bc6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc196f60 con 0x7f20bc100790 2023-08-10T10:49:44.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c1163700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20bc106790 0x7f20bc1965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c1163700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20bc106790 0x7f20bc1965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53622/0 (socket says 172.21.15.107:53622) 2023-08-10T10:49:44.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c1163700 1 -- 172.21.15.107:0/2733706675 learned_addr learned my addr 172.21.15.107:0/2733706675 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20c0962700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc100790 0x7f20bc19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.456+0000 7f20bbfff700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20bc101150 0x7f20bc19ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.457+0000 7f20c1163700 1 -- 172.21.15.107:0/2733706675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc100790 msgr2=0x7f20bc19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.457+0000 7f20c1163700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20bc100790 0x7f20bc19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.457+0000 7f20c1163700 1 -- 172.21.15.107:0/2733706675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20bc101150 msgr2=0x7f20bc19ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.457+0000 7f20c1163700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20bc101150 0x7f20bc19ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.457+0000 7f20c1163700 1 -- 172.21.15.107:0/2733706675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a80095f0 con 0x7f20bc106790 2023-08-10T10:49:44.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.457+0000 7f20c1163700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20bc106790 0x7f20bc1965c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f20b4007d70 tx=0x7f20b400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.457+0000 7f20b9ffb700 1 -- 172.21.15.107:0/2733706675 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b400ac90 con 0x7f20bc106790 2023-08-10T10:49:44.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.457+0000 7f20b9ffb700 1 -- 172.21.15.107:0/2733706675 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20b400adf0 con 0x7f20bc106790 2023-08-10T10:49:44.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.457+0000 7f20b9ffb700 1 -- 172.21.15.107:0/2733706675 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b40115e0 con 0x7f20bc106790 2023-08-10T10:49:44.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.458+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc197240 con 0x7f20bc106790 2023-08-10T10:49:44.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.458+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc1a3530 con 0x7f20bc106790 2023-08-10T10:49:44.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.459+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20bc110980 con 0x7f20bc106790 2023-08-10T10:49:44.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.461+0000 7f20b9ffb700 1 -- 172.21.15.107:0/2733706675 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f20b4004ad0 con 0x7f20bc106790 2023-08-10T10:49:44.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.463+0000 7f20b9ffb700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f20ac0a1330 0x7f20ac0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.463+0000 7f20b9ffb700 1 -- 172.21.15.107:0/2733706675 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f20b40cd190 con 0x7f20bc106790 2023-08-10T10:49:44.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.463+0000 7f20c0962700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f20ac0a1330 0x7f20ac0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.463+0000 7f20b9ffb700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] conn(0x7f20ac0ac2d0 0x7f20ac0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.463+0000 7f20b9ffb700 1 -- 172.21.15.107:0/2733706675 --> [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20ac0aee40 con 0x7f20ac0ac2d0 2023-08-10T10:49:44.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.463+0000 7f20b9ffb700 1 -- 172.21.15.107:0/2733706675 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20b40cd500 con 0x7f20bc106790 2023-08-10T10:49:44.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.464+0000 7f20bbfff700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] conn(0x7f20ac0ac2d0 0x7f20ac0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.464+0000 7f20c0962700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f20ac0a1330 0x7f20ac0a37f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009be0 tx=0x7f20b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.464+0000 7f20bbfff700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] conn(0x7f20ac0ac2d0 0x7f20ac0ae770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.466+0000 7f20b9ffb700 1 -- 172.21.15.107:0/2733706675 <== osd.7 v2:172.21.15.157:6816/3040537595 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f20ac0aee40 con 0x7f20ac0ac2d0 2023-08-10T10:49:44.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.487+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 --> [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20bc04e470 con 0x7f20ac0ac2d0 2023-08-10T10:49:44.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.488+0000 7f20b9ffb700 1 -- 172.21.15.107:0/2733706675 <== osd.7 v2:172.21.15.157:6816/3040537595 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f20bc04e470 con 0x7f20ac0ac2d0 2023-08-10T10:49:44.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.489+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 >> [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] conn(0x7f20ac0ac2d0 msgr2=0x7f20ac0ae770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.489+0000 7f20c2bc6700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] conn(0x7f20ac0ac2d0 0x7f20ac0ae770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.489+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f20ac0a1330 msgr2=0x7f20ac0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.489+0000 7f20c2bc6700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f20ac0a1330 0x7f20ac0a37f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009be0 tx=0x7f20b0009260 comp rx=0 tx=0).stop 2023-08-10T10:49:44.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.489+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20bc106790 msgr2=0x7f20bc1965c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.489+0000 7f20c2bc6700 1 --2- 172.21.15.107:0/2733706675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20bc106790 0x7f20bc1965c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f20b4007d70 tx=0x7f20b400a340 comp rx=0 tx=0).stop 2023-08-10T10:49:44.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.489+0000 7f20c1163700 1 -- 172.21.15.107:0/2733706675 reap_dead start 2023-08-10T10:49:44.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.489+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 shutdown_connections 2023-08-10T10:49:44.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.489+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 >> 172.21.15.107:0/2733706675 conn(0x7f20bc0fc260 msgr2=0x7f20bc1042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:44.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.490+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 shutdown_connections 2023-08-10T10:49:44.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.490+0000 7f20c2bc6700 1 -- 172.21.15.107:0/2733706675 wait complete. 2023-08-10T10:49:44.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.662+0000 7f99190aa700 1 -- 172.21.15.107:0/1236248143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f991410cfd0 msgr2=0x7f991410f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.662+0000 7f99190aa700 1 --2- 172.21.15.107:0/1236248143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f991410cfd0 0x7f991410f440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f990c00b0a0 tx=0x7f990c00b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.662+0000 7f99190aa700 1 -- 172.21.15.107:0/1236248143 shutdown_connections 2023-08-10T10:49:44.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.662+0000 7f99190aa700 1 --2- 172.21.15.107:0/1236248143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9914072ba0 0x7f9914072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.662+0000 7f99190aa700 1 --2- 172.21.15.107:0/1236248143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f991410cfd0 0x7f991410f440 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.662+0000 7f99190aa700 1 --2- 172.21.15.107:0/1236248143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140734c0 0x7f991410ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.662+0000 7f99190aa700 1 -- 172.21.15.107:0/1236248143 >> 172.21.15.107:0/1236248143 conn(0x7f99140fc260 msgr2=0x7f99140fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:44.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.663+0000 7f99190aa700 1 -- 172.21.15.107:0/1236248143 shutdown_connections 2023-08-10T10:49:44.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.663+0000 7f99190aa700 1 -- 172.21.15.107:0/1236248143 wait complete. 2023-08-10T10:49:44.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f99190aa700 1 Processor -- start 2023-08-10T10:49:44.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f99190aa700 1 -- start start 2023-08-10T10:49:44.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f99190aa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9914072ba0 0x7f991419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f99190aa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140734c0 0x7f991419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f99190aa700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f991410cfd0 0x7f99141988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f99190aa700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9914199090 con 0x7f9914072ba0 2023-08-10T10:49:44.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f99190aa700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9914199200 con 0x7f991410cfd0 2023-08-10T10:49:44.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f99190aa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99141993c0 con 0x7f99140734c0 2023-08-10T10:49:44.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f9912d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9914072ba0 0x7f991419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f9912d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9914072ba0 0x7f991419e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53650/0 (socket says 172.21.15.107:53650) 2023-08-10T10:49:44.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.664+0000 7f9912d9d700 1 -- 172.21.15.107:0/1918381222 learned_addr learned my addr 172.21.15.107:0/1918381222 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:44.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f991359e700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f991410cfd0 0x7f99141988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f991259c700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140734c0 0x7f991419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f9912d9d700 1 -- 172.21.15.107:0/1918381222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140734c0 msgr2=0x7f991419edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f9912d9d700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140734c0 0x7f991419edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f9912d9d700 1 -- 172.21.15.107:0/1918381222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f991410cfd0 msgr2=0x7f99141988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f9912d9d700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f991410cfd0 0x7f99141988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f9912d9d700 1 -- 172.21.15.107:0/1918381222 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c009d00 con 0x7f9914072ba0 2023-08-10T10:49:44.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f991259c700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140734c0 0x7f991419edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:44.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f9912d9d700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9914072ba0 0x7f991419e880 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f990400e9a0 tx=0x7f990400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f98fbfff700 1 -- 172.21.15.107:0/1918381222 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904009790 con 0x7f9914072ba0 2023-08-10T10:49:44.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f98fbfff700 1 -- 172.21.15.107:0/1918381222 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f990400cbd0 con 0x7f9914072ba0 2023-08-10T10:49:44.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f98fbfff700 1 -- 172.21.15.107:0/1918381222 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904018680 con 0x7f9914072ba0 2023-08-10T10:49:44.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99141996a0 con 0x7f9914072ba0 2023-08-10T10:49:44.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.665+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99141a5800 con 0x7f9914072ba0 2023-08-10T10:49:44.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.666+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9914112a40 con 0x7f9914072ba0 2023-08-10T10:49:44.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.668+0000 7f98fbfff700 1 -- 172.21.15.107:0/1918381222 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f990400cd40 con 0x7f9914072ba0 2023-08-10T10:49:44.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.670+0000 7f98fbfff700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f98fc0a1260 0x7f98fc0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.670+0000 7f98fbfff700 1 -- 172.21.15.107:0/1918381222 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f9904014070 con 0x7f9914072ba0 2023-08-10T10:49:44.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.670+0000 7f991259c700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f98fc0a1260 0x7f98fc0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.670+0000 7f98fbfff700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] conn(0x7f98fc0ac200 0x7f98fc0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:44.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.670+0000 7f98fbfff700 1 -- 172.21.15.107:0/1918381222 --> [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98fc0aed70 con 0x7f98fc0ac200 2023-08-10T10:49:44.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.670+0000 7f98fbfff700 1 -- 172.21.15.107:0/1918381222 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99040cd7f0 con 0x7f9914072ba0 2023-08-10T10:49:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.670+0000 7f991359e700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] conn(0x7f98fc0ac200 0x7f98fc0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.671+0000 7f991259c700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f98fc0a1260 0x7f98fc0a3720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f991419a0a0 tx=0x7f9908009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.671+0000 7f991359e700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] conn(0x7f98fc0ac200 0x7f98fc0ae6a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.672+0000 7f98fbfff700 1 -- 172.21.15.107:0/1918381222 <== osd.9 v2:172.21.15.107:6826/48908016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f98fc0aed70 con 0x7f98fc0ac200 2023-08-10T10:49:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.688+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 --> [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99140fe1a0 con 0x7f98fc0ac200 2023-08-10T10:49:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.689+0000 7f98fbfff700 1 -- 172.21.15.107:0/1918381222 <== osd.9 v2:172.21.15.107:6826/48908016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f99140fe1a0 con 0x7f98fc0ac200 2023-08-10T10:49:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.689+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] conn(0x7f98fc0ac200 msgr2=0x7f98fc0ae6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.689+0000 7f99190aa700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] conn(0x7f98fc0ac200 0x7f98fc0ae6a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.689+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f98fc0a1260 msgr2=0x7f98fc0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.689+0000 7f99190aa700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f98fc0a1260 0x7f98fc0a3720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f991419a0a0 tx=0x7f9908009260 comp rx=0 tx=0).stop 2023-08-10T10:49:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.689+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9914072ba0 msgr2=0x7f991419e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.689+0000 7f99190aa700 1 --2- 172.21.15.107:0/1918381222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9914072ba0 0x7f991419e880 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f990400e9a0 tx=0x7f990400ecb0 comp rx=0 tx=0).stop 2023-08-10T10:49:44.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.689+0000 7f991359e700 1 -- 172.21.15.107:0/1918381222 reap_dead start 2023-08-10T10:49:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.690+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 shutdown_connections 2023-08-10T10:49:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.690+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 >> 172.21.15.107:0/1918381222 conn(0x7f99140fc260 msgr2=0x7f991410f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.690+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 shutdown_connections 2023-08-10T10:49:44.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:44.690+0000 7f99190aa700 1 -- 172.21.15.107:0/1918381222 wait complete. 2023-08-10T10:49:44.726 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:44.729 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:45.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:44 smithi107 ceph-mon[127953]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-08-10T10:49:45.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:44 smithi195 ceph-mon[129938]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-08-10T10:49:45.284 INFO:teuthology.orchestra.run.smithi107.stdout:219043332143 2023-08-10T10:49:45.285 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-08-10T10:49:45.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:44 smithi157 ceph-mon[129604]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-08-10T10:49:45.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.757+0000 7efd87001700 1 -- 172.21.15.107:0/4127929137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd8010cfd0 msgr2=0x7efd8010f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.757+0000 7efd87001700 1 --2- 172.21.15.107:0/4127929137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd8010cfd0 0x7efd8010f440 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efd7800b0a0 tx=0x7efd7800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.757+0000 7efd87001700 1 -- 172.21.15.107:0/4127929137 shutdown_connections 2023-08-10T10:49:45.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.757+0000 7efd87001700 1 --2- 172.21.15.107:0/4127929137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd8010cfd0 0x7efd8010f440 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.757+0000 7efd87001700 1 --2- 172.21.15.107:0/4127929137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd80072ba0 0x7efd80072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.757+0000 7efd87001700 1 --2- 172.21.15.107:0/4127929137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd800734c0 0x7efd8010ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.757+0000 7efd87001700 1 -- 172.21.15.107:0/4127929137 >> 172.21.15.107:0/4127929137 conn(0x7efd800fc260 msgr2=0x7efd800fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:45.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.757+0000 7efd87001700 1 -- 172.21.15.107:0/4127929137 shutdown_connections 2023-08-10T10:49:45.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.757+0000 7efd87001700 1 -- 172.21.15.107:0/4127929137 wait complete. 2023-08-10T10:49:45.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.758+0000 7efd87001700 1 Processor -- start 2023-08-10T10:49:45.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.758+0000 7efd87001700 1 -- start start 2023-08-10T10:49:45.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.758+0000 7efd87001700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd80072ba0 0x7efd8019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.758+0000 7efd87001700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800734c0 0x7efd8019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.758+0000 7efd87001700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd8010cfd0 0x7efd801988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.758+0000 7efd87001700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80198f50 con 0x7efd800734c0 2023-08-10T10:49:45.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.758+0000 7efd87001700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd801990c0 con 0x7efd80072ba0 2023-08-10T10:49:45.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.758+0000 7efd87001700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80199280 con 0x7efd8010cfd0 2023-08-10T10:49:45.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd7ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800734c0 0x7efd8019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd7ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800734c0 0x7efd8019eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53676/0 (socket says 172.21.15.107:53676) 2023-08-10T10:49:45.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd7ffff700 1 -- 172.21.15.107:0/3208097032 learned_addr learned my addr 172.21.15.107:0/3208097032 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:45.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd8559e700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd8010cfd0 0x7efd801988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd84d9d700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd80072ba0 0x7efd8019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd7ffff700 1 -- 172.21.15.107:0/3208097032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd8010cfd0 msgr2=0x7efd801988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd7ffff700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd8010cfd0 0x7efd801988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd7ffff700 1 -- 172.21.15.107:0/3208097032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd80072ba0 msgr2=0x7efd8019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd7ffff700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd80072ba0 0x7efd8019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd7ffff700 1 -- 172.21.15.107:0/3208097032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009d00 con 0x7efd800734c0 2023-08-10T10:49:45.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.759+0000 7efd84d9d700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd80072ba0 0x7efd8019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:45.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.760+0000 7efd7ffff700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800734c0 0x7efd8019eda0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00e9a0 tx=0x7efd6c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:45.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.760+0000 7efd7dffb700 1 -- 172.21.15.107:0/3208097032 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c009790 con 0x7efd800734c0 2023-08-10T10:49:45.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.760+0000 7efd7dffb700 1 -- 172.21.15.107:0/3208097032 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd6c00cbd0 con 0x7efd800734c0 2023-08-10T10:49:45.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.760+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd80199560 con 0x7efd800734c0 2023-08-10T10:49:45.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.760+0000 7efd7dffb700 1 -- 172.21.15.107:0/3208097032 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c018680 con 0x7efd800734c0 2023-08-10T10:49:45.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.760+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd801a5850 con 0x7efd800734c0 2023-08-10T10:49:45.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.761+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd8004e470 con 0x7efd800734c0 2023-08-10T10:49:45.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.763+0000 7efd7dffb700 1 -- 172.21.15.107:0/3208097032 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7efd6c00cd40 con 0x7efd800734c0 2023-08-10T10:49:45.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.766+0000 7efd7dffb700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efd700a1260 0x7efd700a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.766+0000 7efd7dffb700 1 -- 172.21.15.107:0/3208097032 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7efd6c014070 con 0x7efd800734c0 2023-08-10T10:49:45.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.766+0000 7efd84d9d700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efd700a1260 0x7efd700a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.766+0000 7efd7dffb700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] conn(0x7efd700ac200 0x7efd700ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.766+0000 7efd7dffb700 1 -- 172.21.15.107:0/3208097032 --> [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd700aed70 con 0x7efd700ac200 2023-08-10T10:49:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.766+0000 7efd7dffb700 1 -- 172.21.15.107:0/3208097032 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd6c0cd790 con 0x7efd800734c0 2023-08-10T10:49:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.766+0000 7efd84d9d700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efd700a1260 0x7efd700a3720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efd74005950 tx=0x7efd740058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:45.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.767+0000 7efd8559e700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] conn(0x7efd700ac200 0x7efd700ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:45.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.767+0000 7efd8559e700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] conn(0x7efd700ac200 0x7efd700ae6a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:45.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.768+0000 7efd7dffb700 1 -- 172.21.15.107:0/3208097032 <== osd.5 v2:172.21.15.195:6808/922097042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efd700aed70 con 0x7efd700ac200 2023-08-10T10:49:45.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.786+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 --> [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd800fe120 con 0x7efd700ac200 2023-08-10T10:49:45.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.786+0000 7efd7dffb700 1 -- 172.21.15.107:0/3208097032 <== osd.5 v2:172.21.15.195:6808/922097042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efd800fe120 con 0x7efd700ac200 2023-08-10T10:49:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 >> [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] conn(0x7efd700ac200 msgr2=0x7efd700ae6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] conn(0x7efd700ac200 0x7efd700ae6a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efd700a1260 msgr2=0x7efd700a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7efd700a1260 0x7efd700a3720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efd74005950 tx=0x7efd740058e0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800734c0 msgr2=0x7efd8019eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 --2- 172.21.15.107:0/3208097032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd800734c0 0x7efd8019eda0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00e9a0 tx=0x7efd6c00ecb0 comp rx=0 tx=0).stop 2023-08-10T10:49:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd8559e700 1 -- 172.21.15.107:0/3208097032 reap_dead start 2023-08-10T10:49:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 shutdown_connections 2023-08-10T10:49:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 >> 172.21.15.107:0/3208097032 conn(0x7efd800fc260 msgr2=0x7efd8010f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 shutdown_connections 2023-08-10T10:49:45.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.787+0000 7efd87001700 1 -- 172.21.15.107:0/3208097032 wait complete. 2023-08-10T10:49:46.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.867+0000 7f0a02e64700 1 -- 172.21.15.107:0/4242084734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09fc101150 msgr2=0x7f09fc10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.867+0000 7f0a02e64700 1 --2- 172.21.15.107:0/4242084734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09fc101150 0x7f09fc10d660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f09f400b0a0 tx=0x7f09f400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.868+0000 7f0a02e64700 1 -- 172.21.15.107:0/4242084734 shutdown_connections 2023-08-10T10:49:46.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.868+0000 7f0a02e64700 1 --2- 172.21.15.107:0/4242084734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09fc106790 0x7f09fc106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.868+0000 7f0a02e64700 1 --2- 172.21.15.107:0/4242084734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09fc101150 0x7f09fc10d660 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.868+0000 7f0a02e64700 1 --2- 172.21.15.107:0/4242084734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09fc100790 0x7f09fc100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.868+0000 7f0a02e64700 1 -- 172.21.15.107:0/4242084734 >> 172.21.15.107:0/4242084734 conn(0x7f09fc0fc260 msgr2=0x7f09fc0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:46.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.868+0000 7f0a02e64700 1 -- 172.21.15.107:0/4242084734 shutdown_connections 2023-08-10T10:49:46.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.868+0000 7f0a02e64700 1 -- 172.21.15.107:0/4242084734 wait complete. 2023-08-10T10:49:46.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.869+0000 7f0a02e64700 1 Processor -- start 2023-08-10T10:49:46.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.869+0000 7f0a02e64700 1 -- start start 2023-08-10T10:49:46.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.870+0000 7f0a02e64700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09fc100790 0x7f09fc072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.870+0000 7f0a02e64700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09fc101150 0x7f09fc072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.870+0000 7f0a02e64700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09fc106790 0x7f09fc073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.870+0000 7f0a02e64700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc1a4cf0 con 0x7f09fc101150 2023-08-10T10:49:46.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.870+0000 7f0a02e64700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc1a4e60 con 0x7f09fc100790 2023-08-10T10:49:46.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.870+0000 7f0a02e64700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc1a5020 con 0x7f09fc106790 2023-08-10T10:49:46.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.870+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09fc101150 0x7f09fc072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.870+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09fc101150 0x7f09fc072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53702/0 (socket says 172.21.15.107:53702) 2023-08-10T10:49:46.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.870+0000 7f09fbfff700 1 -- 172.21.15.107:0/1886826359 learned_addr learned my addr 172.21.15.107:0/1886826359 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:46.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f0a00c00700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09fc100790 0x7f09fc072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f0a01401700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09fc106790 0x7f09fc073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f09fbfff700 1 -- 172.21.15.107:0/1886826359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09fc106790 msgr2=0x7f09fc073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f09fbfff700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09fc106790 0x7f09fc073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f09fbfff700 1 -- 172.21.15.107:0/1886826359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09fc100790 msgr2=0x7f09fc072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f09fbfff700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09fc100790 0x7f09fc072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f09fbfff700 1 -- 172.21.15.107:0/1886826359 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4009d00 con 0x7f09fc101150 2023-08-10T10:49:46.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f09fbfff700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09fc101150 0x7f09fc072fb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f09e800e9a0 tx=0x7f09e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:46.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f09f9ffb700 1 -- 172.21.15.107:0/1886826359 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8009790 con 0x7f09fc101150 2023-08-10T10:49:46.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f09f9ffb700 1 -- 172.21.15.107:0/1886826359 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f09e8010430 con 0x7f09fc101150 2023-08-10T10:49:46.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f09f9ffb700 1 -- 172.21.15.107:0/1886826359 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800cea0 con 0x7f09fc101150 2023-08-10T10:49:46.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.871+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc1a5300 con 0x7f09fc101150 2023-08-10T10:49:46.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.872+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc1a57b0 con 0x7f09fc101150 2023-08-10T10:49:46.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.872+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09fc04e470 con 0x7f09fc101150 2023-08-10T10:49:46.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.875+0000 7f09f9ffb700 1 -- 172.21.15.107:0/1886826359 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f09e80105a0 con 0x7f09fc101150 2023-08-10T10:49:46.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.876+0000 7f09f9ffb700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09ec0a11e0 0x7f09ec0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.876+0000 7f09f9ffb700 1 -- 172.21.15.107:0/1886826359 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f09e8014070 con 0x7f09fc101150 2023-08-10T10:49:46.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.876+0000 7f0a00c00700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09ec0a11e0 0x7f09ec0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.876+0000 7f09f9ffb700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] conn(0x7f09ec0ac180 0x7f09ec0ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:46.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.876+0000 7f09f9ffb700 1 -- 172.21.15.107:0/1886826359 --> [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09ec0aecf0 con 0x7f09ec0ac180 2023-08-10T10:49:46.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.876+0000 7f09f9ffb700 1 -- 172.21.15.107:0/1886826359 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09e80cd5d0 con 0x7f09fc101150 2023-08-10T10:49:46.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.877+0000 7f0a00c00700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09ec0a11e0 0x7f09ec0a36a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009be0 tx=0x7f09f0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:46.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.877+0000 7f0a01401700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] conn(0x7f09ec0ac180 0x7f09ec0ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:46.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.877+0000 7f0a01401700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] conn(0x7f09ec0ac180 0x7f09ec0ae620 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:46.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.879+0000 7f09f9ffb700 1 -- 172.21.15.107:0/1886826359 <== osd.8 v2:172.21.15.195:6816/2721690831 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f09ec0aecf0 con 0x7f09ec0ac180 2023-08-10T10:49:46.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.897+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 --> [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09fc110930 con 0x7f09ec0ac180 2023-08-10T10:49:46.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f09f9ffb700 1 -- 172.21.15.107:0/1886826359 <== osd.8 v2:172.21.15.195:6816/2721690831 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f09f4009b80 con 0x7f09ec0ac180 2023-08-10T10:49:46.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 >> [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] conn(0x7f09ec0ac180 msgr2=0x7f09ec0ae620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] conn(0x7f09ec0ac180 0x7f09ec0ae620 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09ec0a11e0 msgr2=0x7f09ec0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f09ec0a11e0 0x7f09ec0a36a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009be0 tx=0x7f09f0009260 comp rx=0 tx=0).stop 2023-08-10T10:49:46.117 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09fc101150 msgr2=0x7f09fc072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:46.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 --2- 172.21.15.107:0/1886826359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09fc101150 0x7f09fc072fb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f09e800e9a0 tx=0x7f09e800ecb0 comp rx=0 tx=0).stop 2023-08-10T10:49:46.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a01401700 1 -- 172.21.15.107:0/1886826359 reap_dead start 2023-08-10T10:49:46.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 shutdown_connections 2023-08-10T10:49:46.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 >> 172.21.15.107:0/1886826359 conn(0x7f09fc0fc260 msgr2=0x7f09fc0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:46.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 shutdown_connections 2023-08-10T10:49:46.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:45.898+0000 7f0a02e64700 1 -- 172.21.15.107:0/1886826359 wait complete. 2023-08-10T10:49:46.610 INFO:teuthology.orchestra.run.smithi107.stdout:287762808869 2023-08-10T10:49:46.610 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.9 2023-08-10T10:49:46.693 INFO:teuthology.orchestra.run.smithi107.stdout:163208757307 2023-08-10T10:49:46.693 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-08-10T10:49:46.876 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:47.087 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:46 smithi107 ceph-mon[127953]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 11 op/s 2023-08-10T10:49:47.087 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:46 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:49:47.089 INFO:teuthology.orchestra.run.smithi107.stdout:253403070507 2023-08-10T10:49:47.089 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.8 2023-08-10T10:49:47.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:46 smithi195 ceph-mon[129938]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 11 op/s 2023-08-10T10:49:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:46 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:49:47.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.849+0000 7f8a15226700 1 -- 172.21.15.107:0/2035616007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a10106790 msgr2=0x7f8a10106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.849+0000 7f8a15226700 1 --2- 172.21.15.107:0/2035616007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a10106790 0x7f8a10106b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a000098f0 tx=0x7f8a00009c00 comp rx=0 tx=0).stop 2023-08-10T10:49:47.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.849+0000 7f8a15226700 1 -- 172.21.15.107:0/2035616007 shutdown_connections 2023-08-10T10:49:47.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.849+0000 7f8a15226700 1 --2- 172.21.15.107:0/2035616007 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a10101150 0x7f8a1010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.849+0000 7f8a15226700 1 --2- 172.21.15.107:0/2035616007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a10106790 0x7f8a10106b70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.849+0000 7f8a15226700 1 --2- 172.21.15.107:0/2035616007 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a10100790 0x7f8a10100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.849+0000 7f8a15226700 1 -- 172.21.15.107:0/2035616007 >> 172.21.15.107:0/2035616007 conn(0x7f8a100fc260 msgr2=0x7f8a100fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:47.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.849+0000 7f8a15226700 1 -- 172.21.15.107:0/2035616007 shutdown_connections 2023-08-10T10:49:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.849+0000 7f8a15226700 1 -- 172.21.15.107:0/2035616007 wait complete. 2023-08-10T10:49:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.850+0000 7f8a15226700 1 Processor -- start 2023-08-10T10:49:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.851+0000 7f8a15226700 1 -- start start 2023-08-10T10:49:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.851+0000 7f8a15226700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a10100790 0x7f8a10072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.851+0000 7f8a15226700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a10101150 0x7f8a10072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.851+0000 7f8a15226700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a10106790 0x7f8a101a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.851+0000 7f8a15226700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100738a0 con 0x7f8a10101150 2023-08-10T10:49:47.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.851+0000 7f8a15226700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101a4f90 con 0x7f8a10106790 2023-08-10T10:49:47.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.851+0000 7f8a15226700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101a5100 con 0x7f8a10100790 2023-08-10T10:49:47.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a10101150 0x7f8a10072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0f59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a10106790 0x7f8a101a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a10101150 0x7f8a10072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53716/0 (socket says 172.21.15.107:53716) 2023-08-10T10:49:47.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0e59c700 1 -- 172.21.15.107:0/1896398176 learned_addr learned my addr 172.21.15.107:0/1896398176 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:47.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0ed9d700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a10100790 0x7f8a10072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0f59e700 1 -- 172.21.15.107:0/1896398176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a10100790 msgr2=0x7f8a10072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0f59e700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a10100790 0x7f8a10072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0f59e700 1 -- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a10101150 msgr2=0x7f8a10072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0f59e700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a10101150 0x7f8a10072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0f59e700 1 -- 172.21.15.107:0/1896398176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00009520 con 0x7f8a10106790 2023-08-10T10:49:47.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.852+0000 7f8a0f59e700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a10106790 0x7f8a101a4a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800efc0 tx=0x7f8a0800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:47.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.853+0000 7f89f7fff700 1 -- 172.21.15.107:0/1896398176 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08018070 con 0x7f8a10106790 2023-08-10T10:49:47.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.853+0000 7f89f7fff700 1 -- 172.21.15.107:0/1896398176 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a0800f040 con 0x7f8a10106790 2023-08-10T10:49:47.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.853+0000 7f89f7fff700 1 -- 172.21.15.107:0/1896398176 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800cba0 con 0x7f8a10106790 2023-08-10T10:49:47.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.853+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a101a5320 con 0x7f8a10106790 2023-08-10T10:49:47.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.854+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a101a57a0 con 0x7f8a10106790 2023-08-10T10:49:47.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.855+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a10110900 con 0x7f8a10106790 2023-08-10T10:49:47.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.857+0000 7f89f7fff700 1 -- 172.21.15.107:0/1896398176 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8a08003a00 con 0x7f8a10106790 2023-08-10T10:49:47.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.858+0000 7f89f7fff700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89f80a11e0 0x7f89f80a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.859+0000 7f89f7fff700 1 -- 172.21.15.107:0/1896398176 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f8a080cca10 con 0x7f8a10106790 2023-08-10T10:49:47.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.859+0000 7f8a0ed9d700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89f80a11e0 0x7f89f80a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.859+0000 7f89f7fff700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] conn(0x7f89f80ac180 0x7f89f80ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:47.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.859+0000 7f89f7fff700 1 -- 172.21.15.107:0/1896398176 --> [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89f80aecf0 con 0x7f89f80ac180 2023-08-10T10:49:47.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.859+0000 7f89f7fff700 1 -- 172.21.15.107:0/1896398176 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a080ccd80 con 0x7f8a10106790 2023-08-10T10:49:47.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.859+0000 7f8a0e59c700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] conn(0x7f89f80ac180 0x7f89f80ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:47.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.860+0000 7f8a0ed9d700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89f80a11e0 0x7f89f80a36a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8a00005e90 tx=0x7f8a00019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:47.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.860+0000 7f8a0e59c700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] conn(0x7f89f80ac180 0x7f89f80ae620 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:47.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.861+0000 7f89f7fff700 1 -- 172.21.15.107:0/1896398176 <== osd.3 v2:172.21.15.107:6810/3845563579 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f89f80aecf0 con 0x7f89f80ac180 2023-08-10T10:49:47.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.884+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 --> [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a1004e470 con 0x7f89f80ac180 2023-08-10T10:49:47.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.884+0000 7f89f7fff700 1 -- 172.21.15.107:0/1896398176 <== osd.3 v2:172.21.15.107:6810/3845563579 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8a1004e470 con 0x7f89f80ac180 2023-08-10T10:49:47.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.885+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] conn(0x7f89f80ac180 msgr2=0x7f89f80ae620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.885+0000 7f8a15226700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] conn(0x7f89f80ac180 0x7f89f80ae620 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.885+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89f80a11e0 msgr2=0x7f89f80a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.885+0000 7f8a15226700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89f80a11e0 0x7f89f80a36a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8a00005e90 tx=0x7f8a00019040 comp rx=0 tx=0).stop 2023-08-10T10:49:47.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.885+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a10106790 msgr2=0x7f8a101a4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:47.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.885+0000 7f8a15226700 1 --2- 172.21.15.107:0/1896398176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a10106790 0x7f8a101a4a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800efc0 tx=0x7f8a0800c3a0 comp rx=0 tx=0).stop 2023-08-10T10:49:47.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.885+0000 7f8a0f59e700 1 -- 172.21.15.107:0/1896398176 reap_dead start 2023-08-10T10:49:47.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.885+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 shutdown_connections 2023-08-10T10:49:47.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.885+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 >> 172.21.15.107:0/1896398176 conn(0x7f8a100fc260 msgr2=0x7f8a100fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:47.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.886+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 shutdown_connections 2023-08-10T10:49:47.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:46.886+0000 7f8a15226700 1 -- 172.21.15.107:0/1896398176 wait complete. 2023-08-10T10:49:47.234 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:47.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:46 smithi157 ceph-mon[129604]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 11 op/s 2023-08-10T10:49:47.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:46 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:49:47.654 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:48.863 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:48 smithi107 ceph-mon[127953]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T10:49:49.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:48 smithi195 ceph-mon[129938]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T10:49:49.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:48 smithi157 ceph-mon[129604]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T10:49:49.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.912+0000 7f17e1e78700 1 -- 172.21.15.107:0/1969101002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17dc1117a0 msgr2=0x7f17dc113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.912+0000 7f17e1e78700 1 --2- 172.21.15.107:0/1969101002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17dc1117a0 0x7f17dc113b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f17d400b0a0 tx=0x7f17d400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.913+0000 7f17e1e78700 1 -- 172.21.15.107:0/1969101002 shutdown_connections 2023-08-10T10:49:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.913+0000 7f17e1e78700 1 --2- 172.21.15.107:0/1969101002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17dc1117a0 0x7f17dc113b90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.913+0000 7f17e1e78700 1 --2- 172.21.15.107:0/1969101002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17dc072b10 0x7f17dc072ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.913+0000 7f17e1e78700 1 --2- 172.21.15.107:0/1969101002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17dc073430 0x7f17dc111260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.913+0000 7f17e1e78700 1 -- 172.21.15.107:0/1969101002 >> 172.21.15.107:0/1969101002 conn(0x7f17dc0fc260 msgr2=0x7f17dc0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.913+0000 7f17e1e78700 1 -- 172.21.15.107:0/1969101002 shutdown_connections 2023-08-10T10:49:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.913+0000 7f17e1e78700 1 -- 172.21.15.107:0/1969101002 wait complete. 2023-08-10T10:49:49.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.915+0000 7f17e1e78700 1 Processor -- start 2023-08-10T10:49:49.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.915+0000 7f17e1e78700 1 -- start start 2023-08-10T10:49:49.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.915+0000 7f17e1e78700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17dc072b10 0x7f17dc19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.915+0000 7f17e1e78700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17dc073430 0x7f17dc19d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.915+0000 7f17e1e78700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17dc1117a0 0x7f17dc1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.915+0000 7f17e1e78700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc1a1e70 con 0x7f17dc073430 2023-08-10T10:49:49.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.915+0000 7f17e1e78700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc1a1fe0 con 0x7f17dc072b10 2023-08-10T10:49:49.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.915+0000 7f17e1e78700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc1a21a0 con 0x7f17dc1117a0 2023-08-10T10:49:49.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17dbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17dc1117a0 0x7f17dc1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17db7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17dc072b10 0x7f17dc19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17dbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17dc1117a0 0x7f17dc1a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38850/0 (socket says 172.21.15.107:38850) 2023-08-10T10:49:49.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17dbfff700 1 -- 172.21.15.107:0/3734719369 learned_addr learned my addr 172.21.15.107:0/3734719369 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:49.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17daffd700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17dc073430 0x7f17dc19d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17dbfff700 1 -- 172.21.15.107:0/3734719369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17dc072b10 msgr2=0x7f17dc19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17dbfff700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17dc072b10 0x7f17dc19ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17dbfff700 1 -- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17dc073430 msgr2=0x7f17dc19d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:49.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17dbfff700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17dc073430 0x7f17dc19d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:49.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17dbfff700 1 -- 172.21.15.107:0/3734719369 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4009d00 con 0x7f17dc1117a0 2023-08-10T10:49:49.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.916+0000 7f17dbfff700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17dc1117a0 0x7f17dc1a1860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f17d400d010 tx=0x7f17d400bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.917+0000 7f17d8ff9700 1 -- 172.21.15.107:0/3734719369 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400e040 con 0x7f17dc1117a0 2023-08-10T10:49:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.917+0000 7f17d8ff9700 1 -- 172.21.15.107:0/3734719369 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17d4009480 con 0x7f17dc1117a0 2023-08-10T10:49:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.917+0000 7f17d8ff9700 1 -- 172.21.15.107:0/3734719369 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4005040 con 0x7f17dc1117a0 2023-08-10T10:49:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.918+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc1a2420 con 0x7f17dc1117a0 2023-08-10T10:49:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.918+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc1a9b10 con 0x7f17dc1117a0 2023-08-10T10:49:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.919+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17dc103c80 con 0x7f17dc1117a0 2023-08-10T10:49:49.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.921+0000 7f17d8ff9700 1 -- 172.21.15.107:0/3734719369 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f17d401d480 con 0x7f17dc1117a0 2023-08-10T10:49:49.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.923+0000 7f17d8ff9700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f17c40a1260 0x7f17c40a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:49.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.923+0000 7f17d8ff9700 1 -- 172.21.15.107:0/3734719369 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f17d40cd520 con 0x7f17dc1117a0 2023-08-10T10:49:49.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.923+0000 7f17db7fe700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f17c40a1260 0x7f17c40a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:49.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.923+0000 7f17db7fe700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f17c40a1260 0x7f17c40a3720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009c60 tx=0x7f17cc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:49.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:49.927+0000 7f17d8ff9700 1 -- 172.21.15.107:0/3734719369 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f17d40968a0 con 0x7f17dc1117a0 2023-08-10T10:49:49.949 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:50.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.029+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/1170284438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a38100790 msgr2=0x7f2a38100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.029+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/1170284438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a38100790 0x7f2a38100c10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009990 tx=0x7f2a2c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.029+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/1170284438 shutdown_connections 2023-08-10T10:49:50.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.029+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/1170284438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a38101150 0x7f2a3810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.029+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/1170284438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a38106790 0x7f2a38106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.029+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/1170284438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a38100790 0x7f2a38100c10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.029+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/1170284438 >> 172.21.15.107:0/1170284438 conn(0x7f2a380fc260 msgr2=0x7f2a380fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:50.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.029+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/1170284438 shutdown_connections 2023-08-10T10:49:50.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.029+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/1170284438 wait complete. 2023-08-10T10:49:50.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.031+0000 7f2a3dc8e700 1 Processor -- start 2023-08-10T10:49:50.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.031+0000 7f2a3dc8e700 1 -- start start 2023-08-10T10:49:50.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.031+0000 7f2a3dc8e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a38100790 0x7f2a3819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.031+0000 7f2a3dc8e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a38101150 0x7f2a3819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a3dc8e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a38106790 0x7f2a381966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a3dc8e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a38196d50 con 0x7f2a38106790 2023-08-10T10:49:50.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a3dc8e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a38196ec0 con 0x7f2a38101150 2023-08-10T10:49:50.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a3dc8e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a38197080 con 0x7f2a38100790 2023-08-10T10:49:50.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a36ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a38101150 0x7f2a3819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a37fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a38106790 0x7f2a381966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a36ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a38101150 0x7f2a3819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:53636/0 (socket says 172.21.15.107:53636) 2023-08-10T10:49:50.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a36ffd700 1 -- 172.21.15.107:0/73820802 learned_addr learned my addr 172.21.15.107:0/73820802 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:50.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a377fe700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a38100790 0x7f2a3819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a37fff700 1 -- 172.21.15.107:0/73820802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a38100790 msgr2=0x7f2a3819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a37fff700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a38100790 0x7f2a3819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a37fff700 1 -- 172.21.15.107:0/73820802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a38101150 msgr2=0x7f2a3819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a37fff700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a38101150 0x7f2a3819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.032+0000 7f2a37fff700 1 -- 172.21.15.107:0/73820802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a28009520 con 0x7f2a38106790 2023-08-10T10:49:50.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.033+0000 7f2a377fe700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a38100790 0x7f2a3819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:49:50.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.033+0000 7f2a37fff700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a38106790 0x7f2a381966e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000be20 tx=0x7f2a30009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:50.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.033+0000 7f2a34ff9700 1 -- 172.21.15.107:0/73820802 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3000cb90 con 0x7f2a38106790 2023-08-10T10:49:50.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.033+0000 7f2a34ff9700 1 -- 172.21.15.107:0/73820802 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a3000ccf0 con 0x7f2a38106790 2023-08-10T10:49:50.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.033+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c0095f0 con 0x7f2a38106790 2023-08-10T10:49:50.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.033+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a380729a0 con 0x7f2a38106790 2023-08-10T10:49:50.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.034+0000 7f2a34ff9700 1 -- 172.21.15.107:0/73820802 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a300125a0 con 0x7f2a38106790 2023-08-10T10:49:50.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.035+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3804e470 con 0x7f2a38106790 2023-08-10T10:49:50.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.037+0000 7f2a34ff9700 1 -- 172.21.15.107:0/73820802 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f2a30012800 con 0x7f2a38106790 2023-08-10T10:49:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.038+0000 7f2a34ff9700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2a200a1260 0x7f2a200a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.038+0000 7f2a34ff9700 1 -- 172.21.15.107:0/73820802 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f2a30006e40 con 0x7f2a38106790 2023-08-10T10:49:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.038+0000 7f2a377fe700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2a200a1260 0x7f2a200a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.039+0000 7f2a377fe700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2a200a1260 0x7f2a200a3720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009fd0 tx=0x7f2a28009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.046+0000 7f2a34ff9700 1 -- 172.21.15.107:0/73820802 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2a30095900 con 0x7f2a38106790 2023-08-10T10:49:50.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.164+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17dc04e470 con 0x7f17dc1117a0 2023-08-10T10:49:50.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.165+0000 7f17d8ff9700 1 -- 172.21.15.107:0/3734719369 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17d4096020 con 0x7f17dc1117a0 2023-08-10T10:49:50.166 INFO:teuthology.orchestra.run.smithi107.stdout:77309411403 2023-08-10T10:49:50.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.167+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f17c40a1260 msgr2=0x7f17c40a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.167+0000 7f17e1e78700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f17c40a1260 0x7f17c40a3720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009c60 tx=0x7f17cc009260 comp rx=0 tx=0).stop 2023-08-10T10:49:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.167+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17dc1117a0 msgr2=0x7f17dc1a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.167+0000 7f17e1e78700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17dc1117a0 0x7f17dc1a1860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f17d400d010 tx=0x7f17d400bce0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.168+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 shutdown_connections 2023-08-10T10:49:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.168+0000 7f17e1e78700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f17c40a1260 0x7f17c40a3720 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.168+0000 7f17e1e78700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17dc072b10 0x7f17dc19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.168+0000 7f17e1e78700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17dc1117a0 0x7f17dc1a1860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.168+0000 7f17e1e78700 1 --2- 172.21.15.107:0/3734719369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f17dc073430 0x7f17dc19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.168+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 >> 172.21.15.107:0/3734719369 conn(0x7f17dc0fc260 msgr2=0x7f17dc0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.168+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 shutdown_connections 2023-08-10T10:49:50.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.168+0000 7f17e1e78700 1 -- 172.21.15.107:0/3734719369 wait complete. 2023-08-10T10:49:50.228 INFO:teuthology.orchestra.run.smithi107.stdout:107374182468 2023-08-10T10:49:50.228 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-08-10T10:49:50.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.284+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2a38072d10 con 0x7f2a38106790 2023-08-10T10:49:50.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.284+0000 7f2a34ff9700 1 -- 172.21.15.107:0/73820802 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a3000ce60 con 0x7f2a38106790 2023-08-10T10:49:50.286 INFO:teuthology.orchestra.run.smithi107.stdout:141733920832 2023-08-10T10:49:50.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2a200a1260 msgr2=0x7f2a200a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2a200a1260 0x7f2a200a3720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009fd0 tx=0x7f2a28009260 comp rx=0 tx=0).stop 2023-08-10T10:49:50.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a38106790 msgr2=0x7f2a381966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:50.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a38106790 0x7f2a381966e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000be20 tx=0x7f2a30009ed0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 shutdown_connections 2023-08-10T10:49:50.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2a200a1260 0x7f2a200a3720 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2a38106790 0x7f2a381966e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a38100790 0x7f2a3819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 --2- 172.21.15.107:0/73820802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a38101150 0x7f2a3819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:50.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 >> 172.21.15.107:0/73820802 conn(0x7f2a380fc260 msgr2=0x7f2a380fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:50.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 shutdown_connections 2023-08-10T10:49:50.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:50.287+0000 7f2a3dc8e700 1 -- 172.21.15.107:0/73820802 wait complete. 2023-08-10T10:49:50.397 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:50 smithi107 ceph-mon[127953]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-08-10T10:49:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:50.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:50.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:50.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:50 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:50.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:50 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3734719369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-08-10T10:49:50.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:50 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/73820802' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-08-10T10:49:50.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:50 smithi195 ceph-mon[129938]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-08-10T10:49:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:50 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:50 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:50 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:50 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:50 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3734719369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-08-10T10:49:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:50 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/73820802' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-08-10T10:49:51.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:50 smithi157 ceph-mon[129604]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-08-10T10:49:51.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:50 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:51.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:50 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:51.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:50 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:51.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:50 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:49:51.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:50 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3734719369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-08-10T10:49:51.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:50 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/73820802' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-08-10T10:49:51.078 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411400 got 77309411403 for osd.2 2023-08-10T10:49:51.079 DEBUG:teuthology.parallel:result is None 2023-08-10T10:49:51.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.305+0000 7fdcc7897700 1 -- 172.21.15.107:0/3104189793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc0100790 msgr2=0x7fdcc0100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.305+0000 7fdcc7897700 1 --2- 172.21.15.107:0/3104189793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc0100790 0x7fdcc0100c10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009990 tx=0x7fdcb0009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.305+0000 7fdcc7897700 1 -- 172.21.15.107:0/3104189793 shutdown_connections 2023-08-10T10:49:51.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.305+0000 7fdcc7897700 1 --2- 172.21.15.107:0/3104189793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0101150 0x7fdcc010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.305+0000 7fdcc7897700 1 --2- 172.21.15.107:0/3104189793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcc0106790 0x7fdcc0106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.305+0000 7fdcc7897700 1 --2- 172.21.15.107:0/3104189793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc0100790 0x7fdcc0100c10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.306+0000 7fdcc7897700 1 -- 172.21.15.107:0/3104189793 >> 172.21.15.107:0/3104189793 conn(0x7fdcc00fc260 msgr2=0x7fdcc00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:51.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.306+0000 7fdcc7897700 1 -- 172.21.15.107:0/3104189793 shutdown_connections 2023-08-10T10:49:51.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.306+0000 7fdcc7897700 1 -- 172.21.15.107:0/3104189793 wait complete. 2023-08-10T10:49:51.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.307+0000 7fdcc7897700 1 Processor -- start 2023-08-10T10:49:51.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.307+0000 7fdcc7897700 1 -- start start 2023-08-10T10:49:51.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc7897700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcc0100790 0x7fdcc01993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc7897700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0101150 0x7fdcc0199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc7897700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc0106790 0x7fdcc010b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc7897700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc010b9f0 con 0x7fdcc0100790 2023-08-10T10:49:51.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc7897700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc010bb60 con 0x7fdcc0101150 2023-08-10T10:49:51.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc7897700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc010bd20 con 0x7fdcc0106790 2023-08-10T10:49:51.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc5633700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcc0100790 0x7fdcc01993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc5633700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcc0100790 0x7fdcc01993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53754/0 (socket says 172.21.15.107:53754) 2023-08-10T10:49:51.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc5633700 1 -- 172.21.15.107:0/869862399 learned_addr learned my addr 172.21.15.107:0/869862399 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:51.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.308+0000 7fdcc5e34700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc0106790 0x7fdcc010b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.309+0000 7fdcc4e32700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0101150 0x7fdcc0199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.309+0000 7fdcc5633700 1 -- 172.21.15.107:0/869862399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc0106790 msgr2=0x7fdcc010b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.309+0000 7fdcc5633700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc0106790 0x7fdcc010b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.309+0000 7fdcc5633700 1 -- 172.21.15.107:0/869862399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0101150 msgr2=0x7fdcc0199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.309+0000 7fdcc5633700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0101150 0x7fdcc0199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.309+0000 7fdcc5633700 1 -- 172.21.15.107:0/869862399 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00095f0 con 0x7fdcc0100790 2023-08-10T10:49:51.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.309+0000 7fdcc5633700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcc0100790 0x7fdcc01993b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00e9a0 tx=0x7fdcbc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:51.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.310+0000 7fdcb67fc700 1 -- 172.21.15.107:0/869862399 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc009790 con 0x7fdcc0100790 2023-08-10T10:49:51.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.310+0000 7fdcb67fc700 1 -- 172.21.15.107:0/869862399 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcbc010430 con 0x7fdcc0100790 2023-08-10T10:49:51.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.310+0000 7fdcb67fc700 1 -- 172.21.15.107:0/869862399 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00cea0 con 0x7fdcc0100790 2023-08-10T10:49:51.313 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:51.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.310+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc010c000 con 0x7fdcc0100790 2023-08-10T10:49:51.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.311+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc019d3c0 con 0x7fdcc0100790 2023-08-10T10:49:51.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.312+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc004e470 con 0x7fdcc0100790 2023-08-10T10:49:51.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.315+0000 7fdcb67fc700 1 -- 172.21.15.107:0/869862399 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fdcbc0105a0 con 0x7fdcc0100790 2023-08-10T10:49:51.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.318+0000 7fdcb67fc700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdcac0a1260 0x7fdcac0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:51.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.318+0000 7fdcb67fc700 1 -- 172.21.15.107:0/869862399 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fdcbc014070 con 0x7fdcc0100790 2023-08-10T10:49:51.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.319+0000 7fdcc4e32700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdcac0a1260 0x7fdcac0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:51.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.319+0000 7fdcc4e32700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdcac0a1260 0x7fdcac0a3720 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0195ce0 tx=0x7fdcb000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:51.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.323+0000 7fdcb67fc700 1 -- 172.21.15.107:0/869862399 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fdcbc0959e0 con 0x7fdcc0100790 2023-08-10T10:49:51.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.592+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdcc010c750 con 0x7fdcc0100790 2023-08-10T10:49:51.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.593+0000 7fdcb67fc700 1 -- 172.21.15.107:0/869862399 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdcbc099000 con 0x7fdcc0100790 2023-08-10T10:49:51.595 INFO:teuthology.orchestra.run.smithi107.stdout:34359738454 2023-08-10T10:49:51.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdcac0a1260 msgr2=0x7fdcac0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdcac0a1260 0x7fdcac0a3720 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0195ce0 tx=0x7fdcb000b260 comp rx=0 tx=0).stop 2023-08-10T10:49:51.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcc0100790 msgr2=0x7fdcc01993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:51.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcc0100790 0x7fdcc01993b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00e9a0 tx=0x7fdcbc00ecb0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 shutdown_connections 2023-08-10T10:49:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdcac0a1260 0x7fdcac0a3720 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc0106790 0x7fdcc010b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdcc0100790 0x7fdcc01993b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 --2- 172.21.15.107:0/869862399 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdcc0101150 0x7fdcc0199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 >> 172.21.15.107:0/869862399 conn(0x7fdcc00fc260 msgr2=0x7fdcc0072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 shutdown_connections 2023-08-10T10:49:51.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:51.596+0000 7fdcc7897700 1 -- 172.21.15.107:0/869862399 wait complete. 2023-08-10T10:49:51.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:51 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/869862399' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-08-10T10:49:51.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:51 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/869862399' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-08-10T10:49:52.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:51 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/869862399' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-08-10T10:49:52.443 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920829 got 141733920832 for osd.4 2023-08-10T10:49:52.443 DEBUG:teuthology.parallel:result is None 2023-08-10T10:49:52.692 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:52.809 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:52 smithi107 ceph-mon[127953]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-10T10:49:52.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:52 smithi195 ceph-mon[129938]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-10T10:49:53.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:52 smithi157 ceph-mon[129604]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-08-10T10:49:53.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.610+0000 7f0f8de95700 1 -- 172.21.15.107:0/743932706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 msgr2=0x7f0f88100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.610+0000 7f0f8de95700 1 --2- 172.21.15.107:0/743932706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 0x7f0f88100c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009990 tx=0x7f0f7c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.610+0000 7f0f8de95700 1 -- 172.21.15.107:0/743932706 shutdown_connections 2023-08-10T10:49:53.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.610+0000 7f0f8de95700 1 --2- 172.21.15.107:0/743932706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f88101150 0x7f0f8810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.610+0000 7f0f8de95700 1 --2- 172.21.15.107:0/743932706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f88106790 0x7f0f88106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.610+0000 7f0f8de95700 1 --2- 172.21.15.107:0/743932706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 0x7f0f88100c10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.610+0000 7f0f8de95700 1 -- 172.21.15.107:0/743932706 >> 172.21.15.107:0/743932706 conn(0x7f0f880fc260 msgr2=0x7f0f880fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:53.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.611+0000 7f0f8de95700 1 -- 172.21.15.107:0/743932706 shutdown_connections 2023-08-10T10:49:53.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.611+0000 7f0f8de95700 1 -- 172.21.15.107:0/743932706 wait complete. 2023-08-10T10:49:53.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.612+0000 7f0f8de95700 1 Processor -- start 2023-08-10T10:49:53.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.612+0000 7f0f8de95700 1 -- start start 2023-08-10T10:49:53.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.612+0000 7f0f8de95700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 0x7f0f88072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.612+0000 7f0f8de95700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f88101150 0x7f0f88072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.612+0000 7f0f8de95700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f88106790 0x7f0f88073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.612+0000 7f0f8de95700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881a4c20 con 0x7f0f88100790 2023-08-10T10:49:53.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.612+0000 7f0f8de95700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881a4d90 con 0x7f0f88101150 2023-08-10T10:49:53.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.612+0000 7f0f8de95700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881a4f50 con 0x7f0f88106790 2023-08-10T10:49:53.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f877fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 0x7f0f88072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f877fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 0x7f0f88072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39560/0 (socket says 172.21.15.107:39560) 2023-08-10T10:49:53.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f877fe700 1 -- 172.21.15.107:0/1592868010 learned_addr learned my addr 172.21.15.107:0/1592868010 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:53.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f86ffd700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f88101150 0x7f0f88072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f87fff700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f88106790 0x7f0f88073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f877fe700 1 -- 172.21.15.107:0/1592868010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f88106790 msgr2=0x7f0f88073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f877fe700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f88106790 0x7f0f88073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f877fe700 1 -- 172.21.15.107:0/1592868010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f88101150 msgr2=0x7f0f88072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f877fe700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f88101150 0x7f0f88072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f877fe700 1 -- 172.21.15.107:0/1592868010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0095f0 con 0x7f0f88100790 2023-08-10T10:49:53.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.613+0000 7f0f87fff700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f88106790 0x7f0f88073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:49:53.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.614+0000 7f0f877fe700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 0x7f0f88072a70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800d950 tx=0x7f0f7800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.614+0000 7f0f84ff9700 1 -- 172.21.15.107:0/1592868010 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78009940 con 0x7f0f88100790 2023-08-10T10:49:53.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.614+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f881a5230 con 0x7f0f88100790 2023-08-10T10:49:53.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.614+0000 7f0f84ff9700 1 -- 172.21.15.107:0/1592868010 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f78010460 con 0x7f0f88100790 2023-08-10T10:49:53.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.614+0000 7f0f84ff9700 1 -- 172.21.15.107:0/1592868010 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800f620 con 0x7f0f88100790 2023-08-10T10:49:53.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.614+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f881a5780 con 0x7f0f88100790 2023-08-10T10:49:53.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.615+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8804e470 con 0x7f0f88100790 2023-08-10T10:49:53.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.617+0000 7f0f84ff9700 1 -- 172.21.15.107:0/1592868010 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f0f780105d0 con 0x7f0f88100790 2023-08-10T10:49:53.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.619+0000 7f0f84ff9700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f700a11e0 0x7f0f700a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.620+0000 7f0f84ff9700 1 -- 172.21.15.107:0/1592868010 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f0f780ccbe0 con 0x7f0f88100790 2023-08-10T10:49:53.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.620+0000 7f0f86ffd700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f700a11e0 0x7f0f700a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.621+0000 7f0f86ffd700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f700a11e0 0x7f0f700a36a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f88074260 tx=0x7f0f7c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.626+0000 7f0f84ff9700 1 -- 172.21.15.107:0/1592868010 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0f78095e70 con 0x7f0f88100790 2023-08-10T10:49:53.745 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738452 got 34359738454 for osd.0 2023-08-10T10:49:53.746 DEBUG:teuthology.parallel:result is None 2023-08-10T10:49:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.794+0000 7f08db07c700 1 -- 172.21.15.107:0/3162242792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d41051e0 msgr2=0x7f08d4105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.794+0000 7f08db07c700 1 --2- 172.21.15.107:0/3162242792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d41051e0 0x7f08d4105660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08c00099c0 tx=0x7f08c0009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.795+0000 7f08db07c700 1 -- 172.21.15.107:0/3162242792 shutdown_connections 2023-08-10T10:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.795+0000 7f08db07c700 1 --2- 172.21.15.107:0/3162242792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08d4105ba0 0x7f08d410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.795+0000 7f08db07c700 1 --2- 172.21.15.107:0/3162242792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d4068730 0x7f08d4068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.795+0000 7f08db07c700 1 --2- 172.21.15.107:0/3162242792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d41051e0 0x7f08d4105660 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.795+0000 7f08db07c700 1 -- 172.21.15.107:0/3162242792 >> 172.21.15.107:0/3162242792 conn(0x7f08d4076770 msgr2=0x7f08d4076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.795+0000 7f08db07c700 1 -- 172.21.15.107:0/3162242792 shutdown_connections 2023-08-10T10:49:53.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.795+0000 7f08db07c700 1 -- 172.21.15.107:0/3162242792 wait complete. 2023-08-10T10:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.796+0000 7f08db07c700 1 Processor -- start 2023-08-10T10:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.796+0000 7f08db07c700 1 -- start start 2023-08-10T10:49:53.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.796+0000 7f08db07c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4068730 0x7f08d419c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.796+0000 7f08db07c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08d41051e0 0x7f08d419cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.796+0000 7f08db07c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d4105ba0 0x7f08d4196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.797+0000 7f08db07c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4196c70 con 0x7f08d4068730 2023-08-10T10:49:53.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.797+0000 7f08db07c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4196de0 con 0x7f08d41051e0 2023-08-10T10:49:53.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.797+0000 7f08db07c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4196fa0 con 0x7f08d4105ba0 2023-08-10T10:49:53.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.797+0000 7f08d9619700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d4105ba0 0x7f08d4196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.797+0000 7f08d9619700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d4105ba0 0x7f08d4196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:56442/0 (socket says 172.21.15.107:56442) 2023-08-10T10:49:53.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.797+0000 7f08d9619700 1 -- 172.21.15.107:0/2473961775 learned_addr learned my addr 172.21.15.107:0/2473961775 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:53.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.797+0000 7f08d3fff700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08d41051e0 0x7f08d419cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d9619700 1 -- 172.21.15.107:0/2473961775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08d41051e0 msgr2=0x7f08d419cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d9619700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08d41051e0 0x7f08d419cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d9619700 1 -- 172.21.15.107:0/2473961775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4068730 msgr2=0x7f08d419c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d9619700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4068730 0x7f08d419c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d9619700 1 -- 172.21.15.107:0/2473961775 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00095f0 con 0x7f08d4105ba0 2023-08-10T10:49:53.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d3fff700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08d41051e0 0x7f08d419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:49:53.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d9619700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d4105ba0 0x7f08d4196600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00efc0 tx=0x7f08cc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d1ffb700 1 -- 172.21.15.107:0/2473961775 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc018070 con 0x7f08d4105ba0 2023-08-10T10:49:53.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d1ffb700 1 -- 172.21.15.107:0/2473961775 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08cc00f040 con 0x7f08d4105ba0 2023-08-10T10:49:53.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08d1ffb700 1 -- 172.21.15.107:0/2473961775 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00cbb0 con 0x7f08d4105ba0 2023-08-10T10:49:53.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d4197220 con 0x7f08d4105ba0 2023-08-10T10:49:53.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.798+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d40ff820 con 0x7f08d4105ba0 2023-08-10T10:49:53.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.799+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d4197410 con 0x7f08d4105ba0 2023-08-10T10:49:53.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.802+0000 7f08d1ffb700 1 -- 172.21.15.107:0/2473961775 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f08cc00cd90 con 0x7f08d4105ba0 2023-08-10T10:49:53.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.804+0000 7f08d1ffb700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f08c40a11e0 0x7f08c40a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:53.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.804+0000 7f08d1ffb700 1 -- 172.21.15.107:0/2473961775 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f08cc0cc830 con 0x7f08d4105ba0 2023-08-10T10:49:53.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.804+0000 7f08d8e18700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f08c40a11e0 0x7f08c40a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:53.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.805+0000 7f08d8e18700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f08c40a11e0 0x7f08c40a36a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005950 tx=0x7f08c80058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:53.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.806+0000 7f08d1ffb700 1 -- 172.21.15.107:0/2473961775 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f08cc095b50 con 0x7f08d4105ba0 2023-08-10T10:49:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.894+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0f881a59a0 con 0x7f0f88100790 2023-08-10T10:49:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.895+0000 7f0f84ff9700 1 -- 172.21.15.107:0/1592868010 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f78016090 con 0x7f0f88100790 2023-08-10T10:49:53.897 INFO:teuthology.orchestra.run.smithi107.stdout:197568495671 2023-08-10T10:49:53.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.897+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f700a11e0 msgr2=0x7f0f700a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.897+0000 7f0f8de95700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f700a11e0 0x7f0f700a36a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f88074260 tx=0x7f0f7c005fb0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.897+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 msgr2=0x7f0f88072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:53.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.897+0000 7f0f8de95700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 0x7f0f88072a70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800d950 tx=0x7f0f7800dc60 comp rx=0 tx=0).stop 2023-08-10T10:49:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.897+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 shutdown_connections 2023-08-10T10:49:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.897+0000 7f0f8de95700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f0f700a11e0 0x7f0f700a36a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.898+0000 7f0f8de95700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f88106790 0x7f0f88073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.898+0000 7f0f8de95700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f88100790 0x7f0f88072a70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.898+0000 7f0f8de95700 1 --2- 172.21.15.107:0/1592868010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f88101150 0x7f0f88072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.898+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 >> 172.21.15.107:0/1592868010 conn(0x7f0f880fc260 msgr2=0x7f0f880fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.898+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 shutdown_connections 2023-08-10T10:49:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:53.898+0000 7f0f8de95700 1 -- 172.21.15.107:0/1592868010 wait complete. 2023-08-10T10:49:54.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.036+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f08d404e470 con 0x7f08d4105ba0 2023-08-10T10:49:54.038 INFO:teuthology.orchestra.run.smithi107.stdout:309237645345 2023-08-10T10:49:54.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.037+0000 7f08d1ffb700 1 -- 172.21.15.107:0/2473961775 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f08cc099170 con 0x7f08d4105ba0 2023-08-10T10:49:54.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f08c40a11e0 msgr2=0x7f08c40a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f08c40a11e0 0x7f08c40a36a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005950 tx=0x7f08c80058e0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d4105ba0 msgr2=0x7f08d4196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d4105ba0 0x7f08d4196600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00efc0 tx=0x7f08cc00c3a0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 shutdown_connections 2023-08-10T10:49:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f08c40a11e0 0x7f08c40a36a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08d4105ba0 0x7f08d4196600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f08d4068730 0x7f08d419c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 --2- 172.21.15.107:0/2473961775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08d41051e0 0x7f08d419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:54.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 >> 172.21.15.107:0/2473961775 conn(0x7f08d4076770 msgr2=0x7f08d40fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:54.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.039+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 shutdown_connections 2023-08-10T10:49:54.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:54.040+0000 7f08db07c700 1 -- 172.21.15.107:0/2473961775 wait complete. 2023-08-10T10:49:54.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495668 got 197568495671 for osd.6 2023-08-10T10:49:54.800 DEBUG:teuthology.parallel:result is None 2023-08-10T10:49:54.892 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:54 smithi107 ceph-mon[127953]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T10:49:54.892 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:54 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1592868010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-08-10T10:49:54.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:54 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2473961775' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-08-10T10:49:54.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:54 smithi195 ceph-mon[129938]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T10:49:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:54 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1592868010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-08-10T10:49:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:54 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2473961775' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-08-10T10:49:55.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:54 smithi157 ceph-mon[129604]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 9 op/s 2023-08-10T10:49:55.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:54 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1592868010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-08-10T10:49:55.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:54 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2473961775' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-08-10T10:49:55.304 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:55.339 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645343 got 309237645345 for osd.10 2023-08-10T10:49:55.339 DEBUG:teuthology.parallel:result is None 2023-08-10T10:49:55.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.652+0000 7f3edeb57700 1 -- 172.21.15.107:0/4088773458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81067a0 msgr2=0x7f3ed8106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.652+0000 7f3edeb57700 1 --2- 172.21.15.107:0/4088773458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81067a0 0x7f3ed8106b80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009990 tx=0x7f3ecc009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.653+0000 7f3edeb57700 1 -- 172.21.15.107:0/4088773458 shutdown_connections 2023-08-10T10:49:55.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.653+0000 7f3edeb57700 1 --2- 172.21.15.107:0/4088773458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ed8101160 0x7f3ed810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.653+0000 7f3edeb57700 1 --2- 172.21.15.107:0/4088773458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81067a0 0x7f3ed8106b80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.653+0000 7f3edeb57700 1 --2- 172.21.15.107:0/4088773458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ed81007a0 0x7f3ed8100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.653+0000 7f3edeb57700 1 -- 172.21.15.107:0/4088773458 >> 172.21.15.107:0/4088773458 conn(0x7f3ed80fc290 msgr2=0x7f3ed80fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:55.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.653+0000 7f3edeb57700 1 -- 172.21.15.107:0/4088773458 shutdown_connections 2023-08-10T10:49:55.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.653+0000 7f3edeb57700 1 -- 172.21.15.107:0/4088773458 wait complete. 2023-08-10T10:49:55.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edeb57700 1 Processor -- start 2023-08-10T10:49:55.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edeb57700 1 -- start start 2023-08-10T10:49:55.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edeb57700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81007a0 0x7f3ed819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edeb57700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ed8101160 0x7f3ed819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edeb57700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ed81067a0 0x7f3ed8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edeb57700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8199030 con 0x7f3ed81007a0 2023-08-10T10:49:55.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edeb57700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed81991a0 con 0x7f3ed81067a0 2023-08-10T10:49:55.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edeb57700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8199360 con 0x7f3ed8101160 2023-08-10T10:49:55.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edc8f3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81007a0 0x7f3ed819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edc8f3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81007a0 0x7f3ed819e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39604/0 (socket says 172.21.15.107:39604) 2023-08-10T10:49:55.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.654+0000 7f3edc8f3700 1 -- 172.21.15.107:0/3203601443 learned_addr learned my addr 172.21.15.107:0/3203601443 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:55.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3ed7fff700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ed8101160 0x7f3ed819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3edd0f4700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ed81067a0 0x7f3ed8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3edc8f3700 1 -- 172.21.15.107:0/3203601443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ed8101160 msgr2=0x7f3ed819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3edc8f3700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ed8101160 0x7f3ed819edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3edc8f3700 1 -- 172.21.15.107:0/3203601443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ed81067a0 msgr2=0x7f3ed8198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3edc8f3700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ed81067a0 0x7f3ed8198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3edc8f3700 1 -- 172.21.15.107:0/3203601443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0095f0 con 0x7f3ed81007a0 2023-08-10T10:49:55.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3edc8f3700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81007a0 0x7f3ed819e890 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0036c0 tx=0x7f3ecc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:55.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3ed5ffb700 1 -- 172.21.15.107:0/3203601443 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc01d070 con 0x7f3ed81007a0 2023-08-10T10:49:55.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3ed5ffb700 1 -- 172.21.15.107:0/3203601443 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ecc003ec0 con 0x7f3ed81007a0 2023-08-10T10:49:55.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed81995e0 con 0x7f3ed81007a0 2023-08-10T10:49:55.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.655+0000 7f3ed5ffb700 1 -- 172.21.15.107:0/3203601443 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc022b00 con 0x7f3ed81007a0 2023-08-10T10:49:55.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.656+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed81a5810 con 0x7f3ed81007a0 2023-08-10T10:49:55.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.657+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed804e470 con 0x7f3ed81007a0 2023-08-10T10:49:55.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.659+0000 7f3ed5ffb700 1 -- 172.21.15.107:0/3203601443 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f3ecc004030 con 0x7f3ed81007a0 2023-08-10T10:49:55.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.660+0000 7f3ed5ffb700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f3ec80a11e0 0x7f3ec80a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.660+0000 7f3ed5ffb700 1 -- 172.21.15.107:0/3203601443 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f3ecc0ce370 con 0x7f3ed81007a0 2023-08-10T10:49:55.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.660+0000 7f3ed7fff700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f3ec80a11e0 0x7f3ec80a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.661+0000 7f3ed7fff700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f3ec80a11e0 0x7f3ec80a36a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ed819a0b0 tx=0x7f3ec400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:55.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.664+0000 7f3ed5ffb700 1 -- 172.21.15.107:0/3203601443 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3ecc097690 con 0x7f3ed81007a0 2023-08-10T10:49:55.751 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:55.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.900+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f3ed81a59a0 con 0x7f3ed81007a0 2023-08-10T10:49:55.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.901+0000 7f3ed5ffb700 1 -- 172.21.15.107:0/3203601443 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f3ecc09acb0 con 0x7f3ed81007a0 2023-08-10T10:49:55.903 INFO:teuthology.orchestra.run.smithi107.stdout:343597383708 2023-08-10T10:49:55.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f3ec80a11e0 msgr2=0x7f3ec80a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f3ec80a11e0 0x7f3ec80a36a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ed819a0b0 tx=0x7f3ec400b410 comp rx=0 tx=0).stop 2023-08-10T10:49:55.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81007a0 msgr2=0x7f3ed819e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81007a0 0x7f3ed819e890 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0036c0 tx=0x7f3ecc005740 comp rx=0 tx=0).stop 2023-08-10T10:49:55.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 shutdown_connections 2023-08-10T10:49:55.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f3ec80a11e0 0x7f3ec80a36a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ed81067a0 0x7f3ed8198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ed81007a0 0x7f3ed819e890 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 --2- 172.21.15.107:0/3203601443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ed8101160 0x7f3ed819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 >> 172.21.15.107:0/3203601443 conn(0x7f3ed80fc290 msgr2=0x7f3ed810bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:55.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 shutdown_connections 2023-08-10T10:49:55.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.903+0000 7f3edeb57700 1 -- 172.21.15.107:0/3203601443 wait complete. 2023-08-10T10:49:55.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.972+0000 7fe5fd476700 1 -- 172.21.15.107:0/4007050474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 msgr2=0x7fe5f8105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.972+0000 7fe5fd476700 1 --2- 172.21.15.107:0/4007050474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 0x7fe5f8105660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0099c0 tx=0x7fe5ec009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.972+0000 7fe5fd476700 1 -- 172.21.15.107:0/4007050474 shutdown_connections 2023-08-10T10:49:55.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.972+0000 7fe5fd476700 1 --2- 172.21.15.107:0/4007050474 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5f8068730 0x7fe5f8068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.972+0000 7fe5fd476700 1 --2- 172.21.15.107:0/4007050474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5f8105ba0 0x7fe5f810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.972+0000 7fe5fd476700 1 --2- 172.21.15.107:0/4007050474 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 0x7fe5f8105660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.972+0000 7fe5fd476700 1 -- 172.21.15.107:0/4007050474 >> 172.21.15.107:0/4007050474 conn(0x7fe5f8076770 msgr2=0x7fe5f8076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:55.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.972+0000 7fe5fd476700 1 -- 172.21.15.107:0/4007050474 shutdown_connections 2023-08-10T10:49:55.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.973+0000 7fe5fd476700 1 -- 172.21.15.107:0/4007050474 wait complete. 2023-08-10T10:49:55.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.974+0000 7fe5fd476700 1 Processor -- start 2023-08-10T10:49:55.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.974+0000 7fe5fd476700 1 -- start start 2023-08-10T10:49:55.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.974+0000 7fe5fd476700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5f8068730 0x7fe5f819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.974+0000 7fe5fd476700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 0x7fe5f819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.974+0000 7fe5fd476700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5f8105ba0 0x7fe5f8198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.974+0000 7fe5fd476700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8198ea0 con 0x7fe5f81051e0 2023-08-10T10:49:55.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.974+0000 7fe5fd476700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8199010 con 0x7fe5f8105ba0 2023-08-10T10:49:55.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.974+0000 7fe5fd476700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f81991d0 con 0x7fe5f8068730 2023-08-10T10:49:55.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f67fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 0x7fe5f819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f67fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 0x7fe5f819ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39616/0 (socket says 172.21.15.107:39616) 2023-08-10T10:49:55.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f67fc700 1 -- 172.21.15.107:0/888388306 learned_addr learned my addr 172.21.15.107:0/888388306 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:55.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f6ffd700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5f8068730 0x7fe5f819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f77fe700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5f8105ba0 0x7fe5f8198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f67fc700 1 -- 172.21.15.107:0/888388306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5f8068730 msgr2=0x7fe5f819e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f67fc700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5f8068730 0x7fe5f819e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f67fc700 1 -- 172.21.15.107:0/888388306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5f8105ba0 msgr2=0x7fe5f8198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:55.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f67fc700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5f8105ba0 0x7fe5f8198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:55.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.975+0000 7fe5f67fc700 1 -- 172.21.15.107:0/888388306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0095f0 con 0x7fe5f81051e0 2023-08-10T10:49:55.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.976+0000 7fe5f67fc700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 0x7fe5f819ecf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009f50 tx=0x7fe5ec005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:55.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.976+0000 7fe5dffff700 1 -- 172.21.15.107:0/888388306 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec01d070 con 0x7fe5f81051e0 2023-08-10T10:49:55.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.976+0000 7fe5dffff700 1 -- 172.21.15.107:0/888388306 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5ec003ec0 con 0x7fe5f81051e0 2023-08-10T10:49:55.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.976+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f8199450 con 0x7fe5f81051e0 2023-08-10T10:49:55.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.976+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f81a57a0 con 0x7fe5f81051e0 2023-08-10T10:49:55.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.977+0000 7fe5dffff700 1 -- 172.21.15.107:0/888388306 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec022a80 con 0x7fe5f81051e0 2023-08-10T10:49:55.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.978+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e4005320 con 0x7fe5f81051e0 2023-08-10T10:49:55.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.980+0000 7fe5dffff700 1 -- 172.21.15.107:0/888388306 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fe5ec004030 con 0x7fe5f81051e0 2023-08-10T10:49:55.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.982+0000 7fe5dffff700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5e00a1260 0x7fe5e00a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:55.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.982+0000 7fe5dffff700 1 -- 172.21.15.107:0/888388306 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fe5ec0ce940 con 0x7fe5f81051e0 2023-08-10T10:49:55.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.982+0000 7fe5f6ffd700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5e00a1260 0x7fe5e00a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:55.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.983+0000 7fe5f6ffd700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5e00a1260 0x7fe5e00a3720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8005950 tx=0x7fe5e800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:55.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:55.983+0000 7fe5dffff700 1 -- 172.21.15.107:0/888388306 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe5ec097c60 con 0x7fe5f81051e0 2023-08-10T10:49:56.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.207+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe5e4005cc0 con 0x7fe5f81051e0 2023-08-10T10:49:56.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.207+0000 7fe5dffff700 1 -- 172.21.15.107:0/888388306 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5ec086020 con 0x7fe5f81051e0 2023-08-10T10:49:56.209 INFO:teuthology.orchestra.run.smithi107.stdout:219043332145 2023-08-10T10:49:56.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5e00a1260 msgr2=0x7fe5e00a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:56.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5e00a1260 0x7fe5e00a3720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8005950 tx=0x7fe5e800b410 comp rx=0 tx=0).stop 2023-08-10T10:49:56.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 msgr2=0x7fe5f819ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:56.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 0x7fe5f819ecf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009f50 tx=0x7fe5ec005740 comp rx=0 tx=0).stop 2023-08-10T10:49:56.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 shutdown_connections 2023-08-10T10:49:56.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5e00a1260 0x7fe5e00a3720 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5f8105ba0 0x7fe5f8198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5f8068730 0x7fe5f819e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:56.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 --2- 172.21.15.107:0/888388306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5f81051e0 0x7fe5f819ecf0 secure :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009f50 tx=0x7fe5ec005740 comp rx=0 tx=0).stop 2023-08-10T10:49:56.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.211+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 >> 172.21.15.107:0/888388306 conn(0x7fe5f8076770 msgr2=0x7fe5f810b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:56.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.212+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 shutdown_connections 2023-08-10T10:49:56.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.212+0000 7fe5fd476700 1 -- 172.21.15.107:0/888388306 wait complete. 2023-08-10T10:49:56.732 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:49:56.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:56 smithi195 ceph-mon[129938]: pgmap v343: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-10T10:49:56.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:56 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3203601443' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-08-10T10:49:56.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:56 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/888388306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-08-10T10:49:56.981 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:56 smithi107 ceph-mon[127953]: pgmap v343: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-10T10:49:56.981 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:56 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3203601443' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-08-10T10:49:56.982 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:56 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/888388306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-08-10T10:49:56.984 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383706 got 343597383708 for osd.11 2023-08-10T10:49:56.985 DEBUG:teuthology.parallel:result is None 2023-08-10T10:49:57.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:56 smithi157 ceph-mon[129604]: pgmap v343: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 170 B/s wr, 10 op/s 2023-08-10T10:49:57.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:56 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3203601443' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-08-10T10:49:57.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:56 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/888388306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-08-10T10:49:57.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.959+0000 7f1aa8936700 1 -- 172.21.15.107:0/811269378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4101150 msgr2=0x7f1aa410d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.959+0000 7f1aa8936700 1 --2- 172.21.15.107:0/811269378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4101150 0x7f1aa410d660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00b0a0 tx=0x7f1a9c00b3b0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.960+0000 7f1aa8936700 1 -- 172.21.15.107:0/811269378 shutdown_connections 2023-08-10T10:49:57.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.960+0000 7f1aa8936700 1 --2- 172.21.15.107:0/811269378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa4106790 0x7f1aa4106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.960+0000 7f1aa8936700 1 --2- 172.21.15.107:0/811269378 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4101150 0x7f1aa410d660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.960+0000 7f1aa8936700 1 --2- 172.21.15.107:0/811269378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa4100790 0x7f1aa4100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.960+0000 7f1aa8936700 1 -- 172.21.15.107:0/811269378 >> 172.21.15.107:0/811269378 conn(0x7f1aa40fc260 msgr2=0x7f1aa40fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:57.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.960+0000 7f1aa8936700 1 -- 172.21.15.107:0/811269378 shutdown_connections 2023-08-10T10:49:57.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.960+0000 7f1aa8936700 1 -- 172.21.15.107:0/811269378 wait complete. 2023-08-10T10:49:57.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.961+0000 7f1aa8936700 1 Processor -- start 2023-08-10T10:49:57.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.961+0000 7f1aa8936700 1 -- start start 2023-08-10T10:49:57.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.961+0000 7f1aa8936700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4100790 0x7f1aa419e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:57.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.961+0000 7f1aa8936700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa4101150 0x7f1aa419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:57.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.961+0000 7f1aa8936700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa4106790 0x7f1aa4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:57.188 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.961+0000 7f1aa8936700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa41990d0 con 0x7f1aa4100790 2023-08-10T10:49:57.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.961+0000 7f1aa8936700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4199240 con 0x7f1aa4106790 2023-08-10T10:49:57.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.961+0000 7f1aa8936700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4199400 con 0x7f1aa4101150 2023-08-10T10:49:57.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4100790 0x7f1aa419e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:57.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4100790 0x7f1aa419e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39638/0 (socket says 172.21.15.107:39638) 2023-08-10T10:49:57.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa259c700 1 -- 172.21.15.107:0/417902422 learned_addr learned my addr 172.21.15.107:0/417902422 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:57.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa1d9b700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa4101150 0x7f1aa419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:57.189 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa2d9d700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa4106790 0x7f1aa4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:57.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa259c700 1 -- 172.21.15.107:0/417902422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa4101150 msgr2=0x7f1aa419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa259c700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa4101150 0x7f1aa419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa259c700 1 -- 172.21.15.107:0/417902422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa4106790 msgr2=0x7f1aa4198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa259c700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa4106790 0x7f1aa4198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa259c700 1 -- 172.21.15.107:0/417902422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c009d00 con 0x7f1aa4100790 2023-08-10T10:49:57.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.962+0000 7f1aa259c700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4100790 0x7f1aa419e9e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400b530 tx=0x7f1a9400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:57.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.963+0000 7f1a937fe700 1 -- 172.21.15.107:0/417902422 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94011830 con 0x7f1aa4100790 2023-08-10T10:49:57.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.963+0000 7f1a937fe700 1 -- 172.21.15.107:0/417902422 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a94011e20 con 0x7f1aa4100790 2023-08-10T10:49:57.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.963+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa41996e0 con 0x7f1aa4100790 2023-08-10T10:49:57.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.963+0000 7f1a937fe700 1 -- 172.21.15.107:0/417902422 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94010db0 con 0x7f1aa4100790 2023-08-10T10:49:57.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.963+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa41a59d0 con 0x7f1aa4100790 2023-08-10T10:49:57.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.964+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa404e470 con 0x7f1aa4100790 2023-08-10T10:49:57.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.966+0000 7f1a937fe700 1 -- 172.21.15.107:0/417902422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f1a94011990 con 0x7f1aa4100790 2023-08-10T10:49:57.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.967+0000 7f1a937fe700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a8c0a1260 0x7f1a8c0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:57.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.968+0000 7f1a937fe700 1 -- 172.21.15.107:0/417902422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f1a940cc600 con 0x7f1aa4100790 2023-08-10T10:49:57.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.968+0000 7f1aa1d9b700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a8c0a1260 0x7f1a8c0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:57.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.969+0000 7f1aa1d9b700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a8c0a1260 0x7f1a8c0a3720 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4105ee0 tx=0x7f1a98009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:57.192 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:56.975+0000 7f1a937fe700 1 -- 172.21.15.107:0/417902422 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1a94095a00 con 0x7f1aa4100790 2023-08-10T10:49:57.202 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332143 got 219043332145 for osd.7 2023-08-10T10:49:57.202 DEBUG:teuthology.parallel:result is None 2023-08-10T10:49:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.208+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f1aa41a5d50 con 0x7f1aa4100790 2023-08-10T10:49:57.209 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.208+0000 7f1a937fe700 1 -- 172.21.15.107:0/417902422 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a94099020 con 0x7f1aa4100790 2023-08-10T10:49:57.209 INFO:teuthology.orchestra.run.smithi107.stdout:287762808871 2023-08-10T10:49:57.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a8c0a1260 msgr2=0x7f1a8c0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a8c0a1260 0x7f1a8c0a3720 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4105ee0 tx=0x7f1a98009190 comp rx=0 tx=0).stop 2023-08-10T10:49:57.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4100790 msgr2=0x7f1aa419e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:57.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4100790 0x7f1aa419e9e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400b530 tx=0x7f1a9400b840 comp rx=0 tx=0).stop 2023-08-10T10:49:57.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 shutdown_connections 2023-08-10T10:49:57.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1a8c0a1260 0x7f1a8c0a3720 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa4106790 0x7f1aa4198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1aa4100790 0x7f1aa419e9e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 --2- 172.21.15.107:0/417902422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1aa4101150 0x7f1aa419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:57.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.211+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 >> 172.21.15.107:0/417902422 conn(0x7f1aa40fc260 msgr2=0x7f1aa410bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:57.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.212+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 shutdown_connections 2023-08-10T10:49:57.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:57.212+0000 7f1aa8936700 1 -- 172.21.15.107:0/417902422 wait complete. 2023-08-10T10:49:57.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:57 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/417902422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-08-10T10:49:57.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:57 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/417902422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-08-10T10:49:58.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:57 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/417902422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-08-10T10:49:58.390 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808869 got 287762808871 for osd.9 2023-08-10T10:49:58.391 DEBUG:teuthology.parallel:result is None 2023-08-10T10:49:58.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.280+0000 7faf60195700 1 -- 172.21.15.107:0/2562063275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58068730 msgr2=0x7faf58068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.280+0000 7faf60195700 1 --2- 172.21.15.107:0/2562063275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58068730 0x7faf58068b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf540099c0 tx=0x7faf54009cd0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.280+0000 7faf60195700 1 -- 172.21.15.107:0/2562063275 shutdown_connections 2023-08-10T10:49:58.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.280+0000 7faf60195700 1 --2- 172.21.15.107:0/2562063275 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf58105ba0 0x7faf5810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.280+0000 7faf60195700 1 --2- 172.21.15.107:0/2562063275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58068730 0x7faf58068b10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.280+0000 7faf60195700 1 --2- 172.21.15.107:0/2562063275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf581051e0 0x7faf58105660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.280+0000 7faf60195700 1 -- 172.21.15.107:0/2562063275 >> 172.21.15.107:0/2562063275 conn(0x7faf58076770 msgr2=0x7faf58076b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:58.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.280+0000 7faf60195700 1 -- 172.21.15.107:0/2562063275 shutdown_connections 2023-08-10T10:49:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.280+0000 7faf60195700 1 -- 172.21.15.107:0/2562063275 wait complete. 2023-08-10T10:49:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.281+0000 7faf60195700 1 Processor -- start 2023-08-10T10:49:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.282+0000 7faf60195700 1 -- start start 2023-08-10T10:49:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.282+0000 7faf60195700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf58068730 0x7faf5819e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.282+0000 7faf60195700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf581051e0 0x7faf5819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.282+0000 7faf60195700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58105ba0 0x7faf581987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.282+0000 7faf60195700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf58198fa0 con 0x7faf581051e0 2023-08-10T10:49:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.282+0000 7faf60195700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf58199110 con 0x7faf58068730 2023-08-10T10:49:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.282+0000 7faf60195700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf581992d0 con 0x7faf58105ba0 2023-08-10T10:49:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.283+0000 7faf5e732700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58105ba0 0x7faf581987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.283+0000 7faf5df31700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf58068730 0x7faf5819e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.283+0000 7faf5e732700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58105ba0 0x7faf581987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:56520/0 (socket says 172.21.15.107:56520) 2023-08-10T10:49:58.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.283+0000 7faf5df31700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf58068730 0x7faf5819e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57632/0 (socket says 172.21.15.107:57632) 2023-08-10T10:49:58.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.283+0000 7faf5e732700 1 -- 172.21.15.107:0/121026137 learned_addr learned my addr 172.21.15.107:0/121026137 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:58.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.283+0000 7faf5d730700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf581051e0 0x7faf5819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf5df31700 1 -- 172.21.15.107:0/121026137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58105ba0 msgr2=0x7faf581987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf5df31700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58105ba0 0x7faf581987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf5df31700 1 -- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf581051e0 msgr2=0x7faf5819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf5df31700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf581051e0 0x7faf5819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf5df31700 1 -- 172.21.15.107:0/121026137 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540095f0 con 0x7faf58068730 2023-08-10T10:49:58.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf5e732700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58105ba0 0x7faf581987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:49:58.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf5d730700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf581051e0 0x7faf5819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:49:58.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf5df31700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf58068730 0x7faf5819e800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf54009fd0 tx=0x7faf5400f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:58.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf4effd700 1 -- 172.21.15.107:0/121026137 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5401d070 con 0x7faf58068730 2023-08-10T10:49:58.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf4effd700 1 -- 172.21.15.107:0/121026137 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf54005050 con 0x7faf58068730 2023-08-10T10:49:58.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf58199550 con 0x7faf58068730 2023-08-10T10:49:58.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf4effd700 1 -- 172.21.15.107:0/121026137 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54004a90 con 0x7faf58068730 2023-08-10T10:49:58.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.284+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf581a5780 con 0x7faf58068730 2023-08-10T10:49:58.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.286+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5804e470 con 0x7faf58068730 2023-08-10T10:49:58.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.288+0000 7faf4effd700 1 -- 172.21.15.107:0/121026137 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7faf540054c0 con 0x7faf58068730 2023-08-10T10:49:58.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.289+0000 7faf4effd700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faf440a11e0 0x7faf440a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:58.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.290+0000 7faf4effd700 1 -- 172.21.15.107:0/121026137 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7faf540cdbb0 con 0x7faf58068730 2023-08-10T10:49:58.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.290+0000 7faf5d730700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faf440a11e0 0x7faf440a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:58.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.290+0000 7faf5d730700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faf440a11e0 0x7faf440a36a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf48005950 tx=0x7faf480058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:58.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.291+0000 7faf4effd700 1 -- 172.21.15.107:0/121026137 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7faf54096ed0 con 0x7faf58068730 2023-08-10T10:49:58.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.519+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faf581a59b0 con 0x7faf58068730 2023-08-10T10:49:58.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.520+0000 7faf4effd700 1 -- 172.21.15.107:0/121026137 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf5409a4f0 con 0x7faf58068730 2023-08-10T10:49:58.521 INFO:teuthology.orchestra.run.smithi107.stdout:163208757309 2023-08-10T10:49:58.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.522+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faf440a11e0 msgr2=0x7faf440a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.522+0000 7faf60195700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faf440a11e0 0x7faf440a36a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf48005950 tx=0x7faf480058e0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.522+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf58068730 msgr2=0x7faf5819e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:58.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.522+0000 7faf60195700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf58068730 0x7faf5819e800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf54009fd0 tx=0x7faf5400f670 comp rx=0 tx=0).stop 2023-08-10T10:49:58.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.522+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 shutdown_connections 2023-08-10T10:49:58.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.523+0000 7faf60195700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7faf440a11e0 0x7faf440a36a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.523+0000 7faf60195700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf58068730 0x7faf5819e800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.523+0000 7faf60195700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf58105ba0 0x7faf581987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.523+0000 7faf60195700 1 --2- 172.21.15.107:0/121026137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faf581051e0 0x7faf5819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:58.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.523+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 >> 172.21.15.107:0/121026137 conn(0x7faf58076770 msgr2=0x7faf5810b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:58.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.523+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 shutdown_connections 2023-08-10T10:49:58.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:58.523+0000 7faf60195700 1 -- 172.21.15.107:0/121026137 wait complete. 2023-08-10T10:49:58.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:58 smithi107 ceph-mon[127953]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T10:49:58.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:49:58 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/121026137' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-08-10T10:49:58.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:58 smithi195 ceph-mon[129938]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T10:49:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:49:58 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/121026137' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-08-10T10:49:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:58 smithi157 ceph-mon[129604]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T10:49:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:49:58 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/121026137' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-08-10T10:49:59.416 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757307 got 163208757309 for osd.5 2023-08-10T10:49:59.417 DEBUG:teuthology.parallel:result is None 2023-08-10T10:49:59.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.759+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1734008923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98100790 msgr2=0x7f2c98100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:59.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.759+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1734008923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98100790 0x7f2c98100c10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009990 tx=0x7f2c84009ca0 comp rx=0 tx=0).stop 2023-08-10T10:49:59.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.760+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1734008923 shutdown_connections 2023-08-10T10:49:59.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.760+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1734008923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98101150 0x7f2c9810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:59.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.760+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1734008923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c98106790 0x7f2c98106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:59.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.760+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1734008923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98100790 0x7f2c98100c10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:59.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.760+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1734008923 >> 172.21.15.107:0/1734008923 conn(0x7f2c980fc260 msgr2=0x7f2c980fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:49:59.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.760+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1734008923 shutdown_connections 2023-08-10T10:49:59.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.760+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1734008923 wait complete. 2023-08-10T10:49:59.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.761+0000 7f2c9ef56700 1 Processor -- start 2023-08-10T10:49:59.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.761+0000 7f2c9ef56700 1 -- start start 2023-08-10T10:49:59.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.761+0000 7f2c9ef56700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98100790 0x7f2c9819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:59.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.761+0000 7f2c9ef56700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98101150 0x7f2c9819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:59.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.761+0000 7f2c9ef56700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c98106790 0x7f2c981987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:59.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.761+0000 7f2c9ef56700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98198f90 con 0x7f2c98101150 2023-08-10T10:49:59.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.761+0000 7f2c9ef56700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98199100 con 0x7f2c98100790 2023-08-10T10:49:59.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.761+0000 7f2c9ef56700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c981992c0 con 0x7f2c98106790 2023-08-10T10:49:59.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c97fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98101150 0x7f2c9819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:59.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c97fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98101150 0x7f2c9819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39650/0 (socket says 172.21.15.107:39650) 2023-08-10T10:49:59.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c97fff700 1 -- 172.21.15.107:0/1472447073 learned_addr learned my addr 172.21.15.107:0/1472447073 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:49:59.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c9d4f3700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c98106790 0x7f2c981987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:59.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c9ccf2700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98100790 0x7f2c9819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c97fff700 1 -- 172.21.15.107:0/1472447073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c98106790 msgr2=0x7f2c981987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c97fff700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c98106790 0x7f2c981987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c97fff700 1 -- 172.21.15.107:0/1472447073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98100790 msgr2=0x7f2c9819e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:49:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c97fff700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98100790 0x7f2c9819e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:49:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c97fff700 1 -- 172.21.15.107:0/1472447073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840095f0 con 0x7f2c98101150 2023-08-10T10:49:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.762+0000 7f2c97fff700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98101150 0x7f2c9819ed30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2c84005740 tx=0x7f2c8400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:59.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.763+0000 7f2c95ffb700 1 -- 172.21.15.107:0/1472447073 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8401d070 con 0x7f2c98101150 2023-08-10T10:49:59.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.763+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c98199540 con 0x7f2c98101150 2023-08-10T10:49:59.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.763+0000 7f2c95ffb700 1 -- 172.21.15.107:0/1472447073 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c84022470 con 0x7f2c98101150 2023-08-10T10:49:59.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.763+0000 7f2c95ffb700 1 -- 172.21.15.107:0/1472447073 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84017650 con 0x7f2c98101150 2023-08-10T10:49:59.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.763+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c981a5770 con 0x7f2c98101150 2023-08-10T10:49:59.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.764+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9804e470 con 0x7f2c98101150 2023-08-10T10:49:59.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.766+0000 7f2c95ffb700 1 -- 172.21.15.107:0/1472447073 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f2c840225e0 con 0x7f2c98101150 2023-08-10T10:49:59.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.768+0000 7f2c95ffb700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c880a11e0 0x7f2c880a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:49:59.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.768+0000 7f2c95ffb700 1 -- 172.21.15.107:0/1472447073 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f2c840ce250 con 0x7f2c98101150 2023-08-10T10:49:59.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.769+0000 7f2c9ccf2700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c880a11e0 0x7f2c880a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:49:59.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.769+0000 7f2c9ccf2700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c880a11e0 0x7f2c880a36a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009bd0 tx=0x7f2c8c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:49:59.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:49:59.772+0000 7f2c95ffb700 1 -- 172.21.15.107:0/1472447073 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2c84097680 con 0x7f2c98101150 2023-08-10T10:50:00.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.002+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2c981a5900 con 0x7f2c98101150 2023-08-10T10:50:00.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.002+0000 7f2c95ffb700 1 -- 172.21.15.107:0/1472447073 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c8409aca0 con 0x7f2c98101150 2023-08-10T10:50:00.004 INFO:teuthology.orchestra.run.smithi107.stdout:55834574931 2023-08-10T10:50:00.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c880a11e0 msgr2=0x7f2c880a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c880a11e0 0x7f2c880a36a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009bd0 tx=0x7f2c8c009260 comp rx=0 tx=0).stop 2023-08-10T10:50:00.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98101150 msgr2=0x7f2c9819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98101150 0x7f2c9819ed30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2c84005740 tx=0x7f2c8400bf50 comp rx=0 tx=0).stop 2023-08-10T10:50:00.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 shutdown_connections 2023-08-10T10:50:00.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c880a11e0 0x7f2c880a36a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c98100790 0x7f2c9819e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c98106790 0x7f2c981987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 --2- 172.21.15.107:0/1472447073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c98101150 0x7f2c9819ed30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 >> 172.21.15.107:0/1472447073 conn(0x7f2c980fc260 msgr2=0x7f2c9810bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:00.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 shutdown_connections 2023-08-10T10:50:00.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.005+0000 7f2c9ef56700 1 -- 172.21.15.107:0/1472447073 wait complete. 2023-08-10T10:50:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.040+0000 7f442b52c700 1 -- 172.21.15.107:0/833078032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424106790 msgr2=0x7f4424106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.040+0000 7f442b52c700 1 --2- 172.21.15.107:0/833078032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424106790 0x7f4424106b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4420009990 tx=0x7f4420009ca0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.040+0000 7f442b52c700 1 -- 172.21.15.107:0/833078032 shutdown_connections 2023-08-10T10:50:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.040+0000 7f442b52c700 1 --2- 172.21.15.107:0/833078032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4424101150 0x7f442410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.040+0000 7f442b52c700 1 --2- 172.21.15.107:0/833078032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424106790 0x7f4424106b70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.040+0000 7f442b52c700 1 --2- 172.21.15.107:0/833078032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4424100790 0x7f4424100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.040+0000 7f442b52c700 1 -- 172.21.15.107:0/833078032 >> 172.21.15.107:0/833078032 conn(0x7f44240fc260 msgr2=0x7f44240fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.040+0000 7f442b52c700 1 -- 172.21.15.107:0/833078032 shutdown_connections 2023-08-10T10:50:00.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.040+0000 7f442b52c700 1 -- 172.21.15.107:0/833078032 wait complete. 2023-08-10T10:50:00.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.041+0000 7f442b52c700 1 Processor -- start 2023-08-10T10:50:00.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.041+0000 7f442b52c700 1 -- start start 2023-08-10T10:50:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f442b52c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4424100790 0x7f442419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f442b52c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424101150 0x7f442419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f442b52c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4424106790 0x7f4424198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f442b52c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4424198eb0 con 0x7f4424101150 2023-08-10T10:50:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f442b52c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4424199020 con 0x7f4424106790 2023-08-10T10:50:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f442b52c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44241991e0 con 0x7f4424100790 2023-08-10T10:50:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f4428ac7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424101150 0x7f442419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f4428ac7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424101150 0x7f442419ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39668/0 (socket says 172.21.15.107:39668) 2023-08-10T10:50:00.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f4428ac7700 1 -- 172.21.15.107:0/708099103 learned_addr learned my addr 172.21.15.107:0/708099103 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:00.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f44292c8700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4424100790 0x7f442419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.042+0000 7f4429ac9700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4424106790 0x7f4424198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.043+0000 7f4428ac7700 1 -- 172.21.15.107:0/708099103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4424100790 msgr2=0x7f442419e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.043+0000 7f4428ac7700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4424100790 0x7f442419e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.043+0000 7f4428ac7700 1 -- 172.21.15.107:0/708099103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4424106790 msgr2=0x7f4424198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.043+0000 7f4428ac7700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4424106790 0x7f4424198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.043+0000 7f4428ac7700 1 -- 172.21.15.107:0/708099103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200095f0 con 0x7f4424101150 2023-08-10T10:50:00.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.043+0000 7f4428ac7700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424101150 0x7f442419ed00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f441400d950 tx=0x7f441400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:00.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.043+0000 7f441a7fc700 1 -- 172.21.15.107:0/708099103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400f890 con 0x7f4424101150 2023-08-10T10:50:00.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.043+0000 7f441a7fc700 1 -- 172.21.15.107:0/708099103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f441400fe80 con 0x7f4424101150 2023-08-10T10:50:00.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.044+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44241994c0 con 0x7f4424101150 2023-08-10T10:50:00.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.044+0000 7f441a7fc700 1 -- 172.21.15.107:0/708099103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441400e3b0 con 0x7f4424101150 2023-08-10T10:50:00.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.044+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44241a57b0 con 0x7f4424101150 2023-08-10T10:50:00.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.045+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442404e470 con 0x7f4424101150 2023-08-10T10:50:00.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.048+0000 7f441a7fc700 1 -- 172.21.15.107:0/708099103 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f4414010460 con 0x7f4424101150 2023-08-10T10:50:00.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.050+0000 7f441a7fc700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f44100a1260 0x7f44100a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.050+0000 7f441a7fc700 1 -- 172.21.15.107:0/708099103 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f44140ccb00 con 0x7f4424101150 2023-08-10T10:50:00.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.050+0000 7f44292c8700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f44100a1260 0x7f44100a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.051+0000 7f441a7fc700 1 -- 172.21.15.107:0/708099103 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4414095d90 con 0x7f4424101150 2023-08-10T10:50:00.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.051+0000 7f44292c8700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f44100a1260 0x7f44100a3720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f442000b5c0 tx=0x7f4420005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:00.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.274+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44241a5ac0 con 0x7f4424101150 2023-08-10T10:50:00.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.275+0000 7f441a7fc700 1 -- 172.21.15.107:0/708099103 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4414020090 con 0x7f4424101150 2023-08-10T10:50:00.276 INFO:teuthology.orchestra.run.smithi107.stdout:107374182471 2023-08-10T10:50:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.277+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f44100a1260 msgr2=0x7f44100a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.277+0000 7f442b52c700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f44100a1260 0x7f44100a3720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f442000b5c0 tx=0x7f4420005fb0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424101150 msgr2=0x7f442419ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424101150 0x7f442419ed00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f441400d950 tx=0x7f441400dc60 comp rx=0 tx=0).stop 2023-08-10T10:50:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 shutdown_connections 2023-08-10T10:50:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f44100a1260 0x7f44100a3720 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4424106790 0x7f4424198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4424100790 0x7f442419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 --2- 172.21.15.107:0/708099103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4424101150 0x7f442419ed00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 >> 172.21.15.107:0/708099103 conn(0x7f44240fc260 msgr2=0x7f44240fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 shutdown_connections 2023-08-10T10:50:00.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.278+0000 7f442b52c700 1 -- 172.21.15.107:0/708099103 wait complete. 2023-08-10T10:50:00.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.383+0000 7f1e1ef93700 1 -- 172.21.15.107:0/3540096572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e18106790 msgr2=0x7f1e18106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.383+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/3540096572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e18106790 0x7f1e18106b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0098f0 tx=0x7f1e0c009c00 comp rx=0 tx=0).stop 2023-08-10T10:50:00.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.383+0000 7f1e1ef93700 1 -- 172.21.15.107:0/3540096572 shutdown_connections 2023-08-10T10:50:00.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.383+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/3540096572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e18106790 0x7f1e18106b70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.383+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/3540096572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e18101150 0x7f1e1810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.383+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/3540096572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18100790 0x7f1e18100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.383+0000 7f1e1ef93700 1 -- 172.21.15.107:0/3540096572 >> 172.21.15.107:0/3540096572 conn(0x7f1e180fc260 msgr2=0x7f1e180fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:00.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.383+0000 7f1e1ef93700 1 -- 172.21.15.107:0/3540096572 shutdown_connections 2023-08-10T10:50:00.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.383+0000 7f1e1ef93700 1 -- 172.21.15.107:0/3540096572 wait complete. 2023-08-10T10:50:00.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.384+0000 7f1e1ef93700 1 Processor -- start 2023-08-10T10:50:00.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.385+0000 7f1e1ef93700 1 -- start start 2023-08-10T10:50:00.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.385+0000 7f1e1ef93700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e18100790 0x7f1e18194610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.385+0000 7f1e1ef93700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e18101150 0x7f1e18194b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.385+0000 7f1e1ef93700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18106790 0x7f1e18198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.385+0000 7f1e1ef93700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181995d0 con 0x7f1e18106790 2023-08-10T10:50:00.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.385+0000 7f1e1ef93700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18199740 con 0x7f1e18100790 2023-08-10T10:50:00.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.385+0000 7f1e1ef93700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18199900 con 0x7f1e18101150 2023-08-10T10:50:00.388 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e1d530700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18106790 0x7f1e18198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e1cd2f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e18100790 0x7f1e18194610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e1d530700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18106790 0x7f1e18198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39688/0 (socket says 172.21.15.107:39688) 2023-08-10T10:50:00.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e1d530700 1 -- 172.21.15.107:0/2955757848 learned_addr learned my addr 172.21.15.107:0/2955757848 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:00.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e17fff700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e18101150 0x7f1e18194b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e1d530700 1 -- 172.21.15.107:0/2955757848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e18101150 msgr2=0x7f1e18194b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e1d530700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e18101150 0x7f1e18194b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e1d530700 1 -- 172.21.15.107:0/2955757848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e18100790 msgr2=0x7f1e18194610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e1d530700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e18100790 0x7f1e18194610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.386+0000 7f1e1d530700 1 -- 172.21.15.107:0/2955757848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c009520 con 0x7f1e18106790 2023-08-10T10:50:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.387+0000 7f1e17fff700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e18101150 0x7f1e18194b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:50:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.387+0000 7f1e1d530700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18106790 0x7f1e18198fc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000ef30 tx=0x7f1e1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.387+0000 7f1e15ffb700 1 -- 172.21.15.107:0/2955757848 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10018070 con 0x7f1e18106790 2023-08-10T10:50:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.387+0000 7f1e15ffb700 1 -- 172.21.15.107:0/2955757848 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1e1000f040 con 0x7f1e18106790 2023-08-10T10:50:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.387+0000 7f1e15ffb700 1 -- 172.21.15.107:0/2955757848 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1000cbb0 con 0x7f1e18106790 2023-08-10T10:50:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.388+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e18199b80 con 0x7f1e18106790 2023-08-10T10:50:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.388+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e181a1440 con 0x7f1e18106790 2023-08-10T10:50:00.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.389+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1804e470 con 0x7f1e18106790 2023-08-10T10:50:00.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.392+0000 7f1e15ffb700 1 -- 172.21.15.107:0/2955757848 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f1e1000cd10 con 0x7f1e18106790 2023-08-10T10:50:00.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.395+0000 7f1e15ffb700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1e080a57c0 0x7f1e080a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:00.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.395+0000 7f1e15ffb700 1 -- 172.21.15.107:0/2955757848 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f1e100ccd20 con 0x7f1e18106790 2023-08-10T10:50:00.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.395+0000 7f1e15ffb700 1 -- 172.21.15.107:0/2955757848 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1e10099270 con 0x7f1e18106790 2023-08-10T10:50:00.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.396+0000 7f1e1cd2f700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1e080a57c0 0x7f1e080a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:00.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.397+0000 7f1e1cd2f700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1e080a57c0 0x7f1e080a7c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c005e90 tx=0x7f1e0c019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:00.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.613+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f1e181a1670 con 0x7f1e18106790 2023-08-10T10:50:00.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.614+0000 7f1e15ffb700 1 -- 172.21.15.107:0/2955757848 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e10099500 con 0x7f1e18106790 2023-08-10T10:50:00.615 INFO:teuthology.orchestra.run.smithi107.stdout:253403070509 2023-08-10T10:50:00.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.616+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1e080a57c0 msgr2=0x7f1e080a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.616+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1e080a57c0 0x7f1e080a7c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c005e90 tx=0x7f1e0c019040 comp rx=0 tx=0).stop 2023-08-10T10:50:00.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.616+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18106790 msgr2=0x7f1e18198fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:00.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.616+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18106790 0x7f1e18198fc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000ef30 tx=0x7f1e1000c3a0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.617+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 shutdown_connections 2023-08-10T10:50:00.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.617+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1e080a57c0 0x7f1e080a7c80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.617+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e18100790 0x7f1e18194610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.617+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18106790 0x7f1e18198fc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.617+0000 7f1e1ef93700 1 --2- 172.21.15.107:0/2955757848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e18101150 0x7f1e18194b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:00.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.617+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 >> 172.21.15.107:0/2955757848 conn(0x7f1e180fc260 msgr2=0x7f1e180fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:00.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.617+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 shutdown_connections 2023-08-10T10:50:00.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:00.617+0000 7f1e1ef93700 1 -- 172.21.15.107:0/2955757848 wait complete. 2023-08-10T10:50:00.816 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574931 for osd.1 2023-08-10T10:50:00.816 DEBUG:teuthology.parallel:result is None 2023-08-10T10:50:00.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:00 smithi195 ceph-mon[129938]: pgmap v345: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T10:50:00.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:00 smithi195 ceph-mon[129938]: overall HEALTH_OK 2023-08-10T10:50:00.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:00 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1472447073' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-08-10T10:50:00.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:00 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/708099103' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-08-10T10:50:00.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:50:00.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:00 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:50:00.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:00 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2955757848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-08-10T10:50:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:00 smithi157 ceph-mon[129604]: pgmap v345: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T10:50:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:00 smithi157 ceph-mon[129604]: overall HEALTH_OK 2023-08-10T10:50:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:00 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1472447073' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-08-10T10:50:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:00 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/708099103' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-08-10T10:50:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:50:01.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:00 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:50:01.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:00 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2955757848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-08-10T10:50:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:00 smithi107 ceph-mon[127953]: pgmap v345: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T10:50:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:00 smithi107 ceph-mon[127953]: overall HEALTH_OK 2023-08-10T10:50:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1472447073' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-08-10T10:50:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/708099103' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-08-10T10:50:01.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:50:01.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:00 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:50:01.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2955757848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-08-10T10:50:01.282 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070507 got 253403070509 for osd.8 2023-08-10T10:50:01.283 DEBUG:teuthology.parallel:result is None 2023-08-10T10:50:01.311 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182468 got 107374182471 for osd.3 2023-08-10T10:50:01.312 DEBUG:teuthology.parallel:result is None 2023-08-10T10:50:01.312 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-08-10T10:50:01.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph pg dump --format=json 2023-08-10T10:50:02.087 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:02.885 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:02 smithi107 ceph-mon[127953]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T10:50:02.885 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:50:02.885 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:50:02.885 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:50:02.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:02 smithi195 ceph-mon[129938]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T10:50:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:50:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:50:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:50:03.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:02 smithi157 ceph-mon[129604]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T10:50:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:50:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:50:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:50:03.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.545+0000 7f677d0e3700 1 -- 172.21.15.107:0/1798083730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778100790 msgr2=0x7f6778100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.545+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1798083730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778100790 0x7f6778100c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f676c009990 tx=0x7f676c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.545+0000 7f677d0e3700 1 -- 172.21.15.107:0/1798083730 shutdown_connections 2023-08-10T10:50:03.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.545+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1798083730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6778106790 0x7f6778106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.545+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1798083730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6778101150 0x7f677810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.545+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1798083730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778100790 0x7f6778100c10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.545+0000 7f677d0e3700 1 -- 172.21.15.107:0/1798083730 >> 172.21.15.107:0/1798083730 conn(0x7f67780fc260 msgr2=0x7f67780fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:03.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.545+0000 7f677d0e3700 1 -- 172.21.15.107:0/1798083730 shutdown_connections 2023-08-10T10:50:03.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.545+0000 7f677d0e3700 1 -- 172.21.15.107:0/1798083730 wait complete. 2023-08-10T10:50:03.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.546+0000 7f677d0e3700 1 Processor -- start 2023-08-10T10:50:03.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.546+0000 7f677d0e3700 1 -- start start 2023-08-10T10:50:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677d0e3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6778100790 0x7f677819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677d0e3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6778101150 0x7f677819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677d0e3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778106790 0x7f67781965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677d0e3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778196c40 con 0x7f6778106790 2023-08-10T10:50:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677d0e3700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778196db0 con 0x7f6778101150 2023-08-10T10:50:03.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677d0e3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778196f70 con 0x7f6778100790 2023-08-10T10:50:03.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677759e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778106790 0x7f67781965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677759e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778106790 0x7f67781965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44802/0 (socket says 172.21.15.107:44802) 2023-08-10T10:50:03.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677759e700 1 -- 172.21.15.107:0/1867381062 learned_addr learned my addr 172.21.15.107:0/1867381062 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:03.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677659c700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6778101150 0x7f677819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f6776d9d700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6778100790 0x7f677819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677759e700 1 -- 172.21.15.107:0/1867381062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6778100790 msgr2=0x7f677819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.547+0000 7f677759e700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6778100790 0x7f677819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f677759e700 1 -- 172.21.15.107:0/1867381062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6778101150 msgr2=0x7f677819ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f677759e700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6778101150 0x7f677819ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f677759e700 1 -- 172.21.15.107:0/1867381062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c0095f0 con 0x7f6778106790 2023-08-10T10:50:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f6776d9d700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6778100790 0x7f677819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f677659c700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6778101150 0x7f677819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f677759e700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778106790 0x7f67781965d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6770007ee0 tx=0x7f677000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f675ffff700 1 -- 172.21.15.107:0/1867381062 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770017070 con 0x7f6778106790 2023-08-10T10:50:03.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f675ffff700 1 -- 172.21.15.107:0/1867381062 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f677000f040 con 0x7f6778106790 2023-08-10T10:50:03.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6778197250 con 0x7f6778106790 2023-08-10T10:50:03.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f675ffff700 1 -- 172.21.15.107:0/1867381062 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770005710 con 0x7f6778106790 2023-08-10T10:50:03.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.548+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67781a3540 con 0x7f6778106790 2023-08-10T10:50:03.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.549+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677804e470 con 0x7f6778106790 2023-08-10T10:50:03.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.551+0000 7f675ffff700 1 -- 172.21.15.107:0/1867381062 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f6770005870 con 0x7f6778106790 2023-08-10T10:50:03.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.553+0000 7f675ffff700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f67600a1260 0x7f67600a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:03.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.553+0000 7f675ffff700 1 -- 172.21.15.107:0/1867381062 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f67700cc640 con 0x7f6778106790 2023-08-10T10:50:03.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.553+0000 7f6776d9d700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f67600a1260 0x7f67600a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:03.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.553+0000 7f6776d9d700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f67600a1260 0x7f67600a3720 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6768005e90 tx=0x7f6768005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:03.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.556+0000 7f675ffff700 1 -- 172.21.15.107:0/1867381062 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f67700958d0 con 0x7f6778106790 2023-08-10T10:50:03.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.759+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67781049b0 con 0x7f67600a1260 2023-08-10T10:50:03.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.772+0000 7f675ffff700 1 -- 172.21.15.107:0/1867381062 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426112 (secure 0 0 0) 0x7f67781049b0 con 0x7f67600a1260 2023-08-10T10:50:03.779 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:03.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f67600a1260 msgr2=0x7f67600a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f67600a1260 0x7f67600a3720 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6768005e90 tx=0x7f6768005d20 comp rx=0 tx=0).stop 2023-08-10T10:50:03.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778106790 msgr2=0x7f67781965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:03.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778106790 0x7f67781965d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6770007ee0 tx=0x7f677000d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 shutdown_connections 2023-08-10T10:50:03.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f67600a1260 0x7f67600a3720 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6778106790 0x7f67781965d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6778100790 0x7f677819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 --2- 172.21.15.107:0/1867381062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6778101150 0x7f677819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:03.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 >> 172.21.15.107:0/1867381062 conn(0x7f67780fc260 msgr2=0x7f67781042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:03.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 shutdown_connections 2023-08-10T10:50:03.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:03.778+0000 7f677d0e3700 1 -- 172.21.15.107:0/1867381062 wait complete. 2023-08-10T10:50:03.784 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-08-10T10:50:04.277 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2023-08-10T10:50:03.601772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657432,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":631,"num_read_kb":438,"num_write":421,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336460,"kb_used_data":12268,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605364,"statfs":{"total":1151940427776,"available":1151595892736,"internally_reserved":0,"allocated":12562432,"data_stored":7948389,"data_compressed":319464,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003474"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714060+0000","last_change":"2023-08-10T10:48:42.585259+0000","last_active":"2023-08-10T10:49:12.714060+0000","last_peered":"2023-08-10T10:49:12.714060+0000","last_clean":"2023-08-10T10:49:12.714060+0000","last_became_active":"2023-08-10T10:48:42.584501+0000","last_became_peered":"2023-08-10T10:48:42.584501+0000","last_unstale":"2023-08-10T10:49:12.714060+0000","last_undegraded":"2023-08-10T10:49:12.714060+0000","last_fullsized":"2023-08-10T10:49:12.714060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:31.281761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731723+0000","last_change":"2023-08-10T10:48:42.577812+0000","last_active":"2023-08-10T10:49:12.731723+0000","last_peered":"2023-08-10T10:49:12.731723+0000","last_clean":"2023-08-10T10:49:12.731723+0000","last_became_active":"2023-08-10T10:48:42.577499+0000","last_became_peered":"2023-08-10T10:48:42.577499+0000","last_unstale":"2023-08-10T10:49:12.731723+0000","last_undegraded":"2023-08-10T10:49:12.731723+0000","last_fullsized":"2023-08-10T10:49:12.731723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:32.054997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731226+0000","last_change":"2023-08-10T10:48:42.577302+0000","last_active":"2023-08-10T10:49:12.731226+0000","last_peered":"2023-08-10T10:49:12.731226+0000","last_clean":"2023-08-10T10:49:12.731226+0000","last_became_active":"2023-08-10T10:48:42.577022+0000","last_became_peered":"2023-08-10T10:48:42.577022+0000","last_unstale":"2023-08-10T10:49:12.731226+0000","last_undegraded":"2023-08-10T10:49:12.731226+0000","last_fullsized":"2023-08-10T10:49:12.731226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:19.509385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707930+0000","last_change":"2023-08-10T10:48:42.577198+0000","last_active":"2023-08-10T10:49:12.707930+0000","last_peered":"2023-08-10T10:49:12.707930+0000","last_clean":"2023-08-10T10:49:12.707930+0000","last_became_active":"2023-08-10T10:48:42.576887+0000","last_became_peered":"2023-08-10T10:48:42.576887+0000","last_unstale":"2023-08-10T10:49:12.707930+0000","last_undegraded":"2023-08-10T10:49:12.707930+0000","last_fullsized":"2023-08-10T10:49:12.707930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:13.115193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712407+0000","last_change":"2023-08-10T10:48:42.587532+0000","last_active":"2023-08-10T10:49:12.712407+0000","last_peered":"2023-08-10T10:49:12.712407+0000","last_clean":"2023-08-10T10:49:12.712407+0000","last_became_active":"2023-08-10T10:48:42.587199+0000","last_became_peered":"2023-08-10T10:48:42.587199+0000","last_unstale":"2023-08-10T10:49:12.712407+0000","last_undegraded":"2023-08-10T10:49:12.712407+0000","last_fullsized":"2023-08-10T10:49:12.712407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:39.740129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711152+0000","last_change":"2023-08-10T10:48:42.581998+0000","last_active":"2023-08-10T10:49:12.711152+0000","last_peered":"2023-08-10T10:49:12.711152+0000","last_clean":"2023-08-10T10:49:12.711152+0000","last_became_active":"2023-08-10T10:48:42.581683+0000","last_became_peered":"2023-08-10T10:48:42.581683+0000","last_unstale":"2023-08-10T10:49:12.711152+0000","last_undegraded":"2023-08-10T10:49:12.711152+0000","last_fullsized":"2023-08-10T10:49:12.711152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:19.796398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717754+0000","last_change":"2023-08-10T10:48:42.578452+0000","last_active":"2023-08-10T10:49:12.717754+0000","last_peered":"2023-08-10T10:49:12.717754+0000","last_clean":"2023-08-10T10:49:12.717754+0000","last_became_active":"2023-08-10T10:48:42.577456+0000","last_became_peered":"2023-08-10T10:48:42.577456+0000","last_unstale":"2023-08-10T10:49:12.717754+0000","last_undegraded":"2023-08-10T10:49:12.717754+0000","last_fullsized":"2023-08-10T10:49:12.717754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:17:35.823145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717028+0000","last_change":"2023-08-10T10:48:42.578839+0000","last_active":"2023-08-10T10:49:12.717028+0000","last_peered":"2023-08-10T10:49:12.717028+0000","last_clean":"2023-08-10T10:49:12.717028+0000","last_became_active":"2023-08-10T10:48:42.578450+0000","last_became_peered":"2023-08-10T10:48:42.578450+0000","last_unstale":"2023-08-10T10:49:12.717028+0000","last_undegraded":"2023-08-10T10:49:12.717028+0000","last_fullsized":"2023-08-10T10:49:12.717028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:29:39.316129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708298+0000","last_change":"2023-08-10T10:48:42.588533+0000","last_active":"2023-08-10T10:49:12.708298+0000","last_peered":"2023-08-10T10:49:12.708298+0000","last_clean":"2023-08-10T10:49:12.708298+0000","last_became_active":"2023-08-10T10:48:42.588205+0000","last_became_peered":"2023-08-10T10:48:42.588205+0000","last_unstale":"2023-08-10T10:49:12.708298+0000","last_undegraded":"2023-08-10T10:49:12.708298+0000","last_fullsized":"2023-08-10T10:49:12.708298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:27.853522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711349+0000","last_change":"2023-08-10T10:48:42.588606+0000","last_active":"2023-08-10T10:49:12.711349+0000","last_peered":"2023-08-10T10:49:12.711349+0000","last_clean":"2023-08-10T10:49:12.711349+0000","last_became_active":"2023-08-10T10:48:42.588261+0000","last_became_peered":"2023-08-10T10:48:42.588261+0000","last_unstale":"2023-08-10T10:49:12.711349+0000","last_undegraded":"2023-08-10T10:49:12.711349+0000","last_fullsized":"2023-08-10T10:49:12.711349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:08:25.435478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718340+0000","last_change":"2023-08-10T10:48:42.577245+0000","last_active":"2023-08-10T10:49:12.718340+0000","last_peered":"2023-08-10T10:49:12.718340+0000","last_clean":"2023-08-10T10:49:12.718340+0000","last_became_active":"2023-08-10T10:48:42.576512+0000","last_became_peered":"2023-08-10T10:48:42.576512+0000","last_unstale":"2023-08-10T10:49:12.718340+0000","last_undegraded":"2023-08-10T10:49:12.718340+0000","last_fullsized":"2023-08-10T10:49:12.718340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:41.419282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707744+0000","last_change":"2023-08-10T10:48:42.590704+0000","last_active":"2023-08-10T10:49:12.707744+0000","last_peered":"2023-08-10T10:49:12.707744+0000","last_clean":"2023-08-10T10:49:12.707744+0000","last_became_active":"2023-08-10T10:48:42.590360+0000","last_became_peered":"2023-08-10T10:48:42.590360+0000","last_unstale":"2023-08-10T10:49:12.707744+0000","last_undegraded":"2023-08-10T10:49:12.707744+0000","last_fullsized":"2023-08-10T10:49:12.707744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:27.858538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712842+0000","last_change":"2023-08-10T10:48:42.580072+0000","last_active":"2023-08-10T10:49:12.712842+0000","last_peered":"2023-08-10T10:49:12.712842+0000","last_clean":"2023-08-10T10:49:12.712842+0000","last_became_active":"2023-08-10T10:48:42.579745+0000","last_became_peered":"2023-08-10T10:48:42.579745+0000","last_unstale":"2023-08-10T10:49:12.712842+0000","last_undegraded":"2023-08-10T10:49:12.712842+0000","last_fullsized":"2023-08-10T10:49:12.712842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:58.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730013+0000","last_change":"2023-08-10T10:48:42.577050+0000","last_active":"2023-08-10T10:49:12.730013+0000","last_peered":"2023-08-10T10:49:12.730013+0000","last_clean":"2023-08-10T10:49:12.730013+0000","last_became_active":"2023-08-10T10:48:42.576686+0000","last_became_peered":"2023-08-10T10:48:42.576686+0000","last_unstale":"2023-08-10T10:49:12.730013+0000","last_undegraded":"2023-08-10T10:49:12.730013+0000","last_fullsized":"2023-08-10T10:49:12.730013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:20:27.181934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730451+0000","last_change":"2023-08-10T10:48:42.582939+0000","last_active":"2023-08-10T10:49:12.730451+0000","last_peered":"2023-08-10T10:49:12.730451+0000","last_clean":"2023-08-10T10:49:12.730451+0000","last_became_active":"2023-08-10T10:48:42.582560+0000","last_became_peered":"2023-08-10T10:48:42.582560+0000","last_unstale":"2023-08-10T10:49:12.730451+0000","last_undegraded":"2023-08-10T10:49:12.730451+0000","last_fullsized":"2023-08-10T10:49:12.730451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:36:49.334857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.706881+0000","last_change":"2023-08-10T10:48:42.577163+0000","last_active":"2023-08-10T10:49:12.706881+0000","last_peered":"2023-08-10T10:49:12.706881+0000","last_clean":"2023-08-10T10:49:12.706881+0000","last_became_active":"2023-08-10T10:48:42.576866+0000","last_became_peered":"2023-08-10T10:48:42.576866+0000","last_unstale":"2023-08-10T10:49:12.706881+0000","last_undegraded":"2023-08-10T10:49:12.706881+0000","last_fullsized":"2023-08-10T10:49:12.706881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:50:27.812527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713970+0000","last_change":"2023-08-10T10:48:42.585496+0000","last_active":"2023-08-10T10:49:12.713970+0000","last_peered":"2023-08-10T10:49:12.713970+0000","last_clean":"2023-08-10T10:49:12.713970+0000","last_became_active":"2023-08-10T10:48:42.584963+0000","last_became_peered":"2023-08-10T10:48:42.584963+0000","last_unstale":"2023-08-10T10:49:12.713970+0000","last_undegraded":"2023-08-10T10:49:12.713970+0000","last_fullsized":"2023-08-10T10:49:12.713970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:05.902933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709523+0000","last_change":"2023-08-10T10:48:42.576038+0000","last_active":"2023-08-10T10:49:12.709523+0000","last_peered":"2023-08-10T10:49:12.709523+0000","last_clean":"2023-08-10T10:49:12.709523+0000","last_became_active":"2023-08-10T10:48:42.575660+0000","last_became_peered":"2023-08-10T10:48:42.575660+0000","last_unstale":"2023-08-10T10:49:12.709523+0000","last_undegraded":"2023-08-10T10:49:12.709523+0000","last_fullsized":"2023-08-10T10:49:12.709523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:17.443396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717536+0000","last_change":"2023-08-10T10:48:42.573855+0000","last_active":"2023-08-10T10:49:12.717536+0000","last_peered":"2023-08-10T10:49:12.717536+0000","last_clean":"2023-08-10T10:49:12.717536+0000","last_became_active":"2023-08-10T10:48:42.573475+0000","last_became_peered":"2023-08-10T10:48:42.573475+0000","last_unstale":"2023-08-10T10:49:12.717536+0000","last_undegraded":"2023-08-10T10:49:12.717536+0000","last_fullsized":"2023-08-10T10:49:12.717536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:13:36.282148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719366+0000","last_change":"2023-08-10T10:48:46.628005+0000","last_active":"2023-08-10T10:49:12.719366+0000","last_peered":"2023-08-10T10:49:12.719366+0000","last_clean":"2023-08-10T10:49:12.719366+0000","last_became_active":"2023-08-10T10:48:46.627558+0000","last_became_peered":"2023-08-10T10:48:46.627558+0000","last_unstale":"2023-08-10T10:49:12.719366+0000","last_undegraded":"2023-08-10T10:49:12.719366+0000","last_fullsized":"2023-08-10T10:49:12.719366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:33:01.121958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":85,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:01.745042+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:50:01.745042+0000","last_peered":"2023-08-10T10:50:01.745042+0000","last_clean":"2023-08-10T10:50:01.745042+0000","last_became_active":"2023-08-10T10:48:41.585341+0000","last_became_peered":"2023-08-10T10:48:41.585341+0000","last_unstale":"2023-08-10T10:50:01.745042+0000","last_undegraded":"2023-08-10T10:50:01.745042+0000","last_fullsized":"2023-08-10T10:50:01.745042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:34.374039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717943+0000","last_change":"2023-08-10T10:48:42.580893+0000","last_active":"2023-08-10T10:49:12.717943+0000","last_peered":"2023-08-10T10:49:12.717943+0000","last_clean":"2023-08-10T10:49:12.717943+0000","last_became_active":"2023-08-10T10:48:42.580591+0000","last_became_peered":"2023-08-10T10:48:42.580591+0000","last_unstale":"2023-08-10T10:49:12.717943+0000","last_undegraded":"2023-08-10T10:49:12.717943+0000","last_fullsized":"2023-08-10T10:49:12.717943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:32.998434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707054+0000","last_change":"2023-08-10T10:48:46.635407+0000","last_active":"2023-08-10T10:49:12.707054+0000","last_peered":"2023-08-10T10:49:12.707054+0000","last_clean":"2023-08-10T10:49:12.707054+0000","last_became_active":"2023-08-10T10:48:46.634936+0000","last_became_peered":"2023-08-10T10:48:46.634936+0000","last_unstale":"2023-08-10T10:49:12.707054+0000","last_undegraded":"2023-08-10T10:49:12.707054+0000","last_fullsized":"2023-08-10T10:49:12.707054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:17:41.129674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718213+0000","last_change":"2023-08-10T10:48:41.588054+0000","last_active":"2023-08-10T10:49:12.718213+0000","last_peered":"2023-08-10T10:49:12.718213+0000","last_clean":"2023-08-10T10:49:12.718213+0000","last_became_active":"2023-08-10T10:48:41.587764+0000","last_became_peered":"2023-08-10T10:48:41.587764+0000","last_unstale":"2023-08-10T10:49:12.718213+0000","last_undegraded":"2023-08-10T10:49:12.718213+0000","last_fullsized":"2023-08-10T10:49:12.718213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:07:17.541181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731849+0000","last_change":"2023-08-10T10:48:42.581834+0000","last_active":"2023-08-10T10:49:12.731849+0000","last_peered":"2023-08-10T10:49:12.731849+0000","last_clean":"2023-08-10T10:49:12.731849+0000","last_became_active":"2023-08-10T10:48:42.581438+0000","last_became_peered":"2023-08-10T10:48:42.581438+0000","last_unstale":"2023-08-10T10:49:12.731849+0000","last_undegraded":"2023-08-10T10:49:12.731849+0000","last_fullsized":"2023-08-10T10:49:12.731849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:05:46.899608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.737051+0000","last_change":"2023-08-10T10:49:12.737051+0000","last_active":"2023-08-10T10:49:12.737051+0000","last_peered":"2023-08-10T10:49:12.737051+0000","last_clean":"2023-08-10T10:49:12.737051+0000","last_became_active":"2023-08-10T10:49:12.736586+0000","last_became_peered":"2023-08-10T10:49:12.736586+0000","last_unstale":"2023-08-10T10:49:12.737051+0000","last_undegraded":"2023-08-10T10:49:12.737051+0000","last_fullsized":"2023-08-10T10:49:12.737051+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:41.900139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:16.651601+0000","last_change":"2023-08-10T10:49:12.734942+0000","last_active":"2023-08-10T10:49:16.651601+0000","last_peered":"2023-08-10T10:49:16.651601+0000","last_clean":"2023-08-10T10:49:16.651601+0000","last_became_active":"2023-08-10T10:49:12.720078+0000","last_became_peered":"2023-08-10T10:49:12.720078+0000","last_unstale":"2023-08-10T10:49:16.651601+0000","last_undegraded":"2023-08-10T10:49:16.651601+0000","last_fullsized":"2023-08-10T10:49:16.651601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:02.059905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707771+0000","last_change":"2023-08-10T10:48:42.581222+0000","last_active":"2023-08-10T10:49:12.707771+0000","last_peered":"2023-08-10T10:49:12.707771+0000","last_clean":"2023-08-10T10:49:12.707771+0000","last_became_active":"2023-08-10T10:48:42.580885+0000","last_became_peered":"2023-08-10T10:48:42.580885+0000","last_unstale":"2023-08-10T10:49:12.707771+0000","last_undegraded":"2023-08-10T10:49:12.707771+0000","last_fullsized":"2023-08-10T10:49:12.707771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:44:10.016090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707604+0000","last_change":"2023-08-10T10:48:46.626985+0000","last_active":"2023-08-10T10:49:12.707604+0000","last_peered":"2023-08-10T10:49:12.707604+0000","last_clean":"2023-08-10T10:49:12.707604+0000","last_became_active":"2023-08-10T10:48:46.626292+0000","last_became_peered":"2023-08-10T10:48:46.626292+0000","last_unstale":"2023-08-10T10:49:12.707604+0000","last_undegraded":"2023-08-10T10:49:12.707604+0000","last_fullsized":"2023-08-10T10:49:12.707604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:17.994796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.637116+0000","last_change":"2023-08-10T10:48:41.588563+0000","last_active":"2023-08-10T10:49:15.637116+0000","last_peered":"2023-08-10T10:49:15.637116+0000","last_clean":"2023-08-10T10:49:15.637116+0000","last_became_active":"2023-08-10T10:48:41.588250+0000","last_became_peered":"2023-08-10T10:48:41.588250+0000","last_unstale":"2023-08-10T10:49:15.637116+0000","last_undegraded":"2023-08-10T10:49:15.637116+0000","last_fullsized":"2023-08-10T10:49:15.637116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:12.146812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715313+0000","last_change":"2023-08-10T10:49:12.714641+0000","last_active":"2023-08-10T10:49:12.715313+0000","last_peered":"2023-08-10T10:49:12.715313+0000","last_clean":"2023-08-10T10:49:12.715313+0000","last_became_active":"2023-08-10T10:49:12.714185+0000","last_became_peered":"2023-08-10T10:49:12.714185+0000","last_unstale":"2023-08-10T10:49:12.715313+0000","last_undegraded":"2023-08-10T10:49:12.715313+0000","last_fullsized":"2023-08-10T10:49:12.715313+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:34:26.821493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717311+0000","last_change":"2023-08-10T10:48:46.630641+0000","last_active":"2023-08-10T10:49:12.717311+0000","last_peered":"2023-08-10T10:49:12.717311+0000","last_clean":"2023-08-10T10:49:12.717311+0000","last_became_active":"2023-08-10T10:48:46.630231+0000","last_became_peered":"2023-08-10T10:48:46.630231+0000","last_unstale":"2023-08-10T10:49:12.717311+0000","last_undegraded":"2023-08-10T10:49:12.717311+0000","last_fullsized":"2023-08-10T10:49:12.717311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:57:59.187279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:58.687836+0000","last_change":"2023-08-10T10:48:41.586083+0000","last_active":"2023-08-10T10:49:58.687836+0000","last_peered":"2023-08-10T10:49:58.687836+0000","last_clean":"2023-08-10T10:49:58.687836+0000","last_became_active":"2023-08-10T10:48:41.585714+0000","last_became_peered":"2023-08-10T10:48:41.585714+0000","last_unstale":"2023-08-10T10:49:58.687836+0000","last_undegraded":"2023-08-10T10:49:58.687836+0000","last_fullsized":"2023-08-10T10:49:58.687836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:28.992239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712459+0000","last_change":"2023-08-10T10:48:42.578007+0000","last_active":"2023-08-10T10:49:12.712459+0000","last_peered":"2023-08-10T10:49:12.712459+0000","last_clean":"2023-08-10T10:49:12.712459+0000","last_became_active":"2023-08-10T10:48:42.577687+0000","last_became_peered":"2023-08-10T10:48:42.577687+0000","last_unstale":"2023-08-10T10:49:12.712459+0000","last_undegraded":"2023-08-10T10:49:12.712459+0000","last_fullsized":"2023-08-10T10:49:12.712459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:23.114738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719097+0000","last_change":"2023-08-10T10:48:46.633618+0000","last_active":"2023-08-10T10:49:12.719097+0000","last_peered":"2023-08-10T10:49:12.719097+0000","last_clean":"2023-08-10T10:49:12.719097+0000","last_became_active":"2023-08-10T10:48:46.633223+0000","last_became_peered":"2023-08-10T10:48:46.633223+0000","last_unstale":"2023-08-10T10:49:12.719097+0000","last_undegraded":"2023-08-10T10:49:12.719097+0000","last_fullsized":"2023-08-10T10:49:12.719097+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:03.852150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627875+0000","last_change":"2023-08-10T10:48:41.591262+0000","last_active":"2023-08-10T10:49:14.627875+0000","last_peered":"2023-08-10T10:49:14.627875+0000","last_clean":"2023-08-10T10:49:14.627875+0000","last_became_active":"2023-08-10T10:48:41.590879+0000","last_became_peered":"2023-08-10T10:48:41.590879+0000","last_unstale":"2023-08-10T10:49:14.627875+0000","last_undegraded":"2023-08-10T10:49:14.627875+0000","last_fullsized":"2023-08-10T10:49:14.627875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:32:51.331831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730883+0000","last_change":"2023-08-10T10:48:42.581852+0000","last_active":"2023-08-10T10:49:12.730883+0000","last_peered":"2023-08-10T10:49:12.730883+0000","last_clean":"2023-08-10T10:49:12.730883+0000","last_became_active":"2023-08-10T10:48:42.581516+0000","last_became_peered":"2023-08-10T10:48:42.581516+0000","last_unstale":"2023-08-10T10:49:12.730883+0000","last_undegraded":"2023-08-10T10:49:12.730883+0000","last_fullsized":"2023-08-10T10:49:12.730883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:10.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713879+0000","last_change":"2023-08-10T10:48:46.629922+0000","last_active":"2023-08-10T10:49:12.713879+0000","last_peered":"2023-08-10T10:49:12.713879+0000","last_clean":"2023-08-10T10:49:12.713879+0000","last_became_active":"2023-08-10T10:48:46.629079+0000","last_became_peered":"2023-08-10T10:48:46.629079+0000","last_unstale":"2023-08-10T10:49:12.713879+0000","last_undegraded":"2023-08-10T10:49:12.713879+0000","last_fullsized":"2023-08-10T10:49:12.713879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:31:34.256668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.619783+0000","last_change":"2023-08-10T10:48:41.580410+0000","last_active":"2023-08-10T10:49:13.619783+0000","last_peered":"2023-08-10T10:49:13.619783+0000","last_clean":"2023-08-10T10:49:13.619783+0000","last_became_active":"2023-08-10T10:48:41.580032+0000","last_became_peered":"2023-08-10T10:48:41.580032+0000","last_unstale":"2023-08-10T10:49:13.619783+0000","last_undegraded":"2023-08-10T10:49:13.619783+0000","last_fullsized":"2023-08-10T10:49:13.619783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:46.503559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717834+0000","last_change":"2023-08-10T10:48:42.582297+0000","last_active":"2023-08-10T10:49:12.717834+0000","last_peered":"2023-08-10T10:49:12.717834+0000","last_clean":"2023-08-10T10:49:12.717834+0000","last_became_active":"2023-08-10T10:48:42.581966+0000","last_became_peered":"2023-08-10T10:48:42.581966+0000","last_unstale":"2023-08-10T10:49:12.717834+0000","last_undegraded":"2023-08-10T10:49:12.717834+0000","last_fullsized":"2023-08-10T10:49:12.717834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:48:05.595908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731000+0000","last_change":"2023-08-10T10:48:46.622376+0000","last_active":"2023-08-10T10:49:12.731000+0000","last_peered":"2023-08-10T10:49:12.731000+0000","last_clean":"2023-08-10T10:49:12.731000+0000","last_became_active":"2023-08-10T10:48:46.621872+0000","last_became_peered":"2023-08-10T10:48:46.621872+0000","last_unstale":"2023-08-10T10:49:12.731000+0000","last_undegraded":"2023-08-10T10:49:12.731000+0000","last_fullsized":"2023-08-10T10:49:12.731000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:06:48.430562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636118+0000","last_change":"2023-08-10T10:48:41.585309+0000","last_active":"2023-08-10T10:49:15.636118+0000","last_peered":"2023-08-10T10:49:15.636118+0000","last_clean":"2023-08-10T10:49:15.636118+0000","last_became_active":"2023-08-10T10:48:41.585007+0000","last_became_peered":"2023-08-10T10:48:41.585007+0000","last_unstale":"2023-08-10T10:49:15.636118+0000","last_undegraded":"2023-08-10T10:49:15.636118+0000","last_fullsized":"2023-08-10T10:49:15.636118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:23.129389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708400+0000","last_change":"2023-08-10T10:48:42.575404+0000","last_active":"2023-08-10T10:49:12.708400+0000","last_peered":"2023-08-10T10:49:12.708400+0000","last_clean":"2023-08-10T10:49:12.708400+0000","last_became_active":"2023-08-10T10:48:42.575072+0000","last_became_peered":"2023-08-10T10:48:42.575072+0000","last_unstale":"2023-08-10T10:49:12.708400+0000","last_undegraded":"2023-08-10T10:49:12.708400+0000","last_fullsized":"2023-08-10T10:49:12.708400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:48:47.730243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718109+0000","last_change":"2023-08-10T10:48:46.627175+0000","last_active":"2023-08-10T10:49:12.718109+0000","last_peered":"2023-08-10T10:49:12.718109+0000","last_clean":"2023-08-10T10:49:12.718109+0000","last_became_active":"2023-08-10T10:48:46.626639+0000","last_became_peered":"2023-08-10T10:48:46.626639+0000","last_unstale":"2023-08-10T10:49:12.718109+0000","last_undegraded":"2023-08-10T10:49:12.718109+0000","last_fullsized":"2023-08-10T10:49:12.718109+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:34:37.354808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:57.755906+0000","last_change":"2023-08-10T10:48:41.585185+0000","last_active":"2023-08-10T10:49:57.755906+0000","last_peered":"2023-08-10T10:49:57.755906+0000","last_clean":"2023-08-10T10:49:57.755906+0000","last_became_active":"2023-08-10T10:48:41.584834+0000","last_became_peered":"2023-08-10T10:48:41.584834+0000","last_unstale":"2023-08-10T10:49:57.755906+0000","last_undegraded":"2023-08-10T10:49:57.755906+0000","last_fullsized":"2023-08-10T10:49:57.755906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:10.581491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708214+0000","last_change":"2023-08-10T10:48:42.574634+0000","last_active":"2023-08-10T10:49:12.708214+0000","last_peered":"2023-08-10T10:49:12.708214+0000","last_clean":"2023-08-10T10:49:12.708214+0000","last_became_active":"2023-08-10T10:48:42.574290+0000","last_became_peered":"2023-08-10T10:48:42.574290+0000","last_unstale":"2023-08-10T10:49:12.708214+0000","last_undegraded":"2023-08-10T10:49:12.708214+0000","last_fullsized":"2023-08-10T10:49:12.708214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:32.688234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708363+0000","last_change":"2023-08-10T10:48:46.627158+0000","last_active":"2023-08-10T10:49:12.708363+0000","last_peered":"2023-08-10T10:49:12.708363+0000","last_clean":"2023-08-10T10:49:12.708363+0000","last_became_active":"2023-08-10T10:48:46.626686+0000","last_became_peered":"2023-08-10T10:48:46.626686+0000","last_unstale":"2023-08-10T10:49:12.708363+0000","last_undegraded":"2023-08-10T10:49:12.708363+0000","last_fullsized":"2023-08-10T10:49:12.708363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:44:14.440163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636298+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:49:15.636298+0000","last_peered":"2023-08-10T10:49:15.636298+0000","last_clean":"2023-08-10T10:49:15.636298+0000","last_became_active":"2023-08-10T10:48:41.586573+0000","last_became_peered":"2023-08-10T10:48:41.586573+0000","last_unstale":"2023-08-10T10:49:15.636298+0000","last_undegraded":"2023-08-10T10:49:15.636298+0000","last_fullsized":"2023-08-10T10:49:15.636298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:12.186283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731695+0000","last_change":"2023-08-10T10:48:42.584454+0000","last_active":"2023-08-10T10:49:12.731695+0000","last_peered":"2023-08-10T10:49:12.731695+0000","last_clean":"2023-08-10T10:49:12.731695+0000","last_became_active":"2023-08-10T10:48:42.584098+0000","last_became_peered":"2023-08-10T10:48:42.584098+0000","last_unstale":"2023-08-10T10:49:12.731695+0000","last_undegraded":"2023-08-10T10:49:12.731695+0000","last_fullsized":"2023-08-10T10:49:12.731695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:06.825290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708091+0000","last_change":"2023-08-10T10:48:46.635451+0000","last_active":"2023-08-10T10:49:12.708091+0000","last_peered":"2023-08-10T10:49:12.708091+0000","last_clean":"2023-08-10T10:49:12.708091+0000","last_became_active":"2023-08-10T10:48:46.634768+0000","last_became_peered":"2023-08-10T10:48:46.634768+0000","last_unstale":"2023-08-10T10:49:12.708091+0000","last_undegraded":"2023-08-10T10:49:12.708091+0000","last_fullsized":"2023-08-10T10:49:12.708091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:18.826421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.609913+0000","last_change":"2023-08-10T10:48:41.586720+0000","last_active":"2023-08-10T10:49:13.609913+0000","last_peered":"2023-08-10T10:49:13.609913+0000","last_clean":"2023-08-10T10:49:13.609913+0000","last_became_active":"2023-08-10T10:48:41.586365+0000","last_became_peered":"2023-08-10T10:48:41.586365+0000","last_unstale":"2023-08-10T10:49:13.609913+0000","last_undegraded":"2023-08-10T10:49:13.609913+0000","last_fullsized":"2023-08-10T10:49:13.609913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:18.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715509+0000","last_change":"2023-08-10T10:49:12.715509+0000","last_active":"2023-08-10T10:49:12.715509+0000","last_peered":"2023-08-10T10:49:12.715509+0000","last_clean":"2023-08-10T10:49:12.715509+0000","last_became_active":"2023-08-10T10:49:12.714785+0000","last_became_peered":"2023-08-10T10:49:12.714785+0000","last_unstale":"2023-08-10T10:49:12.715509+0000","last_undegraded":"2023-08-10T10:49:12.715509+0000","last_fullsized":"2023-08-10T10:49:12.715509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:02:27.185255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708443+0000","last_change":"2023-08-10T10:48:46.630613+0000","last_active":"2023-08-10T10:49:12.708443+0000","last_peered":"2023-08-10T10:49:12.708443+0000","last_clean":"2023-08-10T10:49:12.708443+0000","last_became_active":"2023-08-10T10:48:46.630152+0000","last_became_peered":"2023-08-10T10:48:46.630152+0000","last_unstale":"2023-08-10T10:49:12.708443+0000","last_undegraded":"2023-08-10T10:49:12.708443+0000","last_fullsized":"2023-08-10T10:49:12.708443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:18.733177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":160,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:58.701032+0000","last_change":"2023-08-10T10:48:41.583291+0000","last_active":"2023-08-10T10:49:58.701032+0000","last_peered":"2023-08-10T10:49:58.701032+0000","last_clean":"2023-08-10T10:49:58.701032+0000","last_became_active":"2023-08-10T10:48:41.582894+0000","last_became_peered":"2023-08-10T10:48:41.582894+0000","last_unstale":"2023-08-10T10:49:58.701032+0000","last_undegraded":"2023-08-10T10:49:58.701032+0000","last_fullsized":"2023-08-10T10:49:58.701032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:47.694100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59808,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":100,"num_read_kb":108,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713000+0000","last_change":"2023-08-10T10:48:42.582097+0000","last_active":"2023-08-10T10:49:12.713000+0000","last_peered":"2023-08-10T10:49:12.713000+0000","last_clean":"2023-08-10T10:49:12.713000+0000","last_became_active":"2023-08-10T10:48:42.581622+0000","last_became_peered":"2023-08-10T10:48:42.581622+0000","last_unstale":"2023-08-10T10:49:12.713000+0000","last_undegraded":"2023-08-10T10:49:12.713000+0000","last_fullsized":"2023-08-10T10:49:12.713000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:01.359438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731717+0000","last_change":"2023-08-10T10:48:46.628850+0000","last_active":"2023-08-10T10:49:12.731717+0000","last_peered":"2023-08-10T10:49:12.731717+0000","last_clean":"2023-08-10T10:49:12.731717+0000","last_became_active":"2023-08-10T10:48:46.628060+0000","last_became_peered":"2023-08-10T10:48:46.628060+0000","last_unstale":"2023-08-10T10:49:12.731717+0000","last_undegraded":"2023-08-10T10:49:12.731717+0000","last_fullsized":"2023-08-10T10:49:12.731717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:22.729040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.660296+0000","last_change":"2023-08-10T10:49:12.726708+0000","last_active":"2023-08-10T10:49:15.660296+0000","last_peered":"2023-08-10T10:49:15.660296+0000","last_clean":"2023-08-10T10:49:15.660296+0000","last_became_active":"2023-08-10T10:49:12.718963+0000","last_became_peered":"2023-08-10T10:49:12.718963+0000","last_unstale":"2023-08-10T10:49:15.660296+0000","last_undegraded":"2023-08-10T10:49:15.660296+0000","last_fullsized":"2023-08-10T10:49:15.660296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:42.202471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712953+0000","last_change":"2023-08-10T10:48:42.583174+0000","last_active":"2023-08-10T10:49:12.712953+0000","last_peered":"2023-08-10T10:49:12.712953+0000","last_clean":"2023-08-10T10:49:12.712953+0000","last_became_active":"2023-08-10T10:48:42.582869+0000","last_became_peered":"2023-08-10T10:48:42.582869+0000","last_unstale":"2023-08-10T10:49:12.712953+0000","last_undegraded":"2023-08-10T10:49:12.712953+0000","last_fullsized":"2023-08-10T10:49:12.712953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:25:22.404203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713733+0000","last_change":"2023-08-10T10:48:46.629285+0000","last_active":"2023-08-10T10:49:12.713733+0000","last_peered":"2023-08-10T10:49:12.713733+0000","last_clean":"2023-08-10T10:49:12.713733+0000","last_became_active":"2023-08-10T10:48:46.628849+0000","last_became_peered":"2023-08-10T10:48:46.628849+0000","last_unstale":"2023-08-10T10:49:12.713733+0000","last_undegraded":"2023-08-10T10:49:12.713733+0000","last_fullsized":"2023-08-10T10:49:12.713733+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:19.082444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636450+0000","last_change":"2023-08-10T10:48:41.592802+0000","last_active":"2023-08-10T10:49:15.636450+0000","last_peered":"2023-08-10T10:49:15.636450+0000","last_clean":"2023-08-10T10:49:15.636450+0000","last_became_active":"2023-08-10T10:48:41.592443+0000","last_became_peered":"2023-08-10T10:48:41.592443+0000","last_unstale":"2023-08-10T10:49:15.636450+0000","last_undegraded":"2023-08-10T10:49:15.636450+0000","last_fullsized":"2023-08-10T10:49:15.636450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:29:59.847912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718046+0000","last_change":"2023-08-10T10:48:42.586447+0000","last_active":"2023-08-10T10:49:12.718046+0000","last_peered":"2023-08-10T10:49:12.718046+0000","last_clean":"2023-08-10T10:49:12.718046+0000","last_became_active":"2023-08-10T10:48:42.586138+0000","last_became_peered":"2023-08-10T10:48:42.586138+0000","last_unstale":"2023-08-10T10:49:12.718046+0000","last_undegraded":"2023-08-10T10:49:12.718046+0000","last_fullsized":"2023-08-10T10:49:12.718046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:46.349690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733732+0000","last_change":"2023-08-10T10:49:12.732915+0000","last_active":"2023-08-10T10:49:12.733732+0000","last_peered":"2023-08-10T10:49:12.733732+0000","last_clean":"2023-08-10T10:49:12.733732+0000","last_became_active":"2023-08-10T10:49:12.732428+0000","last_became_peered":"2023-08-10T10:49:12.732428+0000","last_unstale":"2023-08-10T10:49:12.733732+0000","last_undegraded":"2023-08-10T10:49:12.733732+0000","last_fullsized":"2023-08-10T10:49:12.733732+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:48.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"91'6","reported_seq":79,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:01.748222+0000","last_change":"2023-08-10T10:48:41.588502+0000","last_active":"2023-08-10T10:50:01.748222+0000","last_peered":"2023-08-10T10:50:01.748222+0000","last_clean":"2023-08-10T10:50:01.748222+0000","last_became_active":"2023-08-10T10:48:41.588155+0000","last_became_peered":"2023-08-10T10:48:41.588155+0000","last_unstale":"2023-08-10T10:50:01.748222+0000","last_undegraded":"2023-08-10T10:50:01.748222+0000","last_fullsized":"2023-08-10T10:50:01.748222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:03.041234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717532+0000","last_change":"2023-08-10T10:48:42.578175+0000","last_active":"2023-08-10T10:49:12.717532+0000","last_peered":"2023-08-10T10:49:12.717532+0000","last_clean":"2023-08-10T10:49:12.717532+0000","last_became_active":"2023-08-10T10:48:42.577873+0000","last_became_peered":"2023-08-10T10:48:42.577873+0000","last_unstale":"2023-08-10T10:49:12.717532+0000","last_undegraded":"2023-08-10T10:49:12.717532+0000","last_fullsized":"2023-08-10T10:49:12.717532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:00:20.738100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719745+0000","last_change":"2023-08-10T10:49:12.719745+0000","last_active":"2023-08-10T10:49:12.719745+0000","last_peered":"2023-08-10T10:49:12.719745+0000","last_clean":"2023-08-10T10:49:12.719745+0000","last_became_active":"2023-08-10T10:49:12.719289+0000","last_became_peered":"2023-08-10T10:49:12.719289+0000","last_unstale":"2023-08-10T10:49:12.719745+0000","last_undegraded":"2023-08-10T10:49:12.719745+0000","last_fullsized":"2023-08-10T10:49:12.719745+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:06.026574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636507+0000","last_change":"2023-08-10T10:48:41.594170+0000","last_active":"2023-08-10T10:49:15.636507+0000","last_peered":"2023-08-10T10:49:15.636507+0000","last_clean":"2023-08-10T10:49:15.636507+0000","last_became_active":"2023-08-10T10:48:41.593776+0000","last_became_peered":"2023-08-10T10:48:41.593776+0000","last_unstale":"2023-08-10T10:49:15.636507+0000","last_undegraded":"2023-08-10T10:49:15.636507+0000","last_fullsized":"2023-08-10T10:49:15.636507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:58:00.968178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730226+0000","last_change":"2023-08-10T10:48:42.589149+0000","last_active":"2023-08-10T10:49:12.730226+0000","last_peered":"2023-08-10T10:49:12.730226+0000","last_clean":"2023-08-10T10:49:12.730226+0000","last_became_active":"2023-08-10T10:48:42.588466+0000","last_became_peered":"2023-08-10T10:48:42.588466+0000","last_unstale":"2023-08-10T10:49:12.730226+0000","last_undegraded":"2023-08-10T10:49:12.730226+0000","last_fullsized":"2023-08-10T10:49:12.730226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:16:06.271764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730078+0000","last_change":"2023-08-10T10:48:46.629070+0000","last_active":"2023-08-10T10:49:12.730078+0000","last_peered":"2023-08-10T10:49:12.730078+0000","last_clean":"2023-08-10T10:49:12.730078+0000","last_became_active":"2023-08-10T10:48:46.626045+0000","last_became_peered":"2023-08-10T10:48:46.626045+0000","last_unstale":"2023-08-10T10:49:12.730078+0000","last_undegraded":"2023-08-10T10:49:12.730078+0000","last_fullsized":"2023-08-10T10:49:12.730078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:07:15.985024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.606522+0000","last_change":"2023-08-10T10:48:41.590670+0000","last_active":"2023-08-10T10:49:13.606522+0000","last_peered":"2023-08-10T10:49:13.606522+0000","last_clean":"2023-08-10T10:49:13.606522+0000","last_became_active":"2023-08-10T10:48:41.589958+0000","last_became_peered":"2023-08-10T10:48:41.589958+0000","last_unstale":"2023-08-10T10:49:13.606522+0000","last_undegraded":"2023-08-10T10:49:13.606522+0000","last_fullsized":"2023-08-10T10:49:13.606522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:39:18.603399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714523+0000","last_change":"2023-08-10T10:48:42.581041+0000","last_active":"2023-08-10T10:49:12.714523+0000","last_peered":"2023-08-10T10:49:12.714523+0000","last_clean":"2023-08-10T10:49:12.714523+0000","last_became_active":"2023-08-10T10:48:42.580311+0000","last_became_peered":"2023-08-10T10:48:42.580311+0000","last_unstale":"2023-08-10T10:49:12.714523+0000","last_undegraded":"2023-08-10T10:49:12.714523+0000","last_fullsized":"2023-08-10T10:49:12.714523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:58:22.239730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712329+0000","last_change":"2023-08-10T10:48:46.907496+0000","last_active":"2023-08-10T10:49:12.712329+0000","last_peered":"2023-08-10T10:49:12.712329+0000","last_clean":"2023-08-10T10:49:12.712329+0000","last_became_active":"2023-08-10T10:48:46.907098+0000","last_became_peered":"2023-08-10T10:48:46.907098+0000","last_unstale":"2023-08-10T10:49:12.712329+0000","last_undegraded":"2023-08-10T10:49:12.712329+0000","last_fullsized":"2023-08-10T10:49:12.712329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:32.578901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708762+0000","last_change":"2023-08-10T10:48:41.585252+0000","last_active":"2023-08-10T10:49:12.708762+0000","last_peered":"2023-08-10T10:49:12.708762+0000","last_clean":"2023-08-10T10:49:12.708762+0000","last_became_active":"2023-08-10T10:48:41.583599+0000","last_became_peered":"2023-08-10T10:48:41.583599+0000","last_unstale":"2023-08-10T10:49:12.708762+0000","last_undegraded":"2023-08-10T10:49:12.708762+0000","last_fullsized":"2023-08-10T10:49:12.708762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:05.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711390+0000","last_change":"2023-08-10T10:48:42.581317+0000","last_active":"2023-08-10T10:49:12.711390+0000","last_peered":"2023-08-10T10:49:12.711390+0000","last_clean":"2023-08-10T10:49:12.711390+0000","last_became_active":"2023-08-10T10:48:42.581012+0000","last_became_peered":"2023-08-10T10:48:42.581012+0000","last_unstale":"2023-08-10T10:49:12.711390+0000","last_undegraded":"2023-08-10T10:49:12.711390+0000","last_fullsized":"2023-08-10T10:49:12.711390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:06.685943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713749+0000","last_change":"2023-08-10T10:48:46.623489+0000","last_active":"2023-08-10T10:49:12.713749+0000","last_peered":"2023-08-10T10:49:12.713749+0000","last_clean":"2023-08-10T10:49:12.713749+0000","last_became_active":"2023-08-10T10:48:46.621968+0000","last_became_peered":"2023-08-10T10:48:46.621968+0000","last_unstale":"2023-08-10T10:49:12.713749+0000","last_undegraded":"2023-08-10T10:49:12.713749+0000","last_fullsized":"2023-08-10T10:49:12.713749+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:46:18.848816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:57.740133+0000","last_change":"2023-08-10T10:48:41.579828+0000","last_active":"2023-08-10T10:49:57.740133+0000","last_peered":"2023-08-10T10:49:57.740133+0000","last_clean":"2023-08-10T10:49:57.740133+0000","last_became_active":"2023-08-10T10:48:41.579340+0000","last_became_peered":"2023-08-10T10:48:41.579340+0000","last_unstale":"2023-08-10T10:49:57.740133+0000","last_undegraded":"2023-08-10T10:49:57.740133+0000","last_fullsized":"2023-08-10T10:49:57.740133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:37.616654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733771+0000","last_change":"2023-08-10T10:49:12.733771+0000","last_active":"2023-08-10T10:49:12.733771+0000","last_peered":"2023-08-10T10:49:12.733771+0000","last_clean":"2023-08-10T10:49:12.733771+0000","last_became_active":"2023-08-10T10:49:12.733357+0000","last_became_peered":"2023-08-10T10:49:12.733357+0000","last_unstale":"2023-08-10T10:49:12.733771+0000","last_undegraded":"2023-08-10T10:49:12.733771+0000","last_fullsized":"2023-08-10T10:49:12.733771+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:42.675113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713322+0000","last_change":"2023-08-10T10:48:46.907982+0000","last_active":"2023-08-10T10:49:12.713322+0000","last_peered":"2023-08-10T10:49:12.713322+0000","last_clean":"2023-08-10T10:49:12.713322+0000","last_became_active":"2023-08-10T10:48:46.907184+0000","last_became_peered":"2023-08-10T10:48:46.907184+0000","last_unstale":"2023-08-10T10:49:12.713322+0000","last_undegraded":"2023-08-10T10:49:12.713322+0000","last_fullsized":"2023-08-10T10:49:12.713322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:10.496532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731622+0000","last_change":"2023-08-10T10:48:42.582808+0000","last_active":"2023-08-10T10:49:12.731622+0000","last_peered":"2023-08-10T10:49:12.731622+0000","last_clean":"2023-08-10T10:49:12.731622+0000","last_became_active":"2023-08-10T10:48:42.582517+0000","last_became_peered":"2023-08-10T10:48:42.582517+0000","last_unstale":"2023-08-10T10:49:12.731622+0000","last_undegraded":"2023-08-10T10:49:12.731622+0000","last_fullsized":"2023-08-10T10:49:12.731622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:03:17.102214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":78,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:00.745974+0000","last_change":"2023-08-10T10:48:41.594873+0000","last_active":"2023-08-10T10:50:00.745974+0000","last_peered":"2023-08-10T10:50:00.745974+0000","last_clean":"2023-08-10T10:50:00.745974+0000","last_became_active":"2023-08-10T10:48:41.594550+0000","last_became_peered":"2023-08-10T10:48:41.594550+0000","last_unstale":"2023-08-10T10:50:00.745974+0000","last_undegraded":"2023-08-10T10:50:00.745974+0000","last_fullsized":"2023-08-10T10:50:00.745974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:12.288533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718128+0000","last_change":"2023-08-10T10:48:46.626960+0000","last_active":"2023-08-10T10:49:12.718128+0000","last_peered":"2023-08-10T10:49:12.718128+0000","last_clean":"2023-08-10T10:49:12.718128+0000","last_became_active":"2023-08-10T10:48:46.626519+0000","last_became_peered":"2023-08-10T10:48:46.626519+0000","last_unstale":"2023-08-10T10:49:12.718128+0000","last_undegraded":"2023-08-10T10:49:12.718128+0000","last_fullsized":"2023-08-10T10:49:12.718128+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:12.352223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717207+0000","last_change":"2023-08-10T10:48:42.578921+0000","last_active":"2023-08-10T10:49:12.717207+0000","last_peered":"2023-08-10T10:49:12.717207+0000","last_clean":"2023-08-10T10:49:12.717207+0000","last_became_active":"2023-08-10T10:48:42.578322+0000","last_became_peered":"2023-08-10T10:48:42.578322+0000","last_unstale":"2023-08-10T10:49:12.717207+0000","last_undegraded":"2023-08-10T10:49:12.717207+0000","last_fullsized":"2023-08-10T10:49:12.717207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:39.453887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:16.651768+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:49:16.651768+0000","last_peered":"2023-08-10T10:49:16.651768+0000","last_clean":"2023-08-10T10:49:16.651768+0000","last_became_active":"2023-08-10T10:48:41.585217+0000","last_became_peered":"2023-08-10T10:48:41.585217+0000","last_unstale":"2023-08-10T10:49:16.651768+0000","last_undegraded":"2023-08-10T10:49:16.651768+0000","last_fullsized":"2023-08-10T10:49:16.651768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:01:10.279255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":357,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717157+0000","last_change":"2023-08-10T10:47:22.594211+0000","last_active":"2023-08-10T10:49:12.717157+0000","last_peered":"2023-08-10T10:49:12.717157+0000","last_clean":"2023-08-10T10:49:12.717157+0000","last_became_active":"2023-08-10T10:47:22.593742+0000","last_became_peered":"2023-08-10T10:47:22.593742+0000","last_unstale":"2023-08-10T10:49:12.717157+0000","last_undegraded":"2023-08-10T10:49:12.717157+0000","last_fullsized":"2023-08-10T10:49:12.717157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_clean_scrub_stamp":"2023-08-10T10:43:44.512037+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:23.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730745+0000","last_change":"2023-08-10T10:48:46.907769+0000","last_active":"2023-08-10T10:49:12.730745+0000","last_peered":"2023-08-10T10:49:12.730745+0000","last_clean":"2023-08-10T10:49:12.730745+0000","last_became_active":"2023-08-10T10:48:46.907241+0000","last_became_peered":"2023-08-10T10:48:46.907241+0000","last_unstale":"2023-08-10T10:49:12.730745+0000","last_undegraded":"2023-08-10T10:49:12.730745+0000","last_fullsized":"2023-08-10T10:49:12.730745+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:37:49.077753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712543+0000","last_change":"2023-08-10T10:48:42.587277+0000","last_active":"2023-08-10T10:49:12.712543+0000","last_peered":"2023-08-10T10:49:12.712543+0000","last_clean":"2023-08-10T10:49:12.712543+0000","last_became_active":"2023-08-10T10:48:42.586308+0000","last_became_peered":"2023-08-10T10:48:42.586308+0000","last_unstale":"2023-08-10T10:49:12.712543+0000","last_undegraded":"2023-08-10T10:49:12.712543+0000","last_fullsized":"2023-08-10T10:49:12.712543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:23.894942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.622279+0000","last_change":"2023-08-10T10:48:41.587116+0000","last_active":"2023-08-10T10:49:13.622279+0000","last_peered":"2023-08-10T10:49:13.622279+0000","last_clean":"2023-08-10T10:49:13.622279+0000","last_became_active":"2023-08-10T10:48:41.586771+0000","last_became_peered":"2023-08-10T10:48:41.586771+0000","last_unstale":"2023-08-10T10:49:13.622279+0000","last_undegraded":"2023-08-10T10:49:13.622279+0000","last_fullsized":"2023-08-10T10:49:13.622279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:30.371131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714841+0000","last_change":"2023-08-10T10:48:46.625140+0000","last_active":"2023-08-10T10:49:12.714841+0000","last_peered":"2023-08-10T10:49:12.714841+0000","last_clean":"2023-08-10T10:49:12.714841+0000","last_became_active":"2023-08-10T10:48:46.624615+0000","last_became_peered":"2023-08-10T10:48:46.624615+0000","last_unstale":"2023-08-10T10:49:12.714841+0000","last_undegraded":"2023-08-10T10:49:12.714841+0000","last_fullsized":"2023-08-10T10:49:12.714841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:42.063440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627974+0000","last_change":"2023-08-10T10:48:41.589435+0000","last_active":"2023-08-10T10:49:14.627974+0000","last_peered":"2023-08-10T10:49:14.627974+0000","last_clean":"2023-08-10T10:49:14.627974+0000","last_became_active":"2023-08-10T10:48:41.589070+0000","last_became_peered":"2023-08-10T10:48:41.589070+0000","last_unstale":"2023-08-10T10:49:14.627974+0000","last_undegraded":"2023-08-10T10:49:14.627974+0000","last_fullsized":"2023-08-10T10:49:14.627974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:22:03.215196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713488+0000","last_change":"2023-08-10T10:48:42.586352+0000","last_active":"2023-08-10T10:49:12.713488+0000","last_peered":"2023-08-10T10:49:12.713488+0000","last_clean":"2023-08-10T10:49:12.713488+0000","last_became_active":"2023-08-10T10:48:42.585955+0000","last_became_peered":"2023-08-10T10:48:42.585955+0000","last_unstale":"2023-08-10T10:49:12.713488+0000","last_undegraded":"2023-08-10T10:49:12.713488+0000","last_fullsized":"2023-08-10T10:49:12.713488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:45.529054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717201+0000","last_change":"2023-08-10T10:48:46.907519+0000","last_active":"2023-08-10T10:49:12.717201+0000","last_peered":"2023-08-10T10:49:12.717201+0000","last_clean":"2023-08-10T10:49:12.717201+0000","last_became_active":"2023-08-10T10:48:46.907087+0000","last_became_peered":"2023-08-10T10:48:46.907087+0000","last_unstale":"2023-08-10T10:49:12.717201+0000","last_undegraded":"2023-08-10T10:49:12.717201+0000","last_fullsized":"2023-08-10T10:49:12.717201+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:03.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:21.915528+0000","last_change":"2023-08-10T10:48:41.583746+0000","last_active":"2023-08-10T10:49:21.915528+0000","last_peered":"2023-08-10T10:49:21.915528+0000","last_clean":"2023-08-10T10:49:21.915528+0000","last_became_active":"2023-08-10T10:48:41.583321+0000","last_became_peered":"2023-08-10T10:48:41.583321+0000","last_unstale":"2023-08-10T10:49:21.915528+0000","last_undegraded":"2023-08-10T10:49:21.915528+0000","last_fullsized":"2023-08-10T10:49:21.915528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:53:25.620711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717495+0000","last_change":"2023-08-10T10:48:42.579942+0000","last_active":"2023-08-10T10:49:12.717495+0000","last_peered":"2023-08-10T10:49:12.717495+0000","last_clean":"2023-08-10T10:49:12.717495+0000","last_became_active":"2023-08-10T10:48:42.579561+0000","last_became_peered":"2023-08-10T10:48:42.579561+0000","last_unstale":"2023-08-10T10:49:12.717495+0000","last_undegraded":"2023-08-10T10:49:12.717495+0000","last_fullsized":"2023-08-10T10:49:12.717495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:22.447394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718242+0000","last_change":"2023-08-10T10:48:46.621499+0000","last_active":"2023-08-10T10:49:12.718242+0000","last_peered":"2023-08-10T10:49:12.718242+0000","last_clean":"2023-08-10T10:49:12.718242+0000","last_became_active":"2023-08-10T10:48:46.621076+0000","last_became_peered":"2023-08-10T10:48:46.621076+0000","last_unstale":"2023-08-10T10:49:12.718242+0000","last_undegraded":"2023-08-10T10:49:12.718242+0000","last_fullsized":"2023-08-10T10:49:12.718242+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:34.844650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635369+0000","last_change":"2023-08-10T10:48:41.585574+0000","last_active":"2023-08-10T10:49:15.635369+0000","last_peered":"2023-08-10T10:49:15.635369+0000","last_clean":"2023-08-10T10:49:15.635369+0000","last_became_active":"2023-08-10T10:48:41.585254+0000","last_became_peered":"2023-08-10T10:48:41.585254+0000","last_unstale":"2023-08-10T10:49:15.635369+0000","last_undegraded":"2023-08-10T10:49:15.635369+0000","last_fullsized":"2023-08-10T10:49:15.635369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:25:52.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731219+0000","last_change":"2023-08-10T10:48:42.584003+0000","last_active":"2023-08-10T10:49:12.731219+0000","last_peered":"2023-08-10T10:49:12.731219+0000","last_clean":"2023-08-10T10:49:12.731219+0000","last_became_active":"2023-08-10T10:48:42.583712+0000","last_became_peered":"2023-08-10T10:48:42.583712+0000","last_unstale":"2023-08-10T10:49:12.731219+0000","last_undegraded":"2023-08-10T10:49:12.731219+0000","last_fullsized":"2023-08-10T10:49:12.731219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:52.543954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707184+0000","last_change":"2023-08-10T10:48:46.908113+0000","last_active":"2023-08-10T10:49:12.707184+0000","last_peered":"2023-08-10T10:49:12.707184+0000","last_clean":"2023-08-10T10:49:12.707184+0000","last_became_active":"2023-08-10T10:48:46.907552+0000","last_became_peered":"2023-08-10T10:48:46.907552+0000","last_unstale":"2023-08-10T10:49:12.707184+0000","last_undegraded":"2023-08-10T10:49:12.707184+0000","last_fullsized":"2023-08-10T10:49:12.707184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:48:47.326917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.732470+0000","last_change":"2023-08-10T10:48:41.584254+0000","last_active":"2023-08-10T10:49:12.732470+0000","last_peered":"2023-08-10T10:49:12.732470+0000","last_clean":"2023-08-10T10:49:12.732470+0000","last_became_active":"2023-08-10T10:48:41.583129+0000","last_became_peered":"2023-08-10T10:48:41.583129+0000","last_unstale":"2023-08-10T10:49:12.732470+0000","last_undegraded":"2023-08-10T10:49:12.732470+0000","last_fullsized":"2023-08-10T10:49:12.732470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:23.183495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712107+0000","last_change":"2023-08-10T10:48:42.582264+0000","last_active":"2023-08-10T10:49:12.712107+0000","last_peered":"2023-08-10T10:49:12.712107+0000","last_clean":"2023-08-10T10:49:12.712107+0000","last_became_active":"2023-08-10T10:48:42.581542+0000","last_became_peered":"2023-08-10T10:48:42.581542+0000","last_unstale":"2023-08-10T10:49:12.712107+0000","last_undegraded":"2023-08-10T10:49:12.712107+0000","last_fullsized":"2023-08-10T10:49:12.712107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:30:57.631202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709384+0000","last_change":"2023-08-10T10:48:46.632019+0000","last_active":"2023-08-10T10:49:12.709384+0000","last_peered":"2023-08-10T10:49:12.709384+0000","last_clean":"2023-08-10T10:49:12.709384+0000","last_became_active":"2023-08-10T10:48:46.631510+0000","last_became_peered":"2023-08-10T10:48:46.631510+0000","last_unstale":"2023-08-10T10:49:12.709384+0000","last_undegraded":"2023-08-10T10:49:12.709384+0000","last_fullsized":"2023-08-10T10:49:12.709384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:55.720402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635631+0000","last_change":"2023-08-10T10:48:41.591206+0000","last_active":"2023-08-10T10:49:15.635631+0000","last_peered":"2023-08-10T10:49:15.635631+0000","last_clean":"2023-08-10T10:49:15.635631+0000","last_became_active":"2023-08-10T10:48:41.590897+0000","last_became_peered":"2023-08-10T10:48:41.590897+0000","last_unstale":"2023-08-10T10:49:15.635631+0000","last_undegraded":"2023-08-10T10:49:15.635631+0000","last_fullsized":"2023-08-10T10:49:15.635631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:30.418971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713681+0000","last_change":"2023-08-10T10:48:42.586470+0000","last_active":"2023-08-10T10:49:12.713681+0000","last_peered":"2023-08-10T10:49:12.713681+0000","last_clean":"2023-08-10T10:49:12.713681+0000","last_became_active":"2023-08-10T10:48:42.586109+0000","last_became_peered":"2023-08-10T10:48:42.586109+0000","last_unstale":"2023-08-10T10:49:12.713681+0000","last_undegraded":"2023-08-10T10:49:12.713681+0000","last_fullsized":"2023-08-10T10:49:12.713681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:12.453665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707306+0000","last_change":"2023-08-10T10:48:46.629886+0000","last_active":"2023-08-10T10:49:12.707306+0000","last_peered":"2023-08-10T10:49:12.707306+0000","last_clean":"2023-08-10T10:49:12.707306+0000","last_became_active":"2023-08-10T10:48:46.629403+0000","last_became_peered":"2023-08-10T10:48:46.629403+0000","last_unstale":"2023-08-10T10:49:12.707306+0000","last_undegraded":"2023-08-10T10:49:12.707306+0000","last_fullsized":"2023-08-10T10:49:12.707306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:11.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:17.355530+0000","last_change":"2023-08-10T10:48:41.593231+0000","last_active":"2023-08-10T10:49:17.355530+0000","last_peered":"2023-08-10T10:49:17.355530+0000","last_clean":"2023-08-10T10:49:17.355530+0000","last_became_active":"2023-08-10T10:48:41.592893+0000","last_became_peered":"2023-08-10T10:48:41.592893+0000","last_unstale":"2023-08-10T10:49:17.355530+0000","last_undegraded":"2023-08-10T10:49:17.355530+0000","last_fullsized":"2023-08-10T10:49:17.355530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:41.661067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.734525+0000","last_change":"2023-08-10T10:49:12.732774+0000","last_active":"2023-08-10T10:49:12.734525+0000","last_peered":"2023-08-10T10:49:12.734525+0000","last_clean":"2023-08-10T10:49:12.734525+0000","last_became_active":"2023-08-10T10:49:12.732277+0000","last_became_peered":"2023-08-10T10:49:12.732277+0000","last_unstale":"2023-08-10T10:49:12.734525+0000","last_undegraded":"2023-08-10T10:49:12.734525+0000","last_fullsized":"2023-08-10T10:49:12.734525+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:06.334205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707420+0000","last_change":"2023-08-10T10:48:46.908347+0000","last_active":"2023-08-10T10:49:12.707420+0000","last_peered":"2023-08-10T10:49:12.707420+0000","last_clean":"2023-08-10T10:49:12.707420+0000","last_became_active":"2023-08-10T10:48:46.907266+0000","last_became_peered":"2023-08-10T10:48:46.907266+0000","last_unstale":"2023-08-10T10:49:12.707420+0000","last_undegraded":"2023-08-10T10:49:12.707420+0000","last_fullsized":"2023-08-10T10:49:12.707420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:52.767489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.734388+0000","last_change":"2023-08-10T10:48:41.585055+0000","last_active":"2023-08-10T10:49:12.734388+0000","last_peered":"2023-08-10T10:49:12.734388+0000","last_clean":"2023-08-10T10:49:12.734388+0000","last_became_active":"2023-08-10T10:48:41.584676+0000","last_became_peered":"2023-08-10T10:48:41.584676+0000","last_unstale":"2023-08-10T10:49:12.734388+0000","last_undegraded":"2023-08-10T10:49:12.734388+0000","last_fullsized":"2023-08-10T10:49:12.734388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:14:29.461100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718623+0000","last_change":"2023-08-10T10:48:42.586764+0000","last_active":"2023-08-10T10:49:12.718623+0000","last_peered":"2023-08-10T10:49:12.718623+0000","last_clean":"2023-08-10T10:49:12.718623+0000","last_became_active":"2023-08-10T10:48:42.586177+0000","last_became_peered":"2023-08-10T10:48:42.586177+0000","last_unstale":"2023-08-10T10:49:12.718623+0000","last_undegraded":"2023-08-10T10:49:12.718623+0000","last_fullsized":"2023-08-10T10:49:12.718623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:34.472956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707294+0000","last_change":"2023-08-10T10:48:46.626872+0000","last_active":"2023-08-10T10:49:12.707294+0000","last_peered":"2023-08-10T10:49:12.707294+0000","last_clean":"2023-08-10T10:49:12.707294+0000","last_became_active":"2023-08-10T10:48:46.626354+0000","last_became_peered":"2023-08-10T10:48:46.626354+0000","last_unstale":"2023-08-10T10:49:12.707294+0000","last_undegraded":"2023-08-10T10:49:12.707294+0000","last_fullsized":"2023-08-10T10:49:12.707294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:10:12.332212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:01.762709+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:50:01.762709+0000","last_peered":"2023-08-10T10:50:01.762709+0000","last_clean":"2023-08-10T10:50:01.762709+0000","last_became_active":"2023-08-10T10:48:41.586311+0000","last_became_peered":"2023-08-10T10:48:41.586311+0000","last_unstale":"2023-08-10T10:50:01.762709+0000","last_undegraded":"2023-08-10T10:50:01.762709+0000","last_fullsized":"2023-08-10T10:50:01.762709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:57.983205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718513+0000","last_change":"2023-08-10T10:48:42.577290+0000","last_active":"2023-08-10T10:49:12.718513+0000","last_peered":"2023-08-10T10:49:12.718513+0000","last_clean":"2023-08-10T10:49:12.718513+0000","last_became_active":"2023-08-10T10:48:42.576928+0000","last_became_peered":"2023-08-10T10:48:42.576928+0000","last_unstale":"2023-08-10T10:49:12.718513+0000","last_undegraded":"2023-08-10T10:49:12.718513+0000","last_fullsized":"2023-08-10T10:49:12.718513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:20.491056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730204+0000","last_change":"2023-08-10T10:48:46.627842+0000","last_active":"2023-08-10T10:49:12.730204+0000","last_peered":"2023-08-10T10:49:12.730204+0000","last_clean":"2023-08-10T10:49:12.730204+0000","last_became_active":"2023-08-10T10:48:46.627472+0000","last_became_peered":"2023-08-10T10:48:46.627472+0000","last_unstale":"2023-08-10T10:49:12.730204+0000","last_undegraded":"2023-08-10T10:49:12.730204+0000","last_fullsized":"2023-08-10T10:49:12.730204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:23.103275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627941+0000","last_change":"2023-08-10T10:48:41.592742+0000","last_active":"2023-08-10T10:49:14.627941+0000","last_peered":"2023-08-10T10:49:14.627941+0000","last_clean":"2023-08-10T10:49:14.627941+0000","last_became_active":"2023-08-10T10:48:41.592409+0000","last_became_peered":"2023-08-10T10:48:41.592409+0000","last_unstale":"2023-08-10T10:49:14.627941+0000","last_undegraded":"2023-08-10T10:49:14.627941+0000","last_fullsized":"2023-08-10T10:49:14.627941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:38:45.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717859+0000","last_change":"2023-08-10T10:48:42.583444+0000","last_active":"2023-08-10T10:49:12.717859+0000","last_peered":"2023-08-10T10:49:12.717859+0000","last_clean":"2023-08-10T10:49:12.717859+0000","last_became_active":"2023-08-10T10:48:42.583073+0000","last_became_peered":"2023-08-10T10:48:42.583073+0000","last_unstale":"2023-08-10T10:49:12.717859+0000","last_undegraded":"2023-08-10T10:49:12.717859+0000","last_fullsized":"2023-08-10T10:49:12.717859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:40.712897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730483+0000","last_change":"2023-08-10T10:48:46.626340+0000","last_active":"2023-08-10T10:49:12.730483+0000","last_peered":"2023-08-10T10:49:12.730483+0000","last_clean":"2023-08-10T10:49:12.730483+0000","last_became_active":"2023-08-10T10:48:46.625867+0000","last_became_peered":"2023-08-10T10:48:46.625867+0000","last_unstale":"2023-08-10T10:49:12.730483+0000","last_undegraded":"2023-08-10T10:49:12.730483+0000","last_fullsized":"2023-08-10T10:49:12.730483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:50:35.707438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635911+0000","last_change":"2023-08-10T10:48:41.590734+0000","last_active":"2023-08-10T10:49:15.635911+0000","last_peered":"2023-08-10T10:49:15.635911+0000","last_clean":"2023-08-10T10:49:15.635911+0000","last_became_active":"2023-08-10T10:48:41.590433+0000","last_became_peered":"2023-08-10T10:48:41.590433+0000","last_unstale":"2023-08-10T10:49:15.635911+0000","last_undegraded":"2023-08-10T10:49:15.635911+0000","last_fullsized":"2023-08-10T10:49:15.635911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:07.269605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718071+0000","last_change":"2023-08-10T10:48:42.576628+0000","last_active":"2023-08-10T10:49:12.718071+0000","last_peered":"2023-08-10T10:49:12.718071+0000","last_clean":"2023-08-10T10:49:12.718071+0000","last_became_active":"2023-08-10T10:48:42.576285+0000","last_became_peered":"2023-08-10T10:48:42.576285+0000","last_unstale":"2023-08-10T10:49:12.718071+0000","last_undegraded":"2023-08-10T10:49:12.718071+0000","last_fullsized":"2023-08-10T10:49:12.718071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:36.534268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713896+0000","last_change":"2023-08-10T10:48:42.579615+0000","last_active":"2023-08-10T10:49:12.713896+0000","last_peered":"2023-08-10T10:49:12.713896+0000","last_clean":"2023-08-10T10:49:12.713896+0000","last_became_active":"2023-08-10T10:48:42.579291+0000","last_became_peered":"2023-08-10T10:48:42.579291+0000","last_unstale":"2023-08-10T10:49:12.713896+0000","last_undegraded":"2023-08-10T10:49:12.713896+0000","last_fullsized":"2023-08-10T10:49:12.713896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:20.879001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718573+0000","last_change":"2023-08-10T10:48:42.581358+0000","last_active":"2023-08-10T10:49:12.718573+0000","last_peered":"2023-08-10T10:49:12.718573+0000","last_clean":"2023-08-10T10:49:12.718573+0000","last_became_active":"2023-08-10T10:48:42.580942+0000","last_became_peered":"2023-08-10T10:48:42.580942+0000","last_unstale":"2023-08-10T10:49:12.718573+0000","last_undegraded":"2023-08-10T10:49:12.718573+0000","last_fullsized":"2023-08-10T10:49:12.718573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:45.675996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718718+0000","last_change":"2023-08-10T10:48:42.574494+0000","last_active":"2023-08-10T10:49:12.718718+0000","last_peered":"2023-08-10T10:49:12.718718+0000","last_clean":"2023-08-10T10:49:12.718718+0000","last_became_active":"2023-08-10T10:48:42.574203+0000","last_became_peered":"2023-08-10T10:48:42.574203+0000","last_unstale":"2023-08-10T10:49:12.718718+0000","last_undegraded":"2023-08-10T10:49:12.718718+0000","last_fullsized":"2023-08-10T10:49:12.718718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:10:10.406920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731545+0000","last_change":"2023-08-10T10:48:42.587557+0000","last_active":"2023-08-10T10:49:12.731545+0000","last_peered":"2023-08-10T10:49:12.731545+0000","last_clean":"2023-08-10T10:49:12.731545+0000","last_became_active":"2023-08-10T10:48:42.587133+0000","last_became_peered":"2023-08-10T10:48:42.587133+0000","last_unstale":"2023-08-10T10:49:12.731545+0000","last_undegraded":"2023-08-10T10:49:12.731545+0000","last_fullsized":"2023-08-10T10:49:12.731545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:45:35.005412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713339+0000","last_change":"2023-08-10T10:48:42.587283+0000","last_active":"2023-08-10T10:49:12.713339+0000","last_peered":"2023-08-10T10:49:12.713339+0000","last_clean":"2023-08-10T10:49:12.713339+0000","last_became_active":"2023-08-10T10:48:42.586118+0000","last_became_peered":"2023-08-10T10:48:42.586118+0000","last_unstale":"2023-08-10T10:49:12.713339+0000","last_undegraded":"2023-08-10T10:49:12.713339+0000","last_fullsized":"2023-08-10T10:49:12.713339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:10:50.868060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715015+0000","last_change":"2023-08-10T10:48:42.580843+0000","last_active":"2023-08-10T10:49:12.715015+0000","last_peered":"2023-08-10T10:49:12.715015+0000","last_clean":"2023-08-10T10:49:12.715015+0000","last_became_active":"2023-08-10T10:48:42.579735+0000","last_became_peered":"2023-08-10T10:48:42.579735+0000","last_unstale":"2023-08-10T10:49:12.715015+0000","last_undegraded":"2023-08-10T10:49:12.715015+0000","last_fullsized":"2023-08-10T10:49:12.715015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:24.025912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717927+0000","last_change":"2023-08-10T10:48:42.580250+0000","last_active":"2023-08-10T10:49:12.717927+0000","last_peered":"2023-08-10T10:49:12.717927+0000","last_clean":"2023-08-10T10:49:12.717927+0000","last_became_active":"2023-08-10T10:48:42.579962+0000","last_became_peered":"2023-08-10T10:48:42.579962+0000","last_unstale":"2023-08-10T10:49:12.717927+0000","last_undegraded":"2023-08-10T10:49:12.717927+0000","last_fullsized":"2023-08-10T10:49:12.717927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:03:04.269405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717788+0000","last_change":"2023-08-10T10:48:42.582699+0000","last_active":"2023-08-10T10:49:12.717788+0000","last_peered":"2023-08-10T10:49:12.717788+0000","last_clean":"2023-08-10T10:49:12.717788+0000","last_became_active":"2023-08-10T10:48:42.582426+0000","last_became_peered":"2023-08-10T10:48:42.582426+0000","last_unstale":"2023-08-10T10:49:12.717788+0000","last_undegraded":"2023-08-10T10:49:12.717788+0000","last_fullsized":"2023-08-10T10:49:12.717788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:40.237741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731459+0000","last_change":"2023-08-10T10:48:42.577483+0000","last_active":"2023-08-10T10:49:12.731459+0000","last_peered":"2023-08-10T10:49:12.731459+0000","last_clean":"2023-08-10T10:49:12.731459+0000","last_became_active":"2023-08-10T10:48:42.577195+0000","last_became_peered":"2023-08-10T10:48:42.577195+0000","last_unstale":"2023-08-10T10:49:12.731459+0000","last_undegraded":"2023-08-10T10:49:12.731459+0000","last_fullsized":"2023-08-10T10:49:12.731459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:59:56.657695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717888+0000","last_change":"2023-08-10T10:48:42.581129+0000","last_active":"2023-08-10T10:49:12.717888+0000","last_peered":"2023-08-10T10:49:12.717888+0000","last_clean":"2023-08-10T10:49:12.717888+0000","last_became_active":"2023-08-10T10:48:42.579350+0000","last_became_peered":"2023-08-10T10:48:42.579350+0000","last_unstale":"2023-08-10T10:49:12.717888+0000","last_undegraded":"2023-08-10T10:49:12.717888+0000","last_fullsized":"2023-08-10T10:49:12.717888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:27.669242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707581+0000","last_change":"2023-08-10T10:48:42.578167+0000","last_active":"2023-08-10T10:49:12.707581+0000","last_peered":"2023-08-10T10:49:12.707581+0000","last_clean":"2023-08-10T10:49:12.707581+0000","last_became_active":"2023-08-10T10:48:42.577571+0000","last_became_peered":"2023-08-10T10:48:42.577571+0000","last_unstale":"2023-08-10T10:49:12.707581+0000","last_undegraded":"2023-08-10T10:49:12.707581+0000","last_fullsized":"2023-08-10T10:49:12.707581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:54:14.264193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712579+0000","last_change":"2023-08-10T10:48:42.587207+0000","last_active":"2023-08-10T10:49:12.712579+0000","last_peered":"2023-08-10T10:49:12.712579+0000","last_clean":"2023-08-10T10:49:12.712579+0000","last_became_active":"2023-08-10T10:48:42.586848+0000","last_became_peered":"2023-08-10T10:48:42.586848+0000","last_unstale":"2023-08-10T10:49:12.712579+0000","last_undegraded":"2023-08-10T10:49:12.712579+0000","last_fullsized":"2023-08-10T10:49:12.712579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:34:50.994727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714173+0000","last_change":"2023-08-10T10:48:42.580785+0000","last_active":"2023-08-10T10:49:12.714173+0000","last_peered":"2023-08-10T10:49:12.714173+0000","last_clean":"2023-08-10T10:49:12.714173+0000","last_became_active":"2023-08-10T10:48:42.580395+0000","last_became_peered":"2023-08-10T10:48:42.580395+0000","last_unstale":"2023-08-10T10:49:12.714173+0000","last_undegraded":"2023-08-10T10:49:12.714173+0000","last_fullsized":"2023-08-10T10:49:12.714173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:17:41.679781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250142,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66818,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":495,"num_read_kb":319,"num_write":238,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383710,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":501253,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46100000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.93000000000000005,"5min":1.044,"15min":1.044},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97599999999999998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97899999999999998,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.38100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.84099999999999997},"min":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.216,"5min":1.272,"15min":1.272},"last":1.077},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.59599999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0109999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.77500000000000002,"15min":0.76400000000000001},"min":{"1min":0.626,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1479999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73099999999999998,"15min":0.72099999999999997},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.093,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.83199999999999996,"15min":0.82699999999999996},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.91900000000000004,"15min":0.91300000000000003},"min":{"1min":0.71699999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.9019999999999999,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88500000000000001,"15min":0.88},"min":{"1min":0.65500000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":1.597,"15min":1.597},"last":1.03},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.88700000000000001,"15min":0.88600000000000001},"min":{"1min":0.70699999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1659999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0189999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.093},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.84799999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.069,"5min":0.93500000000000005,"15min":0.91300000000000003},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.7759999999999998,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":0.98799999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92700000000000005,"15min":0.92100000000000004},"min":{"1min":0.65800000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.05},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.98899999999999999,"15min":0.97799999999999998},"min":{"1min":0.73699999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.478,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.1180000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645347,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1146880,"data_stored":1147478,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.89200000000000002,"5min":1.355,"15min":1.355},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.68700000000000006,"15min":0.70599999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80200000000000005,"5min":1.494,"15min":1.494},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.496,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.99099999999999999,"5min":1.222,"15min":1.222},"last":0.622},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82899999999999996,"15min":0.84099999999999997},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97399999999999998,"5min":1.198,"15min":1.198},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.82399999999999995,"15min":0.84399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0249999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.83899999999999997,"15min":0.86499999999999999},"min":{"1min":0.502,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86599999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80700000000000005,"15min":0.81999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91800000000000004,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.81499999999999995,"15min":0.83899999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.119,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.93899999999999995,"15min":0.95799999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0029999999999999,"5min":1.369,"15min":1.369},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.91700000000000004,"15min":0.93700000000000006},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.018,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0960000000000001,"5min":1.579,"15min":1.579},"last":0.88},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.94199999999999995,"15min":0.95599999999999996},"min":{"1min":0.65500000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.109,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.53000000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0269999999999999},"min":{"1min":0.67900000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1739999999999999,"5min":1.869,"15min":1.869},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.874,"5min":1.046,"15min":1.0740000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0860000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.90200000000000002}]},{"osd":9,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.034,"15min":1.052},"min":{"1min":0.70099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.129,"5min":1.619,"15min":1.619},"last":0.746},{"interface":"front","average":{"1min":0.873,"5min":1.0549999999999999,"15min":1.085},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0640000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.86099999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:49:46 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.999,"15min":1.006},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2270000000000001,"5min":1.79,"15min":1.79},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96599999999999997,"15min":0.96999999999999997},"min":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1459999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.80800000000000005}]}]},{"osd":9,"up_from":67,"seq":287762808873,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":504869,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.35499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.86599999999999999},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.93200000000000005,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.024,"5min":1.077,"15min":1.077},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.747,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.157,"5min":1.167,"15min":1.167},"last":0.751}]},{"osd":3,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65000000000000002,"15min":0.68799999999999994},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3109999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.39700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75,"15min":0.78600000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86099999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.80200000000000005,"15min":0.84199999999999997},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0209999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81799999999999995,"15min":0.85399999999999998},"min":{"1min":0.53700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.111,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81999999999999995,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2110000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.081}]},{"osd":7,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.85399999999999998,"15min":0.90200000000000002},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.099,"5min":1.607,"15min":1.607},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.143,"5min":1.236,"15min":1.236},"last":0.66500000000000004}]},{"osd":8,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0229999999999999,"5min":1.319,"15min":1.319},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":0.94499999999999995},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.63300000000000001}]},{"osd":10,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.86599999999999999,"15min":0.878},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0289999999999999,"5min":1.258,"15min":1.258},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.91400000000000003,"15min":0.92600000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.98099999999999998,"5min":1.381,"15min":1.381},"last":0.84099999999999997}]},{"osd":11,"last update":"Thu Aug 10 10:49:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.73499999999999999}]}]},{"osd":8,"up_from":59,"seq":253403070510,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":500820,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":5.1909999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.873}]},{"osd":2,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.66900000000000004},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98999999999999999,"5min":1.103,"15min":1.103},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63300000000000001,"15min":0.66300000000000003},"min":{"1min":0.33300000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73299999999999998,"15min":0.75800000000000001},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92200000000000004,"5min":1.113,"15min":1.113},"last":5.1189999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94799999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.84399999999999997},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0700000000000001,"5min":1.238,"15min":1.238},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.1739999999999999,"5min":1.214,"15min":1.214},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76900000000000002,"15min":0.81000000000000005},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99099999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.628},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78800000000000003,"15min":0.82299999999999995},"min":{"1min":0.5,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1639999999999999,"5min":1.236,"15min":1.236},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86599999999999999,"15min":0.89300000000000002},"min":{"1min":0.55900000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.876,"15min":0.91200000000000003},"min":{"1min":0.51100000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96899999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":5.1609999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90600000000000003,"15min":0.94099999999999995},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1279999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91300000000000003,"15min":0.93700000000000006},"min":{"1min":0.66900000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2390000000000001,"5min":1.29,"15min":1.29},"last":0.84299999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:48:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1919999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88100000000000001,"15min":0.88300000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.341,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.73999999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89200000000000002,"15min":0.877},"min":{"1min":0.64500000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.179,"5min":1.214,"15min":1.214},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.91300000000000003,"15min":0.90800000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.139,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.85899999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.95899999999999996}]}]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":1097172,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0489999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99299999999999999,"5min":1.466,"15min":1.466},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.622}]},{"osd":2,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.82199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.81200000000000006,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88200000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.876}]},{"osd":4,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65400000000000003,"15min":0.67100000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81299999999999994,"15min":0.82399999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.194,"15min":1.194},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0329999999999999,"5min":1.409,"15min":1.409},"last":0.84799999999999998}]},{"osd":8,"last update":"Thu Aug 10 10:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89200000000000002,"15min":0.874},"min":{"1min":0.68200000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.0620000000000001,"5min":1.379,"15min":1.379},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88300000000000001,"15min":0.878},"min":{"1min":0.67700000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0329999999999999,"5min":1.357,"15min":1.357},"last":0.79700000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93899999999999995,"15min":0.96099999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0109999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.89200000000000002,"15min":0.89600000000000002},"min":{"1min":0.64800000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0940000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96699999999999997,"15min":0.97099999999999997},"min":{"1min":0.70999999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.143,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.0649999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.95199999999999996}]}]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":496229,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.48199999999999998,"15min":0.45900000000000002},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.53400000000000003,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.748,"15min":0.73299999999999998},"min":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73399999999999999,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.95899999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.434},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.70999999999999996,"15min":0.69599999999999995},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.625}]},{"osd":3,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.423,"5min":3.423,"15min":3.423},"last":0.501}]},{"osd":4,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76700000000000002,"15min":0.754},"min":{"1min":0.56200000000000006,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78100000000000003,"15min":0.77300000000000002},"min":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.91100000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.746,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.66400000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.755}]},{"osd":7,"last update":"Thu Aug 10 10:49:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.95599999999999996,"5min":1.016,"15min":1.016},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98999999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.88600000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.66500000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83399999999999996,"15min":0.85499999999999998},"min":{"1min":0.62,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.77800000000000002}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.88700000000000001,"15min":0.88900000000000001},"min":{"1min":0.52800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.879}]},{"osd":10,"last update":"Thu Aug 10 10:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.91900000000000004,"15min":0.92700000000000005},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.103,"5min":1.175,"15min":1.175},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.66700000000000004,"5min":0.63,"15min":0.63},"max":{"1min":1.147,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0289999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:49:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":557067,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.57699999999999996},"min":{"1min":0.434,"5min":0.35299999999999998,"15min":0.26600000000000001},"max":{"1min":0.95699999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.624,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.28399999999999997},"max":{"1min":0.82699999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.432}]},{"osd":2,"last update":"Thu Aug 10 10:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.70599999999999996,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.40999999999999998,"15min":0.32200000000000001},"max":{"1min":1.1539999999999999,"5min":1.25,"15min":1.25},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.68500000000000005,"15min":0.60499999999999998},"min":{"1min":0.45200000000000001,"5min":0.38900000000000001,"15min":0.34499999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.876}]},{"osd":3,"last update":"Thu Aug 10 10:49:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69499999999999995,"15min":0.63900000000000001},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71799999999999997,"15min":0.66100000000000003},"min":{"1min":0.58299999999999996,"5min":0.377,"15min":0.377},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.47399999999999998},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.74199999999999999,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.72999999999999998,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.77600000000000002},"min":{"1min":0.60199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.78600000000000003,"15min":0.73999999999999999},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Aug 10 10:49:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69499999999999995,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.80600000000000005,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.72199999999999998}]},{"osd":8,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89500000000000002,"15min":0.876},"min":{"1min":0.68300000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.86199999999999999,"15min":0.83799999999999997},"min":{"1min":0.64500000000000002,"5min":0.624,"15min":0.624},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.78400000000000003}]},{"osd":9,"last update":"Thu Aug 10 10:49:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":0.89300000000000002,"15min":0.85299999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.159,"5min":0.97399999999999998,"15min":0.93600000000000005},"min":{"1min":0.67200000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":5.2670000000000003,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.84599999999999997}]},{"osd":10,"last update":"Thu Aug 10 10:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90800000000000003,"15min":0.91000000000000003},"min":{"1min":0.65600000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.76200000000000001}]},{"osd":11,"last update":"Thu Aug 10 10:49:46 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.83299999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":498075,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61899999999999999,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91600000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.61399999999999999},"min":{"1min":0.48299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70699999999999996,"15min":0.69299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.73799999999999999,"15min":0.70999999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Aug 10 10:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.72099999999999997,"15min":0.67300000000000004},"min":{"1min":0.45200000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.69299999999999995,"15min":0.65400000000000003},"min":{"1min":0.48099999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.52500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90700000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70999999999999996,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Aug 10 10:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.64400000000000002}]},{"osd":8,"last update":"Thu Aug 10 10:49:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.60099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.84899999999999998,"15min":0.84299999999999997},"min":{"1min":0.621,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.88800000000000001}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.80700000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88800000000000001},"min":{"1min":0.60099999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.327,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.873,"15min":0.879},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.86799999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.871,"15min":0.86099999999999999},"min":{"1min":0.72299999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.70899999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.90400000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":556619,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.72699999999999998,"15min":0.63800000000000001},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":9.548,"5min":9.548,"15min":9.548},"last":0.626},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.70399999999999996,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":9.5,"5min":9.5,"15min":9.5},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.70499999999999996,"15min":0.625},"min":{"1min":0.55200000000000005,"5min":0.315,"15min":0.315},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.624},"min":{"1min":0.52000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.51500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.97899999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88100000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56299999999999994,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0189999999999999,"5min":1.488,"15min":1.488},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.57799999999999996,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92100000000000004,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Aug 10 10:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.76900000000000002,"15min":0.70099999999999996},"min":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.851,"5min":4.851,"15min":4.851},"last":0.504},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.73599999999999999,"15min":0.69999999999999996},"min":{"1min":0.58399999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.748}]},{"osd":7,"last update":"Thu Aug 10 10:49:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.80100000000000005}]},{"osd":8,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.45300000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88,"5min":0.997,"15min":0.997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.63600000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.145,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.45100000000000001}]},{"osd":9,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.80800000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.9379999999999997,"5min":4.9379999999999997,"15min":4.9379999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.508,"5min":0.94999999999999996,"15min":0.85799999999999998},"min":{"1min":0.78400000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":0.70099999999999996}]},{"osd":10,"last update":"Thu Aug 10 10:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.74399999999999999,"15min":0.72999999999999998},"min":{"1min":0.60299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.876},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.90400000000000003,"15min":0.88800000000000001},"min":{"1min":0.71099999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89200000000000002}]},{"osd":11,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.78100000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182472,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":495654,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.442,"15min":0.41699999999999998},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.61399999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.45800000000000002,"15min":0.436},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.624,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.68200000000000005,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0469999999999999,"5min":1.133,"15min":1.133},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97499999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73999999999999999,"15min":0.66800000000000004},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92000000000000004,"5min":6.367,"15min":6.367},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.66800000000000004},"min":{"1min":0.52900000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":1.004,"15min":1.004},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:49:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.85499999999999998,"15min":0.73699999999999999},"min":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.98099999999999998,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.76500000000000001,"15min":0.71499999999999997},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85699999999999998,"5min":6.3410000000000002,"15min":6.3410000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.59499999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94299999999999995,"5min":1.054,"15min":1.054},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86199999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93799999999999994,"5min":1.095,"15min":1.095},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79400000000000004,"15min":0.76800000000000002},"min":{"1min":0.59299999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.032,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78400000000000003,"15min":0.754},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0249999999999999,"5min":1.327,"15min":1.327},"last":1.1519999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.04,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.85799999999999998},"min":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.0880000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.753}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.82299999999999995,"15min":0.85999999999999999},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.069,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0029999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.70399999999999996,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.056,"5min":1.165,"15min":1.165},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88400000000000001,"15min":0.88700000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.877}]},{"osd":11,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0269999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920835,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":500693,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:49:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68999999999999995,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:49:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.70099999999999996,"15min":0.68500000000000005},"min":{"1min":0.50900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.71899999999999997,"15min":0.70099999999999996},"min":{"1min":0.54100000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.421,"15min":1.421},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:49:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67700000000000005,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.94299999999999995,"5min":1.069,"15min":1.069},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.752,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95399999999999996,"5min":1.377,"15min":1.377},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.59499999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91600000000000004,"5min":0.999,"15min":0.999},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76800000000000002,"15min":0.748},"min":{"1min":0.59899999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.089,"15min":1.089},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.006,"5min":1.071,"15min":1.071},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.751,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.92100000000000004}]},{"osd":8,"last update":"Thu Aug 10 10:49:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.88,"15min":0.86299999999999999},"min":{"1min":0.755,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.69999999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.98399999999999999}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84599999999999997,"15min":0.85299999999999998},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.0720000000000001,"5min":1.175,"15min":1.175},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.88400000000000001,"15min":0.872},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.94799999999999995}]},{"osd":10,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.92300000000000004,"15min":0.92600000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.89600000000000002,"15min":0.90100000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.65100000000000002}]},{"osd":11,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.879}]}]},{"osd":5,"up_from":38,"seq":163208757310,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":1092460,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94099999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78400000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.625}]},{"osd":1,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.97899999999999998,"5min":1.073,"15min":1.073},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95699999999999996,"5min":1.014,"15min":1.014},"last":0.84999999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.499},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.876,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.875,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89600000000000002,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.68999999999999995},"min":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96399999999999997,"5min":1.141,"15min":1.141},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69499999999999995,"15min":0.68500000000000005},"min":{"1min":0.52000000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99099999999999999,"5min":1.321,"15min":1.321},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72299999999999998,"15min":0.70899999999999996},"min":{"1min":0.625,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92900000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.751},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.76000000000000001,"15min":0.73399999999999999},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.753,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.88900000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.51900000000000002,"5min":0.503,"15min":0.503},"max":{"1min":0.99399999999999999,"5min":1.012,"15min":1.012},"last":0.871},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.56499999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94699999999999995,"5min":0.997,"15min":0.997},"last":0.57999999999999996}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83699999999999997,"15min":0.83399999999999996},"min":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.91200000000000003}]},{"osd":10,"last update":"Thu Aug 10 10:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.024,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:50:04.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph pg dump --format=json 2023-08-10T10:50:04.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:04 smithi195 ceph-mon[129938]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T10:50:04.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:04 smithi195 ceph-mon[129938]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:50:05.032 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:05.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:04 smithi157 ceph-mon[129604]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T10:50:05.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:04 smithi157 ceph-mon[129604]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:50:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:04 smithi107 ceph-mon[127953]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T10:50:05.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:04 smithi107 ceph-mon[127953]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:50:06.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.505+0000 7f84f0dbc700 1 -- 172.21.15.107:0/1629140637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec100790 msgr2=0x7f84ec100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.505+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/1629140637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec100790 0x7f84ec100c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f84e00098f0 tx=0x7f84e0009c00 comp rx=0 tx=0).stop 2023-08-10T10:50:06.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.505+0000 7f84f0dbc700 1 -- 172.21.15.107:0/1629140637 shutdown_connections 2023-08-10T10:50:06.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.506+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/1629140637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84ec106790 0x7f84ec106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.506+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/1629140637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84ec101150 0x7f84ec10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.506+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/1629140637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec100790 0x7f84ec100c10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.506+0000 7f84f0dbc700 1 -- 172.21.15.107:0/1629140637 >> 172.21.15.107:0/1629140637 conn(0x7f84ec0fc260 msgr2=0x7f84ec0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:06.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.506+0000 7f84f0dbc700 1 -- 172.21.15.107:0/1629140637 shutdown_connections 2023-08-10T10:50:06.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.506+0000 7f84f0dbc700 1 -- 172.21.15.107:0/1629140637 wait complete. 2023-08-10T10:50:06.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.507+0000 7f84f0dbc700 1 Processor -- start 2023-08-10T10:50:06.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.507+0000 7f84f0dbc700 1 -- start start 2023-08-10T10:50:06.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.507+0000 7f84f0dbc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84ec100790 0x7f84ec19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.507+0000 7f84f0dbc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84ec101150 0x7f84ec19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.507+0000 7f84f0dbc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec106790 0x7f84ec1966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.507+0000 7f84f0dbc700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec196d60 con 0x7f84ec106790 2023-08-10T10:50:06.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.507+0000 7f84f0dbc700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec196ed0 con 0x7f84ec100790 2023-08-10T10:50:06.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.507+0000 7f84f0dbc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec197090 con 0x7f84ec101150 2023-08-10T10:50:06.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ead9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec106790 0x7f84ec1966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ead9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec106790 0x7f84ec1966f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44826/0 (socket says 172.21.15.107:44826) 2023-08-10T10:50:06.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ead9d700 1 -- 172.21.15.107:0/736441218 learned_addr learned my addr 172.21.15.107:0/736441218 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:06.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ea59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84ec100790 0x7f84ec19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84e9d9b700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84ec101150 0x7f84ec19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ead9d700 1 -- 172.21.15.107:0/736441218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84ec101150 msgr2=0x7f84ec19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ead9d700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84ec101150 0x7f84ec19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ead9d700 1 -- 172.21.15.107:0/736441218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84ec100790 msgr2=0x7f84ec19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ead9d700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84ec100790 0x7f84ec19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ead9d700 1 -- 172.21.15.107:0/736441218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009520 con 0x7f84ec106790 2023-08-10T10:50:06.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84e9d9b700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84ec101150 0x7f84ec19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:06.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84ead9d700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec106790 0x7f84ec1966f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c110 tx=0x7f84e400c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84db7fe700 1 -- 172.21.15.107:0/736441218 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4017070 con 0x7f84ec106790 2023-08-10T10:50:06.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84db7fe700 1 -- 172.21.15.107:0/736441218 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84e400e050 con 0x7f84ec106790 2023-08-10T10:50:06.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.508+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec197310 con 0x7f84ec106790 2023-08-10T10:50:06.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.509+0000 7f84db7fe700 1 -- 172.21.15.107:0/736441218 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4007880 con 0x7f84ec106790 2023-08-10T10:50:06.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.509+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec1a3660 con 0x7f84ec106790 2023-08-10T10:50:06.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.510+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec04e470 con 0x7f84ec106790 2023-08-10T10:50:06.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.511+0000 7f84db7fe700 1 -- 172.21.15.107:0/736441218 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f84e400cad0 con 0x7f84ec106790 2023-08-10T10:50:06.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.513+0000 7f84db7fe700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f84d40a1260 0x7f84d40a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:06.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.513+0000 7f84db7fe700 1 -- 172.21.15.107:0/736441218 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f84e40cc870 con 0x7f84ec106790 2023-08-10T10:50:06.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.513+0000 7f84ea59c700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f84d40a1260 0x7f84d40a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:06.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.514+0000 7f84ea59c700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f84d40a1260 0x7f84d40a3720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009be0 tx=0x7f84dc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:06.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.517+0000 7f84db7fe700 1 -- 172.21.15.107:0/736441218 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f84e4095b00 con 0x7f84ec106790 2023-08-10T10:50:06.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.712+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84ec0fd070 con 0x7f84d40a1260 2023-08-10T10:50:06.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.725+0000 7f84db7fe700 1 -- 172.21.15.107:0/736441218 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426138 (secure 0 0 0) 0x7f84ec0fd070 con 0x7f84d40a1260 2023-08-10T10:50:06.730 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:06.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f84d40a1260 msgr2=0x7f84d40a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f84d40a1260 0x7f84d40a3720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009be0 tx=0x7f84dc009260 comp rx=0 tx=0).stop 2023-08-10T10:50:06.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec106790 msgr2=0x7f84ec1966f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:06.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec106790 0x7f84ec1966f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c110 tx=0x7f84e400c420 comp rx=0 tx=0).stop 2023-08-10T10:50:06.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 shutdown_connections 2023-08-10T10:50:06.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f84d40a1260 0x7f84d40a3720 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84ec100790 0x7f84ec19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f84ec106790 0x7f84ec1966f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 --2- 172.21.15.107:0/736441218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84ec101150 0x7f84ec19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:06.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 >> 172.21.15.107:0/736441218 conn(0x7f84ec0fc260 msgr2=0x7f84ec0fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:06.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 shutdown_connections 2023-08-10T10:50:06.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:06.731+0000 7f84f0dbc700 1 -- 172.21.15.107:0/736441218 wait complete. 2023-08-10T10:50:06.734 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-08-10T10:50:06.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:06 smithi195 ceph-mon[129938]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-08-10T10:50:06.914 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:06 smithi107 ceph-mon[127953]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-08-10T10:50:07.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:06 smithi157 ceph-mon[129604]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-08-10T10:50:07.224 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2023-08-10T10:50:05.602278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657432,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":659,"num_read_kb":452,"num_write":421,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336460,"kb_used_data":12268,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605364,"statfs":{"total":1151940427776,"available":1151595892736,"internally_reserved":0,"allocated":12562432,"data_stored":7948389,"data_compressed":319464,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":64,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003514"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714060+0000","last_change":"2023-08-10T10:48:42.585259+0000","last_active":"2023-08-10T10:49:12.714060+0000","last_peered":"2023-08-10T10:49:12.714060+0000","last_clean":"2023-08-10T10:49:12.714060+0000","last_became_active":"2023-08-10T10:48:42.584501+0000","last_became_peered":"2023-08-10T10:48:42.584501+0000","last_unstale":"2023-08-10T10:49:12.714060+0000","last_undegraded":"2023-08-10T10:49:12.714060+0000","last_fullsized":"2023-08-10T10:49:12.714060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:18:31.281761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731723+0000","last_change":"2023-08-10T10:48:42.577812+0000","last_active":"2023-08-10T10:49:12.731723+0000","last_peered":"2023-08-10T10:49:12.731723+0000","last_clean":"2023-08-10T10:49:12.731723+0000","last_became_active":"2023-08-10T10:48:42.577499+0000","last_became_peered":"2023-08-10T10:48:42.577499+0000","last_unstale":"2023-08-10T10:49:12.731723+0000","last_undegraded":"2023-08-10T10:49:12.731723+0000","last_fullsized":"2023-08-10T10:49:12.731723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:27:32.054997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731226+0000","last_change":"2023-08-10T10:48:42.577302+0000","last_active":"2023-08-10T10:49:12.731226+0000","last_peered":"2023-08-10T10:49:12.731226+0000","last_clean":"2023-08-10T10:49:12.731226+0000","last_became_active":"2023-08-10T10:48:42.577022+0000","last_became_peered":"2023-08-10T10:48:42.577022+0000","last_unstale":"2023-08-10T10:49:12.731226+0000","last_undegraded":"2023-08-10T10:49:12.731226+0000","last_fullsized":"2023-08-10T10:49:12.731226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:19.509385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707930+0000","last_change":"2023-08-10T10:48:42.577198+0000","last_active":"2023-08-10T10:49:12.707930+0000","last_peered":"2023-08-10T10:49:12.707930+0000","last_clean":"2023-08-10T10:49:12.707930+0000","last_became_active":"2023-08-10T10:48:42.576887+0000","last_became_peered":"2023-08-10T10:48:42.576887+0000","last_unstale":"2023-08-10T10:49:12.707930+0000","last_undegraded":"2023-08-10T10:49:12.707930+0000","last_fullsized":"2023-08-10T10:49:12.707930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:13.115193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712407+0000","last_change":"2023-08-10T10:48:42.587532+0000","last_active":"2023-08-10T10:49:12.712407+0000","last_peered":"2023-08-10T10:49:12.712407+0000","last_clean":"2023-08-10T10:49:12.712407+0000","last_became_active":"2023-08-10T10:48:42.587199+0000","last_became_peered":"2023-08-10T10:48:42.587199+0000","last_unstale":"2023-08-10T10:49:12.712407+0000","last_undegraded":"2023-08-10T10:49:12.712407+0000","last_fullsized":"2023-08-10T10:49:12.712407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:39.740129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711152+0000","last_change":"2023-08-10T10:48:42.581998+0000","last_active":"2023-08-10T10:49:12.711152+0000","last_peered":"2023-08-10T10:49:12.711152+0000","last_clean":"2023-08-10T10:49:12.711152+0000","last_became_active":"2023-08-10T10:48:42.581683+0000","last_became_peered":"2023-08-10T10:48:42.581683+0000","last_unstale":"2023-08-10T10:49:12.711152+0000","last_undegraded":"2023-08-10T10:49:12.711152+0000","last_fullsized":"2023-08-10T10:49:12.711152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:19.796398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717754+0000","last_change":"2023-08-10T10:48:42.578452+0000","last_active":"2023-08-10T10:49:12.717754+0000","last_peered":"2023-08-10T10:49:12.717754+0000","last_clean":"2023-08-10T10:49:12.717754+0000","last_became_active":"2023-08-10T10:48:42.577456+0000","last_became_peered":"2023-08-10T10:48:42.577456+0000","last_unstale":"2023-08-10T10:49:12.717754+0000","last_undegraded":"2023-08-10T10:49:12.717754+0000","last_fullsized":"2023-08-10T10:49:12.717754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:17:35.823145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717028+0000","last_change":"2023-08-10T10:48:42.578839+0000","last_active":"2023-08-10T10:49:12.717028+0000","last_peered":"2023-08-10T10:49:12.717028+0000","last_clean":"2023-08-10T10:49:12.717028+0000","last_became_active":"2023-08-10T10:48:42.578450+0000","last_became_peered":"2023-08-10T10:48:42.578450+0000","last_unstale":"2023-08-10T10:49:12.717028+0000","last_undegraded":"2023-08-10T10:49:12.717028+0000","last_fullsized":"2023-08-10T10:49:12.717028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:29:39.316129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708298+0000","last_change":"2023-08-10T10:48:42.588533+0000","last_active":"2023-08-10T10:49:12.708298+0000","last_peered":"2023-08-10T10:49:12.708298+0000","last_clean":"2023-08-10T10:49:12.708298+0000","last_became_active":"2023-08-10T10:48:42.588205+0000","last_became_peered":"2023-08-10T10:48:42.588205+0000","last_unstale":"2023-08-10T10:49:12.708298+0000","last_undegraded":"2023-08-10T10:49:12.708298+0000","last_fullsized":"2023-08-10T10:49:12.708298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:27.853522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711349+0000","last_change":"2023-08-10T10:48:42.588606+0000","last_active":"2023-08-10T10:49:12.711349+0000","last_peered":"2023-08-10T10:49:12.711349+0000","last_clean":"2023-08-10T10:49:12.711349+0000","last_became_active":"2023-08-10T10:48:42.588261+0000","last_became_peered":"2023-08-10T10:48:42.588261+0000","last_unstale":"2023-08-10T10:49:12.711349+0000","last_undegraded":"2023-08-10T10:49:12.711349+0000","last_fullsized":"2023-08-10T10:49:12.711349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:08:25.435478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718340+0000","last_change":"2023-08-10T10:48:42.577245+0000","last_active":"2023-08-10T10:49:12.718340+0000","last_peered":"2023-08-10T10:49:12.718340+0000","last_clean":"2023-08-10T10:49:12.718340+0000","last_became_active":"2023-08-10T10:48:42.576512+0000","last_became_peered":"2023-08-10T10:48:42.576512+0000","last_unstale":"2023-08-10T10:49:12.718340+0000","last_undegraded":"2023-08-10T10:49:12.718340+0000","last_fullsized":"2023-08-10T10:49:12.718340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:41.419282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707744+0000","last_change":"2023-08-10T10:48:42.590704+0000","last_active":"2023-08-10T10:49:12.707744+0000","last_peered":"2023-08-10T10:49:12.707744+0000","last_clean":"2023-08-10T10:49:12.707744+0000","last_became_active":"2023-08-10T10:48:42.590360+0000","last_became_peered":"2023-08-10T10:48:42.590360+0000","last_unstale":"2023-08-10T10:49:12.707744+0000","last_undegraded":"2023-08-10T10:49:12.707744+0000","last_fullsized":"2023-08-10T10:49:12.707744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:27.858538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712842+0000","last_change":"2023-08-10T10:48:42.580072+0000","last_active":"2023-08-10T10:49:12.712842+0000","last_peered":"2023-08-10T10:49:12.712842+0000","last_clean":"2023-08-10T10:49:12.712842+0000","last_became_active":"2023-08-10T10:48:42.579745+0000","last_became_peered":"2023-08-10T10:48:42.579745+0000","last_unstale":"2023-08-10T10:49:12.712842+0000","last_undegraded":"2023-08-10T10:49:12.712842+0000","last_fullsized":"2023-08-10T10:49:12.712842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:58.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730013+0000","last_change":"2023-08-10T10:48:42.577050+0000","last_active":"2023-08-10T10:49:12.730013+0000","last_peered":"2023-08-10T10:49:12.730013+0000","last_clean":"2023-08-10T10:49:12.730013+0000","last_became_active":"2023-08-10T10:48:42.576686+0000","last_became_peered":"2023-08-10T10:48:42.576686+0000","last_unstale":"2023-08-10T10:49:12.730013+0000","last_undegraded":"2023-08-10T10:49:12.730013+0000","last_fullsized":"2023-08-10T10:49:12.730013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:20:27.181934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730451+0000","last_change":"2023-08-10T10:48:42.582939+0000","last_active":"2023-08-10T10:49:12.730451+0000","last_peered":"2023-08-10T10:49:12.730451+0000","last_clean":"2023-08-10T10:49:12.730451+0000","last_became_active":"2023-08-10T10:48:42.582560+0000","last_became_peered":"2023-08-10T10:48:42.582560+0000","last_unstale":"2023-08-10T10:49:12.730451+0000","last_undegraded":"2023-08-10T10:49:12.730451+0000","last_fullsized":"2023-08-10T10:49:12.730451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:36:49.334857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.706881+0000","last_change":"2023-08-10T10:48:42.577163+0000","last_active":"2023-08-10T10:49:12.706881+0000","last_peered":"2023-08-10T10:49:12.706881+0000","last_clean":"2023-08-10T10:49:12.706881+0000","last_became_active":"2023-08-10T10:48:42.576866+0000","last_became_peered":"2023-08-10T10:48:42.576866+0000","last_unstale":"2023-08-10T10:49:12.706881+0000","last_undegraded":"2023-08-10T10:49:12.706881+0000","last_fullsized":"2023-08-10T10:49:12.706881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:50:27.812527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713970+0000","last_change":"2023-08-10T10:48:42.585496+0000","last_active":"2023-08-10T10:49:12.713970+0000","last_peered":"2023-08-10T10:49:12.713970+0000","last_clean":"2023-08-10T10:49:12.713970+0000","last_became_active":"2023-08-10T10:48:42.584963+0000","last_became_peered":"2023-08-10T10:48:42.584963+0000","last_unstale":"2023-08-10T10:49:12.713970+0000","last_undegraded":"2023-08-10T10:49:12.713970+0000","last_fullsized":"2023-08-10T10:49:12.713970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:05.902933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709523+0000","last_change":"2023-08-10T10:48:42.576038+0000","last_active":"2023-08-10T10:49:12.709523+0000","last_peered":"2023-08-10T10:49:12.709523+0000","last_clean":"2023-08-10T10:49:12.709523+0000","last_became_active":"2023-08-10T10:48:42.575660+0000","last_became_peered":"2023-08-10T10:48:42.575660+0000","last_unstale":"2023-08-10T10:49:12.709523+0000","last_undegraded":"2023-08-10T10:49:12.709523+0000","last_fullsized":"2023-08-10T10:49:12.709523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:17.443396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717536+0000","last_change":"2023-08-10T10:48:42.573855+0000","last_active":"2023-08-10T10:49:12.717536+0000","last_peered":"2023-08-10T10:49:12.717536+0000","last_clean":"2023-08-10T10:49:12.717536+0000","last_became_active":"2023-08-10T10:48:42.573475+0000","last_became_peered":"2023-08-10T10:48:42.573475+0000","last_unstale":"2023-08-10T10:49:12.717536+0000","last_undegraded":"2023-08-10T10:49:12.717536+0000","last_fullsized":"2023-08-10T10:49:12.717536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:13:36.282148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719366+0000","last_change":"2023-08-10T10:48:46.628005+0000","last_active":"2023-08-10T10:49:12.719366+0000","last_peered":"2023-08-10T10:49:12.719366+0000","last_clean":"2023-08-10T10:49:12.719366+0000","last_became_active":"2023-08-10T10:48:46.627558+0000","last_became_peered":"2023-08-10T10:48:46.627558+0000","last_unstale":"2023-08-10T10:49:12.719366+0000","last_undegraded":"2023-08-10T10:49:12.719366+0000","last_fullsized":"2023-08-10T10:49:12.719366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:33:01.121958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":85,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:01.745042+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:50:01.745042+0000","last_peered":"2023-08-10T10:50:01.745042+0000","last_clean":"2023-08-10T10:50:01.745042+0000","last_became_active":"2023-08-10T10:48:41.585341+0000","last_became_peered":"2023-08-10T10:48:41.585341+0000","last_unstale":"2023-08-10T10:50:01.745042+0000","last_undegraded":"2023-08-10T10:50:01.745042+0000","last_fullsized":"2023-08-10T10:50:01.745042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:34.374039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717943+0000","last_change":"2023-08-10T10:48:42.580893+0000","last_active":"2023-08-10T10:49:12.717943+0000","last_peered":"2023-08-10T10:49:12.717943+0000","last_clean":"2023-08-10T10:49:12.717943+0000","last_became_active":"2023-08-10T10:48:42.580591+0000","last_became_peered":"2023-08-10T10:48:42.580591+0000","last_unstale":"2023-08-10T10:49:12.717943+0000","last_undegraded":"2023-08-10T10:49:12.717943+0000","last_fullsized":"2023-08-10T10:49:12.717943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:53:32.998434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707054+0000","last_change":"2023-08-10T10:48:46.635407+0000","last_active":"2023-08-10T10:49:12.707054+0000","last_peered":"2023-08-10T10:49:12.707054+0000","last_clean":"2023-08-10T10:49:12.707054+0000","last_became_active":"2023-08-10T10:48:46.634936+0000","last_became_peered":"2023-08-10T10:48:46.634936+0000","last_unstale":"2023-08-10T10:49:12.707054+0000","last_undegraded":"2023-08-10T10:49:12.707054+0000","last_fullsized":"2023-08-10T10:49:12.707054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:17:41.129674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718213+0000","last_change":"2023-08-10T10:48:41.588054+0000","last_active":"2023-08-10T10:49:12.718213+0000","last_peered":"2023-08-10T10:49:12.718213+0000","last_clean":"2023-08-10T10:49:12.718213+0000","last_became_active":"2023-08-10T10:48:41.587764+0000","last_became_peered":"2023-08-10T10:48:41.587764+0000","last_unstale":"2023-08-10T10:49:12.718213+0000","last_undegraded":"2023-08-10T10:49:12.718213+0000","last_fullsized":"2023-08-10T10:49:12.718213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:07:17.541181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731849+0000","last_change":"2023-08-10T10:48:42.581834+0000","last_active":"2023-08-10T10:49:12.731849+0000","last_peered":"2023-08-10T10:49:12.731849+0000","last_clean":"2023-08-10T10:49:12.731849+0000","last_became_active":"2023-08-10T10:48:42.581438+0000","last_became_peered":"2023-08-10T10:48:42.581438+0000","last_unstale":"2023-08-10T10:49:12.731849+0000","last_undegraded":"2023-08-10T10:49:12.731849+0000","last_fullsized":"2023-08-10T10:49:12.731849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:05:46.899608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.737051+0000","last_change":"2023-08-10T10:49:12.737051+0000","last_active":"2023-08-10T10:49:12.737051+0000","last_peered":"2023-08-10T10:49:12.737051+0000","last_clean":"2023-08-10T10:49:12.737051+0000","last_became_active":"2023-08-10T10:49:12.736586+0000","last_became_peered":"2023-08-10T10:49:12.736586+0000","last_unstale":"2023-08-10T10:49:12.737051+0000","last_undegraded":"2023-08-10T10:49:12.737051+0000","last_fullsized":"2023-08-10T10:49:12.737051+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:41.900139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:16.651601+0000","last_change":"2023-08-10T10:49:12.734942+0000","last_active":"2023-08-10T10:49:16.651601+0000","last_peered":"2023-08-10T10:49:16.651601+0000","last_clean":"2023-08-10T10:49:16.651601+0000","last_became_active":"2023-08-10T10:49:12.720078+0000","last_became_peered":"2023-08-10T10:49:12.720078+0000","last_unstale":"2023-08-10T10:49:16.651601+0000","last_undegraded":"2023-08-10T10:49:16.651601+0000","last_fullsized":"2023-08-10T10:49:16.651601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:13:02.059905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707771+0000","last_change":"2023-08-10T10:48:42.581222+0000","last_active":"2023-08-10T10:49:12.707771+0000","last_peered":"2023-08-10T10:49:12.707771+0000","last_clean":"2023-08-10T10:49:12.707771+0000","last_became_active":"2023-08-10T10:48:42.580885+0000","last_became_peered":"2023-08-10T10:48:42.580885+0000","last_unstale":"2023-08-10T10:49:12.707771+0000","last_undegraded":"2023-08-10T10:49:12.707771+0000","last_fullsized":"2023-08-10T10:49:12.707771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:44:10.016090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707604+0000","last_change":"2023-08-10T10:48:46.626985+0000","last_active":"2023-08-10T10:49:12.707604+0000","last_peered":"2023-08-10T10:49:12.707604+0000","last_clean":"2023-08-10T10:49:12.707604+0000","last_became_active":"2023-08-10T10:48:46.626292+0000","last_became_peered":"2023-08-10T10:48:46.626292+0000","last_unstale":"2023-08-10T10:49:12.707604+0000","last_undegraded":"2023-08-10T10:49:12.707604+0000","last_fullsized":"2023-08-10T10:49:12.707604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:17.994796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.637116+0000","last_change":"2023-08-10T10:48:41.588563+0000","last_active":"2023-08-10T10:49:15.637116+0000","last_peered":"2023-08-10T10:49:15.637116+0000","last_clean":"2023-08-10T10:49:15.637116+0000","last_became_active":"2023-08-10T10:48:41.588250+0000","last_became_peered":"2023-08-10T10:48:41.588250+0000","last_unstale":"2023-08-10T10:49:15.637116+0000","last_undegraded":"2023-08-10T10:49:15.637116+0000","last_fullsized":"2023-08-10T10:49:15.637116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:12.146812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715313+0000","last_change":"2023-08-10T10:49:12.714641+0000","last_active":"2023-08-10T10:49:12.715313+0000","last_peered":"2023-08-10T10:49:12.715313+0000","last_clean":"2023-08-10T10:49:12.715313+0000","last_became_active":"2023-08-10T10:49:12.714185+0000","last_became_peered":"2023-08-10T10:49:12.714185+0000","last_unstale":"2023-08-10T10:49:12.715313+0000","last_undegraded":"2023-08-10T10:49:12.715313+0000","last_fullsized":"2023-08-10T10:49:12.715313+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:34:26.821493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717311+0000","last_change":"2023-08-10T10:48:46.630641+0000","last_active":"2023-08-10T10:49:12.717311+0000","last_peered":"2023-08-10T10:49:12.717311+0000","last_clean":"2023-08-10T10:49:12.717311+0000","last_became_active":"2023-08-10T10:48:46.630231+0000","last_became_peered":"2023-08-10T10:48:46.630231+0000","last_unstale":"2023-08-10T10:49:12.717311+0000","last_undegraded":"2023-08-10T10:49:12.717311+0000","last_fullsized":"2023-08-10T10:49:12.717311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:57:59.187279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'5","reported_seq":85,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:03.696921+0000","last_change":"2023-08-10T10:48:41.586083+0000","last_active":"2023-08-10T10:50:03.696921+0000","last_peered":"2023-08-10T10:50:03.696921+0000","last_clean":"2023-08-10T10:50:03.696921+0000","last_became_active":"2023-08-10T10:48:41.585714+0000","last_became_peered":"2023-08-10T10:48:41.585714+0000","last_unstale":"2023-08-10T10:50:03.696921+0000","last_undegraded":"2023-08-10T10:50:03.696921+0000","last_fullsized":"2023-08-10T10:50:03.696921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:28.992239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712459+0000","last_change":"2023-08-10T10:48:42.578007+0000","last_active":"2023-08-10T10:49:12.712459+0000","last_peered":"2023-08-10T10:49:12.712459+0000","last_clean":"2023-08-10T10:49:12.712459+0000","last_became_active":"2023-08-10T10:48:42.577687+0000","last_became_peered":"2023-08-10T10:48:42.577687+0000","last_unstale":"2023-08-10T10:49:12.712459+0000","last_undegraded":"2023-08-10T10:49:12.712459+0000","last_fullsized":"2023-08-10T10:49:12.712459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:23.114738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719097+0000","last_change":"2023-08-10T10:48:46.633618+0000","last_active":"2023-08-10T10:49:12.719097+0000","last_peered":"2023-08-10T10:49:12.719097+0000","last_clean":"2023-08-10T10:49:12.719097+0000","last_became_active":"2023-08-10T10:48:46.633223+0000","last_became_peered":"2023-08-10T10:48:46.633223+0000","last_unstale":"2023-08-10T10:49:12.719097+0000","last_undegraded":"2023-08-10T10:49:12.719097+0000","last_fullsized":"2023-08-10T10:49:12.719097+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:00:03.852150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627875+0000","last_change":"2023-08-10T10:48:41.591262+0000","last_active":"2023-08-10T10:49:14.627875+0000","last_peered":"2023-08-10T10:49:14.627875+0000","last_clean":"2023-08-10T10:49:14.627875+0000","last_became_active":"2023-08-10T10:48:41.590879+0000","last_became_peered":"2023-08-10T10:48:41.590879+0000","last_unstale":"2023-08-10T10:49:14.627875+0000","last_undegraded":"2023-08-10T10:49:14.627875+0000","last_fullsized":"2023-08-10T10:49:14.627875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:32:51.331831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730883+0000","last_change":"2023-08-10T10:48:42.581852+0000","last_active":"2023-08-10T10:49:12.730883+0000","last_peered":"2023-08-10T10:49:12.730883+0000","last_clean":"2023-08-10T10:49:12.730883+0000","last_became_active":"2023-08-10T10:48:42.581516+0000","last_became_peered":"2023-08-10T10:48:42.581516+0000","last_unstale":"2023-08-10T10:49:12.730883+0000","last_undegraded":"2023-08-10T10:49:12.730883+0000","last_fullsized":"2023-08-10T10:49:12.730883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:10.943574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713879+0000","last_change":"2023-08-10T10:48:46.629922+0000","last_active":"2023-08-10T10:49:12.713879+0000","last_peered":"2023-08-10T10:49:12.713879+0000","last_clean":"2023-08-10T10:49:12.713879+0000","last_became_active":"2023-08-10T10:48:46.629079+0000","last_became_peered":"2023-08-10T10:48:46.629079+0000","last_unstale":"2023-08-10T10:49:12.713879+0000","last_undegraded":"2023-08-10T10:49:12.713879+0000","last_fullsized":"2023-08-10T10:49:12.713879+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:31:34.256668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.619783+0000","last_change":"2023-08-10T10:48:41.580410+0000","last_active":"2023-08-10T10:49:13.619783+0000","last_peered":"2023-08-10T10:49:13.619783+0000","last_clean":"2023-08-10T10:49:13.619783+0000","last_became_active":"2023-08-10T10:48:41.580032+0000","last_became_peered":"2023-08-10T10:48:41.580032+0000","last_unstale":"2023-08-10T10:49:13.619783+0000","last_undegraded":"2023-08-10T10:49:13.619783+0000","last_fullsized":"2023-08-10T10:49:13.619783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:46.503559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717834+0000","last_change":"2023-08-10T10:48:42.582297+0000","last_active":"2023-08-10T10:49:12.717834+0000","last_peered":"2023-08-10T10:49:12.717834+0000","last_clean":"2023-08-10T10:49:12.717834+0000","last_became_active":"2023-08-10T10:48:42.581966+0000","last_became_peered":"2023-08-10T10:48:42.581966+0000","last_unstale":"2023-08-10T10:49:12.717834+0000","last_undegraded":"2023-08-10T10:49:12.717834+0000","last_fullsized":"2023-08-10T10:49:12.717834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:48:05.595908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731000+0000","last_change":"2023-08-10T10:48:46.622376+0000","last_active":"2023-08-10T10:49:12.731000+0000","last_peered":"2023-08-10T10:49:12.731000+0000","last_clean":"2023-08-10T10:49:12.731000+0000","last_became_active":"2023-08-10T10:48:46.621872+0000","last_became_peered":"2023-08-10T10:48:46.621872+0000","last_unstale":"2023-08-10T10:49:12.731000+0000","last_undegraded":"2023-08-10T10:49:12.731000+0000","last_fullsized":"2023-08-10T10:49:12.731000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:06:48.430562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636118+0000","last_change":"2023-08-10T10:48:41.585309+0000","last_active":"2023-08-10T10:49:15.636118+0000","last_peered":"2023-08-10T10:49:15.636118+0000","last_clean":"2023-08-10T10:49:15.636118+0000","last_became_active":"2023-08-10T10:48:41.585007+0000","last_became_peered":"2023-08-10T10:48:41.585007+0000","last_unstale":"2023-08-10T10:49:15.636118+0000","last_undegraded":"2023-08-10T10:49:15.636118+0000","last_fullsized":"2023-08-10T10:49:15.636118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:29:23.129389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708400+0000","last_change":"2023-08-10T10:48:42.575404+0000","last_active":"2023-08-10T10:49:12.708400+0000","last_peered":"2023-08-10T10:49:12.708400+0000","last_clean":"2023-08-10T10:49:12.708400+0000","last_became_active":"2023-08-10T10:48:42.575072+0000","last_became_peered":"2023-08-10T10:48:42.575072+0000","last_unstale":"2023-08-10T10:49:12.708400+0000","last_undegraded":"2023-08-10T10:49:12.708400+0000","last_fullsized":"2023-08-10T10:49:12.708400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:48:47.730243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718109+0000","last_change":"2023-08-10T10:48:46.627175+0000","last_active":"2023-08-10T10:49:12.718109+0000","last_peered":"2023-08-10T10:49:12.718109+0000","last_clean":"2023-08-10T10:49:12.718109+0000","last_became_active":"2023-08-10T10:48:46.626639+0000","last_became_peered":"2023-08-10T10:48:46.626639+0000","last_unstale":"2023-08-10T10:49:12.718109+0000","last_undegraded":"2023-08-10T10:49:12.718109+0000","last_fullsized":"2023-08-10T10:49:12.718109+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:34:37.354808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'4","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:02.763636+0000","last_change":"2023-08-10T10:48:41.585185+0000","last_active":"2023-08-10T10:50:02.763636+0000","last_peered":"2023-08-10T10:50:02.763636+0000","last_clean":"2023-08-10T10:50:02.763636+0000","last_became_active":"2023-08-10T10:48:41.584834+0000","last_became_peered":"2023-08-10T10:48:41.584834+0000","last_unstale":"2023-08-10T10:50:02.763636+0000","last_undegraded":"2023-08-10T10:50:02.763636+0000","last_fullsized":"2023-08-10T10:50:02.763636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:10.581491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708214+0000","last_change":"2023-08-10T10:48:42.574634+0000","last_active":"2023-08-10T10:49:12.708214+0000","last_peered":"2023-08-10T10:49:12.708214+0000","last_clean":"2023-08-10T10:49:12.708214+0000","last_became_active":"2023-08-10T10:48:42.574290+0000","last_became_peered":"2023-08-10T10:48:42.574290+0000","last_unstale":"2023-08-10T10:49:12.708214+0000","last_undegraded":"2023-08-10T10:49:12.708214+0000","last_fullsized":"2023-08-10T10:49:12.708214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:32.688234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708363+0000","last_change":"2023-08-10T10:48:46.627158+0000","last_active":"2023-08-10T10:49:12.708363+0000","last_peered":"2023-08-10T10:49:12.708363+0000","last_clean":"2023-08-10T10:49:12.708363+0000","last_became_active":"2023-08-10T10:48:46.626686+0000","last_became_peered":"2023-08-10T10:48:46.626686+0000","last_unstale":"2023-08-10T10:49:12.708363+0000","last_undegraded":"2023-08-10T10:49:12.708363+0000","last_fullsized":"2023-08-10T10:49:12.708363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:44:14.440163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636298+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:49:15.636298+0000","last_peered":"2023-08-10T10:49:15.636298+0000","last_clean":"2023-08-10T10:49:15.636298+0000","last_became_active":"2023-08-10T10:48:41.586573+0000","last_became_peered":"2023-08-10T10:48:41.586573+0000","last_unstale":"2023-08-10T10:49:15.636298+0000","last_undegraded":"2023-08-10T10:49:15.636298+0000","last_fullsized":"2023-08-10T10:49:15.636298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:32:12.186283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731695+0000","last_change":"2023-08-10T10:48:42.584454+0000","last_active":"2023-08-10T10:49:12.731695+0000","last_peered":"2023-08-10T10:49:12.731695+0000","last_clean":"2023-08-10T10:49:12.731695+0000","last_became_active":"2023-08-10T10:48:42.584098+0000","last_became_peered":"2023-08-10T10:48:42.584098+0000","last_unstale":"2023-08-10T10:49:12.731695+0000","last_undegraded":"2023-08-10T10:49:12.731695+0000","last_fullsized":"2023-08-10T10:49:12.731695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:06.825290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708091+0000","last_change":"2023-08-10T10:48:46.635451+0000","last_active":"2023-08-10T10:49:12.708091+0000","last_peered":"2023-08-10T10:49:12.708091+0000","last_clean":"2023-08-10T10:49:12.708091+0000","last_became_active":"2023-08-10T10:48:46.634768+0000","last_became_peered":"2023-08-10T10:48:46.634768+0000","last_unstale":"2023-08-10T10:49:12.708091+0000","last_undegraded":"2023-08-10T10:49:12.708091+0000","last_fullsized":"2023-08-10T10:49:12.708091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:18.826421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.609913+0000","last_change":"2023-08-10T10:48:41.586720+0000","last_active":"2023-08-10T10:49:13.609913+0000","last_peered":"2023-08-10T10:49:13.609913+0000","last_clean":"2023-08-10T10:49:13.609913+0000","last_became_active":"2023-08-10T10:48:41.586365+0000","last_became_peered":"2023-08-10T10:48:41.586365+0000","last_unstale":"2023-08-10T10:49:13.609913+0000","last_undegraded":"2023-08-10T10:49:13.609913+0000","last_fullsized":"2023-08-10T10:49:13.609913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:18.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715509+0000","last_change":"2023-08-10T10:49:12.715509+0000","last_active":"2023-08-10T10:49:12.715509+0000","last_peered":"2023-08-10T10:49:12.715509+0000","last_clean":"2023-08-10T10:49:12.715509+0000","last_became_active":"2023-08-10T10:49:12.714785+0000","last_became_peered":"2023-08-10T10:49:12.714785+0000","last_unstale":"2023-08-10T10:49:12.715509+0000","last_undegraded":"2023-08-10T10:49:12.715509+0000","last_fullsized":"2023-08-10T10:49:12.715509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:02:27.185255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708443+0000","last_change":"2023-08-10T10:48:46.630613+0000","last_active":"2023-08-10T10:49:12.708443+0000","last_peered":"2023-08-10T10:49:12.708443+0000","last_clean":"2023-08-10T10:49:12.708443+0000","last_became_active":"2023-08-10T10:48:46.630152+0000","last_became_peered":"2023-08-10T10:48:46.630152+0000","last_unstale":"2023-08-10T10:49:12.708443+0000","last_undegraded":"2023-08-10T10:49:12.708443+0000","last_fullsized":"2023-08-10T10:49:12.708443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:47:18.733177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:02.708416+0000","last_change":"2023-08-10T10:48:41.583291+0000","last_active":"2023-08-10T10:50:02.708416+0000","last_peered":"2023-08-10T10:50:02.708416+0000","last_clean":"2023-08-10T10:50:02.708416+0000","last_became_active":"2023-08-10T10:48:41.582894+0000","last_became_peered":"2023-08-10T10:48:41.582894+0000","last_unstale":"2023-08-10T10:50:02.708416+0000","last_undegraded":"2023-08-10T10:50:02.708416+0000","last_fullsized":"2023-08-10T10:50:02.708416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:08:47.694100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59808,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713000+0000","last_change":"2023-08-10T10:48:42.582097+0000","last_active":"2023-08-10T10:49:12.713000+0000","last_peered":"2023-08-10T10:49:12.713000+0000","last_clean":"2023-08-10T10:49:12.713000+0000","last_became_active":"2023-08-10T10:48:42.581622+0000","last_became_peered":"2023-08-10T10:48:42.581622+0000","last_unstale":"2023-08-10T10:49:12.713000+0000","last_undegraded":"2023-08-10T10:49:12.713000+0000","last_fullsized":"2023-08-10T10:49:12.713000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:01.359438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731717+0000","last_change":"2023-08-10T10:48:46.628850+0000","last_active":"2023-08-10T10:49:12.731717+0000","last_peered":"2023-08-10T10:49:12.731717+0000","last_clean":"2023-08-10T10:49:12.731717+0000","last_became_active":"2023-08-10T10:48:46.628060+0000","last_became_peered":"2023-08-10T10:48:46.628060+0000","last_unstale":"2023-08-10T10:49:12.731717+0000","last_undegraded":"2023-08-10T10:49:12.731717+0000","last_fullsized":"2023-08-10T10:49:12.731717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:21:22.729040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.660296+0000","last_change":"2023-08-10T10:49:12.726708+0000","last_active":"2023-08-10T10:49:15.660296+0000","last_peered":"2023-08-10T10:49:15.660296+0000","last_clean":"2023-08-10T10:49:15.660296+0000","last_became_active":"2023-08-10T10:49:12.718963+0000","last_became_peered":"2023-08-10T10:49:12.718963+0000","last_unstale":"2023-08-10T10:49:15.660296+0000","last_undegraded":"2023-08-10T10:49:15.660296+0000","last_fullsized":"2023-08-10T10:49:15.660296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:42.202471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712953+0000","last_change":"2023-08-10T10:48:42.583174+0000","last_active":"2023-08-10T10:49:12.712953+0000","last_peered":"2023-08-10T10:49:12.712953+0000","last_clean":"2023-08-10T10:49:12.712953+0000","last_became_active":"2023-08-10T10:48:42.582869+0000","last_became_peered":"2023-08-10T10:48:42.582869+0000","last_unstale":"2023-08-10T10:49:12.712953+0000","last_undegraded":"2023-08-10T10:49:12.712953+0000","last_fullsized":"2023-08-10T10:49:12.712953+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:25:22.404203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713733+0000","last_change":"2023-08-10T10:48:46.629285+0000","last_active":"2023-08-10T10:49:12.713733+0000","last_peered":"2023-08-10T10:49:12.713733+0000","last_clean":"2023-08-10T10:49:12.713733+0000","last_became_active":"2023-08-10T10:48:46.628849+0000","last_became_peered":"2023-08-10T10:48:46.628849+0000","last_unstale":"2023-08-10T10:49:12.713733+0000","last_undegraded":"2023-08-10T10:49:12.713733+0000","last_fullsized":"2023-08-10T10:49:12.713733+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:52:19.082444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636450+0000","last_change":"2023-08-10T10:48:41.592802+0000","last_active":"2023-08-10T10:49:15.636450+0000","last_peered":"2023-08-10T10:49:15.636450+0000","last_clean":"2023-08-10T10:49:15.636450+0000","last_became_active":"2023-08-10T10:48:41.592443+0000","last_became_peered":"2023-08-10T10:48:41.592443+0000","last_unstale":"2023-08-10T10:49:15.636450+0000","last_undegraded":"2023-08-10T10:49:15.636450+0000","last_fullsized":"2023-08-10T10:49:15.636450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:29:59.847912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718046+0000","last_change":"2023-08-10T10:48:42.586447+0000","last_active":"2023-08-10T10:49:12.718046+0000","last_peered":"2023-08-10T10:49:12.718046+0000","last_clean":"2023-08-10T10:49:12.718046+0000","last_became_active":"2023-08-10T10:48:42.586138+0000","last_became_peered":"2023-08-10T10:48:42.586138+0000","last_unstale":"2023-08-10T10:49:12.718046+0000","last_undegraded":"2023-08-10T10:49:12.718046+0000","last_fullsized":"2023-08-10T10:49:12.718046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:46.349690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733732+0000","last_change":"2023-08-10T10:49:12.732915+0000","last_active":"2023-08-10T10:49:12.733732+0000","last_peered":"2023-08-10T10:49:12.733732+0000","last_clean":"2023-08-10T10:49:12.733732+0000","last_became_active":"2023-08-10T10:49:12.732428+0000","last_became_peered":"2023-08-10T10:49:12.732428+0000","last_unstale":"2023-08-10T10:49:12.733732+0000","last_undegraded":"2023-08-10T10:49:12.733732+0000","last_fullsized":"2023-08-10T10:49:12.733732+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:48.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"91'6","reported_seq":79,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:01.748222+0000","last_change":"2023-08-10T10:48:41.588502+0000","last_active":"2023-08-10T10:50:01.748222+0000","last_peered":"2023-08-10T10:50:01.748222+0000","last_clean":"2023-08-10T10:50:01.748222+0000","last_became_active":"2023-08-10T10:48:41.588155+0000","last_became_peered":"2023-08-10T10:48:41.588155+0000","last_unstale":"2023-08-10T10:50:01.748222+0000","last_undegraded":"2023-08-10T10:50:01.748222+0000","last_fullsized":"2023-08-10T10:50:01.748222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:17:03.041234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717532+0000","last_change":"2023-08-10T10:48:42.578175+0000","last_active":"2023-08-10T10:49:12.717532+0000","last_peered":"2023-08-10T10:49:12.717532+0000","last_clean":"2023-08-10T10:49:12.717532+0000","last_became_active":"2023-08-10T10:48:42.577873+0000","last_became_peered":"2023-08-10T10:48:42.577873+0000","last_unstale":"2023-08-10T10:49:12.717532+0000","last_undegraded":"2023-08-10T10:49:12.717532+0000","last_fullsized":"2023-08-10T10:49:12.717532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:00:20.738100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.719745+0000","last_change":"2023-08-10T10:49:12.719745+0000","last_active":"2023-08-10T10:49:12.719745+0000","last_peered":"2023-08-10T10:49:12.719745+0000","last_clean":"2023-08-10T10:49:12.719745+0000","last_became_active":"2023-08-10T10:49:12.719289+0000","last_became_peered":"2023-08-10T10:49:12.719289+0000","last_unstale":"2023-08-10T10:49:12.719745+0000","last_undegraded":"2023-08-10T10:49:12.719745+0000","last_fullsized":"2023-08-10T10:49:12.719745+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:06.026574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.636507+0000","last_change":"2023-08-10T10:48:41.594170+0000","last_active":"2023-08-10T10:49:15.636507+0000","last_peered":"2023-08-10T10:49:15.636507+0000","last_clean":"2023-08-10T10:49:15.636507+0000","last_became_active":"2023-08-10T10:48:41.593776+0000","last_became_peered":"2023-08-10T10:48:41.593776+0000","last_unstale":"2023-08-10T10:49:15.636507+0000","last_undegraded":"2023-08-10T10:49:15.636507+0000","last_fullsized":"2023-08-10T10:49:15.636507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:58:00.968178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730226+0000","last_change":"2023-08-10T10:48:42.589149+0000","last_active":"2023-08-10T10:49:12.730226+0000","last_peered":"2023-08-10T10:49:12.730226+0000","last_clean":"2023-08-10T10:49:12.730226+0000","last_became_active":"2023-08-10T10:48:42.588466+0000","last_became_peered":"2023-08-10T10:48:42.588466+0000","last_unstale":"2023-08-10T10:49:12.730226+0000","last_undegraded":"2023-08-10T10:49:12.730226+0000","last_fullsized":"2023-08-10T10:49:12.730226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:16:06.271764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730078+0000","last_change":"2023-08-10T10:48:46.629070+0000","last_active":"2023-08-10T10:49:12.730078+0000","last_peered":"2023-08-10T10:49:12.730078+0000","last_clean":"2023-08-10T10:49:12.730078+0000","last_became_active":"2023-08-10T10:48:46.626045+0000","last_became_peered":"2023-08-10T10:48:46.626045+0000","last_unstale":"2023-08-10T10:49:12.730078+0000","last_undegraded":"2023-08-10T10:49:12.730078+0000","last_fullsized":"2023-08-10T10:49:12.730078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:07:15.985024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.606522+0000","last_change":"2023-08-10T10:48:41.590670+0000","last_active":"2023-08-10T10:49:13.606522+0000","last_peered":"2023-08-10T10:49:13.606522+0000","last_clean":"2023-08-10T10:49:13.606522+0000","last_became_active":"2023-08-10T10:48:41.589958+0000","last_became_peered":"2023-08-10T10:48:41.589958+0000","last_unstale":"2023-08-10T10:49:13.606522+0000","last_undegraded":"2023-08-10T10:49:13.606522+0000","last_fullsized":"2023-08-10T10:49:13.606522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:39:18.603399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714523+0000","last_change":"2023-08-10T10:48:42.581041+0000","last_active":"2023-08-10T10:49:12.714523+0000","last_peered":"2023-08-10T10:49:12.714523+0000","last_clean":"2023-08-10T10:49:12.714523+0000","last_became_active":"2023-08-10T10:48:42.580311+0000","last_became_peered":"2023-08-10T10:48:42.580311+0000","last_unstale":"2023-08-10T10:49:12.714523+0000","last_undegraded":"2023-08-10T10:49:12.714523+0000","last_fullsized":"2023-08-10T10:49:12.714523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:58:22.239730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712329+0000","last_change":"2023-08-10T10:48:46.907496+0000","last_active":"2023-08-10T10:49:12.712329+0000","last_peered":"2023-08-10T10:49:12.712329+0000","last_clean":"2023-08-10T10:49:12.712329+0000","last_became_active":"2023-08-10T10:48:46.907098+0000","last_became_peered":"2023-08-10T10:48:46.907098+0000","last_unstale":"2023-08-10T10:49:12.712329+0000","last_undegraded":"2023-08-10T10:49:12.712329+0000","last_fullsized":"2023-08-10T10:49:12.712329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:32.578901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.708762+0000","last_change":"2023-08-10T10:48:41.585252+0000","last_active":"2023-08-10T10:49:12.708762+0000","last_peered":"2023-08-10T10:49:12.708762+0000","last_clean":"2023-08-10T10:49:12.708762+0000","last_became_active":"2023-08-10T10:48:41.583599+0000","last_became_peered":"2023-08-10T10:48:41.583599+0000","last_unstale":"2023-08-10T10:49:12.708762+0000","last_undegraded":"2023-08-10T10:49:12.708762+0000","last_fullsized":"2023-08-10T10:49:12.708762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:01:05.063058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.711390+0000","last_change":"2023-08-10T10:48:42.581317+0000","last_active":"2023-08-10T10:49:12.711390+0000","last_peered":"2023-08-10T10:49:12.711390+0000","last_clean":"2023-08-10T10:49:12.711390+0000","last_became_active":"2023-08-10T10:48:42.581012+0000","last_became_peered":"2023-08-10T10:48:42.581012+0000","last_unstale":"2023-08-10T10:49:12.711390+0000","last_undegraded":"2023-08-10T10:49:12.711390+0000","last_fullsized":"2023-08-10T10:49:12.711390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:19:06.685943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713749+0000","last_change":"2023-08-10T10:48:46.623489+0000","last_active":"2023-08-10T10:49:12.713749+0000","last_peered":"2023-08-10T10:49:12.713749+0000","last_clean":"2023-08-10T10:49:12.713749+0000","last_became_active":"2023-08-10T10:48:46.621968+0000","last_became_peered":"2023-08-10T10:48:46.621968+0000","last_unstale":"2023-08-10T10:49:12.713749+0000","last_undegraded":"2023-08-10T10:49:12.713749+0000","last_fullsized":"2023-08-10T10:49:12.713749+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:46:18.848816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":78,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:02.746652+0000","last_change":"2023-08-10T10:48:41.579828+0000","last_active":"2023-08-10T10:50:02.746652+0000","last_peered":"2023-08-10T10:50:02.746652+0000","last_clean":"2023-08-10T10:50:02.746652+0000","last_became_active":"2023-08-10T10:48:41.579340+0000","last_became_peered":"2023-08-10T10:48:41.579340+0000","last_unstale":"2023-08-10T10:50:02.746652+0000","last_undegraded":"2023-08-10T10:50:02.746652+0000","last_fullsized":"2023-08-10T10:50:02.746652+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:10:37.616654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.733771+0000","last_change":"2023-08-10T10:49:12.733771+0000","last_active":"2023-08-10T10:49:12.733771+0000","last_peered":"2023-08-10T10:49:12.733771+0000","last_clean":"2023-08-10T10:49:12.733771+0000","last_became_active":"2023-08-10T10:49:12.733357+0000","last_became_peered":"2023-08-10T10:49:12.733357+0000","last_unstale":"2023-08-10T10:49:12.733771+0000","last_undegraded":"2023-08-10T10:49:12.733771+0000","last_fullsized":"2023-08-10T10:49:12.733771+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:42.675113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713322+0000","last_change":"2023-08-10T10:48:46.907982+0000","last_active":"2023-08-10T10:49:12.713322+0000","last_peered":"2023-08-10T10:49:12.713322+0000","last_clean":"2023-08-10T10:49:12.713322+0000","last_became_active":"2023-08-10T10:48:46.907184+0000","last_became_peered":"2023-08-10T10:48:46.907184+0000","last_unstale":"2023-08-10T10:49:12.713322+0000","last_undegraded":"2023-08-10T10:49:12.713322+0000","last_fullsized":"2023-08-10T10:49:12.713322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:26:10.496532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731622+0000","last_change":"2023-08-10T10:48:42.582808+0000","last_active":"2023-08-10T10:49:12.731622+0000","last_peered":"2023-08-10T10:49:12.731622+0000","last_clean":"2023-08-10T10:49:12.731622+0000","last_became_active":"2023-08-10T10:48:42.582517+0000","last_became_peered":"2023-08-10T10:48:42.582517+0000","last_unstale":"2023-08-10T10:49:12.731622+0000","last_undegraded":"2023-08-10T10:49:12.731622+0000","last_fullsized":"2023-08-10T10:49:12.731622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:03:17.102214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":78,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:00.745974+0000","last_change":"2023-08-10T10:48:41.594873+0000","last_active":"2023-08-10T10:50:00.745974+0000","last_peered":"2023-08-10T10:50:00.745974+0000","last_clean":"2023-08-10T10:50:00.745974+0000","last_became_active":"2023-08-10T10:48:41.594550+0000","last_became_peered":"2023-08-10T10:48:41.594550+0000","last_unstale":"2023-08-10T10:50:00.745974+0000","last_undegraded":"2023-08-10T10:50:00.745974+0000","last_fullsized":"2023-08-10T10:50:00.745974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:29:12.288533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718128+0000","last_change":"2023-08-10T10:48:46.626960+0000","last_active":"2023-08-10T10:49:12.718128+0000","last_peered":"2023-08-10T10:49:12.718128+0000","last_clean":"2023-08-10T10:49:12.718128+0000","last_became_active":"2023-08-10T10:48:46.626519+0000","last_became_peered":"2023-08-10T10:48:46.626519+0000","last_unstale":"2023-08-10T10:49:12.718128+0000","last_undegraded":"2023-08-10T10:49:12.718128+0000","last_fullsized":"2023-08-10T10:49:12.718128+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:12.352223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717207+0000","last_change":"2023-08-10T10:48:42.578921+0000","last_active":"2023-08-10T10:49:12.717207+0000","last_peered":"2023-08-10T10:49:12.717207+0000","last_clean":"2023-08-10T10:49:12.717207+0000","last_became_active":"2023-08-10T10:48:42.578322+0000","last_became_peered":"2023-08-10T10:48:42.578322+0000","last_unstale":"2023-08-10T10:49:12.717207+0000","last_undegraded":"2023-08-10T10:49:12.717207+0000","last_fullsized":"2023-08-10T10:49:12.717207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:11:39.453887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:16.651768+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:49:16.651768+0000","last_peered":"2023-08-10T10:49:16.651768+0000","last_clean":"2023-08-10T10:49:16.651768+0000","last_became_active":"2023-08-10T10:48:41.585217+0000","last_became_peered":"2023-08-10T10:48:41.585217+0000","last_unstale":"2023-08-10T10:49:16.651768+0000","last_undegraded":"2023-08-10T10:49:16.651768+0000","last_fullsized":"2023-08-10T10:49:16.651768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:01:10.279255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":358,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717226+0000","last_change":"2023-08-10T10:47:22.594211+0000","last_active":"2023-08-10T10:49:12.717226+0000","last_peered":"2023-08-10T10:49:12.717226+0000","last_clean":"2023-08-10T10:49:12.717226+0000","last_became_active":"2023-08-10T10:47:22.593742+0000","last_became_peered":"2023-08-10T10:47:22.593742+0000","last_unstale":"2023-08-10T10:49:12.717226+0000","last_undegraded":"2023-08-10T10:49:12.717226+0000","last_fullsized":"2023-08-10T10:49:12.717226+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_clean_scrub_stamp":"2023-08-10T10:43:44.512037+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:24:23.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730745+0000","last_change":"2023-08-10T10:48:46.907769+0000","last_active":"2023-08-10T10:49:12.730745+0000","last_peered":"2023-08-10T10:49:12.730745+0000","last_clean":"2023-08-10T10:49:12.730745+0000","last_became_active":"2023-08-10T10:48:46.907241+0000","last_became_peered":"2023-08-10T10:48:46.907241+0000","last_unstale":"2023-08-10T10:49:12.730745+0000","last_undegraded":"2023-08-10T10:49:12.730745+0000","last_fullsized":"2023-08-10T10:49:12.730745+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:37:49.077753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712543+0000","last_change":"2023-08-10T10:48:42.587277+0000","last_active":"2023-08-10T10:49:12.712543+0000","last_peered":"2023-08-10T10:49:12.712543+0000","last_clean":"2023-08-10T10:49:12.712543+0000","last_became_active":"2023-08-10T10:48:42.586308+0000","last_became_peered":"2023-08-10T10:48:42.586308+0000","last_unstale":"2023-08-10T10:49:12.712543+0000","last_undegraded":"2023-08-10T10:49:12.712543+0000","last_fullsized":"2023-08-10T10:49:12.712543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:23.894942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:13.622279+0000","last_change":"2023-08-10T10:48:41.587116+0000","last_active":"2023-08-10T10:49:13.622279+0000","last_peered":"2023-08-10T10:49:13.622279+0000","last_clean":"2023-08-10T10:49:13.622279+0000","last_became_active":"2023-08-10T10:48:41.586771+0000","last_became_peered":"2023-08-10T10:48:41.586771+0000","last_unstale":"2023-08-10T10:49:13.622279+0000","last_undegraded":"2023-08-10T10:49:13.622279+0000","last_fullsized":"2023-08-10T10:49:13.622279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:30.371131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714841+0000","last_change":"2023-08-10T10:48:46.625140+0000","last_active":"2023-08-10T10:49:12.714841+0000","last_peered":"2023-08-10T10:49:12.714841+0000","last_clean":"2023-08-10T10:49:12.714841+0000","last_became_active":"2023-08-10T10:48:46.624615+0000","last_became_peered":"2023-08-10T10:48:46.624615+0000","last_unstale":"2023-08-10T10:49:12.714841+0000","last_undegraded":"2023-08-10T10:49:12.714841+0000","last_fullsized":"2023-08-10T10:49:12.714841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:55:42.063440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627974+0000","last_change":"2023-08-10T10:48:41.589435+0000","last_active":"2023-08-10T10:49:14.627974+0000","last_peered":"2023-08-10T10:49:14.627974+0000","last_clean":"2023-08-10T10:49:14.627974+0000","last_became_active":"2023-08-10T10:48:41.589070+0000","last_became_peered":"2023-08-10T10:48:41.589070+0000","last_unstale":"2023-08-10T10:49:14.627974+0000","last_undegraded":"2023-08-10T10:49:14.627974+0000","last_fullsized":"2023-08-10T10:49:14.627974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:22:03.215196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713488+0000","last_change":"2023-08-10T10:48:42.586352+0000","last_active":"2023-08-10T10:49:12.713488+0000","last_peered":"2023-08-10T10:49:12.713488+0000","last_clean":"2023-08-10T10:49:12.713488+0000","last_became_active":"2023-08-10T10:48:42.585955+0000","last_became_peered":"2023-08-10T10:48:42.585955+0000","last_unstale":"2023-08-10T10:49:12.713488+0000","last_undegraded":"2023-08-10T10:49:12.713488+0000","last_fullsized":"2023-08-10T10:49:12.713488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:45.529054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717201+0000","last_change":"2023-08-10T10:48:46.907519+0000","last_active":"2023-08-10T10:49:12.717201+0000","last_peered":"2023-08-10T10:49:12.717201+0000","last_clean":"2023-08-10T10:49:12.717201+0000","last_became_active":"2023-08-10T10:48:46.907087+0000","last_became_peered":"2023-08-10T10:48:46.907087+0000","last_unstale":"2023-08-10T10:49:12.717201+0000","last_undegraded":"2023-08-10T10:49:12.717201+0000","last_fullsized":"2023-08-10T10:49:12.717201+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:28:03.482635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:21.915528+0000","last_change":"2023-08-10T10:48:41.583746+0000","last_active":"2023-08-10T10:49:21.915528+0000","last_peered":"2023-08-10T10:49:21.915528+0000","last_clean":"2023-08-10T10:49:21.915528+0000","last_became_active":"2023-08-10T10:48:41.583321+0000","last_became_peered":"2023-08-10T10:48:41.583321+0000","last_unstale":"2023-08-10T10:49:21.915528+0000","last_undegraded":"2023-08-10T10:49:21.915528+0000","last_fullsized":"2023-08-10T10:49:21.915528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:53:25.620711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717495+0000","last_change":"2023-08-10T10:48:42.579942+0000","last_active":"2023-08-10T10:49:12.717495+0000","last_peered":"2023-08-10T10:49:12.717495+0000","last_clean":"2023-08-10T10:49:12.717495+0000","last_became_active":"2023-08-10T10:48:42.579561+0000","last_became_peered":"2023-08-10T10:48:42.579561+0000","last_unstale":"2023-08-10T10:49:12.717495+0000","last_undegraded":"2023-08-10T10:49:12.717495+0000","last_fullsized":"2023-08-10T10:49:12.717495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:32:22.447394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718242+0000","last_change":"2023-08-10T10:48:46.621499+0000","last_active":"2023-08-10T10:49:12.718242+0000","last_peered":"2023-08-10T10:49:12.718242+0000","last_clean":"2023-08-10T10:49:12.718242+0000","last_became_active":"2023-08-10T10:48:46.621076+0000","last_became_peered":"2023-08-10T10:48:46.621076+0000","last_unstale":"2023-08-10T10:49:12.718242+0000","last_undegraded":"2023-08-10T10:49:12.718242+0000","last_fullsized":"2023-08-10T10:49:12.718242+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:34.844650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635369+0000","last_change":"2023-08-10T10:48:41.585574+0000","last_active":"2023-08-10T10:49:15.635369+0000","last_peered":"2023-08-10T10:49:15.635369+0000","last_clean":"2023-08-10T10:49:15.635369+0000","last_became_active":"2023-08-10T10:48:41.585254+0000","last_became_peered":"2023-08-10T10:48:41.585254+0000","last_unstale":"2023-08-10T10:49:15.635369+0000","last_undegraded":"2023-08-10T10:49:15.635369+0000","last_fullsized":"2023-08-10T10:49:15.635369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:25:52.304547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731219+0000","last_change":"2023-08-10T10:48:42.584003+0000","last_active":"2023-08-10T10:49:12.731219+0000","last_peered":"2023-08-10T10:49:12.731219+0000","last_clean":"2023-08-10T10:49:12.731219+0000","last_became_active":"2023-08-10T10:48:42.583712+0000","last_became_peered":"2023-08-10T10:48:42.583712+0000","last_unstale":"2023-08-10T10:49:12.731219+0000","last_undegraded":"2023-08-10T10:49:12.731219+0000","last_fullsized":"2023-08-10T10:49:12.731219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:52.543954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707184+0000","last_change":"2023-08-10T10:48:46.908113+0000","last_active":"2023-08-10T10:49:12.707184+0000","last_peered":"2023-08-10T10:49:12.707184+0000","last_clean":"2023-08-10T10:49:12.707184+0000","last_became_active":"2023-08-10T10:48:46.907552+0000","last_became_peered":"2023-08-10T10:48:46.907552+0000","last_unstale":"2023-08-10T10:49:12.707184+0000","last_undegraded":"2023-08-10T10:49:12.707184+0000","last_fullsized":"2023-08-10T10:49:12.707184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:48:47.326917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.732470+0000","last_change":"2023-08-10T10:48:41.584254+0000","last_active":"2023-08-10T10:49:12.732470+0000","last_peered":"2023-08-10T10:49:12.732470+0000","last_clean":"2023-08-10T10:49:12.732470+0000","last_became_active":"2023-08-10T10:48:41.583129+0000","last_became_peered":"2023-08-10T10:48:41.583129+0000","last_unstale":"2023-08-10T10:49:12.732470+0000","last_undegraded":"2023-08-10T10:49:12.732470+0000","last_fullsized":"2023-08-10T10:49:12.732470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:59:23.183495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712107+0000","last_change":"2023-08-10T10:48:42.582264+0000","last_active":"2023-08-10T10:49:12.712107+0000","last_peered":"2023-08-10T10:49:12.712107+0000","last_clean":"2023-08-10T10:49:12.712107+0000","last_became_active":"2023-08-10T10:48:42.581542+0000","last_became_peered":"2023-08-10T10:48:42.581542+0000","last_unstale":"2023-08-10T10:49:12.712107+0000","last_undegraded":"2023-08-10T10:49:12.712107+0000","last_fullsized":"2023-08-10T10:49:12.712107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:30:57.631202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.709384+0000","last_change":"2023-08-10T10:48:46.632019+0000","last_active":"2023-08-10T10:49:12.709384+0000","last_peered":"2023-08-10T10:49:12.709384+0000","last_clean":"2023-08-10T10:49:12.709384+0000","last_became_active":"2023-08-10T10:48:46.631510+0000","last_became_peered":"2023-08-10T10:48:46.631510+0000","last_unstale":"2023-08-10T10:49:12.709384+0000","last_undegraded":"2023-08-10T10:49:12.709384+0000","last_fullsized":"2023-08-10T10:49:12.709384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:56:55.720402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635631+0000","last_change":"2023-08-10T10:48:41.591206+0000","last_active":"2023-08-10T10:49:15.635631+0000","last_peered":"2023-08-10T10:49:15.635631+0000","last_clean":"2023-08-10T10:49:15.635631+0000","last_became_active":"2023-08-10T10:48:41.590897+0000","last_became_peered":"2023-08-10T10:48:41.590897+0000","last_unstale":"2023-08-10T10:49:15.635631+0000","last_undegraded":"2023-08-10T10:49:15.635631+0000","last_fullsized":"2023-08-10T10:49:15.635631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:50:30.418971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713681+0000","last_change":"2023-08-10T10:48:42.586470+0000","last_active":"2023-08-10T10:49:12.713681+0000","last_peered":"2023-08-10T10:49:12.713681+0000","last_clean":"2023-08-10T10:49:12.713681+0000","last_became_active":"2023-08-10T10:48:42.586109+0000","last_became_peered":"2023-08-10T10:48:42.586109+0000","last_unstale":"2023-08-10T10:49:12.713681+0000","last_undegraded":"2023-08-10T10:49:12.713681+0000","last_fullsized":"2023-08-10T10:49:12.713681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:29:12.453665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707306+0000","last_change":"2023-08-10T10:48:46.629886+0000","last_active":"2023-08-10T10:49:12.707306+0000","last_peered":"2023-08-10T10:49:12.707306+0000","last_clean":"2023-08-10T10:49:12.707306+0000","last_became_active":"2023-08-10T10:48:46.629403+0000","last_became_peered":"2023-08-10T10:48:46.629403+0000","last_unstale":"2023-08-10T10:49:12.707306+0000","last_undegraded":"2023-08-10T10:49:12.707306+0000","last_fullsized":"2023-08-10T10:49:12.707306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:11:11.458504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:17.355530+0000","last_change":"2023-08-10T10:48:41.593231+0000","last_active":"2023-08-10T10:49:17.355530+0000","last_peered":"2023-08-10T10:49:17.355530+0000","last_clean":"2023-08-10T10:49:17.355530+0000","last_became_active":"2023-08-10T10:48:41.592893+0000","last_became_peered":"2023-08-10T10:48:41.592893+0000","last_unstale":"2023-08-10T10:49:17.355530+0000","last_undegraded":"2023-08-10T10:49:17.355530+0000","last_fullsized":"2023-08-10T10:49:17.355530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:02:41.661067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.734525+0000","last_change":"2023-08-10T10:49:12.732774+0000","last_active":"2023-08-10T10:49:12.734525+0000","last_peered":"2023-08-10T10:49:12.734525+0000","last_clean":"2023-08-10T10:49:12.734525+0000","last_became_active":"2023-08-10T10:49:12.732277+0000","last_became_peered":"2023-08-10T10:49:12.732277+0000","last_unstale":"2023-08-10T10:49:12.734525+0000","last_undegraded":"2023-08-10T10:49:12.734525+0000","last_fullsized":"2023-08-10T10:49:12.734525+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:06.334205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707420+0000","last_change":"2023-08-10T10:48:46.908347+0000","last_active":"2023-08-10T10:49:12.707420+0000","last_peered":"2023-08-10T10:49:12.707420+0000","last_clean":"2023-08-10T10:49:12.707420+0000","last_became_active":"2023-08-10T10:48:46.907266+0000","last_became_peered":"2023-08-10T10:48:46.907266+0000","last_unstale":"2023-08-10T10:49:12.707420+0000","last_undegraded":"2023-08-10T10:49:12.707420+0000","last_fullsized":"2023-08-10T10:49:12.707420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:33:52.767489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.734388+0000","last_change":"2023-08-10T10:48:41.585055+0000","last_active":"2023-08-10T10:49:12.734388+0000","last_peered":"2023-08-10T10:49:12.734388+0000","last_clean":"2023-08-10T10:49:12.734388+0000","last_became_active":"2023-08-10T10:48:41.584676+0000","last_became_peered":"2023-08-10T10:48:41.584676+0000","last_unstale":"2023-08-10T10:49:12.734388+0000","last_undegraded":"2023-08-10T10:49:12.734388+0000","last_fullsized":"2023-08-10T10:49:12.734388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:14:29.461100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718623+0000","last_change":"2023-08-10T10:48:42.586764+0000","last_active":"2023-08-10T10:49:12.718623+0000","last_peered":"2023-08-10T10:49:12.718623+0000","last_clean":"2023-08-10T10:49:12.718623+0000","last_became_active":"2023-08-10T10:48:42.586177+0000","last_became_peered":"2023-08-10T10:48:42.586177+0000","last_unstale":"2023-08-10T10:49:12.718623+0000","last_undegraded":"2023-08-10T10:49:12.718623+0000","last_fullsized":"2023-08-10T10:49:12.718623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:55:34.472956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707294+0000","last_change":"2023-08-10T10:48:46.626872+0000","last_active":"2023-08-10T10:49:12.707294+0000","last_peered":"2023-08-10T10:49:12.707294+0000","last_clean":"2023-08-10T10:49:12.707294+0000","last_became_active":"2023-08-10T10:48:46.626354+0000","last_became_peered":"2023-08-10T10:48:46.626354+0000","last_unstale":"2023-08-10T10:49:12.707294+0000","last_undegraded":"2023-08-10T10:49:12.707294+0000","last_fullsized":"2023-08-10T10:49:12.707294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:10:12.332212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:50:01.762709+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:50:01.762709+0000","last_peered":"2023-08-10T10:50:01.762709+0000","last_clean":"2023-08-10T10:50:01.762709+0000","last_became_active":"2023-08-10T10:48:41.586311+0000","last_became_peered":"2023-08-10T10:48:41.586311+0000","last_unstale":"2023-08-10T10:50:01.762709+0000","last_undegraded":"2023-08-10T10:50:01.762709+0000","last_fullsized":"2023-08-10T10:50:01.762709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:23:57.983205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718513+0000","last_change":"2023-08-10T10:48:42.577290+0000","last_active":"2023-08-10T10:49:12.718513+0000","last_peered":"2023-08-10T10:49:12.718513+0000","last_clean":"2023-08-10T10:49:12.718513+0000","last_became_active":"2023-08-10T10:48:42.576928+0000","last_became_peered":"2023-08-10T10:48:42.576928+0000","last_unstale":"2023-08-10T10:49:12.718513+0000","last_undegraded":"2023-08-10T10:49:12.718513+0000","last_fullsized":"2023-08-10T10:49:12.718513+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:20.491056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730204+0000","last_change":"2023-08-10T10:48:46.627842+0000","last_active":"2023-08-10T10:49:12.730204+0000","last_peered":"2023-08-10T10:49:12.730204+0000","last_clean":"2023-08-10T10:49:12.730204+0000","last_became_active":"2023-08-10T10:48:46.627472+0000","last_became_peered":"2023-08-10T10:48:46.627472+0000","last_unstale":"2023-08-10T10:49:12.730204+0000","last_undegraded":"2023-08-10T10:49:12.730204+0000","last_fullsized":"2023-08-10T10:49:12.730204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:22:23.103275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:14.627941+0000","last_change":"2023-08-10T10:48:41.592742+0000","last_active":"2023-08-10T10:49:14.627941+0000","last_peered":"2023-08-10T10:49:14.627941+0000","last_clean":"2023-08-10T10:49:14.627941+0000","last_became_active":"2023-08-10T10:48:41.592409+0000","last_became_peered":"2023-08-10T10:48:41.592409+0000","last_unstale":"2023-08-10T10:49:14.627941+0000","last_undegraded":"2023-08-10T10:49:14.627941+0000","last_fullsized":"2023-08-10T10:49:14.627941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:38:45.367655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717859+0000","last_change":"2023-08-10T10:48:42.583444+0000","last_active":"2023-08-10T10:49:12.717859+0000","last_peered":"2023-08-10T10:49:12.717859+0000","last_clean":"2023-08-10T10:49:12.717859+0000","last_became_active":"2023-08-10T10:48:42.583073+0000","last_became_peered":"2023-08-10T10:48:42.583073+0000","last_unstale":"2023-08-10T10:49:12.717859+0000","last_undegraded":"2023-08-10T10:49:12.717859+0000","last_fullsized":"2023-08-10T10:49:12.717859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:22:40.712897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.730483+0000","last_change":"2023-08-10T10:48:46.626340+0000","last_active":"2023-08-10T10:49:12.730483+0000","last_peered":"2023-08-10T10:49:12.730483+0000","last_clean":"2023-08-10T10:49:12.730483+0000","last_became_active":"2023-08-10T10:48:46.625867+0000","last_became_peered":"2023-08-10T10:48:46.625867+0000","last_unstale":"2023-08-10T10:49:12.730483+0000","last_undegraded":"2023-08-10T10:49:12.730483+0000","last_fullsized":"2023-08-10T10:49:12.730483+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:50:35.707438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:15.635911+0000","last_change":"2023-08-10T10:48:41.590734+0000","last_active":"2023-08-10T10:49:15.635911+0000","last_peered":"2023-08-10T10:49:15.635911+0000","last_clean":"2023-08-10T10:49:15.635911+0000","last_became_active":"2023-08-10T10:48:41.590433+0000","last_became_peered":"2023-08-10T10:48:41.590433+0000","last_unstale":"2023-08-10T10:49:15.635911+0000","last_undegraded":"2023-08-10T10:49:15.635911+0000","last_fullsized":"2023-08-10T10:49:15.635911+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:37:07.269605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718071+0000","last_change":"2023-08-10T10:48:42.576628+0000","last_active":"2023-08-10T10:49:12.718071+0000","last_peered":"2023-08-10T10:49:12.718071+0000","last_clean":"2023-08-10T10:49:12.718071+0000","last_became_active":"2023-08-10T10:48:42.576285+0000","last_became_peered":"2023-08-10T10:48:42.576285+0000","last_unstale":"2023-08-10T10:49:12.718071+0000","last_undegraded":"2023-08-10T10:49:12.718071+0000","last_fullsized":"2023-08-10T10:49:12.718071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:36.534268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713896+0000","last_change":"2023-08-10T10:48:42.579615+0000","last_active":"2023-08-10T10:49:12.713896+0000","last_peered":"2023-08-10T10:49:12.713896+0000","last_clean":"2023-08-10T10:49:12.713896+0000","last_became_active":"2023-08-10T10:48:42.579291+0000","last_became_peered":"2023-08-10T10:48:42.579291+0000","last_unstale":"2023-08-10T10:49:12.713896+0000","last_undegraded":"2023-08-10T10:49:12.713896+0000","last_fullsized":"2023-08-10T10:49:12.713896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:30:20.879001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718573+0000","last_change":"2023-08-10T10:48:42.581358+0000","last_active":"2023-08-10T10:49:12.718573+0000","last_peered":"2023-08-10T10:49:12.718573+0000","last_clean":"2023-08-10T10:49:12.718573+0000","last_became_active":"2023-08-10T10:48:42.580942+0000","last_became_peered":"2023-08-10T10:48:42.580942+0000","last_unstale":"2023-08-10T10:49:12.718573+0000","last_undegraded":"2023-08-10T10:49:12.718573+0000","last_fullsized":"2023-08-10T10:49:12.718573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:45.675996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.718718+0000","last_change":"2023-08-10T10:48:42.574494+0000","last_active":"2023-08-10T10:49:12.718718+0000","last_peered":"2023-08-10T10:49:12.718718+0000","last_clean":"2023-08-10T10:49:12.718718+0000","last_became_active":"2023-08-10T10:48:42.574203+0000","last_became_peered":"2023-08-10T10:48:42.574203+0000","last_unstale":"2023-08-10T10:49:12.718718+0000","last_undegraded":"2023-08-10T10:49:12.718718+0000","last_fullsized":"2023-08-10T10:49:12.718718+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:10:10.406920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731545+0000","last_change":"2023-08-10T10:48:42.587557+0000","last_active":"2023-08-10T10:49:12.731545+0000","last_peered":"2023-08-10T10:49:12.731545+0000","last_clean":"2023-08-10T10:49:12.731545+0000","last_became_active":"2023-08-10T10:48:42.587133+0000","last_became_peered":"2023-08-10T10:48:42.587133+0000","last_unstale":"2023-08-10T10:49:12.731545+0000","last_undegraded":"2023-08-10T10:49:12.731545+0000","last_fullsized":"2023-08-10T10:49:12.731545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:45:35.005412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.713339+0000","last_change":"2023-08-10T10:48:42.587283+0000","last_active":"2023-08-10T10:49:12.713339+0000","last_peered":"2023-08-10T10:49:12.713339+0000","last_clean":"2023-08-10T10:49:12.713339+0000","last_became_active":"2023-08-10T10:48:42.586118+0000","last_became_peered":"2023-08-10T10:48:42.586118+0000","last_unstale":"2023-08-10T10:49:12.713339+0000","last_undegraded":"2023-08-10T10:49:12.713339+0000","last_fullsized":"2023-08-10T10:49:12.713339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:10:50.868060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.715015+0000","last_change":"2023-08-10T10:48:42.580843+0000","last_active":"2023-08-10T10:49:12.715015+0000","last_peered":"2023-08-10T10:49:12.715015+0000","last_clean":"2023-08-10T10:49:12.715015+0000","last_became_active":"2023-08-10T10:48:42.579735+0000","last_became_peered":"2023-08-10T10:48:42.579735+0000","last_unstale":"2023-08-10T10:49:12.715015+0000","last_undegraded":"2023-08-10T10:49:12.715015+0000","last_fullsized":"2023-08-10T10:49:12.715015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:15:24.025912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717927+0000","last_change":"2023-08-10T10:48:42.580250+0000","last_active":"2023-08-10T10:49:12.717927+0000","last_peered":"2023-08-10T10:49:12.717927+0000","last_clean":"2023-08-10T10:49:12.717927+0000","last_became_active":"2023-08-10T10:48:42.579962+0000","last_became_peered":"2023-08-10T10:48:42.579962+0000","last_unstale":"2023-08-10T10:49:12.717927+0000","last_undegraded":"2023-08-10T10:49:12.717927+0000","last_fullsized":"2023-08-10T10:49:12.717927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:03:04.269405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717788+0000","last_change":"2023-08-10T10:48:42.582699+0000","last_active":"2023-08-10T10:49:12.717788+0000","last_peered":"2023-08-10T10:49:12.717788+0000","last_clean":"2023-08-10T10:49:12.717788+0000","last_became_active":"2023-08-10T10:48:42.582426+0000","last_became_peered":"2023-08-10T10:48:42.582426+0000","last_unstale":"2023-08-10T10:49:12.717788+0000","last_undegraded":"2023-08-10T10:49:12.717788+0000","last_fullsized":"2023-08-10T10:49:12.717788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:38:40.237741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.731459+0000","last_change":"2023-08-10T10:48:42.577483+0000","last_active":"2023-08-10T10:49:12.731459+0000","last_peered":"2023-08-10T10:49:12.731459+0000","last_clean":"2023-08-10T10:49:12.731459+0000","last_became_active":"2023-08-10T10:48:42.577195+0000","last_became_peered":"2023-08-10T10:48:42.577195+0000","last_unstale":"2023-08-10T10:49:12.731459+0000","last_undegraded":"2023-08-10T10:49:12.731459+0000","last_fullsized":"2023-08-10T10:49:12.731459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:59:56.657695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.717888+0000","last_change":"2023-08-10T10:48:42.581129+0000","last_active":"2023-08-10T10:49:12.717888+0000","last_peered":"2023-08-10T10:49:12.717888+0000","last_clean":"2023-08-10T10:49:12.717888+0000","last_became_active":"2023-08-10T10:48:42.579350+0000","last_became_peered":"2023-08-10T10:48:42.579350+0000","last_unstale":"2023-08-10T10:49:12.717888+0000","last_undegraded":"2023-08-10T10:49:12.717888+0000","last_fullsized":"2023-08-10T10:49:12.717888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:50:27.669242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.707581+0000","last_change":"2023-08-10T10:48:42.578167+0000","last_active":"2023-08-10T10:49:12.707581+0000","last_peered":"2023-08-10T10:49:12.707581+0000","last_clean":"2023-08-10T10:49:12.707581+0000","last_became_active":"2023-08-10T10:48:42.577571+0000","last_became_peered":"2023-08-10T10:48:42.577571+0000","last_unstale":"2023-08-10T10:49:12.707581+0000","last_undegraded":"2023-08-10T10:49:12.707581+0000","last_fullsized":"2023-08-10T10:49:12.707581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:54:14.264193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.712579+0000","last_change":"2023-08-10T10:48:42.587207+0000","last_active":"2023-08-10T10:49:12.712579+0000","last_peered":"2023-08-10T10:49:12.712579+0000","last_clean":"2023-08-10T10:49:12.712579+0000","last_became_active":"2023-08-10T10:48:42.586848+0000","last_became_peered":"2023-08-10T10:48:42.586848+0000","last_unstale":"2023-08-10T10:49:12.712579+0000","last_undegraded":"2023-08-10T10:49:12.712579+0000","last_fullsized":"2023-08-10T10:49:12.712579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:34:50.994727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-08-10T10:49:12.714173+0000","last_change":"2023-08-10T10:48:42.580785+0000","last_active":"2023-08-10T10:49:12.714173+0000","last_peered":"2023-08-10T10:49:12.714173+0000","last_clean":"2023-08-10T10:49:12.714173+0000","last_became_active":"2023-08-10T10:48:42.580395+0000","last_became_peered":"2023-08-10T10:48:42.580395+0000","last_unstale":"2023-08-10T10:49:12.714173+0000","last_undegraded":"2023-08-10T10:49:12.714173+0000","last_fullsized":"2023-08-10T10:49:12.714173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:17:41.679781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250142,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66818,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":523,"num_read_kb":333,"num_write":238,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383710,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":501253,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46100000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.93000000000000005,"5min":1.044,"15min":1.044},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97599999999999998,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97899999999999998,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.38100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.85699999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.84099999999999997},"min":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.216,"5min":1.272,"15min":1.272},"last":1.077},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.59599999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0109999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.77500000000000002,"15min":0.76400000000000001},"min":{"1min":0.626,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1479999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73099999999999998,"15min":0.72099999999999997},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.093,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.83199999999999996,"15min":0.82699999999999996},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.91900000000000004,"15min":0.91300000000000003},"min":{"1min":0.71699999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.9019999999999999,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.88500000000000001,"15min":0.88},"min":{"1min":0.65500000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.167,"5min":1.597,"15min":1.597},"last":1.03},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.88700000000000001,"15min":0.88600000000000001},"min":{"1min":0.70699999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1659999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0189999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.093},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":0.97499999999999998,"15min":0.95499999999999996},"min":{"1min":0.84799999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.069,"5min":0.93500000000000005,"15min":0.91300000000000003},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.7759999999999998,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":0.98799999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:49:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92700000000000005,"15min":0.92100000000000004},"min":{"1min":0.65800000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.05},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.98899999999999999,"15min":0.97799999999999998},"min":{"1min":0.73699999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.478,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.1180000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645348,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1146880,"data_stored":1147478,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.89200000000000002,"5min":1.355,"15min":1.355},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.68700000000000006,"15min":0.70599999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80200000000000005,"5min":1.494,"15min":1.494},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.496,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.99099999999999999,"5min":1.222,"15min":1.222},"last":0.751},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82899999999999996,"15min":0.84099999999999997},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97399999999999998,"5min":1.198,"15min":1.198},"last":0.87}]},{"osd":3,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.82399999999999995,"15min":0.84399999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0249999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.83899999999999997,"15min":0.86499999999999999},"min":{"1min":0.502,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86599999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91400000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.80700000000000005,"15min":0.81999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91800000000000004,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.81499999999999995,"15min":0.83899999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.119,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.629}]},{"osd":5,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.93899999999999995,"15min":0.95799999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0029999999999999,"5min":1.369,"15min":1.369},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.91700000000000004,"15min":0.93700000000000006},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.018,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0960000000000001,"5min":1.579,"15min":1.579},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.94199999999999995,"15min":0.95599999999999996},"min":{"1min":0.65500000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.109,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.53000000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0269999999999999},"min":{"1min":0.67900000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1739999999999999,"5min":1.869,"15min":1.869},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.874,"5min":1.046,"15min":1.0740000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0860000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.89900000000000002}]},{"osd":9,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.034,"15min":1.052},"min":{"1min":0.70099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.129,"5min":1.619,"15min":1.619},"last":0.88},{"interface":"front","average":{"1min":0.873,"5min":1.0549999999999999,"15min":1.085},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0640000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.85399999999999998}]},{"osd":11,"last update":"Thu Aug 10 10:49:46 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.999,"15min":1.006},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2270000000000001,"5min":1.79,"15min":1.79},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96599999999999997,"15min":0.96999999999999997},"min":{"1min":0.629,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1459999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.95099999999999996}]}]},{"osd":9,"up_from":67,"seq":287762808873,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":504869,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.35499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.86599999999999999},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.93200000000000005,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.024,"5min":1.077,"15min":1.077},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.747,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.157,"5min":1.167,"15min":1.167},"last":0.751}]},{"osd":3,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65000000000000002,"15min":0.68799999999999994},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3109999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.39700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75,"15min":0.78600000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86099999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.80200000000000005,"15min":0.84199999999999997},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0209999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81799999999999995,"15min":0.85399999999999998},"min":{"1min":0.53700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.111,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81999999999999995,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2110000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.081}]},{"osd":7,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.85399999999999998,"15min":0.90200000000000002},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.099,"5min":1.607,"15min":1.607},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.143,"5min":1.236,"15min":1.236},"last":0.66500000000000004}]},{"osd":8,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0229999999999999,"5min":1.319,"15min":1.319},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":0.94499999999999995},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.63300000000000001}]},{"osd":10,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.86599999999999999,"15min":0.878},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0289999999999999,"5min":1.258,"15min":1.258},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.91400000000000003,"15min":0.92600000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.98099999999999998,"5min":1.381,"15min":1.381},"last":0.84099999999999997}]},{"osd":11,"last update":"Thu Aug 10 10:49:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.73499999999999999}]}]},{"osd":8,"up_from":59,"seq":253403070510,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":500820,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":5.1909999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.873}]},{"osd":2,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64100000000000001,"15min":0.66900000000000004},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.98999999999999999,"5min":1.103,"15min":1.103},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63300000000000001,"15min":0.66300000000000003},"min":{"1min":0.33300000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73299999999999998,"15min":0.75800000000000001},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92200000000000004,"5min":1.113,"15min":1.113},"last":5.1189999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94799999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.84399999999999997},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0700000000000001,"5min":1.238,"15min":1.238},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.85999999999999999,"15min":0.872},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.1739999999999999,"5min":1.214,"15min":1.214},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76900000000000002,"15min":0.81000000000000005},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99099999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.628},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78800000000000003,"15min":0.82299999999999995},"min":{"1min":0.5,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1639999999999999,"5min":1.236,"15min":1.236},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86599999999999999,"15min":0.89300000000000002},"min":{"1min":0.55900000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.034,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.876,"15min":0.91200000000000003},"min":{"1min":0.51100000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96899999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":5.1609999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:49:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.90600000000000003,"15min":0.94099999999999995},"min":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1279999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91300000000000003,"15min":0.93700000000000006},"min":{"1min":0.66900000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2390000000000001,"5min":1.29,"15min":1.29},"last":0.84299999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:48:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1919999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88100000000000001,"15min":0.88300000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.341,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.73999999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89200000000000002,"15min":0.877},"min":{"1min":0.64500000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.179,"5min":1.214,"15min":1.214},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.91300000000000003,"15min":0.90800000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.139,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.85899999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.95899999999999996}]}]},{"osd":7,"up_from":51,"seq":219043332147,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":1097172,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0489999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99299999999999999,"5min":1.466,"15min":1.466},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.622}]},{"osd":2,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.82199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.81200000000000006,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.76000000000000001,"15min":0.78400000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88200000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.876}]},{"osd":4,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65400000000000003,"15min":0.67100000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81299999999999994,"15min":0.82399999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97799999999999998,"5min":1.194,"15min":1.194},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0329999999999999,"5min":1.409,"15min":1.409},"last":0.84799999999999998}]},{"osd":8,"last update":"Thu Aug 10 10:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89200000000000002,"15min":0.874},"min":{"1min":0.68200000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.0620000000000001,"5min":1.379,"15min":1.379},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.88300000000000001,"15min":0.878},"min":{"1min":0.67700000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0329999999999999,"5min":1.357,"15min":1.357},"last":0.79700000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93899999999999995,"15min":0.96099999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0109999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.89200000000000002,"15min":0.89600000000000002},"min":{"1min":0.64800000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0940000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96699999999999997,"15min":0.97099999999999997},"min":{"1min":0.70999999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.143,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.0649999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.95199999999999996}]}]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":496229,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.48199999999999998,"15min":0.45900000000000002},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.875,"5min":3.875,"15min":3.875},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.53400000000000003,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.748,"15min":0.73299999999999998},"min":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73399999999999999,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.95899999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.434},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.70999999999999996,"15min":0.69599999999999995},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.625}]},{"osd":3,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.42199999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.423,"5min":3.423,"15min":3.423},"last":0.501}]},{"osd":4,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76700000000000002,"15min":0.754},"min":{"1min":0.56200000000000006,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78100000000000003,"15min":0.77300000000000002},"min":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.91100000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:49:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.746,"15min":0.752},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.66400000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.755}]},{"osd":7,"last update":"Thu Aug 10 10:49:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.95599999999999996,"5min":1.016,"15min":1.016},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98999999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.88600000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.66500000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.83399999999999996,"15min":0.85499999999999998},"min":{"1min":0.62,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.77800000000000002}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.88700000000000001,"15min":0.88900000000000001},"min":{"1min":0.52800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.879}]},{"osd":10,"last update":"Thu Aug 10 10:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.91900000000000004,"15min":0.92700000000000005},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.103,"5min":1.175,"15min":1.175},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.66700000000000004,"5min":0.63,"15min":0.63},"max":{"1min":1.147,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0289999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:49:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":557067,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.57699999999999996},"min":{"1min":0.434,"5min":0.35299999999999998,"15min":0.26600000000000001},"max":{"1min":0.95699999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.624,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.36899999999999999,"15min":0.28399999999999997},"max":{"1min":0.82699999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.432}]},{"osd":2,"last update":"Thu Aug 10 10:49:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.70599999999999996,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.40999999999999998,"15min":0.32200000000000001},"max":{"1min":1.1539999999999999,"5min":1.25,"15min":1.25},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.68500000000000005,"15min":0.60499999999999998},"min":{"1min":0.45200000000000001,"5min":0.38900000000000001,"15min":0.34499999999999997},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.876}]},{"osd":3,"last update":"Thu Aug 10 10:49:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69499999999999995,"15min":0.63900000000000001},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71799999999999997,"15min":0.66100000000000003},"min":{"1min":0.58299999999999996,"5min":0.377,"15min":0.377},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.47399999999999998},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.74199999999999999,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.72999999999999998,"15min":0.66900000000000004},"min":{"1min":0.60899999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.77600000000000002},"min":{"1min":0.60199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.78600000000000003,"15min":0.73999999999999999},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Aug 10 10:49:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.69499999999999995,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.80600000000000005,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.72199999999999998}]},{"osd":8,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.89500000000000002,"15min":0.876},"min":{"1min":0.68300000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.86199999999999999,"15min":0.83799999999999997},"min":{"1min":0.64500000000000002,"5min":0.624,"15min":0.624},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.78400000000000003}]},{"osd":9,"last update":"Thu Aug 10 10:49:54 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":0.89300000000000002,"15min":0.85299999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.159,"5min":0.97399999999999998,"15min":0.93600000000000005},"min":{"1min":0.67200000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":5.2670000000000003,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.84599999999999997}]},{"osd":10,"last update":"Thu Aug 10 10:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90800000000000003,"15min":0.91000000000000003},"min":{"1min":0.65600000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.76200000000000001}]},{"osd":11,"last update":"Thu Aug 10 10:49:46 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.83299999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":498075,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61899999999999999,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91600000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.61399999999999999},"min":{"1min":0.48299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.90100000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70699999999999996,"15min":0.69299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.73799999999999999,"15min":0.70999999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Aug 10 10:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.72099999999999997,"15min":0.67300000000000004},"min":{"1min":0.45200000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.69299999999999995,"15min":0.65400000000000003},"min":{"1min":0.48099999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.52500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90700000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70999999999999996,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Aug 10 10:49:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.64400000000000002}]},{"osd":8,"last update":"Thu Aug 10 10:49:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.60099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.84899999999999998,"15min":0.84299999999999997},"min":{"1min":0.621,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.88800000000000001}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.80700000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:49:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88800000000000001},"min":{"1min":0.60099999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.327,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.873,"15min":0.879},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.86799999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:49:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.871,"15min":0.86099999999999999},"min":{"1min":0.72299999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.70899999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.90400000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":556619,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.72699999999999998,"15min":0.63800000000000001},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":9.548,"5min":9.548,"15min":9.548},"last":0.626},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.70399999999999996,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":9.5,"5min":9.5,"15min":9.5},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.70499999999999996,"15min":0.625},"min":{"1min":0.55200000000000005,"5min":0.315,"15min":0.315},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.624},"min":{"1min":0.52000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.51500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.97899999999999998,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63900000000000001,"15min":0.65800000000000003},"min":{"1min":0.45400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88100000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:49:12 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56299999999999994,"15min":0.53200000000000003},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0189999999999999,"5min":1.488,"15min":1.488},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.57799999999999996,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92100000000000004,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Aug 10 10:49:40 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.76900000000000002,"15min":0.70099999999999996},"min":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":4.851,"5min":4.851,"15min":4.851},"last":0.504},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.73599999999999999,"15min":0.69999999999999996},"min":{"1min":0.58399999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.748}]},{"osd":7,"last update":"Thu Aug 10 10:49:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.80100000000000005}]},{"osd":8,"last update":"Thu Aug 10 10:49:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.45300000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88,"5min":0.997,"15min":0.997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.63600000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.145,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.45100000000000001}]},{"osd":9,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.80800000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.9379999999999997,"5min":4.9379999999999997,"15min":4.9379999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.508,"5min":0.94999999999999996,"15min":0.85799999999999998},"min":{"1min":0.78400000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":0.70099999999999996}]},{"osd":10,"last update":"Thu Aug 10 10:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.74399999999999999,"15min":0.72999999999999998},"min":{"1min":0.60299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.876},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.90400000000000003,"15min":0.88800000000000001},"min":{"1min":0.71099999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89200000000000002}]},{"osd":11,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.78100000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182472,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":495654,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.442,"15min":0.41699999999999998},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.61399999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.45800000000000002,"15min":0.436},"min":{"1min":0.308,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.624,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.68200000000000005,"15min":0.65200000000000002},"min":{"1min":0.47099999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0469999999999999,"5min":1.133,"15min":1.133},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.67800000000000005,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.97499999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73999999999999999,"15min":0.66800000000000004},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92000000000000004,"5min":6.367,"15min":6.367},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69599999999999995,"15min":0.66800000000000004},"min":{"1min":0.52900000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":1.004,"15min":1.004},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:49:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.85499999999999998,"15min":0.73699999999999999},"min":{"1min":0.502,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.98099999999999998,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:49:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.76500000000000001,"15min":0.71499999999999997},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85699999999999998,"5min":6.3410000000000002,"15min":6.3410000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.59499999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94299999999999995,"5min":1.054,"15min":1.054},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86199999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68000000000000005,"15min":0.70399999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.93799999999999994,"5min":1.095,"15min":1.095},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:49:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79400000000000004,"15min":0.76800000000000002},"min":{"1min":0.59299999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.032,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.78400000000000003,"15min":0.754},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0249999999999999,"5min":1.327,"15min":1.327},"last":1.1519999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.04,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.85799999999999998},"min":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.0880000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.753}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.82299999999999995,"15min":0.85999999999999999},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.069,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.0029999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:49:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.70399999999999996,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.056,"5min":1.165,"15min":1.165},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88400000000000001,"15min":0.88700000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.877}]},{"osd":11,"last update":"Thu Aug 10 10:49:43 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.0269999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920835,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":500693,"data_compressed":17571,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:49:50 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48999999999999999,"15min":0.47599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68999999999999995,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.34300000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79100000000000004,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:49:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.70099999999999996,"15min":0.68500000000000005},"min":{"1min":0.50900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.71899999999999997,"15min":0.70099999999999996},"min":{"1min":0.54100000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.421,"15min":1.421},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:49:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67700000000000005,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.94299999999999995,"5min":1.069,"15min":1.069},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.752,"15min":0.748},"min":{"1min":0.53700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95399999999999996,"5min":1.377,"15min":1.377},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.59499999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91600000000000004,"5min":0.999,"15min":0.999},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:49:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76800000000000002,"15min":0.748},"min":{"1min":0.59899999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.089,"15min":1.089},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.006,"5min":1.071,"15min":1.071},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.751,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.05},"last":0.92100000000000004}]},{"osd":8,"last update":"Thu Aug 10 10:49:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.88,"15min":0.86299999999999999},"min":{"1min":0.755,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.69999999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.98399999999999999}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84599999999999997,"15min":0.85299999999999998},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.0720000000000001,"5min":1.175,"15min":1.175},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.88400000000000001,"15min":0.872},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.94799999999999995}]},{"osd":10,"last update":"Thu Aug 10 10:49:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.92300000000000004,"15min":0.92600000000000005},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.89600000000000002,"15min":0.90100000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.65100000000000002}]},{"osd":11,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.879}]}]},{"osd":5,"up_from":38,"seq":163208757311,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":1092460,"data_compressed":53775,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94099999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78400000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.74099999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.97899999999999998,"5min":1.073,"15min":1.073},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95699999999999996,"5min":1.014,"15min":1.014},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.499},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.876,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.39700000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.875,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89600000000000002,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":3.4860000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71499999999999997,"15min":0.68999999999999995},"min":{"1min":0.53200000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96399999999999997,"5min":1.141,"15min":1.141},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69499999999999995,"15min":0.68500000000000005},"min":{"1min":0.52000000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99099999999999999,"5min":1.321,"15min":1.321},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:49:41 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72299999999999998,"15min":0.70899999999999996},"min":{"1min":0.625,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92900000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.76000000000000001,"15min":0.73399999999999999},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:49:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.753,"15min":0.75},"min":{"1min":0.56599999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.82399999999999995}]},{"osd":8,"last update":"Thu Aug 10 10:49:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.51900000000000002,"5min":0.503,"15min":0.503},"max":{"1min":0.99399999999999999,"5min":1.012,"15min":1.012},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.56499999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94699999999999995,"5min":0.997,"15min":0.997},"last":0.46200000000000002}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83699999999999997,"15min":0.83399999999999996},"min":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.69499999999999995}]},{"osd":10,"last update":"Thu Aug 10 10:49:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82299999999999995,"15min":0.81899999999999995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.024,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.86499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:50:07.235 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-08-10T10:50:07.235 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-10T10:50:07.235 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-08-10T10:50:07.236 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph health --format=json 2023-08-10T10:50:07.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:07 smithi195 ceph-mon[129938]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:50:07.990 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:08.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:07 smithi157 ceph-mon[129604]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:50:08.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:07 smithi107 ceph-mon[127953]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:50:08.941 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:08 smithi107 ceph-mon[127953]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T10:50:09.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:08 smithi157 ceph-mon[129604]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T10:50:09.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:08 smithi195 ceph-mon[129938]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-08-10T10:50:09.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.628+0000 7f8e02f01700 1 -- 172.21.15.107:0/829356495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc101150 msgr2=0x7f8dfc10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.628+0000 7f8e02f01700 1 --2- 172.21.15.107:0/829356495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc101150 0x7f8dfc10d660 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8df400b0a0 tx=0x7f8df400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.628+0000 7f8e02f01700 1 -- 172.21.15.107:0/829356495 shutdown_connections 2023-08-10T10:50:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.628+0000 7f8e02f01700 1 --2- 172.21.15.107:0/829356495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc101150 0x7f8dfc10d660 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.628+0000 7f8e02f01700 1 --2- 172.21.15.107:0/829356495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dfc106790 0x7f8dfc106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.628+0000 7f8e02f01700 1 --2- 172.21.15.107:0/829356495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dfc100790 0x7f8dfc100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.628+0000 7f8e02f01700 1 -- 172.21.15.107:0/829356495 >> 172.21.15.107:0/829356495 conn(0x7f8dfc0fc260 msgr2=0x7f8dfc0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.629+0000 7f8e02f01700 1 -- 172.21.15.107:0/829356495 shutdown_connections 2023-08-10T10:50:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.629+0000 7f8e02f01700 1 -- 172.21.15.107:0/829356495 wait complete. 2023-08-10T10:50:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.630+0000 7f8e02f01700 1 Processor -- start 2023-08-10T10:50:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.630+0000 7f8e02f01700 1 -- start start 2023-08-10T10:50:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.630+0000 7f8e02f01700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc100790 0x7f8dfc072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.630+0000 7f8e02f01700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dfc101150 0x7f8dfc072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.630+0000 7f8e02f01700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dfc106790 0x7f8dfc073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.630+0000 7f8e02f01700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1a4d90 con 0x7f8dfc100790 2023-08-10T10:50:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.630+0000 7f8e02f01700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1a4f00 con 0x7f8dfc106790 2023-08-10T10:50:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.630+0000 7f8e02f01700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1a50c0 con 0x7f8dfc101150 2023-08-10T10:50:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e00c9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc100790 0x7f8dfc072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e00c9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc100790 0x7f8dfc072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44840/0 (socket says 172.21.15.107:44840) 2023-08-10T10:50:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e00c9d700 1 -- 172.21.15.107:0/2855683411 learned_addr learned my addr 172.21.15.107:0/2855683411 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8dfbfff700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dfc101150 0x7f8dfc072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e0149e700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dfc106790 0x7f8dfc073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e00c9d700 1 -- 172.21.15.107:0/2855683411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dfc101150 msgr2=0x7f8dfc072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e00c9d700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dfc101150 0x7f8dfc072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e00c9d700 1 -- 172.21.15.107:0/2855683411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dfc106790 msgr2=0x7f8dfc073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e00c9d700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dfc106790 0x7f8dfc073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e00c9d700 1 -- 172.21.15.107:0/2855683411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4009d00 con 0x7f8dfc100790 2023-08-10T10:50:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e00c9d700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc100790 0x7f8dfc072a70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8df000e9a0 tx=0x7f8df000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8df9ffb700 1 -- 172.21.15.107:0/2855683411 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0009790 con 0x7f8dfc100790 2023-08-10T10:50:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8df9ffb700 1 -- 172.21.15.107:0/2855683411 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8df000cbd0 con 0x7f8dfc100790 2023-08-10T10:50:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc1a53a0 con 0x7f8dfc100790 2023-08-10T10:50:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.631+0000 7f8df9ffb700 1 -- 172.21.15.107:0/2855683411 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0018680 con 0x7f8dfc100790 2023-08-10T10:50:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.632+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc1a58f0 con 0x7f8dfc100790 2023-08-10T10:50:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.633+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc04e470 con 0x7f8dfc100790 2023-08-10T10:50:09.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.635+0000 7f8df9ffb700 1 -- 172.21.15.107:0/2855683411 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8df000cd40 con 0x7f8dfc100790 2023-08-10T10:50:09.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.637+0000 7f8df9ffb700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8dec0a1260 0x7f8dec0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.637+0000 7f8df9ffb700 1 -- 172.21.15.107:0/2855683411 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f8df0014070 con 0x7f8dfc100790 2023-08-10T10:50:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.637+0000 7f8dfbfff700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8dec0a1260 0x7f8dec0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.637+0000 7f8dfbfff700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8dec0a1260 0x7f8dec0a3720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8de8006fd0 tx=0x7f8de8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:09.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.641+0000 7f8df9ffb700 1 -- 172.21.15.107:0/2855683411 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8df0051790 con 0x7f8dfc100790 2023-08-10T10:50:09.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.882+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8dfc073fa0 con 0x7f8dfc100790 2023-08-10T10:50:09.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.882+0000 7f8df9ffb700 1 -- 172.21.15.107:0/2855683411 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8dfc073fa0 con 0x7f8dfc100790 2023-08-10T10:50:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:09.884 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-10T10:50:09.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8dec0a1260 msgr2=0x7f8dec0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8dec0a1260 0x7f8dec0a3720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8de8006fd0 tx=0x7f8de8008040 comp rx=0 tx=0).stop 2023-08-10T10:50:09.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc100790 msgr2=0x7f8dfc072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:09.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc100790 0x7f8dfc072a70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8df000e9a0 tx=0x7f8df000ed60 comp rx=0 tx=0).stop 2023-08-10T10:50:09.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 shutdown_connections 2023-08-10T10:50:09.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8dec0a1260 0x7f8dec0a3720 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dfc106790 0x7f8dfc073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8dfc100790 0x7f8dfc072a70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 --2- 172.21.15.107:0/2855683411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dfc101150 0x7f8dfc072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:09.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 >> 172.21.15.107:0/2855683411 conn(0x7f8dfc0fc260 msgr2=0x7f8dfc0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:09.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 shutdown_connections 2023-08-10T10:50:09.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:09.885+0000 7f8e02f01700 1 -- 172.21.15.107:0/2855683411 wait complete. 2023-08-10T10:50:10.379 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-08-10T10:50:10.379 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:10.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.582+0000 7fee82dff700 1 -- 172.21.15.107:0/1478477371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee7c1019a0 msgr2=0x7fee7c101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.582+0000 7fee82dff700 1 --2- 172.21.15.107:0/1478477371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee7c1019a0 0x7fee7c101e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee680099c0 tx=0x7fee68009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.583+0000 7fee82dff700 1 -- 172.21.15.107:0/1478477371 shutdown_connections 2023-08-10T10:50:10.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.583+0000 7fee82dff700 1 --2- 172.21.15.107:0/1478477371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee7c102340 0x7fee7c108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.583+0000 7fee82dff700 1 --2- 172.21.15.107:0/1478477371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7c1007b0 0x7fee7c100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.583+0000 7fee82dff700 1 --2- 172.21.15.107:0/1478477371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee7c1019a0 0x7fee7c101e00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.583+0000 7fee82dff700 1 -- 172.21.15.107:0/1478477371 >> 172.21.15.107:0/1478477371 conn(0x7fee7c0fbd20 msgr2=0x7fee7c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:10.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.583+0000 7fee82dff700 1 -- 172.21.15.107:0/1478477371 shutdown_connections 2023-08-10T10:50:10.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.583+0000 7fee82dff700 1 -- 172.21.15.107:0/1478477371 wait complete. 2023-08-10T10:50:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.584+0000 7fee82dff700 1 Processor -- start 2023-08-10T10:50:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.584+0000 7fee82dff700 1 -- start start 2023-08-10T10:50:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee82dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7c1007b0 0x7fee7c074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee82dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee7c1019a0 0x7fee7c072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee82dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee7c102340 0x7fee7c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee82dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c073840 con 0x7fee7c1019a0 2023-08-10T10:50:10.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee82dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0739b0 con 0x7fee7c102340 2023-08-10T10:50:10.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee82dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c1a0370 con 0x7fee7c1007b0 2023-08-10T10:50:10.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee80b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7c1007b0 0x7fee7c074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee80b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7c1007b0 0x7fee7c074520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:52318/0 (socket says 172.21.15.107:52318) 2023-08-10T10:50:10.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee80b9b700 1 -- 172.21.15.107:0/2015286372 learned_addr learned my addr 172.21.15.107:0/2015286372 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:10.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee8139c700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee7c102340 0x7fee7c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee7bfff700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee7c1019a0 0x7fee7c072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee80b9b700 1 -- 172.21.15.107:0/2015286372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee7c102340 msgr2=0x7fee7c0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee80b9b700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee7c102340 0x7fee7c0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee80b9b700 1 -- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee7c1019a0 msgr2=0x7fee7c072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee80b9b700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee7c1019a0 0x7fee7c072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.585+0000 7fee80b9b700 1 -- 172.21.15.107:0/2015286372 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680095f0 con 0x7fee7c1007b0 2023-08-10T10:50:10.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.586+0000 7fee80b9b700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7c1007b0 0x7fee7c074520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fee7000e970 tx=0x7fee7000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:10.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.586+0000 7fee79ffb700 1 -- 172.21.15.107:0/2015286372 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70009790 con 0x7fee7c1007b0 2023-08-10T10:50:10.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.586+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c1a0650 con 0x7fee7c1007b0 2023-08-10T10:50:10.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.586+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c1a0bb0 con 0x7fee7c1007b0 2023-08-10T10:50:10.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.586+0000 7fee79ffb700 1 -- 172.21.15.107:0/2015286372 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee7000c7e0 con 0x7fee7c1007b0 2023-08-10T10:50:10.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.586+0000 7fee79ffb700 1 -- 172.21.15.107:0/2015286372 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70003bd0 con 0x7fee7c1007b0 2023-08-10T10:50:10.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.588+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee60005320 con 0x7fee7c1007b0 2023-08-10T10:50:10.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.590+0000 7fee79ffb700 1 -- 172.21.15.107:0/2015286372 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fee70004220 con 0x7fee7c1007b0 2023-08-10T10:50:10.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.591+0000 7fee79ffb700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fee6c0a12a0 0x7fee6c0a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:10.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.591+0000 7fee79ffb700 1 -- 172.21.15.107:0/2015286372 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fee70014070 con 0x7fee7c1007b0 2023-08-10T10:50:10.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.591+0000 7fee7bfff700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fee6c0a12a0 0x7fee6c0a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:10.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.592+0000 7fee7bfff700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fee6c0a12a0 0x7fee6c0a3760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fee68009990 tx=0x7fee68005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:10.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.594+0000 7fee79ffb700 1 -- 172.21.15.107:0/2015286372 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fee700967f0 con 0x7fee7c1007b0 2023-08-10T10:50:10.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.797+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee60005190 con 0x7fee7c1007b0 2023-08-10T10:50:10.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.799+0000 7fee79ffb700 1 -- 172.21.15.107:0/2015286372 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+24517 (secure 0 0 0) 0x7fee70099e10 con 0x7fee7c1007b0 2023-08-10T10:50:10.800 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:10.800 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":91,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:49:12.696718+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:10.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fee6c0a12a0 msgr2=0x7fee6c0a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fee6c0a12a0 0x7fee6c0a3760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fee68009990 tx=0x7fee68005be0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7c1007b0 msgr2=0x7fee7c074520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:10.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7c1007b0 0x7fee7c074520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fee7000e970 tx=0x7fee7000ec80 comp rx=0 tx=0).stop 2023-08-10T10:50:10.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 shutdown_connections 2023-08-10T10:50:10.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fee6c0a12a0 0x7fee6c0a3760 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee7c102340 0x7fee7c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7c1007b0 0x7fee7c074520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 --2- 172.21.15.107:0/2015286372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee7c1019a0 0x7fee7c072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:10.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 >> 172.21.15.107:0/2015286372 conn(0x7fee7c0fbd20 msgr2=0x7fee7c104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:10.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 shutdown_connections 2023-08-10T10:50:10.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:10.801+0000 7fee82dff700 1 -- 172.21.15.107:0/2015286372 wait complete. 2023-08-10T10:50:10.821 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:50:10.823 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:50:11.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.024+0000 7f8b461ff700 1 -- 172.21.15.107:0/4072085036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 msgr2=0x7f8b4010add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.024+0000 7f8b461ff700 1 --2- 172.21.15.107:0/4072085036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 0x7f8b4010add0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800b0d0 tx=0x7f8b3800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.024+0000 7f8b461ff700 1 -- 172.21.15.107:0/4072085036 shutdown_connections 2023-08-10T10:50:11.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.024+0000 7f8b461ff700 1 --2- 172.21.15.107:0/4072085036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b40102990 0x7f8b40102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.024+0000 7f8b461ff700 1 --2- 172.21.15.107:0/4072085036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 0x7f8b4010add0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.024+0000 7f8b461ff700 1 --2- 172.21.15.107:0/4072085036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b40103b80 0x7f8b40103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.024+0000 7f8b461ff700 1 -- 172.21.15.107:0/4072085036 >> 172.21.15.107:0/4072085036 conn(0x7f8b400fdf20 msgr2=0x7f8b40100340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:11.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.024+0000 7f8b461ff700 1 -- 172.21.15.107:0/4072085036 shutdown_connections 2023-08-10T10:50:11.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.024+0000 7f8b461ff700 1 -- 172.21.15.107:0/4072085036 wait complete. 2023-08-10T10:50:11.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.025+0000 7f8b461ff700 1 Processor -- start 2023-08-10T10:50:11.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.025+0000 7f8b461ff700 1 -- start start 2023-08-10T10:50:11.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.025+0000 7f8b461ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b40102990 0x7f8b40198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.025+0000 7f8b461ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b40103b80 0x7f8b40198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.025+0000 7f8b461ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 0x7f8b4019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.025+0000 7f8b461ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b401a01f0 con 0x7f8b40104520 2023-08-10T10:50:11.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.025+0000 7f8b461ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b401a0330 con 0x7f8b40103b80 2023-08-10T10:50:11.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.025+0000 7f8b461ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b401a04c0 con 0x7f8b40102990 2023-08-10T10:50:11.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 0x7f8b4019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b40102990 0x7f8b40198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 0x7f8b4019fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44880/0 (socket says 172.21.15.107:44880) 2023-08-10T10:50:11.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b40102990 0x7f8b40198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:52334/0 (socket says 172.21.15.107:52334) 2023-08-10T10:50:11.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3ffff700 1 -- 172.21.15.107:0/3409153714 learned_addr learned my addr 172.21.15.107:0/3409153714 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:11.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b37fff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b40103b80 0x7f8b40198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3ffff700 1 -- 172.21.15.107:0/3409153714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b40102990 msgr2=0x7f8b40198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3ffff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b40102990 0x7f8b40198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3ffff700 1 -- 172.21.15.107:0/3409153714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b40103b80 msgr2=0x7f8b40198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3ffff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b40103b80 0x7f8b40198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3ffff700 1 -- 172.21.15.107:0/3409153714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38009d00 con 0x7f8b40104520 2023-08-10T10:50:11.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3ffff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 0x7f8b4019fc20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009fd0 tx=0x7f8b3800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:11.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.026+0000 7f8b3d7fa700 1 -- 172.21.15.107:0/3409153714 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800e040 con 0x7f8b40104520 2023-08-10T10:50:11.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.027+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b401a0740 con 0x7f8b40104520 2023-08-10T10:50:11.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.027+0000 7f8b3d7fa700 1 -- 172.21.15.107:0/3409153714 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b38003e10 con 0x7f8b40104520 2023-08-10T10:50:11.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.027+0000 7f8b3d7fa700 1 -- 172.21.15.107:0/3409153714 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380052a0 con 0x7f8b40104520 2023-08-10T10:50:11.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.027+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b401a0c10 con 0x7f8b40104520 2023-08-10T10:50:11.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.028+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4010e060 con 0x7f8b40104520 2023-08-10T10:50:11.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.030+0000 7f8b3d7fa700 1 -- 172.21.15.107:0/3409153714 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8b38005400 con 0x7f8b40104520 2023-08-10T10:50:11.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.031+0000 7f8b3d7fa700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8b2c0a11e0 0x7f8b2c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.031+0000 7f8b3d7fa700 1 -- 172.21.15.107:0/3409153714 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f8b380ce470 con 0x7f8b40104520 2023-08-10T10:50:11.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.032+0000 7f8b3f7fe700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8b2c0a11e0 0x7f8b2c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.032+0000 7f8b3f7fe700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8b2c0a11e0 0x7f8b2c0a36a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b401039e0 tx=0x7f8b30009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:11.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.035+0000 7f8b3d7fa700 1 -- 172.21.15.107:0/3409153714 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8b38097790 con 0x7f8b40104520 2023-08-10T10:50:11.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:10 smithi157 ceph-mon[129604]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T10:50:11.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:10 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2855683411' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-08-10T10:50:11.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:10 smithi107 ceph-mon[127953]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T10:50:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:10 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2855683411' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-08-10T10:50:11.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:10 smithi195 ceph-mon[129938]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-08-10T10:50:11.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:10 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2855683411' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-08-10T10:50:11.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.235+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b401098d0 con 0x7f8b40104520 2023-08-10T10:50:11.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.235+0000 7f8b3d7fa700 1 -- 172.21.15.107:0/3409153714 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b3809adb0 con 0x7f8b40104520 2023-08-10T10:50:11.237 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:50:11.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.237+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8b2c0a11e0 msgr2=0x7f8b2c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.237+0000 7f8b461ff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8b2c0a11e0 0x7f8b2c0a36a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b401039e0 tx=0x7f8b30009260 comp rx=0 tx=0).stop 2023-08-10T10:50:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.237+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 msgr2=0x7f8b4019fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.237+0000 7f8b461ff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 0x7f8b4019fc20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009fd0 tx=0x7f8b3800ccc0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.238+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 shutdown_connections 2023-08-10T10:50:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.238+0000 7f8b461ff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f8b2c0a11e0 0x7f8b2c0a36a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.238+0000 7f8b461ff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b40104520 0x7f8b4019fc20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.238+0000 7f8b461ff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b40102990 0x7f8b40198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.238+0000 7f8b461ff700 1 --2- 172.21.15.107:0/3409153714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b40103b80 0x7f8b40198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.238+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 >> 172.21.15.107:0/3409153714 conn(0x7f8b400fdf20 msgr2=0x7f8b401001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:11.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.238+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 shutdown_connections 2023-08-10T10:50:11.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.238+0000 7f8b461ff700 1 -- 172.21.15.107:0/3409153714 wait complete. 2023-08-10T10:50:11.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:50:11.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.455+0000 7f4629fff700 1 -- 172.21.15.107:0/706362229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 msgr2=0x7f462410aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.455+0000 7f4629fff700 1 --2- 172.21.15.107:0/706362229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 0x7f462410aaa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f461c00b0a0 tx=0x7f461c00b3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.455+0000 7f4629fff700 1 -- 172.21.15.107:0/706362229 shutdown_connections 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.455+0000 7f4629fff700 1 --2- 172.21.15.107:0/706362229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 0x7f462410aaa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.455+0000 7f4629fff700 1 --2- 172.21.15.107:0/706362229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624074750 0x7f4624072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.455+0000 7f4629fff700 1 --2- 172.21.15.107:0/706362229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4624073170 0x7f46240735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.455+0000 7f4629fff700 1 -- 172.21.15.107:0/706362229 >> 172.21.15.107:0/706362229 conn(0x7f46240fbcb0 msgr2=0x7f46240fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:11.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.455+0000 7f4629fff700 1 -- 172.21.15.107:0/706362229 shutdown_connections 2023-08-10T10:50:11.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.455+0000 7f4629fff700 1 -- 172.21.15.107:0/706362229 wait complete. 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.457+0000 7f4629fff700 1 Processor -- start 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.457+0000 7f4629fff700 1 -- start start 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.457+0000 7f4629fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624073170 0x7f4624198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4629fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4624074750 0x7f4624198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4629fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 0x7f462419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4629fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46241a01b0 con 0x7f4624108630 2023-08-10T10:50:11.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4629fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46241a02f0 con 0x7f4624074750 2023-08-10T10:50:11.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4629fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46241a0480 con 0x7f4624073170 2023-08-10T10:50:11.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4623fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 0x7f462419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f46237fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624073170 0x7f4624198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4623fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 0x7f462419fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44906/0 (socket says 172.21.15.107:44906) 2023-08-10T10:50:11.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4623fff700 1 -- 172.21.15.107:0/1733186068 learned_addr learned my addr 172.21.15.107:0/1733186068 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:11.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4622ffd700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4624074750 0x7f4624198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4623fff700 1 -- 172.21.15.107:0/1733186068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624073170 msgr2=0x7f4624198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4623fff700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624073170 0x7f4624198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4623fff700 1 -- 172.21.15.107:0/1733186068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4624074750 msgr2=0x7f4624198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4623fff700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4624074750 0x7f4624198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4623fff700 1 -- 172.21.15.107:0/1733186068 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c009d00 con 0x7f4624108630 2023-08-10T10:50:11.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.458+0000 7f4623fff700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 0x7f462419fbe0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f461c00d010 tx=0x7f461c00bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:11.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.459+0000 7f4620ff9700 1 -- 172.21.15.107:0/1733186068 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c00e040 con 0x7f4624108630 2023-08-10T10:50:11.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.459+0000 7f4620ff9700 1 -- 172.21.15.107:0/1733186068 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f461c009480 con 0x7f4624108630 2023-08-10T10:50:11.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.459+0000 7f4620ff9700 1 -- 172.21.15.107:0/1733186068 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0052a0 con 0x7f4624108630 2023-08-10T10:50:11.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.459+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46241a0700 con 0x7f4624108630 2023-08-10T10:50:11.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.459+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46241a0ad0 con 0x7f4624108630 2023-08-10T10:50:11.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.460+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4624106d30 con 0x7f4624108630 2023-08-10T10:50:11.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.462+0000 7f4620ff9700 1 -- 172.21.15.107:0/1733186068 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f461c005400 con 0x7f4624108630 2023-08-10T10:50:11.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.463+0000 7f4620ff9700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f460c0a11e0 0x7f460c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.463+0000 7f4620ff9700 1 -- 172.21.15.107:0/1733186068 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f461c0ce5f0 con 0x7f4624108630 2023-08-10T10:50:11.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.463+0000 7f46237fe700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f460c0a11e0 0x7f460c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.464+0000 7f46237fe700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f460c0a11e0 0x7f460c0a36a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4614009c60 tx=0x7f4614009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:11.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.465+0000 7f4620ff9700 1 -- 172.21.15.107:0/1733186068 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f461c097910 con 0x7f4624108630 2023-08-10T10:50:11.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.667+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f462402cb00 con 0x7f4624108630 2023-08-10T10:50:11.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.668+0000 7f4620ff9700 1 -- 172.21.15.107:0/1733186068 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f461c09af30 con 0x7f4624108630 2023-08-10T10:50:11.669 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:11.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f460c0a11e0 msgr2=0x7f460c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f460c0a11e0 0x7f460c0a36a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4614009c60 tx=0x7f4614009260 comp rx=0 tx=0).stop 2023-08-10T10:50:11.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 msgr2=0x7f462419fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 0x7f462419fbe0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f461c00d010 tx=0x7f461c00bcc0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 shutdown_connections 2023-08-10T10:50:11.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f460c0a11e0 0x7f460c0a36a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4624108630 0x7f462419fbe0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624073170 0x7f4624198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 --2- 172.21.15.107:0/1733186068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4624074750 0x7f4624198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 >> 172.21.15.107:0/1733186068 conn(0x7f46240fbcb0 msgr2=0x7f46240fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:11.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 shutdown_connections 2023-08-10T10:50:11.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.670+0000 7f4629fff700 1 -- 172.21.15.107:0/1733186068 wait complete. 2023-08-10T10:50:11.691 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:50:11.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.892+0000 7f68ccbff700 1 -- 172.21.15.107:0/2544219220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 msgr2=0x7f68c8100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.892+0000 7f68ccbff700 1 --2- 172.21.15.107:0/2544219220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 0x7f68c8100b80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f68b80099c0 tx=0x7f68b8009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.892+0000 7f68ccbff700 1 -- 172.21.15.107:0/2544219220 shutdown_connections 2023-08-10T10:50:11.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.892+0000 7f68ccbff700 1 --2- 172.21.15.107:0/2544219220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68c81022f0 0x7f68c8108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.892+0000 7f68ccbff700 1 --2- 172.21.15.107:0/2544219220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 0x7f68c8100b80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.892+0000 7f68ccbff700 1 --2- 172.21.15.107:0/2544219220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c8101950 0x7f68c8101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.892+0000 7f68ccbff700 1 -- 172.21.15.107:0/2544219220 >> 172.21.15.107:0/2544219220 conn(0x7f68c80fbcb0 msgr2=0x7f68c80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:11.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.892+0000 7f68ccbff700 1 -- 172.21.15.107:0/2544219220 shutdown_connections 2023-08-10T10:50:11.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.892+0000 7f68ccbff700 1 -- 172.21.15.107:0/2544219220 wait complete. 2023-08-10T10:50:11.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.893+0000 7f68ccbff700 1 Processor -- start 2023-08-10T10:50:11.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.893+0000 7f68ccbff700 1 -- start start 2023-08-10T10:50:11.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.893+0000 7f68ccbff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 0x7f68c8198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68ccbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c8101950 0x7f68c8198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68ccbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68c81022f0 0x7f68c819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68ccbff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c81a0180 con 0x7f68c8100760 2023-08-10T10:50:11.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68ccbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c81a02c0 con 0x7f68c81022f0 2023-08-10T10:50:11.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68ccbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c81a0450 con 0x7f68c8101950 2023-08-10T10:50:11.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 0x7f68c8198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 0x7f68c8198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44918/0 (socket says 172.21.15.107:44918) 2023-08-10T10:50:11.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c659c700 1 -- 172.21.15.107:0/421078948 learned_addr learned my addr 172.21.15.107:0/421078948 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:11.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c5d9b700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c8101950 0x7f68c8198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c6d9d700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68c81022f0 0x7f68c819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c659c700 1 -- 172.21.15.107:0/421078948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c8101950 msgr2=0x7f68c8198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c659c700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c8101950 0x7f68c8198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c659c700 1 -- 172.21.15.107:0/421078948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68c81022f0 msgr2=0x7f68c819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:11.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c659c700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68c81022f0 0x7f68c819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:11.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c659c700 1 -- 172.21.15.107:0/421078948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b80095f0 con 0x7f68c8100760 2023-08-10T10:50:11.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.894+0000 7f68c659c700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 0x7f68c8198600 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f68b8000c00 tx=0x7f68b800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:11.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.895+0000 7f68b77fe700 1 -- 172.21.15.107:0/421078948 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b801d070 con 0x7f68c8100760 2023-08-10T10:50:11.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.895+0000 7f68b77fe700 1 -- 172.21.15.107:0/421078948 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68b800bcf0 con 0x7f68c8100760 2023-08-10T10:50:11.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.895+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c81a06d0 con 0x7f68c8100760 2023-08-10T10:50:11.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.895+0000 7f68b77fe700 1 -- 172.21.15.107:0/421078948 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b80173f0 con 0x7f68c8100760 2023-08-10T10:50:11.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.895+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c81a0af0 con 0x7f68c8100760 2023-08-10T10:50:11.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.896+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c8192c70 con 0x7f68c8100760 2023-08-10T10:50:11.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.898+0000 7f68b77fe700 1 -- 172.21.15.107:0/421078948 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f68b8022470 con 0x7f68c8100760 2023-08-10T10:50:11.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.899+0000 7f68b77fe700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68b00a11e0 0x7f68b00a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:11.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.899+0000 7f68b77fe700 1 -- 172.21.15.107:0/421078948 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7f68b80cdf50 con 0x7f68c8100760 2023-08-10T10:50:11.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.900+0000 7f68c5d9b700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68b00a11e0 0x7f68b00a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:11.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.900+0000 7f68c5d9b700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68b00a11e0 0x7f68b00a36a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009c60 tx=0x7f68bc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:11.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:11.903+0000 7f68b77fe700 1 -- 172.21.15.107:0/421078948 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f68b8097270 con 0x7f68c8100760 2023-08-10T10:50:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:11 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2015286372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:11 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3409153714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:11 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1733186068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:11 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2015286372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:11 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3409153714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:11 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1733186068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:12.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.102+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68c802cb90 con 0x7f68c8100760 2023-08-10T10:50:12.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.103+0000 7f68b77fe700 1 -- 172.21.15.107:0/421078948 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68b809a890 con 0x7f68c8100760 2023-08-10T10:50:12.105 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T10:50:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.105+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68b00a11e0 msgr2=0x7f68b00a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.105+0000 7f68ccbff700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68b00a11e0 0x7f68b00a36a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009c60 tx=0x7f68bc009260 comp rx=0 tx=0).stop 2023-08-10T10:50:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.105+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 msgr2=0x7f68c8198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.105+0000 7f68ccbff700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 0x7f68c8198600 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f68b8000c00 tx=0x7f68b800fa00 comp rx=0 tx=0).stop 2023-08-10T10:50:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.105+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 shutdown_connections 2023-08-10T10:50:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.106+0000 7f68ccbff700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f68b00a11e0 0x7f68b00a36a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.106+0000 7f68ccbff700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68c81022f0 0x7f68c819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.106+0000 7f68ccbff700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c8100760 0x7f68c8198600 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.106+0000 7f68ccbff700 1 --2- 172.21.15.107:0/421078948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c8101950 0x7f68c8198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.106+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 >> 172.21.15.107:0/421078948 conn(0x7f68c80fbcb0 msgr2=0x7f68c8107360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.106+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 shutdown_connections 2023-08-10T10:50:12.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.106+0000 7f68ccbff700 1 -- 172.21.15.107:0/421078948 wait complete. 2023-08-10T10:50:12.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:50:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:11 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2015286372' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:11 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3409153714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:11 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1733186068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:12.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.324+0000 7fa4467ff700 1 -- 172.21.15.107:0/3045110593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa440073170 msgr2=0x7fa4400735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.324+0000 7fa4467ff700 1 --2- 172.21.15.107:0/3045110593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa440073170 0x7fa4400735f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa434009990 tx=0x7fa434009ca0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.324+0000 7fa4467ff700 1 -- 172.21.15.107:0/3045110593 shutdown_connections 2023-08-10T10:50:12.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.324+0000 7fa4467ff700 1 --2- 172.21.15.107:0/3045110593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa440108630 0x7fa44010aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.324+0000 7fa4467ff700 1 --2- 172.21.15.107:0/3045110593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa440074750 0x7fa440072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.324+0000 7fa4467ff700 1 --2- 172.21.15.107:0/3045110593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa440073170 0x7fa4400735f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.324+0000 7fa4467ff700 1 -- 172.21.15.107:0/3045110593 >> 172.21.15.107:0/3045110593 conn(0x7fa4400fbcb0 msgr2=0x7fa4400fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:12.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.324+0000 7fa4467ff700 1 -- 172.21.15.107:0/3045110593 shutdown_connections 2023-08-10T10:50:12.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.324+0000 7fa4467ff700 1 -- 172.21.15.107:0/3045110593 wait complete. 2023-08-10T10:50:12.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.325+0000 7fa4467ff700 1 Processor -- start 2023-08-10T10:50:12.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.325+0000 7fa4467ff700 1 -- start start 2023-08-10T10:50:12.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.325+0000 7fa4467ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa440073170 0x7fa4401985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.325+0000 7fa4467ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa440074750 0x7fa440198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.325+0000 7fa4467ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa440108630 0x7fa44019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.325+0000 7fa4467ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401a0130 con 0x7fa440073170 2023-08-10T10:50:12.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.325+0000 7fa4467ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401a0270 con 0x7fa440108630 2023-08-10T10:50:12.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.325+0000 7fa4467ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401a0400 con 0x7fa440074750 2023-08-10T10:50:12.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa440073170 0x7fa4401985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa440074750 0x7fa440198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa440074750 0x7fa440198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:52392/0 (socket says 172.21.15.107:52392) 2023-08-10T10:50:12.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43f7fe700 1 -- 172.21.15.107:0/1023185184 learned_addr learned my addr 172.21.15.107:0/1023185184 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:12.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa444d9c700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa440108630 0x7fa44019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43ffff700 1 -- 172.21.15.107:0/1023185184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa440074750 msgr2=0x7fa440198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43ffff700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa440074750 0x7fa440198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43ffff700 1 -- 172.21.15.107:0/1023185184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa440108630 msgr2=0x7fa44019fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43ffff700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa440108630 0x7fa44019fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43ffff700 1 -- 172.21.15.107:0/1023185184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4340095f0 con 0x7fa440073170 2023-08-10T10:50:12.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43ffff700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa440073170 0x7fa4401985b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa43000d750 tx=0x7fa43000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:12.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.326+0000 7fa43d7fa700 1 -- 172.21.15.107:0/1023185184 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430004020 con 0x7fa440073170 2023-08-10T10:50:12.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.327+0000 7fa43d7fa700 1 -- 172.21.15.107:0/1023185184 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa430004830 con 0x7fa440073170 2023-08-10T10:50:12.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.327+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4401a06e0 con 0x7fa440073170 2023-08-10T10:50:12.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.327+0000 7fa43d7fa700 1 -- 172.21.15.107:0/1023185184 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430005400 con 0x7fa440073170 2023-08-10T10:50:12.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.327+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4401a0bf0 con 0x7fa440073170 2023-08-10T10:50:12.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.328+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa440106d30 con 0x7fa440073170 2023-08-10T10:50:12.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.330+0000 7fa43d7fa700 1 -- 172.21.15.107:0/1023185184 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa430004c80 con 0x7fa440073170 2023-08-10T10:50:12.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.331+0000 7fa43d7fa700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4280a11e0 0x7fa4280a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.331+0000 7fa43d7fa700 1 -- 172.21.15.107:0/1023185184 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8999+0+0 (secure 0 0 0) 0x7fa4300cc730 con 0x7fa440073170 2023-08-10T10:50:12.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.331+0000 7fa43f7fe700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4280a11e0 0x7fa4280a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.332+0000 7fa43f7fe700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4280a11e0 0x7fa4280a36a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa434006010 tx=0x7fa43400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:12.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.335+0000 7fa43d7fa700 1 -- 172.21.15.107:0/1023185184 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa4300959c0 con 0x7fa440073170 2023-08-10T10:50:12.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.534+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa44002cc20 con 0x7fa440073170 2023-08-10T10:50:12.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.535+0000 7fa43d7fa700 1 -- 172.21.15.107:0/1023185184 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa430098fe0 con 0x7fa440073170 2023-08-10T10:50:12.536 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:12.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4280a11e0 msgr2=0x7fa4280a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4280a11e0 0x7fa4280a36a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa434006010 tx=0x7fa43400b540 comp rx=0 tx=0).stop 2023-08-10T10:50:12.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa440073170 msgr2=0x7fa4401985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa440073170 0x7fa4401985b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa43000d750 tx=0x7fa43000da60 comp rx=0 tx=0).stop 2023-08-10T10:50:12.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 shutdown_connections 2023-08-10T10:50:12.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa4280a11e0 0x7fa4280a36a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa440108630 0x7fa44019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa440073170 0x7fa4401985b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 --2- 172.21.15.107:0/1023185184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa440074750 0x7fa440198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.537+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 >> 172.21.15.107:0/1023185184 conn(0x7fa4400fbcb0 msgr2=0x7fa4400fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:12.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.538+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 shutdown_connections 2023-08-10T10:50:12.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.538+0000 7fa4467ff700 1 -- 172.21.15.107:0/1023185184 wait complete. 2023-08-10T10:50:12.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:12.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.758+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/75530993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8100770 msgr2=0x7fe5d8100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.758+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/75530993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8100770 0x7fe5d8100b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80099c0 tx=0x7fe5c8009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.758+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/75530993 shutdown_connections 2023-08-10T10:50:12.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.758+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/75530993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5d8102300 0x7fe5d8108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.758+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/75530993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8100770 0x7fe5d8100b90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.758+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/75530993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5d8101960 0x7fe5d8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.758+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/75530993 >> 172.21.15.107:0/75530993 conn(0x7fe5d80fbca0 msgr2=0x7fe5d80fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:12.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.758+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/75530993 shutdown_connections 2023-08-10T10:50:12.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.758+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/75530993 wait complete. 2023-08-10T10:50:12.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.759+0000 7fe5dd1ff700 1 Processor -- start 2023-08-10T10:50:12.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.759+0000 7fe5dd1ff700 1 -- start start 2023-08-10T10:50:12.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.759+0000 7fe5dd1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5d8100770 0x7fe5d8196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.759+0000 7fe5dd1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5d8101960 0x7fe5d8196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.759+0000 7fe5dd1ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8102300 0x7fe5d819d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.759+0000 7fe5dd1ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d819dea0 con 0x7fe5d8102300 2023-08-10T10:50:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.759+0000 7fe5dd1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d819dfe0 con 0x7fe5d8101960 2023-08-10T10:50:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.759+0000 7fe5dd1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d819e170 con 0x7fe5d8100770 2023-08-10T10:50:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d759e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8102300 0x7fe5d819d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d759e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8102300 0x7fe5d819d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44960/0 (socket says 172.21.15.107:44960) 2023-08-10T10:50:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d759e700 1 -- 172.21.15.107:0/3271582229 learned_addr learned my addr 172.21.15.107:0/3271582229 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d6d9d700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5d8100770 0x7fe5d8196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d659c700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5d8101960 0x7fe5d8196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d759e700 1 -- 172.21.15.107:0/3271582229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5d8100770 msgr2=0x7fe5d8196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d759e700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5d8100770 0x7fe5d8196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d759e700 1 -- 172.21.15.107:0/3271582229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5d8101960 msgr2=0x7fe5d8196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:12.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d759e700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5d8101960 0x7fe5d8196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:12.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.760+0000 7fe5d759e700 1 -- 172.21.15.107:0/3271582229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80095f0 con 0x7fe5d8102300 2023-08-10T10:50:12.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.761+0000 7fe5d759e700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8102300 0x7fe5d819d8d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0007ee0 tx=0x7fe5d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:12.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.761+0000 7fe5bffff700 1 -- 172.21.15.107:0/3271582229 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0017070 con 0x7fe5d8102300 2023-08-10T10:50:12.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.761+0000 7fe5bffff700 1 -- 172.21.15.107:0/3271582229 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5d000f040 con 0x7fe5d8102300 2023-08-10T10:50:12.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.761+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d819e450 con 0x7fe5d8102300 2023-08-10T10:50:12.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.761+0000 7fe5bffff700 1 -- 172.21.15.107:0/3271582229 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0005570 con 0x7fe5d8102300 2023-08-10T10:50:12.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.761+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d819e960 con 0x7fe5d8102300 2023-08-10T10:50:12.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.762+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d810be90 con 0x7fe5d8102300 2023-08-10T10:50:12.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.765+0000 7fe5bffff700 1 -- 172.21.15.107:0/3271582229 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fe5d000db20 con 0x7fe5d8102300 2023-08-10T10:50:12.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.766+0000 7fe5bffff700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5c00a12a0 0x7fe5c00a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:12.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.766+0000 7fe5bffff700 1 -- 172.21.15.107:0/3271582229 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fe5d00ccb10 con 0x7fe5d8102300 2023-08-10T10:50:12.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.766+0000 7fe5d6d9d700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5c00a12a0 0x7fe5c00a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:12.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.767+0000 7fe5d6d9d700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5c00a12a0 0x7fe5c00a3760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8006010 tx=0x7fe5c8005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:12.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:12.768+0000 7fe5bffff700 1 -- 172.21.15.107:0/3271582229 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe5d0095de0 con 0x7fe5d8102300 2023-08-10T10:50:12.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:12 smithi107 ceph-mon[127953]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T10:50:12.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:12 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]: dispatch 2023-08-10T10:50:12.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:12 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/421078948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:12 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1023185184' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:13.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.013+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5d8107670 con 0x7fe5d8102300 2023-08-10T10:50:13.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.014+0000 7fe5bffff700 1 -- 172.21.15.107:0/3271582229 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10914 (secure 0 0 0) 0x7fe5d0099400 con 0x7fe5d8102300 2023-08-10T10:50:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:13.015 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:49:16.643966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:50:13.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.016+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5c00a12a0 msgr2=0x7fe5c00a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.016+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5c00a12a0 0x7fe5c00a3760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8006010 tx=0x7fe5c8005e80 comp rx=0 tx=0).stop 2023-08-10T10:50:13.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.016+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8102300 msgr2=0x7fe5d819d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.016+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8102300 0x7fe5d819d8d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0007ee0 tx=0x7fe5d000d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.017+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 shutdown_connections 2023-08-10T10:50:13.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.017+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe5c00a12a0 0x7fe5c00a3760 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.017+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5d8102300 0x7fe5d819d8d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.017+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5d8100770 0x7fe5d8196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.017+0000 7fe5dd1ff700 1 --2- 172.21.15.107:0/3271582229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5d8101960 0x7fe5d8196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.017+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 >> 172.21.15.107:0/3271582229 conn(0x7fe5d80fbca0 msgr2=0x7fe5d80fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:13.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.017+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 shutdown_connections 2023-08-10T10:50:13.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.017+0000 7fe5dd1ff700 1 -- 172.21.15.107:0/3271582229 wait complete. 2023-08-10T10:50:13.020 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:50:13.037 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:12 smithi157 ceph-mon[129604]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T10:50:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:12 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]: dispatch 2023-08-10T10:50:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:12 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/421078948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:12 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1023185184' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:13.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:12 smithi195 ceph-mon[129938]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-08-10T10:50:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:12 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]: dispatch 2023-08-10T10:50:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:12 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/421078948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:12 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1023185184' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:13.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.233+0000 7f61eadff700 1 -- 172.21.15.107:0/4176685107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4102300 msgr2=0x7f61e4108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.233+0000 7f61eadff700 1 --2- 172.21.15.107:0/4176685107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4102300 0x7f61e4108bb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00b0d0 tx=0x7f61dc00b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.233+0000 7f61eadff700 1 -- 172.21.15.107:0/4176685107 shutdown_connections 2023-08-10T10:50:13.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.233+0000 7f61eadff700 1 --2- 172.21.15.107:0/4176685107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e4100770 0x7f61e4100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.233+0000 7f61eadff700 1 --2- 172.21.15.107:0/4176685107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4102300 0x7f61e4108bb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.233+0000 7f61eadff700 1 --2- 172.21.15.107:0/4176685107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61e4101960 0x7f61e4101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.233+0000 7f61eadff700 1 -- 172.21.15.107:0/4176685107 >> 172.21.15.107:0/4176685107 conn(0x7f61e40fbca0 msgr2=0x7f61e40fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:13.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.233+0000 7f61eadff700 1 -- 172.21.15.107:0/4176685107 shutdown_connections 2023-08-10T10:50:13.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.233+0000 7f61eadff700 1 -- 172.21.15.107:0/4176685107 wait complete. 2023-08-10T10:50:13.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.234+0000 7f61eadff700 1 Processor -- start 2023-08-10T10:50:13.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.234+0000 7f61eadff700 1 -- start start 2023-08-10T10:50:13.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.234+0000 7f61eadff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4100770 0x7f61e41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.234+0000 7f61eadff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61e4101960 0x7f61e4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.234+0000 7f61eadff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e4102300 0x7f61e419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.234+0000 7f61eadff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41a0050 con 0x7f61e4100770 2023-08-10T10:50:13.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.234+0000 7f61eadff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41a0190 con 0x7f61e4102300 2023-08-10T10:50:13.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.234+0000 7f61eadff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41a0320 con 0x7f61e4101960 2023-08-10T10:50:13.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e8b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4100770 0x7f61e41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e8b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4100770 0x7f61e41984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44410/0 (socket says 172.21.15.107:44410) 2023-08-10T10:50:13.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e8b9b700 1 -- 172.21.15.107:0/3586884569 learned_addr learned my addr 172.21.15.107:0/3586884569 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:13.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e3fff700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61e4101960 0x7f61e4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e939c700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e4102300 0x7f61e419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e8b9b700 1 -- 172.21.15.107:0/3586884569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61e4101960 msgr2=0x7f61e4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e8b9b700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61e4101960 0x7f61e4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e8b9b700 1 -- 172.21.15.107:0/3586884569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e4102300 msgr2=0x7f61e419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e8b9b700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e4102300 0x7f61e419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e8b9b700 1 -- 172.21.15.107:0/3586884569 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc009d00 con 0x7f61e4100770 2023-08-10T10:50:13.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e8b9b700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4100770 0x7f61e41984d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c990 tx=0x7f61d800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:13.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e1ffb700 1 -- 172.21.15.107:0/3586884569 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8007940 con 0x7f61e4100770 2023-08-10T10:50:13.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.235+0000 7f61e1ffb700 1 -- 172.21.15.107:0/3586884569 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61d800f450 con 0x7f61e4100770 2023-08-10T10:50:13.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.236+0000 7f61e1ffb700 1 -- 172.21.15.107:0/3586884569 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8018660 con 0x7f61e4100770 2023-08-10T10:50:13.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.236+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e41a0600 con 0x7f61e4100770 2023-08-10T10:50:13.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.236+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e41a0ac0 con 0x7f61e4100770 2023-08-10T10:50:13.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.237+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e410be30 con 0x7f61e4100770 2023-08-10T10:50:13.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.239+0000 7f61e1ffb700 1 -- 172.21.15.107:0/3586884569 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f61d800f5c0 con 0x7f61e4100770 2023-08-10T10:50:13.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.240+0000 7f61e1ffb700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f61d40a1220 0x7f61d40a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.240+0000 7f61e1ffb700 1 -- 172.21.15.107:0/3586884569 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f61d80ccd20 con 0x7f61e4100770 2023-08-10T10:50:13.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.240+0000 7f61e3fff700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f61d40a1220 0x7f61d40a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.241+0000 7f61e3fff700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f61d40a1220 0x7f61d40a36e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f61d000ac50 tx=0x7f61d000a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:13.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.244+0000 7f61e1ffb700 1 -- 172.21.15.107:0/3586884569 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f61d8095f90 con 0x7f61e4100770 2023-08-10T10:50:13.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.442+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61e41a1160 con 0x7f61e4100770 2023-08-10T10:50:13.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.444+0000 7f61e1ffb700 1 -- 172.21.15.107:0/3586884569 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24563 (secure 0 0 0) 0x7f61d80995b0 con 0x7f61e4100770 2023-08-10T10:50:13.445 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:13.445 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":92,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:50:12.680000+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:13.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f61d40a1220 msgr2=0x7f61d40a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f61d40a1220 0x7f61d40a36e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f61d000ac50 tx=0x7f61d000a380 comp rx=0 tx=0).stop 2023-08-10T10:50:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4100770 msgr2=0x7f61e41984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4100770 0x7f61e41984d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c990 tx=0x7f61d800cca0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 shutdown_connections 2023-08-10T10:50:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f61d40a1220 0x7f61d40a36e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61e4102300 0x7f61e419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61e4100770 0x7f61e41984d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 --2- 172.21.15.107:0/3586884569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61e4101960 0x7f61e4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 >> 172.21.15.107:0/3586884569 conn(0x7f61e40fbca0 msgr2=0x7f61e4107110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 shutdown_connections 2023-08-10T10:50:13.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.446+0000 7f61eadff700 1 -- 172.21.15.107:0/3586884569 wait complete. 2023-08-10T10:50:13.466 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:50:13.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:50:13.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.670+0000 7f149a39d700 1 -- 172.21.15.107:0/72446137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 msgr2=0x7f1494108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.670+0000 7f149a39d700 1 --2- 172.21.15.107:0/72446137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 0x7f1494108a20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b0d0 tx=0x7f148c00b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.670+0000 7f149a39d700 1 -- 172.21.15.107:0/72446137 shutdown_connections 2023-08-10T10:50:13.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.670+0000 7f149a39d700 1 --2- 172.21.15.107:0/72446137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 0x7f1494108a20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.670+0000 7f149a39d700 1 --2- 172.21.15.107:0/72446137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941005e0 0x7f1494100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.670+0000 7f149a39d700 1 --2- 172.21.15.107:0/72446137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14941017d0 0x7f1494101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.670+0000 7f149a39d700 1 -- 172.21.15.107:0/72446137 >> 172.21.15.107:0/72446137 conn(0x7f14940fbb50 msgr2=0x7f14940fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:13.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.670+0000 7f149a39d700 1 -- 172.21.15.107:0/72446137 shutdown_connections 2023-08-10T10:50:13.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.670+0000 7f149a39d700 1 -- 172.21.15.107:0/72446137 wait complete. 2023-08-10T10:50:13.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.672+0000 7f149a39d700 1 Processor -- start 2023-08-10T10:50:13.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.672+0000 7f149a39d700 1 -- start start 2023-08-10T10:50:13.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.672+0000 7f149a39d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941005e0 0x7f1494196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.672+0000 7f149a39d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14941017d0 0x7f1494196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.672+0000 7f149a39d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 0x7f149419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.672+0000 7f149a39d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149419dd80 con 0x7f1494102170 2023-08-10T10:50:13.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.672+0000 7f149a39d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149419dec0 con 0x7f14941017d0 2023-08-10T10:50:13.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.672+0000 7f149a39d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149419e050 con 0x7f14941005e0 2023-08-10T10:50:13.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1499b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 0x7f149419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1499b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 0x7f149419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44426/0 (socket says 172.21.15.107:44426) 2023-08-10T10:50:13.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1499b9c700 1 -- 172.21.15.107:0/1861441694 learned_addr learned my addr 172.21.15.107:0/1861441694 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:13.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1498b9a700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14941017d0 0x7f1494196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f149939b700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941005e0 0x7f1494196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1499b9c700 1 -- 172.21.15.107:0/1861441694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941005e0 msgr2=0x7f1494196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1499b9c700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941005e0 0x7f1494196200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1499b9c700 1 -- 172.21.15.107:0/1861441694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14941017d0 msgr2=0x7f1494196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1499b9c700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14941017d0 0x7f1494196740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1499b9c700 1 -- 172.21.15.107:0/1861441694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c009d00 con 0x7f1494102170 2023-08-10T10:50:13.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f1499b9c700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 0x7f149419d7b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f148c009fd0 tx=0x7f148c00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:13.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.673+0000 7f148a7fc700 1 -- 172.21.15.107:0/1861441694 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00e040 con 0x7f1494102170 2023-08-10T10:50:13.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.674+0000 7f148a7fc700 1 -- 172.21.15.107:0/1861441694 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f148c00ce80 con 0x7f1494102170 2023-08-10T10:50:13.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.674+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149419e2d0 con 0x7f1494102170 2023-08-10T10:50:13.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.674+0000 7f148a7fc700 1 -- 172.21.15.107:0/1861441694 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0052a0 con 0x7f1494102170 2023-08-10T10:50:13.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.674+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149419e750 con 0x7f1494102170 2023-08-10T10:50:13.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.675+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1494107a80 con 0x7f1494102170 2023-08-10T10:50:13.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.677+0000 7f148a7fc700 1 -- 172.21.15.107:0/1861441694 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f148c01b450 con 0x7f1494102170 2023-08-10T10:50:13.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.678+0000 7f148a7fc700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f14800a1290 0x7f14800a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:13.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.678+0000 7f148a7fc700 1 -- 172.21.15.107:0/1861441694 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f148c0ce390 con 0x7f1494102170 2023-08-10T10:50:13.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.678+0000 7f149939b700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f14800a1290 0x7f14800a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:13.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.679+0000 7f149939b700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f14800a1290 0x7f14800a3750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1494101630 tx=0x7f1490009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:13.682 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.682+0000 7f148a7fc700 1 -- 172.21.15.107:0/1861441694 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f148c097690 con 0x7f1494102170 2023-08-10T10:50:13.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:13 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]': finished 2023-08-10T10:50:13.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:13 smithi107 ceph-mon[127953]: osdmap e92: 12 total, 12 up, 12 in 2023-08-10T10:50:13.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:13 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3271582229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:13.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:13 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3586884569' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:13.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.880+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f149402cb90 con 0x7f1494102170 2023-08-10T10:50:13.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.881+0000 7f148a7fc700 1 -- 172.21.15.107:0/1861441694 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f148c09acb0 con 0x7f1494102170 2023-08-10T10:50:13.882 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:50:13.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f14800a1290 msgr2=0x7f14800a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f14800a1290 0x7f14800a3750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1494101630 tx=0x7f1490009260 comp rx=0 tx=0).stop 2023-08-10T10:50:13.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 msgr2=0x7f149419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:13.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 0x7f149419d7b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f148c009fd0 tx=0x7f148c00cab0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 shutdown_connections 2023-08-10T10:50:13.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f14800a1290 0x7f14800a3750 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1494102170 0x7f149419d7b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941005e0 0x7f1494196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 --2- 172.21.15.107:0/1861441694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14941017d0 0x7f1494196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:13.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 >> 172.21.15.107:0/1861441694 conn(0x7f14940fbb50 msgr2=0x7f1494104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:13.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 shutdown_connections 2023-08-10T10:50:13.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:13.883+0000 7f149a39d700 1 -- 172.21.15.107:0/1861441694 wait complete. 2023-08-10T10:50:13.903 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:50:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:13 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]': finished 2023-08-10T10:50:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:13 smithi157 ceph-mon[129604]: osdmap e92: 12 total, 12 up, 12 in 2023-08-10T10:50:14.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:13 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3271582229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:14.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:13 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3586884569' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:14.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.101+0000 7f48419ff700 1 -- 172.21.15.107:0/3332672927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 msgr2=0x7f483c100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.101+0000 7f48419ff700 1 --2- 172.21.15.107:0/3332672927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 0x7f483c100b80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f482c0099c0 tx=0x7f482c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.101+0000 7f48419ff700 1 -- 172.21.15.107:0/3332672927 shutdown_connections 2023-08-10T10:50:14.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.101+0000 7f48419ff700 1 --2- 172.21.15.107:0/3332672927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c1022f0 0x7f483c108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.101+0000 7f48419ff700 1 --2- 172.21.15.107:0/3332672927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 0x7f483c100b80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.101+0000 7f48419ff700 1 --2- 172.21.15.107:0/3332672927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483c101950 0x7f483c101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.101+0000 7f48419ff700 1 -- 172.21.15.107:0/3332672927 >> 172.21.15.107:0/3332672927 conn(0x7f483c0fbcb0 msgr2=0x7f483c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:14.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.101+0000 7f48419ff700 1 -- 172.21.15.107:0/3332672927 shutdown_connections 2023-08-10T10:50:14.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.101+0000 7f48419ff700 1 -- 172.21.15.107:0/3332672927 wait complete. 2023-08-10T10:50:14.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.102+0000 7f48419ff700 1 Processor -- start 2023-08-10T10:50:14.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.102+0000 7f48419ff700 1 -- start start 2023-08-10T10:50:14.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f48419ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 0x7f483c196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f48419ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c101950 0x7f483c1968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f48419ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483c1022f0 0x7f483c19d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f48419ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c19df00 con 0x7f483c100760 2023-08-10T10:50:14.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f48419ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c19e040 con 0x7f483c101950 2023-08-10T10:50:14.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f48419ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c19e1d0 con 0x7f483c1022f0 2023-08-10T10:50:14.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 0x7f483c196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 0x7f483c196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44452/0 (socket says 172.21.15.107:44452) 2023-08-10T10:50:14.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483affd700 1 -- 172.21.15.107:0/950088903 learned_addr learned my addr 172.21.15.107:0/950088903 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:14.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483a7fc700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c101950 0x7f483c1968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483b7fe700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483c1022f0 0x7f483c19d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483affd700 1 -- 172.21.15.107:0/950088903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483c1022f0 msgr2=0x7f483c19d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483affd700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483c1022f0 0x7f483c19d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483affd700 1 -- 172.21.15.107:0/950088903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c101950 msgr2=0x7f483c1968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483affd700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c101950 0x7f483c1968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483affd700 1 -- 172.21.15.107:0/950088903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0095f0 con 0x7f483c100760 2023-08-10T10:50:14.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.103+0000 7f483a7fc700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c101950 0x7f483c1968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:14.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.104+0000 7f483affd700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 0x7f483c196380 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f482c0098e0 tx=0x7f482c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.104+0000 7f48409fd700 1 -- 172.21.15.107:0/950088903 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c01d070 con 0x7f483c100760 2023-08-10T10:50:14.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.104+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c19e450 con 0x7f483c100760 2023-08-10T10:50:14.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.104+0000 7f48409fd700 1 -- 172.21.15.107:0/950088903 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f482c004100 con 0x7f483c100760 2023-08-10T10:50:14.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.104+0000 7f48409fd700 1 -- 172.21.15.107:0/950088903 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c005270 con 0x7f483c100760 2023-08-10T10:50:14.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.104+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c19e870 con 0x7f483c100760 2023-08-10T10:50:14.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.105+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c107d40 con 0x7f483c100760 2023-08-10T10:50:14.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.107+0000 7f48409fd700 1 -- 172.21.15.107:0/950088903 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f482c0049a0 con 0x7f483c100760 2023-08-10T10:50:14.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.109+0000 7f48409fd700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48240a11e0 0x7f48240a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.109+0000 7f48409fd700 1 -- 172.21.15.107:0/950088903 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f482c0cdc70 con 0x7f483c100760 2023-08-10T10:50:14.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.109+0000 7f483a7fc700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48240a11e0 0x7f48240a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.110+0000 7f483a7fc700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48240a11e0 0x7f48240a36a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4830005950 tx=0x7f48300058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.113+0000 7f48409fd700 1 -- 172.21.15.107:0/950088903 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f482c096f70 con 0x7f483c100760 2023-08-10T10:50:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:13 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]': finished 2023-08-10T10:50:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:13 smithi195 ceph-mon[129938]: osdmap e92: 12 total, 12 up, 12 in 2023-08-10T10:50:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:13 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3271582229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:13 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3586884569' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:14.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.311+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f483c02cbc0 con 0x7f483c100760 2023-08-10T10:50:14.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.311+0000 7f48409fd700 1 -- 172.21.15.107:0/950088903 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f482c0163a0 con 0x7f483c100760 2023-08-10T10:50:14.312 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:14.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48240a11e0 msgr2=0x7f48240a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48240a11e0 0x7f48240a36a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4830005950 tx=0x7f48300058e0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 msgr2=0x7f483c196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 0x7f483c196380 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f482c0098e0 tx=0x7f482c009580 comp rx=0 tx=0).stop 2023-08-10T10:50:14.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 shutdown_connections 2023-08-10T10:50:14.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f48240a11e0 0x7f48240a36a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f483c1022f0 0x7f483c19d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f483c100760 0x7f483c196380 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 --2- 172.21.15.107:0/950088903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f483c101950 0x7f483c1968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.313+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 >> 172.21.15.107:0/950088903 conn(0x7f483c0fbcb0 msgr2=0x7f483c104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:14.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.314+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 shutdown_connections 2023-08-10T10:50:14.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.314+0000 7f48419ff700 1 -- 172.21.15.107:0/950088903 wait complete. 2023-08-10T10:50:14.333 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:50:14.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.532+0000 7fcb743ff700 1 -- 172.21.15.107:0/3360688336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c108610 msgr2=0x7fcb6c10aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.532+0000 7fcb743ff700 1 --2- 172.21.15.107:0/3360688336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c108610 0x7fcb6c10aaa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400b0a0 tx=0x7fcb6400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.532+0000 7fcb743ff700 1 -- 172.21.15.107:0/3360688336 shutdown_connections 2023-08-10T10:50:14.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.532+0000 7fcb743ff700 1 --2- 172.21.15.107:0/3360688336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb6c074770 0x7fcb6c072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.532+0000 7fcb743ff700 1 --2- 172.21.15.107:0/3360688336 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c108610 0x7fcb6c10aaa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.532+0000 7fcb743ff700 1 --2- 172.21.15.107:0/3360688336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb6c073190 0x7fcb6c0735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.532+0000 7fcb743ff700 1 -- 172.21.15.107:0/3360688336 >> 172.21.15.107:0/3360688336 conn(0x7fcb6c0fbcb0 msgr2=0x7fcb6c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:14.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.532+0000 7fcb743ff700 1 -- 172.21.15.107:0/3360688336 shutdown_connections 2023-08-10T10:50:14.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.532+0000 7fcb743ff700 1 -- 172.21.15.107:0/3360688336 wait complete. 2023-08-10T10:50:14.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.533+0000 7fcb743ff700 1 Processor -- start 2023-08-10T10:50:14.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.534+0000 7fcb743ff700 1 -- start start 2023-08-10T10:50:14.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.534+0000 7fcb743ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c073190 0x7fcb6c103ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.534+0000 7fcb743ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb6c074770 0x7fcb6c104000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.534+0000 7fcb743ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb6c108610 0x7fcb6c100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.534+0000 7fcb743ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c100df0 con 0x7fcb6c073190 2023-08-10T10:50:14.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.534+0000 7fcb743ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c100f60 con 0x7fcb6c108610 2023-08-10T10:50:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.534+0000 7fcb743ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c101120 con 0x7fcb6c074770 2023-08-10T10:50:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7219b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c073190 0x7fcb6c103ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7219b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c073190 0x7fcb6c103ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44470/0 (socket says 172.21.15.107:44470) 2023-08-10T10:50:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7219b700 1 -- 172.21.15.107:0/1783882302 learned_addr learned my addr 172.21.15.107:0/1783882302 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:14.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7299c700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb6c108610 0x7fcb6c100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7219b700 1 -- 172.21.15.107:0/1783882302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb6c074770 msgr2=0x7fcb6c104000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:50:14.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7219b700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb6c074770 0x7fcb6c104000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7219b700 1 -- 172.21.15.107:0/1783882302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb6c108610 msgr2=0x7fcb6c100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7219b700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb6c108610 0x7fcb6c100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7219b700 1 -- 172.21.15.107:0/1783882302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68009520 con 0x7fcb6c073190 2023-08-10T10:50:14.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.535+0000 7fcb7299c700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb6c108610 0x7fcb6c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:50:14.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.536+0000 7fcb7219b700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c073190 0x7fcb6c103ac0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800eb30 tx=0x7fcb6800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.536+0000 7fcb637fe700 1 -- 172.21.15.107:0/1783882302 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68009880 con 0x7fcb6c073190 2023-08-10T10:50:14.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.536+0000 7fcb637fe700 1 -- 172.21.15.107:0/1783882302 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb680044b0 con 0x7fcb6c073190 2023-08-10T10:50:14.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.536+0000 7fcb637fe700 1 -- 172.21.15.107:0/1783882302 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68003df0 con 0x7fcb6c073190 2023-08-10T10:50:14.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.536+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb64009d00 con 0x7fcb6c073190 2023-08-10T10:50:14.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.536+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c1a4ec0 con 0x7fcb6c073190 2023-08-10T10:50:14.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.538+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c106d10 con 0x7fcb6c073190 2023-08-10T10:50:14.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.542+0000 7fcb637fe700 1 -- 172.21.15.107:0/1783882302 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fcb68003f50 con 0x7fcb6c073190 2023-08-10T10:50:14.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.543+0000 7fcb637fe700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb580a1260 0x7fcb580a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.543+0000 7fcb637fe700 1 -- 172.21.15.107:0/1783882302 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fcb68014070 con 0x7fcb6c073190 2023-08-10T10:50:14.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.543+0000 7fcb7199a700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb580a1260 0x7fcb580a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.544+0000 7fcb7199a700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb580a1260 0x7fcb580a3720 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c005fd0 tx=0x7fcb5c005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.547+0000 7fcb637fe700 1 -- 172.21.15.107:0/1783882302 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcb68096370 con 0x7fcb6c073190 2023-08-10T10:50:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.752+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb6c02cc20 con 0x7fcb6c073190 2023-08-10T10:50:14.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.752+0000 7fcb637fe700 1 -- 172.21.15.107:0/1783882302 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb68099990 con 0x7fcb6c073190 2023-08-10T10:50:14.754 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T10:50:14.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb580a1260 msgr2=0x7fcb580a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb580a1260 0x7fcb580a3720 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c005fd0 tx=0x7fcb5c005f60 comp rx=0 tx=0).stop 2023-08-10T10:50:14.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c073190 msgr2=0x7fcb6c103ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c073190 0x7fcb6c103ac0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800eb30 tx=0x7fcb6800ee40 comp rx=0 tx=0).stop 2023-08-10T10:50:14.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 shutdown_connections 2023-08-10T10:50:14.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb580a1260 0x7fcb580a3720 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb6c108610 0x7fcb6c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb6c073190 0x7fcb6c103ac0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 --2- 172.21.15.107:0/1783882302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb6c074770 0x7fcb6c104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 >> 172.21.15.107:0/1783882302 conn(0x7fcb6c0fbcb0 msgr2=0x7fcb6c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:14.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 shutdown_connections 2023-08-10T10:50:14.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.755+0000 7fcb743ff700 1 -- 172.21.15.107:0/1783882302 wait complete. 2023-08-10T10:50:14.775 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:50:14.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.983+0000 7f5fe239d700 1 -- 172.21.15.107:0/1344638829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 msgr2=0x7f5fdc101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.983+0000 7f5fe239d700 1 --2- 172.21.15.107:0/1344638829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 0x7f5fdc101c30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0099c0 tx=0x7f5fcc009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.983+0000 7f5fe239d700 1 -- 172.21.15.107:0/1344638829 shutdown_connections 2023-08-10T10:50:14.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.983+0000 7f5fe239d700 1 --2- 172.21.15.107:0/1344638829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fdc102170 0x7f5fdc108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.983+0000 7f5fe239d700 1 --2- 172.21.15.107:0/1344638829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fdc1005e0 0x7f5fdc100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.983+0000 7f5fe239d700 1 --2- 172.21.15.107:0/1344638829 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 0x7f5fdc101c30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.983+0000 7f5fe239d700 1 -- 172.21.15.107:0/1344638829 >> 172.21.15.107:0/1344638829 conn(0x7f5fdc0fbb50 msgr2=0x7f5fdc0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:14.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.983+0000 7f5fe239d700 1 -- 172.21.15.107:0/1344638829 shutdown_connections 2023-08-10T10:50:14.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.983+0000 7f5fe239d700 1 -- 172.21.15.107:0/1344638829 wait complete. 2023-08-10T10:50:14.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.984+0000 7f5fe239d700 1 Processor -- start 2023-08-10T10:50:14.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.984+0000 7f5fe239d700 1 -- start start 2023-08-10T10:50:14.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.984+0000 7f5fe239d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fdc1005e0 0x7f5fdc074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.984+0000 7f5fe239d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 0x7f5fdc072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.984+0000 7f5fe239d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fdc102170 0x7f5fdc0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.984+0000 7f5fe239d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc199fd0 con 0x7f5fdc1017d0 2023-08-10T10:50:14.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.984+0000 7f5fe239d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0735e0 con 0x7f5fdc1005e0 2023-08-10T10:50:14.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.984+0000 7f5fe239d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0737a0 con 0x7f5fdc102170 2023-08-10T10:50:14.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe0b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 0x7f5fdc072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe1b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fdc102170 0x7f5fdc0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe1b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fdc102170 0x7f5fdc0730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:46488/0 (socket says 172.21.15.107:46488) 2023-08-10T10:50:14.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe0b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 0x7f5fdc072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44484/0 (socket says 172.21.15.107:44484) 2023-08-10T10:50:14.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe1b9c700 1 -- 172.21.15.107:0/94537985 learned_addr learned my addr 172.21.15.107:0/94537985 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:14.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe139b700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fdc1005e0 0x7f5fdc074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe0b9a700 1 -- 172.21.15.107:0/94537985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fdc102170 msgr2=0x7f5fdc0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe0b9a700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fdc102170 0x7f5fdc0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe0b9a700 1 -- 172.21.15.107:0/94537985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fdc1005e0 msgr2=0x7f5fdc074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:14.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe0b9a700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fdc1005e0 0x7f5fdc074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:14.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe0b9a700 1 -- 172.21.15.107:0/94537985 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0095f0 con 0x7f5fdc1017d0 2023-08-10T10:50:14.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.985+0000 7f5fe0b9a700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 0x7f5fdc072b60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009f50 tx=0x7f5fcc003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.986+0000 7f5fd27fc700 1 -- 172.21.15.107:0/94537985 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc01d070 con 0x7f5fdc1017d0 2023-08-10T10:50:14.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.986+0000 7f5fd27fc700 1 -- 172.21.15.107:0/94537985 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fcc004220 con 0x7f5fdc1017d0 2023-08-10T10:50:14.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.986+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc1a4980 con 0x7f5fdc1017d0 2023-08-10T10:50:14.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.986+0000 7f5fd27fc700 1 -- 172.21.15.107:0/94537985 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc022bf0 con 0x7f5fdc1017d0 2023-08-10T10:50:14.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.986+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc1a4cf0 con 0x7f5fdc1017d0 2023-08-10T10:50:14.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.987+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc107b00 con 0x7f5fdc1017d0 2023-08-10T10:50:14.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.989+0000 7f5fd27fc700 1 -- 172.21.15.107:0/94537985 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f5fcc022d50 con 0x7f5fdc1017d0 2023-08-10T10:50:14.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.990+0000 7f5fd27fc700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5fc80a1310 0x7f5fc80a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:14.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.990+0000 7f5fd27fc700 1 -- 172.21.15.107:0/94537985 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f5fcc0cdf50 con 0x7f5fdc1017d0 2023-08-10T10:50:14.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.990+0000 7f5fe139b700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5fc80a1310 0x7f5fc80a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:14.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.991+0000 7f5fe139b700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5fc80a1310 0x7f5fc80a37d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc101630 tx=0x7f5fd800a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:14.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:14.994+0000 7f5fd27fc700 1 -- 172.21.15.107:0/94537985 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5fcc097250 con 0x7f5fdc1017d0 2023-08-10T10:50:15.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:14 smithi157 ceph-mon[129604]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T10:50:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:14 smithi157 ceph-mon[129604]: osdmap e93: 12 total, 12 up, 12 in 2023-08-10T10:50:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:14 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1861441694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:14 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/950088903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:14 smithi107 ceph-mon[127953]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T10:50:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:14 smithi107 ceph-mon[127953]: osdmap e93: 12 total, 12 up, 12 in 2023-08-10T10:50:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:14 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1861441694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:15.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:14 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/950088903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:15.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:14 smithi195 ceph-mon[129938]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T10:50:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:14 smithi195 ceph-mon[129938]: osdmap e93: 12 total, 12 up, 12 in 2023-08-10T10:50:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:14 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1861441694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:14 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/950088903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:15.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.192+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5fdc02cbc0 con 0x7f5fdc1017d0 2023-08-10T10:50:15.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.192+0000 7f5fd27fc700 1 -- 172.21.15.107:0/94537985 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5fcc0270a0 con 0x7f5fdc1017d0 2023-08-10T10:50:15.193 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:15.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5fc80a1310 msgr2=0x7f5fc80a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5fc80a1310 0x7f5fc80a37d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc101630 tx=0x7f5fd800a3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 msgr2=0x7f5fdc072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 0x7f5fdc072b60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009f50 tx=0x7f5fcc003a50 comp rx=0 tx=0).stop 2023-08-10T10:50:15.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 shutdown_connections 2023-08-10T10:50:15.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5fc80a1310 0x7f5fc80a37d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fdc1005e0 0x7f5fdc074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fdc102170 0x7f5fdc0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 --2- 172.21.15.107:0/94537985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5fdc1017d0 0x7f5fdc072b60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 >> 172.21.15.107:0/94537985 conn(0x7f5fdc0fbb50 msgr2=0x7f5fdc104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:15.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 shutdown_connections 2023-08-10T10:50:15.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.195+0000 7f5fe239d700 1 -- 172.21.15.107:0/94537985 wait complete. 2023-08-10T10:50:15.214 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:15.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.411+0000 7f70f6dff700 1 -- 172.21.15.107:0/3562013484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 msgr2=0x7f70f0108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.411+0000 7f70f6dff700 1 --2- 172.21.15.107:0/3562013484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 0x7f70f0108bb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f70e800b0d0 tx=0x7f70e800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.411+0000 7f70f6dff700 1 -- 172.21.15.107:0/3562013484 shutdown_connections 2023-08-10T10:50:15.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.411+0000 7f70f6dff700 1 --2- 172.21.15.107:0/3562013484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 0x7f70f0108bb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.411+0000 7f70f6dff700 1 --2- 172.21.15.107:0/3562013484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70f0100770 0x7f70f0100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.411+0000 7f70f6dff700 1 --2- 172.21.15.107:0/3562013484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f0101960 0x7f70f0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.411+0000 7f70f6dff700 1 -- 172.21.15.107:0/3562013484 >> 172.21.15.107:0/3562013484 conn(0x7f70f00fbca0 msgr2=0x7f70f00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:15.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.411+0000 7f70f6dff700 1 -- 172.21.15.107:0/3562013484 shutdown_connections 2023-08-10T10:50:15.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.411+0000 7f70f6dff700 1 -- 172.21.15.107:0/3562013484 wait complete. 2023-08-10T10:50:15.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.412+0000 7f70f6dff700 1 Processor -- start 2023-08-10T10:50:15.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.412+0000 7f70f6dff700 1 -- start start 2023-08-10T10:50:15.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.412+0000 7f70f6dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f0100770 0x7f70f0074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.412+0000 7f70f6dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70f0101960 0x7f70f0072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.412+0000 7f70f6dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 0x7f70f00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.412+0000 7f70f6dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f019a330 con 0x7f70f0102300 2023-08-10T10:50:15.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.412+0000 7f70f6dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00735e0 con 0x7f70f0100770 2023-08-10T10:50:15.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.412+0000 7f70f6dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00737a0 con 0x7f70f0101960 2023-08-10T10:50:15.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f539c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 0x7f70f00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f539c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 0x7f70f00730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44512/0 (socket says 172.21.15.107:44512) 2023-08-10T10:50:15.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f539c700 1 -- 172.21.15.107:0/4142956148 learned_addr learned my addr 172.21.15.107:0/4142956148 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:15.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f4b9b700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f0100770 0x7f70f0074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70effff700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70f0101960 0x7f70f0072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f539c700 1 -- 172.21.15.107:0/4142956148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70f0101960 msgr2=0x7f70f0072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f539c700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70f0101960 0x7f70f0072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f539c700 1 -- 172.21.15.107:0/4142956148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f0100770 msgr2=0x7f70f0074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f539c700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f0100770 0x7f70f0074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f539c700 1 -- 172.21.15.107:0/4142956148 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8009d00 con 0x7f70f0102300 2023-08-10T10:50:15.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.413+0000 7f70f539c700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 0x7f70f00730a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009fd0 tx=0x7f70e800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.414+0000 7f70edffb700 1 -- 172.21.15.107:0/4142956148 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800e040 con 0x7f70f0102300 2023-08-10T10:50:15.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.414+0000 7f70edffb700 1 -- 172.21.15.107:0/4142956148 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70e80094c0 con 0x7f70f0102300 2023-08-10T10:50:15.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.414+0000 7f70f6dff700 1 -- 172.21.15.107:0/4142956148 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f01a4ce0 con 0x7f70f0102300 2023-08-10T10:50:15.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.414+0000 7f70edffb700 1 -- 172.21.15.107:0/4142956148 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80052a0 con 0x7f70f0102300 2023-08-10T10:50:15.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.414+0000 7f70f6dff700 1 -- 172.21.15.107:0/4142956148 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f01a5050 con 0x7f70f0102300 2023-08-10T10:50:15.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.415+0000 7f70db7fe700 1 -- 172.21.15.107:0/4142956148 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d00052f0 con 0x7f70f0102300 2023-08-10T10:50:15.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.417+0000 7f70edffb700 1 -- 172.21.15.107:0/4142956148 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f70e8005400 con 0x7f70f0102300 2023-08-10T10:50:15.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.419+0000 7f70edffb700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f70e00a1220 0x7f70e00a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.419+0000 7f70edffb700 1 -- 172.21.15.107:0/4142956148 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f70e80ce2b0 con 0x7f70f0102300 2023-08-10T10:50:15.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.419+0000 7f70f4b9b700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f70e00a1220 0x7f70e00a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.420+0000 7f70f4b9b700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f70e00a1220 0x7f70e00a36e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f70f01017c0 tx=0x7f70e4007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.423+0000 7f70edffb700 1 -- 172.21.15.107:0/4142956148 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f70e8097610 con 0x7f70f0102300 2023-08-10T10:50:15.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.663+0000 7f70db7fe700 1 -- 172.21.15.107:0/4142956148 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70d00059c0 con 0x7f70f0102300 2023-08-10T10:50:15.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.664+0000 7f70edffb700 1 -- 172.21.15.107:0/4142956148 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10914 (secure 0 0 0) 0x7f70e809ac30 con 0x7f70f0102300 2023-08-10T10:50:15.665 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:15.665 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:49:16.643966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:50:15.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 -- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f70e00a1220 msgr2=0x7f70e00a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f70e00a1220 0x7f70e00a36e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f70f01017c0 tx=0x7f70e4007400 comp rx=0 tx=0).stop 2023-08-10T10:50:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 -- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 msgr2=0x7f70f00730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 0x7f70f00730a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009fd0 tx=0x7f70e800ccc0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 -- 172.21.15.107:0/4142956148 shutdown_connections 2023-08-10T10:50:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f70e00a1220 0x7f70e00a36e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70f0100770 0x7f70f0074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70f0102300 0x7f70f00730a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 --2- 172.21.15.107:0/4142956148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70f0101960 0x7f70f0072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 -- 172.21.15.107:0/4142956148 >> 172.21.15.107:0/4142956148 conn(0x7f70f00fbca0 msgr2=0x7f70f0104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:15.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.666+0000 7f70db7fe700 1 -- 172.21.15.107:0/4142956148 shutdown_connections 2023-08-10T10:50:15.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.667+0000 7f70db7fe700 1 -- 172.21.15.107:0/4142956148 wait complete. 2023-08-10T10:50:15.669 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:50:15.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:15.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.885+0000 7fe8579ff700 1 -- 172.21.15.107:0/3530908732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850101970 msgr2=0x7fe850101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.885+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3530908732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850101970 0x7fe850101dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe8400099c0 tx=0x7fe840009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.885+0000 7fe8579ff700 1 -- 172.21.15.107:0/3530908732 shutdown_connections 2023-08-10T10:50:15.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.885+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3530908732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe850102310 0x7fe850108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.885+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3530908732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe850100780 0x7fe850100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.885+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3530908732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850101970 0x7fe850101dd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.885+0000 7fe8579ff700 1 -- 172.21.15.107:0/3530908732 >> 172.21.15.107:0/3530908732 conn(0x7fe8500fbcb0 msgr2=0x7fe8500fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:15.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.885+0000 7fe8579ff700 1 -- 172.21.15.107:0/3530908732 shutdown_connections 2023-08-10T10:50:15.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.885+0000 7fe8579ff700 1 -- 172.21.15.107:0/3530908732 wait complete. 2023-08-10T10:50:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.886+0000 7fe8579ff700 1 Processor -- start 2023-08-10T10:50:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.886+0000 7fe8579ff700 1 -- start start 2023-08-10T10:50:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.886+0000 7fe8579ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe850100780 0x7fe8501962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.886+0000 7fe8579ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe850101970 0x7fe850196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.886+0000 7fe8579ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850102310 0x7fe85019d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.886+0000 7fe8579ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85019de50 con 0x7fe850102310 2023-08-10T10:50:15.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.886+0000 7fe8579ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85019df90 con 0x7fe850101970 2023-08-10T10:50:15.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.886+0000 7fe8579ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85019e120 con 0x7fe850100780 2023-08-10T10:50:15.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe855f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850102310 0x7fe85019d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe855f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850102310 0x7fe85019d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44536/0 (socket says 172.21.15.107:44536) 2023-08-10T10:50:15.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe855f9c700 1 -- 172.21.15.107:0/3758174557 learned_addr learned my addr 172.21.15.107:0/3758174557 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:15.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe85579b700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe850100780 0x7fe8501962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe854f9a700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe850101970 0x7fe850196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe855f9c700 1 -- 172.21.15.107:0/3758174557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe850100780 msgr2=0x7fe8501962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe855f9c700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe850100780 0x7fe8501962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe855f9c700 1 -- 172.21.15.107:0/3758174557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe850101970 msgr2=0x7fe850196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe855f9c700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe850101970 0x7fe850196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe855f9c700 1 -- 172.21.15.107:0/3758174557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8400095f0 con 0x7fe850102310 2023-08-10T10:50:15.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe854f9a700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe850101970 0x7fe850196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe855f9c700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850102310 0x7fe85019d880 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b970 tx=0x7fe84800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe8467fc700 1 -- 172.21.15.107:0/3758174557 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800c930 con 0x7fe850102310 2023-08-10T10:50:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe8467fc700 1 -- 172.21.15.107:0/3758174557 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe848014440 con 0x7fe850102310 2023-08-10T10:50:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.887+0000 7fe8467fc700 1 -- 172.21.15.107:0/3758174557 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480075d0 con 0x7fe850102310 2023-08-10T10:50:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.888+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85019e400 con 0x7fe850102310 2023-08-10T10:50:15.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.888+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85019e8c0 con 0x7fe850102310 2023-08-10T10:50:15.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.889+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85010bec0 con 0x7fe850102310 2023-08-10T10:50:15.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.892+0000 7fe8467fc700 1 -- 172.21.15.107:0/3758174557 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fe8480145b0 con 0x7fe850102310 2023-08-10T10:50:15.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.894+0000 7fe8467fc700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe83c0a12a0 0x7fe83c0a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.894+0000 7fe8467fc700 1 -- 172.21.15.107:0/3758174557 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fe848006e40 con 0x7fe850102310 2023-08-10T10:50:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.894+0000 7fe85579b700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe83c0a12a0 0x7fe83c0a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:15.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.894+0000 7fe85579b700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe83c0a12a0 0x7fe83c0a3760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe8501017d0 tx=0x7fe84c00a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:15.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:15.895+0000 7fe8467fc700 1 -- 172.21.15.107:0/3758174557 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe848096070 con 0x7fe850102310 2023-08-10T10:50:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:15 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1783882302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:15 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/94537985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:15 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4142956148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:15 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1783882302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:15 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/94537985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:15 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4142956148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:16.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.095+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe85019ef60 con 0x7fe850102310 2023-08-10T10:50:16.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.096+0000 7fe8467fc700 1 -- 172.21.15.107:0/3758174557 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24563 (secure 0 0 0) 0x7fe848019020 con 0x7fe850102310 2023-08-10T10:50:16.098 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:16.098 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":93,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:50:13.687527+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe83c0a12a0 msgr2=0x7fe83c0a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe83c0a12a0 0x7fe83c0a3760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe8501017d0 tx=0x7fe84c00a3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850102310 msgr2=0x7fe85019d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850102310 0x7fe85019d880 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe84800b970 tx=0x7fe84800bc80 comp rx=0 tx=0).stop 2023-08-10T10:50:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 shutdown_connections 2023-08-10T10:50:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe83c0a12a0 0x7fe83c0a3760 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe850102310 0x7fe85019d880 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe850100780 0x7fe8501962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 --2- 172.21.15.107:0/3758174557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe850101970 0x7fe850196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 >> 172.21.15.107:0/3758174557 conn(0x7fe8500fbcb0 msgr2=0x7fe8500fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 shutdown_connections 2023-08-10T10:50:16.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.099+0000 7fe8579ff700 1 -- 172.21.15.107:0/3758174557 wait complete. 2023-08-10T10:50:16.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:16.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:15 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1783882302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:15 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/94537985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:15 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4142956148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.315+0000 7fb941fff700 1 -- 172.21.15.107:0/3803920184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c101970 msgr2=0x7fb93c101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.315+0000 7fb941fff700 1 --2- 172.21.15.107:0/3803920184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c101970 0x7fb93c101dd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb9300099c0 tx=0x7fb930009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.315+0000 7fb941fff700 1 -- 172.21.15.107:0/3803920184 shutdown_connections 2023-08-10T10:50:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.315+0000 7fb941fff700 1 --2- 172.21.15.107:0/3803920184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb93c102310 0x7fb93c108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.315+0000 7fb941fff700 1 --2- 172.21.15.107:0/3803920184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb93c100780 0x7fb93c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.315+0000 7fb941fff700 1 --2- 172.21.15.107:0/3803920184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c101970 0x7fb93c101dd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.315+0000 7fb941fff700 1 -- 172.21.15.107:0/3803920184 >> 172.21.15.107:0/3803920184 conn(0x7fb93c0fbcb0 msgr2=0x7fb93c0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.315+0000 7fb941fff700 1 -- 172.21.15.107:0/3803920184 shutdown_connections 2023-08-10T10:50:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.316+0000 7fb941fff700 1 -- 172.21.15.107:0/3803920184 wait complete. 2023-08-10T10:50:16.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.316+0000 7fb941fff700 1 Processor -- start 2023-08-10T10:50:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb941fff700 1 -- start start 2023-08-10T10:50:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb941fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb93c100780 0x7fb93c198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb941fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb93c101970 0x7fb93c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb941fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c102310 0x7fb93c19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb941fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c1a0110 con 0x7fb93c102310 2023-08-10T10:50:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb941fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c1a0250 con 0x7fb93c101970 2023-08-10T10:50:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb941fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c1a03e0 con 0x7fb93c100780 2023-08-10T10:50:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb93bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c102310 0x7fb93c19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb93affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb93c101970 0x7fb93c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb93bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c102310 0x7fb93c19fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44554/0 (socket says 172.21.15.107:44554) 2023-08-10T10:50:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb93bfff700 1 -- 172.21.15.107:0/1935806711 learned_addr learned my addr 172.21.15.107:0/1935806711 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.317+0000 7fb93b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb93c100780 0x7fb93c198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb93bfff700 1 -- 172.21.15.107:0/1935806711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb93c100780 msgr2=0x7fb93c198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb93bfff700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb93c100780 0x7fb93c198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb93bfff700 1 -- 172.21.15.107:0/1935806711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb93c101970 msgr2=0x7fb93c198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb93bfff700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb93c101970 0x7fb93c198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb93bfff700 1 -- 172.21.15.107:0/1935806711 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300095f0 con 0x7fb93c102310 2023-08-10T10:50:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb93bfff700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c102310 0x7fb93c19fb40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb934007ee0 tx=0x7fb93400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb938ff9700 1 -- 172.21.15.107:0/1935806711 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934017070 con 0x7fb93c102310 2023-08-10T10:50:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb938ff9700 1 -- 172.21.15.107:0/1935806711 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb93400f040 con 0x7fb93c102310 2023-08-10T10:50:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c1a06c0 con 0x7fb93c102310 2023-08-10T10:50:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb938ff9700 1 -- 172.21.15.107:0/1935806711 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934005570 con 0x7fb93c102310 2023-08-10T10:50:16.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.318+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c1a0bd0 con 0x7fb93c102310 2023-08-10T10:50:16.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.319+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c192c90 con 0x7fb93c102310 2023-08-10T10:50:16.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.321+0000 7fb938ff9700 1 -- 172.21.15.107:0/1935806711 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fb93400db20 con 0x7fb93c102310 2023-08-10T10:50:16.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.323+0000 7fb938ff9700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9240a12a0 0x7fb9240a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.323+0000 7fb938ff9700 1 -- 172.21.15.107:0/1935806711 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fb9340cc4a0 con 0x7fb93c102310 2023-08-10T10:50:16.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.323+0000 7fb93b7fe700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9240a12a0 0x7fb9240a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.323+0000 7fb93b7fe700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9240a12a0 0x7fb9240a3760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb93c1017d0 tx=0x7fb92c007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.326+0000 7fb938ff9700 1 -- 172.21.15.107:0/1935806711 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb934095710 con 0x7fb93c102310 2023-08-10T10:50:16.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.569+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb93c02c970 con 0x7fb93c102310 2023-08-10T10:50:16.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.570+0000 7fb938ff9700 1 -- 172.21.15.107:0/1935806711 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10914 (secure 0 0 0) 0x7fb934098d30 con 0x7fb93c102310 2023-08-10T10:50:16.571 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:16.571 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:49:16.643966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:50:16.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9240a12a0 msgr2=0x7fb9240a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9240a12a0 0x7fb9240a3760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb93c1017d0 tx=0x7fb92c007400 comp rx=0 tx=0).stop 2023-08-10T10:50:16.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c102310 msgr2=0x7fb93c19fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c102310 0x7fb93c19fb40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb934007ee0 tx=0x7fb93400d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 shutdown_connections 2023-08-10T10:50:16.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9240a12a0 0x7fb9240a3760 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb93c102310 0x7fb93c19fb40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb93c100780 0x7fb93c198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 --2- 172.21.15.107:0/1935806711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb93c101970 0x7fb93c198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 >> 172.21.15.107:0/1935806711 conn(0x7fb93c0fbcb0 msgr2=0x7fb93c1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 shutdown_connections 2023-08-10T10:50:16.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.572+0000 7fb941fff700 1 -- 172.21.15.107:0/1935806711 wait complete. 2023-08-10T10:50:16.575 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:50:16.593 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-08-10T10:48:42.135183+0000', 'modified': '2023-08-10T10:49:16.643966+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24575, 'mds_1': 24571, 'mds_2': 24532, 'mds_3': 24497, 'mds_4': 24469}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14592': {'gid': 14592, 'name': 'd', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6837/1989272471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6836', 'nonce': 1989272471}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 1989272471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14670': {'gid': 14670, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6839/1945342668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 1945342668}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 1945342668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14682': {'gid': 14682, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6841/718281985', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6840', 'nonce': 718281985}, {'type': 'v1', 'addr': '172.21.15.107:6841', 'nonce': 718281985}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24469': {'gid': 24469, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.195:6833/3699521074', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 3699521074}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 3699521074}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.157:6835/1674728866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 1674728866}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 1674728866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24532': {'gid': 24532, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.195:6835/3324910460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 3324910460}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 3324910460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24536': {'gid': 24536, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6837/2089201911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 2089201911}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 2089201911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24550': {'gid': 24550, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6837/2175306413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 2175306413}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 2175306413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24571': {'gid': 24571, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.195:6839/1633036352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 1633036352}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 1633036352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6839/2476404740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 2476404740}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 2476404740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:50:16.593 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-08-10T10:50:16.594 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2023-08-10T10:50:16.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.794+0000 7f58d99ff700 1 -- 172.21.15.107:0/876552415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4101970 msgr2=0x7f58d4101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.794+0000 7f58d99ff700 1 --2- 172.21.15.107:0/876552415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4101970 0x7f58d4101dd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f58c80099c0 tx=0x7f58c8009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.794+0000 7f58d99ff700 1 -- 172.21.15.107:0/876552415 shutdown_connections 2023-08-10T10:50:16.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.794+0000 7f58d99ff700 1 --2- 172.21.15.107:0/876552415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d4100780 0x7f58d4100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.794+0000 7f58d99ff700 1 --2- 172.21.15.107:0/876552415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58d4102310 0x7f58d4108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.794+0000 7f58d99ff700 1 --2- 172.21.15.107:0/876552415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4101970 0x7f58d4101dd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.794+0000 7f58d99ff700 1 -- 172.21.15.107:0/876552415 >> 172.21.15.107:0/876552415 conn(0x7f58d40fbcf0 msgr2=0x7f58d40fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.794+0000 7f58d99ff700 1 -- 172.21.15.107:0/876552415 shutdown_connections 2023-08-10T10:50:16.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.795+0000 7f58d99ff700 1 -- 172.21.15.107:0/876552415 wait complete. 2023-08-10T10:50:16.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.795+0000 7f58d99ff700 1 Processor -- start 2023-08-10T10:50:16.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d99ff700 1 -- start start 2023-08-10T10:50:16.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d99ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d4100780 0x7f58d41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d99ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58d4101970 0x7f58d4198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d99ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4102310 0x7f58d419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d99ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d41a0160 con 0x7f58d4102310 2023-08-10T10:50:16.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d99ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d41a02a0 con 0x7f58d4100780 2023-08-10T10:50:16.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d99ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d41a0430 con 0x7f58d4101970 2023-08-10T10:50:16.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4102310 0x7f58d419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4102310 0x7f58d419fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44570/0 (socket says 172.21.15.107:44570) 2023-08-10T10:50:16.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d37fe700 1 -- 172.21.15.107:0/1840704055 learned_addr learned my addr 172.21.15.107:0/1840704055 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:16.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.796+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d4100780 0x7f58d41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d27fc700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58d4101970 0x7f58d4198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d37fe700 1 -- 172.21.15.107:0/1840704055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58d4101970 msgr2=0x7f58d4198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d37fe700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58d4101970 0x7f58d4198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d37fe700 1 -- 172.21.15.107:0/1840704055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d4100780 msgr2=0x7f58d41985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d37fe700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d4100780 0x7f58d41985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d37fe700 1 -- 172.21.15.107:0/1840704055 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80095f0 con 0x7f58d4102310 2023-08-10T10:50:16.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d37fe700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4102310 0x7f58d419fb90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f58cc007ee0 tx=0x7f58cc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d89fd700 1 -- 172.21.15.107:0/1840704055 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc017070 con 0x7f58d4102310 2023-08-10T10:50:16.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d89fd700 1 -- 172.21.15.107:0/1840704055 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58cc00f040 con 0x7f58d4102310 2023-08-10T10:50:16.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d99ff700 1 -- 172.21.15.107:0/1840704055 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d41a0710 con 0x7f58d4102310 2023-08-10T10:50:16.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d89fd700 1 -- 172.21.15.107:0/1840704055 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc005710 con 0x7f58d4102310 2023-08-10T10:50:16.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.797+0000 7f58d99ff700 1 -- 172.21.15.107:0/1840704055 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d41a0bd0 con 0x7f58d4102310 2023-08-10T10:50:16.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.800+0000 7f58d89fd700 1 -- 172.21.15.107:0/1840704055 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f58cc005870 con 0x7f58d4102310 2023-08-10T10:50:16.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.801+0000 7f58ed41db80 1 Processor -- start 2023-08-10T10:50:16.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58ed41db80 1 -- start start 2023-08-10T10:50:16.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dbf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 0x560a74dc0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dc0910 0x560a74dc0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58ed41db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74d3ad70 con 0x560a74dbf4f0 2023-08-10T10:50:16.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58ed41db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74d17540 con 0x560a74dc0910 2023-08-10T10:50:16.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58ed41db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74d14e60 con 0x560a74dbfe50 2023-08-10T10:50:16.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58d89fd700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f58bc0a11e0 0x7f58bc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58d89fd700 1 -- 172.21.15.107:0/1840704055 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f58cc0cc630 con 0x7f58d4102310 2023-08-10T10:50:16.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dbf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dbf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44578/0 (socket says 172.21.15.107:44578) 2023-08-10T10:50:16.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58d27fc700 1 -- 172.21.15.107:0/2066923532 learned_addr learned my addr 172.21.15.107:0/2066923532 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:16.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.802+0000 7f58d37fe700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f58bc0a11e0 0x7f58bc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/2066923532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 0x560a74dc0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58d27fc700 1 --2- 172.21.15.107:0/2066923532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dc0910 0x560a74dc0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58d27fc700 1 -- 172.21.15.107:0/2066923532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 msgr2=0x560a74dc0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:16.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58d27fc700 1 --2- 172.21.15.107:0/2066923532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 0x560a74dc0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58d27fc700 1 -- 172.21.15.107:0/2066923532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dc0910 msgr2=0x560a74dc0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:16.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58d27fc700 1 --2- 172.21.15.107:0/2066923532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dc0910 0x560a74dc0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58d27fc700 1 -- 172.21.15.107:0/2066923532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a74b915e0 con 0x560a74dbf4f0 2023-08-10T10:50:16.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58d37fe700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f58bc0a11e0 0x7f58bc0a36a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0a1480 tx=0x7f58cc007f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58d27fc700 1 --2- 172.21.15.107:0/2066923532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dbf910 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f58c80095c0 tx=0x7f58c8009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9dd225722aae9e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58b9ffb700 1 -- 172.21.15.107:0/2066923532 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c800bb00 con 0x560a74dbf4f0 2023-08-10T10:50:16.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58b9ffb700 1 -- 172.21.15.107:0/2066923532 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58c800bc60 con 0x560a74dbf4f0 2023-08-10T10:50:16.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.803+0000 7f58b9ffb700 1 -- 172.21.15.107:0/2066923532 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8003d50 con 0x560a74dbf4f0 2023-08-10T10:50:16.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.804+0000 7f58ed41db80 1 -- 172.21.15.107:0/2066923532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 msgr2=0x560a74dbf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.804+0000 7f58ed41db80 1 --2- 172.21.15.107:0/2066923532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dbf910 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f58c80095c0 tx=0x7f58c8009530 comp rx=0 tx=0).stop 2023-08-10T10:50:16.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.804+0000 7f58ed41db80 1 -- 172.21.15.107:0/2066923532 shutdown_connections 2023-08-10T10:50:16.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.804+0000 7f58ed41db80 1 --2- 172.21.15.107:0/2066923532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dc0910 0x560a74dc0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.804+0000 7f58ed41db80 1 --2- 172.21.15.107:0/2066923532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dbf910 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.804+0000 7f58ed41db80 1 --2- 172.21.15.107:0/2066923532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 0x560a74dc0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.804+0000 7f58ed41db80 1 -- 172.21.15.107:0/2066923532 >> 172.21.15.107:0/2066923532 conn(0x560a74d1cc80 msgr2=0x560a74dba280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.804+0000 7f58ed41db80 1 -- 172.21.15.107:0/2066923532 shutdown_connections 2023-08-10T10:50:16.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.804+0000 7f58ed41db80 1 -- 172.21.15.107:0/2066923532 wait complete. 2023-08-10T10:50:16.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.805+0000 7f58ed41db80 1 -- start start 2023-08-10T10:50:16.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.805+0000 7f58ed41db80 1 Processor -- start 2023-08-10T10:50:16.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 0x560a74dc94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dc0910 0x560a74dd04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58ed41db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74d10750 con 0x560a74dbf4f0 2023-08-10T10:50:16.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58ed41db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74cafa70 con 0x560a74dbfe50 2023-08-10T10:50:16.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58ed41db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74caf770 con 0x560a74dc0910 2023-08-10T10:50:16.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58ed41db80 10 client.0 _ll_register_callbacks cb 0x560a74cad630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:16.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44586/0 (socket says 172.21.15.107:44586) 2023-08-10T10:50:16.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58d27fc700 1 -- 172.21.15.107:0/3775643417 learned_addr learned my addr 172.21.15.107:0/3775643417 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:16.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 0x560a74dc94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.806+0000 7f58d27fc700 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dc0910 0x560a74dd04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58d27fc700 1 -- 172.21.15.107:0/3775643417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dc0910 msgr2=0x560a74dd04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:16.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58d27fc700 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dc0910 0x560a74dd04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58d27fc700 1 -- 172.21.15.107:0/3775643417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 msgr2=0x560a74dc94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:16.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58d27fc700 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 0x560a74dc94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58d27fc700 1 -- 172.21.15.107:0/3775643417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c8020040 con 0x560a74dbf4f0 2023-08-10T10:50:16.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 0x560a74dc94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:16.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58d27fc700 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8f60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58c800a010 tx=0x7f58c8019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65405988326c296a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:16.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3775643417 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8005510 con 0x560a74dbf4f0 2023-08-10T10:50:16.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58ed41db80 1 -- 172.21.15.107:0/3775643417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a74db2420 con 0x560a74dbf4f0 2023-08-10T10:50:16.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3775643417 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f58c800f460 con 0x560a74dbf4f0 2023-08-10T10:50:16.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3775643417 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58c8005670 con 0x560a74dbf4f0 2023-08-10T10:50:16.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58ed41db80 10 client.15261 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:16.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.807+0000 7f58ed41db80 1 -- 172.21.15.107:0/3775643417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560a74b3dd90 con 0x560a74dbf4f0 2023-08-10T10:50:16.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.808+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3775643417 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560a74db2420 con 0x560a74dbf4f0 2023-08-10T10:50:16.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.808+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3775643417 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f58c80265f0 con 0x560a74dbf4f0 2023-08-10T10:50:16.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.808+0000 7f58ed41db80 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:16.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.808+0000 7f58ed41db80 10 client.15261 resolve_mds: resolved name 'l' to daemon mds.l 2023-08-10T10:50:16.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.808+0000 7f58ed41db80 20 client.15261 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:16.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.808+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x560a74dd4350 0x560a74dd3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.808+0000 7f58ed41db80 4 client.15261 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:16.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.808+0000 7f58ed41db80 1 -- 172.21.15.107:0/3775643417 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a74d8e980 con 0x560a74dd4350 2023-08-10T10:50:16.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.808+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x560a74dd4350 0x560a74dd3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.809+0000 7f58b2ffd700 10 client.15261 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:50:16.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.809+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x560a74dd4350 0x560a74dd3410 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7825fe4dac1f3009 server_cookie=6b66a2b610efe105 in_seq=0 out_seq=0 2023-08-10T10:50:16.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3775643417 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560a74d8e980 con 0x560a74dd4350 2023-08-10T10:50:16.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58b2ffd700 10 client.15261 handle_command_reply: tid=0 2023-08-10T10:50:16.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 client.15261 shutdown 2023-08-10T10:50:16.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 -- 172.21.15.107:0/3775643417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 msgr2=0x560a74dc8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8f60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58c800a010 tx=0x7f58c8019040 comp rx=0 tx=0).stop 2023-08-10T10:50:16.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 -- 172.21.15.107:0/3775643417 shutdown_connections 2023-08-10T10:50:16.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x560a74dd4350 0x560a74dd3410 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dc0910 0x560a74dd04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8f60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3775643417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 0x560a74dc94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58b2ffd700 0 client.15261 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:50:16.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 -- 172.21.15.107:0/3775643417 >> 172.21.15.107:0/3775643417 conn(0x560a74d1cc80 msgr2=0x560a74db9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.810+0000 7f58ed41db80 1 -- 172.21.15.107:0/3775643417 shutdown_connections 2023-08-10T10:50:16.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.811+0000 7f58ed41db80 1 -- 172.21.15.107:0/3775643417 wait complete. 2023-08-10T10:50:16.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.811+0000 7f58ed41db80 20 client.15261 trim_cache size 0 max 16384 2023-08-10T10:50:16.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.828+0000 7f58ed41db80 1 Processor -- start 2023-08-10T10:50:16.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.828+0000 7f58ed41db80 1 -- start start 2023-08-10T10:50:16.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 0x560a74dd0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dc0910 0x560a74dc7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58ed41db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74b938d0 con 0x560a74dbf4f0 2023-08-10T10:50:16.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58ed41db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74dc9e60 con 0x560a74dbfe50 2023-08-10T10:50:16.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58ed41db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74dbb180 con 0x560a74dc0910 2023-08-10T10:50:16.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44594/0 (socket says 172.21.15.107:44594) 2023-08-10T10:50:16.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58d27fc700 1 -- 172.21.15.107:0/1183260525 learned_addr learned my addr 172.21.15.107:0/1183260525 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:16.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/1183260525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 0x560a74dd0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58d27fc700 1 -- 172.21.15.107:0/1183260525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dc0910 msgr2=0x560a74dc7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:16.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58d27fc700 1 --2- 172.21.15.107:0/1183260525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dc0910 0x560a74dc7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58d27fc700 1 -- 172.21.15.107:0/1183260525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 msgr2=0x560a74dd0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:16.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58d27fc700 1 --2- 172.21.15.107:0/1183260525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 0x560a74dd0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.829+0000 7f58d27fc700 1 -- 172.21.15.107:0/1183260525 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a74b26c10 con 0x560a74dbf4f0 2023-08-10T10:50:16.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58d27fc700 1 --2- 172.21.15.107:0/1183260525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8610 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f58c8005950 tx=0x7f58c8026aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc07a530c3c1a7d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ba7fc700 1 -- 172.21.15.107:0/1183260525 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c800b540 con 0x560a74dbf4f0 2023-08-10T10:50:16.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ba7fc700 1 -- 172.21.15.107:0/1183260525 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58c8026bd0 con 0x560a74dbf4f0 2023-08-10T10:50:16.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ba7fc700 1 -- 172.21.15.107:0/1183260525 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8032340 con 0x560a74dbf4f0 2023-08-10T10:50:16.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ed41db80 1 -- 172.21.15.107:0/1183260525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 msgr2=0x560a74dc8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ed41db80 1 --2- 172.21.15.107:0/1183260525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8610 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f58c8005950 tx=0x7f58c8026aa0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ed41db80 1 -- 172.21.15.107:0/1183260525 shutdown_connections 2023-08-10T10:50:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ed41db80 1 --2- 172.21.15.107:0/1183260525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dc0910 0x560a74dc7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ed41db80 1 --2- 172.21.15.107:0/1183260525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dbf4f0 0x560a74dc8610 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ed41db80 1 --2- 172.21.15.107:0/1183260525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbfe50 0x560a74dd0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ed41db80 1 -- 172.21.15.107:0/1183260525 >> 172.21.15.107:0/1183260525 conn(0x560a74d1cc80 msgr2=0x560a74dba250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.830+0000 7f58ed41db80 1 -- 172.21.15.107:0/1183260525 shutdown_connections 2023-08-10T10:50:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.831+0000 7f58ed41db80 1 -- 172.21.15.107:0/1183260525 wait complete. 2023-08-10T10:50:16.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.831+0000 7f58ed41db80 1 -- start start 2023-08-10T10:50:16.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.831+0000 7f58ed41db80 1 Processor -- start 2023-08-10T10:50:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.831+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbf4f0 0x560a74dcaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.831+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 0x560a74dcb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.831+0000 7f58ed41db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dc0910 0x560a74dcfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.831+0000 7f58ed41db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74dd03b0 con 0x560a74dc0910 2023-08-10T10:50:16.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.831+0000 7f58ed41db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74dd0520 con 0x560a74dbf4f0 2023-08-10T10:50:16.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.831+0000 7f58ed41db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a74dd06e0 con 0x560a74dbfe50 2023-08-10T10:50:16.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58ed41db80 10 client.0 _ll_register_callbacks cb 0x560a74cad630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:16.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dc0910 0x560a74dcfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dc0910 0x560a74dcfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44608/0 (socket says 172.21.15.107:44608) 2023-08-10T10:50:16.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 -- 172.21.15.107:0/3649986127 learned_addr learned my addr 172.21.15.107:0/3649986127 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:16.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 0x560a74dcb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbf4f0 0x560a74dcaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 -- 172.21.15.107:0/3649986127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 msgr2=0x560a74dcb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:16.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 0x560a74dcb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 -- 172.21.15.107:0/3649986127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbf4f0 msgr2=0x560a74dcaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:16.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbf4f0 0x560a74dcaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 -- 172.21.15.107:0/3649986127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a74b3dd90 con 0x560a74dc0910 2023-08-10T10:50:16.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58d27fc700 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dc0910 0x560a74dcfe70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x560a74dcbde0 tx=0x7f58c8036040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a44b55460a85d2d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.832+0000 7f58b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3649986127 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8032550 con 0x560a74dc0910 2023-08-10T10:50:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58ed41db80 1 -- 172.21.15.107:0/3649986127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58c800bc60 con 0x560a74dc0910 2023-08-10T10:50:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3649986127 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f58c8048060 con 0x560a74dc0910 2023-08-10T10:50:16.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3649986127 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58c80263f0 con 0x560a74dc0910 2023-08-10T10:50:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58ed41db80 10 client.15267 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58ed41db80 1 -- 172.21.15.107:0/3649986127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560a74b64200 con 0x560a74dc0910 2023-08-10T10:50:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3649986127 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58c800bc60 con 0x560a74dc0910 2023-08-10T10:50:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3649986127 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f58c800f460 con 0x560a74dc0910 2023-08-10T10:50:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58ed41db80 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58ed41db80 10 client.15267 resolve_mds: resolved name 'l' to daemon mds.l 2023-08-10T10:50:16.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58ed41db80 20 client.15267 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x560a74e2bef0 0x560a74e288d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58ed41db80 4 client.15267 mds_command: new command op to 24469 tid=0[{"prefix": "status"}] 2023-08-10T10:50:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.833+0000 7f58ed41db80 1 -- 172.21.15.107:0/3649986127 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560a74d09730 con 0x560a74e2bef0 2023-08-10T10:50:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.834+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x560a74e2bef0 0x560a74e288d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.834+0000 7f58d2ffd700 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x560a74e2bef0 0x560a74e288d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=66362c94c47a9183 server_cookie=92839c25b2f4b52b in_seq=0 out_seq=0 2023-08-10T10:50:16.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.834+0000 7f58b2ffd700 10 client.15267 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:50:16.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58b2ffd700 1 -- 172.21.15.107:0/3649986127 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x560a74d09730 con 0x560a74e2bef0 2023-08-10T10:50:16.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58b2ffd700 10 client.15267 handle_command_reply: tid=0 2023-08-10T10:50:16.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 client.15267 shutdown 2023-08-10T10:50:16.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 -- 172.21.15.107:0/3649986127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dc0910 msgr2=0x560a74dcfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dc0910 0x560a74dcfe70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x560a74dcbde0 tx=0x7f58c8036040 comp rx=0 tx=0).stop 2023-08-10T10:50:16.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 -- 172.21.15.107:0/3649986127 shutdown_connections 2023-08-10T10:50:16.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x560a74e2bef0 0x560a74e288d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a74dbf4f0 0x560a74dcaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a74dc0910 0x560a74dcfe70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58b2ffd700 0 client.15267 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:50:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 --2- 172.21.15.107:0/3649986127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a74dbfe50 0x560a74dcb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 -- 172.21.15.107:0/3649986127 >> 172.21.15.107:0/3649986127 conn(0x560a74d1cc80 msgr2=0x560a74dc8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 -- 172.21.15.107:0/3649986127 shutdown_connections 2023-08-10T10:50:16.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 1 -- 172.21.15.107:0/3649986127 wait complete. 2023-08-10T10:50:16.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.835+0000 7f58ed41db80 20 client.15267 trim_cache size 0 max 16384 2023-08-10T10:50:16.848 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:16.848 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:16.849 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 4, 2023-08-10T10:50:16.849 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24469, 2023-08-10T10:50:16.849 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:16.849 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:16.849 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:16.849 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 61.212082913000003, 2023-08-10T10:50:16.850 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:16.850 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:16.850 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:16.850 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 134.57634980899999 2023-08-10T10:50:16.850 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:16.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 -- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f58bc0a11e0 msgr2=0x7f58bc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f58bc0a11e0 0x7f58bc0a36a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0a1480 tx=0x7f58cc007f10 comp rx=0 tx=0).stop 2023-08-10T10:50:16.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 -- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4102310 msgr2=0x7f58d419fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:16.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4102310 0x7f58d419fb90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f58cc007ee0 tx=0x7f58cc00d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 -- 172.21.15.107:0/1840704055 shutdown_connections 2023-08-10T10:50:16.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f58bc0a11e0 0x7f58bc0a36a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d4100780 0x7f58d41985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f58d4102310 0x7f58d419fb90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 --2- 172.21.15.107:0/1840704055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58d4101970 0x7f58d4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:16.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 -- 172.21.15.107:0/1840704055 >> 172.21.15.107:0/1840704055 conn(0x7f58d40fbcf0 msgr2=0x7f58d40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:16.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 -- 172.21.15.107:0/1840704055 shutdown_connections 2023-08-10T10:50:16.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:16.836+0000 7f58d99ff700 1 -- 172.21.15.107:0/1840704055 wait complete. 2023-08-10T10:50:16.853 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:16 smithi107 ceph-mon[127953]: pgmap v355: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2023-08-10T10:50:16.853 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:16 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3758174557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:16.854 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:16 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1935806711' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:16.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-08-10T10:50:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:16 smithi157 ceph-mon[129604]: pgmap v355: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2023-08-10T10:50:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:16 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3758174557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:16 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1935806711' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:17.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.051+0000 7f99c79ff700 1 -- 172.21.15.107:0/1044727065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 msgr2=0x7f99c0108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.051+0000 7f99c79ff700 1 --2- 172.21.15.107:0/1044727065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 0x7f99c0108bc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f99b800b0d0 tx=0x7f99b800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.051+0000 7f99c79ff700 1 -- 172.21.15.107:0/1044727065 shutdown_connections 2023-08-10T10:50:17.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.051+0000 7f99c79ff700 1 --2- 172.21.15.107:0/1044727065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99c0100780 0x7f99c0100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.051+0000 7f99c79ff700 1 --2- 172.21.15.107:0/1044727065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 0x7f99c0108bc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.051+0000 7f99c79ff700 1 --2- 172.21.15.107:0/1044727065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c0101970 0x7f99c0101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.051+0000 7f99c79ff700 1 -- 172.21.15.107:0/1044727065 >> 172.21.15.107:0/1044727065 conn(0x7f99c00fbcf0 msgr2=0x7f99c00fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.051+0000 7f99c79ff700 1 -- 172.21.15.107:0/1044727065 shutdown_connections 2023-08-10T10:50:17.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.051+0000 7f99c79ff700 1 -- 172.21.15.107:0/1044727065 wait complete. 2023-08-10T10:50:17.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.052+0000 7f99c79ff700 1 Processor -- start 2023-08-10T10:50:17.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.052+0000 7f99c79ff700 1 -- start start 2023-08-10T10:50:17.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c79ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c0100780 0x7f99c0074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c79ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99c0101970 0x7f99c0072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c79ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 0x7f99c00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c79ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0073840 con 0x7f99c0102310 2023-08-10T10:50:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c79ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00739b0 con 0x7f99c0101970 2023-08-10T10:50:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c79ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c01a04a0 con 0x7f99c0100780 2023-08-10T10:50:17.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c5f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 0x7f99c00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c5f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 0x7f99c00730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44620/0 (socket says 172.21.15.107:44620) 2023-08-10T10:50:17.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c5f9c700 1 -- 172.21.15.107:0/879038372 learned_addr learned my addr 172.21.15.107:0/879038372 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c579b700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c0100780 0x7f99c0074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99c0101970 0x7f99c0072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c5f9c700 1 -- 172.21.15.107:0/879038372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c0100780 msgr2=0x7f99c0074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c5f9c700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c0100780 0x7f99c0074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c5f9c700 1 -- 172.21.15.107:0/879038372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99c0101970 msgr2=0x7f99c0072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c5f9c700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99c0101970 0x7f99c0072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.053+0000 7f99c5f9c700 1 -- 172.21.15.107:0/879038372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8009d00 con 0x7f99c0102310 2023-08-10T10:50:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.054+0000 7f99c5f9c700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 0x7f99c00730a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f99b8007870 tx=0x7f99b80078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.054+0000 7f99b67fc700 1 -- 172.21.15.107:0/879038372 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b800e040 con 0x7f99c0102310 2023-08-10T10:50:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.054+0000 7f99b67fc700 1 -- 172.21.15.107:0/879038372 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99b800be30 con 0x7f99c0102310 2023-08-10T10:50:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.054+0000 7f99c79ff700 1 -- 172.21.15.107:0/879038372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c01a0720 con 0x7f99c0102310 2023-08-10T10:50:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.054+0000 7f99b67fc700 1 -- 172.21.15.107:0/879038372 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b801b6c0 con 0x7f99c0102310 2023-08-10T10:50:17.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.054+0000 7f99c79ff700 1 -- 172.21.15.107:0/879038372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c01a0b40 con 0x7f99c0102310 2023-08-10T10:50:17.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.057+0000 7f99b67fc700 1 -- 172.21.15.107:0/879038372 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f99b8024410 con 0x7f99c0102310 2023-08-10T10:50:17.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.058+0000 7f99db23db80 1 Processor -- start 2023-08-10T10:50:17.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.058+0000 7f99db23db80 1 -- start start 2023-08-10T10:50:17.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99b67fc700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f99ac0a11e0 0x7f99ac0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99db23db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ec4f0 0x564ec17ec910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99db23db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ece50 0x564ec17ed380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99b67fc700 1 -- 172.21.15.107:0/879038372 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f99b80cdf40 con 0x7f99c0102310 2023-08-10T10:50:17.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99db23db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec17edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99db23db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec1767d70 con 0x564ec17ec4f0 2023-08-10T10:50:17.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99db23db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec1744540 con 0x564ec17ece50 2023-08-10T10:50:17.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99db23db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec1741e60 con 0x564ec17ed910 2023-08-10T10:50:17.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f99ac0a11e0 0x7f99ac0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c579b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ec4f0 0x564ec17ec910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c4f9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ece50 0x564ec17ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c579b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ec4f0 0x564ec17ec910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44632/0 (socket says 172.21.15.107:44632) 2023-08-10T10:50:17.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c579b700 1 -- 172.21.15.107:0/2626432511 learned_addr learned my addr 172.21.15.107:0/2626432511 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c579b700 1 -- 172.21.15.107:0/2626432511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 msgr2=0x564ec17edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c579b700 1 --2- 172.21.15.107:0/2626432511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec17edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c579b700 1 -- 172.21.15.107:0/2626432511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ece50 msgr2=0x564ec17ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c579b700 1 --2- 172.21.15.107:0/2626432511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ece50 0x564ec17ed380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.059+0000 7f99c579b700 1 -- 172.21.15.107:0/2626432511 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ec15be5e0 con 0x564ec17ec4f0 2023-08-10T10:50:17.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.060+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f99ac0a11e0 0x7f99ac0a36a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f99b0013510 tx=0x7f99b00098c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.060+0000 7f99c579b700 1 --2- 172.21.15.107:0/2626432511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ec4f0 0x564ec17ec910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009d30 tx=0x7f99bc011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a98c0c5bace1cb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.060+0000 7f99ab7fe700 1 -- 172.21.15.107:0/2626432511 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc004220 con 0x564ec17ec4f0 2023-08-10T10:50:17.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.060+0000 7f99ab7fe700 1 -- 172.21.15.107:0/2626432511 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99bc004380 con 0x564ec17ec4f0 2023-08-10T10:50:17.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.060+0000 7f99ab7fe700 1 -- 172.21.15.107:0/2626432511 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0197a0 con 0x564ec17ec4f0 2023-08-10T10:50:17.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 -- 172.21.15.107:0/2626432511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ec4f0 msgr2=0x564ec17ec910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 --2- 172.21.15.107:0/2626432511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ec4f0 0x564ec17ec910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009d30 tx=0x7f99bc011720 comp rx=0 tx=0).stop 2023-08-10T10:50:17.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 -- 172.21.15.107:0/2626432511 shutdown_connections 2023-08-10T10:50:17.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 --2- 172.21.15.107:0/2626432511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec17edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 --2- 172.21.15.107:0/2626432511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ec4f0 0x564ec17ec910 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 --2- 172.21.15.107:0/2626432511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ece50 0x564ec17ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 -- 172.21.15.107:0/2626432511 >> 172.21.15.107:0/2626432511 conn(0x564ec1749c80 msgr2=0x564ec17e7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 -- 172.21.15.107:0/2626432511 shutdown_connections 2023-08-10T10:50:17.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 -- 172.21.15.107:0/2626432511 wait complete. 2023-08-10T10:50:17.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.061+0000 7f99db23db80 1 -- start start 2023-08-10T10:50:17.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99db23db80 1 Processor -- start 2023-08-10T10:50:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99db23db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ec4f0 0x564ec17f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99db23db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99db23db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ed910 0x564ec17fd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99db23db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec173d750 con 0x564ec17ece50 2023-08-10T10:50:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99db23db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec16dca70 con 0x564ec17ed910 2023-08-10T10:50:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99db23db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec16dc770 con 0x564ec17ec4f0 2023-08-10T10:50:17.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99db23db80 10 client.0 _ll_register_callbacks cb 0x564ec16da630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99c4f9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99c4f9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44646/0 (socket says 172.21.15.107:44646) 2023-08-10T10:50:17.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99c4f9a700 1 -- 172.21.15.107:0/255959955 learned_addr learned my addr 172.21.15.107:0/255959955 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99c5f9c700 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ed910 0x564ec17fd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.062+0000 7f99c579b700 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ec4f0 0x564ec17f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99c4f9a700 1 -- 172.21.15.107:0/255959955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ec4f0 msgr2=0x564ec17f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ec4f0 0x564ec17f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99c4f9a700 1 -- 172.21.15.107:0/255959955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ed910 msgr2=0x564ec17fd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ed910 0x564ec17fd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99c4f9a700 1 -- 172.21.15.107:0/255959955 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc009960 con 0x564ec17ece50 2023-08-10T10:50:17.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f6500 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f99b000fb30 tx=0x7f99b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56420832b9777c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:17.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99a8ff9700 1 -- 172.21.15.107:0/255959955 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b001fa10 con 0x564ec17ece50 2023-08-10T10:50:17.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99db23db80 1 -- 172.21.15.107:0/255959955 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ec17df420 con 0x564ec17ece50 2023-08-10T10:50:17.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99a8ff9700 1 -- 172.21.15.107:0/255959955 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f99b000fe40 con 0x564ec17ece50 2023-08-10T10:50:17.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99a8ff9700 1 -- 172.21.15.107:0/255959955 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b001fb70 con 0x564ec17ece50 2023-08-10T10:50:17.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.063+0000 7f99db23db80 10 client.15279 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:17.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.064+0000 7f99db23db80 1 -- 172.21.15.107:0/255959955 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564ec156ad90 con 0x564ec17ece50 2023-08-10T10:50:17.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.064+0000 7f99a8ff9700 1 -- 172.21.15.107:0/255959955 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564ec17df420 con 0x564ec17ece50 2023-08-10T10:50:17.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.064+0000 7f99a8ff9700 1 -- 172.21.15.107:0/255959955 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f99b0029c40 con 0x564ec17ece50 2023-08-10T10:50:17.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.064+0000 7f99db23db80 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:17.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.064+0000 7f99db23db80 10 client.15279 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-10T10:50:17.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.064+0000 7f99db23db80 20 client.15279 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:17.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.064+0000 7f99db23db80 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x564ec1801240 0x564ec1800640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.064+0000 7f99db23db80 4 client.15279 mds_command: new command op to 24497 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:17.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.064+0000 7f99db23db80 1 -- 172.21.15.107:0/255959955 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ec17bb980 con 0x564ec1801240 2023-08-10T10:50:17.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.065+0000 7f99c579b700 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x564ec1801240 0x564ec1800640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.065+0000 7f99a8ff9700 10 client.15279 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:50:17.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.065+0000 7f99c579b700 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x564ec1801240 0x564ec1800640 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8c6fe60e5b14474a server_cookie=bffb63ada2afac6a in_seq=0 out_seq=0 2023-08-10T10:50:17.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.066+0000 7f99a8ff9700 1 -- 172.21.15.107:0/255959955 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564ec17bb980 con 0x564ec1801240 2023-08-10T10:50:17.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.066+0000 7f99a8ff9700 10 client.15279 handle_command_reply: tid=0 2023-08-10T10:50:17.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.066+0000 7f99db23db80 1 client.15279 shutdown 2023-08-10T10:50:17.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.066+0000 7f99db23db80 1 -- 172.21.15.107:0/255959955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 msgr2=0x564ec17f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.066+0000 7f99db23db80 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f6500 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f99b000fb30 tx=0x7f99b00047c0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99db23db80 1 -- 172.21.15.107:0/255959955 shutdown_connections 2023-08-10T10:50:17.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99db23db80 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x564ec1801240 0x564ec1800640 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99db23db80 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ed910 0x564ec17fd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99a8ff9700 0 client.15279 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:50:17.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99db23db80 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ec4f0 0x564ec17f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99db23db80 1 --2- 172.21.15.107:0/255959955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f6500 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99db23db80 1 -- 172.21.15.107:0/255959955 >> 172.21.15.107:0/255959955 conn(0x564ec1749c80 msgr2=0x564ec17e6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99db23db80 1 -- 172.21.15.107:0/255959955 shutdown_connections 2023-08-10T10:50:17.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99db23db80 1 -- 172.21.15.107:0/255959955 wait complete. 2023-08-10T10:50:17.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.067+0000 7f99db23db80 20 client.15279 trim_cache size 0 max 16384 2023-08-10T10:50:17.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.084+0000 7f99db23db80 1 Processor -- start 2023-08-10T10:50:17.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99db23db80 1 -- start start 2023-08-10T10:50:17.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99db23db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99db23db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17fd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99db23db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec17f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99db23db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec15c08d0 con 0x564ec17ece50 2023-08-10T10:50:17.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99db23db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec17ff260 con 0x564ec17ec4f0 2023-08-10T10:50:17.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99db23db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec170b790 con 0x564ec17ed910 2023-08-10T10:50:17.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99c4f9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17fd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99c4f9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17fd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44654/0 (socket says 172.21.15.107:44654) 2023-08-10T10:50:17.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99c4f9a700 1 -- 172.21.15.107:0/965630976 learned_addr learned my addr 172.21.15.107:0/965630976 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99c579b700 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99c5f9c700 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec17f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99c4f9a700 1 -- 172.21.15.107:0/965630976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 msgr2=0x564ec17f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec17f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99c4f9a700 1 -- 172.21.15.107:0/965630976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 msgr2=0x564ec17f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.085+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.086+0000 7f99c4f9a700 1 -- 172.21.15.107:0/965630976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ec1553c10 con 0x564ec17ece50 2023-08-10T10:50:17.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.086+0000 7f99c5f9c700 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec17f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.086+0000 7f99c579b700 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:17.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.086+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17fd500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f99b0013db0 tx=0x7f99b0005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b83e3cfd1e4928 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.086+0000 7f99abfff700 1 -- 172.21.15.107:0/965630976 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b003a070 con 0x564ec17ece50 2023-08-10T10:50:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.086+0000 7f99abfff700 1 -- 172.21.15.107:0/965630976 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99b0011620 con 0x564ec17ece50 2023-08-10T10:50:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.086+0000 7f99abfff700 1 -- 172.21.15.107:0/965630976 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0011ac0 con 0x564ec17ece50 2023-08-10T10:50:17.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.086+0000 7f99db23db80 1 -- 172.21.15.107:0/965630976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 msgr2=0x564ec17fd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.086+0000 7f99db23db80 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17fd500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f99b0013db0 tx=0x7f99b0005980 comp rx=0 tx=0).stop 2023-08-10T10:50:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.087+0000 7f99db23db80 1 -- 172.21.15.107:0/965630976 shutdown_connections 2023-08-10T10:50:17.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.087+0000 7f99db23db80 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.087+0000 7f99db23db80 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec17f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.087+0000 7f99db23db80 1 --2- 172.21.15.107:0/965630976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17fd500 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.087+0000 7f99db23db80 1 -- 172.21.15.107:0/965630976 >> 172.21.15.107:0/965630976 conn(0x564ec1749c80 msgr2=0x564ec17f0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.087+0000 7f99db23db80 1 -- 172.21.15.107:0/965630976 shutdown_connections 2023-08-10T10:50:17.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.087+0000 7f99db23db80 1 -- 172.21.15.107:0/965630976 wait complete. 2023-08-10T10:50:17.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.087+0000 7f99db23db80 1 -- start start 2023-08-10T10:50:17.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.087+0000 7f99db23db80 1 Processor -- start 2023-08-10T10:50:17.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99db23db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99db23db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99db23db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec1854ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99db23db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec17f8fc0 con 0x564ec17ece50 2023-08-10T10:50:17.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99db23db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec18553e0 con 0x564ec17ec4f0 2023-08-10T10:50:17.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99db23db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ec18555a0 con 0x564ec17ed910 2023-08-10T10:50:17.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99db23db80 10 client.0 _ll_register_callbacks cb 0x564ec16da630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c4f9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c4f9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44662/0 (socket says 172.21.15.107:44662) 2023-08-10T10:50:17.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c4f9a700 1 -- 172.21.15.107:0/4265716596 learned_addr learned my addr 172.21.15.107:0/4265716596 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c5f9c700 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec1854ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c579b700 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c4f9a700 1 -- 172.21.15.107:0/4265716596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 msgr2=0x564ec1854ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec1854ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c4f9a700 1 -- 172.21.15.107:0/4265716596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 msgr2=0x564ec17f8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c4f9a700 1 -- 172.21.15.107:0/4265716596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b002e040 con 0x564ec17ece50 2023-08-10T10:50:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c5f9c700 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec1854ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.088+0000 7f99c579b700 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99c4f9a700 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f88d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f99b0004280 tx=0x7f99b0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb009d2b3ea9398 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:17.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99a8ff9700 1 -- 172.21.15.107:0/4265716596 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b003a040 con 0x564ec17ece50 2023-08-10T10:50:17.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99db23db80 1 -- 172.21.15.107:0/4265716596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99bc004380 con 0x564ec17ece50 2023-08-10T10:50:17.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99a8ff9700 1 -- 172.21.15.107:0/4265716596 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f99b0011c70 con 0x564ec17ece50 2023-08-10T10:50:17.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99a8ff9700 1 -- 172.21.15.107:0/4265716596 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b0004540 con 0x564ec17ece50 2023-08-10T10:50:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99db23db80 10 client.15285 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99db23db80 1 -- 172.21.15.107:0/4265716596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564ec1591200 con 0x564ec17ece50 2023-08-10T10:50:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99a8ff9700 1 -- 172.21.15.107:0/4265716596 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99bc004380 con 0x564ec17ece50 2023-08-10T10:50:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.089+0000 7f99a8ff9700 1 -- 172.21.15.107:0/4265716596 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f99b001f660 con 0x564ec17ece50 2023-08-10T10:50:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.090+0000 7f99db23db80 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.090+0000 7f99db23db80 10 client.15285 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-10T10:50:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.090+0000 7f99db23db80 20 client.15285 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.090+0000 7f99db23db80 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x564ec1859e90 0x564ec18567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.090+0000 7f99db23db80 4 client.15285 mds_command: new command op to 24497 tid=0[{"prefix": "status"}] 2023-08-10T10:50:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.090+0000 7f99db23db80 1 -- 172.21.15.107:0/4265716596 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564ec1736730 con 0x564ec1859e90 2023-08-10T10:50:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.090+0000 7f99c579b700 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x564ec1859e90 0x564ec18567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.091+0000 7f99a8ff9700 10 client.15285 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:50:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.091+0000 7f99c579b700 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x564ec1859e90 0x564ec18567c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5a698f6ca6e99fd9 server_cookie=3861214f001fcaf7 in_seq=0 out_seq=0 2023-08-10T10:50:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.091+0000 7f99a8ff9700 1 -- 172.21.15.107:0/4265716596 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x564ec1736730 con 0x564ec1859e90 2023-08-10T10:50:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.091+0000 7f99a8ff9700 10 client.15285 handle_command_reply: tid=0 2023-08-10T10:50:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.091+0000 7f99db23db80 1 client.15285 shutdown 2023-08-10T10:50:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 -- 172.21.15.107:0/4265716596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 msgr2=0x564ec17f88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f88d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f99b0004280 tx=0x7f99b0009260 comp rx=0 tx=0).stop 2023-08-10T10:50:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 -- 172.21.15.107:0/4265716596 shutdown_connections 2023-08-10T10:50:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x564ec1859e90 0x564ec18567c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564ec17ec4f0 0x564ec17f8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99a8ff9700 0 client.15285 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:50:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ec17ed910 0x564ec1854ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 --2- 172.21.15.107:0/4265716596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564ec17ece50 0x564ec17f88d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 -- 172.21.15.107:0/4265716596 >> 172.21.15.107:0/4265716596 conn(0x564ec1749c80 msgr2=0x564ec17f5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 -- 172.21.15.107:0/4265716596 shutdown_connections 2023-08-10T10:50:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 1 -- 172.21.15.107:0/4265716596 wait complete. 2023-08-10T10:50:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99db23db80 20 client.15285 trim_cache size 0 max 16384 2023-08-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 3, 2023-08-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24497, 2023-08-10T10:50:17.112 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:17.113 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:17.113 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:17.113 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 62.476194694, 2023-08-10T10:50:17.113 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:17.113 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:17.113 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:17.113 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 122.463521344 2023-08-10T10:50:17.113 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:17.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99c79ff700 1 -- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f99ac0a11e0 msgr2=0x7f99ac0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99c79ff700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f99ac0a11e0 0x7f99ac0a36a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f99b0013510 tx=0x7f99b00098c0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99c79ff700 1 -- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 msgr2=0x7f99c00730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.092+0000 7f99c79ff700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 0x7f99c00730a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f99b8007870 tx=0x7f99b80078a0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.093+0000 7f99c79ff700 1 -- 172.21.15.107:0/879038372 shutdown_connections 2023-08-10T10:50:17.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.093+0000 7f99c79ff700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f99ac0a11e0 0x7f99ac0a36a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.093+0000 7f99c79ff700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99c0102310 0x7f99c00730a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.093+0000 7f99c79ff700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99c0100780 0x7f99c0074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.093+0000 7f99c79ff700 1 --2- 172.21.15.107:0/879038372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99c0101970 0x7f99c0072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.093+0000 7f99c79ff700 1 -- 172.21.15.107:0/879038372 >> 172.21.15.107:0/879038372 conn(0x7f99c00fbcf0 msgr2=0x7f99c00fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.093+0000 7f99c79ff700 1 -- 172.21.15.107:0/879038372 shutdown_connections 2023-08-10T10:50:17.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.093+0000 7f99c79ff700 1 -- 172.21.15.107:0/879038372 wait complete. 2023-08-10T10:50:17.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-08-10T10:50:17.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:16 smithi195 ceph-mon[129938]: pgmap v355: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2023-08-10T10:50:17.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:16 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3758174557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:17.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:16 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1935806711' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:17.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.313+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/651637440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24100780 msgr2=0x7f4a24100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.313+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/651637440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24100780 0x7f4a24100ba0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4a140099c0 tx=0x7f4a14009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.313+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/651637440 shutdown_connections 2023-08-10T10:50:17.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.313+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/651637440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a24102310 0x7f4a24108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.313+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/651637440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24100780 0x7f4a24100ba0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.313+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/651637440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a24101970 0x7f4a24101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.313+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/651637440 >> 172.21.15.107:0/651637440 conn(0x7f4a240fbcf0 msgr2=0x7f4a240fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.314+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/651637440 shutdown_connections 2023-08-10T10:50:17.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.314+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/651637440 wait complete. 2023-08-10T10:50:17.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.315+0000 7f4a2a5ff700 1 Processor -- start 2023-08-10T10:50:17.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.315+0000 7f4a2a5ff700 1 -- start start 2023-08-10T10:50:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a2a5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a24100780 0x7f4a24196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a2a5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24101970 0x7f4a241968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a2a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a24102310 0x7f4a2419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a2a5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2419df10 con 0x7f4a24101970 2023-08-10T10:50:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a2a5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2419e050 con 0x7f4a24100780 2023-08-10T10:50:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a2a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2419e1e0 con 0x7f4a24102310 2023-08-10T10:50:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24101970 0x7f4a241968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24101970 0x7f4a241968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44672/0 (socket says 172.21.15.107:44672) 2023-08-10T10:50:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a237fe700 1 -- 172.21.15.107:0/2231884028 learned_addr learned my addr 172.21.15.107:0/2231884028 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a23fff700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a24100780 0x7f4a24196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a237fe700 1 -- 172.21.15.107:0/2231884028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a24102310 msgr2=0x7f4a2419d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a237fe700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a24102310 0x7f4a2419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a237fe700 1 -- 172.21.15.107:0/2231884028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a24100780 msgr2=0x7f4a24196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a237fe700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a24100780 0x7f4a24196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.316+0000 7f4a237fe700 1 -- 172.21.15.107:0/2231884028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140095f0 con 0x7f4a24101970 2023-08-10T10:50:17.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.317+0000 7f4a237fe700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24101970 0x7f4a241968d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800d950 tx=0x7f4a1800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.317+0000 7f4a217fa700 1 -- 172.21.15.107:0/2231884028 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180098c0 con 0x7f4a24101970 2023-08-10T10:50:17.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.317+0000 7f4a217fa700 1 -- 172.21.15.107:0/2231884028 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a18010460 con 0x7f4a24101970 2023-08-10T10:50:17.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.317+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/2231884028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2419e4c0 con 0x7f4a24101970 2023-08-10T10:50:17.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.317+0000 7f4a217fa700 1 -- 172.21.15.107:0/2231884028 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800f620 con 0x7f4a24101970 2023-08-10T10:50:17.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.317+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/2231884028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2419ea20 con 0x7f4a24101970 2023-08-10T10:50:17.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.322+0000 7f4a217fa700 1 -- 172.21.15.107:0/2231884028 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f4a180105d0 con 0x7f4a24101970 2023-08-10T10:50:17.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a3ded6b80 1 Processor -- start 2023-08-10T10:50:17.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a3ded6b80 1 -- start start 2023-08-10T10:50:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a217fa700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4a0c0a1260 0x7f4a0c0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0ef4f0 0x563c0a0ef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a217fa700 1 -- 172.21.15.107:0/2231884028 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4a180ccb80 con 0x7f4a24101970 2023-08-10T10:50:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0efe50 0x563c0a0f0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 0x563c0a0f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0a06ad70 con 0x563c0a0ef4f0 2023-08-10T10:50:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0a047540 con 0x563c0a0f0910 2023-08-10T10:50:17.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.323+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0a044e60 con 0x563c0a0efe50 2023-08-10T10:50:17.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a28b9c700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4a0c0a1260 0x7f4a0c0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a23fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0ef4f0 0x563c0a0ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a23fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0ef4f0 0x563c0a0ef910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44674/0 (socket says 172.21.15.107:44674) 2023-08-10T10:50:17.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a23fff700 1 -- 172.21.15.107:0/3026473997 learned_addr learned my addr 172.21.15.107:0/3026473997 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a28b9c700 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 0x563c0a0f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a237fe700 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0efe50 0x563c0a0f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a23fff700 1 -- 172.21.15.107:0/3026473997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0efe50 msgr2=0x563c0a0f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a23fff700 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0efe50 0x563c0a0f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a23fff700 1 -- 172.21.15.107:0/3026473997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 msgr2=0x563c0a0f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a23fff700 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 0x563c0a0f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a23fff700 1 -- 172.21.15.107:0/3026473997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c09ec15e0 con 0x563c0a0ef4f0 2023-08-10T10:50:17.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a28b9c700 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 0x563c0a0f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:17.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a28b9c700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4a0c0a1260 0x7f4a0c0a3720 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0060b0 tx=0x7f4a1c010af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.324+0000 7f4a23fff700 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0ef4f0 0x563c0a0ef910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400b580 tx=0x7f4a14005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da96c7dc57e3680 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.325+0000 7f4a0a7fc700 1 -- 172.21.15.107:0/3026473997 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400bb10 con 0x563c0a0ef4f0 2023-08-10T10:50:17.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.325+0000 7f4a0a7fc700 1 -- 172.21.15.107:0/3026473997 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a1401e040 con 0x563c0a0ef4f0 2023-08-10T10:50:17.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.325+0000 7f4a0a7fc700 1 -- 172.21.15.107:0/3026473997 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14003a50 con 0x563c0a0ef4f0 2023-08-10T10:50:17.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.325+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3026473997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0ef4f0 msgr2=0x563c0a0ef910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.325+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0ef4f0 0x563c0a0ef910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400b580 tx=0x7f4a14005c70 comp rx=0 tx=0).stop 2023-08-10T10:50:17.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.325+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3026473997 shutdown_connections 2023-08-10T10:50:17.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.325+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 0x563c0a0f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.325+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0ef4f0 0x563c0a0ef910 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.325+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3026473997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0efe50 0x563c0a0f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.326+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3026473997 >> 172.21.15.107:0/3026473997 conn(0x563c0a04cc80 msgr2=0x563c0a0ea280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.326+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3026473997 shutdown_connections 2023-08-10T10:50:17.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.326+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3026473997 wait complete. 2023-08-10T10:50:17.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.326+0000 7f4a3ded6b80 1 -- start start 2023-08-10T10:50:17.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.327+0000 7f4a3ded6b80 1 Processor -- start 2023-08-10T10:50:17.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.327+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 0x563c0a0f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.327+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.327+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 0x563c0a1004c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.327+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0a040750 con 0x563c0a0efe50 2023-08-10T10:50:17.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.327+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c09fdfa70 con 0x563c0a0ef4f0 2023-08-10T10:50:17.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.327+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c09fdf770 con 0x563c0a0f0910 2023-08-10T10:50:17.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.327+0000 7f4a3ded6b80 10 client.0 _ll_register_callbacks cb 0x563c09fdd630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.327+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44690/0 (socket says 172.21.15.107:44690) 2023-08-10T10:50:17.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a237fe700 1 -- 172.21.15.107:0/189513011 learned_addr learned my addr 172.21.15.107:0/189513011 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a23fff700 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 0x563c0a0f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a28b9c700 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 0x563c0a1004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a237fe700 1 -- 172.21.15.107:0/189513011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 msgr2=0x563c0a1004c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a237fe700 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 0x563c0a1004c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a237fe700 1 -- 172.21.15.107:0/189513011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 msgr2=0x563c0a0f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a237fe700 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 0x563c0a0f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a237fe700 1 -- 172.21.15.107:0/189513011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a24109510 con 0x563c0a0efe50 2023-08-10T10:50:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a28b9c700 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 0x563c0a1004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a237fe700 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f9480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800b2f0 tx=0x7f4a18099b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2be1335eec9fabd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a037fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:17.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a037fe700 1 -- 172.21.15.107:0/189513011 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180991a0 con 0x563c0a0efe50 2023-08-10T10:50:17.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/189513011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c0a0e2420 con 0x563c0a0efe50 2023-08-10T10:50:17.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.328+0000 7f4a037fe700 1 -- 172.21.15.107:0/189513011 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4a180a1a70 con 0x563c0a0efe50 2023-08-10T10:50:17.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a037fe700 1 -- 172.21.15.107:0/189513011 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a180b2200 con 0x563c0a0efe50 2023-08-10T10:50:17.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a3ded6b80 10 client.15297 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:17.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/189513011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563c09e6dd90 con 0x563c0a0efe50 2023-08-10T10:50:17.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a037fe700 1 -- 172.21.15.107:0/189513011 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563c0a0e2420 con 0x563c0a0efe50 2023-08-10T10:50:17.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a037fe700 1 -- 172.21.15.107:0/189513011 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4a18098c10 con 0x563c0a0efe50 2023-08-10T10:50:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a3ded6b80 10 client.15297 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a3ded6b80 10 client.15297 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-10T10:50:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a3ded6b80 20 client.15297 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x563c0a1041b0 0x563c0a1035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a3ded6b80 4 client.15297 mds_command: new command op to 24532 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/189513011 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c0a0be980 con 0x563c0a1041b0 2023-08-10T10:50:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.329+0000 7f4a23fff700 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x563c0a1041b0 0x563c0a1035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.330+0000 7f4a037fe700 10 client.15297 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:50:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.330+0000 7f4a23fff700 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x563c0a1041b0 0x563c0a1035c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a36222ec7265850 server_cookie=3618add64418000 in_seq=0 out_seq=0 2023-08-10T10:50:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a037fe700 1 -- 172.21.15.107:0/189513011 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563c0a0be980 con 0x563c0a1041b0 2023-08-10T10:50:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a037fe700 10 client.15297 handle_command_reply: tid=0 2023-08-10T10:50:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 client.15297 shutdown 2023-08-10T10:50:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/189513011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 msgr2=0x563c0a0f9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f9480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800b2f0 tx=0x7f4a18099b30 comp rx=0 tx=0).stop 2023-08-10T10:50:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/189513011 shutdown_connections 2023-08-10T10:50:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x563c0a1041b0 0x563c0a1035c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 0x563c0a0f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 0x563c0a1004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a037fe700 0 client.15297 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:50:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/189513011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f9480 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/189513011 >> 172.21.15.107:0/189513011 conn(0x563c0a04cc80 msgr2=0x563c0a0e9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/189513011 shutdown_connections 2023-08-10T10:50:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.331+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/189513011 wait complete. 2023-08-10T10:50:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.332+0000 7f4a3ded6b80 20 client.15297 trim_cache size 0 max 16384 2023-08-10T10:50:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.349+0000 7f4a3ded6b80 1 Processor -- start 2023-08-10T10:50:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.349+0000 7f4a3ded6b80 1 -- start start 2023-08-10T10:50:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 0x563c0a1035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 0x563c0a0f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c09ec38d0 con 0x563c0a0efe50 2023-08-10T10:50:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0a1021b0 con 0x563c0a0ef4f0 2023-08-10T10:50:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0a0fa130 con 0x563c0a0f0910 2023-08-10T10:50:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44698/0 (socket says 172.21.15.107:44698) 2023-08-10T10:50:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a237fe700 1 -- 172.21.15.107:0/4158297092 learned_addr learned my addr 172.21.15.107:0/4158297092 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a23fff700 1 --2- 172.21.15.107:0/4158297092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 0x563c0a1035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a237fe700 1 -- 172.21.15.107:0/4158297092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 msgr2=0x563c0a0f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a237fe700 1 --2- 172.21.15.107:0/4158297092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 0x563c0a0f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a237fe700 1 -- 172.21.15.107:0/4158297092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 msgr2=0x563c0a1035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a237fe700 1 --2- 172.21.15.107:0/4158297092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 0x563c0a1035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.350+0000 7f4a237fe700 1 -- 172.21.15.107:0/4158297092 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c09e56c10 con 0x563c0a0efe50 2023-08-10T10:50:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a237fe700 1 --2- 172.21.15.107:0/4158297092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f37c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a18010b70 tx=0x7f4a18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6b457bf19346de server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a0affd700 1 -- 172.21.15.107:0/4158297092 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18009ac0 con 0x563c0a0efe50 2023-08-10T10:50:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a0affd700 1 -- 172.21.15.107:0/4158297092 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a18098110 con 0x563c0a0efe50 2023-08-10T10:50:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a0affd700 1 -- 172.21.15.107:0/4158297092 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180a1cd0 con 0x563c0a0efe50 2023-08-10T10:50:17.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/4158297092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 msgr2=0x563c0a0f37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/4158297092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f37c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a18010b70 tx=0x7f4a18000bc0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/4158297092 shutdown_connections 2023-08-10T10:50:17.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/4158297092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0ef4f0 0x563c0a1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/4158297092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0f0910 0x563c0a0f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/4158297092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0f37c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/4158297092 >> 172.21.15.107:0/4158297092 conn(0x563c0a04cc80 msgr2=0x563c0a0f7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.351+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/4158297092 shutdown_connections 2023-08-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/4158297092 wait complete. 2023-08-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 1 -- start start 2023-08-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 1 Processor -- start 2023-08-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0ef4f0 0x563c0a0faa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0faf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 0x563c0a0fb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0a15c050 con 0x563c0a0efe50 2023-08-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0a15c1c0 con 0x563c0a0f0910 2023-08-10T10:50:17.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c0a15c380 con 0x563c0a0ef4f0 2023-08-10T10:50:17.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.352+0000 7f4a3ded6b80 10 client.0 _ll_register_callbacks cb 0x563c09fdd630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0faf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a237fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0faf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44700/0 (socket says 172.21.15.107:44700) 2023-08-10T10:50:17.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a237fe700 1 -- 172.21.15.107:0/3686185234 learned_addr learned my addr 172.21.15.107:0/3686185234 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a28b9c700 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 0x563c0a0fb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a23fff700 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0ef4f0 0x563c0a0faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a237fe700 1 -- 172.21.15.107:0/3686185234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0ef4f0 msgr2=0x563c0a0faa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a237fe700 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0ef4f0 0x563c0a0faa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a237fe700 1 -- 172.21.15.107:0/3686185234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 msgr2=0x563c0a0fb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a237fe700 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 0x563c0a0fb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a237fe700 1 -- 172.21.15.107:0/3686185234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c09e6dd90 con 0x563c0a0efe50 2023-08-10T10:50:17.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a237fe700 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0faf50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4a18097e00 tx=0x7f4a180108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b85f1355f2874a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a037fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:17.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a037fe700 1 -- 172.21.15.107:0/3686185234 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18083120 con 0x563c0a0efe50 2023-08-10T10:50:17.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a037fe700 1 -- 172.21.15.107:0/3686185234 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4a180991b0 con 0x563c0a0efe50 2023-08-10T10:50:17.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.353+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3686185234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a1401e040 con 0x563c0a0efe50 2023-08-10T10:50:17.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a037fe700 1 -- 172.21.15.107:0/3686185234 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a18009ac0 con 0x563c0a0efe50 2023-08-10T10:50:17.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a3ded6b80 10 client.15303 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3686185234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563c09e94200 con 0x563c0a0efe50 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a037fe700 1 -- 172.21.15.107:0/3686185234 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a1401e040 con 0x563c0a0efe50 2023-08-10T10:50:17.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a037fe700 1 -- 172.21.15.107:0/3686185234 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4a18084370 con 0x563c0a0efe50 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a3ded6b80 10 client.15303 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a3ded6b80 10 client.15303 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a3ded6b80 20 client.15303 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:17.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x563c0a160ba0 0x563c0a15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a3ded6b80 4 client.15303 mds_command: new command op to 24532 tid=0[{"prefix": "status"}] 2023-08-10T10:50:17.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.354+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3686185234 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563c0a039730 con 0x563c0a160ba0 2023-08-10T10:50:17.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.355+0000 7f4a23fff700 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x563c0a160ba0 0x563c0a15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.355+0000 7f4a037fe700 10 client.15303 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:50:17.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.355+0000 7f4a23fff700 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x563c0a160ba0 0x563c0a15d5b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85cd20d6a51eaa2 server_cookie=dcd03ff4e4f04ecf in_seq=0 out_seq=0 2023-08-10T10:50:17.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a037fe700 1 -- 172.21.15.107:0/3686185234 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x563c0a039730 con 0x563c0a160ba0 2023-08-10T10:50:17.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a037fe700 10 client.15303 handle_command_reply: tid=0 2023-08-10T10:50:17.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 client.15303 shutdown 2023-08-10T10:50:17.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3686185234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 msgr2=0x563c0a0faf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0faf50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4a18097e00 tx=0x7f4a180108d0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3686185234 shutdown_connections 2023-08-10T10:50:17.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x563c0a160ba0 0x563c0a15d5b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563c0a0f0910 0x563c0a0fb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c0a0ef4f0 0x563c0a0faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a037fe700 0 client.15303 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:50:17.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 --2- 172.21.15.107:0/3686185234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c0a0efe50 0x563c0a0faf50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3686185234 >> 172.21.15.107:0/3686185234 conn(0x563c0a04cc80 msgr2=0x563c0a1035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3686185234 shutdown_connections 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 1 -- 172.21.15.107:0/3686185234 wait complete. 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a3ded6b80 20 client.15303 trim_cache size 0 max 16384 2023-08-10T10:50:17.374 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 2, 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24532, 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 63.749048866999999, 2023-08-10T10:50:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 119.699550422 2023-08-10T10:50:17.377 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:17.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4a0c0a1260 msgr2=0x7f4a0c0a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4a0c0a1260 0x7f4a0c0a3720 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0060b0 tx=0x7f4a1c010af0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24101970 msgr2=0x7f4a241968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.356+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24101970 0x7f4a241968d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800d950 tx=0x7f4a1800dc60 comp rx=0 tx=0).stop 2023-08-10T10:50:17.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.357+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/2231884028 shutdown_connections 2023-08-10T10:50:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.357+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4a0c0a1260 0x7f4a0c0a3720 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.357+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a24100780 0x7f4a24196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.357+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a24102310 0x7f4a2419d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.357+0000 7f4a2a5ff700 1 --2- 172.21.15.107:0/2231884028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4a24101970 0x7f4a241968d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.357+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/2231884028 >> 172.21.15.107:0/2231884028 conn(0x7f4a240fbcf0 msgr2=0x7f4a240fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.357+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/2231884028 shutdown_connections 2023-08-10T10:50:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.357+0000 7f4a2a5ff700 1 -- 172.21.15.107:0/2231884028 wait complete. 2023-08-10T10:50:17.380 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-08-10T10:50:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.578+0000 7f22235ff700 1 -- 172.21.15.107:0/3816277441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 msgr2=0x7f221c108ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.578+0000 7f22235ff700 1 --2- 172.21.15.107:0/3816277441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 0x7f221c108ba0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f221400b0d0 tx=0x7f221400b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.578+0000 7f22235ff700 1 -- 172.21.15.107:0/3816277441 shutdown_connections 2023-08-10T10:50:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.578+0000 7f22235ff700 1 --2- 172.21.15.107:0/3816277441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 0x7f221c108ba0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.578+0000 7f22235ff700 1 --2- 172.21.15.107:0/3816277441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f221c100760 0x7f221c100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.578+0000 7f22235ff700 1 --2- 172.21.15.107:0/3816277441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c101950 0x7f221c101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.578+0000 7f22235ff700 1 -- 172.21.15.107:0/3816277441 >> 172.21.15.107:0/3816277441 conn(0x7f221c0fbcb0 msgr2=0x7f221c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.578+0000 7f22235ff700 1 -- 172.21.15.107:0/3816277441 shutdown_connections 2023-08-10T10:50:17.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.578+0000 7f22235ff700 1 -- 172.21.15.107:0/3816277441 wait complete. 2023-08-10T10:50:17.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.579+0000 7f22235ff700 1 Processor -- start 2023-08-10T10:50:17.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.579+0000 7f22235ff700 1 -- start start 2023-08-10T10:50:17.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f22235ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c100760 0x7f221c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f22235ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f221c101950 0x7f221c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f22235ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 0x7f221c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f22235ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1a01d0 con 0x7f221c1022f0 2023-08-10T10:50:17.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f22235ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1a0310 con 0x7f221c100760 2023-08-10T10:50:17.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f22235ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1a04a0 con 0x7f221c101950 2023-08-10T10:50:17.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f2221b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 0x7f221c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f2221b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 0x7f221c19fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44724/0 (socket says 172.21.15.107:44724) 2023-08-10T10:50:17.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f2220b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f221c101950 0x7f221c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f2221b9c700 1 -- 172.21.15.107:0/963026274 learned_addr learned my addr 172.21.15.107:0/963026274 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f222139b700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c100760 0x7f221c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f2221b9c700 1 -- 172.21.15.107:0/963026274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f221c101950 msgr2=0x7f221c198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f2221b9c700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f221c101950 0x7f221c198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f2221b9c700 1 -- 172.21.15.107:0/963026274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c100760 msgr2=0x7f221c198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f2221b9c700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c100760 0x7f221c198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f2221b9c700 1 -- 172.21.15.107:0/963026274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214009d00 con 0x7f221c1022f0 2023-08-10T10:50:17.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.580+0000 7f222139b700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c100760 0x7f221c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.581+0000 7f2221b9c700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 0x7f221c19fc00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2214009fd0 tx=0x7f221400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.581+0000 7f22127fc700 1 -- 172.21.15.107:0/963026274 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221400e040 con 0x7f221c1022f0 2023-08-10T10:50:17.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.581+0000 7f22235ff700 1 -- 172.21.15.107:0/963026274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c1a0720 con 0x7f221c1022f0 2023-08-10T10:50:17.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.581+0000 7f22127fc700 1 -- 172.21.15.107:0/963026274 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2214003e10 con 0x7f221c1022f0 2023-08-10T10:50:17.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.581+0000 7f22127fc700 1 -- 172.21.15.107:0/963026274 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140052a0 con 0x7f221c1022f0 2023-08-10T10:50:17.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.581+0000 7f22235ff700 1 -- 172.21.15.107:0/963026274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c1a0ba0 con 0x7f221c1022f0 2023-08-10T10:50:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.584+0000 7f22127fc700 1 -- 172.21.15.107:0/963026274 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f2214005400 con 0x7f221c1022f0 2023-08-10T10:50:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.586+0000 7f22127fc700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f22080a11e0 0x7f22080a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.586+0000 7f2236ecdb80 1 Processor -- start 2023-08-10T10:50:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.586+0000 7f22127fc700 1 -- 172.21.15.107:0/963026274 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f22140ce490 con 0x7f221c1022f0 2023-08-10T10:50:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.586+0000 7f222139b700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f22080a11e0 0x7f22080a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.586+0000 7f2236ecdb80 1 -- start start 2023-08-10T10:50:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 0x5644e37df910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37e0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37e0910 0x5644e37e0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e375ad70 con 0x5644e37e0910 2023-08-10T10:50:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e3737540 con 0x5644e37dfe50 2023-08-10T10:50:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e3734e60 con 0x5644e37df4f0 2023-08-10T10:50:17.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f222139b700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f22080a11e0 0x7f22080a36a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2218005fd0 tx=0x7f2218005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2221b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37e0910 0x5644e37e0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2221b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37e0910 0x5644e37e0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44730/0 (socket says 172.21.15.107:44730) 2023-08-10T10:50:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2221b9c700 1 -- 172.21.15.107:0/3063126178 learned_addr learned my addr 172.21.15.107:0/3063126178 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2220b9a700 1 --2- 172.21.15.107:0/3063126178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37e0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f222139b700 1 --2- 172.21.15.107:0/3063126178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 0x5644e37df910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2221b9c700 1 -- 172.21.15.107:0/3063126178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 msgr2=0x5644e37df910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2221b9c700 1 --2- 172.21.15.107:0/3063126178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 0x5644e37df910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2221b9c700 1 -- 172.21.15.107:0/3063126178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 msgr2=0x5644e37e0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2221b9c700 1 --2- 172.21.15.107:0/3063126178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37e0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.587+0000 7f2221b9c700 1 -- 172.21.15.107:0/3063126178 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644e35b15e0 con 0x5644e37e0910 2023-08-10T10:50:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.588+0000 7f2221b9c700 1 --2- 172.21.15.107:0/3063126178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37e0910 0x5644e37e0da0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2214097ec0 tx=0x7f221400cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30457fc00476e250 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.588+0000 7f22077fe700 1 -- 172.21.15.107:0/3063126178 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221409adb0 con 0x5644e37e0910 2023-08-10T10:50:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.588+0000 7f22077fe700 1 -- 172.21.15.107:0/3063126178 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f221402ad50 con 0x5644e37e0910 2023-08-10T10:50:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.588+0000 7f22077fe700 1 -- 172.21.15.107:0/3063126178 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221409f480 con 0x5644e37e0910 2023-08-10T10:50:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 -- 172.21.15.107:0/3063126178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37e0910 msgr2=0x5644e37e0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/3063126178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37e0910 0x5644e37e0da0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2214097ec0 tx=0x7f221400cfd0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 -- 172.21.15.107:0/3063126178 shutdown_connections 2023-08-10T10:50:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/3063126178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37e0910 0x5644e37e0da0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/3063126178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 0x5644e37df910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/3063126178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37e0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 -- 172.21.15.107:0/3063126178 >> 172.21.15.107:0/3063126178 conn(0x5644e373cc80 msgr2=0x5644e37da280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 -- 172.21.15.107:0/3063126178 shutdown_connections 2023-08-10T10:50:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 -- 172.21.15.107:0/3063126178 wait complete. 2023-08-10T10:50:17.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.589+0000 7f2236ecdb80 1 -- start start 2023-08-10T10:50:17.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.590+0000 7f2236ecdb80 1 Processor -- start 2023-08-10T10:50:17.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.590+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e37f1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.590+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.590+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 0x5644e37f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.590+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e3730750 con 0x5644e37df4f0 2023-08-10T10:50:17.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.590+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e36cfa70 con 0x5644e37dfe50 2023-08-10T10:50:17.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.590+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e36cf770 con 0x5644e37e0910 2023-08-10T10:50:17.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.590+0000 7f2236ecdb80 10 client.0 _ll_register_callbacks cb 0x5644e36cd630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.590+0000 7f222139b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e37f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f222139b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e37f1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44734/0 (socket says 172.21.15.107:44734) 2023-08-10T10:50:17.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f222139b700 1 -- 172.21.15.107:0/2877783043 learned_addr learned my addr 172.21.15.107:0/2877783043 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f2220b9a700 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f2221b9c700 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 0x5644e37f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f222139b700 1 -- 172.21.15.107:0/2877783043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 msgr2=0x5644e37f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f222139b700 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 0x5644e37f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f222139b700 1 -- 172.21.15.107:0/2877783043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 msgr2=0x5644e37f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f222139b700 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f222139b700 1 -- 172.21.15.107:0/2877783043 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c1a0ba0 con 0x5644e37df4f0 2023-08-10T10:50:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f222139b700 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e37f1510 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f22180117f0 tx=0x7f2218004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee26f430c668501 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.591+0000 7f2204ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.592+0000 7f2204ff9700 1 -- 172.21.15.107:0/2877783043 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221801f830 con 0x5644e37df4f0 2023-08-10T10:50:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.592+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2877783043 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644e37d2420 con 0x5644e37df4f0 2023-08-10T10:50:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.592+0000 7f2204ff9700 1 -- 172.21.15.107:0/2877783043 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f221801f990 con 0x5644e37df4f0 2023-08-10T10:50:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.592+0000 7f2204ff9700 1 -- 172.21.15.107:0/2877783043 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f221801fb50 con 0x5644e37df4f0 2023-08-10T10:50:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.592+0000 7f2236ecdb80 10 client.15315 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.592+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2877783043 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5644e355dd90 con 0x5644e37df4f0 2023-08-10T10:50:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.592+0000 7f2204ff9700 1 -- 172.21.15.107:0/2877783043 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5644e37d2420 con 0x5644e37df4f0 2023-08-10T10:50:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.592+0000 7f2204ff9700 1 -- 172.21.15.107:0/2877783043 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2218010c10 con 0x5644e37df4f0 2023-08-10T10:50:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.593+0000 7f2236ecdb80 10 client.15315 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.593+0000 7f2236ecdb80 10 client.15315 resolve_mds: resolved name 'i' to daemon mds.i 2023-08-10T10:50:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.593+0000 7f2236ecdb80 20 client.15315 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.593+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5644e37ec1a0 0x5644e37eb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.593+0000 7f2236ecdb80 4 client.15315 mds_command: new command op to 24571 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.593+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2877783043 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644e37ae980 con 0x5644e37ec1a0 2023-08-10T10:50:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.593+0000 7f2220b9a700 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5644e37ec1a0 0x5644e37eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.594+0000 7f2220b9a700 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5644e37ec1a0 0x5644e37eb550 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=802d2cdc2b061c5 server_cookie=a6fd98950a65128d in_seq=0 out_seq=0 2023-08-10T10:50:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.594+0000 7f2204ff9700 10 client.15315 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:50:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2204ff9700 1 -- 172.21.15.107:0/2877783043 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5644e37ae980 con 0x5644e37ec1a0 2023-08-10T10:50:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2204ff9700 10 client.15315 handle_command_reply: tid=0 2023-08-10T10:50:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 client.15315 shutdown 2023-08-10T10:50:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2877783043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 msgr2=0x5644e37f1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e37f1510 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f22180117f0 tx=0x7f2218004750 comp rx=0 tx=0).stop 2023-08-10T10:50:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2877783043 shutdown_connections 2023-08-10T10:50:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5644e37ec1a0 0x5644e37eb550 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 0x5644e37f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e37f1510 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2877783043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2877783043 >> 172.21.15.107:0/2877783043 conn(0x5644e373cc80 msgr2=0x5644e37d9960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2204ff9700 0 client.15315 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:50:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2877783043 shutdown_connections 2023-08-10T10:50:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.595+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2877783043 wait complete. 2023-08-10T10:50:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.596+0000 7f2236ecdb80 20 client.15315 trim_cache size 0 max 16384 2023-08-10T10:50:17.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.613+0000 7f2236ecdb80 1 Processor -- start 2023-08-10T10:50:17.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.613+0000 7f2236ecdb80 1 -- start start 2023-08-10T10:50:17.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e380e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 0x5644e37e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e35b38d0 con 0x5644e37df4f0 2023-08-10T10:50:17.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e36fe790 con 0x5644e37dfe50 2023-08-10T10:50:17.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e35bfde0 con 0x5644e37e0910 2023-08-10T10:50:17.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f222139b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e380e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f222139b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e380e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44746/0 (socket says 172.21.15.107:44746) 2023-08-10T10:50:17.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f222139b700 1 -- 172.21.15.107:0/2462309472 learned_addr learned my addr 172.21.15.107:0/2462309472 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f2220b9a700 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f2221b9c700 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 0x5644e37e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f222139b700 1 -- 172.21.15.107:0/2462309472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 msgr2=0x5644e37e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f222139b700 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 0x5644e37e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f222139b700 1 -- 172.21.15.107:0/2462309472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 msgr2=0x5644e37f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f222139b700 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f222139b700 1 -- 172.21.15.107:0/2462309472 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644e3546c10 con 0x5644e37df4f0 2023-08-10T10:50:17.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.614+0000 7f2220b9a700 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:50:17.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.615+0000 7f222139b700 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e380e000 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2218009810 tx=0x7f2218009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1f1f36adf899cf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.615+0000 7f2207fff700 1 -- 172.21.15.107:0/2462309472 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218027880 con 0x5644e37df4f0 2023-08-10T10:50:17.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.615+0000 7f2207fff700 1 -- 172.21.15.107:0/2462309472 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2218027e70 con 0x5644e37df4f0 2023-08-10T10:50:17.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.615+0000 7f2207fff700 1 -- 172.21.15.107:0/2462309472 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218005290 con 0x5644e37df4f0 2023-08-10T10:50:17.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2462309472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 msgr2=0x5644e380e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e380e000 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2218009810 tx=0x7f2218009840 comp rx=0 tx=0).stop 2023-08-10T10:50:17.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2462309472 shutdown_connections 2023-08-10T10:50:17.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37e0910 0x5644e37e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37df4f0 0x5644e380e000 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/2462309472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37dfe50 0x5644e37f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2462309472 >> 172.21.15.107:0/2462309472 conn(0x5644e373cc80 msgr2=0x5644e37da1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2462309472 shutdown_connections 2023-08-10T10:50:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 -- 172.21.15.107:0/2462309472 wait complete. 2023-08-10T10:50:17.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 -- start start 2023-08-10T10:50:17.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.616+0000 7f2236ecdb80 1 Processor -- start 2023-08-10T10:50:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 0x5644e37f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37dfe50 0x5644e37f3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2236ecdb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37e0910 0x5644e37f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e37f8830 con 0x5644e37dfe50 2023-08-10T10:50:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e37f89a0 con 0x5644e37e0910 2023-08-10T10:50:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2236ecdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644e37f8b60 con 0x5644e37df4f0 2023-08-10T10:50:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2236ecdb80 10 client.0 _ll_register_callbacks cb 0x5644e36cd630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2220b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37dfe50 0x5644e37f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2220b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37dfe50 0x5644e37f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44762/0 (socket says 172.21.15.107:44762) 2023-08-10T10:50:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2220b9a700 1 -- 172.21.15.107:0/1862251178 learned_addr learned my addr 172.21.15.107:0/1862251178 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2221b9c700 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37e0910 0x5644e37f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f222139b700 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 0x5644e37f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2220b9a700 1 -- 172.21.15.107:0/1862251178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 msgr2=0x5644e37f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2220b9a700 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 0x5644e37f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2220b9a700 1 -- 172.21.15.107:0/1862251178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37e0910 msgr2=0x5644e37f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2220b9a700 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37e0910 0x5644e37f82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.617+0000 7f2220b9a700 1 -- 172.21.15.107:0/1862251178 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c009b30 con 0x5644e37dfe50 2023-08-10T10:50:17.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2220b9a700 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37dfe50 0x5644e37f3310 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f220c0097c0 tx=0x7f220c010870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706c1bda51829839 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2204ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:17.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2204ff9700 1 -- 172.21.15.107:0/1862251178 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c017070 con 0x5644e37dfe50 2023-08-10T10:50:17.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2236ecdb80 1 -- 172.21.15.107:0/1862251178 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f221402ad50 con 0x5644e37dfe50 2023-08-10T10:50:17.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2204ff9700 1 -- 172.21.15.107:0/1862251178 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f220c01ecd0 con 0x5644e37dfe50 2023-08-10T10:50:17.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2204ff9700 1 -- 172.21.15.107:0/1862251178 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f220c01ee90 con 0x5644e37dfe50 2023-08-10T10:50:17.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2236ecdb80 10 client.15321 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:17.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2236ecdb80 1 -- 172.21.15.107:0/1862251178 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5644e355dd90 con 0x5644e37dfe50 2023-08-10T10:50:17.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2204ff9700 1 -- 172.21.15.107:0/1862251178 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f221402ad50 con 0x5644e37dfe50 2023-08-10T10:50:17.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2204ff9700 1 -- 172.21.15.107:0/1862251178 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f220c005390 con 0x5644e37dfe50 2023-08-10T10:50:17.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.618+0000 7f2236ecdb80 10 client.15321 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:17.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.619+0000 7f2236ecdb80 10 client.15321 resolve_mds: resolved name 'i' to daemon mds.i 2023-08-10T10:50:17.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.619+0000 7f2236ecdb80 20 client.15321 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:17.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.619+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5644e385d870 0x5644e385a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.619+0000 7f2236ecdb80 4 client.15321 mds_command: new command op to 24571 tid=0[{"prefix": "status"}] 2023-08-10T10:50:17.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.619+0000 7f2236ecdb80 1 -- 172.21.15.107:0/1862251178 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5644e3729730 con 0x5644e385d870 2023-08-10T10:50:17.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.619+0000 7f222139b700 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5644e385d870 0x5644e385a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2204ff9700 10 client.15321 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:50:17.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f222139b700 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5644e385d870 0x5644e385a1e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d15de782129fd8d3 server_cookie=a309f82fbae4c0a8 in_seq=0 out_seq=0 2023-08-10T10:50:17.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2204ff9700 1 -- 172.21.15.107:0/1862251178 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5644e3729730 con 0x5644e385d870 2023-08-10T10:50:17.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2204ff9700 10 client.15321 handle_command_reply: tid=0 2023-08-10T10:50:17.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 client.15321 shutdown 2023-08-10T10:50:17.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 -- 172.21.15.107:0/1862251178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37dfe50 msgr2=0x5644e37f3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37dfe50 0x5644e37f3310 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f220c0097c0 tx=0x7f220c010870 comp rx=0 tx=0).stop 2023-08-10T10:50:17.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 -- 172.21.15.107:0/1862251178 shutdown_connections 2023-08-10T10:50:17.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5644e385d870 0x5644e385a1e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5644e37e0910 0x5644e37f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5644e37df4f0 0x5644e37f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2204ff9700 0 client.15321 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:50:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 --2- 172.21.15.107:0/1862251178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5644e37dfe50 0x5644e37f3310 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 -- 172.21.15.107:0/1862251178 >> 172.21.15.107:0/1862251178 conn(0x5644e373cc80 msgr2=0x5644e37eb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 -- 172.21.15.107:0/1862251178 shutdown_connections 2023-08-10T10:50:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 1 -- 172.21.15.107:0/1862251178 wait complete. 2023-08-10T10:50:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.620+0000 7f2236ecdb80 20 client.15321 trim_cache size 0 max 16384 2023-08-10T10:50:17.631 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:17.631 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:17.631 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 1, 2023-08-10T10:50:17.631 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24571, 2023-08-10T10:50:17.631 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:17.632 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:17.632 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:17.632 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 64.903176254000002, 2023-08-10T10:50:17.632 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:17.632 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:17.632 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:17.632 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 110.27225914500001 2023-08-10T10:50:17.633 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:17.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 -- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f22080a11e0 msgr2=0x7f22080a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f22080a11e0 0x7f22080a36a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2218005fd0 tx=0x7f2218005f00 comp rx=0 tx=0).stop 2023-08-10T10:50:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 -- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 msgr2=0x7f221c19fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 0x7f221c19fc00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2214009fd0 tx=0x7f221400ccc0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 -- 172.21.15.107:0/963026274 shutdown_connections 2023-08-10T10:50:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f22080a11e0 0x7f22080a36a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f221c100760 0x7f221c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f221c1022f0 0x7f221c19fc00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 --2- 172.21.15.107:0/963026274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f221c101950 0x7f221c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 -- 172.21.15.107:0/963026274 >> 172.21.15.107:0/963026274 conn(0x7f221c0fbcb0 msgr2=0x7f221c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 -- 172.21.15.107:0/963026274 shutdown_connections 2023-08-10T10:50:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.621+0000 7f22235ff700 1 -- 172.21.15.107:0/963026274 wait complete. 2023-08-10T10:50:17.640 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-10T10:50:17.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.839+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/4129085724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce0102170 msgr2=0x7f5ce0108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.839+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/4129085724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce0102170 0x7f5ce0108a20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800b0d0 tx=0x7f5cd800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.839+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/4129085724 shutdown_connections 2023-08-10T10:50:17.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.839+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/4129085724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce01005e0 0x7f5ce0100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.839+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/4129085724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce0102170 0x7f5ce0108a20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.839+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/4129085724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce01017d0 0x7f5ce0101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.839+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/4129085724 >> 172.21.15.107:0/4129085724 conn(0x7f5ce00fbb50 msgr2=0x7f5ce00fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.839+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/4129085724 shutdown_connections 2023-08-10T10:50:17.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.839+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/4129085724 wait complete. 2023-08-10T10:50:17.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.840+0000 7f5ce5b9d700 1 Processor -- start 2023-08-10T10:50:17.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.840+0000 7f5ce5b9d700 1 -- start start 2023-08-10T10:50:17.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.840+0000 7f5ce5b9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce01005e0 0x7f5ce0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5ce5b9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce01017d0 0x7f5ce0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5ce5b9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce0102170 0x7f5ce019f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5ce5b9d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce019ffc0 con 0x7f5ce01017d0 2023-08-10T10:50:17.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5ce5b9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce01a0100 con 0x7f5ce01005e0 2023-08-10T10:50:17.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5ce5b9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce01a0290 con 0x7f5ce0102170 2023-08-10T10:50:17.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5cdffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce01017d0 0x7f5ce0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5cdffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce01017d0 0x7f5ce0198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44786/0 (socket says 172.21.15.107:44786) 2023-08-10T10:50:17.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5cdffff700 1 -- 172.21.15.107:0/3408305830 learned_addr learned my addr 172.21.15.107:0/3408305830 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce01005e0 0x7f5ce0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5ce539c700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce0102170 0x7f5ce019f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5cdffff700 1 -- 172.21.15.107:0/3408305830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce0102170 msgr2=0x7f5ce019f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5cdffff700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce0102170 0x7f5ce019f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5cdffff700 1 -- 172.21.15.107:0/3408305830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce01005e0 msgr2=0x7f5ce0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5cdffff700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce01005e0 0x7f5ce0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5cdffff700 1 -- 172.21.15.107:0/3408305830 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009d00 con 0x7f5ce01017d0 2023-08-10T10:50:17.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.841+0000 7f5cdffff700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce01017d0 0x7f5ce0198980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00d950 tx=0x7f5ccc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.842+0000 7f5cddffb700 1 -- 172.21.15.107:0/3408305830 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00f890 con 0x7f5ce01017d0 2023-08-10T10:50:17.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.842+0000 7f5cddffb700 1 -- 172.21.15.107:0/3408305830 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ccc00fe80 con 0x7f5ce01017d0 2023-08-10T10:50:17.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.842+0000 7f5cddffb700 1 -- 172.21.15.107:0/3408305830 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00e3b0 con 0x7f5ce01017d0 2023-08-10T10:50:17.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.842+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/3408305830 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce01a0570 con 0x7f5ce01017d0 2023-08-10T10:50:17.846 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.842+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/3408305830 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce01a0a30 con 0x7f5ce01017d0 2023-08-10T10:50:17.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.845+0000 7f5cddffb700 1 -- 172.21.15.107:0/3408305830 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f5ccc010460 con 0x7f5ce01017d0 2023-08-10T10:50:17.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cfa7c0b80 1 Processor -- start 2023-08-10T10:50:17.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cfa7c0b80 1 -- start start 2023-08-10T10:50:17.847 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cddffb700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5cd00a1310 0x7f5cd00a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cddffb700 1 -- 172.21.15.107:0/3408305830 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f5ccc0ccb10 con 0x7f5ce01017d0 2023-08-10T10:50:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abeebb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abeea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abeeadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abe65d70 con 0x5652abeeb700 2023-08-10T10:50:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abe42540 con 0x5652abeec060 2023-08-10T10:50:17.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.846+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abe3fe60 con 0x5652abeea930 2023-08-10T10:50:17.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce539c700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5cd00a1310 0x7f5cd00a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce4b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abeebb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce4b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abeebb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44804/0 (socket says 172.21.15.107:44804) 2023-08-10T10:50:17.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce4b9b700 1 -- 172.21.15.107:0/3733622101 learned_addr learned my addr 172.21.15.107:0/3733622101 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce539c700 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abeeadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce4b9b700 1 -- 172.21.15.107:0/3733622101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 msgr2=0x5652abeeadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abeeadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce4b9b700 1 -- 172.21.15.107:0/3733622101 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 msgr2=0x5652abeea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5cdffff700 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abeea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abeea350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce4b9b700 1 -- 172.21.15.107:0/3733622101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652abcbc5e0 con 0x5652abeeb700 2023-08-10T10:50:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5cdffff700 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abeea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce539c700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5cd00a1310 0x7f5cd00a37d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800b820 tx=0x7f5cd8007830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.847+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abeebb20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4007d10 tx=0x7f5cd40106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2050f59ac515b29b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5ccaffd700 1 -- 172.21.15.107:0/3733622101 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4010ec0 con 0x5652abeeb700 2023-08-10T10:50:17.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5ccaffd700 1 -- 172.21.15.107:0/3733622101 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5cd4015070 con 0x5652abeeb700 2023-08-10T10:50:17.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5ccaffd700 1 -- 172.21.15.107:0/3733622101 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4019610 con 0x5652abeeb700 2023-08-10T10:50:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/3733622101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 msgr2=0x5652abeebb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abeebb20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4007d10 tx=0x7f5cd40106b0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/3733622101 shutdown_connections 2023-08-10T10:50:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abeeadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abeebb20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/3733622101 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abeea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.848+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/3733622101 >> 172.21.15.107:0/3733622101 conn(0x5652abe47c80 msgr2=0x5652abee5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.849+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/3733622101 shutdown_connections 2023-08-10T10:50:17.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.849+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/3733622101 wait complete. 2023-08-10T10:50:17.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.849+0000 7f5cfa7c0b80 1 -- start start 2023-08-10T10:50:17.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.849+0000 7f5cfa7c0b80 1 Processor -- start 2023-08-10T10:50:17.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeea930 0x5652abef42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 0x5652abef4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeec060 0x5652abefb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abe3b750 con 0x5652abeea930 2023-08-10T10:50:17.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abddaa70 con 0x5652abeeb700 2023-08-10T10:50:17.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abdda770 con 0x5652abeec060 2023-08-10T10:50:17.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5cfa7c0b80 10 client.0 _ll_register_callbacks cb 0x5652abdd8630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5ce4b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeea930 0x5652abef42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5ce4b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeea930 0x5652abef42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44816/0 (socket says 172.21.15.107:44816) 2023-08-10T10:50:17.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5ce4b9b700 1 -- 172.21.15.107:0/642699961 learned_addr learned my addr 172.21.15.107:0/642699961 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5cdffff700 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 0x5652abef4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5ce539c700 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeec060 0x5652abefb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5ce4b9b700 1 -- 172.21.15.107:0/642699961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeec060 msgr2=0x5652abefb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeec060 0x5652abefb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5ce4b9b700 1 -- 172.21.15.107:0/642699961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 msgr2=0x5652abef4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 0x5652abef4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.850+0000 7f5ce4b9b700 1 -- 172.21.15.107:0/642699961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd4007970 con 0x5652abeea930 2023-08-10T10:50:17.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.851+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeea930 0x5652abef42d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4005c50 tx=0x7f5cd4010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1ebd3651b968fa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.851+0000 7f5cbffff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:17.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.851+0000 7f5cbffff700 1 -- 172.21.15.107:0/642699961 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40116c0 con 0x5652abeea930 2023-08-10T10:50:17.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.851+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/642699961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652abedd420 con 0x5652abeea930 2023-08-10T10:50:17.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.851+0000 7f5cbffff700 1 -- 172.21.15.107:0/642699961 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f5cd4011820 con 0x5652abeea930 2023-08-10T10:50:17.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.851+0000 7f5cbffff700 1 -- 172.21.15.107:0/642699961 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cd40119e0 con 0x5652abeea930 2023-08-10T10:50:17.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.851+0000 7f5cfa7c0b80 10 client.15333 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:17.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.851+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/642699961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5652abc68d90 con 0x5652abeea930 2023-08-10T10:50:17.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.851+0000 7f5cbffff700 1 -- 172.21.15.107:0/642699961 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5652abedd420 con 0x5652abeea930 2023-08-10T10:50:17.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.852+0000 7f5cbffff700 1 -- 172.21.15.107:0/642699961 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5cd402a060 con 0x5652abeea930 2023-08-10T10:50:17.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.852+0000 7f5cfa7c0b80 10 client.15333 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:17.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.852+0000 7f5cfa7c0b80 10 client.15333 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:50:17.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.852+0000 7f5cfa7c0b80 20 client.15333 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:17.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.852+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5652abeff410 0x5652abefe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.852+0000 7f5cfa7c0b80 4 client.15333 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:17.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.852+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/642699961 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652abeb9980 con 0x5652abeff410 2023-08-10T10:50:17.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.852+0000 7f5cdffff700 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5652abeff410 0x5652abefe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.853+0000 7f5cbffff700 10 client.15333 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:50:17.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.853+0000 7f5cdffff700 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5652abeff410 0x5652abefe830 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31048f248091c3a1 server_cookie=b59a70e8866e642d in_seq=0 out_seq=0 2023-08-10T10:50:17.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.853+0000 7f5cbffff700 1 -- 172.21.15.107:0/642699961 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5652abeb9980 con 0x5652abeff410 2023-08-10T10:50:17.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.853+0000 7f5cbffff700 10 client.15333 handle_command_reply: tid=0 2023-08-10T10:50:17.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 client.15333 shutdown 2023-08-10T10:50:17.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/642699961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeea930 msgr2=0x5652abef42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeea930 0x5652abef42d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4005c50 tx=0x7f5cd4010df0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/642699961 shutdown_connections 2023-08-10T10:50:17.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5652abeff410 0x5652abefe830 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeec060 0x5652abefb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.869 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeea930 0x5652abef42d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.869 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cbffff700 0 client.15333 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:50:17.869 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/642699961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 0x5652abef4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.869 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/642699961 >> 172.21.15.107:0/642699961 conn(0x5652abe47c80 msgr2=0x5652abee4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.869 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/642699961 shutdown_connections 2023-08-10T10:50:17.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/642699961 wait complete. 2023-08-10T10:50:17.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.854+0000 7f5cfa7c0b80 20 client.15333 trim_cache size 0 max 16384 2023-08-10T10:50:17.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.872+0000 7f5cfa7c0b80 1 Processor -- start 2023-08-10T10:50:17.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.872+0000 7f5cfa7c0b80 1 -- start start 2023-08-10T10:50:17.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.872+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abee1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.872+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abefb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.872+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abefe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.872+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abcbe8d0 con 0x5652abeeb700 2023-08-10T10:50:17.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.872+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abe09790 con 0x5652abeec060 2023-08-10T10:50:17.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.872+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abccade0 con 0x5652abeea930 2023-08-10T10:50:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5cdffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abefb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5ce4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abee1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5cdffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abefb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44824/0 (socket says 172.21.15.107:44824) 2023-08-10T10:50:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5cdffff700 1 -- 172.21.15.107:0/2803953057 learned_addr learned my addr 172.21.15.107:0/2803953057 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5ce539c700 1 --2- 172.21.15.107:0/2803953057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abefe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5cdffff700 1 -- 172.21.15.107:0/2803953057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 msgr2=0x5652abee1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5cdffff700 1 --2- 172.21.15.107:0/2803953057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abee1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5cdffff700 1 -- 172.21.15.107:0/2803953057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 msgr2=0x5652abefe830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5cdffff700 1 --2- 172.21.15.107:0/2803953057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abefe830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5cdffff700 1 -- 172.21.15.107:0/2803953057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652abc51c10 con 0x5652abeeb700 2023-08-10T10:50:17.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5ce539c700 1 --2- 172.21.15.107:0/2803953057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abefe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:17.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5cdffff700 1 --2- 172.21.15.107:0/2803953057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abefb5d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc010710 tx=0x7f5ccc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52609edb4139990c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5ccb7fe700 1 -- 172.21.15.107:0/2803953057 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc09aea0 con 0x5652abeeb700 2023-08-10T10:50:17.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5ccb7fe700 1 -- 172.21.15.107:0/2803953057 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ccc0b2210 con 0x5652abeeb700 2023-08-10T10:50:17.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.873+0000 7f5ccb7fe700 1 -- 172.21.15.107:0/2803953057 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc098f30 con 0x5652abeeb700 2023-08-10T10:50:17.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/2803953057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 msgr2=0x5652abefb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/2803953057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abefb5d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc010710 tx=0x7f5ccc010000 comp rx=0 tx=0).stop 2023-08-10T10:50:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/2803953057 shutdown_connections 2023-08-10T10:50:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/2803953057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeec060 0x5652abefe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/2803953057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abee1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/2803953057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeeb700 0x5652abefb5d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/2803953057 >> 172.21.15.107:0/2803953057 conn(0x5652abe47c80 msgr2=0x5652abeead10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/2803953057 shutdown_connections 2023-08-10T10:50:17.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/2803953057 wait complete. 2023-08-10T10:50:17.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.874+0000 7f5cfa7c0b80 1 -- start start 2023-08-10T10:50:17.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5cfa7c0b80 1 Processor -- start 2023-08-10T10:50:17.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abef64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 0x5652abef6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5cfa7c0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeec060 0x5652abf530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abf535f0 con 0x5652abeec060 2023-08-10T10:50:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abf53730 con 0x5652abeeb700 2023-08-10T10:50:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5cfa7c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652abf53870 con 0x5652abeea930 2023-08-10T10:50:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5cfa7c0b80 10 client.0 _ll_register_callbacks cb 0x5652abdd8630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5ce539c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeec060 0x5652abf530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.881 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5ce539c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeec060 0x5652abf530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44830/0 (socket says 172.21.15.107:44830) 2023-08-10T10:50:17.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5ce539c700 1 -- 172.21.15.107:0/1166132424 learned_addr learned my addr 172.21.15.107:0/1166132424 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:17.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5cdffff700 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 0x5652abef6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.875+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abef64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5ce539c700 1 -- 172.21.15.107:0/1166132424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 msgr2=0x5652abef64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5ce539c700 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abef64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5ce539c700 1 -- 172.21.15.107:0/1166132424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 msgr2=0x5652abef6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5ce539c700 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 0x5652abef6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.884 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5ce539c700 1 -- 172.21.15.107:0/1166132424 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce01a0a30 con 0x5652abeec060 2023-08-10T10:50:17.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5ce539c700 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeec060 0x5652abf530b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800d010 tx=0x7f5cd8022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0400cdaf936e07 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:17.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5cbffff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:17.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5cbffff700 1 -- 172.21.15.107:0/1166132424 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80054c0 con 0x5652abeec060 2023-08-10T10:50:17.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/1166132424 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5cd4015070 con 0x5652abeec060 2023-08-10T10:50:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5cbffff700 1 -- 172.21.15.107:0/1166132424 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f5cd8005620 con 0x5652abeec060 2023-08-10T10:50:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5cbffff700 1 -- 172.21.15.107:0/1166132424 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cd80057e0 con 0x5652abeec060 2023-08-10T10:50:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5cfa7c0b80 10 client.15339 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:17.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.876+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/1166132424 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5652abc8f200 con 0x5652abeec060 2023-08-10T10:50:17.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.877+0000 7f5cbffff700 1 -- 172.21.15.107:0/1166132424 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5cd4015070 con 0x5652abeec060 2023-08-10T10:50:17.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.877+0000 7f5cbffff700 1 -- 172.21.15.107:0/1166132424 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5cd8034070 con 0x5652abeec060 2023-08-10T10:50:17.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.877+0000 7f5cfa7c0b80 10 client.15339 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:17.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.877+0000 7f5cfa7c0b80 10 client.15339 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:50:17.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.877+0000 7f5cfa7c0b80 20 client.15339 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:17.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.877+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5652abf58660 0x5652abf54fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:17.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.877+0000 7f5cfa7c0b80 4 client.15339 mds_command: new command op to 24575 tid=0[{"prefix": "status"}] 2023-08-10T10:50:17.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.877+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/1166132424 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5652abe34730 con 0x5652abf58660 2023-08-10T10:50:17.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.877+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5652abf58660 0x5652abf54fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.878+0000 7f5cbffff700 10 client.15339 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:50:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.878+0000 7f5ce4b9b700 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5652abf58660 0x5652abf54fd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50534aead76b41ec server_cookie=2f2b7d1063924bf4 in_seq=0 out_seq=0 2023-08-10T10:50:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.878+0000 7f5cbffff700 1 -- 172.21.15.107:0/1166132424 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5652abe34730 con 0x5652abf58660 2023-08-10T10:50:17.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.878+0000 7f5cbffff700 10 client.15339 handle_command_reply: tid=0 2023-08-10T10:50:17.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.878+0000 7f5cfa7c0b80 1 client.15339 shutdown 2023-08-10T10:50:17.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.878+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/1166132424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeec060 msgr2=0x5652abf530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.878+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeec060 0x5652abf530b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800d010 tx=0x7f5cd8022040 comp rx=0 tx=0).stop 2023-08-10T10:50:17.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/1166132424 shutdown_connections 2023-08-10T10:50:17.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5652abf58660 0x5652abf54fd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652abeec060 0x5652abf530b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652abeea930 0x5652abef64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cbffff700 0 client.15339 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:50:17.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cfa7c0b80 1 --2- 172.21.15.107:0/1166132424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652abeeb700 0x5652abef6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/1166132424 >> 172.21.15.107:0/1166132424 conn(0x5652abe47c80 msgr2=0x5652abeead10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/1166132424 shutdown_connections 2023-08-10T10:50:17.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cfa7c0b80 1 -- 172.21.15.107:0/1166132424 wait complete. 2023-08-10T10:50:17.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5cfa7c0b80 20 client.15339 trim_cache size 0 max 16384 2023-08-10T10:50:17.893 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2023-08-10T10:50:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24575, 2023-08-10T10:50:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 94.987322564999999, 2023-08-10T10:50:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 100.970715599 2023-08-10T10:50:17.896 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:17.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5cd00a1310 msgr2=0x7f5cd00a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5cd00a1310 0x7f5cd00a37d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800b820 tx=0x7f5cd8007830 comp rx=0 tx=0).stop 2023-08-10T10:50:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce01017d0 msgr2=0x7f5ce0198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce01017d0 0x7f5ce0198980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00d950 tx=0x7f5ccc00dc60 comp rx=0 tx=0).stop 2023-08-10T10:50:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/3408305830 shutdown_connections 2023-08-10T10:50:17.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f5cd00a1310 0x7f5cd00a37d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ce01005e0 0x7f5ce0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ce0102170 0x7f5ce019f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 --2- 172.21.15.107:0/3408305830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ce01017d0 0x7f5ce0198980 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:17.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.879+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/3408305830 >> 172.21.15.107:0/3408305830 conn(0x7f5ce00fbb50 msgr2=0x7f5ce0106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:17.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.880+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/3408305830 shutdown_connections 2023-08-10T10:50:17.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:17.880+0000 7f5ce5b9d700 1 -- 172.21.15.107:0/3408305830 wait complete. 2023-08-10T10:50:17.901 INFO:tasks.cephadm:Setup complete, yielding 2023-08-10T10:50:17.901 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-08-10T10:50:17.911 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T10:50:17.912 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- bash -c 'ceph orch status' 2023-08-10T10:50:18.633 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:18.971 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:18 smithi107 ceph-mon[127953]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2023-08-10T10:50:19.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:18 smithi157 ceph-mon[129604]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2023-08-10T10:50:19.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:18 smithi195 ceph-mon[129938]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2023-08-10T10:50:20.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.269+0000 7fc8d0f37700 1 -- 172.21.15.107:0/3233290617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 msgr2=0x7fc8cc101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:20.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.269+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/3233290617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 0x7fc8cc101e60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00099c0 tx=0x7fc8c0009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.269+0000 7fc8d0f37700 1 -- 172.21.15.107:0/3233290617 shutdown_connections 2023-08-10T10:50:20.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.269+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/3233290617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8cc1023a0 0x7fc8cc108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.269+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/3233290617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8cc100800 0x7fc8cc100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.269+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/3233290617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 0x7fc8cc101e60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.269+0000 7fc8d0f37700 1 -- 172.21.15.107:0/3233290617 >> 172.21.15.107:0/3233290617 conn(0x7fc8cc0fbd60 msgr2=0x7fc8cc0fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:20.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.269+0000 7fc8d0f37700 1 -- 172.21.15.107:0/3233290617 shutdown_connections 2023-08-10T10:50:20.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.269+0000 7fc8d0f37700 1 -- 172.21.15.107:0/3233290617 wait complete. 2023-08-10T10:50:20.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.270+0000 7fc8d0f37700 1 Processor -- start 2023-08-10T10:50:20.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.270+0000 7fc8d0f37700 1 -- start start 2023-08-10T10:50:20.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8d0f37700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8cc100800 0x7fc8cc074510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8d0f37700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 0x7fc8cc072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8d0f37700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8cc1023a0 0x7fc8cc0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8d0f37700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc073820 con 0x7fc8cc101a00 2023-08-10T10:50:20.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8d0f37700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc073990 con 0x7fc8cc100800 2023-08-10T10:50:20.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8d0f37700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc1a0420 con 0x7fc8cc1023a0 2023-08-10T10:50:20.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8c9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 0x7fc8cc072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8c9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 0x7fc8cc072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44852/0 (socket says 172.21.15.107:44852) 2023-08-10T10:50:20.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8c9d9b700 1 -- 172.21.15.107:0/159736166 learned_addr learned my addr 172.21.15.107:0/159736166 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:20.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8ca59c700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8cc100800 0x7fc8cc074510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8cad9d700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8cc1023a0 0x7fc8cc0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8c9d9b700 1 -- 172.21.15.107:0/159736166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8cc1023a0 msgr2=0x7fc8cc0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:20.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8c9d9b700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8cc1023a0 0x7fc8cc0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8c9d9b700 1 -- 172.21.15.107:0/159736166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8cc100800 msgr2=0x7fc8cc074510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:20.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8c9d9b700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8cc100800 0x7fc8cc074510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8c9d9b700 1 -- 172.21.15.107:0/159736166 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c00095f0 con 0x7fc8cc101a00 2023-08-10T10:50:20.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.271+0000 7fc8cad9d700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8cc1023a0 0x7fc8cc0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:20.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.272+0000 7fc8c9d9b700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 0x7fc8cc072b60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000b580 tx=0x7fc8c0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:20.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.272+0000 7fc8bb7fe700 1 -- 172.21.15.107:0/159736166 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c001d070 con 0x7fc8cc101a00 2023-08-10T10:50:20.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.272+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc1a06a0 con 0x7fc8cc101a00 2023-08-10T10:50:20.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.272+0000 7fc8bb7fe700 1 -- 172.21.15.107:0/159736166 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8c0004100 con 0x7fc8cc101a00 2023-08-10T10:50:20.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.272+0000 7fc8bb7fe700 1 -- 172.21.15.107:0/159736166 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0022db0 con 0x7fc8cc101a00 2023-08-10T10:50:20.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.272+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc1a0ac0 con 0x7fc8cc101a00 2023-08-10T10:50:20.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.273+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc107ea0 con 0x7fc8cc101a00 2023-08-10T10:50:20.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.275+0000 7fc8bb7fe700 1 -- 172.21.15.107:0/159736166 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fc8c0022470 con 0x7fc8cc101a00 2023-08-10T10:50:20.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.276+0000 7fc8bb7fe700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc8b40a11e0 0x7fc8b40a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:20.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.277+0000 7fc8bb7fe700 1 -- 172.21.15.107:0/159736166 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fc8c00ce2f0 con 0x7fc8cc101a00 2023-08-10T10:50:20.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.277+0000 7fc8ca59c700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc8b40a11e0 0x7fc8b40a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:20.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.277+0000 7fc8ca59c700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc8b40a11e0 0x7fc8b40a36a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc101860 tx=0x7fc8bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:20.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.281+0000 7fc8bb7fe700 1 -- 172.21.15.107:0/159736166 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc8c00975f0 con 0x7fc8cc101a00 2023-08-10T10:50:20.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.488+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8cc060bb0 con 0x7fc8b40a11e0 2023-08-10T10:50:20.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.490+0000 7fc8bb7fe700 1 -- 172.21.15.107:0/159736166 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc8cc060bb0 con 0x7fc8b40a11e0 2023-08-10T10:50:20.491 INFO:teuthology.orchestra.run.smithi107.stdout:Backend: cephadm 2023-08-10T10:50:20.491 INFO:teuthology.orchestra.run.smithi107.stdout:Available: Yes 2023-08-10T10:50:20.491 INFO:teuthology.orchestra.run.smithi107.stdout:Paused: No 2023-08-10T10:50:20.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc8b40a11e0 msgr2=0x7fc8b40a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:20.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc8b40a11e0 0x7fc8b40a36a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc101860 tx=0x7fc8bc00b410 comp rx=0 tx=0).stop 2023-08-10T10:50:20.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 msgr2=0x7fc8cc072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:20.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 0x7fc8cc072b60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000b580 tx=0x7fc8c0005740 comp rx=0 tx=0).stop 2023-08-10T10:50:20.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 shutdown_connections 2023-08-10T10:50:20.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc8b40a11e0 0x7fc8b40a36a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8cc100800 0x7fc8cc074510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8cc1023a0 0x7fc8cc0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 --2- 172.21.15.107:0/159736166 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8cc101a00 0x7fc8cc072b60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:20.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 >> 172.21.15.107:0/159736166 conn(0x7fc8cc0fbd60 msgr2=0x7fc8cc104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:20.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 shutdown_connections 2023-08-10T10:50:20.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:20.492+0000 7fc8d0f37700 1 -- 172.21.15.107:0/159736166 wait complete. 2023-08-10T10:50:20.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:20 smithi107 ceph-mon[127953]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-08-10T10:50:21.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- bash -c 'ceph orch ps' 2023-08-10T10:50:21.033 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:20 smithi195 ceph-mon[129938]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-08-10T10:50:21.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:20 smithi157 ceph-mon[129604]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-08-10T10:50:21.746 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:22.001 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:21 smithi107 ceph-mon[127953]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:21 smithi157 ceph-mon[129604]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:22.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:21 smithi195 ceph-mon[129938]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:22.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:22 smithi107 ceph-mon[127953]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-08-10T10:50:23.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:22 smithi157 ceph-mon[129604]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-08-10T10:50:23.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:22 smithi195 ceph-mon[129938]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-08-10T10:50:23.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.285+0000 7f6c206d9700 1 -- 172.21.15.107:0/33477607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18100800 msgr2=0x7f6c18100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:23.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.285+0000 7f6c206d9700 1 --2- 172.21.15.107:0/33477607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18100800 0x7f6c18100c20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6c140099c0 tx=0x7f6c14009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.285+0000 7f6c206d9700 1 -- 172.21.15.107:0/33477607 shutdown_connections 2023-08-10T10:50:23.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.285+0000 7f6c206d9700 1 --2- 172.21.15.107:0/33477607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c181023a0 0x7f6c18108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.285+0000 7f6c206d9700 1 --2- 172.21.15.107:0/33477607 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18100800 0x7f6c18100c20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.285+0000 7f6c206d9700 1 --2- 172.21.15.107:0/33477607 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c18101a00 0x7f6c18101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.285+0000 7f6c206d9700 1 -- 172.21.15.107:0/33477607 >> 172.21.15.107:0/33477607 conn(0x7f6c180fbd60 msgr2=0x7f6c180fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:23.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.285+0000 7f6c206d9700 1 -- 172.21.15.107:0/33477607 shutdown_connections 2023-08-10T10:50:23.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.285+0000 7f6c206d9700 1 -- 172.21.15.107:0/33477607 wait complete. 2023-08-10T10:50:23.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.286+0000 7f6c206d9700 1 Processor -- start 2023-08-10T10:50:23.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c206d9700 1 -- start start 2023-08-10T10:50:23.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c206d9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c18100800 0x7f6c18074510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:23.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c206d9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18101a00 0x7f6c18072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:23.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c206d9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c181023a0 0x7f6c180730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:23.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c206d9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18073820 con 0x7f6c18101a00 2023-08-10T10:50:23.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c206d9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18073990 con 0x7f6c18100800 2023-08-10T10:50:23.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c206d9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c181a0490 con 0x7f6c181023a0 2023-08-10T10:50:23.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c1dc74700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18101a00 0x7f6c18072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:23.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c1dc74700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18101a00 0x7f6c18072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58762/0 (socket says 172.21.15.107:58762) 2023-08-10T10:50:23.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c1dc74700 1 -- 172.21.15.107:0/479116058 learned_addr learned my addr 172.21.15.107:0/479116058 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:23.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c1e475700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c18100800 0x7f6c18074510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:23.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.287+0000 7f6c1ec76700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c181023a0 0x7f6c180730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:23.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c1dc74700 1 -- 172.21.15.107:0/479116058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c181023a0 msgr2=0x7f6c180730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:23.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c1dc74700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c181023a0 0x7f6c180730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c1dc74700 1 -- 172.21.15.107:0/479116058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c18100800 msgr2=0x7f6c18074510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:23.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c1dc74700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c18100800 0x7f6c18074510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c1dc74700 1 -- 172.21.15.107:0/479116058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140095f0 con 0x7f6c18101a00 2023-08-10T10:50:23.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c1dc74700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18101a00 0x7f6c18072b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800d950 tx=0x7f6c0800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:23.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c0f7fe700 1 -- 172.21.15.107:0/479116058 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800f890 con 0x7f6c18101a00 2023-08-10T10:50:23.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c0f7fe700 1 -- 172.21.15.107:0/479116058 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c0800fe80 con 0x7f6c18101a00 2023-08-10T10:50:23.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c181a0770 con 0x7f6c18101a00 2023-08-10T10:50:23.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c0f7fe700 1 -- 172.21.15.107:0/479116058 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800e3b0 con 0x7f6c18101a00 2023-08-10T10:50:23.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.288+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c181a0c70 con 0x7f6c18101a00 2023-08-10T10:50:23.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.290+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1810bf00 con 0x7f6c18101a00 2023-08-10T10:50:23.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.291+0000 7f6c0f7fe700 1 -- 172.21.15.107:0/479116058 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f6c08010460 con 0x7f6c18101a00 2023-08-10T10:50:23.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.293+0000 7f6c0f7fe700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6c040a11e0 0x7f6c040a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:23.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.293+0000 7f6c0f7fe700 1 -- 172.21.15.107:0/479116058 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f6c080ccbc0 con 0x7f6c18101a00 2023-08-10T10:50:23.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.293+0000 7f6c1e475700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6c040a11e0 0x7f6c040a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:23.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.294+0000 7f6c1e475700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6c040a11e0 0x7f6c040a36a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009990 tx=0x7f6c1400b9b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:23.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.297+0000 7f6c0f7fe700 1 -- 172.21.15.107:0/479116058 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6c08095e30 con 0x7f6c18101a00 2023-08-10T10:50:23.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.501+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c181a12b0 con 0x7f6c040a11e0 2023-08-10T10:50:23.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.514+0000 7f6c0f7fe700 1 -- 172.21.15.107:0/479116058 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f6c181a12b0 con 0x7f6c040a11e0 2023-08-10T10:50:23.515 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-08-10T10:50:23.515 INFO:teuthology.orchestra.run.smithi107.stdout:mds.a smithi107 running (110s) - 109s 16.0M - 18.0.0-5118-ga8bf445f 97af32c09d74 f70181fcdfd8 2023-08-10T10:50:23.515 INFO:teuthology.orchestra.run.smithi107.stdout:mds.b smithi157 running (106s) - 106s 29.7M - 18.0.0-5118-ga8bf445f 97af32c09d74 82b9b8bd815c 2023-08-10T10:50:23.516 INFO:teuthology.orchestra.run.smithi107.stdout:mds.c smithi195 running (2m) - 2m 17.3M - 18.0.0-5118-ga8bf445f 97af32c09d74 b7cab99e727d 2023-08-10T10:50:23.516 INFO:teuthology.orchestra.run.smithi107.stdout:mds.d smithi107 running (2m) - 2m 16.1M - 18.0.0-5118-ga8bf445f 97af32c09d74 f55095a96c36 2023-08-10T10:50:23.516 INFO:teuthology.orchestra.run.smithi107.stdout:mds.e smithi157 running (2m) - 2m 18.1M - 18.0.0-5118-ga8bf445f 97af32c09d74 f45f05f32182 2023-08-10T10:50:23.516 INFO:teuthology.orchestra.run.smithi107.stdout:mds.f smithi195 running (2m) - 2m 18.0M - 18.0.0-5118-ga8bf445f 97af32c09d74 3d917812b19d 2023-08-10T10:50:23.516 INFO:teuthology.orchestra.run.smithi107.stdout:mds.g smithi107 running (113s) - 112s 15.9M - 18.0.0-5118-ga8bf445f 97af32c09d74 1940a3bf22d4 2023-08-10T10:50:23.517 INFO:teuthology.orchestra.run.smithi107.stdout:mds.h smithi157 running (119s) - 119s 16.0M - 18.0.0-5118-ga8bf445f 97af32c09d74 7bcc35bf42d3 2023-08-10T10:50:23.517 INFO:teuthology.orchestra.run.smithi107.stdout:mds.i smithi195 running (116s) - 116s 17.6M - 18.0.0-5118-ga8bf445f 97af32c09d74 fc9d9f7ed2a6 2023-08-10T10:50:23.517 INFO:teuthology.orchestra.run.smithi107.stdout:mds.j smithi107 running (2m) - 2m 13.9M - 18.0.0-5118-ga8bf445f 97af32c09d74 61e43924c977 2023-08-10T10:50:23.517 INFO:teuthology.orchestra.run.smithi107.stdout:mds.k smithi157 running (2m) - 2m 13.9M - 18.0.0-5118-ga8bf445f 97af32c09d74 4f4309c16dcb 2023-08-10T10:50:23.517 INFO:teuthology.orchestra.run.smithi107.stdout:mds.l smithi195 running (2m) - 2m 17.4M - 18.0.0-5118-ga8bf445f 97af32c09d74 3a0b439108af 2023-08-10T10:50:23.518 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.x smithi107 *:9283,8765 running (10m) - 10m 524M - 18.0.0-5118-ga8bf445f 97af32c09d74 5daa8652a44e 2023-08-10T10:50:23.518 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.y smithi157 *:8443,8765 running (7m) - 7m 449M - 18.0.0-5118-ga8bf445f 97af32c09d74 a00097e92d45 2023-08-10T10:50:23.518 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.z smithi195 *:8443,8765 running (8m) - 8m 449M - 18.0.0-5118-ga8bf445f 97af32c09d74 b33feea0f47c 2023-08-10T10:50:23.518 INFO:teuthology.orchestra.run.smithi107.stdout:mon.a smithi107 running (10m) - 10m 100M 2048M 18.0.0-5118-ga8bf445f 97af32c09d74 c2ce6b5f6d2f 2023-08-10T10:50:23.518 INFO:teuthology.orchestra.run.smithi107.stdout:mon.b smithi157 running (8m) - 8m 67.3M 2048M 18.0.0-5118-ga8bf445f 97af32c09d74 00437ddcbe9f 2023-08-10T10:50:23.519 INFO:teuthology.orchestra.run.smithi107.stdout:mon.c smithi195 running (8m) - 8m 66.7M 2048M 18.0.0-5118-ga8bf445f 97af32c09d74 5acaaa59cee8 2023-08-10T10:50:23.519 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (7m) - 7m 72.9M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 6adf7887b0bb 2023-08-10T10:50:23.519 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi157 running (7m) - 7m 80.9M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 9de6d2916da4 2023-08-10T10:50:23.519 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi195 running (6m) - 6m 77.1M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 87fb08b27f2c 2023-08-10T10:50:23.519 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi107 running (6m) - 6m 67.9M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 31bb93de1564 2023-08-10T10:50:23.519 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi157 running (5m) - 5m 65.9M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 b1c879013c45 2023-08-10T10:50:23.520 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi195 running (5m) - 5m 70.5M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 e094eccb88ee 2023-08-10T10:50:23.520 INFO:teuthology.orchestra.run.smithi107.stdout:osd.6 smithi107 running (4m) - 4m 63.8M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 0f2263581c94 2023-08-10T10:50:23.520 INFO:teuthology.orchestra.run.smithi107.stdout:osd.7 smithi157 running (4m) - 4m 67.8M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 29cf69da5540 2023-08-10T10:50:23.520 INFO:teuthology.orchestra.run.smithi107.stdout:osd.8 smithi195 running (4m) - 4m 63.4M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 8f136ffbcf48 2023-08-10T10:50:23.520 INFO:teuthology.orchestra.run.smithi107.stdout:osd.9 smithi107 running (3m) - 3m 62.3M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 11e4f3ffcbb9 2023-08-10T10:50:23.521 INFO:teuthology.orchestra.run.smithi107.stdout:osd.10 smithi157 running (3m) - 3m 66.6M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 3c1f00b26792 2023-08-10T10:50:23.521 INFO:teuthology.orchestra.run.smithi107.stdout:osd.11 smithi195 running (2m) - 2m 57.3M 4316M 18.0.0-5118-ga8bf445f 97af32c09d74 a6dc373b3145 2023-08-10T10:50:23.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6c040a11e0 msgr2=0x7f6c040a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:23.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6c040a11e0 0x7f6c040a36a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009990 tx=0x7f6c1400b9b0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18101a00 msgr2=0x7f6c18072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:23.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18101a00 0x7f6c18072b60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800d950 tx=0x7f6c0800dc60 comp rx=0 tx=0).stop 2023-08-10T10:50:23.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 shutdown_connections 2023-08-10T10:50:23.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6c040a11e0 0x7f6c040a36a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c18100800 0x7f6c18074510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c181023a0 0x7f6c180730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 --2- 172.21.15.107:0/479116058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c18101a00 0x7f6c18072b60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:23.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 >> 172.21.15.107:0/479116058 conn(0x7f6c180fbd60 msgr2=0x7f6c180fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:23.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 shutdown_connections 2023-08-10T10:50:23.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:23.516+0000 7f6c206d9700 1 -- 172.21.15.107:0/479116058 wait complete. 2023-08-10T10:50:24.041 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- bash -c 'ceph orch ls' 2023-08-10T10:50:24.762 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:25.012 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:24 smithi107 ceph-mon[127953]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:25.012 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:24 smithi107 ceph-mon[127953]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T10:50:25.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:24 smithi157 ceph-mon[129604]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:25.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:24 smithi157 ceph-mon[129604]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T10:50:25.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:24 smithi195 ceph-mon[129938]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:25.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:24 smithi195 ceph-mon[129938]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-08-10T10:50:26.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.278+0000 7f82ce966700 1 -- 172.21.15.107:0/3487803138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c81023a0 msgr2=0x7f82c8108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:26.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.278+0000 7f82ce966700 1 --2- 172.21.15.107:0/3487803138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c81023a0 0x7f82c8108c50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f82c000b0d0 tx=0x7f82c000b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.278+0000 7f82ce966700 1 -- 172.21.15.107:0/3487803138 shutdown_connections 2023-08-10T10:50:26.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.278+0000 7f82ce966700 1 --2- 172.21.15.107:0/3487803138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c81023a0 0x7f82c8108c50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.278+0000 7f82ce966700 1 --2- 172.21.15.107:0/3487803138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8100800 0x7f82c8100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.278+0000 7f82ce966700 1 --2- 172.21.15.107:0/3487803138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82c8101a00 0x7f82c8101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.278+0000 7f82ce966700 1 -- 172.21.15.107:0/3487803138 >> 172.21.15.107:0/3487803138 conn(0x7f82c80fbd60 msgr2=0x7f82c80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:26.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.278+0000 7f82ce966700 1 -- 172.21.15.107:0/3487803138 shutdown_connections 2023-08-10T10:50:26.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.278+0000 7f82ce966700 1 -- 172.21.15.107:0/3487803138 wait complete. 2023-08-10T10:50:26.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.279+0000 7f82ce966700 1 Processor -- start 2023-08-10T10:50:26.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.279+0000 7f82ce966700 1 -- start start 2023-08-10T10:50:26.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82ce966700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8100800 0x7f82c8074510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:26.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82ce966700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c8101a00 0x7f82c8072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:26.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82ce966700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82c81023a0 0x7f82c80730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:26.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82ce966700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8073820 con 0x7f82c8101a00 2023-08-10T10:50:26.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82ce966700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8073990 con 0x7f82c81023a0 2023-08-10T10:50:26.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82ce966700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c81a0550 con 0x7f82c8100800 2023-08-10T10:50:26.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82c77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c8101a00 0x7f82c8072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:26.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82c77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c8101a00 0x7f82c8072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58774/0 (socket says 172.21.15.107:58774) 2023-08-10T10:50:26.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82c77fe700 1 -- 172.21.15.107:0/1710460771 learned_addr learned my addr 172.21.15.107:0/1710460771 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:26.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82c7fff700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8100800 0x7f82c8074510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:26.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82c77fe700 1 -- 172.21.15.107:0/1710460771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8100800 msgr2=0x7f82c8074510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:26.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82ccf03700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82c81023a0 0x7f82c80730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:26.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82c77fe700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8100800 0x7f82c8074510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82c77fe700 1 -- 172.21.15.107:0/1710460771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82c81023a0 msgr2=0x7f82c80730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:26.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82c77fe700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82c81023a0 0x7f82c80730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.280+0000 7f82c77fe700 1 -- 172.21.15.107:0/1710460771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c0009d00 con 0x7f82c8101a00 2023-08-10T10:50:26.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.281+0000 7f82c7fff700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8100800 0x7f82c8074510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:26.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.281+0000 7f82ccf03700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82c81023a0 0x7f82c80730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:26.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.281+0000 7f82c77fe700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c8101a00 0x7f82c8072b60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00d980 tx=0x7f82bc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:26.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.281+0000 7f82c57fa700 1 -- 172.21.15.107:0/1710460771 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00bb60 con 0x7f82c8101a00 2023-08-10T10:50:26.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.281+0000 7f82c57fa700 1 -- 172.21.15.107:0/1710460771 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82bc007640 con 0x7f82c8101a00 2023-08-10T10:50:26.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.281+0000 7f82c57fa700 1 -- 172.21.15.107:0/1710460771 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc004d60 con 0x7f82c8101a00 2023-08-10T10:50:26.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.281+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c81a0830 con 0x7f82c8101a00 2023-08-10T10:50:26.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.281+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c81a0ce0 con 0x7f82c8101a00 2023-08-10T10:50:26.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.282+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c8107e50 con 0x7f82c8101a00 2023-08-10T10:50:26.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.284+0000 7f82c57fa700 1 -- 172.21.15.107:0/1710460771 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f82bc004020 con 0x7f82c8101a00 2023-08-10T10:50:26.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.286+0000 7f82c57fa700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82b00a1260 0x7f82b00a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:26.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.286+0000 7f82c57fa700 1 -- 172.21.15.107:0/1710460771 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f82bc0ccc50 con 0x7f82c8101a00 2023-08-10T10:50:26.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.286+0000 7f82c7fff700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82b00a1260 0x7f82b00a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:26.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.286+0000 7f82c7fff700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82b00a1260 0x7f82b00a3720 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f82c8101860 tx=0x7f82b8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:26.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.289+0000 7f82c57fa700 1 -- 172.21.15.107:0/1710460771 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f82bc095ec0 con 0x7f82c8101a00 2023-08-10T10:50:26.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.494+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f82c8060bb0 con 0x7f82b00a1260 2023-08-10T10:50:26.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.499+0000 7f82c57fa700 1 -- 172.21.15.107:0/1710460771 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f82c8060bb0 con 0x7f82b00a1260 2023-08-10T10:50:26.499 INFO:teuthology.orchestra.run.smithi107.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-08-10T10:50:26.499 INFO:teuthology.orchestra.run.smithi107.stdout:mds.all 12/12 - 2m smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-08-10T10:50:26.499 INFO:teuthology.orchestra.run.smithi107.stdout:mgr 3/3 - 8m smithi107=x;smithi157=y;smithi195=z;count:3 2023-08-10T10:50:26.499 INFO:teuthology.orchestra.run.smithi107.stdout:mon 3/3 - 8m smithi107:172.21.15.107=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c;count:3 2023-08-10T10:50:26.499 INFO:teuthology.orchestra.run.smithi107.stdout:osd 12 - - 2023-08-10T10:50:26.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.501+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82b00a1260 msgr2=0x7f82b00a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:26.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.501+0000 7f82ce966700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82b00a1260 0x7f82b00a3720 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f82c8101860 tx=0x7f82b8009260 comp rx=0 tx=0).stop 2023-08-10T10:50:26.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.501+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c8101a00 msgr2=0x7f82c8072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:26.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.501+0000 7f82ce966700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c8101a00 0x7f82c8072b60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00d980 tx=0x7f82bc00dd40 comp rx=0 tx=0).stop 2023-08-10T10:50:26.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.502+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 shutdown_connections 2023-08-10T10:50:26.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.502+0000 7f82ce966700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82b00a1260 0x7f82b00a3720 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.502+0000 7f82ce966700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82c81023a0 0x7f82c80730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.502+0000 7f82ce966700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8100800 0x7f82c8074510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.502+0000 7f82ce966700 1 --2- 172.21.15.107:0/1710460771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f82c8101a00 0x7f82c8072b60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:26.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.502+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 >> 172.21.15.107:0/1710460771 conn(0x7f82c80fbd60 msgr2=0x7f82c8104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:26.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.502+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 shutdown_connections 2023-08-10T10:50:26.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:26.502+0000 7f82ce966700 1 -- 172.21.15.107:0/1710460771 wait complete. 2023-08-10T10:50:26.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:26 smithi107 ceph-mon[127953]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-10T10:50:27.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:26 smithi157 ceph-mon[129604]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-10T10:50:27.052 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- bash -c 'ceph orch host ls' 2023-08-10T10:50:27.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:26 smithi195 ceph-mon[129938]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-10T10:50:27.773 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:28.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:27 smithi157 ceph-mon[129604]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:28.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:27 smithi107 ceph-mon[127953]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:28.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:27 smithi195 ceph-mon[129938]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:29.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:28 smithi157 ceph-mon[129604]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T10:50:29.065 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:28 smithi107 ceph-mon[127953]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T10:50:29.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:28 smithi195 ceph-mon[129938]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T10:50:29.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.309+0000 7fbd9ce15700 1 -- 172.21.15.107:0/3812604901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98101a00 msgr2=0x7fbd98101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:29.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.309+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/3812604901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98101a00 0x7fbd98101e60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0099c0 tx=0x7fbd8c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.310+0000 7fbd9ce15700 1 -- 172.21.15.107:0/3812604901 shutdown_connections 2023-08-10T10:50:29.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.310+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/3812604901 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd981023a0 0x7fbd98108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.310+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/3812604901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd98100800 0x7fbd98100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.310+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/3812604901 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98101a00 0x7fbd98101e60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.310+0000 7fbd9ce15700 1 -- 172.21.15.107:0/3812604901 >> 172.21.15.107:0/3812604901 conn(0x7fbd980fbd60 msgr2=0x7fbd980fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:29.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.310+0000 7fbd9ce15700 1 -- 172.21.15.107:0/3812604901 shutdown_connections 2023-08-10T10:50:29.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.310+0000 7fbd9ce15700 1 -- 172.21.15.107:0/3812604901 wait complete. 2023-08-10T10:50:29.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9ce15700 1 Processor -- start 2023-08-10T10:50:29.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9ce15700 1 -- start start 2023-08-10T10:50:29.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9ce15700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98100800 0x7fbd98198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:29.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9ce15700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd98101a00 0x7fbd98198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:29.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9ce15700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd981023a0 0x7fbd9819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:29.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9ce15700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd981a01d0 con 0x7fbd98100800 2023-08-10T10:50:29.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9ce15700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd981a0310 con 0x7fbd981023a0 2023-08-10T10:50:29.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9ce15700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd981a04a0 con 0x7fbd98101a00 2023-08-10T10:50:29.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98100800 0x7fbd98198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:29.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98100800 0x7fbd98198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58792/0 (socket says 172.21.15.107:58792) 2023-08-10T10:50:29.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.311+0000 7fbd9659c700 1 -- 172.21.15.107:0/763756417 learned_addr learned my addr 172.21.15.107:0/763756417 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:29.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd96d9d700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd981023a0 0x7fbd9819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:29.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd95d9b700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd98101a00 0x7fbd98198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:29.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd9659c700 1 -- 172.21.15.107:0/763756417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd98101a00 msgr2=0x7fbd98198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:29.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd9659c700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd98101a00 0x7fbd98198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd9659c700 1 -- 172.21.15.107:0/763756417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd981023a0 msgr2=0x7fbd9819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:29.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd9659c700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd981023a0 0x7fbd9819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd9659c700 1 -- 172.21.15.107:0/763756417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0095f0 con 0x7fbd98100800 2023-08-10T10:50:29.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd95d9b700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd98101a00 0x7fbd98198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:29.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd9659c700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98100800 0x7fbd98198640 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800e9a0 tx=0x7fbd8800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:29.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd877fe700 1 -- 172.21.15.107:0/763756417 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd88009790 con 0x7fbd98100800 2023-08-10T10:50:29.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd877fe700 1 -- 172.21.15.107:0/763756417 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd880044b0 con 0x7fbd98100800 2023-08-10T10:50:29.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd981a0780 con 0x7fbd98100800 2023-08-10T10:50:29.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.312+0000 7fbd877fe700 1 -- 172.21.15.107:0/763756417 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd88003c60 con 0x7fbd98100800 2023-08-10T10:50:29.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.313+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd981a0cd0 con 0x7fbd98100800 2023-08-10T10:50:29.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.314+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd98192cf0 con 0x7fbd98100800 2023-08-10T10:50:29.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.316+0000 7fbd877fe700 1 -- 172.21.15.107:0/763756417 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fbd88003dc0 con 0x7fbd98100800 2023-08-10T10:50:29.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.317+0000 7fbd877fe700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbd800a1260 0x7fbd800a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:29.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.317+0000 7fbd877fe700 1 -- 172.21.15.107:0/763756417 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fbd88014070 con 0x7fbd98100800 2023-08-10T10:50:29.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.317+0000 7fbd95d9b700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbd800a1260 0x7fbd800a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:29.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.318+0000 7fbd95d9b700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbd800a1260 0x7fbd800a3720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00b580 tx=0x7fbd8c01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:29.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.321+0000 7fbd877fe700 1 -- 172.21.15.107:0/763756417 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fbd880962b0 con 0x7fbd98100800 2023-08-10T10:50:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.522+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd98060bb0 con 0x7fbd800a1260 2023-08-10T10:50:29.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.524+0000 7fbd877fe700 1 -- 172.21.15.107:0/763756417 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fbd98060bb0 con 0x7fbd800a1260 2023-08-10T10:50:29.525 INFO:teuthology.orchestra.run.smithi107.stdout:HOST ADDR LABELS STATUS 2023-08-10T10:50:29.526 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107 172.21.15.107 2023-08-10T10:50:29.526 INFO:teuthology.orchestra.run.smithi107.stdout:smithi157 172.21.15.157 2023-08-10T10:50:29.526 INFO:teuthology.orchestra.run.smithi107.stdout:smithi195 172.21.15.195 2023-08-10T10:50:29.526 INFO:teuthology.orchestra.run.smithi107.stdout:3 hosts in cluster 2023-08-10T10:50:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.526+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbd800a1260 msgr2=0x7fbd800a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.526+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbd800a1260 0x7fbd800a3720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00b580 tx=0x7fbd8c01a040 comp rx=0 tx=0).stop 2023-08-10T10:50:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.526+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98100800 msgr2=0x7fbd98198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.526+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98100800 0x7fbd98198640 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800e9a0 tx=0x7fbd8800ecb0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.527+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 shutdown_connections 2023-08-10T10:50:29.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.527+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fbd800a1260 0x7fbd800a3720 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.527+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd981023a0 0x7fbd9819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.527+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd98100800 0x7fbd98198640 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.527+0000 7fbd9ce15700 1 --2- 172.21.15.107:0/763756417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd98101a00 0x7fbd98198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:29.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.527+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 >> 172.21.15.107:0/763756417 conn(0x7fbd980fbd60 msgr2=0x7fbd98107410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:29.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.527+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 shutdown_connections 2023-08-10T10:50:29.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:29.527+0000 7fbd9ce15700 1 -- 172.21.15.107:0/763756417 wait complete. 2023-08-10T10:50:30.068 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- bash -c 'ceph orch device ls' 2023-08-10T10:50:30.790 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:30 smithi157 ceph-mon[129604]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:31.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:30 smithi157 ceph-mon[129604]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T10:50:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:30 smithi107 ceph-mon[127953]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:30 smithi107 ceph-mon[127953]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T10:50:31.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:30 smithi195 ceph-mon[129938]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:30 smithi195 ceph-mon[129938]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T10:50:32.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.326+0000 7f7804d6d700 1 -- 172.21.15.107:0/3292898485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800101a00 msgr2=0x7f7800101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:32.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.326+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3292898485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800101a00 0x7f7800101e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f77f40099c0 tx=0x7f77f4009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.326+0000 7f7804d6d700 1 -- 172.21.15.107:0/3292898485 shutdown_connections 2023-08-10T10:50:32.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.326+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3292898485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78001023a0 0x7f7800108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.326+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3292898485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7800100800 0x7f7800100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.326+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3292898485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800101a00 0x7f7800101e60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.326+0000 7f7804d6d700 1 -- 172.21.15.107:0/3292898485 >> 172.21.15.107:0/3292898485 conn(0x7f78000fbd60 msgr2=0x7f78000fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:32.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.327+0000 7f7804d6d700 1 -- 172.21.15.107:0/3292898485 shutdown_connections 2023-08-10T10:50:32.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.327+0000 7f7804d6d700 1 -- 172.21.15.107:0/3292898485 wait complete. 2023-08-10T10:50:32.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f7804d6d700 1 Processor -- start 2023-08-10T10:50:32.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f7804d6d700 1 -- start start 2023-08-10T10:50:32.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f7804d6d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800100800 0x7f78001985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:32.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f7804d6d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7800101a00 0x7f7800198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:32.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f7804d6d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78001023a0 0x7f780019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:32.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f7804d6d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78001a0150 con 0x7f7800100800 2023-08-10T10:50:32.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f7804d6d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78001a0290 con 0x7f78001023a0 2023-08-10T10:50:32.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f7804d6d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78001a0420 con 0x7f7800101a00 2023-08-10T10:50:32.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f77fe59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800100800 0x7f78001985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:32.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f77fe59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800100800 0x7f78001985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58820/0 (socket says 172.21.15.107:58820) 2023-08-10T10:50:32.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.328+0000 7f77fe59c700 1 -- 172.21.15.107:0/3011423287 learned_addr learned my addr 172.21.15.107:0/3011423287 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:32.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fed9d700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78001023a0 0x7f780019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:32.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fe59c700 1 -- 172.21.15.107:0/3011423287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7800101a00 msgr2=0x7f7800198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:32.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fdd9b700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7800101a00 0x7f7800198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:32.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fe59c700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7800101a00 0x7f7800198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fe59c700 1 -- 172.21.15.107:0/3011423287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78001023a0 msgr2=0x7f780019fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:32.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fe59c700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78001023a0 0x7f780019fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fe59c700 1 -- 172.21.15.107:0/3011423287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f40095f0 con 0x7f7800100800 2023-08-10T10:50:32.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fed9d700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78001023a0 0x7f780019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:32.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fdd9b700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7800101a00 0x7f7800198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:32.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77fe59c700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800100800 0x7f78001985c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c9a0 tx=0x7f77f000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:32.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77ef7fe700 1 -- 172.21.15.107:0/3011423287 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0004220 con 0x7f7800100800 2023-08-10T10:50:32.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78001a0700 con 0x7f7800100800 2023-08-10T10:50:32.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77ef7fe700 1 -- 172.21.15.107:0/3011423287 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77f0007cf0 con 0x7f7800100800 2023-08-10T10:50:32.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f77ef7fe700 1 -- 172.21.15.107:0/3011423287 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0003c30 con 0x7f7800100800 2023-08-10T10:50:32.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.329+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78001a0c50 con 0x7f7800100800 2023-08-10T10:50:32.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.331+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7800192cf0 con 0x7f7800100800 2023-08-10T10:50:32.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.333+0000 7f77ef7fe700 1 -- 172.21.15.107:0/3011423287 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f77f0004380 con 0x7f7800100800 2023-08-10T10:50:32.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.334+0000 7f77ef7fe700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f77e80a11e0 0x7f77e80a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:32.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.334+0000 7f77ef7fe700 1 -- 172.21.15.107:0/3011423287 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f77f00cca60 con 0x7f7800100800 2023-08-10T10:50:32.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.334+0000 7f77fdd9b700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f77e80a11e0 0x7f77e80a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:32.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.335+0000 7f77fdd9b700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f77e80a11e0 0x7f77e80a36a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77f4006010 tx=0x7f77f4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:32.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.338+0000 7f77ef7fe700 1 -- 172.21.15.107:0/3011423287 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f77f0095cd0 con 0x7f7800100800 2023-08-10T10:50:32.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.542+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7800060bb0 con 0x7f77e80a11e0 2023-08-10T10:50:32.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.544+0000 7f77ef7fe700 1 -- 172.21.15.107:0/3011423287 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7f7800060bb0 con 0x7f77e80a11e0 2023-08-10T10:50:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-08-10T10:50:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NK400BGN 372G No 3m ago LVM detected, locked 2023-08-10T10:50:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:smithi157 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002V480DGN 447G No 3m ago LVM detected, locked 2023-08-10T10:50:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:smithi195 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300FS480DGN 447G No 2m ago LVM detected, locked 2023-08-10T10:50:32.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f77e80a11e0 msgr2=0x7f77e80a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:32.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f77e80a11e0 0x7f77e80a36a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77f4006010 tx=0x7f77f4000bc0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800100800 msgr2=0x7f78001985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:32.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800100800 0x7f78001985c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c9a0 tx=0x7f77f000cd60 comp rx=0 tx=0).stop 2023-08-10T10:50:32.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 shutdown_connections 2023-08-10T10:50:32.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f77e80a11e0 0x7f77e80a36a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78001023a0 0x7f780019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7800100800 0x7f78001985c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 --2- 172.21.15.107:0/3011423287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7800101a00 0x7f7800198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:32.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 >> 172.21.15.107:0/3011423287 conn(0x7f78000fbd60 msgr2=0x7f7800107360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:32.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.546+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 shutdown_connections 2023-08-10T10:50:32.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:32.547+0000 7f7804d6d700 1 -- 172.21.15.107:0/3011423287 wait complete. 2023-08-10T10:50:32.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:32 smithi107 ceph-mon[127953]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T10:50:33.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:32 smithi157 ceph-mon[129604]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T10:50:33.084 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-08-10T10:50:33.099 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T10:50:33.100 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- bash -c 'ceph fs dump' 2023-08-10T10:50:33.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:32 smithi195 ceph-mon[129938]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T10:50:33.824 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:34.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:33 smithi157 ceph-mon[129604]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:33 smithi107 ceph-mon[127953]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:34.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:33 smithi195 ceph-mon[129938]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:50:35.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:34 smithi157 ceph-mon[129604]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T10:50:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:34 smithi107 ceph-mon[127953]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T10:50:35.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:34 smithi195 ceph-mon[129938]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-08-10T10:50:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.333+0000 7fe7ffc79700 1 -- 172.21.15.107:0/2153007195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f8100800 msgr2=0x7fe7f8100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.333+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/2153007195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f8100800 0x7fe7f8100c20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40099c0 tx=0x7fe7f4009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.333+0000 7fe7ffc79700 1 -- 172.21.15.107:0/2153007195 shutdown_connections 2023-08-10T10:50:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.333+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/2153007195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7f81023a0 0x7fe7f8108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.333+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/2153007195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f8100800 0x7fe7f8100c20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.333+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/2153007195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f8101a00 0x7fe7f8101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.333+0000 7fe7ffc79700 1 -- 172.21.15.107:0/2153007195 >> 172.21.15.107:0/2153007195 conn(0x7fe7f80fbd60 msgr2=0x7fe7f80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:35.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.333+0000 7fe7ffc79700 1 -- 172.21.15.107:0/2153007195 shutdown_connections 2023-08-10T10:50:35.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.333+0000 7fe7ffc79700 1 -- 172.21.15.107:0/2153007195 wait complete. 2023-08-10T10:50:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.334+0000 7fe7ffc79700 1 Processor -- start 2023-08-10T10:50:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7ffc79700 1 -- start start 2023-08-10T10:50:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7ffc79700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7f8100800 0x7fe7f8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7ffc79700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f8101a00 0x7fe7f8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7ffc79700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f81023a0 0x7fe7f819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7ffc79700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f81a0090 con 0x7fe7f81023a0 2023-08-10T10:50:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7ffc79700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f81a01d0 con 0x7fe7f8101a00 2023-08-10T10:50:35.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7ffc79700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f81a0360 con 0x7fe7f8100800 2023-08-10T10:50:35.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7fe216700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f81023a0 0x7fe7f819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:35.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7fe216700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f81023a0 0x7fe7f819fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48328/0 (socket says 172.21.15.107:48328) 2023-08-10T10:50:35.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7fe216700 1 -- 172.21.15.107:0/4008256715 learned_addr learned my addr 172.21.15.107:0/4008256715 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:35.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7fda15700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7f8100800 0x7fe7f8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:35.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.335+0000 7fe7fd214700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f8101a00 0x7fe7f8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:35.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7fe216700 1 -- 172.21.15.107:0/4008256715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7f8100800 msgr2=0x7fe7f8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7fe216700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7f8100800 0x7fe7f8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7fe216700 1 -- 172.21.15.107:0/4008256715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f8101a00 msgr2=0x7fe7f8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7fe216700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f8101a00 0x7fe7f8198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7fe216700 1 -- 172.21.15.107:0/4008256715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f40095f0 con 0x7fe7f81023a0 2023-08-10T10:50:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7fe216700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f81023a0 0x7fe7f819fac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0007da0 tx=0x7fe7f000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7eeffd700 1 -- 172.21.15.107:0/4008256715 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000ac50 con 0x7fe7f81023a0 2023-08-10T10:50:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7eeffd700 1 -- 172.21.15.107:0/4008256715 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7f000adb0 con 0x7fe7f81023a0 2023-08-10T10:50:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f81a0640 con 0x7fe7f81023a0 2023-08-10T10:50:35.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7eeffd700 1 -- 172.21.15.107:0/4008256715 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00115e0 con 0x7fe7f81023a0 2023-08-10T10:50:35.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.336+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f81a0b90 con 0x7fe7f81023a0 2023-08-10T10:50:35.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.338+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f8192ca0 con 0x7fe7f81023a0 2023-08-10T10:50:35.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.339+0000 7fe7eeffd700 1 -- 172.21.15.107:0/4008256715 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fe7f0012420 con 0x7fe7f81023a0 2023-08-10T10:50:35.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.341+0000 7fe7eeffd700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7e40a1260 0x7fe7e40a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:35.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.341+0000 7fe7eeffd700 1 -- 172.21.15.107:0/4008256715 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fe7f00ccea0 con 0x7fe7f81023a0 2023-08-10T10:50:35.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.341+0000 7fe7fda15700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7e40a1260 0x7fe7e40a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:35.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.342+0000 7fe7fda15700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7e40a1260 0x7fe7e40a3720 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009990 tx=0x7fe7f400ba90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:35.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.345+0000 7fe7eeffd700 1 -- 172.21.15.107:0/4008256715 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe7f0096220 con 0x7fe7f81023a0 2023-08-10T10:50:35.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.581+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe7f802c970 con 0x7fe7f81023a0 2023-08-10T10:50:35.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.582+0000 7fe7eeffd700 1 -- 172.21.15.107:0/4008256715 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2943 (secure 0 0 0) 0x7fe7f0016b90 con 0x7fe7f81023a0 2023-08-10T10:50:35.584 INFO:teuthology.orchestra.run.smithi107.stdout:e27 2023-08-10T10:50:35.584 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-08-10T10:50:35.584 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-08-10T10:50:35.584 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2023-08-10T10:50:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:35.584 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2023-08-10T10:50:35.584 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2023-08-10T10:50:35.585 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 27 2023-08-10T10:50:35.585 INFO:teuthology.orchestra.run.smithi107.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-08-10T10:50:35.585 INFO:teuthology.orchestra.run.smithi107.stdout:created 2023-08-10T10:48:42.135183+0000 2023-08-10T10:50:35.585 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2023-08-10T10:49:16.643966+0000 2023-08-10T10:50:35.585 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2023-08-10T10:50:35.585 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2023-08-10T10:50:35.586 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 300 2023-08-10T10:50:35.586 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2023-08-10T10:50:35.586 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2023-08-10T10:50:35.586 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2023-08-10T10:50:35.586 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2023-08-10T10:50:35.587 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2023-08-10T10:50:35.587 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 0 2023-08-10T10:50:35.587 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-08-10T10:50:35.587 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 5 2023-08-10T10:50:35.587 INFO:teuthology.orchestra.run.smithi107.stdout:in 0,1,2,3,4 2023-08-10T10:50:35.587 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=24575,1=24571,2=24532,3=24497,4=24469} 2023-08-10T10:50:35.587 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2023-08-10T10:50:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2023-08-10T10:50:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2023-08-10T10:50:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3,4] 2023-08-10T10:50:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2023-08-10T10:50:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2023-08-10T10:50:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2023-08-10T10:50:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2023-08-10T10:50:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 0 2023-08-10T10:50:35.589 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b{0:24575} state up:active seq 3 addr [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.589 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c{0:24550} state up:standby-replay seq 1 addr [v2:172.21.15.195:6836/2175306413,v1:172.21.15.195:6837/2175306413] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.589 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.i{1:24571} state up:active seq 13 addr [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.589 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.h{1:24536} state up:standby-replay seq 1 addr [v2:172.21.15.157:6836/2089201911,v1:172.21.15.157:6837/2089201911] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.589 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.f{2:24532} state up:active seq 15 addr [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.589 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a{2:14682} state up:standby-replay seq 1 addr [v2:172.21.15.107:6840/718281985,v1:172.21.15.107:6841/718281985] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.589 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.e{3:24497} state up:active seq 16 addr [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.589 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.g{3:14670} state up:standby-replay seq 1 addr [v2:172.21.15.107:6838/1945342668,v1:172.21.15.107:6839/1945342668] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.590 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.l{4:24469} state up:active seq 20 addr [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.590 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d{4:14592} state up:standby-replay seq 1 addr [v2:172.21.15.107:6836/1989272471,v1:172.21.15.107:6837/1989272471] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:35.590 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2023-08-10T10:50:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:35.590 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.k{-1:14568} state up:standby seq 1 addr [v2:172.21.15.157:6832/699889592,v1:172.21.15.157:6833/699889592] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.590 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.j{-1:14580} state up:standby seq 1 addr [v2:172.21.15.107:6834/1837769086,v1:172.21.15.107:6835/1837769086] compat {c=[1],r=[1],i=[7ff]}] 2023-08-10T10:50:35.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.584+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7e40a1260 msgr2=0x7fe7e40a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.584+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7e40a1260 0x7fe7e40a3720 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009990 tx=0x7fe7f400ba90 comp rx=0 tx=0).stop 2023-08-10T10:50:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.584+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f81023a0 msgr2=0x7fe7f819fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.584+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f81023a0 0x7fe7f819fac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0007da0 tx=0x7fe7f000a340 comp rx=0 tx=0).stop 2023-08-10T10:50:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.585+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 shutdown_connections 2023-08-10T10:50:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.585+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7e40a1260 0x7fe7e40a3720 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.585+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7f81023a0 0x7fe7f819fac0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.585+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7f8100800 0x7fe7f8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.585+0000 7fe7ffc79700 1 --2- 172.21.15.107:0/4008256715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7f8101a00 0x7fe7f8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:35.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.585+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 >> 172.21.15.107:0/4008256715 conn(0x7fe7f80fbd60 msgr2=0x7fe7f8107330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:35.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.585+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 shutdown_connections 2023-08-10T10:50:35.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:35.585+0000 7fe7ffc79700 1 -- 172.21.15.107:0/4008256715 wait complete. 2023-08-10T10:50:35.593 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:50:36.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:35 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4008256715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-08-10T10:50:36.056 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:35 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4008256715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-08-10T10:50:36.121 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- bash -c 'ceph osd dump' 2023-08-10T10:50:36.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:35 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4008256715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-08-10T10:50:36.844 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:37.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:36 smithi157 ceph-mon[129604]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-10T10:50:37.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:36 smithi107 ceph-mon[127953]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-10T10:50:37.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:36 smithi195 ceph-mon[129938]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-08-10T10:50:38.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.348+0000 7f3499813700 1 -- 172.21.15.107:0/15999544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3494100800 msgr2=0x7f3494100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:38.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.348+0000 7f3499813700 1 --2- 172.21.15.107:0/15999544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3494100800 0x7f3494100c20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f34840099c0 tx=0x7f3484009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.348+0000 7f3499813700 1 -- 172.21.15.107:0/15999544 shutdown_connections 2023-08-10T10:50:38.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.348+0000 7f3499813700 1 --2- 172.21.15.107:0/15999544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34941023a0 0x7f3494108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.348+0000 7f3499813700 1 --2- 172.21.15.107:0/15999544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3494100800 0x7f3494100c20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.348+0000 7f3499813700 1 --2- 172.21.15.107:0/15999544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3494101a00 0x7f3494101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.348+0000 7f3499813700 1 -- 172.21.15.107:0/15999544 >> 172.21.15.107:0/15999544 conn(0x7f34940fbd60 msgr2=0x7f34940fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:38.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.348+0000 7f3499813700 1 -- 172.21.15.107:0/15999544 shutdown_connections 2023-08-10T10:50:38.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.348+0000 7f3499813700 1 -- 172.21.15.107:0/15999544 wait complete. 2023-08-10T10:50:38.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.349+0000 7f3499813700 1 Processor -- start 2023-08-10T10:50:38.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.349+0000 7f3499813700 1 -- start start 2023-08-10T10:50:38.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f3499813700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3494100800 0x7f34941963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:38.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f3499813700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3494101a00 0x7f3494196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:38.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f3499813700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34941023a0 0x7f349419d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:38.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f3499813700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349419df80 con 0x7f34941023a0 2023-08-10T10:50:38.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f3499813700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349419e0c0 con 0x7f3494101a00 2023-08-10T10:50:38.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f3499813700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349419e250 con 0x7f3494100800 2023-08-10T10:50:38.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f34937fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34941023a0 0x7f349419d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:38.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f34937fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34941023a0 0x7f349419d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48360/0 (socket says 172.21.15.107:48360) 2023-08-10T10:50:38.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f34937fe700 1 -- 172.21.15.107:0/1763227969 learned_addr learned my addr 172.21.15.107:0/1763227969 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:38.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f34927fc700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3494101a00 0x7f3494196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:38.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.350+0000 7f3492ffd700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3494100800 0x7f34941963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:38.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f34937fe700 1 -- 172.21.15.107:0/1763227969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3494100800 msgr2=0x7f34941963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:38.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f34937fe700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3494100800 0x7f34941963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f34937fe700 1 -- 172.21.15.107:0/1763227969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3494101a00 msgr2=0x7f3494196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:38.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f34937fe700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3494101a00 0x7f3494196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f34937fe700 1 -- 172.21.15.107:0/1763227969 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840095f0 con 0x7f34941023a0 2023-08-10T10:50:38.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f34937fe700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34941023a0 0x7f349419d9b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f348c00ef60 tx=0x7f348c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:38.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f3498811700 1 -- 172.21.15.107:0/1763227969 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c018070 con 0x7f34941023a0 2023-08-10T10:50:38.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349419e4d0 con 0x7f34941023a0 2023-08-10T10:50:38.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f3498811700 1 -- 172.21.15.107:0/1763227969 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f348c00f040 con 0x7f34941023a0 2023-08-10T10:50:38.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f3498811700 1 -- 172.21.15.107:0/1763227969 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00cc60 con 0x7f34941023a0 2023-08-10T10:50:38.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.351+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349419e9d0 con 0x7f34941023a0 2023-08-10T10:50:38.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.352+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3494107ed0 con 0x7f34941023a0 2023-08-10T10:50:38.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.354+0000 7f3498811700 1 -- 172.21.15.107:0/1763227969 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f348c004ad0 con 0x7f34941023a0 2023-08-10T10:50:38.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.356+0000 7f3498811700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f347c0a11e0 0x7f347c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:38.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.356+0000 7f3498811700 1 -- 172.21.15.107:0/1763227969 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f348c0cc910 con 0x7f34941023a0 2023-08-10T10:50:38.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.356+0000 7f3492ffd700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f347c0a11e0 0x7f347c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:38.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.357+0000 7f3492ffd700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f347c0a11e0 0x7f347c0a36a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3484009990 tx=0x7f348400b9b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:38.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.358+0000 7f3498811700 1 -- 172.21.15.107:0/1763227969 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f348c095c10 con 0x7f34941023a0 2023-08-10T10:50:38.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.553+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f349402c970 con 0x7f34941023a0 2023-08-10T10:50:38.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.554+0000 7f3498811700 1 -- 172.21.15.107:0/1763227969 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v93) v1 ==== 56+0+5631 (secure 0 0 0) 0x7f348c099230 con 0x7f34941023a0 2023-08-10T10:50:38.555 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 93 2023-08-10T10:50:38.555 INFO:teuthology.orchestra.run.smithi107.stdout:fsid 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T10:50:38.556 INFO:teuthology.orchestra.run.smithi107.stdout:created 2023-08-10T10:40:11.953393+0000 2023-08-10T10:50:38.556 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2023-08-10T10:50:13.687527+0000 2023-08-10T10:50:38.556 INFO:teuthology.orchestra.run.smithi107.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-08-10T10:50:38.556 INFO:teuthology.orchestra.run.smithi107.stdout:crush_version 27 2023-08-10T10:50:38.556 INFO:teuthology.orchestra.run.smithi107.stdout:full_ratio 0.95 2023-08-10T10:50:38.556 INFO:teuthology.orchestra.run.smithi107.stdout:backfillfull_ratio 0.9 2023-08-10T10:50:38.557 INFO:teuthology.orchestra.run.smithi107.stdout:nearfull_ratio 0.85 2023-08-10T10:50:38.557 INFO:teuthology.orchestra.run.smithi107.stdout:require_min_compat_client luminous 2023-08-10T10:50:38.557 INFO:teuthology.orchestra.run.smithi107.stdout:min_compat_client luminous 2023-08-10T10:50:38.557 INFO:teuthology.orchestra.run.smithi107.stdout:require_osd_release reef 2023-08-10T10:50:38.557 INFO:teuthology.orchestra.run.smithi107.stdout:stretch_mode_enabled false 2023-08-10T10:50:38.558 INFO:teuthology.orchestra.run.smithi107.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-08-10T10:50:38.558 INFO:teuthology.orchestra.run.smithi107.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-08-10T10:50:38.558 INFO:teuthology.orchestra.run.smithi107.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2023-08-10T10:50:38.558 INFO:teuthology.orchestra.run.smithi107.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-08-10T10:50:38.558 INFO:teuthology.orchestra.run.smithi107.stdout:max_osd 12 2023-08-10T10:50:38.559 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6802/3090277820,v1:172.21.15.107:6803/3090277820] [v2:172.21.15.107:6804/3090277820,v1:172.21.15.107:6805/3090277820] exists,up 6be24c5b-22c4-465b-bbc9-a6debc566b31 2023-08-10T10:50:38.559 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 up in weight 1 up_from 13 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6800/3276667831,v1:172.21.15.157:6801/3276667831] [v2:172.21.15.157:6802/3276667831,v1:172.21.15.157:6803/3276667831] exists,up 1197ceb3-455f-48be-9ed5-978800d57983 2023-08-10T10:50:38.559 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6800/3340307341,v1:172.21.15.195:6801/3340307341] [v2:172.21.15.195:6802/3340307341,v1:172.21.15.195:6803/3340307341] exists,up 733c3626-a769-4765-9316-705c451387ec 2023-08-10T10:50:38.559 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 up in weight 1 up_from 25 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6810/3845563579,v1:172.21.15.107:6811/3845563579] [v2:172.21.15.107:6812/3845563579,v1:172.21.15.107:6813/3845563579] exists,up 499f11fd-b9fc-4945-8b3a-929bc041ca5f 2023-08-10T10:50:38.559 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 up in weight 1 up_from 33 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6808/2085843494,v1:172.21.15.157:6809/2085843494] [v2:172.21.15.157:6810/2085843494,v1:172.21.15.157:6811/2085843494] exists,up a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30 2023-08-10T10:50:38.559 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 up in weight 1 up_from 38 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6808/922097042,v1:172.21.15.195:6809/922097042] [v2:172.21.15.195:6810/922097042,v1:172.21.15.195:6811/922097042] exists,up 4638e56c-4db1-4e41-8916-0063d45f3deb 2023-08-10T10:50:38.560 INFO:teuthology.orchestra.run.smithi107.stdout:osd.6 up in weight 1 up_from 46 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6818/2967097574,v1:172.21.15.107:6819/2967097574] [v2:172.21.15.107:6820/2967097574,v1:172.21.15.107:6821/2967097574] exists,up 4ac5a683-512b-450f-a2a6-b79cce87988f 2023-08-10T10:50:38.560 INFO:teuthology.orchestra.run.smithi107.stdout:osd.7 up in weight 1 up_from 51 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6816/3040537595,v1:172.21.15.157:6817/3040537595] [v2:172.21.15.157:6818/3040537595,v1:172.21.15.157:6819/3040537595] exists,up 41ebd81c-5952-4224-9cd5-ae37fa8885a1 2023-08-10T10:50:38.560 INFO:teuthology.orchestra.run.smithi107.stdout:osd.8 up in weight 1 up_from 59 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6816/2721690831,v1:172.21.15.195:6817/2721690831] [v2:172.21.15.195:6818/2721690831,v1:172.21.15.195:6819/2721690831] exists,up 8b4173ce-ee76-4468-b01e-92713996ea0a 2023-08-10T10:50:38.560 INFO:teuthology.orchestra.run.smithi107.stdout:osd.9 up in weight 1 up_from 67 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6826/48908016,v1:172.21.15.107:6827/48908016] [v2:172.21.15.107:6828/48908016,v1:172.21.15.107:6829/48908016] exists,up 0c771bbc-1eec-4fed-ac65-425b06e9ef59 2023-08-10T10:50:38.560 INFO:teuthology.orchestra.run.smithi107.stdout:osd.10 up in weight 1 up_from 72 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6824/1583160453,v1:172.21.15.157:6825/1583160453] [v2:172.21.15.157:6826/1583160453,v1:172.21.15.157:6827/1583160453] exists,up 56d55b48-d75f-4a1b-a164-308dc2788c93 2023-08-10T10:50:38.560 INFO:teuthology.orchestra.run.smithi107.stdout:osd.11 up in weight 1 up_from 80 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6824/3972031939,v1:172.21.15.195:6825/3972031939] [v2:172.21.15.195:6826/3972031939,v1:172.21.15.195:6827/3972031939] exists,up 36bf890d-e08d-447e-b2c4-7a7c3bd30d06 2023-08-10T10:50:38.560 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 2.13 [2,11] 2023-08-10T10:50:38.561 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 2.1d [8,11] 2023-08-10T10:50:38.561 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 3.3 [4,9] 2023-08-10T10:50:38.561 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 3.b [3,9] 2023-08-10T10:50:38.561 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 3.14 [4,6] 2023-08-10T10:50:38.561 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 3.1d [4,8,5,9] 2023-08-10T10:50:38.561 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 4.9 [5,8] 2023-08-10T10:50:38.561 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 4.16 [9,10] 2023-08-10T10:50:38.561 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 4.17 [9,8] 2023-08-10T10:50:38.562 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 4.1b [9,8] 2023-08-10T10:50:38.562 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:6801/294010818 expires 2023-08-11T10:41:11.475754+0000 2023-08-10T10:50:38.562 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:6800/294010818 expires 2023-08-11T10:41:11.475754+0000 2023-08-10T10:50:38.562 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/2325198765 expires 2023-08-11T10:40:45.031723+0000 2023-08-10T10:50:38.562 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/4249017598 expires 2023-08-11T10:40:45.031723+0000 2023-08-10T10:50:38.562 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/155446065 expires 2023-08-11T10:41:11.475754+0000 2023-08-10T10:50:38.562 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/2780861048 expires 2023-08-11T10:40:45.031723+0000 2023-08-10T10:50:38.562 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:6800/4026286774 expires 2023-08-11T10:40:45.031723+0000 2023-08-10T10:50:38.563 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:6801/4026286774 expires 2023-08-11T10:40:45.031723+0000 2023-08-10T10:50:38.563 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/2396317165 expires 2023-08-11T10:41:11.475754+0000 2023-08-10T10:50:38.563 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/2565207558 expires 2023-08-11T10:41:11.475754+0000 2023-08-10T10:50:38.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.556+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f347c0a11e0 msgr2=0x7f347c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:38.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.556+0000 7f3499813700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f347c0a11e0 0x7f347c0a36a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3484009990 tx=0x7f348400b9b0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.556+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34941023a0 msgr2=0x7f349419d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:38.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.556+0000 7f3499813700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34941023a0 0x7f349419d9b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f348c00ef60 tx=0x7f348c00ef90 comp rx=0 tx=0).stop 2023-08-10T10:50:38.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.557+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 shutdown_connections 2023-08-10T10:50:38.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.557+0000 7f3499813700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f347c0a11e0 0x7f347c0a36a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.557+0000 7f3499813700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34941023a0 0x7f349419d9b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.557+0000 7f3499813700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3494100800 0x7f34941963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.557+0000 7f3499813700 1 --2- 172.21.15.107:0/1763227969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3494101a00 0x7f3494196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:38.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.557+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 >> 172.21.15.107:0/1763227969 conn(0x7f34940fbd60 msgr2=0x7f3494105010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:38.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.557+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 shutdown_connections 2023-08-10T10:50:38.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:38.557+0000 7f3499813700 1 -- 172.21.15.107:0/1763227969 wait complete. 2023-08-10T10:50:39.029 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:38 smithi107 ceph-mon[127953]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T10:50:39.029 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:38 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1763227969' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-08-10T10:50:39.031 INFO:teuthology.run_tasks:Running task fs.ready... 2023-08-10T10:50:39.043 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:39.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:38 smithi157 ceph-mon[129604]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T10:50:39.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:38 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1763227969' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-08-10T10:50:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:38 smithi195 ceph-mon[129938]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-08-10T10:50:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:38 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1763227969' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-08-10T10:50:39.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.246+0000 7f784a5ff700 1 -- 172.21.15.107:0/412046179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844101970 msgr2=0x7f7844101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.246+0000 7f784a5ff700 1 --2- 172.21.15.107:0/412046179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844101970 0x7f7844101dd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f78380099c0 tx=0x7f7838009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.246+0000 7f784a5ff700 1 -- 172.21.15.107:0/412046179 shutdown_connections 2023-08-10T10:50:39.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.246+0000 7f784a5ff700 1 --2- 172.21.15.107:0/412046179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7844102310 0x7f7844108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.246+0000 7f784a5ff700 1 --2- 172.21.15.107:0/412046179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7844100780 0x7f7844100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.246+0000 7f784a5ff700 1 --2- 172.21.15.107:0/412046179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844101970 0x7f7844101dd0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.246+0000 7f784a5ff700 1 -- 172.21.15.107:0/412046179 >> 172.21.15.107:0/412046179 conn(0x7f78440fbcb0 msgr2=0x7f78440fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:39.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.246+0000 7f784a5ff700 1 -- 172.21.15.107:0/412046179 shutdown_connections 2023-08-10T10:50:39.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.246+0000 7f784a5ff700 1 -- 172.21.15.107:0/412046179 wait complete. 2023-08-10T10:50:39.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f784a5ff700 1 Processor -- start 2023-08-10T10:50:39.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f784a5ff700 1 -- start start 2023-08-10T10:50:39.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f784a5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7844100780 0x7f7844074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:39.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f784a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7844101970 0x7f7844072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:39.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f784a5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844102310 0x7f78440730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:39.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f784a5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7844073840 con 0x7f7844102310 2023-08-10T10:50:39.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f784a5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440739b0 con 0x7f7844100780 2023-08-10T10:50:39.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f784a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78441a0390 con 0x7f7844101970 2023-08-10T10:50:39.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f7848b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844102310 0x7f78440730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:39.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f7848b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844102310 0x7f78440730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48386/0 (socket says 172.21.15.107:48386) 2023-08-10T10:50:39.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.248+0000 7f7848b9c700 1 -- 172.21.15.107:0/2176107141 learned_addr learned my addr 172.21.15.107:0/2176107141 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f78437fe700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7844101970 0x7f7844072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f7843fff700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7844100780 0x7f7844074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f7848b9c700 1 -- 172.21.15.107:0/2176107141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7844101970 msgr2=0x7f7844072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f7848b9c700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7844101970 0x7f7844072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f7848b9c700 1 -- 172.21.15.107:0/2176107141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7844100780 msgr2=0x7f7844074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f7848b9c700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7844100780 0x7f7844074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f7848b9c700 1 -- 172.21.15.107:0/2176107141 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380095f0 con 0x7f7844102310 2023-08-10T10:50:39.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f7848b9c700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844102310 0x7f78440730a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f783c007ee0 tx=0x7f783c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f78417fa700 1 -- 172.21.15.107:0/2176107141 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c00dd20 con 0x7f7844102310 2023-08-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f78417fa700 1 -- 172.21.15.107:0/2176107141 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f783c00f040 con 0x7f7844102310 2023-08-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78441a0670 con 0x7f7844102310 2023-08-10T10:50:39.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.249+0000 7f78417fa700 1 -- 172.21.15.107:0/2176107141 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c004750 con 0x7f7844102310 2023-08-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.250+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78441a0b80 con 0x7f7844102310 2023-08-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.251+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784410be50 con 0x7f7844102310 2023-08-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.252+0000 7f78417fa700 1 -- 172.21.15.107:0/2176107141 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f783c003a00 con 0x7f7844102310 2023-08-10T10:50:39.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.254+0000 7f78417fa700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f782c0a12a0 0x7f782c0a3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.254+0000 7f78417fa700 1 -- 172.21.15.107:0/2176107141 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f783c0cc640 con 0x7f7844102310 2023-08-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.254+0000 7f7843fff700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f782c0a12a0 0x7f782c0a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:39.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.255+0000 7f7843fff700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f782c0a12a0 0x7f782c0a3760 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78441017d0 tx=0x7f783400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:39.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.258+0000 7f78417fa700 1 -- 172.21.15.107:0/2176107141 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f783c04e790 con 0x7f7844102310 2023-08-10T10:50:39.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.459+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f784410c070 con 0x7f7844102310 2023-08-10T10:50:39.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.460+0000 7f78417fa700 1 -- 172.21.15.107:0/2176107141 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24563 (secure 0 0 0) 0x7f783c0958b0 con 0x7f7844102310 2023-08-10T10:50:39.461 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:39.462 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":93,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:50:13.687527+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:39.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.462+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f782c0a12a0 msgr2=0x7f782c0a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.462+0000 7f784a5ff700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f782c0a12a0 0x7f782c0a3760 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78441017d0 tx=0x7f783400b410 comp rx=0 tx=0).stop 2023-08-10T10:50:39.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844102310 msgr2=0x7f78440730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844102310 0x7f78440730a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f783c007ee0 tx=0x7f783c00d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 shutdown_connections 2023-08-10T10:50:39.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f782c0a12a0 0x7f782c0a3760 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7844100780 0x7f7844074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7844102310 0x7f78440730a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 --2- 172.21.15.107:0/2176107141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7844101970 0x7f7844072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 >> 172.21.15.107:0/2176107141 conn(0x7f78440fbcb0 msgr2=0x7f78440fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:39.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 shutdown_connections 2023-08-10T10:50:39.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.463+0000 7f784a5ff700 1 -- 172.21.15.107:0/2176107141 wait complete. 2023-08-10T10:50:39.482 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:50:39.483 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:50:39.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.684+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/4118265077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8108630 msgr2=0x7fdfc810aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.684+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/4118265077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8108630 0x7fdfc810aaa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000b0a0 tx=0x7fdfc000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.684+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/4118265077 shutdown_connections 2023-08-10T10:50:39.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.684+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/4118265077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8108630 0x7fdfc810aaa0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.684+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/4118265077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8074750 0x7fdfc8072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.684+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/4118265077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc8073170 0x7fdfc80735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.684+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/4118265077 >> 172.21.15.107:0/4118265077 conn(0x7fdfc80fbcb0 msgr2=0x7fdfc80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:39.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.684+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/4118265077 shutdown_connections 2023-08-10T10:50:39.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.684+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/4118265077 wait complete. 2023-08-10T10:50:39.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.685+0000 7fdfcd3ff700 1 Processor -- start 2023-08-10T10:50:39.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.685+0000 7fdfcd3ff700 1 -- start start 2023-08-10T10:50:39.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfcd3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc8073170 0x7fdfc8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:39.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfcd3ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8074750 0x7fdfc8198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:39.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfcd3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8108630 0x7fdfc819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:39.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfcd3ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81a01b0 con 0x7fdfc8074750 2023-08-10T10:50:39.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfcd3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81a02f0 con 0x7fdfc8073170 2023-08-10T10:50:39.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfcd3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81a0480 con 0x7fdfc8108630 2023-08-10T10:50:39.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc67fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8074750 0x7fdfc8198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:39.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc67fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8074750 0x7fdfc8198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48390/0 (socket says 172.21.15.107:48390) 2023-08-10T10:50:39.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc67fc700 1 -- 172.21.15.107:0/2270015827 learned_addr learned my addr 172.21.15.107:0/2270015827 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:39.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc6ffd700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc8073170 0x7fdfc8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:39.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc77fe700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8108630 0x7fdfc819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:39.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc67fc700 1 -- 172.21.15.107:0/2270015827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8108630 msgr2=0x7fdfc819fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc67fc700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8108630 0x7fdfc819fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc67fc700 1 -- 172.21.15.107:0/2270015827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc8073170 msgr2=0x7fdfc8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc67fc700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc8073170 0x7fdfc8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc67fc700 1 -- 172.21.15.107:0/2270015827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0009d00 con 0x7fdfc8074750 2023-08-10T10:50:39.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.686+0000 7fdfc77fe700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8108630 0x7fdfc819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:39.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.687+0000 7fdfc67fc700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8074750 0x7fdfc8198b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00e9a0 tx=0x7fdfbc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:39.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.687+0000 7fdfaffff700 1 -- 172.21.15.107:0/2270015827 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc009790 con 0x7fdfc8074750 2023-08-10T10:50:39.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.687+0000 7fdfaffff700 1 -- 172.21.15.107:0/2270015827 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfbc00cbd0 con 0x7fdfc8074750 2023-08-10T10:50:39.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.687+0000 7fdfaffff700 1 -- 172.21.15.107:0/2270015827 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc018680 con 0x7fdfc8074750 2023-08-10T10:50:39.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.687+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc81a0760 con 0x7fdfc8074750 2023-08-10T10:50:39.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.687+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc81a0c70 con 0x7fdfc8074750 2023-08-10T10:50:39.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.688+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc8106d30 con 0x7fdfc8074750 2023-08-10T10:50:39.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.690+0000 7fdfaffff700 1 -- 172.21.15.107:0/2270015827 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fdfbc00cd40 con 0x7fdfc8074750 2023-08-10T10:50:39.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.691+0000 7fdfaffff700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdfb00a1260 0x7fdfb00a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:39.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.692+0000 7fdfaffff700 1 -- 172.21.15.107:0/2270015827 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fdfbc014070 con 0x7fdfc8074750 2023-08-10T10:50:39.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.692+0000 7fdfc6ffd700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdfb00a1260 0x7fdfb00a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:39.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.692+0000 7fdfc6ffd700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdfb00a1260 0x7fdfb00a3720 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009bf0 tx=0x7fdfb8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:39.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.693+0000 7fdfaffff700 1 -- 172.21.15.107:0/2270015827 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fdfbc096330 con 0x7fdfc8074750 2023-08-10T10:50:39.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.895+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfc802cb00 con 0x7fdfc8074750 2023-08-10T10:50:39.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.896+0000 7fdfaffff700 1 -- 172.21.15.107:0/2270015827 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfbc099950 con 0x7fdfc8074750 2023-08-10T10:50:39.897 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:50:39.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdfb00a1260 msgr2=0x7fdfb00a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdfb00a1260 0x7fdfb00a3720 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009bf0 tx=0x7fdfb8009260 comp rx=0 tx=0).stop 2023-08-10T10:50:39.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8074750 msgr2=0x7fdfc8198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:39.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8074750 0x7fdfc8198b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00e9a0 tx=0x7fdfbc00ed60 comp rx=0 tx=0).stop 2023-08-10T10:50:39.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 shutdown_connections 2023-08-10T10:50:39.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fdfb00a1260 0x7fdfb00a3720 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfc8073170 0x7fdfc8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8108630 0x7fdfc819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 --2- 172.21.15.107:0/2270015827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfc8074750 0x7fdfc8198b70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:39.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 >> 172.21.15.107:0/2270015827 conn(0x7fdfc80fbcb0 msgr2=0x7fdfc80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:39.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 shutdown_connections 2023-08-10T10:50:39.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:39.898+0000 7fdfcd3ff700 1 -- 172.21.15.107:0/2270015827 wait complete. 2023-08-10T10:50:39.918 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:50:40.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:39 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2176107141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:39 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2176107141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:40.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.118+0000 7f89f2dff700 1 -- 172.21.15.107:0/2658647198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec100780 msgr2=0x7f89ec100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.118+0000 7f89f2dff700 1 --2- 172.21.15.107:0/2658647198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec100780 0x7f89ec100ba0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f89e00099c0 tx=0x7f89e0009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.118+0000 7f89f2dff700 1 -- 172.21.15.107:0/2658647198 shutdown_connections 2023-08-10T10:50:40.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.118+0000 7f89f2dff700 1 --2- 172.21.15.107:0/2658647198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ec102310 0x7f89ec108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.118+0000 7f89f2dff700 1 --2- 172.21.15.107:0/2658647198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec100780 0x7f89ec100ba0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.118+0000 7f89f2dff700 1 --2- 172.21.15.107:0/2658647198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89ec101970 0x7f89ec101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.118+0000 7f89f2dff700 1 -- 172.21.15.107:0/2658647198 >> 172.21.15.107:0/2658647198 conn(0x7f89ec0fbcf0 msgr2=0x7f89ec0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:40.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.118+0000 7f89f2dff700 1 -- 172.21.15.107:0/2658647198 shutdown_connections 2023-08-10T10:50:40.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.118+0000 7f89f2dff700 1 -- 172.21.15.107:0/2658647198 wait complete. 2023-08-10T10:50:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.119+0000 7f89f2dff700 1 Processor -- start 2023-08-10T10:50:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.119+0000 7f89f2dff700 1 -- start start 2023-08-10T10:50:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.119+0000 7f89f2dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89ec100780 0x7f89ec074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.119+0000 7f89f2dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec101970 0x7f89ec072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.119+0000 7f89f2dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ec102310 0x7f89ec0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.119+0000 7f89f2dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec073840 con 0x7f89ec101970 2023-08-10T10:50:40.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.119+0000 7f89f2dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0739b0 con 0x7f89ec100780 2023-08-10T10:50:40.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.119+0000 7f89f2dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec1a03e0 con 0x7f89ec102310 2023-08-10T10:50:40.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89ebfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec101970 0x7f89ec072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89ebfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec101970 0x7f89ec072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48406/0 (socket says 172.21.15.107:48406) 2023-08-10T10:50:40.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89ebfff700 1 -- 172.21.15.107:0/244985721 learned_addr learned my addr 172.21.15.107:0/244985721 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:40.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89f0b9b700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89ec100780 0x7f89ec074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89f139c700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ec102310 0x7f89ec0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89ebfff700 1 -- 172.21.15.107:0/244985721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ec102310 msgr2=0x7f89ec0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89ebfff700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ec102310 0x7f89ec0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89ebfff700 1 -- 172.21.15.107:0/244985721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89ec100780 msgr2=0x7f89ec074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89ebfff700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89ec100780 0x7f89ec074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89ebfff700 1 -- 172.21.15.107:0/244985721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00095f0 con 0x7f89ec101970 2023-08-10T10:50:40.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.120+0000 7f89ebfff700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec101970 0x7f89ec072b60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f89d800d950 tx=0x7f89d800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:40.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.121+0000 7f89e9ffb700 1 -- 172.21.15.107:0/244985721 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8009940 con 0x7f89ec101970 2023-08-10T10:50:40.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.121+0000 7f89e9ffb700 1 -- 172.21.15.107:0/244985721 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89d8010460 con 0x7f89ec101970 2023-08-10T10:50:40.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.121+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec1a06c0 con 0x7f89ec101970 2023-08-10T10:50:40.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.121+0000 7f89e9ffb700 1 -- 172.21.15.107:0/244985721 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800f620 con 0x7f89ec101970 2023-08-10T10:50:40.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.121+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec1a0bd0 con 0x7f89ec101970 2023-08-10T10:50:40.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.122+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec107d60 con 0x7f89ec101970 2023-08-10T10:50:40.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.124+0000 7f89e9ffb700 1 -- 172.21.15.107:0/244985721 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f89d80105d0 con 0x7f89ec101970 2023-08-10T10:50:40.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.125+0000 7f89e9ffb700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89dc0a11e0 0x7f89dc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.125+0000 7f89e9ffb700 1 -- 172.21.15.107:0/244985721 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f89d80ccc70 con 0x7f89ec101970 2023-08-10T10:50:40.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.125+0000 7f89f0b9b700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89dc0a11e0 0x7f89dc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.126+0000 7f89f0b9b700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89dc0a11e0 0x7f89dc0a36a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f89e0006010 tx=0x7f89e0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:40.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.129+0000 7f89e9ffb700 1 -- 172.21.15.107:0/244985721 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f89d8095ee0 con 0x7f89ec101970 2023-08-10T10:50:40.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:39 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2176107141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:40.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.325+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89ec02cb90 con 0x7f89ec101970 2023-08-10T10:50:40.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.326+0000 7f89e9ffb700 1 -- 172.21.15.107:0/244985721 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89d8016020 con 0x7f89ec101970 2023-08-10T10:50:40.327 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:40.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89dc0a11e0 msgr2=0x7f89dc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89dc0a11e0 0x7f89dc0a36a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f89e0006010 tx=0x7f89e0005e80 comp rx=0 tx=0).stop 2023-08-10T10:50:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec101970 msgr2=0x7f89ec072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec101970 0x7f89ec072b60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f89d800d950 tx=0x7f89d800dc60 comp rx=0 tx=0).stop 2023-08-10T10:50:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 shutdown_connections 2023-08-10T10:50:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f89dc0a11e0 0x7f89dc0a36a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89ec100780 0x7f89ec074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89ec102310 0x7f89ec0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 --2- 172.21.15.107:0/244985721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89ec101970 0x7f89ec072b60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 >> 172.21.15.107:0/244985721 conn(0x7f89ec0fbcf0 msgr2=0x7f89ec104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.328+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 shutdown_connections 2023-08-10T10:50:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.329+0000 7f89f2dff700 1 -- 172.21.15.107:0/244985721 wait complete. 2023-08-10T10:50:40.348 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:50:40.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.547+0000 7f4cd9fff700 1 -- 172.21.15.107:0/314217490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4073170 msgr2=0x7f4cd40735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.547+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/314217490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4073170 0x7f4cd40735f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009990 tx=0x7f4cc8009ca0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.547+0000 7f4cd9fff700 1 -- 172.21.15.107:0/314217490 shutdown_connections 2023-08-10T10:50:40.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.547+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/314217490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd4108630 0x7f4cd410aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.547+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/314217490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd4074750 0x7f4cd4072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.547+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/314217490 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4073170 0x7f4cd40735f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.547+0000 7f4cd9fff700 1 -- 172.21.15.107:0/314217490 >> 172.21.15.107:0/314217490 conn(0x7f4cd40fbcb0 msgr2=0x7f4cd40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:40.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.547+0000 7f4cd9fff700 1 -- 172.21.15.107:0/314217490 shutdown_connections 2023-08-10T10:50:40.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.547+0000 7f4cd9fff700 1 -- 172.21.15.107:0/314217490 wait complete. 2023-08-10T10:50:40.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.548+0000 7f4cd9fff700 1 Processor -- start 2023-08-10T10:50:40.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.548+0000 7f4cd9fff700 1 -- start start 2023-08-10T10:50:40.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd9fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd4073170 0x7f4cd41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd9fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd4074750 0x7f4cd4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd9fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4108630 0x7f4cd419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd9fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd41a0130 con 0x7f4cd4108630 2023-08-10T10:50:40.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd9fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd41a0270 con 0x7f4cd4074750 2023-08-10T10:50:40.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd9fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd41a0400 con 0x7f4cd4073170 2023-08-10T10:50:40.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4108630 0x7f4cd419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4108630 0x7f4cd419fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48420/0 (socket says 172.21.15.107:48420) 2023-08-10T10:50:40.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd3fff700 1 -- 172.21.15.107:0/1750515000 learned_addr learned my addr 172.21.15.107:0/1750515000 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:40.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd2ffd700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd4074750 0x7f4cd4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd37fe700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd4073170 0x7f4cd41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd3fff700 1 -- 172.21.15.107:0/1750515000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd4073170 msgr2=0x7f4cd41985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd3fff700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd4073170 0x7f4cd41985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd3fff700 1 -- 172.21.15.107:0/1750515000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd4074750 msgr2=0x7f4cd4198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd3fff700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd4074750 0x7f4cd4198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd3fff700 1 -- 172.21.15.107:0/1750515000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc80095f0 con 0x7f4cd4108630 2023-08-10T10:50:40.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.549+0000 7f4cd2ffd700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd4074750 0x7f4cd4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:40.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.550+0000 7f4cd3fff700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4108630 0x7f4cd419fb60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00ef30 tx=0x7f4ccc00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:40.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.550+0000 7f4cd0ff9700 1 -- 172.21.15.107:0/1750515000 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc018070 con 0x7f4cd4108630 2023-08-10T10:50:40.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.550+0000 7f4cd0ff9700 1 -- 172.21.15.107:0/1750515000 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ccc00f040 con 0x7f4cd4108630 2023-08-10T10:50:40.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.550+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd41a0680 con 0x7f4cd4108630 2023-08-10T10:50:40.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.550+0000 7f4cd0ff9700 1 -- 172.21.15.107:0/1750515000 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc003d00 con 0x7f4cd4108630 2023-08-10T10:50:40.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.550+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd41a0b40 con 0x7f4cd4108630 2023-08-10T10:50:40.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.551+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd4106d30 con 0x7f4cd4108630 2023-08-10T10:50:40.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.553+0000 7f4cd0ff9700 1 -- 172.21.15.107:0/1750515000 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f4ccc00caa0 con 0x7f4cd4108630 2023-08-10T10:50:40.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.554+0000 7f4cd0ff9700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4cbc0a11e0 0x7f4cbc0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.554+0000 7f4cd0ff9700 1 -- 172.21.15.107:0/1750515000 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4ccc0ccb60 con 0x7f4cd4108630 2023-08-10T10:50:40.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.555+0000 7f4cd37fe700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4cbc0a11e0 0x7f4cbc0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.555+0000 7f4cd37fe700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4cbc0a11e0 0x7f4cbc0a36a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4005950 tx=0x7f4cc40058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:40.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.558+0000 7f4cd0ff9700 1 -- 172.21.15.107:0/1750515000 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4ccc095e60 con 0x7f4cd4108630 2023-08-10T10:50:40.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.757+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cd402cba0 con 0x7f4cd4108630 2023-08-10T10:50:40.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.758+0000 7f4cd0ff9700 1 -- 172.21.15.107:0/1750515000 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ccc099480 con 0x7f4cd4108630 2023-08-10T10:50:40.759 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T10:50:40.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.760+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4cbc0a11e0 msgr2=0x7f4cbc0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.760+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4cbc0a11e0 0x7f4cbc0a36a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4005950 tx=0x7f4cc40058e0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.760+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4108630 msgr2=0x7f4cd419fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.760+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4108630 0x7f4cd419fb60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00ef30 tx=0x7f4ccc00c450 comp rx=0 tx=0).stop 2023-08-10T10:50:40.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.760+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 shutdown_connections 2023-08-10T10:50:40.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.760+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4cbc0a11e0 0x7f4cbc0a36a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.761+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4cd4108630 0x7f4cd419fb60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.761+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd4073170 0x7f4cd41985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.761+0000 7f4cd9fff700 1 --2- 172.21.15.107:0/1750515000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4cd4074750 0x7f4cd4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.761+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 >> 172.21.15.107:0/1750515000 conn(0x7f4cd40fbcb0 msgr2=0x7f4cd40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:40.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.761+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 shutdown_connections 2023-08-10T10:50:40.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.761+0000 7f4cd9fff700 1 -- 172.21.15.107:0/1750515000 wait complete. 2023-08-10T10:50:40.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:50:40.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.979+0000 7f249a5ff700 1 -- 172.21.15.107:0/3461470311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494101950 msgr2=0x7f2494101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.980 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.979+0000 7f249a5ff700 1 --2- 172.21.15.107:0/3461470311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494101950 0x7f2494101db0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f24880099c0 tx=0x7f2488009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.979+0000 7f249a5ff700 1 -- 172.21.15.107:0/3461470311 shutdown_connections 2023-08-10T10:50:40.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.979+0000 7f249a5ff700 1 --2- 172.21.15.107:0/3461470311 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2494100760 0x7f2494100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.979+0000 7f249a5ff700 1 --2- 172.21.15.107:0/3461470311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24941022f0 0x7f2494108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.979+0000 7f249a5ff700 1 --2- 172.21.15.107:0/3461470311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494101950 0x7f2494101db0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.979+0000 7f249a5ff700 1 -- 172.21.15.107:0/3461470311 >> 172.21.15.107:0/3461470311 conn(0x7f24940fbcb0 msgr2=0x7f24940fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:40.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.979+0000 7f249a5ff700 1 -- 172.21.15.107:0/3461470311 shutdown_connections 2023-08-10T10:50:40.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.979+0000 7f249a5ff700 1 -- 172.21.15.107:0/3461470311 wait complete. 2023-08-10T10:50:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.980+0000 7f249a5ff700 1 Processor -- start 2023-08-10T10:50:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.980+0000 7f249a5ff700 1 -- start start 2023-08-10T10:50:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.980+0000 7f249a5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494100760 0x7f2494074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f249a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2494101950 0x7f2494072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f249a5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24941022f0 0x7f24940730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f249a5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249419a270 con 0x7f2494100760 2023-08-10T10:50:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f249a5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940735e0 con 0x7f24941022f0 2023-08-10T10:50:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f249a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940737a0 con 0x7f2494101950 2023-08-10T10:50:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2493fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494100760 0x7f2494074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2493fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494100760 0x7f2494074520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48444/0 (socket says 172.21.15.107:48444) 2023-08-10T10:50:40.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2493fff700 1 -- 172.21.15.107:0/167643171 learned_addr learned my addr 172.21.15.107:0/167643171 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:40.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2498b9c700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24941022f0 0x7f24940730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f24937fe700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2494101950 0x7f2494072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2493fff700 1 -- 172.21.15.107:0/167643171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2494101950 msgr2=0x7f2494072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2493fff700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2494101950 0x7f2494072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2493fff700 1 -- 172.21.15.107:0/167643171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24941022f0 msgr2=0x7f24940730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:40.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2493fff700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24941022f0 0x7f24940730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:40.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2493fff700 1 -- 172.21.15.107:0/167643171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880095f0 con 0x7f2494100760 2023-08-10T10:50:40.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.981+0000 7f2493fff700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494100760 0x7f2494074520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f248400d980 tx=0x7f248400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:40.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.982+0000 7f24917fa700 1 -- 172.21.15.107:0/167643171 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248400b950 con 0x7f2494100760 2023-08-10T10:50:40.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.982+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24941a4c20 con 0x7f2494100760 2023-08-10T10:50:40.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.982+0000 7f24917fa700 1 -- 172.21.15.107:0/167643171 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2484007620 con 0x7f2494100760 2023-08-10T10:50:40.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.982+0000 7f24917fa700 1 -- 172.21.15.107:0/167643171 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248400f3c0 con 0x7f2494100760 2023-08-10T10:50:40.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.982+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24941a50a0 con 0x7f2494100760 2023-08-10T10:50:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.983+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249410be80 con 0x7f2494100760 2023-08-10T10:50:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.985+0000 7f24917fa700 1 -- 172.21.15.107:0/167643171 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f248400bab0 con 0x7f2494100760 2023-08-10T10:50:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.986+0000 7f24917fa700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f247c0a11e0 0x7f247c0a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:40.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.986+0000 7f24917fa700 1 -- 172.21.15.107:0/167643171 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f24840ccf60 con 0x7f2494100760 2023-08-10T10:50:40.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.986+0000 7f24937fe700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f247c0a11e0 0x7f247c0a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:40.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.987+0000 7f24937fe700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f247c0a11e0 0x7f247c0a36a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f248800c010 tx=0x7f2488005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:40.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:40.990+0000 7f24917fa700 1 -- 172.21.15.107:0/167643171 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f24840961d0 con 0x7f2494100760 2023-08-10T10:50:41.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:40 smithi157 ceph-mon[129604]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T10:50:41.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:40 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2270015827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:41.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:40 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/244985721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:41.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:40 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1750515000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:41.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:40 smithi107 ceph-mon[127953]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T10:50:41.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:40 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2270015827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:41.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:40 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/244985721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:41.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:40 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1750515000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:40 smithi195 ceph-mon[129938]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-08-10T10:50:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:40 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2270015827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:40 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/244985721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:40 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1750515000' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:41.190 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.189+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f249410c040 con 0x7f2494100760 2023-08-10T10:50:41.191 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.190+0000 7f24917fa700 1 -- 172.21.15.107:0/167643171 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f249410c040 con 0x7f2494100760 2023-08-10T10:50:41.191 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:41.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f247c0a11e0 msgr2=0x7f247c0a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.193 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f247c0a11e0 0x7f247c0a36a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f248800c010 tx=0x7f2488005fb0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494100760 msgr2=0x7f2494074520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494100760 0x7f2494074520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f248400d980 tx=0x7f248400dc90 comp rx=0 tx=0).stop 2023-08-10T10:50:41.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 shutdown_connections 2023-08-10T10:50:41.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f247c0a11e0 0x7f247c0a36a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24941022f0 0x7f24940730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2494100760 0x7f2494074520 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 --2- 172.21.15.107:0/167643171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2494101950 0x7f2494072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.194 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 >> 172.21.15.107:0/167643171 conn(0x7f24940fbcb0 msgr2=0x7f24940fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:41.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 shutdown_connections 2023-08-10T10:50:41.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.192+0000 7f249a5ff700 1 -- 172.21.15.107:0/167643171 wait complete. 2023-08-10T10:50:41.213 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:41.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.411+0000 7f2e35dff700 1 -- 172.21.15.107:0/3104006416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30102310 msgr2=0x7f2e30108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.411+0000 7f2e35dff700 1 --2- 172.21.15.107:0/3104006416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30102310 0x7f2e30108bc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800b0d0 tx=0x7f2e2800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.411+0000 7f2e35dff700 1 -- 172.21.15.107:0/3104006416 shutdown_connections 2023-08-10T10:50:41.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.411+0000 7f2e35dff700 1 --2- 172.21.15.107:0/3104006416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e30100780 0x7f2e30100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.411+0000 7f2e35dff700 1 --2- 172.21.15.107:0/3104006416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30102310 0x7f2e30108bc0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.411+0000 7f2e35dff700 1 --2- 172.21.15.107:0/3104006416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e30101970 0x7f2e30101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.411+0000 7f2e35dff700 1 -- 172.21.15.107:0/3104006416 >> 172.21.15.107:0/3104006416 conn(0x7f2e300fbcb0 msgr2=0x7f2e300fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:41.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.411+0000 7f2e35dff700 1 -- 172.21.15.107:0/3104006416 shutdown_connections 2023-08-10T10:50:41.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.411+0000 7f2e35dff700 1 -- 172.21.15.107:0/3104006416 wait complete. 2023-08-10T10:50:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.412+0000 7f2e35dff700 1 Processor -- start 2023-08-10T10:50:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.412+0000 7f2e35dff700 1 -- start start 2023-08-10T10:50:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.412+0000 7f2e35dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e30100780 0x7f2e30074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.412+0000 7f2e35dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30101970 0x7f2e30072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.412+0000 7f2e35dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e30102310 0x7f2e300730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.412+0000 7f2e35dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30073840 con 0x7f2e30101970 2023-08-10T10:50:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.412+0000 7f2e35dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e300739b0 con 0x7f2e30102310 2023-08-10T10:50:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.412+0000 7f2e35dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301a0430 con 0x7f2e30100780 2023-08-10T10:50:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e27fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30101970 0x7f2e30072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e27fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30101970 0x7f2e30072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48458/0 (socket says 172.21.15.107:48458) 2023-08-10T10:50:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e27fff700 1 -- 172.21.15.107:0/1649037845 learned_addr learned my addr 172.21.15.107:0/1649037845 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e2f7fe700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e30100780 0x7f2e30074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e27fff700 1 -- 172.21.15.107:0/1649037845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e30100780 msgr2=0x7f2e30074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e27fff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e30100780 0x7f2e30074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e27fff700 1 -- 172.21.15.107:0/1649037845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e30102310 msgr2=0x7f2e300730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e2ffff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e30102310 0x7f2e300730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e27fff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e30102310 0x7f2e300730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e27fff700 1 -- 172.21.15.107:0/1649037845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e28009d00 con 0x7f2e30101970 2023-08-10T10:50:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e2ffff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e30102310 0x7f2e300730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.413+0000 7f2e27fff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30101970 0x7f2e30072b60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800e9a0 tx=0x7f2e1800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.414+0000 7f2e2d7fa700 1 -- 172.21.15.107:0/1649037845 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18009790 con 0x7f2e30101970 2023-08-10T10:50:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.414+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e301a0710 con 0x7f2e30101970 2023-08-10T10:50:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.414+0000 7f2e2d7fa700 1 -- 172.21.15.107:0/1649037845 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e1800cbd0 con 0x7f2e30101970 2023-08-10T10:50:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.414+0000 7f2e2d7fa700 1 -- 172.21.15.107:0/1649037845 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18018680 con 0x7f2e30101970 2023-08-10T10:50:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.414+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301a0c20 con 0x7f2e30101970 2023-08-10T10:50:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.415+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3010be50 con 0x7f2e30101970 2023-08-10T10:50:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.417+0000 7f2e2d7fa700 1 -- 172.21.15.107:0/1649037845 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f2e1800cd40 con 0x7f2e30101970 2023-08-10T10:50:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.418+0000 7f2e2d7fa700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2e1c0a1220 0x7f2e1c0a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.418+0000 7f2e2d7fa700 1 -- 172.21.15.107:0/1649037845 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f2e18014070 con 0x7f2e30101970 2023-08-10T10:50:41.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.418+0000 7f2e2f7fe700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2e1c0a1220 0x7f2e1c0a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:41.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.419+0000 7f2e2f7fe700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2e1c0a1220 0x7f2e1c0a36e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2e301017d0 tx=0x7f2e2000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:41.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.420+0000 7f2e2d7fa700 1 -- 172.21.15.107:0/1649037845 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2e180966f0 con 0x7f2e30101970 2023-08-10T10:50:41.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.694+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e301075e0 con 0x7f2e30101970 2023-08-10T10:50:41.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.695+0000 7f2e2d7fa700 1 -- 172.21.15.107:0/1649037845 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10914 (secure 0 0 0) 0x7f2e18099d10 con 0x7f2e30101970 2023-08-10T10:50:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:41.697 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:49:16.643966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:50:41.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2e1c0a1220 msgr2=0x7f2e1c0a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2e1c0a1220 0x7f2e1c0a36e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2e301017d0 tx=0x7f2e2000b410 comp rx=0 tx=0).stop 2023-08-10T10:50:41.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30101970 msgr2=0x7f2e30072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30101970 0x7f2e30072b60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800e9a0 tx=0x7f2e1800ecb0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 shutdown_connections 2023-08-10T10:50:41.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2e1c0a1220 0x7f2e1c0a36e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e30102310 0x7f2e300730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e30100780 0x7f2e30074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 --2- 172.21.15.107:0/1649037845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2e30101970 0x7f2e30072b60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 >> 172.21.15.107:0/1649037845 conn(0x7f2e300fbcb0 msgr2=0x7f2e300fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:41.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 shutdown_connections 2023-08-10T10:50:41.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.698+0000 7f2e35dff700 1 -- 172.21.15.107:0/1649037845 wait complete. 2023-08-10T10:50:41.701 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:50:41.718 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.920+0000 7f534a9ff700 1 -- 172.21.15.107:0/222308852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344102310 msgr2=0x7f5344108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.920+0000 7f534a9ff700 1 --2- 172.21.15.107:0/222308852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344102310 0x7f5344108bc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f533c009fc0 tx=0x7f533c00b330 comp rx=0 tx=0).stop 2023-08-10T10:50:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.921+0000 7f534a9ff700 1 -- 172.21.15.107:0/222308852 shutdown_connections 2023-08-10T10:50:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.921+0000 7f534a9ff700 1 --2- 172.21.15.107:0/222308852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5344100780 0x7f5344100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.921+0000 7f534a9ff700 1 --2- 172.21.15.107:0/222308852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344102310 0x7f5344108bc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.921+0000 7f534a9ff700 1 --2- 172.21.15.107:0/222308852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5344101970 0x7f5344101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.921+0000 7f534a9ff700 1 -- 172.21.15.107:0/222308852 >> 172.21.15.107:0/222308852 conn(0x7f53440fbcb0 msgr2=0x7f53440fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.921+0000 7f534a9ff700 1 -- 172.21.15.107:0/222308852 shutdown_connections 2023-08-10T10:50:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.921+0000 7f534a9ff700 1 -- 172.21.15.107:0/222308852 wait complete. 2023-08-10T10:50:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f534a9ff700 1 Processor -- start 2023-08-10T10:50:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f534a9ff700 1 -- start start 2023-08-10T10:50:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f534a9ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344100780 0x7f5344074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f534a9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5344101970 0x7f5344072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f534a9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5344102310 0x7f53440730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f534a9ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344073840 con 0x7f5344100780 2023-08-10T10:50:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f534a9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440739b0 con 0x7f5344102310 2023-08-10T10:50:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f534a9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53441a04d0 con 0x7f5344101970 2023-08-10T10:50:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f5343fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344100780 0x7f5344074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f5343fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344100780 0x7f5344074520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48480/0 (socket says 172.21.15.107:48480) 2023-08-10T10:50:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.922+0000 7f5343fff700 1 -- 172.21.15.107:0/351743749 learned_addr learned my addr 172.21.15.107:0/351743749 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f53437fe700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5344101970 0x7f5344072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f5343fff700 1 -- 172.21.15.107:0/351743749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5344101970 msgr2=0x7f5344072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f5343fff700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5344101970 0x7f5344072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f5348f9c700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5344102310 0x7f53440730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f5343fff700 1 -- 172.21.15.107:0/351743749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5344102310 msgr2=0x7f53440730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f5343fff700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5344102310 0x7f53440730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f5343fff700 1 -- 172.21.15.107:0/351743749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009c40 con 0x7f5344100780 2023-08-10T10:50:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f5343fff700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344100780 0x7f5344074520 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f533400e970 tx=0x7f533400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f53417fa700 1 -- 172.21.15.107:0/351743749 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334009790 con 0x7f5344100780 2023-08-10T10:50:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f53417fa700 1 -- 172.21.15.107:0/351743749 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f533400eeb0 con 0x7f5344100780 2023-08-10T10:50:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f53417fa700 1 -- 172.21.15.107:0/351743749 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334003c50 con 0x7f5344100780 2023-08-10T10:50:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.923+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53441a07b0 con 0x7f5344100780 2023-08-10T10:50:41.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.924+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53441a0c70 con 0x7f5344100780 2023-08-10T10:50:41.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.925+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5344107cc0 con 0x7f5344100780 2023-08-10T10:50:41.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.927+0000 7f53417fa700 1 -- 172.21.15.107:0/351743749 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5334003db0 con 0x7f5344100780 2023-08-10T10:50:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.928+0000 7f53417fa700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f532c0a11a0 0x7f532c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.928+0000 7f53417fa700 1 -- 172.21.15.107:0/351743749 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f5334014070 con 0x7f5344100780 2023-08-10T10:50:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.928+0000 7f53437fe700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f532c0a11a0 0x7f532c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:41.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.929+0000 7f53437fe700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f532c0a11a0 0x7f532c0a3660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5338005fd0 tx=0x7f5338009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:41.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:41.932+0000 7f53417fa700 1 -- 172.21.15.107:0/351743749 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f53340962e0 con 0x7f5344100780 2023-08-10T10:50:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:41 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/167643171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:41 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1649037845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:41 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/167643171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:41 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1649037845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:42.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.132+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f534402c970 con 0x7f5344100780 2023-08-10T10:50:42.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.134+0000 7f53417fa700 1 -- 172.21.15.107:0/351743749 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24563 (secure 0 0 0) 0x7f5334016330 con 0x7f5344100780 2023-08-10T10:50:42.135 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:42.136 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":93,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:50:13.687527+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:42.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f532c0a11a0 msgr2=0x7f532c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f532c0a11a0 0x7f532c0a3660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5338005fd0 tx=0x7f5338009310 comp rx=0 tx=0).stop 2023-08-10T10:50:42.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344100780 msgr2=0x7f5344074520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344100780 0x7f5344074520 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f533400e970 tx=0x7f533400ed30 comp rx=0 tx=0).stop 2023-08-10T10:50:42.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 shutdown_connections 2023-08-10T10:50:42.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f532c0a11a0 0x7f532c0a3660 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5344102310 0x7f53440730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5344100780 0x7f5344074520 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 --2- 172.21.15.107:0/351743749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5344101970 0x7f5344072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 >> 172.21.15.107:0/351743749 conn(0x7f53440fbcb0 msgr2=0x7f5344104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:42.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 shutdown_connections 2023-08-10T10:50:42.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.137+0000 7f534a9ff700 1 -- 172.21.15.107:0/351743749 wait complete. 2023-08-10T10:50:42.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:50:42.158 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:50:42.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:41 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/167643171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:41 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1649037845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:42.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.357+0000 7fe79dfff700 1 -- 172.21.15.107:0/551534545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7981022f0 msgr2=0x7fe798108ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.357+0000 7fe79dfff700 1 --2- 172.21.15.107:0/551534545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7981022f0 0x7fe798108ba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe79000b0d0 tx=0x7fe79000b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.357+0000 7fe79dfff700 1 -- 172.21.15.107:0/551534545 shutdown_connections 2023-08-10T10:50:42.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.357+0000 7fe79dfff700 1 --2- 172.21.15.107:0/551534545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe798100760 0x7fe798100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.357+0000 7fe79dfff700 1 --2- 172.21.15.107:0/551534545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7981022f0 0x7fe798108ba0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.357+0000 7fe79dfff700 1 --2- 172.21.15.107:0/551534545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe798101950 0x7fe798101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.357+0000 7fe79dfff700 1 -- 172.21.15.107:0/551534545 >> 172.21.15.107:0/551534545 conn(0x7fe7980fbcb0 msgr2=0x7fe7980fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:42.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.357+0000 7fe79dfff700 1 -- 172.21.15.107:0/551534545 shutdown_connections 2023-08-10T10:50:42.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.357+0000 7fe79dfff700 1 -- 172.21.15.107:0/551534545 wait complete. 2023-08-10T10:50:42.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.358+0000 7fe79dfff700 1 Processor -- start 2023-08-10T10:50:42.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.358+0000 7fe79dfff700 1 -- start start 2023-08-10T10:50:42.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.358+0000 7fe79dfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe798100760 0x7fe798198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:42.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.358+0000 7fe79dfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe798101950 0x7fe798198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:42.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.358+0000 7fe79dfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7981022f0 0x7fe79819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:42.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.358+0000 7fe79dfff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7981a0200 con 0x7fe798100760 2023-08-10T10:50:42.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.358+0000 7fe79dfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7981a0340 con 0x7fe7981022f0 2023-08-10T10:50:42.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.358+0000 7fe79dfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7981a04d0 con 0x7fe798101950 2023-08-10T10:50:42.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.358+0000 7fe7977fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe798100760 0x7fe798198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:42.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe7977fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe798100760 0x7fe798198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48496/0 (socket says 172.21.15.107:48496) 2023-08-10T10:50:42.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe7977fe700 1 -- 172.21.15.107:0/1762677622 learned_addr learned my addr 172.21.15.107:0/1762677622 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:42.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe796ffd700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe798101950 0x7fe798198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:42.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe797fff700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7981022f0 0x7fe79819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:42.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe7977fe700 1 -- 172.21.15.107:0/1762677622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe798101950 msgr2=0x7fe798198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe7977fe700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe798101950 0x7fe798198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe7977fe700 1 -- 172.21.15.107:0/1762677622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7981022f0 msgr2=0x7fe79819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe7977fe700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7981022f0 0x7fe79819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe7977fe700 1 -- 172.21.15.107:0/1762677622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe790009d00 con 0x7fe798100760 2023-08-10T10:50:42.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe797fff700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7981022f0 0x7fe79819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:42.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe7977fe700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe798100760 0x7fe798198680 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe78800d980 tx=0x7fe78800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:42.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe794ff9700 1 -- 172.21.15.107:0/1762677622 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788004020 con 0x7fe798100760 2023-08-10T10:50:42.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7981a07b0 con 0x7fe798100760 2023-08-10T10:50:42.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe794ff9700 1 -- 172.21.15.107:0/1762677622 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe788009730 con 0x7fe798100760 2023-08-10T10:50:42.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.359+0000 7fe794ff9700 1 -- 172.21.15.107:0/1762677622 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7880039c0 con 0x7fe798100760 2023-08-10T10:50:42.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.360+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7981a0cc0 con 0x7fe798100760 2023-08-10T10:50:42.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.361+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe798192c70 con 0x7fe798100760 2023-08-10T10:50:42.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.363+0000 7fe794ff9700 1 -- 172.21.15.107:0/1762677622 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe7880098a0 con 0x7fe798100760 2023-08-10T10:50:42.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.365+0000 7fe794ff9700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7800a1150 0x7fe7800a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:42.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.365+0000 7fe794ff9700 1 -- 172.21.15.107:0/1762677622 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fe7880cc960 con 0x7fe798100760 2023-08-10T10:50:42.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.365+0000 7fe796ffd700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7800a1150 0x7fe7800a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:42.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.366+0000 7fe796ffd700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7800a1150 0x7fe7800a3610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe78c005950 tx=0x7fe78c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:42.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.369+0000 7fe794ff9700 1 -- 172.21.15.107:0/1762677622 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe788095d30 con 0x7fe798100760 2023-08-10T10:50:42.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.568+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7980613b0 con 0x7fe798100760 2023-08-10T10:50:42.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.569+0000 7fe794ff9700 1 -- 172.21.15.107:0/1762677622 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe788099350 con 0x7fe798100760 2023-08-10T10:50:42.570 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:50:42.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7800a1150 msgr2=0x7fe7800a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7800a1150 0x7fe7800a3610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe78c005950 tx=0x7fe78c00b410 comp rx=0 tx=0).stop 2023-08-10T10:50:42.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe798100760 msgr2=0x7fe798198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe798100760 0x7fe798198680 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe78800d980 tx=0x7fe78800dc90 comp rx=0 tx=0).stop 2023-08-10T10:50:42.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 shutdown_connections 2023-08-10T10:50:42.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe7800a1150 0x7fe7800a3610 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7981022f0 0x7fe79819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe798100760 0x7fe798198680 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 --2- 172.21.15.107:0/1762677622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe798101950 0x7fe798198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 >> 172.21.15.107:0/1762677622 conn(0x7fe7980fbcb0 msgr2=0x7fe798107220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:42.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 shutdown_connections 2023-08-10T10:50:42.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.571+0000 7fe79dfff700 1 -- 172.21.15.107:0/1762677622 wait complete. 2023-08-10T10:50:42.593 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:50:42.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.792+0000 7fc196fff700 1 -- 172.21.15.107:0/755227452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1901007d0 msgr2=0x7fc190100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.792+0000 7fc196fff700 1 --2- 172.21.15.107:0/755227452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1901007d0 0x7fc190100bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc1840099c0 tx=0x7fc184009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.793+0000 7fc196fff700 1 -- 172.21.15.107:0/755227452 shutdown_connections 2023-08-10T10:50:42.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.793+0000 7fc196fff700 1 --2- 172.21.15.107:0/755227452 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc190102360 0x7fc190108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.793+0000 7fc196fff700 1 --2- 172.21.15.107:0/755227452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc1901007d0 0x7fc190100bf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.793+0000 7fc196fff700 1 --2- 172.21.15.107:0/755227452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901019c0 0x7fc190101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.793+0000 7fc196fff700 1 -- 172.21.15.107:0/755227452 >> 172.21.15.107:0/755227452 conn(0x7fc1900fbd40 msgr2=0x7fc1900fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:42.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.793+0000 7fc196fff700 1 -- 172.21.15.107:0/755227452 shutdown_connections 2023-08-10T10:50:42.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.793+0000 7fc196fff700 1 -- 172.21.15.107:0/755227452 wait complete. 2023-08-10T10:50:42.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc196fff700 1 Processor -- start 2023-08-10T10:50:42.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc196fff700 1 -- start start 2023-08-10T10:50:42.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc196fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1901007d0 0x7fc190198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:42.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc196fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901019c0 0x7fc1901988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:42.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc196fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc190102360 0x7fc19019f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:42.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc196fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19019ff00 con 0x7fc190102360 2023-08-10T10:50:42.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc196fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901a0040 con 0x7fc1901007d0 2023-08-10T10:50:42.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc196fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901a01d0 con 0x7fc1901019c0 2023-08-10T10:50:42.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc19559c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc190102360 0x7fc19019f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:42.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc19559c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc190102360 0x7fc19019f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48522/0 (socket says 172.21.15.107:48522) 2023-08-10T10:50:42.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.794+0000 7fc19559c700 1 -- 172.21.15.107:0/2478920189 learned_addr learned my addr 172.21.15.107:0/2478920189 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:42.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc18ffff700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901019c0 0x7fc1901988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:42.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc194d9b700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1901007d0 0x7fc190198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:42.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc19559c700 1 -- 172.21.15.107:0/2478920189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901019c0 msgr2=0x7fc1901988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc19559c700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901019c0 0x7fc1901988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc19559c700 1 -- 172.21.15.107:0/2478920189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1901007d0 msgr2=0x7fc190198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:42.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc19559c700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1901007d0 0x7fc190198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:42.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc19559c700 1 -- 172.21.15.107:0/2478920189 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840095f0 con 0x7fc190102360 2023-08-10T10:50:42.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc194d9b700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1901007d0 0x7fc190198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:42.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc19559c700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc190102360 0x7fc19019f930 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc188007ee0 tx=0x7fc18800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:42.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc18dffb700 1 -- 172.21.15.107:0/2478920189 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188017070 con 0x7fc190102360 2023-08-10T10:50:42.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc18dffb700 1 -- 172.21.15.107:0/2478920189 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc18800f040 con 0x7fc190102360 2023-08-10T10:50:42.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc18dffb700 1 -- 172.21.15.107:0/2478920189 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188005710 con 0x7fc190102360 2023-08-10T10:50:42.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1901a04b0 con 0x7fc190102360 2023-08-10T10:50:42.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.795+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1901a0970 con 0x7fc190102360 2023-08-10T10:50:42.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.797+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19010be20 con 0x7fc190102360 2023-08-10T10:50:42.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.798+0000 7fc18dffb700 1 -- 172.21.15.107:0/2478920189 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc188005870 con 0x7fc190102360 2023-08-10T10:50:42.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.800+0000 7fc18dffb700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1800a1150 0x7fc1800a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:42.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.801+0000 7fc18dffb700 1 -- 172.21.15.107:0/2478920189 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fc1880cc4a0 con 0x7fc190102360 2023-08-10T10:50:42.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.801+0000 7fc194d9b700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1800a1150 0x7fc1800a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:42.802 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.801+0000 7fc194d9b700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1800a1150 0x7fc1800a3610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc184006010 tx=0x7fc184009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:42.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:42.805+0000 7fc18dffb700 1 -- 172.21.15.107:0/2478920189 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc188095870 con 0x7fc190102360 2023-08-10T10:50:43.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.005+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc1901a0fb0 con 0x7fc190102360 2023-08-10T10:50:43.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.006+0000 7fc18dffb700 1 -- 172.21.15.107:0/2478920189 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc188098e90 con 0x7fc190102360 2023-08-10T10:50:43.007 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:43.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1800a1150 msgr2=0x7fc1800a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1800a1150 0x7fc1800a3610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc184006010 tx=0x7fc184009f10 comp rx=0 tx=0).stop 2023-08-10T10:50:43.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc190102360 msgr2=0x7fc19019f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc190102360 0x7fc19019f930 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc188007ee0 tx=0x7fc18800d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 shutdown_connections 2023-08-10T10:50:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc1800a1150 0x7fc1800a3610 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1901007d0 0x7fc190198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc190102360 0x7fc19019f930 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 --2- 172.21.15.107:0/2478920189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1901019c0 0x7fc1901988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 >> 172.21.15.107:0/2478920189 conn(0x7fc1900fbd40 msgr2=0x7fc1900fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.008+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 shutdown_connections 2023-08-10T10:50:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.009+0000 7fc196fff700 1 -- 172.21.15.107:0/2478920189 wait complete. 2023-08-10T10:50:43.026 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:42 smithi107 ceph-mon[127953]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T10:50:43.026 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:42 smithi107 ceph-mon[127953]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-08-10T10:50:43.026 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:42 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/351743749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:43.026 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:42 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1762677622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:43.028 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:50:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:42 smithi157 ceph-mon[129604]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T10:50:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:42 smithi157 ceph-mon[129604]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-08-10T10:50:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:42 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/351743749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:42 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1762677622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:43.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:42 smithi195 ceph-mon[129938]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-08-10T10:50:43.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:42 smithi195 ceph-mon[129938]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-08-10T10:50:43.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:42 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/351743749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:43.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:42 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1762677622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:43.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.226+0000 7f4d59b9d700 1 -- 172.21.15.107:0/3544083576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d541017d0 msgr2=0x7f4d54101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.226+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/3544083576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d541017d0 0x7f4d54101c30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4d400099c0 tx=0x7f4d40009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.226+0000 7f4d59b9d700 1 -- 172.21.15.107:0/3544083576 shutdown_connections 2023-08-10T10:50:43.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.226+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/3544083576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d541005e0 0x7f4d54100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.226+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/3544083576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d54102170 0x7f4d54108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.226+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/3544083576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d541017d0 0x7f4d54101c30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.226+0000 7f4d59b9d700 1 -- 172.21.15.107:0/3544083576 >> 172.21.15.107:0/3544083576 conn(0x7f4d540fbb50 msgr2=0x7f4d540fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:43.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.226+0000 7f4d59b9d700 1 -- 172.21.15.107:0/3544083576 shutdown_connections 2023-08-10T10:50:43.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.227+0000 7f4d59b9d700 1 -- 172.21.15.107:0/3544083576 wait complete. 2023-08-10T10:50:43.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.228+0000 7f4d59b9d700 1 Processor -- start 2023-08-10T10:50:43.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.228+0000 7f4d59b9d700 1 -- start start 2023-08-10T10:50:43.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d59b9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d541005e0 0x7f4d54074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:43.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d59b9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d541017d0 0x7f4d54072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:43.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d59b9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54102170 0x7f4d540730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:43.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d59b9d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54073840 con 0x7f4d54102170 2023-08-10T10:50:43.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d59b9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540739b0 con 0x7f4d541017d0 2023-08-10T10:50:43.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d59b9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541a0160 con 0x7f4d541005e0 2023-08-10T10:50:43.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d5939c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54102170 0x7f4d540730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:43.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d5939c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54102170 0x7f4d540730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60470/0 (socket says 172.21.15.107:60470) 2023-08-10T10:50:43.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d5939c700 1 -- 172.21.15.107:0/2282323216 learned_addr learned my addr 172.21.15.107:0/2282323216 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:43.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d58b9b700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d541005e0 0x7f4d54074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:43.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d53fff700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d541017d0 0x7f4d54072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:43.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d5939c700 1 -- 172.21.15.107:0/2282323216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d541005e0 msgr2=0x7f4d54074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d5939c700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d541005e0 0x7f4d54074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d5939c700 1 -- 172.21.15.107:0/2282323216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d541017d0 msgr2=0x7f4d54072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d5939c700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d541017d0 0x7f4d54072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d5939c700 1 -- 172.21.15.107:0/2282323216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400095f0 con 0x7f4d54102170 2023-08-10T10:50:43.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.229+0000 7f4d53fff700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d541017d0 0x7f4d54072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:43.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.230+0000 7f4d5939c700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54102170 0x7f4d540730a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00ef30 tx=0x7f4d4c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:43.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.230+0000 7f4d51ffb700 1 -- 172.21.15.107:0/2282323216 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c018070 con 0x7f4d54102170 2023-08-10T10:50:43.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.230+0000 7f4d51ffb700 1 -- 172.21.15.107:0/2282323216 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d4c00f040 con 0x7f4d54102170 2023-08-10T10:50:43.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.230+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d541a03e0 con 0x7f4d54102170 2023-08-10T10:50:43.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.230+0000 7f4d51ffb700 1 -- 172.21.15.107:0/2282323216 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c003d00 con 0x7f4d54102170 2023-08-10T10:50:43.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.230+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d541a08f0 con 0x7f4d54102170 2023-08-10T10:50:43.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.231+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d541074c0 con 0x7f4d54102170 2023-08-10T10:50:43.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.233+0000 7f4d51ffb700 1 -- 172.21.15.107:0/2282323216 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4d4c00caa0 con 0x7f4d54102170 2023-08-10T10:50:43.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.235+0000 7f4d51ffb700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4d440a1270 0x7f4d440a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:43.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.235+0000 7f4d51ffb700 1 -- 172.21.15.107:0/2282323216 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4d4c0cd300 con 0x7f4d54102170 2023-08-10T10:50:43.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.236+0000 7f4d58b9b700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4d440a1270 0x7f4d440a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:43.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.236+0000 7f4d58b9b700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4d440a1270 0x7f4d440a3730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d54101630 tx=0x7f4d48009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:43.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.237+0000 7f4d51ffb700 1 -- 172.21.15.107:0/2282323216 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4d4c096760 con 0x7f4d54102170 2023-08-10T10:50:43.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.435+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d5402cc20 con 0x7f4d54102170 2023-08-10T10:50:43.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.435+0000 7f4d51ffb700 1 -- 172.21.15.107:0/2282323216 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d4c099d80 con 0x7f4d54102170 2023-08-10T10:50:43.437 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T10:50:43.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4d440a1270 msgr2=0x7f4d440a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4d440a1270 0x7f4d440a3730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d54101630 tx=0x7f4d48009260 comp rx=0 tx=0).stop 2023-08-10T10:50:43.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54102170 msgr2=0x7f4d540730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54102170 0x7f4d540730a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00ef30 tx=0x7f4d4c00c450 comp rx=0 tx=0).stop 2023-08-10T10:50:43.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 shutdown_connections 2023-08-10T10:50:43.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4d440a1270 0x7f4d440a3730 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4d54102170 0x7f4d540730a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d541005e0 0x7f4d54074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 --2- 172.21.15.107:0/2282323216 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d541017d0 0x7f4d54072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 >> 172.21.15.107:0/2282323216 conn(0x7f4d540fbb50 msgr2=0x7f4d540fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:43.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 shutdown_connections 2023-08-10T10:50:43.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.438+0000 7f4d59b9d700 1 -- 172.21.15.107:0/2282323216 wait complete. 2023-08-10T10:50:43.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:50:43.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.660+0000 7f3872fff700 1 -- 172.21.15.107:0/1214078635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c1022f0 msgr2=0x7f386c108ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.660+0000 7f3872fff700 1 --2- 172.21.15.107:0/1214078635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c1022f0 0x7f386c108ba0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f386400b0d0 tx=0x7f386400b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.660+0000 7f3872fff700 1 -- 172.21.15.107:0/1214078635 shutdown_connections 2023-08-10T10:50:43.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.660+0000 7f3872fff700 1 --2- 172.21.15.107:0/1214078635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c100760 0x7f386c100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.660+0000 7f3872fff700 1 --2- 172.21.15.107:0/1214078635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c1022f0 0x7f386c108ba0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.660+0000 7f3872fff700 1 --2- 172.21.15.107:0/1214078635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f386c101950 0x7f386c101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.660+0000 7f3872fff700 1 -- 172.21.15.107:0/1214078635 >> 172.21.15.107:0/1214078635 conn(0x7f386c0fbcb0 msgr2=0x7f386c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:43.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.660+0000 7f3872fff700 1 -- 172.21.15.107:0/1214078635 shutdown_connections 2023-08-10T10:50:43.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.660+0000 7f3872fff700 1 -- 172.21.15.107:0/1214078635 wait complete. 2023-08-10T10:50:43.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.661+0000 7f3872fff700 1 Processor -- start 2023-08-10T10:50:43.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.661+0000 7f3872fff700 1 -- start start 2023-08-10T10:50:43.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.661+0000 7f3872fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f386c100760 0x7f386c074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:43.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f3872fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c101950 0x7f386c072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:43.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f3872fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c1022f0 0x7f386c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:43.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f3872fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c073840 con 0x7f386c101950 2023-08-10T10:50:43.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f3872fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0739b0 con 0x7f386c1022f0 2023-08-10T10:50:43.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f3872fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1a05a0 con 0x7f386c100760 2023-08-10T10:50:43.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f386bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c101950 0x7f386c072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:43.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f386bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c101950 0x7f386c072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60482/0 (socket says 172.21.15.107:60482) 2023-08-10T10:50:43.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f386bfff700 1 -- 172.21.15.107:0/1365046291 learned_addr learned my addr 172.21.15.107:0/1365046291 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:43.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f3870d9b700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f386c100760 0x7f386c074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:43.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f387159c700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c1022f0 0x7f386c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:43.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f386bfff700 1 -- 172.21.15.107:0/1365046291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f386c100760 msgr2=0x7f386c074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f386bfff700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f386c100760 0x7f386c074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f386bfff700 1 -- 172.21.15.107:0/1365046291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c1022f0 msgr2=0x7f386c0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f386bfff700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c1022f0 0x7f386c0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f386bfff700 1 -- 172.21.15.107:0/1365046291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3864009d00 con 0x7f386c101950 2023-08-10T10:50:43.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f3870d9b700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f386c100760 0x7f386c074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:43.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f387159c700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c1022f0 0x7f386c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:43.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.662+0000 7f386bfff700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c101950 0x7f386c072b60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f385800b530 tx=0x7f385800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:43.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.663+0000 7f3869ffb700 1 -- 172.21.15.107:0/1365046291 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858011830 con 0x7f386c101950 2023-08-10T10:50:43.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.663+0000 7f3869ffb700 1 -- 172.21.15.107:0/1365046291 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3858011e20 con 0x7f386c101950 2023-08-10T10:50:43.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.663+0000 7f3869ffb700 1 -- 172.21.15.107:0/1365046291 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858010dd0 con 0x7f386c101950 2023-08-10T10:50:43.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.663+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c1a0880 con 0x7f386c101950 2023-08-10T10:50:43.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.663+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c1a0d90 con 0x7f386c101950 2023-08-10T10:50:43.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.664+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c107d40 con 0x7f386c101950 2023-08-10T10:50:43.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.666+0000 7f3869ffb700 1 -- 172.21.15.107:0/1365046291 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3858011990 con 0x7f386c101950 2023-08-10T10:50:43.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.668+0000 7f3869ffb700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f385c0a11d0 0x7f385c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:43.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.668+0000 7f3869ffb700 1 -- 172.21.15.107:0/1365046291 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f38580cc780 con 0x7f386c101950 2023-08-10T10:50:43.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.668+0000 7f3870d9b700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f385c0a11d0 0x7f385c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:43.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.669+0000 7f3870d9b700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f385c0a11d0 0x7f385c0a3690 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f386c1017b0 tx=0x7f3860005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:43.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.672+0000 7f3869ffb700 1 -- 172.21.15.107:0/1365046291 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3858095b50 con 0x7f386c101950 2023-08-10T10:50:43.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.875+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f386c061420 con 0x7f386c101950 2023-08-10T10:50:43.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.875+0000 7f3869ffb700 1 -- 172.21.15.107:0/1365046291 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3858099170 con 0x7f386c101950 2023-08-10T10:50:43.876 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:43.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f385c0a11d0 msgr2=0x7f385c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f385c0a11d0 0x7f385c0a3690 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f386c1017b0 tx=0x7f3860005f90 comp rx=0 tx=0).stop 2023-08-10T10:50:43.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c101950 msgr2=0x7f386c072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:43.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c101950 0x7f386c072b60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f385800b530 tx=0x7f385800b8f0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 shutdown_connections 2023-08-10T10:50:43.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f385c0a11d0 0x7f385c0a3690 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f386c1022f0 0x7f386c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f386c100760 0x7f386c074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 --2- 172.21.15.107:0/1365046291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f386c101950 0x7f386c072b60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:43.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 >> 172.21.15.107:0/1365046291 conn(0x7f386c0fbcb0 msgr2=0x7f386c104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:43.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 shutdown_connections 2023-08-10T10:50:43.880 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:43.878+0000 7f3872fff700 1 -- 172.21.15.107:0/1365046291 wait complete. 2023-08-10T10:50:43.898 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:44.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:43 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2478920189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:44.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:43 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2282323216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:44.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:43 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2478920189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:43 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2282323216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:44.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.096+0000 7f73e37ff700 1 -- 172.21.15.107:0/3674506217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc101970 msgr2=0x7f73dc101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.096+0000 7f73e37ff700 1 --2- 172.21.15.107:0/3674506217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc101970 0x7f73dc101dd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0099c0 tx=0x7f73cc009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.097+0000 7f73e37ff700 1 -- 172.21.15.107:0/3674506217 shutdown_connections 2023-08-10T10:50:44.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.097+0000 7f73e37ff700 1 --2- 172.21.15.107:0/3674506217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73dc102310 0x7f73dc108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.097+0000 7f73e37ff700 1 --2- 172.21.15.107:0/3674506217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc100780 0x7f73dc100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.097+0000 7f73e37ff700 1 --2- 172.21.15.107:0/3674506217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc101970 0x7f73dc101dd0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.097+0000 7f73e37ff700 1 -- 172.21.15.107:0/3674506217 >> 172.21.15.107:0/3674506217 conn(0x7f73dc0fbcb0 msgr2=0x7f73dc0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:44.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.097+0000 7f73e37ff700 1 -- 172.21.15.107:0/3674506217 shutdown_connections 2023-08-10T10:50:44.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.097+0000 7f73e37ff700 1 -- 172.21.15.107:0/3674506217 wait complete. 2023-08-10T10:50:44.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e37ff700 1 Processor -- start 2023-08-10T10:50:44.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e37ff700 1 -- start start 2023-08-10T10:50:44.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e37ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc100780 0x7f73dc1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:44.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e37ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73dc101970 0x7f73dc198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:44.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e37ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc102310 0x7f73dc19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:44.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e37ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc1a0150 con 0x7f73dc100780 2023-08-10T10:50:44.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e37ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc1a0290 con 0x7f73dc101970 2023-08-10T10:50:44.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e37ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc1a0420 con 0x7f73dc102310 2023-08-10T10:50:44.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e159b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc100780 0x7f73dc1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:44.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e159b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc100780 0x7f73dc1985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60508/0 (socket says 172.21.15.107:60508) 2023-08-10T10:50:44.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.098+0000 7f73e159b700 1 -- 172.21.15.107:0/2059641050 learned_addr learned my addr 172.21.15.107:0/2059641050 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:44.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e1d9c700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc102310 0x7f73dc19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:44.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e159b700 1 -- 172.21.15.107:0/2059641050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc102310 msgr2=0x7f73dc19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e159b700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc102310 0x7f73dc19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e0d9a700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73dc101970 0x7f73dc198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:44.102 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e159b700 1 -- 172.21.15.107:0/2059641050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73dc101970 msgr2=0x7f73dc198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e159b700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73dc101970 0x7f73dc198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e159b700 1 -- 172.21.15.107:0/2059641050 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc0095f0 con 0x7f73dc100780 2023-08-10T10:50:44.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e1d9c700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc102310 0x7f73dc19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:44.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e0d9a700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73dc101970 0x7f73dc198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:44.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e159b700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc100780 0x7f73dc1985d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f73d800b500 tx=0x7f73d800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:44.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73d27fc700 1 -- 172.21.15.107:0/2059641050 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8011830 con 0x7f73dc100780 2023-08-10T10:50:44.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc1a0700 con 0x7f73dc100780 2023-08-10T10:50:44.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73d27fc700 1 -- 172.21.15.107:0/2059641050 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73d8011e20 con 0x7f73dc100780 2023-08-10T10:50:44.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73d27fc700 1 -- 172.21.15.107:0/2059641050 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8010dd0 con 0x7f73dc100780 2023-08-10T10:50:44.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.099+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc1a0c90 con 0x7f73dc100780 2023-08-10T10:50:44.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.100+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc192da0 con 0x7f73dc100780 2023-08-10T10:50:44.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.102+0000 7f73d27fc700 1 -- 172.21.15.107:0/2059641050 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f73d8011990 con 0x7f73dc100780 2023-08-10T10:50:44.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.104+0000 7f73d27fc700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f73c80a11a0 0x7f73c80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:44.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.104+0000 7f73d27fc700 1 -- 172.21.15.107:0/2059641050 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f73d80ccbf0 con 0x7f73dc100780 2023-08-10T10:50:44.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.104+0000 7f73e0d9a700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f73c80a11a0 0x7f73c80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:44.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.105+0000 7f73e0d9a700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f73c80a11a0 0x7f73c80a3660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f73cc006010 tx=0x7f73cc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:44.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.105+0000 7f73d27fc700 1 -- 172.21.15.107:0/2059641050 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f73d8095fc0 con 0x7f73dc100780 2023-08-10T10:50:44.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:43 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2478920189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:43 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2282323216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:44.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.346+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73dc02c970 con 0x7f73dc100780 2023-08-10T10:50:44.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.346+0000 7f73d27fc700 1 -- 172.21.15.107:0/2059641050 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10914 (secure 0 0 0) 0x7f73d80995e0 con 0x7f73dc100780 2023-08-10T10:50:44.348 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:44.348 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:49:16.643966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:50:44.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f73c80a11a0 msgr2=0x7f73c80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f73c80a11a0 0x7f73c80a3660 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f73cc006010 tx=0x7f73cc000bc0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc100780 msgr2=0x7f73dc1985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc100780 0x7f73dc1985d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f73d800b500 tx=0x7f73d800b8c0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 shutdown_connections 2023-08-10T10:50:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f73c80a11a0 0x7f73c80a3660 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73dc102310 0x7f73dc19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73dc100780 0x7f73dc1985d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 --2- 172.21.15.107:0/2059641050 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73dc101970 0x7f73dc198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 >> 172.21.15.107:0/2059641050 conn(0x7f73dc0fbcb0 msgr2=0x7f73dc107270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:44.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 shutdown_connections 2023-08-10T10:50:44.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.349+0000 7f73e37ff700 1 -- 172.21.15.107:0/2059641050 wait complete. 2023-08-10T10:50:44.352 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:50:44.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:44.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.564+0000 7f4c601ff700 1 -- 172.21.15.107:0/3355687759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c58100780 msgr2=0x7f4c58100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.564+0000 7f4c601ff700 1 --2- 172.21.15.107:0/3355687759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c58100780 0x7f4c58100ba0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4c540099c0 tx=0x7f4c54009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.564+0000 7f4c601ff700 1 -- 172.21.15.107:0/3355687759 shutdown_connections 2023-08-10T10:50:44.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.564+0000 7f4c601ff700 1 --2- 172.21.15.107:0/3355687759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58102310 0x7f4c58108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.564+0000 7f4c601ff700 1 --2- 172.21.15.107:0/3355687759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c58100780 0x7f4c58100ba0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.564+0000 7f4c601ff700 1 --2- 172.21.15.107:0/3355687759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c58101970 0x7f4c58101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.564+0000 7f4c601ff700 1 -- 172.21.15.107:0/3355687759 >> 172.21.15.107:0/3355687759 conn(0x7f4c580fbcb0 msgr2=0x7f4c580fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:44.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.564+0000 7f4c601ff700 1 -- 172.21.15.107:0/3355687759 shutdown_connections 2023-08-10T10:50:44.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.564+0000 7f4c601ff700 1 -- 172.21.15.107:0/3355687759 wait complete. 2023-08-10T10:50:44.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.565+0000 7f4c601ff700 1 Processor -- start 2023-08-10T10:50:44.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.565+0000 7f4c601ff700 1 -- start start 2023-08-10T10:50:44.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.565+0000 7f4c601ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58100780 0x7f4c58196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:44.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.565+0000 7f4c601ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c58101970 0x7f4c581968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:44.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.565+0000 7f4c601ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c58102310 0x7f4c5819d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:44.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.565+0000 7f4c601ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5819def0 con 0x7f4c58101970 2023-08-10T10:50:44.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.565+0000 7f4c601ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5819e030 con 0x7f4c58102310 2023-08-10T10:50:44.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.565+0000 7f4c601ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5819e1c0 con 0x7f4c58100780 2023-08-10T10:50:44.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5df9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58100780 0x7f4c58196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:44.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5d79a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c58101970 0x7f4c581968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:44.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5df9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58100780 0x7f4c58196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:56526/0 (socket says 172.21.15.107:56526) 2023-08-10T10:50:44.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5df9b700 1 -- 172.21.15.107:0/1603417606 learned_addr learned my addr 172.21.15.107:0/1603417606 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:44.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5e79c700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c58102310 0x7f4c5819d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:44.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5d79a700 1 -- 172.21.15.107:0/1603417606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58100780 msgr2=0x7f4c58196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5d79a700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58100780 0x7f4c58196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5d79a700 1 -- 172.21.15.107:0/1603417606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c58102310 msgr2=0x7f4c5819d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5d79a700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c58102310 0x7f4c5819d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5d79a700 1 -- 172.21.15.107:0/1603417606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c540095f0 con 0x7f4c58101970 2023-08-10T10:50:44.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5e79c700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c58102310 0x7f4c5819d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:44.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c5d79a700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c58101970 0x7f4c581968b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800e9f0 tx=0x7f4c4800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:44.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.566+0000 7f4c4effd700 1 -- 172.21.15.107:0/1603417606 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800eee0 con 0x7f4c58101970 2023-08-10T10:50:44.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.567+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5819e4a0 con 0x7f4c58101970 2023-08-10T10:50:44.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.567+0000 7f4c4effd700 1 -- 172.21.15.107:0/1603417606 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c4800cbd0 con 0x7f4c58101970 2023-08-10T10:50:44.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.567+0000 7f4c4effd700 1 -- 172.21.15.107:0/1603417606 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48018680 con 0x7f4c58101970 2023-08-10T10:50:44.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.567+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5819ea00 con 0x7f4c58101970 2023-08-10T10:50:44.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.568+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5810be50 con 0x7f4c58101970 2023-08-10T10:50:44.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.570+0000 7f4c4effd700 1 -- 172.21.15.107:0/1603417606 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4c4800cd40 con 0x7f4c58101970 2023-08-10T10:50:44.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.571+0000 7f4c4effd700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4c440a11a0 0x7f4c440a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:44.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.571+0000 7f4c4effd700 1 -- 172.21.15.107:0/1603417606 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4c48014070 con 0x7f4c58101970 2023-08-10T10:50:44.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.571+0000 7f4c5df9b700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4c440a11a0 0x7f4c440a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:44.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.572+0000 7f4c5df9b700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4c440a11a0 0x7f4c440a3660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400b580 tx=0x7f4c54005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:44.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.574+0000 7f4c4effd700 1 -- 172.21.15.107:0/1603417606 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4c48051790 con 0x7f4c58101970 2023-08-10T10:50:44.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.775+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c5819f040 con 0x7f4c58101970 2023-08-10T10:50:44.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.777+0000 7f4c4effd700 1 -- 172.21.15.107:0/1603417606 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24563 (secure 0 0 0) 0x7f4c48078e60 con 0x7f4c58101970 2023-08-10T10:50:44.778 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:44.778 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":93,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:50:13.687527+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:44.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4c440a11a0 msgr2=0x7f4c440a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4c440a11a0 0x7f4c440a3660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400b580 tx=0x7f4c54005c00 comp rx=0 tx=0).stop 2023-08-10T10:50:44.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c58101970 msgr2=0x7f4c581968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c58101970 0x7f4c581968b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800e9f0 tx=0x7f4c4800ed00 comp rx=0 tx=0).stop 2023-08-10T10:50:44.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 shutdown_connections 2023-08-10T10:50:44.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4c440a11a0 0x7f4c440a3660 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c58102310 0x7f4c5819d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58100780 0x7f4c58196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 --2- 172.21.15.107:0/1603417606 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c58101970 0x7f4c581968b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 >> 172.21.15.107:0/1603417606 conn(0x7f4c580fbcb0 msgr2=0x7f4c580fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:44.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 shutdown_connections 2023-08-10T10:50:44.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.779+0000 7f4c601ff700 1 -- 172.21.15.107:0/1603417606 wait complete. 2023-08-10T10:50:44.800 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-08-10T10:48:42.135183+0000', 'modified': '2023-08-10T10:49:16.643966+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24575, 'mds_1': 24571, 'mds_2': 24532, 'mds_3': 24497, 'mds_4': 24469}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14592': {'gid': 14592, 'name': 'd', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6837/1989272471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6836', 'nonce': 1989272471}, {'type': 'v1', 'addr': '172.21.15.107:6837', 'nonce': 1989272471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14670': {'gid': 14670, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6839/1945342668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 1945342668}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 1945342668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14682': {'gid': 14682, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6841/718281985', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6840', 'nonce': 718281985}, {'type': 'v1', 'addr': '172.21.15.107:6841', 'nonce': 718281985}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24469': {'gid': 24469, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.195:6833/3699521074', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 3699521074}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 3699521074}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.157:6835/1674728866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 1674728866}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 1674728866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24532': {'gid': 24532, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.195:6835/3324910460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 3324910460}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 3324910460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24536': {'gid': 24536, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6837/2089201911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 2089201911}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 2089201911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24550': {'gid': 24550, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6837/2175306413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 2175306413}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 2175306413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24571': {'gid': 24571, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.195:6839/1633036352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 1633036352}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 1633036352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24575': {'gid': 24575, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6839/2476404740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 2476404740}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 2476404740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:50:44.800 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-08-10T10:50:44.800 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2023-08-10T10:50:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.998+0000 7f019cbff700 1 -- 172.21.15.107:0/3977651347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198102310 msgr2=0x7f0198108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.998+0000 7f019cbff700 1 --2- 172.21.15.107:0/3977651347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198102310 0x7f0198108bc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f019000b0d0 tx=0x7f019000b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.998+0000 7f019cbff700 1 -- 172.21.15.107:0/3977651347 shutdown_connections 2023-08-10T10:50:44.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.998+0000 7f019cbff700 1 --2- 172.21.15.107:0/3977651347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0198100780 0x7f0198100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.998+0000 7f019cbff700 1 --2- 172.21.15.107:0/3977651347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198102310 0x7f0198108bc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.998+0000 7f019cbff700 1 --2- 172.21.15.107:0/3977651347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0198101970 0x7f0198101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.998+0000 7f019cbff700 1 -- 172.21.15.107:0/3977651347 >> 172.21.15.107:0/3977651347 conn(0x7f01980fbcf0 msgr2=0x7f01980fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.998+0000 7f019cbff700 1 -- 172.21.15.107:0/3977651347 shutdown_connections 2023-08-10T10:50:45.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.998+0000 7f019cbff700 1 -- 172.21.15.107:0/3977651347 wait complete. 2023-08-10T10:50:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.999+0000 7f019cbff700 1 Processor -- start 2023-08-10T10:50:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.999+0000 7f019cbff700 1 -- start start 2023-08-10T10:50:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.999+0000 7f019cbff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198100780 0x7f0198196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.999+0000 7f019cbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0198101970 0x7f01981969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.999+0000 7f019cbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0198102310 0x7f019819da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.999+0000 7f019cbff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819dfe0 con 0x7f0198100780 2023-08-10T10:50:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.999+0000 7f019cbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819e120 con 0x7f0198101970 2023-08-10T10:50:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.999+0000 7f019cbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819e2b0 con 0x7f0198102310 2023-08-10T10:50:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:44.999+0000 7f019659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198100780 0x7f0198196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f0195d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0198101970 0x7f01981969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f019659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198100780 0x7f0198196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60548/0 (socket says 172.21.15.107:60548) 2023-08-10T10:50:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f019659c700 1 -- 172.21.15.107:0/1255419666 learned_addr learned my addr 172.21.15.107:0/1255419666 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f0196d9d700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0198102310 0x7f019819da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f019659c700 1 -- 172.21.15.107:0/1255419666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0198102310 msgr2=0x7f019819da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f019659c700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0198102310 0x7f019819da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f019659c700 1 -- 172.21.15.107:0/1255419666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0198101970 msgr2=0x7f01981969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f019659c700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0198101970 0x7f01981969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f019659c700 1 -- 172.21.15.107:0/1255419666 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190009d00 con 0x7f0198100780 2023-08-10T10:50:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f0196d9d700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0198102310 0x7f019819da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f019659c700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198100780 0x7f0198196460 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f018800d980 tx=0x7f018800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f018f7fe700 1 -- 172.21.15.107:0/1255419666 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188004020 con 0x7f0198100780 2023-08-10T10:50:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f019cbff700 1 -- 172.21.15.107:0/1255419666 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019819e590 con 0x7f0198100780 2023-08-10T10:50:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.000+0000 7f018f7fe700 1 -- 172.21.15.107:0/1255419666 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0188009730 con 0x7f0198100780 2023-08-10T10:50:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.001+0000 7f018f7fe700 1 -- 172.21.15.107:0/1255419666 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880039c0 con 0x7f0198100780 2023-08-10T10:50:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.001+0000 7f019cbff700 1 -- 172.21.15.107:0/1255419666 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019819eaa0 con 0x7f0198100780 2023-08-10T10:50:45.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.004+0000 7f018f7fe700 1 -- 172.21.15.107:0/1255419666 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f01880098a0 con 0x7f0198100780 2023-08-10T10:50:45.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.005+0000 7f01b0617b80 1 Processor -- start 2023-08-10T10:50:45.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.005+0000 7f018f7fe700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f017c0a1150 0x7f017c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.005+0000 7f01b0617b80 1 -- start start 2023-08-10T10:50:45.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.005+0000 7f018f7fe700 1 -- 172.21.15.107:0/1255419666 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f01880cc960 con 0x7f0198100780 2023-08-10T10:50:45.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.005+0000 7f0196d9d700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f017c0a1150 0x7f017c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.005+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5610684189a0 0x561068418dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.005+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684176d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.005+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561068417c60 0x5610684180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.005+0000 7f01b0617b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106838ed70 con 0x561068419300 2023-08-10T10:50:45.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f01b0617b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56106836b540 con 0x5610684189a0 2023-08-10T10:50:45.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f01b0617b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561068368e60 con 0x561068417c60 2023-08-10T10:50:45.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0195d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684176d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f019659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5610684189a0 0x561068418dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0195d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684176d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60560/0 (socket says 172.21.15.107:60560) 2023-08-10T10:50:45.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f019659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5610684189a0 0x561068418dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:52192/0 (socket says 172.21.15.107:52192) 2023-08-10T10:50:45.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0195d9b700 1 -- 172.21.15.107:0/1147154204 learned_addr learned my addr 172.21.15.107:0/1147154204 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0196d9d700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f017c0a1150 0x7f017c0a3610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f01900060b0 tx=0x7f0190009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0196d9d700 1 --2- 172.21.15.107:0/1147154204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561068417c60 0x5610684180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0195d9b700 1 -- 172.21.15.107:0/1147154204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561068417c60 msgr2=0x5610684180f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0195d9b700 1 --2- 172.21.15.107:0/1147154204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561068417c60 0x5610684180f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0195d9b700 1 -- 172.21.15.107:0/1147154204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5610684189a0 msgr2=0x561068418dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0195d9b700 1 --2- 172.21.15.107:0/1147154204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5610684189a0 0x561068418dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f0195d9b700 1 -- 172.21.15.107:0/1147154204 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610681e55e0 con 0x561068419300 2023-08-10T10:50:45.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.006+0000 7f019659c700 1 --2- 172.21.15.107:0/1147154204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5610684189a0 0x561068418dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:50:45.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.007+0000 7f0195d9b700 1 --2- 172.21.15.107:0/1147154204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684176d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0184009d80 tx=0x7f0184011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d61eefabbd2e3c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.007+0000 7f018cff9700 1 -- 172.21.15.107:0/1147154204 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184004230 con 0x561068419300 2023-08-10T10:50:45.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.007+0000 7f018cff9700 1 -- 172.21.15.107:0/1147154204 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0184004390 con 0x561068419300 2023-08-10T10:50:45.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.007+0000 7f018cff9700 1 -- 172.21.15.107:0/1147154204 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184019800 con 0x561068419300 2023-08-10T10:50:45.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.007+0000 7f01b0617b80 1 -- 172.21.15.107:0/1147154204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 msgr2=0x5610684176d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.007+0000 7f01b0617b80 1 --2- 172.21.15.107:0/1147154204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684176d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0184009d80 tx=0x7f0184011720 comp rx=0 tx=0).stop 2023-08-10T10:50:45.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.008+0000 7f01b0617b80 1 -- 172.21.15.107:0/1147154204 shutdown_connections 2023-08-10T10:50:45.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.008+0000 7f01b0617b80 1 --2- 172.21.15.107:0/1147154204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5610684189a0 0x561068418dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.008+0000 7f01b0617b80 1 --2- 172.21.15.107:0/1147154204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561068417c60 0x5610684180f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.008+0000 7f01b0617b80 1 --2- 172.21.15.107:0/1147154204 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684176d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.008+0000 7f01b0617b80 1 -- 172.21.15.107:0/1147154204 >> 172.21.15.107:0/1147154204 conn(0x561068370c80 msgr2=0x56106840e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.008+0000 7f01b0617b80 1 -- 172.21.15.107:0/1147154204 shutdown_connections 2023-08-10T10:50:45.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.008+0000 7f01b0617b80 1 -- 172.21.15.107:0/1147154204 wait complete. 2023-08-10T10:50:45.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.008+0000 7f01b0617b80 1 -- start start 2023-08-10T10:50:45.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.008+0000 7f01b0617b80 1 Processor -- start 2023-08-10T10:50:45.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068417c60 0x561068421340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x561068421880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684288c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f01b0617b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561068364750 con 0x561068419300 2023-08-10T10:50:45.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f01b0617b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561068303a70 con 0x561068417c60 2023-08-10T10:50:45.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f01b0617b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561068303770 con 0x5610684189a0 2023-08-10T10:50:45.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f01b0617b80 10 client.0 _ll_register_callbacks cb 0x561068301630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:45.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f0196d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f0196d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684288c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60576/0 (socket says 172.21.15.107:60576) 2023-08-10T10:50:45.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f0196d9d700 1 -- 172.21.15.107:0/879601221 learned_addr learned my addr 172.21.15.107:0/879601221 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f019659c700 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068417c60 0x561068421340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f0195d9b700 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x561068421880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f0196d9d700 1 -- 172.21.15.107:0/879601221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 msgr2=0x561068421880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.009+0000 7f0196d9d700 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x561068421880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f0196d9d700 1 -- 172.21.15.107:0/879601221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068417c60 msgr2=0x561068421340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f0196d9d700 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068417c60 0x561068421340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f0196d9d700 1 -- 172.21.15.107:0/879601221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019819eaa0 con 0x561068419300 2023-08-10T10:50:45.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f019659c700 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068417c60 0x561068421340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:45.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f0196d9d700 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684288c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f019000baa0 tx=0x7f019000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e21dd2dca36865 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f0179ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:45.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f0179ffb700 1 -- 172.21.15.107:0/879601221 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019002a680 con 0x561068419300 2023-08-10T10:50:45.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f01b0617b80 1 -- 172.21.15.107:0/879601221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561068406420 con 0x561068419300 2023-08-10T10:50:45.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f0179ffb700 1 -- 172.21.15.107:0/879601221 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f0190004e20 con 0x561068419300 2023-08-10T10:50:45.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f0179ffb700 1 -- 172.21.15.107:0/879601221 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f019002a7e0 con 0x561068419300 2023-08-10T10:50:45.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f01b0617b80 10 client.15471 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:45.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.010+0000 7f01b0617b80 1 -- 172.21.15.107:0/879601221 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f01840099e0 con 0x561068419300 2023-08-10T10:50:45.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.011+0000 7f0179ffb700 1 -- 172.21.15.107:0/879601221 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561068406420 con 0x561068419300 2023-08-10T10:50:45.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.011+0000 7f0179ffb700 1 -- 172.21.15.107:0/879601221 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f019001d960 con 0x561068419300 2023-08-10T10:50:45.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.011+0000 7f01b0617b80 10 client.15471 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:45.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.011+0000 7f01b0617b80 10 client.15471 resolve_mds: resolved name 'l' to daemon mds.l 2023-08-10T10:50:45.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.011+0000 7f01b0617b80 20 client.15471 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.011+0000 7f01b0617b80 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x56106842c610 0x56106842b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.011+0000 7f01b0617b80 4 client.15471 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.011+0000 7f01b0617b80 1 -- 172.21.15.107:0/879601221 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610683e2980 con 0x56106842c610 2023-08-10T10:50:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.012+0000 7f019659c700 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x56106842c610 0x56106842b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.012+0000 7f0179ffb700 10 client.15471 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:50:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.012+0000 7f019659c700 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x56106842c610 0x56106842b9c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=df8c93e00e521631 server_cookie=ce7edddc9c375b8a in_seq=0 out_seq=0 2023-08-10T10:50:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f0179ffb700 1 -- 172.21.15.107:0/879601221 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5610683e2980 con 0x56106842c610 2023-08-10T10:50:45.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f0179ffb700 10 client.15471 handle_command_reply: tid=0 2023-08-10T10:50:45.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 client.15471 shutdown 2023-08-10T10:50:45.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 -- 172.21.15.107:0/879601221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 msgr2=0x5610684288c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684288c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f019000baa0 tx=0x7f019000b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 -- 172.21.15.107:0/879601221 shutdown_connections 2023-08-10T10:50:45.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x56106842c610 0x56106842b9c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068417c60 0x561068421340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068419300 0x5610684288c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f0179ffb700 0 client.15471 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:50:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 --2- 172.21.15.107:0/879601221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x561068421880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 -- 172.21.15.107:0/879601221 >> 172.21.15.107:0/879601221 conn(0x561068370c80 msgr2=0x56106840d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 -- 172.21.15.107:0/879601221 shutdown_connections 2023-08-10T10:50:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.013+0000 7f01b0617b80 1 -- 172.21.15.107:0/879601221 wait complete. 2023-08-10T10:50:45.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.014+0000 7f01b0617b80 20 client.15471 trim_cache size 0 max 16384 2023-08-10T10:50:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.031+0000 7f01b0617b80 1 Processor -- start 2023-08-10T10:50:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.031+0000 7f01b0617b80 1 -- start start 2023-08-10T10:50:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.031+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x56106842b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.031+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x56106842bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.031+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 0x5610684353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.031+0000 7f01b0617b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610681e78d0 con 0x561068417c60 2023-08-10T10:50:45.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.031+0000 7f01b0617b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610683e29b0 con 0x561068419300 2023-08-10T10:50:45.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.031+0000 7f01b0617b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561068332790 con 0x5610684189a0 2023-08-10T10:50:45.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.031+0000 7f019659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x56106842b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f0196d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 0x5610684353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f019659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x56106842b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60580/0 (socket says 172.21.15.107:60580) 2023-08-10T10:50:45.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f019659c700 1 -- 172.21.15.107:0/1423287305 learned_addr learned my addr 172.21.15.107:0/1423287305 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f0195d9b700 1 --2- 172.21.15.107:0/1423287305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x56106842bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f019659c700 1 -- 172.21.15.107:0/1423287305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 msgr2=0x56106842bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f019659c700 1 --2- 172.21.15.107:0/1423287305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x56106842bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f019659c700 1 -- 172.21.15.107:0/1423287305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 msgr2=0x5610684353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f019659c700 1 --2- 172.21.15.107:0/1423287305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 0x5610684353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f019659c700 1 -- 172.21.15.107:0/1423287305 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561068191d90 con 0x561068417c60 2023-08-10T10:50:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f019659c700 1 --2- 172.21.15.107:0/1423287305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x56106842b9c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0188099980 tx=0x7f01880c9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbbc580da5beea4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f018d7fa700 1 -- 172.21.15.107:0/1423287305 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880999f0 con 0x561068417c60 2023-08-10T10:50:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f018d7fa700 1 -- 172.21.15.107:0/1423287305 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f018809da20 con 0x561068417c60 2023-08-10T10:50:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.032+0000 7f018d7fa700 1 -- 172.21.15.107:0/1423287305 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188098ee0 con 0x561068417c60 2023-08-10T10:50:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 -- 172.21.15.107:0/1423287305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 msgr2=0x56106842b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 --2- 172.21.15.107:0/1423287305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x56106842b9c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0188099980 tx=0x7f01880c9fb0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 -- 172.21.15.107:0/1423287305 shutdown_connections 2023-08-10T10:50:45.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 --2- 172.21.15.107:0/1423287305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 0x5610684353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 --2- 172.21.15.107:0/1423287305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x56106842b9c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 --2- 172.21.15.107:0/1423287305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x56106842bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 -- 172.21.15.107:0/1423287305 >> 172.21.15.107:0/1423287305 conn(0x561068370c80 msgr2=0x56106840e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 -- 172.21.15.107:0/1423287305 shutdown_connections 2023-08-10T10:50:45.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 -- 172.21.15.107:0/1423287305 wait complete. 2023-08-10T10:50:45.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.033+0000 7f01b0617b80 1 -- start start 2023-08-10T10:50:45.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f01b0617b80 1 Processor -- start 2023-08-10T10:50:45.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x561068432520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x561068432a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f01b0617b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 0x561068433a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f01b0617b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561068433f60 con 0x561068417c60 2023-08-10T10:50:45.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f01b0617b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610684340d0 con 0x561068419300 2023-08-10T10:50:45.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f01b0617b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561068434290 con 0x5610684189a0 2023-08-10T10:50:45.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f01b0617b80 10 client.0 _ll_register_callbacks cb 0x561068301630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:45.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f019659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x561068432520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f019659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x561068432520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60588/0 (socket says 172.21.15.107:60588) 2023-08-10T10:50:45.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f019659c700 1 -- 172.21.15.107:0/770875726 learned_addr learned my addr 172.21.15.107:0/770875726 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.034+0000 7f0196d9d700 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 0x561068433a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f0195d9b700 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x561068432a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f019659c700 1 -- 172.21.15.107:0/770875726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 msgr2=0x561068432a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f019659c700 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x561068432a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f019659c700 1 -- 172.21.15.107:0/770875726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 msgr2=0x561068433a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f019659c700 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 0x561068433a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f019659c700 1 -- 172.21.15.107:0/770875726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019819e590 con 0x561068417c60 2023-08-10T10:50:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f0195d9b700 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x561068432a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:45.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f019659c700 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x561068432520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f01880ca0b0 tx=0x7f0188097f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2c68573c3d5e9c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f0179ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:45.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f0179ffb700 1 -- 172.21.15.107:0/770875726 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880a1e40 con 0x561068417c60 2023-08-10T10:50:45.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f01b0617b80 1 -- 172.21.15.107:0/770875726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0184004390 con 0x561068417c60 2023-08-10T10:50:45.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f0179ffb700 1 -- 172.21.15.107:0/770875726 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f0188098ee0 con 0x561068417c60 2023-08-10T10:50:45.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f0179ffb700 1 -- 172.21.15.107:0/770875726 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01880990a0 con 0x561068417c60 2023-08-10T10:50:45.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f01b0617b80 10 client.15477 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:45.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.035+0000 7f01b0617b80 1 -- 172.21.15.107:0/770875726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56106817ac10 con 0x561068417c60 2023-08-10T10:50:45.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.036+0000 7f0179ffb700 1 -- 172.21.15.107:0/770875726 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0184004390 con 0x561068417c60 2023-08-10T10:50:45.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.036+0000 7f0179ffb700 1 -- 172.21.15.107:0/770875726 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f01880b7370 con 0x561068417c60 2023-08-10T10:50:45.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.036+0000 7f01b0617b80 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:45.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.036+0000 7f01b0617b80 10 client.15477 resolve_mds: resolved name 'l' to daemon mds.l 2023-08-10T10:50:45.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.036+0000 7f01b0617b80 20 client.15477 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:45.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.036+0000 7f01b0617b80 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5610684855f0 0x5610684822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.036+0000 7f01b0617b80 4 client.15477 mds_command: new command op to 24469 tid=0[{"prefix": "status"}] 2023-08-10T10:50:45.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.036+0000 7f01b0617b80 1 -- 172.21.15.107:0/770875726 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56106835d730 con 0x5610684855f0 2023-08-10T10:50:45.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.037+0000 7f0195d9b700 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5610684855f0 0x5610684822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.037+0000 7f0179ffb700 10 client.15477 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:50:45.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.037+0000 7f0195d9b700 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5610684855f0 0x5610684822c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5bc4b91f319a0656 server_cookie=4ed78cc71759ddfe in_seq=0 out_seq=0 2023-08-10T10:50:45.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.037+0000 7f0179ffb700 1 -- 172.21.15.107:0/770875726 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56106835d730 con 0x5610684855f0 2023-08-10T10:50:45.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.037+0000 7f0179ffb700 10 client.15477 handle_command_reply: tid=0 2023-08-10T10:50:45.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.037+0000 7f01b0617b80 1 client.15477 shutdown 2023-08-10T10:50:45.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 -- 172.21.15.107:0/770875726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 msgr2=0x561068432520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x561068432520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f01880ca0b0 tx=0x7f0188097f50 comp rx=0 tx=0).stop 2023-08-10T10:50:45.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 -- 172.21.15.107:0/770875726 shutdown_connections 2023-08-10T10:50:45.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5610684855f0 0x5610684822c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561068419300 0x561068433a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f0179ffb700 0 client.15477 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:50:45.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561068417c60 0x561068432520 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 --2- 172.21.15.107:0/770875726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610684189a0 0x561068432a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 -- 172.21.15.107:0/770875726 >> 172.21.15.107:0/770875726 conn(0x561068370c80 msgr2=0x56106841bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 -- 172.21.15.107:0/770875726 shutdown_connections 2023-08-10T10:50:45.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 1 -- 172.21.15.107:0/770875726 wait complete. 2023-08-10T10:50:45.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f01b0617b80 20 client.15477 trim_cache size 0 max 16384 2023-08-10T10:50:45.047 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 4, 2023-08-10T10:50:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24469, 2023-08-10T10:50:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 89.414886124999995, 2023-08-10T10:50:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 162.77915290999999 2023-08-10T10:50:45.049 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:45.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f019cbff700 1 -- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f017c0a1150 msgr2=0x7f017c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f019cbff700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f017c0a1150 0x7f017c0a3610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f01900060b0 tx=0x7f0190009580 comp rx=0 tx=0).stop 2023-08-10T10:50:45.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f019cbff700 1 -- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198100780 msgr2=0x7f0198196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.038+0000 7f019cbff700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198100780 0x7f0198196460 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f018800d980 tx=0x7f018800dc90 comp rx=0 tx=0).stop 2023-08-10T10:50:45.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.039+0000 7f019cbff700 1 -- 172.21.15.107:0/1255419666 shutdown_connections 2023-08-10T10:50:45.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.039+0000 7f019cbff700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f017c0a1150 0x7f017c0a3610 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.039+0000 7f019cbff700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0198102310 0x7f019819da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.039+0000 7f019cbff700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0198100780 0x7f0198196460 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.039+0000 7f019cbff700 1 --2- 172.21.15.107:0/1255419666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0198101970 0x7f01981969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.039+0000 7f019cbff700 1 -- 172.21.15.107:0/1255419666 >> 172.21.15.107:0/1255419666 conn(0x7f01980fbcf0 msgr2=0x7f0198104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.039+0000 7f019cbff700 1 -- 172.21.15.107:0/1255419666 shutdown_connections 2023-08-10T10:50:45.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.039+0000 7f019cbff700 1 -- 172.21.15.107:0/1255419666 wait complete. 2023-08-10T10:50:45.055 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:44 smithi107 ceph-mon[127953]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-08-10T10:50:45.056 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:44 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1365046291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:45.056 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:44 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2059641050' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:45.056 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:44 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1603417606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:45.057 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-08-10T10:50:45.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:44 smithi195 ceph-mon[129938]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-08-10T10:50:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:44 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1365046291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:44 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2059641050' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:44 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1603417606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:45.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.254+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1820687042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd01022f0 msgr2=0x7f6cd0108ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.254+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1820687042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd01022f0 0x7f6cd0108ba0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800b0d0 tx=0x7f6cc800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.254+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1820687042 shutdown_connections 2023-08-10T10:50:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.254+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1820687042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd0100760 0x7f6cd0100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.254+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1820687042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd01022f0 0x7f6cd0108ba0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.254+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1820687042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cd0101950 0x7f6cd0101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.254+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1820687042 >> 172.21.15.107:0/1820687042 conn(0x7f6cd00fbcb0 msgr2=0x7f6cd00fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.254+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1820687042 shutdown_connections 2023-08-10T10:50:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.254+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1820687042 wait complete. 2023-08-10T10:50:45.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.255+0000 7f6cd53ff700 1 Processor -- start 2023-08-10T10:50:45.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.255+0000 7f6cd53ff700 1 -- start start 2023-08-10T10:50:45.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cd53ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100760 0x7f6cd0198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cd53ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd0101950 0x7f6cd0198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cd53ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cd01022f0 0x7f6cd019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cd53ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01a01d0 con 0x7f6cd0100760 2023-08-10T10:50:45.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cd53ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01a0310 con 0x7f6cd0101950 2023-08-10T10:50:45.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cd53ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01a04a0 con 0x7f6cd01022f0 2023-08-10T10:50:45.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cceffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100760 0x7f6cd0198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cceffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100760 0x7f6cd0198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60608/0 (socket says 172.21.15.107:60608) 2023-08-10T10:50:45.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cceffd700 1 -- 172.21.15.107:0/1497858546 learned_addr learned my addr 172.21.15.107:0/1497858546 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cd01022f0 0x7f6cd019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cceffd700 1 -- 172.21.15.107:0/1497858546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cd01022f0 msgr2=0x7f6cd019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cceffd700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cd01022f0 0x7f6cd019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cceffd700 1 -- 172.21.15.107:0/1497858546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd0101950 msgr2=0x7f6cd0198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cceffd700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd0101950 0x7f6cd0198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.256+0000 7f6cceffd700 1 -- 172.21.15.107:0/1497858546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8009d00 con 0x7f6cd0100760 2023-08-10T10:50:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.257+0000 7f6cceffd700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100760 0x7f6cd0198650 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000e970 tx=0x7f6cc000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.257+0000 7f6cccff9700 1 -- 172.21.15.107:0/1497858546 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0009790 con 0x7f6cd0100760 2023-08-10T10:50:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.257+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1497858546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd01a0780 con 0x7f6cd0100760 2023-08-10T10:50:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.257+0000 7f6cccff9700 1 -- 172.21.15.107:0/1497858546 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cc00044b0 con 0x7f6cd0100760 2023-08-10T10:50:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.257+0000 7f6cccff9700 1 -- 172.21.15.107:0/1497858546 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0003dd0 con 0x7f6cd0100760 2023-08-10T10:50:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.257+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1497858546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd01a0c90 con 0x7f6cd0100760 2023-08-10T10:50:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.260+0000 7f6cccff9700 1 -- 172.21.15.107:0/1497858546 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6cc0003f30 con 0x7f6cd0100760 2023-08-10T10:50:45.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6ce8e0bb80 1 Processor -- start 2023-08-10T10:50:45.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6ce8e0bb80 1 -- start start 2023-08-10T10:50:45.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6cccff9700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6cbc0a1150 0x7f6cbc0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecc2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc2e50 0x557e4ecc3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc3910 0x557e4ecc3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ec3dd70 con 0x557e4ecc2e50 2023-08-10T10:50:45.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ec1a540 con 0x557e4ecc3910 2023-08-10T10:50:45.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ec17e60 con 0x557e4ecc24f0 2023-08-10T10:50:45.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6cccff9700 1 -- 172.21.15.107:0/1497858546 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f6cc0014070 con 0x7f6cd0100760 2023-08-10T10:50:45.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6cbc0a1150 0x7f6cbc0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6cc7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc2e50 0x557e4ecc3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.262+0000 7f6cc7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc2e50 0x557e4ecc3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60610/0 (socket says 172.21.15.107:60610) 2023-08-10T10:50:45.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6cc7fff700 1 -- 172.21.15.107:0/3521786053 learned_addr learned my addr 172.21.15.107:0/3521786053 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/3521786053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc3910 0x557e4ecc3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6cceffd700 1 --2- 172.21.15.107:0/3521786053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecc2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6cc7fff700 1 -- 172.21.15.107:0/3521786053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 msgr2=0x557e4ecc2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6cc7fff700 1 --2- 172.21.15.107:0/3521786053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecc2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6cc7fff700 1 -- 172.21.15.107:0/3521786053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc3910 msgr2=0x557e4ecc3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6cc7fff700 1 --2- 172.21.15.107:0/3521786053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc3910 0x557e4ecc3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6cc7fff700 1 -- 172.21.15.107:0/3521786053 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e4ea945e0 con 0x557e4ecc2e50 2023-08-10T10:50:45.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6cc7fff700 1 --2- 172.21.15.107:0/3521786053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc2e50 0x557e4ecc3380 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009cd0 tx=0x7f6cb800e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a328d3918e13511c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6cbc0a1150 0x7f6cbc0a3610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80062a0 tx=0x7f6cc8009450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.263+0000 7f6cc57fa700 1 -- 172.21.15.107:0/3521786053 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800ebd0 con 0x557e4ecc2e50 2023-08-10T10:50:45.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6cc57fa700 1 -- 172.21.15.107:0/3521786053 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cb800ed30 con 0x557e4ecc2e50 2023-08-10T10:50:45.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6cc57fa700 1 -- 172.21.15.107:0/3521786053 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80055c0 con 0x557e4ecc2e50 2023-08-10T10:50:45.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/3521786053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc2e50 msgr2=0x557e4ecc3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/3521786053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc2e50 0x557e4ecc3380 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009cd0 tx=0x7f6cb800e350 comp rx=0 tx=0).stop 2023-08-10T10:50:45.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/3521786053 shutdown_connections 2023-08-10T10:50:45.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/3521786053 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc3910 0x557e4ecc3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/3521786053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecc2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/3521786053 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc2e50 0x557e4ecc3380 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/3521786053 >> 172.21.15.107:0/3521786053 conn(0x557e4ec1fc80 msgr2=0x557e4ecbd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/3521786053 shutdown_connections 2023-08-10T10:50:45.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.264+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/3521786053 wait complete. 2023-08-10T10:50:45.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.265+0000 7f6ce8e0bb80 1 -- start start 2023-08-10T10:50:45.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.265+0000 7f6ce8e0bb80 1 Processor -- start 2023-08-10T10:50:45.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4eccbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4eccc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecd3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ec13750 con 0x557e4ecc3910 2023-08-10T10:50:45.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ebb2a70 con 0x557e4ecc2e50 2023-08-10T10:50:45.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ebb2770 con 0x557e4ecc24f0 2023-08-10T10:50:45.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ce8e0bb80 10 client.0 _ll_register_callbacks cb 0x557e4ebb0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:45.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ccf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecd3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6cceffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4eccbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ccf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecd3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60612/0 (socket says 172.21.15.107:60612) 2023-08-10T10:50:45.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/2650417422 learned_addr learned my addr 172.21.15.107:0/2650417422 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.266+0000 7f6cc7fff700 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4eccc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/2650417422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 msgr2=0x557e4eccbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4eccbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/2650417422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 msgr2=0x557e4eccc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4eccc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/2650417422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb8009980 con 0x557e4ecc3910 2023-08-10T10:50:45.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecd3520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80097f0 tx=0x7f6cc800b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857e0c8c16dd98f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6cb67fc700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:45.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6cb67fc700 1 -- 172.21.15.107:0/2650417422 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc800e070 con 0x557e4ecc3910 2023-08-10T10:50:45.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/2650417422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e4ecb5420 con 0x557e4ecc3910 2023-08-10T10:50:45.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6cb67fc700 1 -- 172.21.15.107:0/2650417422 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f6cc8007cb0 con 0x557e4ecc3910 2023-08-10T10:50:45.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6cb67fc700 1 -- 172.21.15.107:0/2650417422 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cc8009b80 con 0x557e4ecc3910 2023-08-10T10:50:45.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6ce8e0bb80 10 client.15489 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:45.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.267+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/2650417422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557e4ea40d90 con 0x557e4ecc3910 2023-08-10T10:50:45.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.268+0000 7f6cb67fc700 1 -- 172.21.15.107:0/2650417422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557e4ecb5420 con 0x557e4ecc3910 2023-08-10T10:50:45.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.268+0000 7f6cb67fc700 1 -- 172.21.15.107:0/2650417422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6cc8019070 con 0x557e4ecc3910 2023-08-10T10:50:45.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.268+0000 7f6ce8e0bb80 10 client.15489 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:45.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.268+0000 7f6ce8e0bb80 10 client.15489 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-10T10:50:45.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.268+0000 7f6ce8e0bb80 20 client.15489 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:45.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.268+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x557e4ecd7240 0x557e4ecd6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.268+0000 7f6ce8e0bb80 4 client.15489 mds_command: new command op to 24497 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:45.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.268+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/2650417422 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e4ec91980 con 0x557e4ecd7240 2023-08-10T10:50:45.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.268+0000 7f6cceffd700 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x557e4ecd7240 0x557e4ecd6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.269+0000 7f6cb67fc700 10 client.15489 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:50:45.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.269+0000 7f6cceffd700 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x557e4ecd7240 0x557e4ecd6620 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=28755234bafb4d79 server_cookie=ac97592b5664090 in_seq=0 out_seq=0 2023-08-10T10:50:45.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6cb67fc700 1 -- 172.21.15.107:0/2650417422 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557e4ec91980 con 0x557e4ecd7240 2023-08-10T10:50:45.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6cb67fc700 10 client.15489 handle_command_reply: tid=0 2023-08-10T10:50:45.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 client.15489 shutdown 2023-08-10T10:50:45.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/2650417422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 msgr2=0x557e4ecd3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecd3520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80097f0 tx=0x7f6cc800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/2650417422 shutdown_connections 2023-08-10T10:50:45.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x557e4ecd7240 0x557e4ecd6620 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecd3520 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6cb67fc700 0 client.15489 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:50:45.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4eccbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/2650417422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4eccc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/2650417422 >> 172.21.15.107:0/2650417422 conn(0x557e4ec1fc80 msgr2=0x557e4ecbc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/2650417422 shutdown_connections 2023-08-10T10:50:45.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.270+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/2650417422 wait complete. 2023-08-10T10:50:45.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.271+0000 7f6ce8e0bb80 20 client.15489 trim_cache size 0 max 16384 2023-08-10T10:50:45.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:44 smithi157 ceph-mon[129604]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2023-08-10T10:50:45.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:44 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1365046291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:45.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:44 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2059641050' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:45.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:44 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1603417606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:45.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.288+0000 7f6ce8e0bb80 1 Processor -- start 2023-08-10T10:50:45.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.288+0000 7f6ce8e0bb80 1 -- start start 2023-08-10T10:50:45.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.288+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecc6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.288+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecc6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.288+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecdffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.288+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ea968d0 con 0x557e4ecc3910 2023-08-10T10:50:45.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.288+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ecb7cc0 con 0x557e4ecc2e50 2023-08-10T10:50:45.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.288+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ecb7810 con 0x557e4ecc24f0 2023-08-10T10:50:45.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6ccf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecdffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6ccf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecdffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60624/0 (socket says 172.21.15.107:60624) 2023-08-10T10:50:45.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/1792769560 learned_addr learned my addr 172.21.15.107:0/1792769560 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6cceffd700 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecc6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6cc7fff700 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecc6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/1792769560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 msgr2=0x557e4ecc6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecc6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/1792769560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 msgr2=0x557e4ecc6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecc6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/1792769560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e4ea29c10 con 0x557e4ecc3910 2023-08-10T10:50:45.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6cceffd700 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecc6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:45.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6cc7fff700 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecc6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:45.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecdffd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009320 tx=0x7f6cc800b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc3bbe7efbfdd72 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.289+0000 7f6cc5ffb700 1 -- 172.21.15.107:0/1792769560 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc800e070 con 0x557e4ecc3910 2023-08-10T10:50:45.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6cc5ffb700 1 -- 172.21.15.107:0/1792769560 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cc8020ac0 con 0x557e4ecc3910 2023-08-10T10:50:45.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6cc5ffb700 1 -- 172.21.15.107:0/1792769560 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8007760 con 0x557e4ecc3910 2023-08-10T10:50:45.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1792769560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 msgr2=0x557e4ecdffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecdffd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009320 tx=0x7f6cc800b050 comp rx=0 tx=0).stop 2023-08-10T10:50:45.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1792769560 shutdown_connections 2023-08-10T10:50:45.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ecdffd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecc6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1792769560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecc6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1792769560 >> 172.21.15.107:0/1792769560 conn(0x557e4ec1fc80 msgr2=0x557e4ecd6620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1792769560 shutdown_connections 2023-08-10T10:50:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.290+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1792769560 wait complete. 2023-08-10T10:50:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ce8e0bb80 1 -- start start 2023-08-10T10:50:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ce8e0bb80 1 Processor -- start 2023-08-10T10:50:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecdcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecdd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ce8e0bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ed2aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ece00f0 con 0x557e4ecc3910 2023-08-10T10:50:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ece0260 con 0x557e4ecc2e50 2023-08-10T10:50:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ce8e0bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4ece0420 con 0x557e4ecc24f0 2023-08-10T10:50:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ce8e0bb80 10 client.0 _ll_register_callbacks cb 0x557e4ebb0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ccf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ed2aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ccf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ed2aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60628/0 (socket says 172.21.15.107:60628) 2023-08-10T10:50:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.291+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/1060937046 learned_addr learned my addr 172.21.15.107:0/1060937046 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6cceffd700 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecdcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6cc7fff700 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecdd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/1060937046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 msgr2=0x557e4ecdcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecdcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/1060937046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 msgr2=0x557e4ecdd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecdd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6ccf7fe700 1 -- 172.21.15.107:0/1060937046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e4ea40d90 con 0x557e4ecc3910 2023-08-10T10:50:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6cc7fff700 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecdd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6ccf7fe700 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ed2aee0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009fd0 tx=0x7f6cc802c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a45d24312e5d05 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6cb67fc700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6cb67fc700 1 -- 172.21.15.107:0/1060937046 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc800e040 con 0x557e4ecc3910 2023-08-10T10:50:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1060937046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e4ec0c730 con 0x557e4ecc3910 2023-08-10T10:50:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.292+0000 7f6cb67fc700 1 -- 172.21.15.107:0/1060937046 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f6cc8007760 con 0x557e4ecc3910 2023-08-10T10:50:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6cb67fc700 1 -- 172.21.15.107:0/1060937046 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cc8007cb0 con 0x557e4ecc3910 2023-08-10T10:50:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6ce8e0bb80 10 client.15495 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1060937046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557e4ea67200 con 0x557e4ecc3910 2023-08-10T10:50:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6cb67fc700 1 -- 172.21.15.107:0/1060937046 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cc804a020 con 0x557e4ecc3910 2023-08-10T10:50:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6cb67fc700 1 -- 172.21.15.107:0/1060937046 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6cc8019050 con 0x557e4ecc3910 2023-08-10T10:50:45.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6ce8e0bb80 10 client.15495 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:45.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6ce8e0bb80 10 client.15495 resolve_mds: resolved name 'e' to daemon mds.e 2023-08-10T10:50:45.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6ce8e0bb80 20 client.15495 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:45.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x557e4ed2fb30 0x557e4ed2c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6ce8e0bb80 4 client.15495 mds_command: new command op to 24497 tid=0[{"prefix": "status"}] 2023-08-10T10:50:45.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.293+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1060937046 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557e4ebce000 con 0x557e4ed2fb30 2023-08-10T10:50:45.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.294+0000 7f6cceffd700 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x557e4ed2fb30 0x557e4ed2c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.294+0000 7f6cb67fc700 10 client.15495 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:50:45.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.294+0000 7f6cceffd700 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x557e4ed2fb30 0x557e4ed2c4a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=117f2d5f22fb0e0f server_cookie=33ff005f04e77118 in_seq=0 out_seq=0 2023-08-10T10:50:45.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.294+0000 7f6cb67fc700 1 -- 172.21.15.107:0/1060937046 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557e4ebce000 con 0x557e4ed2fb30 2023-08-10T10:50:45.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.294+0000 7f6cb67fc700 10 client.15495 handle_command_reply: tid=0 2023-08-10T10:50:45.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.294+0000 7f6ce8e0bb80 1 client.15495 shutdown 2023-08-10T10:50:45.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.294+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1060937046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 msgr2=0x557e4ed2aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.294+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ed2aee0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009fd0 tx=0x7f6cc802c7e0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1060937046 shutdown_connections 2023-08-10T10:50:45.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x557e4ed2fb30 0x557e4ed2c4a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557e4ecc3910 0x557e4ed2aee0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e4ecc24f0 0x557e4ecdcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6ce8e0bb80 1 --2- 172.21.15.107:0/1060937046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557e4ecc2e50 0x557e4ecdd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6cb67fc700 0 client.15495 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:50:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1060937046 >> 172.21.15.107:0/1060937046 conn(0x557e4ec1fc80 msgr2=0x557e4ecc6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1060937046 shutdown_connections 2023-08-10T10:50:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6ce8e0bb80 1 -- 172.21.15.107:0/1060937046 wait complete. 2023-08-10T10:50:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6ce8e0bb80 20 client.15495 trim_cache size 0 max 16384 2023-08-10T10:50:45.309 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:45.310 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:45.310 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 3, 2023-08-10T10:50:45.310 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24497, 2023-08-10T10:50:45.310 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:45.310 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:45.310 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:45.310 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 90.679359911999995, 2023-08-10T10:50:45.311 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:45.311 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:45.311 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:45.311 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 150.66668781300001 2023-08-10T10:50:45.311 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6cbc0a1150 msgr2=0x7f6cbc0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6cbc0a1150 0x7f6cbc0a3610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80062a0 tx=0x7f6cc8009450 comp rx=0 tx=0).stop 2023-08-10T10:50:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100760 msgr2=0x7f6cd0198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100760 0x7f6cd0198650 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000e970 tx=0x7f6cc000ed30 comp rx=0 tx=0).stop 2023-08-10T10:50:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1497858546 shutdown_connections 2023-08-10T10:50:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f6cbc0a1150 0x7f6cbc0a3610 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.295+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cd01022f0 0x7f6cd019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.296+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cd0100760 0x7f6cd0198650 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.296+0000 7f6cd53ff700 1 --2- 172.21.15.107:0/1497858546 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd0101950 0x7f6cd0198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.296+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1497858546 >> 172.21.15.107:0/1497858546 conn(0x7f6cd00fbcb0 msgr2=0x7f6cd0107290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.296+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1497858546 shutdown_connections 2023-08-10T10:50:45.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.296+0000 7f6cd53ff700 1 -- 172.21.15.107:0/1497858546 wait complete. 2023-08-10T10:50:45.314 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-08-10T10:50:45.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.512+0000 7ff3fcbff700 1 -- 172.21.15.107:0/347455824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f8101950 msgr2=0x7ff3f8101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.512+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/347455824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f8101950 0x7ff3f8101db0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0099c0 tx=0x7ff3ec009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.512+0000 7ff3fcbff700 1 -- 172.21.15.107:0/347455824 shutdown_connections 2023-08-10T10:50:45.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.512+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/347455824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f81022f0 0x7ff3f8108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.512+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/347455824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3f8100760 0x7ff3f8100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.512+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/347455824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f8101950 0x7ff3f8101db0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.512+0000 7ff3fcbff700 1 -- 172.21.15.107:0/347455824 >> 172.21.15.107:0/347455824 conn(0x7ff3f80fbcb0 msgr2=0x7ff3f80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.512+0000 7ff3fcbff700 1 -- 172.21.15.107:0/347455824 shutdown_connections 2023-08-10T10:50:45.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.512+0000 7ff3fcbff700 1 -- 172.21.15.107:0/347455824 wait complete. 2023-08-10T10:50:45.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3fcbff700 1 Processor -- start 2023-08-10T10:50:45.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3fcbff700 1 -- start start 2023-08-10T10:50:45.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3fcbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3f8100760 0x7ff3f8074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3fcbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f8101950 0x7ff3f8072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3fcbff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f81022f0 0x7ff3f80730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3fcbff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f8073840 con 0x7ff3f81022f0 2023-08-10T10:50:45.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3fcbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80739b0 con 0x7ff3f8101950 2023-08-10T10:50:45.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3fcbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f81a0460 con 0x7ff3f8100760 2023-08-10T10:50:45.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3f6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f81022f0 0x7ff3f80730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3f6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f81022f0 0x7ff3f80730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60632/0 (socket says 172.21.15.107:60632) 2023-08-10T10:50:45.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.513+0000 7ff3f6d9d700 1 -- 172.21.15.107:0/2464401803 learned_addr learned my addr 172.21.15.107:0/2464401803 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f8101950 0x7ff3f8072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f659c700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3f8100760 0x7ff3f8074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f6d9d700 1 -- 172.21.15.107:0/2464401803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3f8100760 msgr2=0x7ff3f8074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3f8100760 0x7ff3f8074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f6d9d700 1 -- 172.21.15.107:0/2464401803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f8101950 msgr2=0x7ff3f8072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f8101950 0x7ff3f8072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f6d9d700 1 -- 172.21.15.107:0/2464401803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec0095f0 con 0x7ff3f81022f0 2023-08-10T10:50:45.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f8101950 0x7ff3f8072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:45.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f659c700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3f8100760 0x7ff3f8074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:45.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f81022f0 0x7ff3f80730a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000ef30 tx=0x7ff3f000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3e77fe700 1 -- 172.21.15.107:0/2464401803 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0018070 con 0x7ff3f81022f0 2023-08-10T10:50:45.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3fcbff700 1 -- 172.21.15.107:0/2464401803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f81a06e0 con 0x7ff3f81022f0 2023-08-10T10:50:45.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3e77fe700 1 -- 172.21.15.107:0/2464401803 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3f000f040 con 0x7ff3f81022f0 2023-08-10T10:50:45.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3e77fe700 1 -- 172.21.15.107:0/2464401803 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0003d00 con 0x7ff3f81022f0 2023-08-10T10:50:45.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.514+0000 7ff3fcbff700 1 -- 172.21.15.107:0/2464401803 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f81a0bf0 con 0x7ff3f81022f0 2023-08-10T10:50:45.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.517+0000 7ff3e77fe700 1 -- 172.21.15.107:0/2464401803 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff3f000caa0 con 0x7ff3f81022f0 2023-08-10T10:50:45.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff4104d6b80 1 Processor -- start 2023-08-10T10:50:45.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff4104d6b80 1 -- start start 2023-08-10T10:50:45.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff3e77fe700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff3e00a1150 0x7ff3e00a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff3e77fe700 1 -- 172.21.15.107:0/2464401803 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7ff3f00cc980 con 0x7ff3f81022f0 2023-08-10T10:50:45.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e588b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588be50 0x5637e588c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588c910 0x5637e588cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e5806d70 con 0x5637e588b4f0 2023-08-10T10:50:45.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e57e3540 con 0x5637e588c910 2023-08-10T10:50:45.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e57e0e60 con 0x5637e588be50 2023-08-10T10:50:45.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff3e00a1150 0x7ff3e00a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff3f659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e588b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff3f659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e588b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60634/0 (socket says 172.21.15.107:60634) 2023-08-10T10:50:45.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.519+0000 7ff3f659c700 1 -- 172.21.15.107:0/4292738002 learned_addr learned my addr 172.21.15.107:0/4292738002 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588c910 0x5637e588cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588be50 0x5637e588c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f659c700 1 -- 172.21.15.107:0/4292738002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588be50 msgr2=0x5637e588c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f659c700 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588be50 0x5637e588c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f659c700 1 -- 172.21.15.107:0/4292738002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588c910 msgr2=0x5637e588cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f659c700 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588c910 0x5637e588cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f659c700 1 -- 172.21.15.107:0/4292738002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e565d5e0 con 0x5637e588b4f0 2023-08-10T10:50:45.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588be50 0x5637e588c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:45.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff3e00a1150 0x7ff3e00a3610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00b580 tx=0x7ff3ec005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3f659c700 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e588b910 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009cc0 tx=0x7ff3e800e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c82c31ae7d7839 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3e4ff9700 1 -- 172.21.15.107:0/4292738002 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800eb40 con 0x5637e588b4f0 2023-08-10T10:50:45.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3e4ff9700 1 -- 172.21.15.107:0/4292738002 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3e800eca0 con 0x5637e588b4f0 2023-08-10T10:50:45.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.520+0000 7ff3e4ff9700 1 -- 172.21.15.107:0/4292738002 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8010630 con 0x5637e588b4f0 2023-08-10T10:50:45.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.521+0000 7ff4104d6b80 1 -- 172.21.15.107:0/4292738002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 msgr2=0x5637e588b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.521+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e588b910 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009cc0 tx=0x7ff3e800e2f0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.521+0000 7ff4104d6b80 1 -- 172.21.15.107:0/4292738002 shutdown_connections 2023-08-10T10:50:45.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.521+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588c910 0x5637e588cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.521+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e588b910 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.521+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/4292738002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588be50 0x5637e588c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.521+0000 7ff4104d6b80 1 -- 172.21.15.107:0/4292738002 >> 172.21.15.107:0/4292738002 conn(0x5637e57e8c80 msgr2=0x5637e5886280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.521+0000 7ff4104d6b80 1 -- 172.21.15.107:0/4292738002 shutdown_connections 2023-08-10T10:50:45.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.521+0000 7ff4104d6b80 1 -- 172.21.15.107:0/4292738002 wait complete. 2023-08-10T10:50:45.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.522+0000 7ff4104d6b80 1 -- start start 2023-08-10T10:50:45.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.522+0000 7ff4104d6b80 1 Processor -- start 2023-08-10T10:50:45.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.522+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e5894fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.522+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 0x5637e58954e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.522+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 0x5637e589c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.522+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e57dc750 con 0x5637e588b4f0 2023-08-10T10:50:45.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.522+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e577ba70 con 0x5637e588be50 2023-08-10T10:50:45.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.522+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e577b770 con 0x5637e588c910 2023-08-10T10:50:45.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.522+0000 7ff4104d6b80 10 client.0 _ll_register_callbacks cb 0x5637e5779630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:45.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e5894fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e5894fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60646/0 (socket says 172.21.15.107:60646) 2023-08-10T10:50:45.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f659c700 1 -- 172.21.15.107:0/70457495 learned_addr learned my addr 172.21.15.107:0/70457495 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 0x5637e58954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 0x5637e589c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f659c700 1 -- 172.21.15.107:0/70457495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 msgr2=0x5637e589c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f659c700 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 0x5637e589c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f659c700 1 -- 172.21.15.107:0/70457495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 msgr2=0x5637e58954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f659c700 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 0x5637e58954e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f659c700 1 -- 172.21.15.107:0/70457495 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e8009920 con 0x5637e588b4f0 2023-08-10T10:50:45.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3f659c700 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e5894fa0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80098f0 tx=0x7ff3e8011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50e7015b98a6f45 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.523+0000 7ff3ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:45.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff3ddffb700 1 -- 172.21.15.107:0/70457495 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8021070 con 0x5637e588b4f0 2023-08-10T10:50:45.532 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff4104d6b80 1 -- 172.21.15.107:0/70457495 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637e587e420 con 0x5637e588b4f0 2023-08-10T10:50:45.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff3ddffb700 1 -- 172.21.15.107:0/70457495 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7ff3e8011680 con 0x5637e588b4f0 2023-08-10T10:50:45.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff3ddffb700 1 -- 172.21.15.107:0/70457495 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3e8011840 con 0x5637e588b4f0 2023-08-10T10:50:45.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff4104d6b80 10 client.15507 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:45.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff4104d6b80 1 -- 172.21.15.107:0/70457495 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5637e5609d90 con 0x5637e588b4f0 2023-08-10T10:50:45.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff3ddffb700 1 -- 172.21.15.107:0/70457495 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5637e587e420 con 0x5637e588b4f0 2023-08-10T10:50:45.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff3ddffb700 1 -- 172.21.15.107:0/70457495 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff3e800c070 con 0x5637e588b4f0 2023-08-10T10:50:45.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff4104d6b80 10 client.15507 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:45.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff4104d6b80 10 client.15507 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-10T10:50:45.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff4104d6b80 20 client.15507 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:45.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5637e58a0100 0x5637e589f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff4104d6b80 4 client.15507 mds_command: new command op to 24532 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:45.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.524+0000 7ff4104d6b80 1 -- 172.21.15.107:0/70457495 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637e585a980 con 0x5637e58a0100 2023-08-10T10:50:45.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.525+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5637e58a0100 0x5637e589f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.525+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5637e58a0100 0x5637e589f580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a9f0bf08d15b4d76 server_cookie=da1209d24440fe86 in_seq=0 out_seq=0 2023-08-10T10:50:45.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.525+0000 7ff3ddffb700 10 client.15507 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:50:45.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.526+0000 7ff3ddffb700 1 -- 172.21.15.107:0/70457495 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5637e585a980 con 0x5637e58a0100 2023-08-10T10:50:45.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.526+0000 7ff3ddffb700 10 client.15507 handle_command_reply: tid=0 2023-08-10T10:50:45.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.526+0000 7ff4104d6b80 1 client.15507 shutdown 2023-08-10T10:50:45.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.526+0000 7ff4104d6b80 1 -- 172.21.15.107:0/70457495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 msgr2=0x5637e5894fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.526+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e5894fa0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80098f0 tx=0x7ff3e8011d00 comp rx=0 tx=0).stop 2023-08-10T10:50:45.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff4104d6b80 1 -- 172.21.15.107:0/70457495 shutdown_connections 2023-08-10T10:50:45.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5637e58a0100 0x5637e589f580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 0x5637e589c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588b4f0 0x5637e5894fa0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff3ddffb700 0 client.15507 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:50:45.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/70457495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 0x5637e58954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff4104d6b80 1 -- 172.21.15.107:0/70457495 >> 172.21.15.107:0/70457495 conn(0x5637e57e8c80 msgr2=0x5637e5885960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff4104d6b80 1 -- 172.21.15.107:0/70457495 shutdown_connections 2023-08-10T10:50:45.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff4104d6b80 1 -- 172.21.15.107:0/70457495 wait complete. 2023-08-10T10:50:45.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.527+0000 7ff4104d6b80 20 client.15507 trim_cache size 0 max 16384 2023-08-10T10:50:45.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff4104d6b80 1 Processor -- start 2023-08-10T10:50:45.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff4104d6b80 1 -- start start 2023-08-10T10:50:45.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588b4f0 0x5637e589f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 0x5637e589c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588c910 0x5637e588f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e565f8d0 con 0x5637e588c910 2023-08-10T10:50:45.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e5880a30 con 0x5637e588be50 2023-08-10T10:50:45.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e5886fc0 con 0x5637e588b4f0 2023-08-10T10:50:45.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff3f6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588c910 0x5637e588f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff3f6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588c910 0x5637e588f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60650/0 (socket says 172.21.15.107:60650) 2023-08-10T10:50:45.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.545+0000 7ff3f6d9d700 1 -- 172.21.15.107:0/367706310 learned_addr learned my addr 172.21.15.107:0/367706310 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 0x5637e589c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f659c700 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588b4f0 0x5637e589f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f6d9d700 1 -- 172.21.15.107:0/367706310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588b4f0 msgr2=0x5637e589f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588b4f0 0x5637e589f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f6d9d700 1 -- 172.21.15.107:0/367706310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 msgr2=0x5637e589c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 0x5637e589c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f6d9d700 1 -- 172.21.15.107:0/367706310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e55f2c10 con 0x5637e588c910 2023-08-10T10:50:45.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 0x5637e589c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:45.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f659c700 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588b4f0 0x5637e589f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:45.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588c910 0x5637e588f7c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00997a0 tx=0x7ff3f00956c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99892fef9566a66 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3e57fa700 1 -- 172.21.15.107:0/367706310 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f009dad0 con 0x5637e588c910 2023-08-10T10:50:45.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3e57fa700 1 -- 172.21.15.107:0/367706310 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3f00a1e60 con 0x5637e588c910 2023-08-10T10:50:45.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.546+0000 7ff3e57fa700 1 -- 172.21.15.107:0/367706310 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00991f0 con 0x5637e588c910 2023-08-10T10:50:45.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 -- 172.21.15.107:0/367706310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588c910 msgr2=0x5637e588f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588c910 0x5637e588f7c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00997a0 tx=0x7ff3f00956c0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 -- 172.21.15.107:0/367706310 shutdown_connections 2023-08-10T10:50:45.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588c910 0x5637e588f7c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588b4f0 0x5637e589f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/367706310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588be50 0x5637e589c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 -- 172.21.15.107:0/367706310 >> 172.21.15.107:0/367706310 conn(0x5637e57e8c80 msgr2=0x5637e5893c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 -- 172.21.15.107:0/367706310 shutdown_connections 2023-08-10T10:50:45.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 -- 172.21.15.107:0/367706310 wait complete. 2023-08-10T10:50:45.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.547+0000 7ff4104d6b80 1 -- start start 2023-08-10T10:50:45.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff4104d6b80 1 Processor -- start 2023-08-10T10:50:45.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588b4f0 0x5637e5897840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588be50 0x5637e5897d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff4104d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 0x5637e589ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e589b2e0 con 0x5637e588be50 2023-08-10T10:50:45.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e589b450 con 0x5637e588b4f0 2023-08-10T10:50:45.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff4104d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e589b610 con 0x5637e588c910 2023-08-10T10:50:45.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff4104d6b80 10 client.0 _ll_register_callbacks cb 0x5637e5779630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:45.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff3f5d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588be50 0x5637e5897d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff3f5d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588be50 0x5637e5897d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60660/0 (socket says 172.21.15.107:60660) 2023-08-10T10:50:45.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff3f5d9b700 1 -- 172.21.15.107:0/1353022771 learned_addr learned my addr 172.21.15.107:0/1353022771 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 0x5637e589ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.548+0000 7ff3f659c700 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588b4f0 0x5637e5897840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3f5d9b700 1 -- 172.21.15.107:0/1353022771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 msgr2=0x5637e589ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 0x5637e589ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3f5d9b700 1 -- 172.21.15.107:0/1353022771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588b4f0 msgr2=0x5637e5897840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588b4f0 0x5637e5897840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3f5d9b700 1 -- 172.21.15.107:0/1353022771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f81a0bf0 con 0x5637e588be50 2023-08-10T10:50:45.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3f6d9d700 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 0x5637e589ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:45.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3f659c700 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588b4f0 0x5637e5897840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:45.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3f5d9b700 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588be50 0x5637e5897d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0099c0 tx=0x7ff3ec009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8446aa4b6593ede7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:45.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3ddffb700 1 -- 172.21.15.107:0/1353022771 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec02b040 con 0x5637e588be50 2023-08-10T10:50:45.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff4104d6b80 1 -- 172.21.15.107:0/1353022771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3e800eca0 con 0x5637e588be50 2023-08-10T10:50:45.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3ddffb700 1 -- 172.21.15.107:0/1353022771 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7ff3ec00f770 con 0x5637e588be50 2023-08-10T10:50:45.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff3ddffb700 1 -- 172.21.15.107:0/1353022771 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3ec00f930 con 0x5637e588be50 2023-08-10T10:50:45.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff4104d6b80 10 client.15513 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:45.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.549+0000 7ff4104d6b80 1 -- 172.21.15.107:0/1353022771 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5637e5630200 con 0x5637e588be50 2023-08-10T10:50:45.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.550+0000 7ff3ddffb700 1 -- 172.21.15.107:0/1353022771 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3e800eca0 con 0x5637e588be50 2023-08-10T10:50:45.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.550+0000 7ff3ddffb700 1 -- 172.21.15.107:0/1353022771 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff3ec026b30 con 0x5637e588be50 2023-08-10T10:50:45.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.550+0000 7ff4104d6b80 10 client.15513 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:45.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.550+0000 7ff4104d6b80 10 client.15513 resolve_mds: resolved name 'f' to daemon mds.f 2023-08-10T10:50:45.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.550+0000 7ff4104d6b80 20 client.15513 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:45.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.550+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5637e58f9650 0x5637e58f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.550+0000 7ff4104d6b80 4 client.15513 mds_command: new command op to 24532 tid=0[{"prefix": "status"}] 2023-08-10T10:50:45.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.550+0000 7ff4104d6b80 1 -- 172.21.15.107:0/1353022771 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5637e57d5730 con 0x5637e58f9650 2023-08-10T10:50:45.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.550+0000 7ff3f659c700 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5637e58f9650 0x5637e58f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff3ddffb700 10 client.15513 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:50:45.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff3f659c700 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5637e58f9650 0x5637e58f5fa0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97f3213c564bf865 server_cookie=f5ba154ac0b356df in_seq=0 out_seq=0 2023-08-10T10:50:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff3ddffb700 1 -- 172.21.15.107:0/1353022771 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5637e57d5730 con 0x5637e58f9650 2023-08-10T10:50:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff3ddffb700 10 client.15513 handle_command_reply: tid=0 2023-08-10T10:50:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff4104d6b80 1 client.15513 shutdown 2023-08-10T10:50:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff4104d6b80 1 -- 172.21.15.107:0/1353022771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588be50 msgr2=0x5637e5897d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588be50 0x5637e5897d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0099c0 tx=0x7ff3ec009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff4104d6b80 1 -- 172.21.15.107:0/1353022771 shutdown_connections 2023-08-10T10:50:45.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5637e58f9650 0x5637e58f5fa0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637e588b4f0 0x5637e5897840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637e588c910 0x5637e589ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff3ddffb700 0 client.15513 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:50:45.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff4104d6b80 1 --2- 172.21.15.107:0/1353022771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637e588be50 0x5637e5897d80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.551+0000 7ff4104d6b80 1 -- 172.21.15.107:0/1353022771 >> 172.21.15.107:0/1353022771 conn(0x5637e57e8c80 msgr2=0x5637e589f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff4104d6b80 1 -- 172.21.15.107:0/1353022771 shutdown_connections 2023-08-10T10:50:45.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff4104d6b80 1 -- 172.21.15.107:0/1353022771 wait complete. 2023-08-10T10:50:45.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff4104d6b80 20 client.15513 trim_cache size 0 max 16384 2023-08-10T10:50:45.562 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 2, 2023-08-10T10:50:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24532, 2023-08-10T10:50:45.562 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 91.944685035999996, 2023-08-10T10:50:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:45.563 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 147.895183938 2023-08-10T10:50:45.564 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:45.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 -- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff3e00a1150 msgr2=0x7ff3e00a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff3e00a1150 0x7ff3e00a3610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00b580 tx=0x7ff3ec005fb0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 -- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f81022f0 msgr2=0x7ff3f80730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f81022f0 0x7ff3f80730a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000ef30 tx=0x7ff3f000c450 comp rx=0 tx=0).stop 2023-08-10T10:50:45.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 -- 172.21.15.107:0/2464401803 shutdown_connections 2023-08-10T10:50:45.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff3e00a1150 0x7ff3e00a3610 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3f81022f0 0x7ff3f80730a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3f8100760 0x7ff3f8074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 --2- 172.21.15.107:0/2464401803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3f8101950 0x7ff3f8072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.552+0000 7ff3fcbff700 1 -- 172.21.15.107:0/2464401803 >> 172.21.15.107:0/2464401803 conn(0x7ff3f80fbcb0 msgr2=0x7ff3f8104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.553+0000 7ff3fcbff700 1 -- 172.21.15.107:0/2464401803 shutdown_connections 2023-08-10T10:50:45.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.553+0000 7ff3fcbff700 1 -- 172.21.15.107:0/2464401803 wait complete. 2023-08-10T10:50:45.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-08-10T10:50:45.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.770+0000 7f4f961ff700 1 -- 172.21.15.107:0/3905323697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 msgr2=0x7f4f9010f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.770+0000 7f4f961ff700 1 --2- 172.21.15.107:0/3905323697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 0x7f4f9010f140 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b0a0 tx=0x7f4f8800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.770+0000 7f4f961ff700 1 -- 172.21.15.107:0/3905323697 shutdown_connections 2023-08-10T10:50:45.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.770+0000 7f4f961ff700 1 --2- 172.21.15.107:0/3905323697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 0x7f4f9010f140 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.770+0000 7f4f961ff700 1 --2- 172.21.15.107:0/3905323697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f900747b0 0x7f4f90072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.770+0000 7f4f961ff700 1 --2- 172.21.15.107:0/3905323697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f900731d0 0x7f4f90073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.770+0000 7f4f961ff700 1 -- 172.21.15.107:0/3905323697 >> 172.21.15.107:0/3905323697 conn(0x7f4f900fbcf0 msgr2=0x7f4f900fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.770+0000 7f4f961ff700 1 -- 172.21.15.107:0/3905323697 shutdown_connections 2023-08-10T10:50:45.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.770+0000 7f4f961ff700 1 -- 172.21.15.107:0/3905323697 wait complete. 2023-08-10T10:50:45.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.771+0000 7f4f961ff700 1 Processor -- start 2023-08-10T10:50:45.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.771+0000 7f4f961ff700 1 -- start start 2023-08-10T10:50:45.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f961ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f900731d0 0x7f4f9019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f961ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f900747b0 0x7f4f9019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f961ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 0x7f4f901a3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f961ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f901a45c0 con 0x7f4f9010cd50 2023-08-10T10:50:45.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f961ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f901a4700 con 0x7f4f900747b0 2023-08-10T10:50:45.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f961ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f901a4890 con 0x7f4f900731d0 2023-08-10T10:50:45.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 0x7f4f901a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f900731d0 0x7f4f9019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 0x7f4f901a3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60676/0 (socket says 172.21.15.107:60676) 2023-08-10T10:50:45.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8ffff700 1 -- 172.21.15.107:0/2176482167 learned_addr learned my addr 172.21.15.107:0/2176482167 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8effd700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f900747b0 0x7f4f9019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8ffff700 1 -- 172.21.15.107:0/2176482167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f900731d0 msgr2=0x7f4f9019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f900731d0 0x7f4f9019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8ffff700 1 -- 172.21.15.107:0/2176482167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f900747b0 msgr2=0x7f4f9019cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f900747b0 0x7f4f9019cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.772+0000 7f4f8ffff700 1 -- 172.21.15.107:0/2176482167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88009d00 con 0x7f4f9010cd50 2023-08-10T10:50:45.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.773+0000 7f4f8effd700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f900747b0 0x7f4f9019cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:45.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.773+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 0x7f4f901a3ff0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800d010 tx=0x7f4f8800bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.773+0000 7f4f8cff9700 1 -- 172.21.15.107:0/2176482167 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800e040 con 0x7f4f9010cd50 2023-08-10T10:50:45.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.773+0000 7f4f961ff700 1 -- 172.21.15.107:0/2176482167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f901a4b10 con 0x7f4f9010cd50 2023-08-10T10:50:45.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.773+0000 7f4f8cff9700 1 -- 172.21.15.107:0/2176482167 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f88009480 con 0x7f4f9010cd50 2023-08-10T10:50:45.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.773+0000 7f4f8cff9700 1 -- 172.21.15.107:0/2176482167 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880052a0 con 0x7f4f9010cd50 2023-08-10T10:50:45.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.773+0000 7f4f961ff700 1 -- 172.21.15.107:0/2176482167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f901a4f40 con 0x7f4f9010cd50 2023-08-10T10:50:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.776+0000 7f4f8cff9700 1 -- 172.21.15.107:0/2176482167 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4f88005400 con 0x7f4f9010cd50 2023-08-10T10:50:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.777+0000 7f4f8cff9700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4f780a1150 0x7f4f780a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.777+0000 7f4fa9bd5b80 1 Processor -- start 2023-08-10T10:50:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4f8cff9700 1 -- 172.21.15.107:0/2176482167 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4f880cdde0 con 0x7f4f9010cd50 2023-08-10T10:50:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4fa9bd5b80 1 -- start start 2023-08-10T10:50:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4f8effd700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4f780a1150 0x7f4f780a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739bc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bce50 0x55f5739bd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bd910 0x55f5739bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f573937d70 con 0x55f5739bc4f0 2023-08-10T10:50:45.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f573914540 con 0x55f5739bd910 2023-08-10T10:50:45.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f573911e60 con 0x55f5739bce50 2023-08-10T10:50:45.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4f8effd700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4f780a1150 0x7f4f780a3610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4f900744d0 tx=0x7f4f84009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.778+0000 7f4f8f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739bc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60682/0 (socket says 172.21.15.107:60682) 2023-08-10T10:50:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8f7fe700 1 -- 172.21.15.107:0/390640245 learned_addr learned my addr 172.21.15.107:0/390640245 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/390640245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bd910 0x55f5739bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8effd700 1 --2- 172.21.15.107:0/390640245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bce50 0x55f5739bd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8f7fe700 1 -- 172.21.15.107:0/390640245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bce50 msgr2=0x55f5739bd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/390640245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bce50 0x55f5739bd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8f7fe700 1 -- 172.21.15.107:0/390640245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bd910 msgr2=0x55f5739bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/390640245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bd910 0x55f5739bdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8f7fe700 1 -- 172.21.15.107:0/390640245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f57378e5e0 con 0x55f5739bc4f0 2023-08-10T10:50:45.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/390640245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739bc910 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009d80 tx=0x7f4f80011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d89ea2b5cdb7ba server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.779+0000 7f4f75ffb700 1 -- 172.21.15.107:0/390640245 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80004230 con 0x55f5739bc4f0 2023-08-10T10:50:45.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4f75ffb700 1 -- 172.21.15.107:0/390640245 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f80004390 con 0x55f5739bc4f0 2023-08-10T10:50:45.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4f75ffb700 1 -- 172.21.15.107:0/390640245 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800197e0 con 0x55f5739bc4f0 2023-08-10T10:50:45.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/390640245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 msgr2=0x55f5739bc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/390640245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739bc910 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009d80 tx=0x7f4f80011720 comp rx=0 tx=0).stop 2023-08-10T10:50:45.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/390640245 shutdown_connections 2023-08-10T10:50:45.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/390640245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bd910 0x55f5739bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/390640245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739bc910 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/390640245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bce50 0x55f5739bd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/390640245 >> 172.21.15.107:0/390640245 conn(0x55f573919c80 msgr2=0x55f5739b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/390640245 shutdown_connections 2023-08-10T10:50:45.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.780+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/390640245 wait complete. 2023-08-10T10:50:45.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.781+0000 7f4fa9bd5b80 1 -- start start 2023-08-10T10:50:45.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.781+0000 7f4fa9bd5b80 1 Processor -- start 2023-08-10T10:50:45.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.781+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.781+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739c6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.781+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bd910 0x55f5739cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57390d750 con 0x55f5739bc4f0 2023-08-10T10:50:45.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5738aca70 con 0x55f5739bce50 2023-08-10T10:50:45.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5738ac770 con 0x55f5739bd910 2023-08-10T10:50:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4fa9bd5b80 10 client.0 _ll_register_callbacks cb 0x55f5738aa630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60696/0 (socket says 172.21.15.107:60696) 2023-08-10T10:50:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8f7fe700 1 -- 172.21.15.107:0/3022680102 learned_addr learned my addr 172.21.15.107:0/3022680102 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8effd700 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bd910 0x55f5739cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8f7fe700 1 -- 172.21.15.107:0/3022680102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bd910 msgr2=0x55f5739cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bd910 0x55f5739cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8f7fe700 1 -- 172.21.15.107:0/3022680102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 msgr2=0x55f5739c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8f7fe700 1 -- 172.21.15.107:0/3022680102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f800099e0 con 0x55f5739bc4f0 2023-08-10T10:50:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739c5f30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4f800038b0 tx=0x7f4f80003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ac7c9a5ba2e459 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.782+0000 7f4f6effd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4f6effd700 1 -- 172.21.15.107:0/3022680102 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80005450 con 0x55f5739bc4f0 2023-08-10T10:50:45.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/3022680102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5739af420 con 0x55f5739bc4f0 2023-08-10T10:50:45.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4f6effd700 1 -- 172.21.15.107:0/3022680102 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4f80004500 con 0x55f5739bc4f0 2023-08-10T10:50:45.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4f6effd700 1 -- 172.21.15.107:0/3022680102 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f80005ce0 con 0x55f5739bc4f0 2023-08-10T10:50:45.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4fa9bd5b80 10 client.15525 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:45.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/3022680102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f57373ad90 con 0x55f5739bc4f0 2023-08-10T10:50:45.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4f6effd700 1 -- 172.21.15.107:0/3022680102 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f5739af420 con 0x55f5739bc4f0 2023-08-10T10:50:45.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4f6effd700 1 -- 172.21.15.107:0/3022680102 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4f80021040 con 0x55f5739bc4f0 2023-08-10T10:50:45.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4fa9bd5b80 10 client.15525 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:45.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4fa9bd5b80 10 client.15525 resolve_mds: resolved name 'i' to daemon mds.i 2023-08-10T10:50:45.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4fa9bd5b80 20 client.15525 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:45.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55f5739d1100 0x55f5739d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4fa9bd5b80 4 client.15525 mds_command: new command op to 24571 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:45.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.783+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/3022680102 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f57398b980 con 0x55f5739d1100 2023-08-10T10:50:45.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.784+0000 7f4f8effd700 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55f5739d1100 0x55f5739d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.785+0000 7f4f6effd700 10 client.15525 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:50:45.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.785+0000 7f4f8effd700 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55f5739d1100 0x55f5739d0560 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=acbd438fc84ab45b server_cookie=1e37ec38da0bd420 in_seq=0 out_seq=0 2023-08-10T10:50:45.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.785+0000 7f4f6effd700 1 -- 172.21.15.107:0/3022680102 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f57398b980 con 0x55f5739d1100 2023-08-10T10:50:45.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.785+0000 7f4f6effd700 10 client.15525 handle_command_reply: tid=0 2023-08-10T10:50:45.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 client.15525 shutdown 2023-08-10T10:50:45.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/3022680102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 msgr2=0x55f5739c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739c5f30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4f800038b0 tx=0x7f4f80003990 comp rx=0 tx=0).stop 2023-08-10T10:50:45.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/3022680102 shutdown_connections 2023-08-10T10:50:45.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55f5739d1100 0x55f5739d0560 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bd910 0x55f5739cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bc4f0 0x55f5739c5f30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/3022680102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4f6effd700 0 client.15525 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:50:45.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/3022680102 >> 172.21.15.107:0/3022680102 conn(0x55f573919c80 msgr2=0x55f5739b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/3022680102 shutdown_connections 2023-08-10T10:50:45.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/3022680102 wait complete. 2023-08-10T10:50:45.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.786+0000 7f4fa9bd5b80 20 client.15525 trim_cache size 0 max 16384 2023-08-10T10:50:45.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.804+0000 7f4fa9bd5b80 1 Processor -- start 2023-08-10T10:50:45.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.804+0000 7f4fa9bd5b80 1 -- start start 2023-08-10T10:50:45.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 0x55f5739d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739c0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5737908d0 con 0x55f5739bd910 2023-08-10T10:50:45.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5739c6e30 con 0x55f5739bce50 2023-08-10T10:50:45.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57398b980 con 0x55f5739bc4f0 2023-08-10T10:50:45.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739c0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60706/0 (socket says 172.21.15.107:60706) 2023-08-10T10:50:45.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4f8ffff700 1 -- 172.21.15.107:0/2356669890 learned_addr learned my addr 172.21.15.107:0/2356669890 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4f8effd700 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.805+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 0x55f5739d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f8ffff700 1 -- 172.21.15.107:0/2356669890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 msgr2=0x55f5739d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 0x55f5739d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f8ffff700 1 -- 172.21.15.107:0/2356669890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 msgr2=0x55f5739cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f8ffff700 1 -- 172.21.15.107:0/2356669890 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f573723c10 con 0x55f5739bd910 2023-08-10T10:50:45.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f8effd700 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:50:45.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739c0780 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009cd0 tx=0x7f4f88003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20470d03b03331eb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f767fc700 1 -- 172.21.15.107:0/2356669890 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8809c160 con 0x55f5739bd910 2023-08-10T10:50:45.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f767fc700 1 -- 172.21.15.107:0/2356669890 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f8809af00 con 0x55f5739bd910 2023-08-10T10:50:45.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.806+0000 7f4f767fc700 1 -- 172.21.15.107:0/2356669890 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880a32c0 con 0x55f5739bd910 2023-08-10T10:50:45.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/2356669890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 msgr2=0x55f5739c0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739c0780 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009cd0 tx=0x7f4f88003e10 comp rx=0 tx=0).stop 2023-08-10T10:50:45.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/2356669890 shutdown_connections 2023-08-10T10:50:45.814 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739c0780 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 0x55f5739d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/2356669890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/2356669890 >> 172.21.15.107:0/2356669890 conn(0x55f573919c80 msgr2=0x55f5739c3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/2356669890 shutdown_connections 2023-08-10T10:50:45.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/2356669890 wait complete. 2023-08-10T10:50:45.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 -- start start 2023-08-10T10:50:45.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.807+0000 7f4fa9bd5b80 1 Processor -- start 2023-08-10T10:50:45.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 0x55f5739c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4fa9bd5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5739cc0b0 con 0x55f5739bd910 2023-08-10T10:50:45.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5739cc220 con 0x55f5739bce50 2023-08-10T10:50:45.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4fa9bd5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5739cc3e0 con 0x55f5739bc4f0 2023-08-10T10:50:45.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4fa9bd5b80 10 client.0 _ll_register_callbacks cb 0x55f5738aa630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:45.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60718/0 (socket says 172.21.15.107:60718) 2023-08-10T10:50:45.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4f8ffff700 1 -- 172.21.15.107:0/15357909 learned_addr learned my addr 172.21.15.107:0/15357909 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:45.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4f8effd700 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.808+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 0x55f5739c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f8ffff700 1 -- 172.21.15.107:0/15357909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 msgr2=0x55f5739c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 0x55f5739c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f8ffff700 1 -- 172.21.15.107:0/15357909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 msgr2=0x55f5739c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:45.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f8ffff700 1 -- 172.21.15.107:0/15357909 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f840109f0 con 0x55f5739bd910 2023-08-10T10:50:45.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f8ffff700 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739cbb70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4f880973b0 tx=0x7f4f8809a990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc445d6567c5502 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:45.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f6effd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:45.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f6effd700 1 -- 172.21.15.107:0/15357909 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8809a5f0 con 0x55f5739bd910 2023-08-10T10:50:45.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/15357909 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f80004390 con 0x55f5739bd910 2023-08-10T10:50:45.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f6effd700 1 -- 172.21.15.107:0/15357909 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4f880a0040 con 0x55f5739bd910 2023-08-10T10:50:45.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4f6effd700 1 -- 172.21.15.107:0/15357909 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f880b9270 con 0x55f5739bd910 2023-08-10T10:50:45.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4fa9bd5b80 10 client.15531 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:45.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.809+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/15357909 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f4f901a4f40 con 0x55f5739bd910 2023-08-10T10:50:45.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.810+0000 7f4f6effd700 1 -- 172.21.15.107:0/15357909 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f80004390 con 0x55f5739bd910 2023-08-10T10:50:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.810+0000 7f4f6effd700 1 -- 172.21.15.107:0/15357909 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4f88095c30 con 0x55f5739bd910 2023-08-10T10:50:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.810+0000 7f4fa9bd5b80 10 client.15531 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.810+0000 7f4fa9bd5b80 10 client.15531 resolve_mds: resolved name 'i' to daemon mds.i 2023-08-10T10:50:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.810+0000 7f4fa9bd5b80 20 client.15531 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.810+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55f573a2a000 0x55f573a26d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.810+0000 7f4fa9bd5b80 4 client.15531 mds_command: new command op to 24571 tid=0[{"prefix": "status"}] 2023-08-10T10:50:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.810+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/15357909 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f573906730 con 0x55f573a2a000 2023-08-10T10:50:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.810+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55f573a2a000 0x55f573a26d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4f8f7fe700 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55f573a2a000 0x55f573a26d90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f1246e7cd915b09f server_cookie=f40daca38b4f5e3c in_seq=0 out_seq=0 2023-08-10T10:50:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4f6effd700 10 client.15531 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:50:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4f6effd700 1 -- 172.21.15.107:0/15357909 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x55f573906730 con 0x55f573a2a000 2023-08-10T10:50:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4f6effd700 10 client.15531 handle_command_reply: tid=0 2023-08-10T10:50:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4fa9bd5b80 1 client.15531 shutdown 2023-08-10T10:50:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/15357909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 msgr2=0x55f5739cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739cbb70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4f880973b0 tx=0x7f4f8809a990 comp rx=0 tx=0).stop 2023-08-10T10:50:45.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/15357909 shutdown_connections 2023-08-10T10:50:45.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55f573a2a000 0x55f573a26d90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f5739bd910 0x55f5739cbb70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f5739bc4f0 0x55f5739c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4f6effd700 0 client.15531 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:50:45.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4fa9bd5b80 1 --2- 172.21.15.107:0/15357909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f5739bce50 0x55f5739c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.811+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/15357909 >> 172.21.15.107:0/15357909 conn(0x55f573919c80 msgr2=0x55f5739d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/15357909 shutdown_connections 2023-08-10T10:50:45.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4fa9bd5b80 1 -- 172.21.15.107:0/15357909 wait complete. 2023-08-10T10:50:45.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4fa9bd5b80 20 client.15531 trim_cache size 0 max 16384 2023-08-10T10:50:45.823 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:45.824 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:45.824 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 1, 2023-08-10T10:50:45.824 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24571, 2023-08-10T10:50:45.824 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:45.824 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:45.824 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:45.824 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 93.094382861, 2023-08-10T10:50:45.825 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:45.825 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:45.825 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:45.825 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 138.463466259 2023-08-10T10:50:45.825 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:45.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 -- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4f780a1150 msgr2=0x7f4f780a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4f780a1150 0x7f4f780a3610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4f900744d0 tx=0x7f4f84009260 comp rx=0 tx=0).stop 2023-08-10T10:50:45.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 -- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 msgr2=0x7f4f901a3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:45.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 0x7f4f901a3ff0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800d010 tx=0x7f4f8800bcc0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 -- 172.21.15.107:0/2176482167 shutdown_connections 2023-08-10T10:50:45.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f4f780a1150 0x7f4f780a3610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9010cd50 0x7f4f901a3ff0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f900731d0 0x7f4f9019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 --2- 172.21.15.107:0/2176482167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f900747b0 0x7f4f9019cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:45.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.812+0000 7f4f961ff700 1 -- 172.21.15.107:0/2176482167 >> 172.21.15.107:0/2176482167 conn(0x7f4f900fbcf0 msgr2=0x7f4f900fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:45.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.813+0000 7f4f961ff700 1 -- 172.21.15.107:0/2176482167 shutdown_connections 2023-08-10T10:50:45.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:45.813+0000 7f4f961ff700 1 -- 172.21.15.107:0/2176482167 wait complete. 2023-08-10T10:50:45.831 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-10T10:50:46.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.030+0000 7f46619ff700 1 -- 172.21.15.107:0/2879085729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c1085f0 msgr2=0x7f465c10aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:46.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.030+0000 7f46619ff700 1 --2- 172.21.15.107:0/2879085729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c1085f0 0x7f465c10aa60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f465400b0a0 tx=0x7f465400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.030+0000 7f46619ff700 1 -- 172.21.15.107:0/2879085729 shutdown_connections 2023-08-10T10:50:46.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.030+0000 7f46619ff700 1 --2- 172.21.15.107:0/2879085729 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f465c074750 0x7f465c072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.030+0000 7f46619ff700 1 --2- 172.21.15.107:0/2879085729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c1085f0 0x7f465c10aa60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.030+0000 7f46619ff700 1 --2- 172.21.15.107:0/2879085729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f465c073170 0x7f465c0735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.030+0000 7f46619ff700 1 -- 172.21.15.107:0/2879085729 >> 172.21.15.107:0/2879085729 conn(0x7f465c0fbc90 msgr2=0x7f465c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:46.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.030+0000 7f46619ff700 1 -- 172.21.15.107:0/2879085729 shutdown_connections 2023-08-10T10:50:46.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.030+0000 7f46619ff700 1 -- 172.21.15.107:0/2879085729 wait complete. 2023-08-10T10:50:46.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.031+0000 7f46619ff700 1 Processor -- start 2023-08-10T10:50:46.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.031+0000 7f46619ff700 1 -- start start 2023-08-10T10:50:46.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.031+0000 7f46619ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f465c073170 0x7f465c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.031+0000 7f46619ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c074750 0x7f465c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.031+0000 7f46619ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f465c1085f0 0x7f465c19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.031+0000 7f46619ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c1a0130 con 0x7f465c074750 2023-08-10T10:50:46.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.031+0000 7f46619ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c1a0270 con 0x7f465c073170 2023-08-10T10:50:46.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.031+0000 7f46619ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c1a0400 con 0x7f465c1085f0 2023-08-10T10:50:46.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f4653fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c074750 0x7f465c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f4653fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c074750 0x7f465c198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60724/0 (socket says 172.21.15.107:60724) 2023-08-10T10:50:46.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f4653fff700 1 -- 172.21.15.107:0/3481825097 learned_addr learned my addr 172.21.15.107:0/3481825097 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:46.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f465affd700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f465c073170 0x7f465c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f465b7fe700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f465c1085f0 0x7f465c19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f4653fff700 1 -- 172.21.15.107:0/3481825097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f465c1085f0 msgr2=0x7f465c19fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:46.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f4653fff700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f465c1085f0 0x7f465c19fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f4653fff700 1 -- 172.21.15.107:0/3481825097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f465c073170 msgr2=0x7f465c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:46.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f4653fff700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f465c073170 0x7f465c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f4653fff700 1 -- 172.21.15.107:0/3481825097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4654009d00 con 0x7f465c074750 2023-08-10T10:50:46.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f465affd700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f465c073170 0x7f465c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:46.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f465b7fe700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f465c1085f0 0x7f465c19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:46.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f4653fff700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c074750 0x7f465c198af0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f464400e9a0 tx=0x7f464400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:46.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.032+0000 7f46609fd700 1 -- 172.21.15.107:0/3481825097 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644009790 con 0x7f465c074750 2023-08-10T10:50:46.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.033+0000 7f46619ff700 1 -- 172.21.15.107:0/3481825097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c1a06e0 con 0x7f465c074750 2023-08-10T10:50:46.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.033+0000 7f46609fd700 1 -- 172.21.15.107:0/3481825097 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f464400cbd0 con 0x7f465c074750 2023-08-10T10:50:46.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.033+0000 7f46609fd700 1 -- 172.21.15.107:0/3481825097 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644018680 con 0x7f465c074750 2023-08-10T10:50:46.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.033+0000 7f46619ff700 1 -- 172.21.15.107:0/3481825097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c1a0c40 con 0x7f465c074750 2023-08-10T10:50:46.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.036+0000 7f46609fd700 1 -- 172.21.15.107:0/3481825097 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f464400cd40 con 0x7f465c074750 2023-08-10T10:50:46.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.037+0000 7f4675378b80 1 Processor -- start 2023-08-10T10:50:46.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.037+0000 7f4675378b80 1 -- start start 2023-08-10T10:50:46.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.037+0000 7f46609fd700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f46480a1150 0x7f46480a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.037+0000 7f4675378b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee62910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.037+0000 7f4675378b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee63380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.037+0000 7f4675378b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee63da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.037+0000 7f4675378b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbedddd70 con 0x55bdbee63910 2023-08-10T10:50:46.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.037+0000 7f4675378b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbedba540 con 0x55bdbee624f0 2023-08-10T10:50:46.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.037+0000 7f4675378b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbedb7e60 con 0x55bdbee62e50 2023-08-10T10:50:46.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f46609fd700 1 -- 172.21.15.107:0/3481825097 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4644014070 con 0x7f465c074750 2023-08-10T10:50:46.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f4653fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee63380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f465b7fe700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f46480a1150 0x7f46480a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f4653fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee63380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:56814/0 (socket says 172.21.15.107:56814) 2023-08-10T10:50:46.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f4653fff700 1 -- 172.21.15.107:0/2428088537 learned_addr learned my addr 172.21.15.107:0/2428088537 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:46.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f465affd700 1 --2- 172.21.15.107:0/2428088537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee62910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f465b7fe700 1 --2- 172.21.15.107:0/2428088537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee63da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f4653fff700 1 -- 172.21.15.107:0/2428088537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 msgr2=0x55bdbee62910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:46.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f4653fff700 1 --2- 172.21.15.107:0/2428088537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee62910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f4653fff700 1 -- 172.21.15.107:0/2428088537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 msgr2=0x55bdbee63da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:46.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f4653fff700 1 --2- 172.21.15.107:0/2428088537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee63da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.038+0000 7f4653fff700 1 -- 172.21.15.107:0/2428088537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdbec345e0 con 0x55bdbee62e50 2023-08-10T10:50:46.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.039+0000 7f4653fff700 1 --2- 172.21.15.107:0/2428088537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee63380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4644099ff0 tx=0x7f4644099a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed05584e3fbf35ce server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:46.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.039+0000 7f465b7fe700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f46480a1150 0x7f46480a3610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4654009850 tx=0x7f4654009780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:46.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.039+0000 7f4651ffb700 1 -- 172.21.15.107:0/2428088537 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464409e090 con 0x55bdbee62e50 2023-08-10T10:50:46.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.039+0000 7f4651ffb700 1 -- 172.21.15.107:0/2428088537 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46440a24b0 con 0x55bdbee62e50 2023-08-10T10:50:46.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.039+0000 7f4651ffb700 1 -- 172.21.15.107:0/2428088537 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644089c30 con 0x55bdbee62e50 2023-08-10T10:50:46.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.039+0000 7f4675378b80 1 -- 172.21.15.107:0/2428088537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 msgr2=0x55bdbee63380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:46.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.039+0000 7f4675378b80 1 --2- 172.21.15.107:0/2428088537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee63380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4644099ff0 tx=0x7f4644099a40 comp rx=0 tx=0).stop 2023-08-10T10:50:46.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.040+0000 7f4675378b80 1 -- 172.21.15.107:0/2428088537 shutdown_connections 2023-08-10T10:50:46.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.040+0000 7f4675378b80 1 --2- 172.21.15.107:0/2428088537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee62910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.040+0000 7f4675378b80 1 --2- 172.21.15.107:0/2428088537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee63da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.040+0000 7f4675378b80 1 --2- 172.21.15.107:0/2428088537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee63380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.040+0000 7f4675378b80 1 -- 172.21.15.107:0/2428088537 >> 172.21.15.107:0/2428088537 conn(0x55bdbedbfc80 msgr2=0x55bdbee5d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:46.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.040+0000 7f4675378b80 1 -- 172.21.15.107:0/2428088537 shutdown_connections 2023-08-10T10:50:46.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.040+0000 7f4675378b80 1 -- 172.21.15.107:0/2428088537 wait complete. 2023-08-10T10:50:46.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.040+0000 7f4675378b80 1 -- start start 2023-08-10T10:50:46.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.041+0000 7f4675378b80 1 Processor -- start 2023-08-10T10:50:46.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.041+0000 7f4675378b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee6bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.041+0000 7f4675378b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee6c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.041+0000 7f4675378b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee73570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.041+0000 7f4675378b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbedb3750 con 0x55bdbee63910 2023-08-10T10:50:46.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.041+0000 7f4675378b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbed52a70 con 0x55bdbee624f0 2023-08-10T10:50:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.041+0000 7f4675378b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbed52770 con 0x55bdbee62e50 2023-08-10T10:50:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.041+0000 7f4675378b80 10 client.0 _ll_register_callbacks cb 0x55bdbed50630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee73570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee6bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee6bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:52390/0 (socket says 172.21.15.107:52390) 2023-08-10T10:50:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465affd700 1 -- 172.21.15.107:0/2257297143 learned_addr learned my addr 172.21.15.107:0/2257297143 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:46.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee73570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60740/0 (socket says 172.21.15.107:60740) 2023-08-10T10:50:46.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f4653fff700 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee6c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465b7fe700 1 -- 172.21.15.107:0/2257297143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 msgr2=0x55bdbee6c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:46.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465b7fe700 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee6c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465b7fe700 1 -- 172.21.15.107:0/2257297143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 msgr2=0x55bdbee6bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:46.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465b7fe700 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee6bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465b7fe700 1 -- 172.21.15.107:0/2257297143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c1a0c40 con 0x55bdbee63910 2023-08-10T10:50:46.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465affd700 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee6bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:50:46.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f465b7fe700 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee73570 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f465400b070 tx=0x7f465400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645445241fbfdc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:46.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.042+0000 7f463affd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:46.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f463affd700 1 -- 172.21.15.107:0/2257297143 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465400e030 con 0x55bdbee63910 2023-08-10T10:50:46.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f4675378b80 1 -- 172.21.15.107:0/2257297143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bdbee55420 con 0x55bdbee63910 2023-08-10T10:50:46.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f463affd700 1 -- 172.21.15.107:0/2257297143 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f4654029680 con 0x55bdbee63910 2023-08-10T10:50:46.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f463affd700 1 -- 172.21.15.107:0/2257297143 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4654029840 con 0x55bdbee63910 2023-08-10T10:50:46.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f4675378b80 10 client.15543 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:46.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f4675378b80 1 -- 172.21.15.107:0/2257297143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bdbebe0d90 con 0x55bdbee63910 2023-08-10T10:50:46.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f463affd700 1 -- 172.21.15.107:0/2257297143 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bdbee55420 con 0x55bdbee63910 2023-08-10T10:50:46.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f463affd700 1 -- 172.21.15.107:0/2257297143 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f465401c9f0 con 0x55bdbee63910 2023-08-10T10:50:46.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f4675378b80 10 client.15543 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:46.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f4675378b80 10 client.15543 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:50:46.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f4675378b80 20 client.15543 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:46.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f4675378b80 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55bdbee772e0 0x55bdbee766c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f4675378b80 4 client.15543 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:50:46.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.043+0000 7f4675378b80 1 -- 172.21.15.107:0/2257297143 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bdbee31980 con 0x55bdbee772e0 2023-08-10T10:50:46.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.044+0000 7f465affd700 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55bdbee772e0 0x55bdbee766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.045+0000 7f465affd700 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55bdbee772e0 0x55bdbee766c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab6340fd54f8944 server_cookie=913b83c96fa69543 in_seq=0 out_seq=0 2023-08-10T10:50:46.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.045+0000 7f463affd700 10 client.15543 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:50:46.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.045+0000 7f463affd700 1 -- 172.21.15.107:0/2257297143 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55bdbee31980 con 0x55bdbee772e0 2023-08-10T10:50:46.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.045+0000 7f463affd700 10 client.15543 handle_command_reply: tid=0 2023-08-10T10:50:46.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.045+0000 7f4675378b80 1 client.15543 shutdown 2023-08-10T10:50:46.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.045+0000 7f4675378b80 1 -- 172.21.15.107:0/2257297143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 msgr2=0x55bdbee73570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:46.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.045+0000 7f4675378b80 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee73570 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f465400b070 tx=0x7f465400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f4675378b80 1 -- 172.21.15.107:0/2257297143 shutdown_connections 2023-08-10T10:50:46.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f4675378b80 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55bdbee772e0 0x55bdbee766c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f4675378b80 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee624f0 0x55bdbee6bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f463affd700 0 client.15543 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:50:46.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f4675378b80 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee63910 0x55bdbee73570 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f4675378b80 1 --2- 172.21.15.107:0/2257297143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee6c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f4675378b80 1 -- 172.21.15.107:0/2257297143 >> 172.21.15.107:0/2257297143 conn(0x55bdbedbfc80 msgr2=0x55bdbee5c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:46.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f4675378b80 1 -- 172.21.15.107:0/2257297143 shutdown_connections 2023-08-10T10:50:46.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f4675378b80 1 -- 172.21.15.107:0/2257297143 wait complete. 2023-08-10T10:50:46.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.046+0000 7f4675378b80 20 client.15543 trim_cache size 0 max 16384 2023-08-10T10:50:46.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f4675378b80 1 Processor -- start 2023-08-10T10:50:46.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f4675378b80 1 -- start start 2023-08-10T10:50:46.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f4675378b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee624f0 0x55bdbee6ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f4675378b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee73530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f4675378b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee766c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f4675378b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbec368d0 con 0x55bdbee624f0 2023-08-10T10:50:46.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f4675378b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbed81790 con 0x55bdbee63910 2023-08-10T10:50:46.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f4675378b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbed71480 con 0x55bdbee62e50 2023-08-10T10:50:46.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f465affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee624f0 0x55bdbee6ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f465affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee624f0 0x55bdbee6ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60750/0 (socket says 172.21.15.107:60750) 2023-08-10T10:50:46.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.064+0000 7f465affd700 1 -- 172.21.15.107:0/3730620916 learned_addr learned my addr 172.21.15.107:0/3730620916 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:46.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f465b7fe700 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f4653fff700 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee73530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f465affd700 1 -- 172.21.15.107:0/3730620916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 msgr2=0x55bdbee73530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:46.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f465affd700 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee73530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f465affd700 1 -- 172.21.15.107:0/3730620916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 msgr2=0x55bdbee766c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:46.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f465affd700 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee766c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f465affd700 1 -- 172.21.15.107:0/3730620916 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdbebc9c10 con 0x55bdbee624f0 2023-08-10T10:50:46.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f4653fff700 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee73530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:46.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f465b7fe700 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee766c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:46.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f465affd700 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee624f0 0x55bdbee6ac60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55bdbee6d050 tx=0x7f464c00b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6a281e47388c60 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:46.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f46527fc700 1 -- 172.21.15.107:0/3730620916 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c017040 con 0x55bdbee624f0 2023-08-10T10:50:46.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f46527fc700 1 -- 172.21.15.107:0/3730620916 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f464c01c840 con 0x55bdbee624f0 2023-08-10T10:50:46.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.065+0000 7f46527fc700 1 -- 172.21.15.107:0/3730620916 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0117a0 con 0x55bdbee624f0 2023-08-10T10:50:46.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 -- 172.21.15.107:0/3730620916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee624f0 msgr2=0x55bdbee6ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:46.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee624f0 0x55bdbee6ac60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55bdbee6d050 tx=0x7f464c00b550 comp rx=0 tx=0).stop 2023-08-10T10:50:46.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 -- 172.21.15.107:0/3730620916 shutdown_connections 2023-08-10T10:50:46.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee766c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee624f0 0x55bdbee6ac60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 --2- 172.21.15.107:0/3730620916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee62e50 0x55bdbee73530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 -- 172.21.15.107:0/3730620916 >> 172.21.15.107:0/3730620916 conn(0x55bdbedbfc80 msgr2=0x55bdbee5d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:46.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 -- 172.21.15.107:0/3730620916 shutdown_connections 2023-08-10T10:50:46.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 -- 172.21.15.107:0/3730620916 wait complete. 2023-08-10T10:50:46.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.066+0000 7f4675378b80 1 -- start start 2023-08-10T10:50:46.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4675378b80 1 Processor -- start 2023-08-10T10:50:46.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4675378b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee624f0 0x55bdbee73260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4675378b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee62e50 0x55bdbee6fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4675378b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee70240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4675378b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbee70780 con 0x55bdbee62e50 2023-08-10T10:50:46.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4675378b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbee708f0 con 0x55bdbee63910 2023-08-10T10:50:46.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4675378b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdbeecaf20 con 0x55bdbee624f0 2023-08-10T10:50:46.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4675378b80 10 client.0 _ll_register_callbacks cb 0x55bdbed50630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:50:46.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4653fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee62e50 0x55bdbee6fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4653fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee62e50 0x55bdbee6fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60756/0 (socket says 172.21.15.107:60756) 2023-08-10T10:50:46.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.067+0000 7f4653fff700 1 -- 172.21.15.107:0/427969225 learned_addr learned my addr 172.21.15.107:0/427969225 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:46.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f465b7fe700 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee70240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f4653fff700 1 -- 172.21.15.107:0/427969225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee624f0 msgr2=0x55bdbee73260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:46.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f465affd700 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee624f0 0x55bdbee73260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f4653fff700 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee624f0 0x55bdbee73260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f4653fff700 1 -- 172.21.15.107:0/427969225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 msgr2=0x55bdbee70240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:50:46.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f4653fff700 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee70240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f4653fff700 1 -- 172.21.15.107:0/427969225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c00bc80 con 0x55bdbee62e50 2023-08-10T10:50:46.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f465b7fe700 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee70240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:46.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f4653fff700 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee62e50 0x55bdbee6fd00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f464400e970 tx=0x7f464409a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1d95d2383b6a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:46.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f463affd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:50:46.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f463affd700 1 -- 172.21.15.107:0/427969225 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440ca920 con 0x55bdbee62e50 2023-08-10T10:50:46.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f4675378b80 1 -- 172.21.15.107:0/427969225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46440a24b0 con 0x55bdbee62e50 2023-08-10T10:50:46.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f463affd700 1 -- 172.21.15.107:0/427969225 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f46440a2020 con 0x55bdbee62e50 2023-08-10T10:50:46.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f463affd700 1 -- 172.21.15.107:0/427969225 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46440a21e0 con 0x55bdbee62e50 2023-08-10T10:50:46.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f4675378b80 10 client.15549 fetch_fsmap learned FSMap version 27 2023-08-10T10:50:46.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.068+0000 7f4675378b80 1 -- 172.21.15.107:0/427969225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bdbec07200 con 0x55bdbee62e50 2023-08-10T10:50:46.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.069+0000 7f463affd700 1 -- 172.21.15.107:0/427969225 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46440c8080 con 0x55bdbee62e50 2023-08-10T10:50:46.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.069+0000 7f463affd700 1 -- 172.21.15.107:0/427969225 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4644096050 con 0x55bdbee62e50 2023-08-10T10:50:46.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.069+0000 7f4675378b80 10 client.15549 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:50:46.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.069+0000 7f4675378b80 10 client.15549 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-10T10:50:46.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.069+0000 7f4675378b80 20 client.15549 populate_metadata read hostname 'smithi107' 2023-08-10T10:50:46.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.069+0000 7f4675378b80 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55bdbeecf880 0x55bdbeecc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:46.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.069+0000 7f4675378b80 4 client.15549 mds_command: new command op to 24575 tid=0[{"prefix": "status"}] 2023-08-10T10:50:46.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.069+0000 7f4675378b80 1 -- 172.21.15.107:0/427969225 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bdbedac730 con 0x55bdbeecf880 2023-08-10T10:50:46.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.069+0000 7f465affd700 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55bdbeecf880 0x55bdbeecc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:46.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f465affd700 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55bdbeecf880 0x55bdbeecc190 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff2eeca046aa5fc9 server_cookie=1d487ed30fdb4354 in_seq=0 out_seq=0 2023-08-10T10:50:46.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f463affd700 10 client.15549 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:50:46.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f463affd700 1 -- 172.21.15.107:0/427969225 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55bdbedac730 con 0x55bdbeecf880 2023-08-10T10:50:46.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f463affd700 10 client.15549 handle_command_reply: tid=0 2023-08-10T10:50:46.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f4675378b80 1 client.15549 shutdown 2023-08-10T10:50:46.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f4675378b80 1 -- 172.21.15.107:0/427969225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee62e50 msgr2=0x55bdbee6fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:46.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f4675378b80 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee62e50 0x55bdbee6fd00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f464400e970 tx=0x7f464409a1e0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f4675378b80 1 -- 172.21.15.107:0/427969225 shutdown_connections 2023-08-10T10:50:46.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f4675378b80 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55bdbeecf880 0x55bdbeecc190 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f4675378b80 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bdbee63910 0x55bdbee70240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f4675378b80 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdbee624f0 0x55bdbee73260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f463affd700 0 client.15549 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:50:46.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f4675378b80 1 --2- 172.21.15.107:0/427969225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bdbee62e50 0x55bdbee6fd00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.070+0000 7f4675378b80 1 -- 172.21.15.107:0/427969225 >> 172.21.15.107:0/427969225 conn(0x55bdbedbfc80 msgr2=0x55bdbee766c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:46.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f4675378b80 1 -- 172.21.15.107:0/427969225 shutdown_connections 2023-08-10T10:50:46.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f4675378b80 1 -- 172.21.15.107:0/427969225 wait complete. 2023-08-10T10:50:46.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f4675378b80 20 client.15549 trim_cache size 0 max 16384 2023-08-10T10:50:46.081 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:46.081 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "2b47e340-376a-11ee-9b37-001a4aab830c", 2023-08-10T10:50:46.081 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2023-08-10T10:50:46.081 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24575, 2023-08-10T10:50:46.081 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2023-08-10T10:50:46.081 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2023-08-10T10:50:46.082 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2023-08-10T10:50:46.082 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 123.17953376200001, 2023-08-10T10:50:46.082 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2023-08-10T10:50:46.082 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 93, 2023-08-10T10:50:46.082 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 91, 2023-08-10T10:50:46.082 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 129.16292746600001 2023-08-10T10:50:46.082 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:46.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 -- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f46480a1150 msgr2=0x7f46480a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:46.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f46480a1150 0x7f46480a3610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4654009850 tx=0x7f4654009780 comp rx=0 tx=0).stop 2023-08-10T10:50:46.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 -- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c074750 msgr2=0x7f465c198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:46.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c074750 0x7f465c198af0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f464400e9a0 tx=0x7f464400ed60 comp rx=0 tx=0).stop 2023-08-10T10:50:46.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 -- 172.21.15.107:0/3481825097 shutdown_connections 2023-08-10T10:50:46.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f46480a1150 0x7f46480a3610 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f465c073170 0x7f465c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f465c1085f0 0x7f465c19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 --2- 172.21.15.107:0/3481825097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f465c074750 0x7f465c198af0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:46.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 -- 172.21.15.107:0/3481825097 >> 172.21.15.107:0/3481825097 conn(0x7f465c0fbc90 msgr2=0x7f465c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:46.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.071+0000 7f46619ff700 1 -- 172.21.15.107:0/3481825097 shutdown_connections 2023-08-10T10:50:46.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:46.072+0000 7f46619ff700 1 -- 172.21.15.107:0/3481825097 wait complete. 2023-08-10T10:50:46.090 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-08-10T10:50:46.101 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-08-10T10:50:46.102 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-08-10T10:50:46.102 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-08-10T10:50:46.102 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:50:46.102 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-08-10T10:50:46.103 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-08-10T10:50:46.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:46.103 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2023-08-10T10:50:46.146 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-08-10T10:50:46.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:46.148 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-10T10:50:46.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:46.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2023-08-10T10:50:46.379 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-08-10T10:50:46.379 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph fs ls 2023-08-10T10:50:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:46 smithi107 ceph-mon[127953]: pgmap v370: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-08-10T10:50:47.106 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T10:50:47.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:46 smithi195 ceph-mon[129938]: pgmap v370: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-08-10T10:50:47.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:46 smithi157 ceph-mon[129604]: pgmap v370: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-08-10T10:50:48.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.704+0000 7fce93883700 1 -- 172.21.15.107:0/2942823146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 msgr2=0x7fce8c106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:48.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.704+0000 7fce93883700 1 --2- 172.21.15.107:0/2942823146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 0x7fce8c106b70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fce88009990 tx=0x7fce88009ca0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.704+0000 7fce93883700 1 -- 172.21.15.107:0/2942823146 shutdown_connections 2023-08-10T10:50:48.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.704+0000 7fce93883700 1 --2- 172.21.15.107:0/2942823146 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c101150 0x7fce8c10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.704+0000 7fce93883700 1 --2- 172.21.15.107:0/2942823146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 0x7fce8c106b70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.704+0000 7fce93883700 1 --2- 172.21.15.107:0/2942823146 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce8c100790 0x7fce8c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.704+0000 7fce93883700 1 -- 172.21.15.107:0/2942823146 >> 172.21.15.107:0/2942823146 conn(0x7fce8c0fc260 msgr2=0x7fce8c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:48.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.704+0000 7fce93883700 1 -- 172.21.15.107:0/2942823146 shutdown_connections 2023-08-10T10:50:48.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.704+0000 7fce93883700 1 -- 172.21.15.107:0/2942823146 wait complete. 2023-08-10T10:50:48.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.705+0000 7fce93883700 1 Processor -- start 2023-08-10T10:50:48.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.706+0000 7fce93883700 1 -- start start 2023-08-10T10:50:48.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.706+0000 7fce93883700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100790 0x7fce8c19c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:48.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.706+0000 7fce93883700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce8c101150 0x7fce8c19cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:48.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.706+0000 7fce93883700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 0x7fce8c196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:48.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.706+0000 7fce93883700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c196c70 con 0x7fce8c106790 2023-08-10T10:50:48.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.706+0000 7fce93883700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c196de0 con 0x7fce8c101150 2023-08-10T10:50:48.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.706+0000 7fce93883700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c196fa0 con 0x7fce8c100790 2023-08-10T10:50:48.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.706+0000 7fce91e20700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 0x7fce8c196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:48.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce91e20700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 0x7fce8c196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60772/0 (socket says 172.21.15.107:60772) 2023-08-10T10:50:48.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce90e1e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce8c101150 0x7fce8c19cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce91e20700 1 -- 172.21.15.107:0/181833388 learned_addr learned my addr 172.21.15.107:0/181833388 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce9161f700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100790 0x7fce8c19c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce91e20700 1 -- 172.21.15.107:0/181833388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100790 msgr2=0x7fce8c19c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce91e20700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100790 0x7fce8c19c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce91e20700 1 -- 172.21.15.107:0/181833388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce8c101150 msgr2=0x7fce8c19cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce91e20700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce8c101150 0x7fce8c19cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce91e20700 1 -- 172.21.15.107:0/181833388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce880095f0 con 0x7fce8c106790 2023-08-10T10:50:48.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce91e20700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 0x7fce8c196600 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fce84007ee0 tx=0x7fce8400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:48.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce827fc700 1 -- 172.21.15.107:0/181833388 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84017070 con 0x7fce8c106790 2023-08-10T10:50:48.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c197280 con 0x7fce8c106790 2023-08-10T10:50:48.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce827fc700 1 -- 172.21.15.107:0/181833388 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce8400f040 con 0x7fce8c106790 2023-08-10T10:50:48.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.707+0000 7fce827fc700 1 -- 172.21.15.107:0/181833388 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84005570 con 0x7fce8c106790 2023-08-10T10:50:48.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.708+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c1a3570 con 0x7fce8c106790 2023-08-10T10:50:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.709+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c04e470 con 0x7fce8c106790 2023-08-10T10:50:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.710+0000 7fce827fc700 1 -- 172.21.15.107:0/181833388 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fce8400db20 con 0x7fce8c106790 2023-08-10T10:50:48.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.712+0000 7fce827fc700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce780a1150 0x7fce780a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:48.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.712+0000 7fce827fc700 1 -- 172.21.15.107:0/181833388 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fce840cc390 con 0x7fce8c106790 2023-08-10T10:50:48.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.712+0000 7fce9161f700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce780a1150 0x7fce780a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:48.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.713+0000 7fce9161f700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce780a1150 0x7fce780a3610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fce8800b5c0 tx=0x7fce88005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:48.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.716+0000 7fce827fc700 1 -- 172.21.15.107:0/181833388 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fce84095760 con 0x7fce8c106790 2023-08-10T10:50:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.958+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce8c1a3860 con 0x7fce8c106790 2023-08-10T10:50:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.958+0000 7fce827fc700 1 -- 172.21.15.107:0/181833388 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+88 (secure 0 0 0) 0x7fce84098d80 con 0x7fce8c106790 2023-08-10T10:50:48.960 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-10T10:50:48.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.960+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce780a1150 msgr2=0x7fce780a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:48.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.960+0000 7fce93883700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce780a1150 0x7fce780a3610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fce8800b5c0 tx=0x7fce88005fb0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 msgr2=0x7fce8c196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:48.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 0x7fce8c196600 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fce84007ee0 tx=0x7fce8400d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 shutdown_connections 2023-08-10T10:50:48.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fce780a1150 0x7fce780a3610 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce8c106790 0x7fce8c196600 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce8c100790 0x7fce8c19c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 --2- 172.21.15.107:0/181833388 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce8c101150 0x7fce8c19cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:48.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 >> 172.21.15.107:0/181833388 conn(0x7fce8c0fc260 msgr2=0x7fce8c0fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:48.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 shutdown_connections 2023-08-10T10:50:48.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:48.961+0000 7fce93883700 1 -- 172.21.15.107:0/181833388 wait complete. 2023-08-10T10:50:49.068 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:48 smithi107 ceph-mon[127953]: pgmap v371: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2023-08-10T10:50:49.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:48 smithi195 ceph-mon[129938]: pgmap v371: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2023-08-10T10:50:49.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:48 smithi157 ceph-mon[129604]: pgmap v371: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2023-08-10T10:50:49.386 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:50:49.386 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:50:49.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2023-08-10T10:50:49.387 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:50:49.387 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-08-10T10:50:49.387 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:50:49.388 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:50:49.388 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:50:49.388 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-08-10T10:50:49.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:49.389 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2023-08-10T10:50:49.433 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:50:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:50:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:50:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2023-08-10T10:50:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:49.434 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:50:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2023-08-10T10:50:49.435 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:50:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2023-08-10T10:50:49.435 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:50:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:49.435 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:50:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2023-08-10T10:50:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:50:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 40533sec preferred_lft 40533sec 2023-08-10T10:50:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::3b9b:a750:7172:f772/64 scope link noprefixroute 2023-08-10T10:50:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:50:49.436 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T10:50:49.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:49.437 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:50:49.437 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:50:49.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2023-08-10T10:50:49.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2023-08-10T10:50:49.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2023-08-10T10:50:49.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T10:50:49.438 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:50:49.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:49.682 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:50:49.752 INFO:teuthology.orchestra.run.smithi107.stdout:1 2023-08-10T10:50:49.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:49.755 DEBUG:teuthology.orchestra.run.smithi107:> route 2023-08-10T10:50:49.802 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2023-08-10T10:50:49.802 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:50:49.802 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:50:49.802 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:50:49.802 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:50:49.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:49.804 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:50:49.804 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:50:49.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:50:49.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:50:49.805 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:50:49.805 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:50:49.907 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:49 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/181833388' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-10T10:50:49.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:49.980 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2023-08-10T10:50:50.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:50.024 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2023-08-10T10:50:50.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:50.108 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:50:50.108 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:50:50.108 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--tmp-cephfs 2023-08-10T10:50:50.109 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-08-10T10:50:50.109 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:50:50.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:49 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/181833388' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-10T10:50:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:49 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/181833388' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-08-10T10:50:50.291 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-08-10T10:50:50.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:50.292 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:50:50.292 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:50:50.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-08-10T10:50:50.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T10:50:50.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-08-10T10:50:50.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-08-10T10:50:50.294 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-08-10T10:50:50.294 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:50:50.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:50.540 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2023-08-10T10:50:50.540 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2023-08-10T10:50:50.541 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2023-08-10T10:50:50.541 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T10:50:50.541 DEBUG:teuthology.orchestra.run.smithi107:> ') 2023-08-10T10:50:50.718 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-08-10T10:50:50.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:50:50.718 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /tmp/cephfs 2023-08-10T10:50:50.761 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/tmp/cephfs' 2023-08-10T10:50:50.762 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:50:50.762 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /tmp/cephfs 2023-08-10T10:50:50.844 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-08-10T10:50:50.955 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-10T10:50:50.956 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-10T10:50:51.024 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-10T10:50:51.027 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-10T10:50:51.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:51.028 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-08-10T10:50:51.073 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-10T10:50:51.073 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/90b5c840-6bb9-47ad-86f6-f390c1888057 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2023-08-10T10:50:51.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:50 smithi107 ceph-mon[127953]: pgmap v372: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-08-10T10:50:51.081 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-08-10T10:50:51.152 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-10T10:50:51.152 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-10T10:50:51.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:50 smithi195 ceph-mon[129938]: pgmap v372: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-08-10T10:50:51.220 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-10T10:50:51.223 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-10T10:50:51.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:51.224 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-08-10T10:50:51.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:2023-08-10T10:50:51.254+0000 7fcab76815c0 -1 init, newargv = 0x55f2e0b11320 newargc=17 2023-08-10T10:50:51.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:ceph-fuse[177982]: starting ceph client 2023-08-10T10:50:51.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:ceph-fuse[177982]: starting fuse 2023-08-10T10:50:51.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:50 smithi157 ceph-mon[129604]: pgmap v372: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-08-10T10:50:52.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2023-08-10T10:50:52.450 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-10T10:50:52.451 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-10T10:50:52.521 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-10T10:50:52.523 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-10T10:50:52.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:52.525 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2023-08-10T10:50:52.568 INFO:teuthology.orchestra.run.smithi107.stdout:121 2023-08-10T10:50:52.568 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-08-10T10:50:52.568 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:50:52.569 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2023-08-10T10:50:52.569 DEBUG:teuthology.orchestra.run.smithi107:> import re 2023-08-10T10:50:52.569 DEBUG:teuthology.orchestra.run.smithi107:> import os 2023-08-10T10:50:52.569 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2023-08-10T10:50:52.570 DEBUG:teuthology.orchestra.run.smithi107:> 2023-08-10T10:50:52.570 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2023-08-10T10:50:52.570 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-10T10:50:52.570 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2023-08-10T10:50:52.571 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/tmp/cephfs" 2023-08-10T10:50:52.571 DEBUG:teuthology.orchestra.run.smithi107:> 2023-08-10T10:50:52.571 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2023-08-10T10:50:52.571 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2023-08-10T10:50:52.571 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2023-08-10T10:50:52.572 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2023-08-10T10:50:52.572 DEBUG:teuthology.orchestra.run.smithi107:> 2023-08-10T10:50:52.572 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2023-08-10T10:50:52.572 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-10T10:50:52.573 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-10T10:50:52.573 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-10T10:50:52.573 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2023-08-10T10:50:52.573 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2023-08-10T10:50:52.574 DEBUG:teuthology.orchestra.run.smithi107:> return f 2023-08-10T10:50:52.574 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-10T10:50:52.574 DEBUG:teuthology.orchestra.run.smithi107:> 2023-08-10T10:50:52.574 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.0")) 2023-08-10T10:50:52.574 DEBUG:teuthology.orchestra.run.smithi107:> ' 2023-08-10T10:50:52.751 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.0.177982.asok 2023-08-10T10:50:52.930 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.177982.asok 2023-08-10T10:50:52.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:52.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.177982.asok status 2023-08-10T10:50:53.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:52 smithi107 ceph-mon[127953]: pgmap v373: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-08-10T10:50:53.156 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:50:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2023-08-10T10:50:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "a8bf445f2d27d8e12e060dff0fd151d481b5290b", 2023-08-10T10:50:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev)", 2023-08-10T10:50:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "0", 2023-08-10T10:50:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2023-08-10T10:50:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/tmp/cephfs", 2023-08-10T10:50:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "177982", 2023-08-10T10:50:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/volumes/_nogroup/sv_0/90b5c840-6bb9-47ad-86f6-f390c1888057" 2023-08-10T10:50:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T10:50:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2023-08-10T10:50:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2023-08-10T10:50:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 15561, 2023-08-10T10:50:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2023-08-10T10:50:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2023-08-10T10:50:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2023-08-10T10:50:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 15561 2023-08-10T10:50:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T10:50:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2023-08-10T10:50:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2023-08-10T10:50:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2023-08-10T10:50:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 1901174018 2023-08-10T10:50:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:50:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T10:50:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2023-08-10T10:50:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2023-08-10T10:50:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2023-08-10T10:50:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 1901174018 2023-08-10T10:50:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T10:50:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.15561 192.168.0.1:0/1901174018", 2023-08-10T10:50:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "192.168.0.1:0/1901174018", 2023-08-10T10:50:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 5, 2023-08-10T10:50:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 27, 2023-08-10T10:50:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 93, 2023-08-10T10:50:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2023-08-10T10:50:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2023-08-10T10:50:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs" 2023-08-10T10:50:53.164 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:50:53.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:52 smithi195 ceph-mon[129938]: pgmap v373: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-08-10T10:50:53.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:53.171 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2023-08-10T10:50:53.171 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /tmp/cephfs 2023-08-10T10:50:53.214 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2023-08-10T10:50:53.215 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2023-08-10T10:50:53.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:50:53.215 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /tmp/cephfs 2023-08-10T10:50:53.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:52 smithi157 ceph-mon[129604]: pgmap v373: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-08-10T10:50:53.325 INFO:teuthology.run_tasks:Running task check-counter... 2023-08-10T10:50:53.339 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-08-10T10:50:53.354 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.549+0000 7f8083fff700 1 -- 172.21.15.107:0/316668792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 msgr2=0x7f807c101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.549+0000 7f8083fff700 1 --2- 172.21.15.107:0/316668792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 0x7f807c101e00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f806c0099c0 tx=0x7f806c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.549+0000 7f8083fff700 1 -- 172.21.15.107:0/316668792 shutdown_connections 2023-08-10T10:50:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.549+0000 7f8083fff700 1 --2- 172.21.15.107:0/316668792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f807c1007b0 0x7f807c100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.549+0000 7f8083fff700 1 --2- 172.21.15.107:0/316668792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f807c102340 0x7f807c108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.549+0000 7f8083fff700 1 --2- 172.21.15.107:0/316668792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 0x7f807c101e00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.549+0000 7f8083fff700 1 -- 172.21.15.107:0/316668792 >> 172.21.15.107:0/316668792 conn(0x7f807c0fbd20 msgr2=0x7f807c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.549+0000 7f8083fff700 1 -- 172.21.15.107:0/316668792 shutdown_connections 2023-08-10T10:50:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.549+0000 7f8083fff700 1 -- 172.21.15.107:0/316668792 wait complete. 2023-08-10T10:50:53.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.550+0000 7f8083fff700 1 Processor -- start 2023-08-10T10:50:53.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.550+0000 7f8083fff700 1 -- start start 2023-08-10T10:50:53.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.550+0000 7f8083fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f807c1007b0 0x7f807c074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:53.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f8083fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 0x7f807c072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:53.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f8083fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f807c102340 0x7f807c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:53.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f8083fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c073840 con 0x7f807c1019a0 2023-08-10T10:50:53.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f8083fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c0739b0 con 0x7f807c1007b0 2023-08-10T10:50:53.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f8083fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c1a0410 con 0x7f807c102340 2023-08-10T10:50:53.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808159a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 0x7f807c072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:53.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808159a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 0x7f807c072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44178/0 (socket says 172.21.15.107:44178) 2023-08-10T10:50:53.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808159a700 1 -- 172.21.15.107:0/160288252 learned_addr learned my addr 172.21.15.107:0/160288252 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:53.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f8081d9b700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f807c1007b0 0x7f807c074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808159a700 1 -- 172.21.15.107:0/160288252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f807c102340 msgr2=0x7f807c0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808259c700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f807c102340 0x7f807c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808159a700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f807c102340 0x7f807c0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808159a700 1 -- 172.21.15.107:0/160288252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f807c1007b0 msgr2=0x7f807c074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808159a700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f807c1007b0 0x7f807c074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808159a700 1 -- 172.21.15.107:0/160288252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c0095f0 con 0x7f807c1019a0 2023-08-10T10:50:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f808259c700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f807c102340 0x7f807c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:53.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.551+0000 7f8081d9b700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f807c1007b0 0x7f807c074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:53.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.552+0000 7f808159a700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 0x7f807c072b60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f806c000c00 tx=0x7f806c00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:53.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.552+0000 7f8072ffd700 1 -- 172.21.15.107:0/160288252 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c01d070 con 0x7f807c1019a0 2023-08-10T10:50:53.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.552+0000 7f8072ffd700 1 -- 172.21.15.107:0/160288252 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f806c0054e0 con 0x7f807c1019a0 2023-08-10T10:50:53.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.552+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c1a0690 con 0x7f807c1019a0 2023-08-10T10:50:53.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.552+0000 7f8072ffd700 1 -- 172.21.15.107:0/160288252 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c004c90 con 0x7f807c1019a0 2023-08-10T10:50:53.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.552+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c1a0ab0 con 0x7f807c1019a0 2023-08-10T10:50:53.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.553+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c107d40 con 0x7f807c1019a0 2023-08-10T10:50:53.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.555+0000 7f8072ffd700 1 -- 172.21.15.107:0/160288252 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f806c005050 con 0x7f807c1019a0 2023-08-10T10:50:53.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.556+0000 7f8072ffd700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f80680a11a0 0x7f80680a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:53.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.556+0000 7f8072ffd700 1 -- 172.21.15.107:0/160288252 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f806c0cdc20 con 0x7f807c1019a0 2023-08-10T10:50:53.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.556+0000 7f8081d9b700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f80680a11a0 0x7f80680a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:53.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.557+0000 7f8081d9b700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f80680a11a0 0x7f80680a3660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8078005950 tx=0x7f80780058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:53.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.560+0000 7f8072ffd700 1 -- 172.21.15.107:0/160288252 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f806c097080 con 0x7f807c1019a0 2023-08-10T10:50:53.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.765+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f807c02c970 con 0x7f807c1019a0 2023-08-10T10:50:53.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.767+0000 7f8072ffd700 1 -- 172.21.15.107:0/160288252 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24563 (secure 0 0 0) 0x7f806c09a6a0 con 0x7f807c1019a0 2023-08-10T10:50:53.768 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:53.769 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":93,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:50:13.687527+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:53.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f80680a11a0 msgr2=0x7f80680a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:53.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f80680a11a0 0x7f80680a3660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8078005950 tx=0x7f80780058e0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 msgr2=0x7f807c072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:53.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 0x7f807c072b60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f806c000c00 tx=0x7f806c00fab0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 shutdown_connections 2023-08-10T10:50:53.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f80680a11a0 0x7f80680a3660 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f807c1007b0 0x7f807c074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f807c102340 0x7f807c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 --2- 172.21.15.107:0/160288252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f807c1019a0 0x7f807c072b60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 >> 172.21.15.107:0/160288252 conn(0x7f807c0fbd20 msgr2=0x7f807c104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:53.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.769+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 shutdown_connections 2023-08-10T10:50:53.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.770+0000 7f8083fff700 1 -- 172.21.15.107:0/160288252 wait complete. 2023-08-10T10:50:53.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:50:53.790 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:50:53.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.989+0000 7f004a3ff700 1 -- 172.21.15.107:0/1277013696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0044101970 msgr2=0x7f0044101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:53.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.989+0000 7f004a3ff700 1 --2- 172.21.15.107:0/1277013696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0044101970 0x7f0044101dd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f00380099c0 tx=0x7f0038009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.989+0000 7f004a3ff700 1 -- 172.21.15.107:0/1277013696 shutdown_connections 2023-08-10T10:50:53.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.989+0000 7f004a3ff700 1 --2- 172.21.15.107:0/1277013696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0044100780 0x7f0044100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.989+0000 7f004a3ff700 1 --2- 172.21.15.107:0/1277013696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0044102310 0x7f0044108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.989+0000 7f004a3ff700 1 --2- 172.21.15.107:0/1277013696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0044101970 0x7f0044101dd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.989+0000 7f004a3ff700 1 -- 172.21.15.107:0/1277013696 >> 172.21.15.107:0/1277013696 conn(0x7f00440fbcf0 msgr2=0x7f00440fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:53.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.989+0000 7f004a3ff700 1 -- 172.21.15.107:0/1277013696 shutdown_connections 2023-08-10T10:50:53.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.989+0000 7f004a3ff700 1 -- 172.21.15.107:0/1277013696 wait complete. 2023-08-10T10:50:53.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.990+0000 7f004a3ff700 1 Processor -- start 2023-08-10T10:50:53.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.991+0000 7f004a3ff700 1 -- start start 2023-08-10T10:50:53.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.991+0000 7f004a3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0044100780 0x7f0044196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:53.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.991+0000 7f004a3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0044101970 0x7f00441968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:53.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.991+0000 7f004a3ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0044102310 0x7f004419d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:53.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.991+0000 7f004a3ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004419df00 con 0x7f0044102310 2023-08-10T10:50:53.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.991+0000 7f004a3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004419e040 con 0x7f0044100780 2023-08-10T10:50:53.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.991+0000 7f004a3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004419e1d0 con 0x7f0044101970 2023-08-10T10:50:53.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f004899c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0044102310 0x7f004419d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:53.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f0043fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0044100780 0x7f0044196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:53.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f0043fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0044100780 0x7f0044196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:46964/0 (socket says 172.21.15.107:46964) 2023-08-10T10:50:53.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f00437fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0044101970 0x7f00441968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:53.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f0043fff700 1 -- 172.21.15.107:0/4180579978 learned_addr learned my addr 172.21.15.107:0/4180579978 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:53.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f004899c700 1 -- 172.21.15.107:0/4180579978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0044101970 msgr2=0x7f00441968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:53.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f004899c700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0044101970 0x7f00441968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f004899c700 1 -- 172.21.15.107:0/4180579978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0044100780 msgr2=0x7f0044196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:53.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f004899c700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0044100780 0x7f0044196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:53.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f004899c700 1 -- 172.21.15.107:0/4180579978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380095f0 con 0x7f0044102310 2023-08-10T10:50:53.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f0043fff700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0044100780 0x7f0044196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:50:53.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f004899c700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0044102310 0x7f004419d930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f003c00efc0 tx=0x7f003c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:53.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f00417fa700 1 -- 172.21.15.107:0/4180579978 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c018070 con 0x7f0044102310 2023-08-10T10:50:53.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00440729a0 con 0x7f0044102310 2023-08-10T10:50:53.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f00417fa700 1 -- 172.21.15.107:0/4180579978 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f003c00f040 con 0x7f0044102310 2023-08-10T10:50:53.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.992+0000 7f00417fa700 1 -- 172.21.15.107:0/4180579978 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c00cba0 con 0x7f0044102310 2023-08-10T10:50:53.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.993+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0044072e60 con 0x7f0044102310 2023-08-10T10:50:53.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.993+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004410be50 con 0x7f0044102310 2023-08-10T10:50:53.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.995+0000 7f00417fa700 1 -- 172.21.15.107:0/4180579978 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f003c003a00 con 0x7f0044102310 2023-08-10T10:50:53.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.997+0000 7f00417fa700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f002c0a1150 0x7f002c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:53.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.997+0000 7f00417fa700 1 -- 172.21.15.107:0/4180579978 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f003c0cc710 con 0x7f0044102310 2023-08-10T10:50:53.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.997+0000 7f0043fff700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f002c0a1150 0x7f002c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:53.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:53.998+0000 7f0043fff700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f002c0a1150 0x7f002c0a3610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0034005950 tx=0x7f0034009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:54.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.001+0000 7f00417fa700 1 -- 172.21.15.107:0/4180579978 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f003c095bd0 con 0x7f0044102310 2023-08-10T10:50:54.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.201+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00440736e0 con 0x7f0044102310 2023-08-10T10:50:54.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.201+0000 7f00417fa700 1 -- 172.21.15.107:0/4180579978 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f003c0991f0 con 0x7f0044102310 2023-08-10T10:50:54.202 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:50:54.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f002c0a1150 msgr2=0x7f002c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f002c0a1150 0x7f002c0a3610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0034005950 tx=0x7f0034009260 comp rx=0 tx=0).stop 2023-08-10T10:50:54.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0044102310 msgr2=0x7f004419d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0044102310 0x7f004419d930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f003c00efc0 tx=0x7f003c00c3a0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 shutdown_connections 2023-08-10T10:50:54.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f002c0a1150 0x7f002c0a3610 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0044100780 0x7f0044196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0044102310 0x7f004419d930 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 --2- 172.21.15.107:0/4180579978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0044101970 0x7f00441968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 >> 172.21.15.107:0/4180579978 conn(0x7f00440fbcf0 msgr2=0x7f00440fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:54.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 shutdown_connections 2023-08-10T10:50:54.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.204+0000 7f004a3ff700 1 -- 172.21.15.107:0/4180579978 wait complete. 2023-08-10T10:50:54.223 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:50:54.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.422+0000 7f24ee3ff700 1 -- 172.21.15.107:0/3309400100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8100760 msgr2=0x7f24e8100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.422+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/3309400100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8100760 0x7f24e8100b80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f24d80099c0 tx=0x7f24d8009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.422+0000 7f24ee3ff700 1 -- 172.21.15.107:0/3309400100 shutdown_connections 2023-08-10T10:50:54.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.422+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/3309400100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24e81022f0 0x7f24e8108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.422+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/3309400100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8100760 0x7f24e8100b80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.422+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/3309400100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24e8101950 0x7f24e8101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.422+0000 7f24ee3ff700 1 -- 172.21.15.107:0/3309400100 >> 172.21.15.107:0/3309400100 conn(0x7f24e80fbcb0 msgr2=0x7f24e80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:54.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.422+0000 7f24ee3ff700 1 -- 172.21.15.107:0/3309400100 shutdown_connections 2023-08-10T10:50:54.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.422+0000 7f24ee3ff700 1 -- 172.21.15.107:0/3309400100 wait complete. 2023-08-10T10:50:54.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.423+0000 7f24ee3ff700 1 Processor -- start 2023-08-10T10:50:54.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24ee3ff700 1 -- start start 2023-08-10T10:50:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24ee3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24e8100760 0x7f24e81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24ee3ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8101950 0x7f24e81968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24ee3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24e81022f0 0x7f24e819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24ee3ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e819df20 con 0x7f24e8101950 2023-08-10T10:50:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24ee3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e819e060 con 0x7f24e8100760 2023-08-10T10:50:54.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24ee3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e819e1f0 con 0x7f24e81022f0 2023-08-10T10:50:54.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24e77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8101950 0x7f24e81968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:54.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24e77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8101950 0x7f24e81968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44218/0 (socket says 172.21.15.107:44218) 2023-08-10T10:50:54.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24e77fe700 1 -- 172.21.15.107:0/1070940108 learned_addr learned my addr 172.21.15.107:0/1070940108 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:54.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24e7fff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24e8100760 0x7f24e81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:54.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.424+0000 7f24ec99c700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24e81022f0 0x7f24e819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:54.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e77fe700 1 -- 172.21.15.107:0/1070940108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24e81022f0 msgr2=0x7f24e819d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e77fe700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24e81022f0 0x7f24e819d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e77fe700 1 -- 172.21.15.107:0/1070940108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24e8100760 msgr2=0x7f24e81963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e77fe700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24e8100760 0x7f24e81963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e77fe700 1 -- 172.21.15.107:0/1070940108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc009520 con 0x7f24e8101950 2023-08-10T10:50:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e7fff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24e8100760 0x7f24e81963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:54.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e77fe700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8101950 0x7f24e81968e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00eb30 tx=0x7f24dc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e57fa700 1 -- 172.21.15.107:0/1070940108 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc009880 con 0x7f24e8101950 2023-08-10T10:50:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d80095f0 con 0x7f24e8101950 2023-08-10T10:50:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e57fa700 1 -- 172.21.15.107:0/1070940108 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24dc0044b0 con 0x7f24e8101950 2023-08-10T10:50:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24e57fa700 1 -- 172.21.15.107:0/1070940108 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc003e40 con 0x7f24e8101950 2023-08-10T10:50:54.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.425+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e819e8a0 con 0x7f24e8101950 2023-08-10T10:50:54.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.426+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e8107780 con 0x7f24e8101950 2023-08-10T10:50:54.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.430+0000 7f24e57fa700 1 -- 172.21.15.107:0/1070940108 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f24dc003fa0 con 0x7f24e8101950 2023-08-10T10:50:54.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.431+0000 7f24e57fa700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24d00a1150 0x7f24d00a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:54.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.431+0000 7f24e57fa700 1 -- 172.21.15.107:0/1070940108 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f24dc014070 con 0x7f24e8101950 2023-08-10T10:50:54.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.431+0000 7f24e7fff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24d00a1150 0x7f24d00a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:54.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.432+0000 7f24e7fff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24d00a1150 0x7f24d00a3610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009990 tx=0x7f24d801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:54.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.433+0000 7f24e57fa700 1 -- 172.21.15.107:0/1070940108 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f24dc096680 con 0x7f24e8101950 2023-08-10T10:50:54.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.633+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24e802cbc0 con 0x7f24e8101950 2023-08-10T10:50:54.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.635+0000 7f24e57fa700 1 -- 172.21.15.107:0/1070940108 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24dc099ca0 con 0x7f24e8101950 2023-08-10T10:50:54.636 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:54.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24d00a1150 msgr2=0x7f24d00a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24d00a1150 0x7f24d00a3610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009990 tx=0x7f24d801a040 comp rx=0 tx=0).stop 2023-08-10T10:50:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8101950 msgr2=0x7f24e81968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8101950 0x7f24e81968e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00eb30 tx=0x7f24dc00eef0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 shutdown_connections 2023-08-10T10:50:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f24d00a1150 0x7f24d00a3610 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24e8100760 0x7f24e81963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24e81022f0 0x7f24e819d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 --2- 172.21.15.107:0/1070940108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24e8101950 0x7f24e81968e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.637+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 >> 172.21.15.107:0/1070940108 conn(0x7f24e80fbcb0 msgr2=0x7f24e80fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:54.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.638+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 shutdown_connections 2023-08-10T10:50:54.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.638+0000 7f24ee3ff700 1 -- 172.21.15.107:0/1070940108 wait complete. 2023-08-10T10:50:54.657 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:50:54.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.858+0000 7f2cad3ff700 1 -- 172.21.15.107:0/2013624692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8103b80 msgr2=0x7f2ca8103fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.858+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/2013624692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8103b80 0x7f2ca8103fe0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0099c0 tx=0x7f2c9c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.858+0000 7f2cad3ff700 1 -- 172.21.15.107:0/2013624692 shutdown_connections 2023-08-10T10:50:54.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.858+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/2013624692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ca8104520 0x7f2ca810add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.858+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/2013624692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca8102990 0x7f2ca8102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.858+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/2013624692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8103b80 0x7f2ca8103fe0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.858+0000 7f2cad3ff700 1 -- 172.21.15.107:0/2013624692 >> 172.21.15.107:0/2013624692 conn(0x7f2ca80fdf20 msgr2=0x7f2ca8100340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:54.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.858+0000 7f2cad3ff700 1 -- 172.21.15.107:0/2013624692 shutdown_connections 2023-08-10T10:50:54.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.858+0000 7f2cad3ff700 1 -- 172.21.15.107:0/2013624692 wait complete. 2023-08-10T10:50:54.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.859+0000 7f2cad3ff700 1 Processor -- start 2023-08-10T10:50:54.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.859+0000 7f2cad3ff700 1 -- start start 2023-08-10T10:50:54.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.859+0000 7f2cad3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ca8102990 0x7f2ca81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:54.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.859+0000 7f2cad3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca8103b80 0x7f2ca8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:54.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.859+0000 7f2cad3ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8104520 0x7f2ca819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:54.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.859+0000 7f2cad3ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca81a0140 con 0x7f2ca8104520 2023-08-10T10:50:54.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.859+0000 7f2cad3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca81a0280 con 0x7f2ca8102990 2023-08-10T10:50:54.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.859+0000 7f2cad3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca81a0410 con 0x7f2ca8103b80 2023-08-10T10:50:54.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8104520 0x7f2ca819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:54.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8104520 0x7f2ca819fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44236/0 (socket says 172.21.15.107:44236) 2023-08-10T10:50:54.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca77fe700 1 -- 172.21.15.107:0/3580550815 learned_addr learned my addr 172.21.15.107:0/3580550815 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:54.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca6ffd700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ca8102990 0x7f2ca81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:54.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca67fc700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca8103b80 0x7f2ca8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:54.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca77fe700 1 -- 172.21.15.107:0/3580550815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca8103b80 msgr2=0x7f2ca8198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca77fe700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca8103b80 0x7f2ca8198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca77fe700 1 -- 172.21.15.107:0/3580550815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ca8102990 msgr2=0x7f2ca81985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:54.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca77fe700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ca8102990 0x7f2ca81985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:54.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca77fe700 1 -- 172.21.15.107:0/3580550815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c0095f0 con 0x7f2ca8104520 2023-08-10T10:50:54.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.860+0000 7f2ca77fe700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8104520 0x7f2ca819fb70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0007ee0 tx=0x7f2ca000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:54.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.861+0000 7f2c8ffff700 1 -- 172.21.15.107:0/3580550815 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000dd20 con 0x7f2ca8104520 2023-08-10T10:50:54.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.861+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca81a06f0 con 0x7f2ca8104520 2023-08-10T10:50:54.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.861+0000 7f2c8ffff700 1 -- 172.21.15.107:0/3580550815 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ca000f040 con 0x7f2ca8104520 2023-08-10T10:50:54.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.861+0000 7f2c8ffff700 1 -- 172.21.15.107:0/3580550815 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0004750 con 0x7f2ca8104520 2023-08-10T10:50:54.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.861+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca81a0bb0 con 0x7f2ca8104520 2023-08-10T10:50:54.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.862+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca810e0a0 con 0x7f2ca8104520 2023-08-10T10:50:54.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.864+0000 7f2c8ffff700 1 -- 172.21.15.107:0/3580550815 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2ca0003a00 con 0x7f2ca8104520 2023-08-10T10:50:54.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.865+0000 7f2c8ffff700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c900a1150 0x7f2c900a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:54.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.865+0000 7f2c8ffff700 1 -- 172.21.15.107:0/3580550815 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f2ca00cc540 con 0x7f2ca8104520 2023-08-10T10:50:54.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.865+0000 7f2ca6ffd700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c900a1150 0x7f2c900a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:54.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.866+0000 7f2ca6ffd700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c900a1150 0x7f2c900a3610 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2ca81039e0 tx=0x7f2c98009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:54.869 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:54.869+0000 7f2c8ffff700 1 -- 172.21.15.107:0/3580550815 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2ca004e790 con 0x7f2ca8104520 2023-08-10T10:50:54.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:54 smithi195 ceph-mon[129938]: pgmap v374: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 11 op/s 2023-08-10T10:50:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:54 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/160288252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:54 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4180579978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:55.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:54 smithi157 ceph-mon[129604]: pgmap v374: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 11 op/s 2023-08-10T10:50:55.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:54 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/160288252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:55.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:54 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4180579978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:55.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.070+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ca8109940 con 0x7f2ca8104520 2023-08-10T10:50:55.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.071+0000 7f2c8ffff700 1 -- 172.21.15.107:0/3580550815 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ca0095910 con 0x7f2ca8104520 2023-08-10T10:50:55.072 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T10:50:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c900a1150 msgr2=0x7f2c900a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c900a1150 0x7f2c900a3610 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2ca81039e0 tx=0x7f2c98009260 comp rx=0 tx=0).stop 2023-08-10T10:50:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8104520 msgr2=0x7f2ca819fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8104520 0x7f2ca819fb70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0007ee0 tx=0x7f2ca000d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 shutdown_connections 2023-08-10T10:50:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2c900a1150 0x7f2c900a3610 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2ca8102990 0x7f2ca81985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ca8104520 0x7f2ca819fb70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 --2- 172.21.15.107:0/3580550815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ca8103b80 0x7f2ca8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 >> 172.21.15.107:0/3580550815 conn(0x7f2ca80fdf20 msgr2=0x7f2ca8100210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 shutdown_connections 2023-08-10T10:50:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.073+0000 7f2cad3ff700 1 -- 172.21.15.107:0/3580550815 wait complete. 2023-08-10T10:50:55.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:54 smithi107 ceph-mon[127953]: pgmap v374: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 11 op/s 2023-08-10T10:50:55.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:54 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/160288252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:55.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:54 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4180579978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:55.092 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:50:55.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.291+0000 7ff1375ff700 1 -- 172.21.15.107:0/1936730946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 msgr2=0x7ff1301035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.291+0000 7ff1375ff700 1 --2- 172.21.15.107:0/1936730946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 0x7ff1301035d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009990 tx=0x7ff12c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.291+0000 7ff1375ff700 1 -- 172.21.15.107:0/1936730946 shutdown_connections 2023-08-10T10:50:55.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.291+0000 7ff1375ff700 1 --2- 172.21.15.107:0/1936730946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff130106440 0x7ff1301088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.291+0000 7ff1375ff700 1 --2- 172.21.15.107:0/1936730946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 0x7ff1301035d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.291+0000 7ff1375ff700 1 --2- 172.21.15.107:0/1936730946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff130103b10 0x7ff130105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.291+0000 7ff1375ff700 1 -- 172.21.15.107:0/1936730946 >> 172.21.15.107:0/1936730946 conn(0x7ff1300fabd0 msgr2=0x7ff1300fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:55.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.291+0000 7ff1375ff700 1 -- 172.21.15.107:0/1936730946 shutdown_connections 2023-08-10T10:50:55.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.291+0000 7ff1375ff700 1 -- 172.21.15.107:0/1936730946 wait complete. 2023-08-10T10:50:55.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.292+0000 7ff1375ff700 1 Processor -- start 2023-08-10T10:50:55.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.292+0000 7ff1375ff700 1 -- start start 2023-08-10T10:50:55.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.292+0000 7ff1375ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 0x7ff130198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:55.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff1375ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff130103b10 0x7ff130198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:55.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff1375ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff130106440 0x7ff13019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:55.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff1375ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1301a0110 con 0x7ff1301011e0 2023-08-10T10:50:55.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff1375ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1301a0250 con 0x7ff130103b10 2023-08-10T10:50:55.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff1375ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1301a03e0 con 0x7ff130106440 2023-08-10T10:50:55.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff13539b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 0x7ff130198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:55.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff13539b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 0x7ff130198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44250/0 (socket says 172.21.15.107:44250) 2023-08-10T10:50:55.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff13539b700 1 -- 172.21.15.107:0/2412357859 learned_addr learned my addr 172.21.15.107:0/2412357859 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:55.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff134b9a700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff130103b10 0x7ff130198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:55.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff135b9c700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff130106440 0x7ff13019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:55.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff13539b700 1 -- 172.21.15.107:0/2412357859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff130106440 msgr2=0x7ff13019fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff13539b700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff130106440 0x7ff13019fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff13539b700 1 -- 172.21.15.107:0/2412357859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff130103b10 msgr2=0x7ff130198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff13539b700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff130103b10 0x7ff130198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff13539b700 1 -- 172.21.15.107:0/2412357859 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c0095f0 con 0x7ff1301011e0 2023-08-10T10:50:55.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.293+0000 7ff13539b700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 0x7ff130198590 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff12c000c00 tx=0x7ff12c003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:55.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.294+0000 7ff1267fc700 1 -- 172.21.15.107:0/2412357859 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c01d070 con 0x7ff1301011e0 2023-08-10T10:50:55.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.294+0000 7ff1267fc700 1 -- 172.21.15.107:0/2412357859 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff12c00bd70 con 0x7ff1301011e0 2023-08-10T10:50:55.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.294+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1301a0660 con 0x7ff1301011e0 2023-08-10T10:50:55.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.294+0000 7ff1267fc700 1 -- 172.21.15.107:0/2412357859 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c022cf0 con 0x7ff1301011e0 2023-08-10T10:50:55.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.294+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1301a0a80 con 0x7ff1301011e0 2023-08-10T10:50:55.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.295+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff130108020 con 0x7ff1301011e0 2023-08-10T10:50:55.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.297+0000 7ff1267fc700 1 -- 172.21.15.107:0/2412357859 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff12c022470 con 0x7ff1301011e0 2023-08-10T10:50:55.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.298+0000 7ff1267fc700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff11c0a1150 0x7ff11c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:55.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.298+0000 7ff1267fc700 1 -- 172.21.15.107:0/2412357859 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7ff12c0ce430 con 0x7ff1301011e0 2023-08-10T10:50:55.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.298+0000 7ff134b9a700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff11c0a1150 0x7ff11c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:55.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.299+0000 7ff134b9a700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff11c0a1150 0x7ff11c0a3610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff120005950 tx=0x7ff1200058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:55.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.300+0000 7ff1267fc700 1 -- 172.21.15.107:0/2412357859 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff12c097890 con 0x7ff1301011e0 2023-08-10T10:50:55.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.500+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff13002cb00 con 0x7ff1301011e0 2023-08-10T10:50:55.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.500+0000 7ff1267fc700 1 -- 172.21.15.107:0/2412357859 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff12c09aeb0 con 0x7ff1301011e0 2023-08-10T10:50:55.501 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:55.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.502+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff11c0a1150 msgr2=0x7ff11c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.502+0000 7ff1375ff700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff11c0a1150 0x7ff11c0a3610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff120005950 tx=0x7ff1200058e0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 msgr2=0x7ff130198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 0x7ff130198590 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff12c000c00 tx=0x7ff12c003b00 comp rx=0 tx=0).stop 2023-08-10T10:50:55.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 shutdown_connections 2023-08-10T10:50:55.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff11c0a1150 0x7ff11c0a3610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff130106440 0x7ff13019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1301011e0 0x7ff130198590 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 --2- 172.21.15.107:0/2412357859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff130103b10 0x7ff130198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 >> 172.21.15.107:0/2412357859 conn(0x7ff1300fabd0 msgr2=0x7ff1300ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:55.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 shutdown_connections 2023-08-10T10:50:55.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.503+0000 7ff1375ff700 1 -- 172.21.15.107:0/2412357859 wait complete. 2023-08-10T10:50:55.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:55.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.721+0000 7fc5a81ff700 1 -- 172.21.15.107:0/2379554849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0100780 msgr2=0x7fc5a0100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.721+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/2379554849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0100780 0x7fc5a0100ba0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0099c0 tx=0x7fc59c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.721+0000 7fc5a81ff700 1 -- 172.21.15.107:0/2379554849 shutdown_connections 2023-08-10T10:50:55.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.721+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/2379554849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5a0102310 0x7fc5a0108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.721+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/2379554849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0100780 0x7fc5a0100ba0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.721+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/2379554849 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a0101970 0x7fc5a0101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.721+0000 7fc5a81ff700 1 -- 172.21.15.107:0/2379554849 >> 172.21.15.107:0/2379554849 conn(0x7fc5a00fbcb0 msgr2=0x7fc5a00fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:55.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.721+0000 7fc5a81ff700 1 -- 172.21.15.107:0/2379554849 shutdown_connections 2023-08-10T10:50:55.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.721+0000 7fc5a81ff700 1 -- 172.21.15.107:0/2379554849 wait complete. 2023-08-10T10:50:55.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.722+0000 7fc5a81ff700 1 Processor -- start 2023-08-10T10:50:55.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.722+0000 7fc5a81ff700 1 -- start start 2023-08-10T10:50:55.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.722+0000 7fc5a81ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a0100780 0x7fc5a0074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:55.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.722+0000 7fc5a81ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0101970 0x7fc5a0072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:55.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.722+0000 7fc5a81ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5a0102310 0x7fc5a00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.722+0000 7fc5a81ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a0073840 con 0x7fc5a0101970 2023-08-10T10:50:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a81ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00739b0 con 0x7fc5a0100780 2023-08-10T10:50:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a81ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a01a04a0 con 0x7fc5a0102310 2023-08-10T10:50:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a579a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0101970 0x7fc5a0072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a579a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0101970 0x7fc5a0072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44272/0 (socket says 172.21.15.107:44272) 2023-08-10T10:50:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a579a700 1 -- 172.21.15.107:0/675504009 learned_addr learned my addr 172.21.15.107:0/675504009 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a5f9b700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a0100780 0x7fc5a0074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:55.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a579a700 1 -- 172.21.15.107:0/675504009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5a0102310 msgr2=0x7fc5a00730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a579a700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5a0102310 0x7fc5a00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a579a700 1 -- 172.21.15.107:0/675504009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a0100780 msgr2=0x7fc5a0074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a579a700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a0100780 0x7fc5a0074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a579a700 1 -- 172.21.15.107:0/675504009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c0095f0 con 0x7fc5a0101970 2023-08-10T10:50:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.723+0000 7fc5a579a700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0101970 0x7fc5a0072b60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc59000d980 tx=0x7fc59000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.724+0000 7fc596ffd700 1 -- 172.21.15.107:0/675504009 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000bb60 con 0x7fc5a0101970 2023-08-10T10:50:55.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.724+0000 7fc596ffd700 1 -- 172.21.15.107:0/675504009 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc590007640 con 0x7fc5a0101970 2023-08-10T10:50:55.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.724+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a01a0780 con 0x7fc5a0101970 2023-08-10T10:50:55.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.724+0000 7fc596ffd700 1 -- 172.21.15.107:0/675504009 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590004d60 con 0x7fc5a0101970 2023-08-10T10:50:55.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.724+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a01a0c90 con 0x7fc5a0101970 2023-08-10T10:50:55.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.725+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a010bea0 con 0x7fc5a0101970 2023-08-10T10:50:55.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.727+0000 7fc596ffd700 1 -- 172.21.15.107:0/675504009 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc590004020 con 0x7fc5a0101970 2023-08-10T10:50:55.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.728+0000 7fc596ffd700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc58c0a11a0 0x7fc58c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:55.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.728+0000 7fc596ffd700 1 -- 172.21.15.107:0/675504009 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fc5900cd060 con 0x7fc5a0101970 2023-08-10T10:50:55.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.728+0000 7fc5a5f9b700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc58c0a11a0 0x7fc58c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:55.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.729+0000 7fc5a5f9b700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc58c0a11a0 0x7fc58c0a3660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc59c000c00 tx=0x7fc59c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:55.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.730+0000 7fc596ffd700 1 -- 172.21.15.107:0/675504009 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc590096490 con 0x7fc5a0101970 2023-08-10T10:50:55.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:55 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1070940108' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:55.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:55 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3580550815' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:55.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:55 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2412357859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:55.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:55 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1070940108' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:55.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:55 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3580550815' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:55.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:55 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2412357859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:55.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.931+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5a010c090 con 0x7fc5a0101970 2023-08-10T10:50:55.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.933+0000 7fc596ffd700 1 -- 172.21.15.107:0/675504009 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24563 (secure 0 0 0) 0x7fc590016090 con 0x7fc5a0101970 2023-08-10T10:50:55.934 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:55.934 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":93,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:50:13.687527+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:50:55.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc58c0a11a0 msgr2=0x7fc58c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc58c0a11a0 0x7fc58c0a3660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc59c000c00 tx=0x7fc59c005fb0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0101970 msgr2=0x7fc5a0072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:55.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0101970 0x7fc5a0072b60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc59000d980 tx=0x7fc59000dd40 comp rx=0 tx=0).stop 2023-08-10T10:50:55.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 shutdown_connections 2023-08-10T10:50:55.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc58c0a11a0 0x7fc58c0a3660 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5a0100780 0x7fc5a0074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5a0102310 0x7fc5a00730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 --2- 172.21.15.107:0/675504009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5a0101970 0x7fc5a0072b60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:55.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 >> 172.21.15.107:0/675504009 conn(0x7fc5a00fbcb0 msgr2=0x7fc5a00fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:55.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 shutdown_connections 2023-08-10T10:50:55.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:55.935+0000 7fc5a81ff700 1 -- 172.21.15.107:0/675504009 wait complete. 2023-08-10T10:50:55.955 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:50:55.956 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:50:56.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:55 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1070940108' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:56.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:55 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3580550815' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:56.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:55 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2412357859' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:56.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.154+0000 7f72f93ff700 1 -- 172.21.15.107:0/542654119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4074750 msgr2=0x7f72f4072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.154+0000 7f72f93ff700 1 --2- 172.21.15.107:0/542654119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4074750 0x7f72f4072ba0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009990 tx=0x7f72e4009ca0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.154+0000 7f72f93ff700 1 -- 172.21.15.107:0/542654119 shutdown_connections 2023-08-10T10:50:56.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.154+0000 7f72f93ff700 1 --2- 172.21.15.107:0/542654119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f4108630 0x7f72f410aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.154+0000 7f72f93ff700 1 --2- 172.21.15.107:0/542654119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4074750 0x7f72f4072ba0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.154+0000 7f72f93ff700 1 --2- 172.21.15.107:0/542654119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f4073170 0x7f72f40735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.154+0000 7f72f93ff700 1 -- 172.21.15.107:0/542654119 >> 172.21.15.107:0/542654119 conn(0x7f72f40fbcb0 msgr2=0x7f72f40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:56.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.154+0000 7f72f93ff700 1 -- 172.21.15.107:0/542654119 shutdown_connections 2023-08-10T10:50:56.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.154+0000 7f72f93ff700 1 -- 172.21.15.107:0/542654119 wait complete. 2023-08-10T10:50:56.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.155+0000 7f72f93ff700 1 Processor -- start 2023-08-10T10:50:56.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.155+0000 7f72f93ff700 1 -- start start 2023-08-10T10:50:56.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f93ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f4073170 0x7f72f41985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:56.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f93ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f4074750 0x7f72f4198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:56.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f93ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4108630 0x7f72f419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:56.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f93ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f41a0120 con 0x7f72f4108630 2023-08-10T10:50:56.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f93ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f41a0260 con 0x7f72f4073170 2023-08-10T10:50:56.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f93ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f41a03f0 con 0x7f72f4074750 2023-08-10T10:50:56.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4108630 0x7f72f419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:56.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4108630 0x7f72f419fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44298/0 (socket says 172.21.15.107:44298) 2023-08-10T10:50:56.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f37fe700 1 -- 172.21.15.107:0/3445825889 learned_addr learned my addr 172.21.15.107:0/3445825889 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:56.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f2ffd700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f4073170 0x7f72f41985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:56.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f27fc700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f4074750 0x7f72f4198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:56.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f37fe700 1 -- 172.21.15.107:0/3445825889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f4074750 msgr2=0x7f72f4198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f37fe700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f4074750 0x7f72f4198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f37fe700 1 -- 172.21.15.107:0/3445825889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f4073170 msgr2=0x7f72f41985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f37fe700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f4073170 0x7f72f41985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f37fe700 1 -- 172.21.15.107:0/3445825889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e40095f0 con 0x7f72f4108630 2023-08-10T10:50:56.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.156+0000 7f72f27fc700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f4074750 0x7f72f4198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:56.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.157+0000 7f72f37fe700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4108630 0x7f72f419fb50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f72ec007ee0 tx=0x7f72ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:56.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.157+0000 7f72dbfff700 1 -- 172.21.15.107:0/3445825889 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec017070 con 0x7f72f4108630 2023-08-10T10:50:56.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.157+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f41a06d0 con 0x7f72f4108630 2023-08-10T10:50:56.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.157+0000 7f72dbfff700 1 -- 172.21.15.107:0/3445825889 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72ec00f040 con 0x7f72f4108630 2023-08-10T10:50:56.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.157+0000 7f72dbfff700 1 -- 172.21.15.107:0/3445825889 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec005710 con 0x7f72f4108630 2023-08-10T10:50:56.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.157+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f41a0b90 con 0x7f72f4108630 2023-08-10T10:50:56.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.158+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f4106d30 con 0x7f72f4108630 2023-08-10T10:50:56.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.160+0000 7f72dbfff700 1 -- 172.21.15.107:0/3445825889 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f72ec005870 con 0x7f72f4108630 2023-08-10T10:50:56.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.161+0000 7f72dbfff700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72dc0a1150 0x7f72dc0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:56.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.161+0000 7f72dbfff700 1 -- 172.21.15.107:0/3445825889 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f72ec0cc440 con 0x7f72f4108630 2023-08-10T10:50:56.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.162+0000 7f72f2ffd700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72dc0a1150 0x7f72dc0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:56.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.162+0000 7f72f2ffd700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72dc0a1150 0x7f72dc0a3610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006010 tx=0x7f72e400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:56.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.165+0000 7f72dbfff700 1 -- 172.21.15.107:0/3445825889 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f72ec095870 con 0x7f72f4108630 2023-08-10T10:50:56.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.366+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72f4061380 con 0x7f72f4108630 2023-08-10T10:50:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.367+0000 7f72dbfff700 1 -- 172.21.15.107:0/3445825889 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72ec098e90 con 0x7f72f4108630 2023-08-10T10:50:56.368 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:50:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.369+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72dc0a1150 msgr2=0x7f72dc0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.369+0000 7f72f93ff700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72dc0a1150 0x7f72dc0a3610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006010 tx=0x7f72e400b260 comp rx=0 tx=0).stop 2023-08-10T10:50:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.369+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4108630 msgr2=0x7f72f419fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.369+0000 7f72f93ff700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4108630 0x7f72f419fb50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f72ec007ee0 tx=0x7f72ec00d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.369+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 shutdown_connections 2023-08-10T10:50:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.369+0000 7f72f93ff700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f72dc0a1150 0x7f72dc0a3610 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.369+0000 7f72f93ff700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72f4073170 0x7f72f41985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.369+0000 7f72f93ff700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72f4108630 0x7f72f419fb50 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.369+0000 7f72f93ff700 1 --2- 172.21.15.107:0/3445825889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f4074750 0x7f72f4198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.370+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 >> 172.21.15.107:0/3445825889 conn(0x7f72f40fbcb0 msgr2=0x7f72f40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.370+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 shutdown_connections 2023-08-10T10:50:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.370+0000 7f72f93ff700 1 -- 172.21.15.107:0/3445825889 wait complete. 2023-08-10T10:50:56.389 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:50:56.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.588+0000 7f2be21ff700 1 -- 172.21.15.107:0/2879749683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc101970 msgr2=0x7f2bdc101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.588+0000 7f2be21ff700 1 --2- 172.21.15.107:0/2879749683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc101970 0x7f2bdc101dd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00099c0 tx=0x7f2bd0009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.589+0000 7f2be21ff700 1 -- 172.21.15.107:0/2879749683 shutdown_connections 2023-08-10T10:50:56.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.589+0000 7f2be21ff700 1 --2- 172.21.15.107:0/2879749683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc100780 0x7f2bdc100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.589+0000 7f2be21ff700 1 --2- 172.21.15.107:0/2879749683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bdc102310 0x7f2bdc108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.589+0000 7f2be21ff700 1 --2- 172.21.15.107:0/2879749683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc101970 0x7f2bdc101dd0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.589+0000 7f2be21ff700 1 -- 172.21.15.107:0/2879749683 >> 172.21.15.107:0/2879749683 conn(0x7f2bdc0fbcf0 msgr2=0x7f2bdc0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:56.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.589+0000 7f2be21ff700 1 -- 172.21.15.107:0/2879749683 shutdown_connections 2023-08-10T10:50:56.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.589+0000 7f2be21ff700 1 -- 172.21.15.107:0/2879749683 wait complete. 2023-08-10T10:50:56.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2be21ff700 1 Processor -- start 2023-08-10T10:50:56.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2be21ff700 1 -- start start 2023-08-10T10:50:56.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2be21ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc100780 0x7f2bdc1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:56.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2be21ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bdc101970 0x7f2bdc198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:56.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2be21ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc102310 0x7f2bdc19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:56.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2be21ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1a0150 con 0x7f2bdc102310 2023-08-10T10:50:56.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2be21ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1a0290 con 0x7f2bdc100780 2023-08-10T10:50:56.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2be21ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1a0420 con 0x7f2bdc101970 2023-08-10T10:50:56.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2bdbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc102310 0x7f2bdc19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:56.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2bdbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc102310 0x7f2bdc19fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44328/0 (socket says 172.21.15.107:44328) 2023-08-10T10:50:56.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2bdbfff700 1 -- 172.21.15.107:0/1091365323 learned_addr learned my addr 172.21.15.107:0/1091365323 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:56.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.590+0000 7f2bdaffd700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bdc101970 0x7f2bdc198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:56.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bdb7fe700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc100780 0x7f2bdc1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:56.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bdbfff700 1 -- 172.21.15.107:0/1091365323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bdc101970 msgr2=0x7f2bdc198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bdbfff700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bdc101970 0x7f2bdc198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bdbfff700 1 -- 172.21.15.107:0/1091365323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc100780 msgr2=0x7f2bdc1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bdbfff700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc100780 0x7f2bdc1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bdbfff700 1 -- 172.21.15.107:0/1091365323 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd00095f0 con 0x7f2bdc102310 2023-08-10T10:50:56.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bdbfff700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc102310 0x7f2bdc19fb80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4007ee0 tx=0x7f2bd400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:56.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bd8ff9700 1 -- 172.21.15.107:0/1091365323 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4017070 con 0x7f2bdc102310 2023-08-10T10:50:56.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc1a0700 con 0x7f2bdc102310 2023-08-10T10:50:56.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bd8ff9700 1 -- 172.21.15.107:0/1091365323 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bd400f040 con 0x7f2bdc102310 2023-08-10T10:50:56.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2bd8ff9700 1 -- 172.21.15.107:0/1091365323 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4005570 con 0x7f2bdc102310 2023-08-10T10:50:56.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.591+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc1a0bc0 con 0x7f2bdc102310 2023-08-10T10:50:56.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.592+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc10bea0 con 0x7f2bdc102310 2023-08-10T10:50:56.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.594+0000 7f2bd8ff9700 1 -- 172.21.15.107:0/1091365323 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2bd400db20 con 0x7f2bdc102310 2023-08-10T10:50:56.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.596+0000 7f2bd8ff9700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2bc40a1150 0x7f2bc40a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:56.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.596+0000 7f2bd8ff9700 1 -- 172.21.15.107:0/1091365323 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f2bd40cca10 con 0x7f2bdc102310 2023-08-10T10:50:56.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.596+0000 7f2bdb7fe700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2bc40a1150 0x7f2bc40a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:56.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.597+0000 7f2bdb7fe700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2bc40a1150 0x7f2bc40a3610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc1017d0 tx=0x7f2bcc007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:56.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.598+0000 7f2bd8ff9700 1 -- 172.21.15.107:0/1091365323 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2bd4095de0 con 0x7f2bdc102310 2023-08-10T10:50:56.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.802+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bdc1a1200 con 0x7f2bdc102310 2023-08-10T10:50:56.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.803+0000 7f2bd8ff9700 1 -- 172.21.15.107:0/1091365323 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bd4099400 con 0x7f2bdc102310 2023-08-10T10:50:56.804 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:56.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2bc40a1150 msgr2=0x7f2bc40a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2bc40a1150 0x7f2bc40a3610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc1017d0 tx=0x7f2bcc007400 comp rx=0 tx=0).stop 2023-08-10T10:50:56.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc102310 msgr2=0x7f2bdc19fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:56.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc102310 0x7f2bdc19fb80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4007ee0 tx=0x7f2bd400d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 shutdown_connections 2023-08-10T10:50:56.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2bc40a1150 0x7f2bc40a3610 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.807 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2bdc100780 0x7f2bdc1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2bdc102310 0x7f2bdc19fb80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 --2- 172.21.15.107:0/1091365323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bdc101970 0x7f2bdc198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:56.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.805+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 >> 172.21.15.107:0/1091365323 conn(0x7f2bdc0fbcf0 msgr2=0x7f2bdc0fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:56.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.806+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 shutdown_connections 2023-08-10T10:50:56.808 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:56.806+0000 7f2be21ff700 1 -- 172.21.15.107:0/1091365323 wait complete. 2023-08-10T10:50:56.825 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:50:56.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:56 smithi195 ceph-mon[129938]: pgmap v375: 129 pgs: 129 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-08-10T10:50:56.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:56 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/675504009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:56.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:56 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3445825889' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:57.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.036+0000 7f1fa4fff700 1 -- 172.21.15.107:0/2166637271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0108630 msgr2=0x7f1fa010aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.036+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/2166637271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0108630 0x7f1fa010aaa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800b0a0 tx=0x7f1f9800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.036+0000 7f1fa4fff700 1 -- 172.21.15.107:0/2166637271 shutdown_connections 2023-08-10T10:50:57.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.036+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/2166637271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fa0074750 0x7f1fa0072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.036+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/2166637271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0108630 0x7f1fa010aaa0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.036+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/2166637271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fa0073170 0x7f1fa00735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.036+0000 7f1fa4fff700 1 -- 172.21.15.107:0/2166637271 >> 172.21.15.107:0/2166637271 conn(0x7f1fa00fbcb0 msgr2=0x7f1fa00fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:57.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.036+0000 7f1fa4fff700 1 -- 172.21.15.107:0/2166637271 shutdown_connections 2023-08-10T10:50:57.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.036+0000 7f1fa4fff700 1 -- 172.21.15.107:0/2166637271 wait complete. 2023-08-10T10:50:57.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:56 smithi157 ceph-mon[129604]: pgmap v375: 129 pgs: 129 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-08-10T10:50:57.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:56 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/675504009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:57.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:56 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3445825889' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:57.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.037+0000 7f1fa4fff700 1 Processor -- start 2023-08-10T10:50:57.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.037+0000 7f1fa4fff700 1 -- start start 2023-08-10T10:50:57.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1fa4fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0073170 0x7f1fa01986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1fa4fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fa0074750 0x7f1fa0198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1fa4fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fa0108630 0x7f1fa019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1fa4fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa01a0220 con 0x7f1fa0073170 2023-08-10T10:50:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1fa4fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa01a0360 con 0x7f1fa0074750 2023-08-10T10:50:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1fa4fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa01a04f0 con 0x7f1fa0108630 2023-08-10T10:50:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0073170 0x7f1fa01986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0073170 0x7f1fa01986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44348/0 (socket says 172.21.15.107:44348) 2023-08-10T10:50:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9e59c700 1 -- 172.21.15.107:0/3650916747 learned_addr learned my addr 172.21.15.107:0/3650916747 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9dd9b700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fa0074750 0x7f1fa0198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9e59c700 1 -- 172.21.15.107:0/3650916747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fa0108630 msgr2=0x7f1fa019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9e59c700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fa0108630 0x7f1fa019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9e59c700 1 -- 172.21.15.107:0/3650916747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fa0074750 msgr2=0x7f1fa0198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9e59c700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fa0074750 0x7f1fa0198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9e59c700 1 -- 172.21.15.107:0/3650916747 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98009d00 con 0x7f1fa0073170 2023-08-10T10:50:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.038+0000 7f1f9dd9b700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fa0074750 0x7f1fa0198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:50:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.039+0000 7f1f9e59c700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0073170 0x7f1fa01986a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000d950 tx=0x7f1f9000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.039+0000 7f1f8f7fe700 1 -- 172.21.15.107:0/3650916747 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90009b40 con 0x7f1fa0073170 2023-08-10T10:50:57.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.039+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa01a07d0 con 0x7f1fa0073170 2023-08-10T10:50:57.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.039+0000 7f1f8f7fe700 1 -- 172.21.15.107:0/3650916747 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f90009ca0 con 0x7f1fa0073170 2023-08-10T10:50:57.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.039+0000 7f1f8f7fe700 1 -- 172.21.15.107:0/3650916747 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000f620 con 0x7f1fa0073170 2023-08-10T10:50:57.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.039+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa01a0ce0 con 0x7f1fa0073170 2023-08-10T10:50:57.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.040+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa0106d30 con 0x7f1fa0073170 2023-08-10T10:50:57.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.042+0000 7f1f8f7fe700 1 -- 172.21.15.107:0/3650916747 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f1f90010460 con 0x7f1fa0073170 2023-08-10T10:50:57.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.043+0000 7f1f8f7fe700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f880a1150 0x7f1f880a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.043+0000 7f1f8f7fe700 1 -- 172.21.15.107:0/3650916747 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f1f900ccf30 con 0x7f1fa0073170 2023-08-10T10:50:57.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.043+0000 7f1f9dd9b700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f880a1150 0x7f1f880a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.044+0000 7f1f9dd9b700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f880a1150 0x7f1f880a3610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f94005fd0 tx=0x7f1f94005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:57.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.047+0000 7f1f8f7fe700 1 -- 172.21.15.107:0/3650916747 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1f90096360 con 0x7f1fa0073170 2023-08-10T10:50:57.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:56 smithi107 ceph-mon[127953]: pgmap v375: 129 pgs: 129 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-08-10T10:50:57.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:56 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/675504009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:50:57.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:56 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3445825889' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:50:57.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.247+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fa0061420 con 0x7f1fa0073170 2023-08-10T10:50:57.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.247+0000 7f1f8f7fe700 1 -- 172.21.15.107:0/3650916747 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f900200a0 con 0x7f1fa0073170 2023-08-10T10:50:57.248 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T10:50:57.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f880a1150 msgr2=0x7f1f880a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f880a1150 0x7f1f880a3610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f94005fd0 tx=0x7f1f94005f60 comp rx=0 tx=0).stop 2023-08-10T10:50:57.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0073170 msgr2=0x7f1fa01986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0073170 0x7f1fa01986a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000d950 tx=0x7f1f9000dd10 comp rx=0 tx=0).stop 2023-08-10T10:50:57.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 shutdown_connections 2023-08-10T10:50:57.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f1f880a1150 0x7f1f880a3610 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fa0108630 0x7f1fa019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1fa0073170 0x7f1fa01986a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 --2- 172.21.15.107:0/3650916747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1fa0074750 0x7f1fa0198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 >> 172.21.15.107:0/3650916747 conn(0x7f1fa00fbcb0 msgr2=0x7f1fa00fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:57.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 shutdown_connections 2023-08-10T10:50:57.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.250+0000 7f1fa4fff700 1 -- 172.21.15.107:0/3650916747 wait complete. 2023-08-10T10:50:57.269 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:50:57.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.468+0000 7fb7a19ff700 1 -- 172.21.15.107:0/304574926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c100760 msgr2=0x7fb79c100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.468+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/304574926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c100760 0x7fb79c100b80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0099c0 tx=0x7fb78c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.469+0000 7fb7a19ff700 1 -- 172.21.15.107:0/304574926 shutdown_connections 2023-08-10T10:50:57.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.469+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/304574926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c1022f0 0x7fb79c108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.469+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/304574926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c100760 0x7fb79c100b80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.469+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/304574926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb79c101950 0x7fb79c101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.469+0000 7fb7a19ff700 1 -- 172.21.15.107:0/304574926 >> 172.21.15.107:0/304574926 conn(0x7fb79c0fbcb0 msgr2=0x7fb79c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:57.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.469+0000 7fb7a19ff700 1 -- 172.21.15.107:0/304574926 shutdown_connections 2023-08-10T10:50:57.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.469+0000 7fb7a19ff700 1 -- 172.21.15.107:0/304574926 wait complete. 2023-08-10T10:50:57.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb7a19ff700 1 Processor -- start 2023-08-10T10:50:57.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb7a19ff700 1 -- start start 2023-08-10T10:50:57.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb7a19ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb79c100760 0x7fb79c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb7a19ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c101950 0x7fb79c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb7a19ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c1022f0 0x7fb79c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb7a19ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c1a0140 con 0x7fb79c101950 2023-08-10T10:50:57.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb7a19ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c1a0280 con 0x7fb79c1022f0 2023-08-10T10:50:57.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb7a19ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c1a0410 con 0x7fb79c100760 2023-08-10T10:50:57.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb79a7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c101950 0x7fb79c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb79a7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c101950 0x7fb79c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44366/0 (socket says 172.21.15.107:44366) 2023-08-10T10:50:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.470+0000 7fb79a7fc700 1 -- 172.21.15.107:0/579582684 learned_addr learned my addr 172.21.15.107:0/579582684 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb79affd700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb79c100760 0x7fb79c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb79b7fe700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c1022f0 0x7fb79c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb79a7fc700 1 -- 172.21.15.107:0/579582684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb79c100760 msgr2=0x7fb79c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb79a7fc700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb79c100760 0x7fb79c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb79a7fc700 1 -- 172.21.15.107:0/579582684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c1022f0 msgr2=0x7fb79c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb79a7fc700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c1022f0 0x7fb79c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb79a7fc700 1 -- 172.21.15.107:0/579582684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0095f0 con 0x7fb79c101950 2023-08-10T10:50:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb79a7fc700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c101950 0x7fb79c198b00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb79000e9a0 tx=0x7fb79000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb7a09fd700 1 -- 172.21.15.107:0/579582684 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790009790 con 0x7fb79c101950 2023-08-10T10:50:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79c1a06f0 con 0x7fb79c101950 2023-08-10T10:50:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb7a09fd700 1 -- 172.21.15.107:0/579582684 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb79000cbd0 con 0x7fb79c101950 2023-08-10T10:50:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb7a09fd700 1 -- 172.21.15.107:0/579582684 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790018680 con 0x7fb79c101950 2023-08-10T10:50:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.471+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79c1a0c00 con 0x7fb79c101950 2023-08-10T10:50:57.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.472+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79c10be80 con 0x7fb79c101950 2023-08-10T10:50:57.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.474+0000 7fb7a09fd700 1 -- 172.21.15.107:0/579582684 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb79000cd40 con 0x7fb79c101950 2023-08-10T10:50:57.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.476+0000 7fb7a09fd700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb7840a1150 0x7fb7840a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.476+0000 7fb7a09fd700 1 -- 172.21.15.107:0/579582684 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fb790014070 con 0x7fb79c101950 2023-08-10T10:50:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.476+0000 7fb79affd700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb7840a1150 0x7fb7840a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.477+0000 7fb79affd700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb7840a1150 0x7fb7840a3610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009990 tx=0x7fb78c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:57.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.479+0000 7fb7a09fd700 1 -- 172.21.15.107:0/579582684 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb790051790 con 0x7fb79c101950 2023-08-10T10:50:57.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.685+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb79c1a1240 con 0x7fb79c101950 2023-08-10T10:50:57.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.685+0000 7fb7a09fd700 1 -- 172.21.15.107:0/579582684 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb790096300 con 0x7fb79c101950 2023-08-10T10:50:57.687 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:50:57.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb7840a1150 msgr2=0x7fb7840a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb7840a1150 0x7fb7840a3610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009990 tx=0x7fb78c000bc0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c101950 msgr2=0x7fb79c198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c101950 0x7fb79c198b00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb79000e9a0 tx=0x7fb79000ecb0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 shutdown_connections 2023-08-10T10:50:57.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb7840a1150 0x7fb7840a3610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb79c1022f0 0x7fb79c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb79c100760 0x7fb79c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 --2- 172.21.15.107:0/579582684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c101950 0x7fb79c198b00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 >> 172.21.15.107:0/579582684 conn(0x7fb79c0fbcb0 msgr2=0x7fb79c0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:57.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 shutdown_connections 2023-08-10T10:50:57.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.688+0000 7fb7a19ff700 1 -- 172.21.15.107:0/579582684 wait complete. 2023-08-10T10:50:57.707 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-08-10T10:50:57.707 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:50:57.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.904+0000 7f03f4dff700 1 -- 172.21.15.107:0/1905262481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0102300 msgr2=0x7f03f0108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.904+0000 7f03f4dff700 1 --2- 172.21.15.107:0/1905262481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0102300 0x7f03f0108bb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f03e800b0d0 tx=0x7f03e800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.904+0000 7f03f4dff700 1 -- 172.21.15.107:0/1905262481 shutdown_connections 2023-08-10T10:50:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.904+0000 7f03f4dff700 1 --2- 172.21.15.107:0/1905262481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0102300 0x7f03f0108bb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.904+0000 7f03f4dff700 1 --2- 172.21.15.107:0/1905262481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03f0100770 0x7f03f0100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.904+0000 7f03f4dff700 1 --2- 172.21.15.107:0/1905262481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03f0101960 0x7f03f0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.904+0000 7f03f4dff700 1 -- 172.21.15.107:0/1905262481 >> 172.21.15.107:0/1905262481 conn(0x7f03f00fbca0 msgr2=0x7f03f00fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:57.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.904+0000 7f03f4dff700 1 -- 172.21.15.107:0/1905262481 shutdown_connections 2023-08-10T10:50:57.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.904+0000 7f03f4dff700 1 -- 172.21.15.107:0/1905262481 wait complete. 2023-08-10T10:50:57.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.905+0000 7f03f4dff700 1 Processor -- start 2023-08-10T10:50:57.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.905+0000 7f03f4dff700 1 -- start start 2023-08-10T10:50:57.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03f4dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0100770 0x7f03f01985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03f4dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03f0101960 0x7f03f0198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03f4dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03f0102300 0x7f03f019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03f4dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01a0160 con 0x7f03f0100770 2023-08-10T10:50:57.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03f4dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01a02a0 con 0x7f03f0102300 2023-08-10T10:50:57.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03f4dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01a0430 con 0x7f03f0101960 2023-08-10T10:50:57.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0100770 0x7f03f01985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0100770 0x7f03f01985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44394/0 (socket says 172.21.15.107:44394) 2023-08-10T10:50:57.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03ee59c700 1 -- 172.21.15.107:0/571359824 learned_addr learned my addr 172.21.15.107:0/571359824 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:57.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03edd9b700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03f0101960 0x7f03f0198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03ee59c700 1 -- 172.21.15.107:0/571359824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03f0101960 msgr2=0x7f03f0198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03eed9d700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03f0102300 0x7f03f019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03ee59c700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03f0101960 0x7f03f0198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03ee59c700 1 -- 172.21.15.107:0/571359824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03f0102300 msgr2=0x7f03f019fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:57.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03ee59c700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03f0102300 0x7f03f019fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:57.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03ee59c700 1 -- 172.21.15.107:0/571359824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8009d00 con 0x7f03f0100770 2023-08-10T10:50:57.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03edd9b700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03f0101960 0x7f03f0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:57.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03eed9d700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03f0102300 0x7f03f019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:57.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.906+0000 7f03ee59c700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0100770 0x7f03f01985e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f03e000e970 tx=0x7f03e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:57.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.907+0000 7f03df7fe700 1 -- 172.21.15.107:0/571359824 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0009790 con 0x7f03f0100770 2023-08-10T10:50:57.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.907+0000 7f03df7fe700 1 -- 172.21.15.107:0/571359824 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03e00044b0 con 0x7f03f0100770 2023-08-10T10:50:57.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.907+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f01a0710 con 0x7f03f0100770 2023-08-10T10:50:57.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.907+0000 7f03df7fe700 1 -- 172.21.15.107:0/571359824 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0003dd0 con 0x7f03f0100770 2023-08-10T10:50:57.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.907+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f01a0c20 con 0x7f03f0100770 2023-08-10T10:50:57.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.908+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f010be30 con 0x7f03f0100770 2023-08-10T10:50:57.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.910+0000 7f03df7fe700 1 -- 172.21.15.107:0/571359824 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f03e0003f30 con 0x7f03f0100770 2023-08-10T10:50:57.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:57 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1091365323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:57.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:57 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3650916747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.911+0000 7f03df7fe700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f03d80a11a0 0x7f03d80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.911+0000 7f03df7fe700 1 -- 172.21.15.107:0/571359824 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f03e0014070 con 0x7f03f0100770 2023-08-10T10:50:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.911+0000 7f03edd9b700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f03d80a11a0 0x7f03d80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.912+0000 7f03edd9b700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f03d80a11a0 0x7f03d80a3660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009be0 tx=0x7f03e4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:57.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:57.915+0000 7f03df7fe700 1 -- 172.21.15.107:0/571359824 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f03e00d0030 con 0x7f03f0100770 2023-08-10T10:50:58.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:57 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1091365323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:58.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:57 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3650916747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:57 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1091365323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:50:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:57 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3650916747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:50:58.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.156+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03f010bff0 con 0x7f03f0100770 2023-08-10T10:50:58.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.157+0000 7f03df7fe700 1 -- 172.21.15.107:0/571359824 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10914 (secure 0 0 0) 0x7f03e00963a0 con 0x7f03f0100770 2023-08-10T10:50:58.158 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:58.158 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:49:16.643966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:50:58.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.159+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f03d80a11a0 msgr2=0x7f03d80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.159+0000 7f03f4dff700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f03d80a11a0 0x7f03d80a3660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009be0 tx=0x7f03e4009260 comp rx=0 tx=0).stop 2023-08-10T10:50:58.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.159+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0100770 msgr2=0x7f03f01985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.159+0000 7f03f4dff700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0100770 0x7f03f01985e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f03e000e970 tx=0x7f03e000ed30 comp rx=0 tx=0).stop 2023-08-10T10:50:58.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.159+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 shutdown_connections 2023-08-10T10:50:58.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.159+0000 7f03f4dff700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f03d80a11a0 0x7f03d80a3660 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.159+0000 7f03f4dff700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03f0102300 0x7f03f019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.159+0000 7f03f4dff700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f03f0100770 0x7f03f01985e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.159+0000 7f03f4dff700 1 --2- 172.21.15.107:0/571359824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03f0101960 0x7f03f0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.160+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 >> 172.21.15.107:0/571359824 conn(0x7f03f00fbca0 msgr2=0x7f03f01071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:58.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.160+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 shutdown_connections 2023-08-10T10:50:58.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.160+0000 7f03f4dff700 1 -- 172.21.15.107:0/571359824 wait complete. 2023-08-10T10:50:58.163 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:50:58.179 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-08-10T10:50:58.179 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-08-10T10:50:58.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:50:58.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.375+0000 7fe6c11ff700 1 -- 172.21.15.107:0/3797751702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 msgr2=0x7fe6bc108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.375+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/3797751702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 0x7fe6bc108bc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400b0d0 tx=0x7fe6b400b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.375+0000 7fe6c11ff700 1 -- 172.21.15.107:0/3797751702 shutdown_connections 2023-08-10T10:50:58.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.375+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/3797751702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6bc100780 0x7fe6bc100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.375+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/3797751702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 0x7fe6bc108bc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.375+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/3797751702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc101970 0x7fe6bc101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.375+0000 7fe6c11ff700 1 -- 172.21.15.107:0/3797751702 >> 172.21.15.107:0/3797751702 conn(0x7fe6bc0fbcb0 msgr2=0x7fe6bc0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:58.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.375+0000 7fe6c11ff700 1 -- 172.21.15.107:0/3797751702 shutdown_connections 2023-08-10T10:50:58.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.375+0000 7fe6c11ff700 1 -- 172.21.15.107:0/3797751702 wait complete. 2023-08-10T10:50:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.376+0000 7fe6c11ff700 1 Processor -- start 2023-08-10T10:50:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.376+0000 7fe6c11ff700 1 -- start start 2023-08-10T10:50:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6c11ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6bc100780 0x7fe6bc198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6c11ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc101970 0x7fe6bc198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:58.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6c11ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 0x7fe6bc19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6c11ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc1a0180 con 0x7fe6bc102310 2023-08-10T10:50:58.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6c11ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc1a02c0 con 0x7fe6bc100780 2023-08-10T10:50:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6c11ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc1a0450 con 0x7fe6bc101970 2023-08-10T10:50:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bb59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 0x7fe6bc19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bb59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 0x7fe6bc19fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44412/0 (socket says 172.21.15.107:44412) 2023-08-10T10:50:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bb59e700 1 -- 172.21.15.107:0/2924020687 learned_addr learned my addr 172.21.15.107:0/2924020687 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6ba59c700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc101970 0x7fe6bc198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:58.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bad9d700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6bc100780 0x7fe6bc198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bb59e700 1 -- 172.21.15.107:0/2924020687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc101970 msgr2=0x7fe6bc198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bb59e700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc101970 0x7fe6bc198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bb59e700 1 -- 172.21.15.107:0/2924020687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6bc100780 msgr2=0x7fe6bc198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bb59e700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6bc100780 0x7fe6bc198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bb59e700 1 -- 172.21.15.107:0/2924020687 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4009d00 con 0x7fe6bc102310 2023-08-10T10:50:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6ba59c700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc101970 0x7fe6bc198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:58.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.377+0000 7fe6bad9d700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6bc100780 0x7fe6bc198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:58.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.378+0000 7fe6bb59e700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 0x7fe6bc19fbb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009fd0 tx=0x7fe6b400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:58.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.378+0000 7fe6a3fff700 1 -- 172.21.15.107:0/2924020687 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400e040 con 0x7fe6bc102310 2023-08-10T10:50:58.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.378+0000 7fe6a3fff700 1 -- 172.21.15.107:0/2924020687 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6b4003e10 con 0x7fe6bc102310 2023-08-10T10:50:58.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.378+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc1a06d0 con 0x7fe6bc102310 2023-08-10T10:50:58.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.378+0000 7fe6a3fff700 1 -- 172.21.15.107:0/2924020687 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40052a0 con 0x7fe6bc102310 2023-08-10T10:50:58.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.378+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc1a0ba0 con 0x7fe6bc102310 2023-08-10T10:50:58.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.379+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc192c40 con 0x7fe6bc102310 2023-08-10T10:50:58.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.381+0000 7fe6a3fff700 1 -- 172.21.15.107:0/2924020687 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe6b4005400 con 0x7fe6bc102310 2023-08-10T10:50:58.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.382+0000 7fe6a3fff700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe6a40a1220 0x7fe6a40a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:58.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.382+0000 7fe6a3fff700 1 -- 172.21.15.107:0/2924020687 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fe6b40ce290 con 0x7fe6bc102310 2023-08-10T10:50:58.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.383+0000 7fe6bad9d700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe6a40a1220 0x7fe6a40a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:58.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.383+0000 7fe6bad9d700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe6a40a1220 0x7fe6a40a36e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc1017d0 tx=0x7fe6ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:58.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.386+0000 7fe6a3fff700 1 -- 172.21.15.107:0/2924020687 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe6b40976f0 con 0x7fe6bc102310 2023-08-10T10:50:58.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.580+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6bc060bb0 con 0x7fe6a40a1220 2023-08-10T10:50:58.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.595+0000 7fe6a3fff700 1 -- 172.21.15.107:0/2924020687 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426541 (secure 0 0 0) 0x7fe6bc060bb0 con 0x7fe6a40a1220 2023-08-10T10:50:58.605 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:58.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.600+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe6a40a1220 msgr2=0x7fe6a40a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.600+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe6a40a1220 0x7fe6a40a36e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc1017d0 tx=0x7fe6ac009260 comp rx=0 tx=0).stop 2023-08-10T10:50:58.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.600+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 msgr2=0x7fe6bc19fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.600+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 0x7fe6bc19fbb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009fd0 tx=0x7fe6b400cb60 comp rx=0 tx=0).stop 2023-08-10T10:50:58.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.601+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 shutdown_connections 2023-08-10T10:50:58.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.601+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe6a40a1220 0x7fe6a40a36e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.601+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6bc100780 0x7fe6bc198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.601+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc102310 0x7fe6bc19fbb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.601+0000 7fe6c11ff700 1 --2- 172.21.15.107:0/2924020687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc101970 0x7fe6bc198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.601+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 >> 172.21.15.107:0/2924020687 conn(0x7fe6bc0fbcb0 msgr2=0x7fe6bc107260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:58.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.601+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 shutdown_connections 2023-08-10T10:50:58.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.601+0000 7fe6c11ff700 1 -- 172.21.15.107:0/2924020687 wait complete. 2023-08-10T10:50:58.612 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-08-10T10:50:58.620 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2023-08-10T10:50:57.618387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660378,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1171,"num_read_kb":714,"num_write":443,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336748,"kb_used_data":12556,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605076,"statfs":{"total":1151940427776,"available":1151595597824,"internally_reserved":0,"allocated":12857344,"data_stored":8185947,"data_compressed":390612,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":60,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003040"},"pg_stats":[{"pgid":"3.3f","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622275+0000","last_change":"2023-08-10T10:48:42.585259+0000","last_active":"2023-08-10T10:50:41.622275+0000","last_peered":"2023-08-10T10:50:41.622275+0000","last_clean":"2023-08-10T10:50:41.622275+0000","last_became_active":"2023-08-10T10:48:42.584501+0000","last_became_peered":"2023-08-10T10:48:42.584501+0000","last_unstale":"2023-08-10T10:50:41.622275+0000","last_undegraded":"2023-08-10T10:50:41.622275+0000","last_fullsized":"2023-08-10T10:50:41.622275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:56.485043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617518+0000","last_change":"2023-08-10T10:48:42.577812+0000","last_active":"2023-08-10T10:50:41.617518+0000","last_peered":"2023-08-10T10:50:41.617518+0000","last_clean":"2023-08-10T10:50:41.617518+0000","last_became_active":"2023-08-10T10:48:42.577499+0000","last_became_peered":"2023-08-10T10:48:42.577499+0000","last_unstale":"2023-08-10T10:50:41.617518+0000","last_undegraded":"2023-08-10T10:50:41.617518+0000","last_fullsized":"2023-08-10T10:50:41.617518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:06:40.664014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621396+0000","last_change":"2023-08-10T10:48:42.577302+0000","last_active":"2023-08-10T10:50:41.621396+0000","last_peered":"2023-08-10T10:50:41.621396+0000","last_clean":"2023-08-10T10:50:41.621396+0000","last_became_active":"2023-08-10T10:48:42.577022+0000","last_became_peered":"2023-08-10T10:48:42.577022+0000","last_unstale":"2023-08-10T10:50:41.621396+0000","last_undegraded":"2023-08-10T10:50:41.621396+0000","last_fullsized":"2023-08-10T10:50:41.621396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:04:39.641834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.602333+0000","last_change":"2023-08-10T10:48:42.577198+0000","last_active":"2023-08-10T10:50:41.602333+0000","last_peered":"2023-08-10T10:50:41.602333+0000","last_clean":"2023-08-10T10:50:41.602333+0000","last_became_active":"2023-08-10T10:48:42.576887+0000","last_became_peered":"2023-08-10T10:48:42.576887+0000","last_unstale":"2023-08-10T10:50:41.602333+0000","last_undegraded":"2023-08-10T10:50:41.602333+0000","last_fullsized":"2023-08-10T10:50:41.602333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:53.163140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.607900+0000","last_change":"2023-08-10T10:48:42.587532+0000","last_active":"2023-08-10T10:50:41.607900+0000","last_peered":"2023-08-10T10:50:41.607900+0000","last_clean":"2023-08-10T10:50:41.607900+0000","last_became_active":"2023-08-10T10:48:42.587199+0000","last_became_peered":"2023-08-10T10:48:42.587199+0000","last_unstale":"2023-08-10T10:50:41.607900+0000","last_undegraded":"2023-08-10T10:50:41.607900+0000","last_fullsized":"2023-08-10T10:50:41.607900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:17.189550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617602+0000","last_change":"2023-08-10T10:48:42.581998+0000","last_active":"2023-08-10T10:50:41.617602+0000","last_peered":"2023-08-10T10:50:41.617602+0000","last_clean":"2023-08-10T10:50:41.617602+0000","last_became_active":"2023-08-10T10:48:42.581683+0000","last_became_peered":"2023-08-10T10:48:42.581683+0000","last_unstale":"2023-08-10T10:50:41.617602+0000","last_undegraded":"2023-08-10T10:50:41.617602+0000","last_fullsized":"2023-08-10T10:50:41.617602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:29.246550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.614453+0000","last_change":"2023-08-10T10:48:42.578452+0000","last_active":"2023-08-10T10:50:41.614453+0000","last_peered":"2023-08-10T10:50:41.614453+0000","last_clean":"2023-08-10T10:50:41.614453+0000","last_became_active":"2023-08-10T10:48:42.577456+0000","last_became_peered":"2023-08-10T10:48:42.577456+0000","last_unstale":"2023-08-10T10:50:41.614453+0000","last_undegraded":"2023-08-10T10:50:41.614453+0000","last_fullsized":"2023-08-10T10:50:41.614453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:10:32.160703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613947+0000","last_change":"2023-08-10T10:48:42.578839+0000","last_active":"2023-08-10T10:50:41.613947+0000","last_peered":"2023-08-10T10:50:41.613947+0000","last_clean":"2023-08-10T10:50:41.613947+0000","last_became_active":"2023-08-10T10:48:42.578450+0000","last_became_peered":"2023-08-10T10:48:42.578450+0000","last_unstale":"2023-08-10T10:50:41.613947+0000","last_undegraded":"2023-08-10T10:50:41.613947+0000","last_fullsized":"2023-08-10T10:50:41.613947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:27.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.614776+0000","last_change":"2023-08-10T10:48:42.588533+0000","last_active":"2023-08-10T10:50:41.614776+0000","last_peered":"2023-08-10T10:50:41.614776+0000","last_clean":"2023-08-10T10:50:41.614776+0000","last_became_active":"2023-08-10T10:48:42.588205+0000","last_became_peered":"2023-08-10T10:48:42.588205+0000","last_unstale":"2023-08-10T10:50:41.614776+0000","last_undegraded":"2023-08-10T10:50:41.614776+0000","last_fullsized":"2023-08-10T10:50:41.614776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:24:40.499168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616444+0000","last_change":"2023-08-10T10:48:42.588606+0000","last_active":"2023-08-10T10:50:41.616444+0000","last_peered":"2023-08-10T10:50:41.616444+0000","last_clean":"2023-08-10T10:50:41.616444+0000","last_became_active":"2023-08-10T10:48:42.588261+0000","last_became_peered":"2023-08-10T10:48:42.588261+0000","last_unstale":"2023-08-10T10:50:41.616444+0000","last_undegraded":"2023-08-10T10:50:41.616444+0000","last_fullsized":"2023-08-10T10:50:41.616444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:38:05.898926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622139+0000","last_change":"2023-08-10T10:48:42.577245+0000","last_active":"2023-08-10T10:50:41.622139+0000","last_peered":"2023-08-10T10:50:41.622139+0000","last_clean":"2023-08-10T10:50:41.622139+0000","last_became_active":"2023-08-10T10:48:42.576512+0000","last_became_peered":"2023-08-10T10:48:42.576512+0000","last_unstale":"2023-08-10T10:50:41.622139+0000","last_undegraded":"2023-08-10T10:50:41.622139+0000","last_fullsized":"2023-08-10T10:50:41.622139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:18:10.408544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.608265+0000","last_change":"2023-08-10T10:48:42.590704+0000","last_active":"2023-08-10T10:50:41.608265+0000","last_peered":"2023-08-10T10:50:41.608265+0000","last_clean":"2023-08-10T10:50:41.608265+0000","last_became_active":"2023-08-10T10:48:42.590360+0000","last_became_peered":"2023-08-10T10:48:42.590360+0000","last_unstale":"2023-08-10T10:50:41.608265+0000","last_undegraded":"2023-08-10T10:50:41.608265+0000","last_fullsized":"2023-08-10T10:50:41.608265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:45.721572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.610049+0000","last_change":"2023-08-10T10:48:42.580072+0000","last_active":"2023-08-10T10:50:41.610049+0000","last_peered":"2023-08-10T10:50:41.610049+0000","last_clean":"2023-08-10T10:50:41.610049+0000","last_became_active":"2023-08-10T10:48:42.579745+0000","last_became_peered":"2023-08-10T10:48:42.579745+0000","last_unstale":"2023-08-10T10:50:41.610049+0000","last_undegraded":"2023-08-10T10:50:41.610049+0000","last_fullsized":"2023-08-10T10:50:41.610049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:32.312474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617574+0000","last_change":"2023-08-10T10:48:42.577050+0000","last_active":"2023-08-10T10:50:41.617574+0000","last_peered":"2023-08-10T10:50:41.617574+0000","last_clean":"2023-08-10T10:50:41.617574+0000","last_became_active":"2023-08-10T10:48:42.576686+0000","last_became_peered":"2023-08-10T10:48:42.576686+0000","last_unstale":"2023-08-10T10:50:41.617574+0000","last_undegraded":"2023-08-10T10:50:41.617574+0000","last_fullsized":"2023-08-10T10:50:41.617574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:29.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615362+0000","last_change":"2023-08-10T10:48:42.582939+0000","last_active":"2023-08-10T10:50:41.615362+0000","last_peered":"2023-08-10T10:50:41.615362+0000","last_clean":"2023-08-10T10:50:41.615362+0000","last_became_active":"2023-08-10T10:48:42.582560+0000","last_became_peered":"2023-08-10T10:48:42.582560+0000","last_unstale":"2023-08-10T10:50:41.615362+0000","last_undegraded":"2023-08-10T10:50:41.615362+0000","last_fullsized":"2023-08-10T10:50:41.615362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:30.943272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622383+0000","last_change":"2023-08-10T10:48:42.577163+0000","last_active":"2023-08-10T10:50:41.622383+0000","last_peered":"2023-08-10T10:50:41.622383+0000","last_clean":"2023-08-10T10:50:41.622383+0000","last_became_active":"2023-08-10T10:48:42.576866+0000","last_became_peered":"2023-08-10T10:48:42.576866+0000","last_unstale":"2023-08-10T10:50:41.622383+0000","last_undegraded":"2023-08-10T10:50:41.622383+0000","last_fullsized":"2023-08-10T10:50:41.622383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:57.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622356+0000","last_change":"2023-08-10T10:48:42.585496+0000","last_active":"2023-08-10T10:50:41.622356+0000","last_peered":"2023-08-10T10:50:41.622356+0000","last_clean":"2023-08-10T10:50:41.622356+0000","last_became_active":"2023-08-10T10:48:42.584963+0000","last_became_peered":"2023-08-10T10:48:42.584963+0000","last_unstale":"2023-08-10T10:50:41.622356+0000","last_undegraded":"2023-08-10T10:50:41.622356+0000","last_fullsized":"2023-08-10T10:50:41.622356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:52.754606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.620347+0000","last_change":"2023-08-10T10:48:42.576038+0000","last_active":"2023-08-10T10:50:41.620347+0000","last_peered":"2023-08-10T10:50:41.620347+0000","last_clean":"2023-08-10T10:50:41.620347+0000","last_became_active":"2023-08-10T10:48:42.575660+0000","last_became_peered":"2023-08-10T10:48:42.575660+0000","last_unstale":"2023-08-10T10:50:41.620347+0000","last_undegraded":"2023-08-10T10:50:41.620347+0000","last_fullsized":"2023-08-10T10:50:41.620347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:57.869830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.609383+0000","last_change":"2023-08-10T10:48:42.573855+0000","last_active":"2023-08-10T10:50:41.609383+0000","last_peered":"2023-08-10T10:50:41.609383+0000","last_clean":"2023-08-10T10:50:41.609383+0000","last_became_active":"2023-08-10T10:48:42.573475+0000","last_became_peered":"2023-08-10T10:48:42.573475+0000","last_unstale":"2023-08-10T10:50:41.609383+0000","last_undegraded":"2023-08-10T10:50:41.609383+0000","last_fullsized":"2023-08-10T10:50:41.609383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:19.171470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695765+0000","last_change":"2023-08-10T10:48:46.628005+0000","last_active":"2023-08-10T10:50:13.695765+0000","last_peered":"2023-08-10T10:50:13.695765+0000","last_clean":"2023-08-10T10:50:13.695765+0000","last_became_active":"2023-08-10T10:48:46.627558+0000","last_became_peered":"2023-08-10T10:48:46.627558+0000","last_unstale":"2023-08-10T10:50:13.695765+0000","last_undegraded":"2023-08-10T10:50:13.695765+0000","last_fullsized":"2023-08-10T10:50:13.695765+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:25.084975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"93'14","reported_seq":141,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.815656+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:50:51.815656+0000","last_peered":"2023-08-10T10:50:51.815656+0000","last_clean":"2023-08-10T10:50:51.815656+0000","last_became_active":"2023-08-10T10:48:41.585341+0000","last_became_peered":"2023-08-10T10:48:41.585341+0000","last_unstale":"2023-08-10T10:50:51.815656+0000","last_undegraded":"2023-08-10T10:50:51.815656+0000","last_fullsized":"2023-08-10T10:50:51.815656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:22.340986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613589+0000","last_change":"2023-08-10T10:48:42.580893+0000","last_active":"2023-08-10T10:50:41.613589+0000","last_peered":"2023-08-10T10:50:41.613589+0000","last_clean":"2023-08-10T10:50:41.613589+0000","last_became_active":"2023-08-10T10:48:42.580591+0000","last_became_peered":"2023-08-10T10:48:42.580591+0000","last_unstale":"2023-08-10T10:50:41.613589+0000","last_undegraded":"2023-08-10T10:50:41.613589+0000","last_fullsized":"2023-08-10T10:50:41.613589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:29.317087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769710+0000","last_change":"2023-08-10T10:48:46.635407+0000","last_active":"2023-08-10T10:50:13.769710+0000","last_peered":"2023-08-10T10:50:13.769710+0000","last_clean":"2023-08-10T10:50:13.769710+0000","last_became_active":"2023-08-10T10:48:46.634936+0000","last_became_peered":"2023-08-10T10:48:46.634936+0000","last_unstale":"2023-08-10T10:50:13.769710+0000","last_undegraded":"2023-08-10T10:50:13.769710+0000","last_fullsized":"2023-08-10T10:50:13.769710+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:54:05.307722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.536246+0000","last_change":"2023-08-10T10:48:41.588054+0000","last_active":"2023-08-10T10:50:14.536246+0000","last_peered":"2023-08-10T10:50:14.536246+0000","last_clean":"2023-08-10T10:50:14.536246+0000","last_became_active":"2023-08-10T10:48:41.587764+0000","last_became_peered":"2023-08-10T10:48:41.587764+0000","last_unstale":"2023-08-10T10:50:14.536246+0000","last_undegraded":"2023-08-10T10:50:14.536246+0000","last_fullsized":"2023-08-10T10:50:14.536246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:04:31.407258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621392+0000","last_change":"2023-08-10T10:48:42.581834+0000","last_active":"2023-08-10T10:50:41.621392+0000","last_peered":"2023-08-10T10:50:41.621392+0000","last_clean":"2023-08-10T10:50:41.621392+0000","last_became_active":"2023-08-10T10:48:42.581438+0000","last_became_peered":"2023-08-10T10:48:42.581438+0000","last_unstale":"2023-08-10T10:50:41.621392+0000","last_undegraded":"2023-08-10T10:50:41.621392+0000","last_fullsized":"2023-08-10T10:50:41.621392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:26.141023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769735+0000","last_change":"2023-08-10T10:49:12.737051+0000","last_active":"2023-08-10T10:50:13.769735+0000","last_peered":"2023-08-10T10:50:13.769735+0000","last_clean":"2023-08-10T10:50:13.769735+0000","last_became_active":"2023-08-10T10:49:12.736586+0000","last_became_peered":"2023-08-10T10:49:12.736586+0000","last_unstale":"2023-08-10T10:50:13.769735+0000","last_undegraded":"2023-08-10T10:50:13.769735+0000","last_fullsized":"2023-08-10T10:50:13.769735+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:03.060137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535593+0000","last_change":"2023-08-10T10:49:12.734942+0000","last_active":"2023-08-10T10:50:14.535593+0000","last_peered":"2023-08-10T10:50:14.535593+0000","last_clean":"2023-08-10T10:50:14.535593+0000","last_became_active":"2023-08-10T10:49:12.720078+0000","last_became_peered":"2023-08-10T10:49:12.720078+0000","last_unstale":"2023-08-10T10:50:14.535593+0000","last_undegraded":"2023-08-10T10:50:14.535593+0000","last_fullsized":"2023-08-10T10:50:14.535593+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:20:07.099664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.620117+0000","last_change":"2023-08-10T10:48:42.581222+0000","last_active":"2023-08-10T10:50:41.620117+0000","last_peered":"2023-08-10T10:50:41.620117+0000","last_clean":"2023-08-10T10:50:41.620117+0000","last_became_active":"2023-08-10T10:48:42.580885+0000","last_became_peered":"2023-08-10T10:48:42.580885+0000","last_unstale":"2023-08-10T10:50:41.620117+0000","last_undegraded":"2023-08-10T10:50:41.620117+0000","last_fullsized":"2023-08-10T10:50:41.620117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:16.221857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769667+0000","last_change":"2023-08-10T10:48:46.626985+0000","last_active":"2023-08-10T10:50:13.769667+0000","last_peered":"2023-08-10T10:50:13.769667+0000","last_clean":"2023-08-10T10:50:13.769667+0000","last_became_active":"2023-08-10T10:48:46.626292+0000","last_became_peered":"2023-08-10T10:48:46.626292+0000","last_unstale":"2023-08-10T10:50:13.769667+0000","last_undegraded":"2023-08-10T10:50:13.769667+0000","last_fullsized":"2023-08-10T10:50:13.769667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:51:41.700285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699726+0000","last_change":"2023-08-10T10:48:41.588563+0000","last_active":"2023-08-10T10:50:13.699726+0000","last_peered":"2023-08-10T10:50:13.699726+0000","last_clean":"2023-08-10T10:50:13.699726+0000","last_became_active":"2023-08-10T10:48:41.588250+0000","last_became_peered":"2023-08-10T10:48:41.588250+0000","last_unstale":"2023-08-10T10:50:13.699726+0000","last_undegraded":"2023-08-10T10:50:13.699726+0000","last_fullsized":"2023-08-10T10:50:13.699726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:04.678700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.618719+0000","last_change":"2023-08-10T10:49:12.714641+0000","last_active":"2023-08-10T10:50:41.618719+0000","last_peered":"2023-08-10T10:50:41.618719+0000","last_clean":"2023-08-10T10:50:41.618719+0000","last_became_active":"2023-08-10T10:49:12.714185+0000","last_became_peered":"2023-08-10T10:49:12.714185+0000","last_unstale":"2023-08-10T10:50:41.618719+0000","last_undegraded":"2023-08-10T10:50:41.618719+0000","last_fullsized":"2023-08-10T10:50:41.618719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:59.150048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696244+0000","last_change":"2023-08-10T10:48:46.630641+0000","last_active":"2023-08-10T10:50:13.696244+0000","last_peered":"2023-08-10T10:50:13.696244+0000","last_clean":"2023-08-10T10:50:13.696244+0000","last_became_active":"2023-08-10T10:48:46.630231+0000","last_became_peered":"2023-08-10T10:48:46.630231+0000","last_unstale":"2023-08-10T10:50:13.696244+0000","last_undegraded":"2023-08-10T10:50:13.696244+0000","last_fullsized":"2023-08-10T10:50:13.696244+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:31:33.419951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":141,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:53.792403+0000","last_change":"2023-08-10T10:48:41.586083+0000","last_active":"2023-08-10T10:50:53.792403+0000","last_peered":"2023-08-10T10:50:53.792403+0000","last_clean":"2023-08-10T10:50:53.792403+0000","last_became_active":"2023-08-10T10:48:41.585714+0000","last_became_peered":"2023-08-10T10:48:41.585714+0000","last_unstale":"2023-08-10T10:50:53.792403+0000","last_undegraded":"2023-08-10T10:50:53.792403+0000","last_fullsized":"2023-08-10T10:50:53.792403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:41:40.651578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.606688+0000","last_change":"2023-08-10T10:48:42.578007+0000","last_active":"2023-08-10T10:50:41.606688+0000","last_peered":"2023-08-10T10:50:41.606688+0000","last_clean":"2023-08-10T10:50:41.606688+0000","last_became_active":"2023-08-10T10:48:42.577687+0000","last_became_peered":"2023-08-10T10:48:42.577687+0000","last_unstale":"2023-08-10T10:50:41.606688+0000","last_undegraded":"2023-08-10T10:50:41.606688+0000","last_fullsized":"2023-08-10T10:50:41.606688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:34:45.948119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696195+0000","last_change":"2023-08-10T10:48:46.633618+0000","last_active":"2023-08-10T10:50:13.696195+0000","last_peered":"2023-08-10T10:50:13.696195+0000","last_clean":"2023-08-10T10:50:13.696195+0000","last_became_active":"2023-08-10T10:48:46.633223+0000","last_became_peered":"2023-08-10T10:48:46.633223+0000","last_unstale":"2023-08-10T10:50:13.696195+0000","last_undegraded":"2023-08-10T10:50:13.696195+0000","last_fullsized":"2023-08-10T10:50:13.696195+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:13:53.778786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.718969+0000","last_change":"2023-08-10T10:48:41.591262+0000","last_active":"2023-08-10T10:50:13.718969+0000","last_peered":"2023-08-10T10:50:13.718969+0000","last_clean":"2023-08-10T10:50:13.718969+0000","last_became_active":"2023-08-10T10:48:41.590879+0000","last_became_peered":"2023-08-10T10:48:41.590879+0000","last_unstale":"2023-08-10T10:50:13.718969+0000","last_undegraded":"2023-08-10T10:50:13.718969+0000","last_fullsized":"2023-08-10T10:50:13.718969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:45.414755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.612780+0000","last_change":"2023-08-10T10:48:42.581852+0000","last_active":"2023-08-10T10:50:41.612780+0000","last_peered":"2023-08-10T10:50:41.612780+0000","last_clean":"2023-08-10T10:50:41.612780+0000","last_became_active":"2023-08-10T10:48:42.581516+0000","last_became_peered":"2023-08-10T10:48:42.581516+0000","last_unstale":"2023-08-10T10:50:41.612780+0000","last_undegraded":"2023-08-10T10:50:41.612780+0000","last_fullsized":"2023-08-10T10:50:41.612780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:31.423759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535687+0000","last_change":"2023-08-10T10:48:46.629922+0000","last_active":"2023-08-10T10:50:14.535687+0000","last_peered":"2023-08-10T10:50:14.535687+0000","last_clean":"2023-08-10T10:50:14.535687+0000","last_became_active":"2023-08-10T10:48:46.629079+0000","last_became_peered":"2023-08-10T10:48:46.629079+0000","last_unstale":"2023-08-10T10:50:14.535687+0000","last_undegraded":"2023-08-10T10:50:14.535687+0000","last_fullsized":"2023-08-10T10:50:14.535687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:34.096219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767304+0000","last_change":"2023-08-10T10:48:41.580410+0000","last_active":"2023-08-10T10:50:13.767304+0000","last_peered":"2023-08-10T10:50:13.767304+0000","last_clean":"2023-08-10T10:50:13.767304+0000","last_became_active":"2023-08-10T10:48:41.580032+0000","last_became_peered":"2023-08-10T10:48:41.580032+0000","last_unstale":"2023-08-10T10:50:13.767304+0000","last_undegraded":"2023-08-10T10:50:13.767304+0000","last_fullsized":"2023-08-10T10:50:13.767304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:55:53.357399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613845+0000","last_change":"2023-08-10T10:48:42.582297+0000","last_active":"2023-08-10T10:50:41.613845+0000","last_peered":"2023-08-10T10:50:41.613845+0000","last_clean":"2023-08-10T10:50:41.613845+0000","last_became_active":"2023-08-10T10:48:42.581966+0000","last_became_peered":"2023-08-10T10:48:42.581966+0000","last_unstale":"2023-08-10T10:50:41.613845+0000","last_undegraded":"2023-08-10T10:50:41.613845+0000","last_fullsized":"2023-08-10T10:50:41.613845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:40.949436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.180236+0000","last_change":"2023-08-10T10:48:46.622376+0000","last_active":"2023-08-10T10:50:14.180236+0000","last_peered":"2023-08-10T10:50:14.180236+0000","last_clean":"2023-08-10T10:50:14.180236+0000","last_became_active":"2023-08-10T10:48:46.621872+0000","last_became_peered":"2023-08-10T10:48:46.621872+0000","last_unstale":"2023-08-10T10:50:14.180236+0000","last_undegraded":"2023-08-10T10:50:14.180236+0000","last_fullsized":"2023-08-10T10:50:14.180236+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:09.411007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722298+0000","last_change":"2023-08-10T10:48:41.585309+0000","last_active":"2023-08-10T10:50:13.722298+0000","last_peered":"2023-08-10T10:50:13.722298+0000","last_clean":"2023-08-10T10:50:13.722298+0000","last_became_active":"2023-08-10T10:48:41.585007+0000","last_became_peered":"2023-08-10T10:48:41.585007+0000","last_unstale":"2023-08-10T10:50:13.722298+0000","last_undegraded":"2023-08-10T10:50:13.722298+0000","last_fullsized":"2023-08-10T10:50:13.722298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:27.841219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.611216+0000","last_change":"2023-08-10T10:48:42.575404+0000","last_active":"2023-08-10T10:50:41.611216+0000","last_peered":"2023-08-10T10:50:41.611216+0000","last_clean":"2023-08-10T10:50:41.611216+0000","last_became_active":"2023-08-10T10:48:42.575072+0000","last_became_peered":"2023-08-10T10:48:42.575072+0000","last_unstale":"2023-08-10T10:50:41.611216+0000","last_undegraded":"2023-08-10T10:50:41.611216+0000","last_fullsized":"2023-08-10T10:50:41.611216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:34.330583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535460+0000","last_change":"2023-08-10T10:48:46.627175+0000","last_active":"2023-08-10T10:50:14.535460+0000","last_peered":"2023-08-10T10:50:14.535460+0000","last_clean":"2023-08-10T10:50:14.535460+0000","last_became_active":"2023-08-10T10:48:46.626639+0000","last_became_peered":"2023-08-10T10:48:46.626639+0000","last_unstale":"2023-08-10T10:50:14.535460+0000","last_undegraded":"2023-08-10T10:50:14.535460+0000","last_fullsized":"2023-08-10T10:50:14.535460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:57.748936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"93'6","reported_seq":233,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.789872+0000","last_change":"2023-08-10T10:48:41.585185+0000","last_active":"2023-08-10T10:50:52.789872+0000","last_peered":"2023-08-10T10:50:52.789872+0000","last_clean":"2023-08-10T10:50:52.789872+0000","last_became_active":"2023-08-10T10:48:41.584834+0000","last_became_peered":"2023-08-10T10:48:41.584834+0000","last_unstale":"2023-08-10T10:50:52.789872+0000","last_undegraded":"2023-08-10T10:50:52.789872+0000","last_fullsized":"2023-08-10T10:50:52.789872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:54.728641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":197,"num_read_kb":197,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.619413+0000","last_change":"2023-08-10T10:48:42.574634+0000","last_active":"2023-08-10T10:50:41.619413+0000","last_peered":"2023-08-10T10:50:41.619413+0000","last_clean":"2023-08-10T10:50:41.619413+0000","last_became_active":"2023-08-10T10:48:42.574290+0000","last_became_peered":"2023-08-10T10:48:42.574290+0000","last_unstale":"2023-08-10T10:50:41.619413+0000","last_undegraded":"2023-08-10T10:50:41.619413+0000","last_fullsized":"2023-08-10T10:50:41.619413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:11.236874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695207+0000","last_change":"2023-08-10T10:48:46.627158+0000","last_active":"2023-08-10T10:50:13.695207+0000","last_peered":"2023-08-10T10:50:13.695207+0000","last_clean":"2023-08-10T10:50:13.695207+0000","last_became_active":"2023-08-10T10:48:46.626686+0000","last_became_peered":"2023-08-10T10:48:46.626686+0000","last_unstale":"2023-08-10T10:50:13.695207+0000","last_undegraded":"2023-08-10T10:50:13.695207+0000","last_fullsized":"2023-08-10T10:50:13.695207+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:08:23.207529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696463+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:50:13.696463+0000","last_peered":"2023-08-10T10:50:13.696463+0000","last_clean":"2023-08-10T10:50:13.696463+0000","last_became_active":"2023-08-10T10:48:41.586573+0000","last_became_peered":"2023-08-10T10:48:41.586573+0000","last_unstale":"2023-08-10T10:50:13.696463+0000","last_undegraded":"2023-08-10T10:50:13.696463+0000","last_fullsized":"2023-08-10T10:50:13.696463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:31:32.564891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615637+0000","last_change":"2023-08-10T10:48:42.584454+0000","last_active":"2023-08-10T10:50:41.615637+0000","last_peered":"2023-08-10T10:50:41.615637+0000","last_clean":"2023-08-10T10:50:41.615637+0000","last_became_active":"2023-08-10T10:48:42.584098+0000","last_became_peered":"2023-08-10T10:48:42.584098+0000","last_unstale":"2023-08-10T10:50:41.615637+0000","last_undegraded":"2023-08-10T10:50:41.615637+0000","last_fullsized":"2023-08-10T10:50:41.615637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:32:46.667672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770023+0000","last_change":"2023-08-10T10:48:46.635451+0000","last_active":"2023-08-10T10:50:13.770023+0000","last_peered":"2023-08-10T10:50:13.770023+0000","last_clean":"2023-08-10T10:50:13.770023+0000","last_became_active":"2023-08-10T10:48:46.634768+0000","last_became_peered":"2023-08-10T10:48:46.634768+0000","last_unstale":"2023-08-10T10:50:13.770023+0000","last_undegraded":"2023-08-10T10:50:13.770023+0000","last_fullsized":"2023-08-10T10:50:13.770023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:56:41.981210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722713+0000","last_change":"2023-08-10T10:48:41.586720+0000","last_active":"2023-08-10T10:50:13.722713+0000","last_peered":"2023-08-10T10:50:13.722713+0000","last_clean":"2023-08-10T10:50:13.722713+0000","last_became_active":"2023-08-10T10:48:41.586365+0000","last_became_peered":"2023-08-10T10:48:41.586365+0000","last_unstale":"2023-08-10T10:50:13.722713+0000","last_undegraded":"2023-08-10T10:50:13.722713+0000","last_fullsized":"2023-08-10T10:50:13.722713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:58:16.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.619239+0000","last_change":"2023-08-10T10:49:12.715509+0000","last_active":"2023-08-10T10:50:41.619239+0000","last_peered":"2023-08-10T10:50:41.619239+0000","last_clean":"2023-08-10T10:50:41.619239+0000","last_became_active":"2023-08-10T10:49:12.714785+0000","last_became_peered":"2023-08-10T10:49:12.714785+0000","last_unstale":"2023-08-10T10:50:41.619239+0000","last_undegraded":"2023-08-10T10:50:41.619239+0000","last_fullsized":"2023-08-10T10:50:41.619239+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:26.400386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695336+0000","last_change":"2023-08-10T10:48:46.630613+0000","last_active":"2023-08-10T10:50:13.695336+0000","last_peered":"2023-08-10T10:50:13.695336+0000","last_clean":"2023-08-10T10:50:13.695336+0000","last_became_active":"2023-08-10T10:48:46.630152+0000","last_became_peered":"2023-08-10T10:48:46.630152+0000","last_unstale":"2023-08-10T10:50:13.695336+0000","last_undegraded":"2023-08-10T10:50:13.695336+0000","last_fullsized":"2023-08-10T10:50:13.695336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:39.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'38","reported_seq":278,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.800789+0000","last_change":"2023-08-10T10:48:41.583291+0000","last_active":"2023-08-10T10:50:52.800789+0000","last_peered":"2023-08-10T10:50:52.800789+0000","last_clean":"2023-08-10T10:50:52.800789+0000","last_became_active":"2023-08-10T10:48:41.582894+0000","last_became_peered":"2023-08-10T10:48:41.582894+0000","last_unstale":"2023-08-10T10:50:52.800789+0000","last_undegraded":"2023-08-10T10:50:52.800789+0000","last_fullsized":"2023-08-10T10:50:52.800789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:56:24.559908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60540,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":210,"num_read_kb":164,"num_write":40,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.606334+0000","last_change":"2023-08-10T10:48:42.582097+0000","last_active":"2023-08-10T10:50:41.606334+0000","last_peered":"2023-08-10T10:50:41.606334+0000","last_clean":"2023-08-10T10:50:41.606334+0000","last_became_active":"2023-08-10T10:48:42.581622+0000","last_became_peered":"2023-08-10T10:48:42.581622+0000","last_unstale":"2023-08-10T10:50:41.606334+0000","last_undegraded":"2023-08-10T10:50:41.606334+0000","last_fullsized":"2023-08-10T10:50:41.606334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:46:01.211831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.723017+0000","last_change":"2023-08-10T10:48:46.628850+0000","last_active":"2023-08-10T10:50:13.723017+0000","last_peered":"2023-08-10T10:50:13.723017+0000","last_clean":"2023-08-10T10:50:13.723017+0000","last_became_active":"2023-08-10T10:48:46.628060+0000","last_became_peered":"2023-08-10T10:48:46.628060+0000","last_unstale":"2023-08-10T10:50:13.723017+0000","last_undegraded":"2023-08-10T10:50:13.723017+0000","last_fullsized":"2023-08-10T10:50:13.723017+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:54:47.710911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535364+0000","last_change":"2023-08-10T10:49:12.726708+0000","last_active":"2023-08-10T10:50:14.535364+0000","last_peered":"2023-08-10T10:50:14.535364+0000","last_clean":"2023-08-10T10:50:14.535364+0000","last_became_active":"2023-08-10T10:49:12.718963+0000","last_became_peered":"2023-08-10T10:49:12.718963+0000","last_unstale":"2023-08-10T10:50:14.535364+0000","last_undegraded":"2023-08-10T10:50:14.535364+0000","last_fullsized":"2023-08-10T10:50:14.535364+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:38.518813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.605808+0000","last_change":"2023-08-10T10:48:42.583174+0000","last_active":"2023-08-10T10:50:41.605808+0000","last_peered":"2023-08-10T10:50:41.605808+0000","last_clean":"2023-08-10T10:50:41.605808+0000","last_became_active":"2023-08-10T10:48:42.582869+0000","last_became_peered":"2023-08-10T10:48:42.582869+0000","last_unstale":"2023-08-10T10:50:41.605808+0000","last_undegraded":"2023-08-10T10:50:41.605808+0000","last_fullsized":"2023-08-10T10:50:41.605808+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:46:02.898669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535356+0000","last_change":"2023-08-10T10:48:46.629285+0000","last_active":"2023-08-10T10:50:14.535356+0000","last_peered":"2023-08-10T10:50:14.535356+0000","last_clean":"2023-08-10T10:50:14.535356+0000","last_became_active":"2023-08-10T10:48:46.628849+0000","last_became_peered":"2023-08-10T10:48:46.628849+0000","last_unstale":"2023-08-10T10:50:14.535356+0000","last_undegraded":"2023-08-10T10:50:14.535356+0000","last_fullsized":"2023-08-10T10:50:14.535356+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:54:42.082131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722598+0000","last_change":"2023-08-10T10:48:41.592802+0000","last_active":"2023-08-10T10:50:13.722598+0000","last_peered":"2023-08-10T10:50:13.722598+0000","last_clean":"2023-08-10T10:50:13.722598+0000","last_became_active":"2023-08-10T10:48:41.592443+0000","last_became_peered":"2023-08-10T10:48:41.592443+0000","last_unstale":"2023-08-10T10:50:13.722598+0000","last_undegraded":"2023-08-10T10:50:13.722598+0000","last_fullsized":"2023-08-10T10:50:13.722598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:45:13.131927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.618929+0000","last_change":"2023-08-10T10:48:42.586447+0000","last_active":"2023-08-10T10:50:41.618929+0000","last_peered":"2023-08-10T10:50:41.618929+0000","last_clean":"2023-08-10T10:50:41.618929+0000","last_became_active":"2023-08-10T10:48:42.586138+0000","last_became_peered":"2023-08-10T10:48:42.586138+0000","last_unstale":"2023-08-10T10:50:41.618929+0000","last_undegraded":"2023-08-10T10:50:41.618929+0000","last_fullsized":"2023-08-10T10:50:41.618929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:07:42.241288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699973+0000","last_change":"2023-08-10T10:49:12.732915+0000","last_active":"2023-08-10T10:50:13.699973+0000","last_peered":"2023-08-10T10:50:13.699973+0000","last_clean":"2023-08-10T10:50:13.699973+0000","last_became_active":"2023-08-10T10:49:12.732428+0000","last_became_peered":"2023-08-10T10:49:12.732428+0000","last_unstale":"2023-08-10T10:50:13.699973+0000","last_undegraded":"2023-08-10T10:50:13.699973+0000","last_fullsized":"2023-08-10T10:50:13.699973+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:35.093865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"93'8","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.824763+0000","last_change":"2023-08-10T10:48:41.588502+0000","last_active":"2023-08-10T10:50:51.824763+0000","last_peered":"2023-08-10T10:50:51.824763+0000","last_clean":"2023-08-10T10:50:51.824763+0000","last_became_active":"2023-08-10T10:48:41.588155+0000","last_became_peered":"2023-08-10T10:48:41.588155+0000","last_unstale":"2023-08-10T10:50:51.824763+0000","last_undegraded":"2023-08-10T10:50:51.824763+0000","last_fullsized":"2023-08-10T10:50:51.824763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:11:09.373862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.618396+0000","last_change":"2023-08-10T10:48:42.578175+0000","last_active":"2023-08-10T10:50:41.618396+0000","last_peered":"2023-08-10T10:50:41.618396+0000","last_clean":"2023-08-10T10:50:41.618396+0000","last_became_active":"2023-08-10T10:48:42.577873+0000","last_became_peered":"2023-08-10T10:48:42.577873+0000","last_unstale":"2023-08-10T10:50:41.618396+0000","last_undegraded":"2023-08-10T10:50:41.618396+0000","last_fullsized":"2023-08-10T10:50:41.618396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:06:36.648519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767792+0000","last_change":"2023-08-10T10:49:12.719745+0000","last_active":"2023-08-10T10:50:13.767792+0000","last_peered":"2023-08-10T10:50:13.767792+0000","last_clean":"2023-08-10T10:50:13.767792+0000","last_became_active":"2023-08-10T10:49:12.719289+0000","last_became_peered":"2023-08-10T10:49:12.719289+0000","last_unstale":"2023-08-10T10:50:13.767792+0000","last_undegraded":"2023-08-10T10:50:13.767792+0000","last_fullsized":"2023-08-10T10:50:13.767792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:36.231582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699447+0000","last_change":"2023-08-10T10:48:41.594170+0000","last_active":"2023-08-10T10:50:13.699447+0000","last_peered":"2023-08-10T10:50:13.699447+0000","last_clean":"2023-08-10T10:50:13.699447+0000","last_became_active":"2023-08-10T10:48:41.593776+0000","last_became_peered":"2023-08-10T10:48:41.593776+0000","last_unstale":"2023-08-10T10:50:13.699447+0000","last_undegraded":"2023-08-10T10:50:13.699447+0000","last_fullsized":"2023-08-10T10:50:13.699447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:25:31.902019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621126+0000","last_change":"2023-08-10T10:48:42.589149+0000","last_active":"2023-08-10T10:50:41.621126+0000","last_peered":"2023-08-10T10:50:41.621126+0000","last_clean":"2023-08-10T10:50:41.621126+0000","last_became_active":"2023-08-10T10:48:42.588466+0000","last_became_peered":"2023-08-10T10:48:42.588466+0000","last_unstale":"2023-08-10T10:50:41.621126+0000","last_undegraded":"2023-08-10T10:50:41.621126+0000","last_fullsized":"2023-08-10T10:50:41.621126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:04:40.741096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.537728+0000","last_change":"2023-08-10T10:50:14.537293+0000","last_active":"2023-08-10T10:50:14.537728+0000","last_peered":"2023-08-10T10:50:14.537728+0000","last_clean":"2023-08-10T10:50:14.537728+0000","last_became_active":"2023-08-10T10:50:14.536816+0000","last_became_peered":"2023-08-10T10:50:14.536816+0000","last_unstale":"2023-08-10T10:50:14.537728+0000","last_undegraded":"2023-08-10T10:50:14.537728+0000","last_fullsized":"2023-08-10T10:50:14.537728+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:00:10.839229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.f","version":"93'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.665863+0000","last_change":"2023-08-10T10:48:41.590670+0000","last_active":"2023-08-10T10:50:52.665863+0000","last_peered":"2023-08-10T10:50:52.665863+0000","last_clean":"2023-08-10T10:50:52.665863+0000","last_became_active":"2023-08-10T10:48:41.589958+0000","last_became_peered":"2023-08-10T10:48:41.589958+0000","last_unstale":"2023-08-10T10:50:52.665863+0000","last_undegraded":"2023-08-10T10:50:52.665863+0000","last_fullsized":"2023-08-10T10:50:52.665863+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:36:57.008276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.606741+0000","last_change":"2023-08-10T10:48:42.581041+0000","last_active":"2023-08-10T10:50:41.606741+0000","last_peered":"2023-08-10T10:50:41.606741+0000","last_clean":"2023-08-10T10:50:41.606741+0000","last_became_active":"2023-08-10T10:48:42.580311+0000","last_became_peered":"2023-08-10T10:48:42.580311+0000","last_unstale":"2023-08-10T10:50:41.606741+0000","last_undegraded":"2023-08-10T10:50:41.606741+0000","last_fullsized":"2023-08-10T10:50:41.606741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:22.659342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699796+0000","last_change":"2023-08-10T10:48:46.907496+0000","last_active":"2023-08-10T10:50:13.699796+0000","last_peered":"2023-08-10T10:50:13.699796+0000","last_clean":"2023-08-10T10:50:13.699796+0000","last_became_active":"2023-08-10T10:48:46.907098+0000","last_became_peered":"2023-08-10T10:48:46.907098+0000","last_unstale":"2023-08-10T10:50:13.699796+0000","last_undegraded":"2023-08-10T10:50:13.699796+0000","last_fullsized":"2023-08-10T10:50:13.699796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:22:26.606996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695728+0000","last_change":"2023-08-10T10:48:41.585252+0000","last_active":"2023-08-10T10:50:13.695728+0000","last_peered":"2023-08-10T10:50:13.695728+0000","last_clean":"2023-08-10T10:50:13.695728+0000","last_became_active":"2023-08-10T10:48:41.583599+0000","last_became_peered":"2023-08-10T10:48:41.583599+0000","last_unstale":"2023-08-10T10:50:13.695728+0000","last_undegraded":"2023-08-10T10:50:13.695728+0000","last_fullsized":"2023-08-10T10:50:13.695728+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:50.051408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616656+0000","last_change":"2023-08-10T10:48:42.581317+0000","last_active":"2023-08-10T10:50:41.616656+0000","last_peered":"2023-08-10T10:50:41.616656+0000","last_clean":"2023-08-10T10:50:41.616656+0000","last_became_active":"2023-08-10T10:48:42.581012+0000","last_became_peered":"2023-08-10T10:48:42.581012+0000","last_unstale":"2023-08-10T10:50:41.616656+0000","last_undegraded":"2023-08-10T10:50:41.616656+0000","last_fullsized":"2023-08-10T10:50:41.616656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:28.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767680+0000","last_change":"2023-08-10T10:48:46.623489+0000","last_active":"2023-08-10T10:50:13.767680+0000","last_peered":"2023-08-10T10:50:13.767680+0000","last_clean":"2023-08-10T10:50:13.767680+0000","last_became_active":"2023-08-10T10:48:46.621968+0000","last_became_peered":"2023-08-10T10:48:46.621968+0000","last_unstale":"2023-08-10T10:50:13.767680+0000","last_undegraded":"2023-08-10T10:50:13.767680+0000","last_fullsized":"2023-08-10T10:50:13.767680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:57.091076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.819141+0000","last_change":"2023-08-10T10:48:41.579828+0000","last_active":"2023-08-10T10:50:52.819141+0000","last_peered":"2023-08-10T10:50:52.819141+0000","last_clean":"2023-08-10T10:50:52.819141+0000","last_became_active":"2023-08-10T10:48:41.579340+0000","last_became_peered":"2023-08-10T10:48:41.579340+0000","last_unstale":"2023-08-10T10:50:52.819141+0000","last_undegraded":"2023-08-10T10:50:52.819141+0000","last_fullsized":"2023-08-10T10:50:52.819141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:35:32.747605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1023,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617106+0000","last_change":"2023-08-10T10:49:12.733771+0000","last_active":"2023-08-10T10:50:41.617106+0000","last_peered":"2023-08-10T10:50:41.617106+0000","last_clean":"2023-08-10T10:50:41.617106+0000","last_became_active":"2023-08-10T10:49:12.733357+0000","last_became_peered":"2023-08-10T10:49:12.733357+0000","last_unstale":"2023-08-10T10:50:41.617106+0000","last_undegraded":"2023-08-10T10:50:41.617106+0000","last_fullsized":"2023-08-10T10:50:41.617106+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:26.666048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767683+0000","last_change":"2023-08-10T10:48:46.907982+0000","last_active":"2023-08-10T10:50:13.767683+0000","last_peered":"2023-08-10T10:50:13.767683+0000","last_clean":"2023-08-10T10:50:13.767683+0000","last_became_active":"2023-08-10T10:48:46.907184+0000","last_became_peered":"2023-08-10T10:48:46.907184+0000","last_unstale":"2023-08-10T10:50:13.767683+0000","last_undegraded":"2023-08-10T10:50:13.767683+0000","last_fullsized":"2023-08-10T10:50:13.767683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:37:44.678304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616051+0000","last_change":"2023-08-10T10:48:42.582808+0000","last_active":"2023-08-10T10:50:41.616051+0000","last_peered":"2023-08-10T10:50:41.616051+0000","last_clean":"2023-08-10T10:50:41.616051+0000","last_became_active":"2023-08-10T10:48:42.582517+0000","last_became_peered":"2023-08-10T10:48:42.582517+0000","last_unstale":"2023-08-10T10:50:41.616051+0000","last_undegraded":"2023-08-10T10:50:41.616051+0000","last_fullsized":"2023-08-10T10:50:41.616051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:48:51.550019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'6","reported_seq":139,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:55.829768+0000","last_change":"2023-08-10T10:48:41.594873+0000","last_active":"2023-08-10T10:50:55.829768+0000","last_peered":"2023-08-10T10:50:55.829768+0000","last_clean":"2023-08-10T10:50:55.829768+0000","last_became_active":"2023-08-10T10:48:41.594550+0000","last_became_peered":"2023-08-10T10:48:41.594550+0000","last_unstale":"2023-08-10T10:50:55.829768+0000","last_undegraded":"2023-08-10T10:50:55.829768+0000","last_fullsized":"2023-08-10T10:50:55.829768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:03:31.289927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696533+0000","last_change":"2023-08-10T10:48:46.626960+0000","last_active":"2023-08-10T10:50:13.696533+0000","last_peered":"2023-08-10T10:50:13.696533+0000","last_clean":"2023-08-10T10:50:13.696533+0000","last_became_active":"2023-08-10T10:48:46.626519+0000","last_became_peered":"2023-08-10T10:48:46.626519+0000","last_unstale":"2023-08-10T10:50:13.696533+0000","last_undegraded":"2023-08-10T10:50:13.696533+0000","last_fullsized":"2023-08-10T10:50:13.696533+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:10:15.398639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.620791+0000","last_change":"2023-08-10T10:48:42.578921+0000","last_active":"2023-08-10T10:50:41.620791+0000","last_peered":"2023-08-10T10:50:41.620791+0000","last_clean":"2023-08-10T10:50:41.620791+0000","last_became_active":"2023-08-10T10:48:42.578322+0000","last_became_peered":"2023-08-10T10:48:42.578322+0000","last_unstale":"2023-08-10T10:50:41.620791+0000","last_undegraded":"2023-08-10T10:50:41.620791+0000","last_fullsized":"2023-08-10T10:50:41.620791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:30.672144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770099+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:50:13.770099+0000","last_peered":"2023-08-10T10:50:13.770099+0000","last_clean":"2023-08-10T10:50:13.770099+0000","last_became_active":"2023-08-10T10:48:41.585217+0000","last_became_peered":"2023-08-10T10:48:41.585217+0000","last_unstale":"2023-08-10T10:50:13.770099+0000","last_undegraded":"2023-08-10T10:50:13.770099+0000","last_fullsized":"2023-08-10T10:50:13.770099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:08.790470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":362,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695907+0000","last_change":"2023-08-10T10:47:22.594211+0000","last_active":"2023-08-10T10:50:13.695907+0000","last_peered":"2023-08-10T10:50:13.695907+0000","last_clean":"2023-08-10T10:50:13.695907+0000","last_became_active":"2023-08-10T10:47:22.593742+0000","last_became_peered":"2023-08-10T10:47:22.593742+0000","last_unstale":"2023-08-10T10:50:13.695907+0000","last_undegraded":"2023-08-10T10:50:13.695907+0000","last_fullsized":"2023-08-10T10:50:13.695907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_clean_scrub_stamp":"2023-08-10T10:43:44.512037+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:36.018260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722905+0000","last_change":"2023-08-10T10:48:46.907769+0000","last_active":"2023-08-10T10:50:13.722905+0000","last_peered":"2023-08-10T10:50:13.722905+0000","last_clean":"2023-08-10T10:50:13.722905+0000","last_became_active":"2023-08-10T10:48:46.907241+0000","last_became_peered":"2023-08-10T10:48:46.907241+0000","last_unstale":"2023-08-10T10:50:13.722905+0000","last_undegraded":"2023-08-10T10:50:13.722905+0000","last_fullsized":"2023-08-10T10:50:13.722905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:45:20.554540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.604493+0000","last_change":"2023-08-10T10:48:42.587277+0000","last_active":"2023-08-10T10:50:41.604493+0000","last_peered":"2023-08-10T10:50:41.604493+0000","last_clean":"2023-08-10T10:50:41.604493+0000","last_became_active":"2023-08-10T10:48:42.586308+0000","last_became_peered":"2023-08-10T10:48:42.586308+0000","last_unstale":"2023-08-10T10:50:41.604493+0000","last_undegraded":"2023-08-10T10:50:41.604493+0000","last_fullsized":"2023-08-10T10:50:41.604493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:30:31.610095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696125+0000","last_change":"2023-08-10T10:48:41.587116+0000","last_active":"2023-08-10T10:50:13.696125+0000","last_peered":"2023-08-10T10:50:13.696125+0000","last_clean":"2023-08-10T10:50:13.696125+0000","last_became_active":"2023-08-10T10:48:41.586771+0000","last_became_peered":"2023-08-10T10:48:41.586771+0000","last_unstale":"2023-08-10T10:50:13.696125+0000","last_undegraded":"2023-08-10T10:50:13.696125+0000","last_fullsized":"2023-08-10T10:50:13.696125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:31.434737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535389+0000","last_change":"2023-08-10T10:48:46.625140+0000","last_active":"2023-08-10T10:50:14.535389+0000","last_peered":"2023-08-10T10:50:14.535389+0000","last_clean":"2023-08-10T10:50:14.535389+0000","last_became_active":"2023-08-10T10:48:46.624615+0000","last_became_peered":"2023-08-10T10:48:46.624615+0000","last_unstale":"2023-08-10T10:50:14.535389+0000","last_undegraded":"2023-08-10T10:50:14.535389+0000","last_fullsized":"2023-08-10T10:50:14.535389+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:08:05.843613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.700103+0000","last_change":"2023-08-10T10:48:41.589435+0000","last_active":"2023-08-10T10:50:13.700103+0000","last_peered":"2023-08-10T10:50:13.700103+0000","last_clean":"2023-08-10T10:50:13.700103+0000","last_became_active":"2023-08-10T10:48:41.589070+0000","last_became_peered":"2023-08-10T10:48:41.589070+0000","last_unstale":"2023-08-10T10:50:13.700103+0000","last_undegraded":"2023-08-10T10:50:13.700103+0000","last_fullsized":"2023-08-10T10:50:13.700103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:43:40.722261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.612864+0000","last_change":"2023-08-10T10:48:42.586352+0000","last_active":"2023-08-10T10:50:41.612864+0000","last_peered":"2023-08-10T10:50:41.612864+0000","last_clean":"2023-08-10T10:50:41.612864+0000","last_became_active":"2023-08-10T10:48:42.585955+0000","last_became_peered":"2023-08-10T10:48:42.585955+0000","last_unstale":"2023-08-10T10:50:41.612864+0000","last_undegraded":"2023-08-10T10:50:41.612864+0000","last_fullsized":"2023-08-10T10:50:41.612864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:39:33.549404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.534826+0000","last_change":"2023-08-10T10:48:46.907519+0000","last_active":"2023-08-10T10:50:14.534826+0000","last_peered":"2023-08-10T10:50:14.534826+0000","last_clean":"2023-08-10T10:50:14.534826+0000","last_became_active":"2023-08-10T10:48:46.907087+0000","last_became_peered":"2023-08-10T10:48:46.907087+0000","last_unstale":"2023-08-10T10:50:14.534826+0000","last_undegraded":"2023-08-10T10:50:14.534826+0000","last_fullsized":"2023-08-10T10:50:14.534826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:32.544474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.917019+0000","last_change":"2023-08-10T10:48:41.583746+0000","last_active":"2023-08-10T10:50:51.917019+0000","last_peered":"2023-08-10T10:50:51.917019+0000","last_clean":"2023-08-10T10:50:51.917019+0000","last_became_active":"2023-08-10T10:48:41.583321+0000","last_became_peered":"2023-08-10T10:48:41.583321+0000","last_unstale":"2023-08-10T10:50:51.917019+0000","last_undegraded":"2023-08-10T10:50:51.917019+0000","last_fullsized":"2023-08-10T10:50:51.917019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:55:33.137575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616495+0000","last_change":"2023-08-10T10:48:42.579942+0000","last_active":"2023-08-10T10:50:41.616495+0000","last_peered":"2023-08-10T10:50:41.616495+0000","last_clean":"2023-08-10T10:50:41.616495+0000","last_became_active":"2023-08-10T10:48:42.579561+0000","last_became_peered":"2023-08-10T10:48:42.579561+0000","last_unstale":"2023-08-10T10:50:41.616495+0000","last_undegraded":"2023-08-10T10:50:41.616495+0000","last_fullsized":"2023-08-10T10:50:41.616495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:58.430924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695861+0000","last_change":"2023-08-10T10:48:46.621499+0000","last_active":"2023-08-10T10:50:13.695861+0000","last_peered":"2023-08-10T10:50:13.695861+0000","last_clean":"2023-08-10T10:50:13.695861+0000","last_became_active":"2023-08-10T10:48:46.621076+0000","last_became_peered":"2023-08-10T10:48:46.621076+0000","last_unstale":"2023-08-10T10:50:13.695861+0000","last_undegraded":"2023-08-10T10:50:13.695861+0000","last_fullsized":"2023-08-10T10:50:13.695861+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:56.077491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770338+0000","last_change":"2023-08-10T10:48:41.585574+0000","last_active":"2023-08-10T10:50:13.770338+0000","last_peered":"2023-08-10T10:50:13.770338+0000","last_clean":"2023-08-10T10:50:13.770338+0000","last_became_active":"2023-08-10T10:48:41.585254+0000","last_became_peered":"2023-08-10T10:48:41.585254+0000","last_unstale":"2023-08-10T10:50:13.770338+0000","last_undegraded":"2023-08-10T10:50:13.770338+0000","last_fullsized":"2023-08-10T10:50:13.770338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:01.410863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615467+0000","last_change":"2023-08-10T10:48:42.584003+0000","last_active":"2023-08-10T10:50:41.615467+0000","last_peered":"2023-08-10T10:50:41.615467+0000","last_clean":"2023-08-10T10:50:41.615467+0000","last_became_active":"2023-08-10T10:48:42.583712+0000","last_became_peered":"2023-08-10T10:48:42.583712+0000","last_unstale":"2023-08-10T10:50:41.615467+0000","last_undegraded":"2023-08-10T10:50:41.615467+0000","last_fullsized":"2023-08-10T10:50:41.615467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:38:56.521128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770153+0000","last_change":"2023-08-10T10:48:46.908113+0000","last_active":"2023-08-10T10:50:13.770153+0000","last_peered":"2023-08-10T10:50:13.770153+0000","last_clean":"2023-08-10T10:50:13.770153+0000","last_became_active":"2023-08-10T10:48:46.907552+0000","last_became_peered":"2023-08-10T10:48:46.907552+0000","last_unstale":"2023-08-10T10:50:13.770153+0000","last_undegraded":"2023-08-10T10:50:13.770153+0000","last_fullsized":"2023-08-10T10:50:13.770153+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:59.307817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.012760+0000","last_change":"2023-08-10T10:48:41.584254+0000","last_active":"2023-08-10T10:50:14.012760+0000","last_peered":"2023-08-10T10:50:14.012760+0000","last_clean":"2023-08-10T10:50:14.012760+0000","last_became_active":"2023-08-10T10:48:41.583129+0000","last_became_peered":"2023-08-10T10:48:41.583129+0000","last_unstale":"2023-08-10T10:50:14.012760+0000","last_undegraded":"2023-08-10T10:50:14.012760+0000","last_fullsized":"2023-08-10T10:50:14.012760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:23.152095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.598754+0000","last_change":"2023-08-10T10:48:42.582264+0000","last_active":"2023-08-10T10:50:41.598754+0000","last_peered":"2023-08-10T10:50:41.598754+0000","last_clean":"2023-08-10T10:50:41.598754+0000","last_became_active":"2023-08-10T10:48:42.581542+0000","last_became_peered":"2023-08-10T10:48:42.581542+0000","last_unstale":"2023-08-10T10:50:41.598754+0000","last_undegraded":"2023-08-10T10:50:41.598754+0000","last_fullsized":"2023-08-10T10:50:41.598754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:21.881081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695569+0000","last_change":"2023-08-10T10:48:46.632019+0000","last_active":"2023-08-10T10:50:13.695569+0000","last_peered":"2023-08-10T10:50:13.695569+0000","last_clean":"2023-08-10T10:50:13.695569+0000","last_became_active":"2023-08-10T10:48:46.631510+0000","last_became_peered":"2023-08-10T10:48:46.631510+0000","last_unstale":"2023-08-10T10:50:13.695569+0000","last_undegraded":"2023-08-10T10:50:13.695569+0000","last_fullsized":"2023-08-10T10:50:13.695569+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:42.173606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535166+0000","last_change":"2023-08-10T10:48:41.591206+0000","last_active":"2023-08-10T10:50:14.535166+0000","last_peered":"2023-08-10T10:50:14.535166+0000","last_clean":"2023-08-10T10:50:14.535166+0000","last_became_active":"2023-08-10T10:48:41.590897+0000","last_became_peered":"2023-08-10T10:48:41.590897+0000","last_unstale":"2023-08-10T10:50:14.535166+0000","last_undegraded":"2023-08-10T10:50:14.535166+0000","last_fullsized":"2023-08-10T10:50:14.535166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:47.099891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.612127+0000","last_change":"2023-08-10T10:48:42.586470+0000","last_active":"2023-08-10T10:50:41.612127+0000","last_peered":"2023-08-10T10:50:41.612127+0000","last_clean":"2023-08-10T10:50:41.612127+0000","last_became_active":"2023-08-10T10:48:42.586109+0000","last_became_peered":"2023-08-10T10:48:42.586109+0000","last_unstale":"2023-08-10T10:50:41.612127+0000","last_undegraded":"2023-08-10T10:50:41.612127+0000","last_fullsized":"2023-08-10T10:50:41.612127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:02.527807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769837+0000","last_change":"2023-08-10T10:48:46.629886+0000","last_active":"2023-08-10T10:50:13.769837+0000","last_peered":"2023-08-10T10:50:13.769837+0000","last_clean":"2023-08-10T10:50:13.769837+0000","last_became_active":"2023-08-10T10:48:46.629403+0000","last_became_peered":"2023-08-10T10:48:46.629403+0000","last_unstale":"2023-08-10T10:50:13.769837+0000","last_undegraded":"2023-08-10T10:50:13.769837+0000","last_fullsized":"2023-08-10T10:50:13.769837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:13.690617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"93'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.357181+0000","last_change":"2023-08-10T10:48:41.593231+0000","last_active":"2023-08-10T10:50:52.357181+0000","last_peered":"2023-08-10T10:50:52.357181+0000","last_clean":"2023-08-10T10:50:52.357181+0000","last_became_active":"2023-08-10T10:48:41.592893+0000","last_became_peered":"2023-08-10T10:48:41.592893+0000","last_unstale":"2023-08-10T10:50:52.357181+0000","last_undegraded":"2023-08-10T10:50:52.357181+0000","last_fullsized":"2023-08-10T10:50:52.357181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:37:49.643933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.611175+0000","last_change":"2023-08-10T10:49:12.732774+0000","last_active":"2023-08-10T10:50:41.611175+0000","last_peered":"2023-08-10T10:50:41.611175+0000","last_clean":"2023-08-10T10:50:41.611175+0000","last_became_active":"2023-08-10T10:49:12.732277+0000","last_became_peered":"2023-08-10T10:49:12.732277+0000","last_unstale":"2023-08-10T10:50:41.611175+0000","last_undegraded":"2023-08-10T10:50:41.611175+0000","last_fullsized":"2023-08-10T10:50:41.611175+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:43:48.144206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770033+0000","last_change":"2023-08-10T10:48:46.908347+0000","last_active":"2023-08-10T10:50:13.770033+0000","last_peered":"2023-08-10T10:50:13.770033+0000","last_clean":"2023-08-10T10:50:13.770033+0000","last_became_active":"2023-08-10T10:48:46.907266+0000","last_became_peered":"2023-08-10T10:48:46.907266+0000","last_unstale":"2023-08-10T10:50:13.770033+0000","last_undegraded":"2023-08-10T10:50:13.770033+0000","last_fullsized":"2023-08-10T10:50:13.770033+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:39:11.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699637+0000","last_change":"2023-08-10T10:48:41.585055+0000","last_active":"2023-08-10T10:50:13.699637+0000","last_peered":"2023-08-10T10:50:13.699637+0000","last_clean":"2023-08-10T10:50:13.699637+0000","last_became_active":"2023-08-10T10:48:41.584676+0000","last_became_peered":"2023-08-10T10:48:41.584676+0000","last_unstale":"2023-08-10T10:50:13.699637+0000","last_undegraded":"2023-08-10T10:50:13.699637+0000","last_fullsized":"2023-08-10T10:50:13.699637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:20.879455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622529+0000","last_change":"2023-08-10T10:48:42.586764+0000","last_active":"2023-08-10T10:50:41.622529+0000","last_peered":"2023-08-10T10:50:41.622529+0000","last_clean":"2023-08-10T10:50:41.622529+0000","last_became_active":"2023-08-10T10:48:42.586177+0000","last_became_peered":"2023-08-10T10:48:42.586177+0000","last_unstale":"2023-08-10T10:50:41.622529+0000","last_undegraded":"2023-08-10T10:50:41.622529+0000","last_fullsized":"2023-08-10T10:50:41.622529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:36.400611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.012662+0000","last_change":"2023-08-10T10:48:46.626872+0000","last_active":"2023-08-10T10:50:14.012662+0000","last_peered":"2023-08-10T10:50:14.012662+0000","last_clean":"2023-08-10T10:50:14.012662+0000","last_became_active":"2023-08-10T10:48:46.626354+0000","last_became_peered":"2023-08-10T10:48:46.626354+0000","last_unstale":"2023-08-10T10:50:14.012662+0000","last_undegraded":"2023-08-10T10:50:14.012662+0000","last_fullsized":"2023-08-10T10:50:14.012662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:24:11.803864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"93'8","reported_seq":139,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.853543+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:50:51.853543+0000","last_peered":"2023-08-10T10:50:51.853543+0000","last_clean":"2023-08-10T10:50:51.853543+0000","last_became_active":"2023-08-10T10:48:41.586311+0000","last_became_peered":"2023-08-10T10:48:41.586311+0000","last_unstale":"2023-08-10T10:50:51.853543+0000","last_undegraded":"2023-08-10T10:50:51.853543+0000","last_fullsized":"2023-08-10T10:50:51.853543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.700845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2136,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622108+0000","last_change":"2023-08-10T10:48:42.577290+0000","last_active":"2023-08-10T10:50:41.622108+0000","last_peered":"2023-08-10T10:50:41.622108+0000","last_clean":"2023-08-10T10:50:41.622108+0000","last_became_active":"2023-08-10T10:48:42.576928+0000","last_became_peered":"2023-08-10T10:48:42.576928+0000","last_unstale":"2023-08-10T10:50:41.622108+0000","last_undegraded":"2023-08-10T10:50:41.622108+0000","last_fullsized":"2023-08-10T10:50:41.622108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:22:30.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.179915+0000","last_change":"2023-08-10T10:48:46.627842+0000","last_active":"2023-08-10T10:50:14.179915+0000","last_peered":"2023-08-10T10:50:14.179915+0000","last_clean":"2023-08-10T10:50:14.179915+0000","last_became_active":"2023-08-10T10:48:46.627472+0000","last_became_peered":"2023-08-10T10:48:46.627472+0000","last_unstale":"2023-08-10T10:50:14.179915+0000","last_undegraded":"2023-08-10T10:50:14.179915+0000","last_fullsized":"2023-08-10T10:50:14.179915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:06:48.140390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722566+0000","last_change":"2023-08-10T10:48:41.592742+0000","last_active":"2023-08-10T10:50:13.722566+0000","last_peered":"2023-08-10T10:50:13.722566+0000","last_clean":"2023-08-10T10:50:13.722566+0000","last_became_active":"2023-08-10T10:48:41.592409+0000","last_became_peered":"2023-08-10T10:48:41.592409+0000","last_unstale":"2023-08-10T10:50:13.722566+0000","last_undegraded":"2023-08-10T10:50:13.722566+0000","last_fullsized":"2023-08-10T10:50:13.722566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:07:28.885109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613982+0000","last_change":"2023-08-10T10:48:42.583444+0000","last_active":"2023-08-10T10:50:41.613982+0000","last_peered":"2023-08-10T10:50:41.613982+0000","last_clean":"2023-08-10T10:50:41.613982+0000","last_became_active":"2023-08-10T10:48:42.583073+0000","last_became_peered":"2023-08-10T10:48:42.583073+0000","last_unstale":"2023-08-10T10:50:41.613982+0000","last_undegraded":"2023-08-10T10:50:41.613982+0000","last_fullsized":"2023-08-10T10:50:41.613982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:23:10.749501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722087+0000","last_change":"2023-08-10T10:48:46.626340+0000","last_active":"2023-08-10T10:50:13.722087+0000","last_peered":"2023-08-10T10:50:13.722087+0000","last_clean":"2023-08-10T10:50:13.722087+0000","last_became_active":"2023-08-10T10:48:46.625867+0000","last_became_peered":"2023-08-10T10:48:46.625867+0000","last_unstale":"2023-08-10T10:50:13.722087+0000","last_undegraded":"2023-08-10T10:50:13.722087+0000","last_fullsized":"2023-08-10T10:50:13.722087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:40.288099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767768+0000","last_change":"2023-08-10T10:48:41.590734+0000","last_active":"2023-08-10T10:50:13.767768+0000","last_peered":"2023-08-10T10:50:13.767768+0000","last_clean":"2023-08-10T10:50:13.767768+0000","last_became_active":"2023-08-10T10:48:41.590433+0000","last_became_peered":"2023-08-10T10:48:41.590433+0000","last_unstale":"2023-08-10T10:50:13.767768+0000","last_undegraded":"2023-08-10T10:50:13.767768+0000","last_fullsized":"2023-08-10T10:50:13.767768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:08:56.564752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613324+0000","last_change":"2023-08-10T10:48:42.576628+0000","last_active":"2023-08-10T10:50:41.613324+0000","last_peered":"2023-08-10T10:50:41.613324+0000","last_clean":"2023-08-10T10:50:41.613324+0000","last_became_active":"2023-08-10T10:48:42.576285+0000","last_became_peered":"2023-08-10T10:48:42.576285+0000","last_unstale":"2023-08-10T10:50:41.613324+0000","last_undegraded":"2023-08-10T10:50:41.613324+0000","last_fullsized":"2023-08-10T10:50:41.613324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:56.152902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.609242+0000","last_change":"2023-08-10T10:48:42.579615+0000","last_active":"2023-08-10T10:50:41.609242+0000","last_peered":"2023-08-10T10:50:41.609242+0000","last_clean":"2023-08-10T10:50:41.609242+0000","last_became_active":"2023-08-10T10:48:42.579291+0000","last_became_peered":"2023-08-10T10:48:42.579291+0000","last_unstale":"2023-08-10T10:50:41.609242+0000","last_undegraded":"2023-08-10T10:50:41.609242+0000","last_fullsized":"2023-08-10T10:50:41.609242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:07:16.219311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.607050+0000","last_change":"2023-08-10T10:48:42.581358+0000","last_active":"2023-08-10T10:50:41.607050+0000","last_peered":"2023-08-10T10:50:41.607050+0000","last_clean":"2023-08-10T10:50:41.607050+0000","last_became_active":"2023-08-10T10:48:42.580942+0000","last_became_peered":"2023-08-10T10:48:42.580942+0000","last_unstale":"2023-08-10T10:50:41.607050+0000","last_undegraded":"2023-08-10T10:50:41.607050+0000","last_fullsized":"2023-08-10T10:50:41.607050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:15:15.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.610115+0000","last_change":"2023-08-10T10:48:42.574494+0000","last_active":"2023-08-10T10:50:41.610115+0000","last_peered":"2023-08-10T10:50:41.610115+0000","last_clean":"2023-08-10T10:50:41.610115+0000","last_became_active":"2023-08-10T10:48:42.574203+0000","last_became_peered":"2023-08-10T10:48:42.574203+0000","last_unstale":"2023-08-10T10:50:41.610115+0000","last_undegraded":"2023-08-10T10:50:41.610115+0000","last_fullsized":"2023-08-10T10:50:41.610115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:08:52.621504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615876+0000","last_change":"2023-08-10T10:48:42.587557+0000","last_active":"2023-08-10T10:50:41.615876+0000","last_peered":"2023-08-10T10:50:41.615876+0000","last_clean":"2023-08-10T10:50:41.615876+0000","last_became_active":"2023-08-10T10:48:42.587133+0000","last_became_peered":"2023-08-10T10:48:42.587133+0000","last_unstale":"2023-08-10T10:50:41.615876+0000","last_undegraded":"2023-08-10T10:50:41.615876+0000","last_fullsized":"2023-08-10T10:50:41.615876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:06:59.879669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.608431+0000","last_change":"2023-08-10T10:48:42.587283+0000","last_active":"2023-08-10T10:50:41.608431+0000","last_peered":"2023-08-10T10:50:41.608431+0000","last_clean":"2023-08-10T10:50:41.608431+0000","last_became_active":"2023-08-10T10:48:42.586118+0000","last_became_peered":"2023-08-10T10:48:42.586118+0000","last_unstale":"2023-08-10T10:50:41.608431+0000","last_undegraded":"2023-08-10T10:50:41.608431+0000","last_fullsized":"2023-08-10T10:50:41.608431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:07:02.654188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.607274+0000","last_change":"2023-08-10T10:48:42.580843+0000","last_active":"2023-08-10T10:50:41.607274+0000","last_peered":"2023-08-10T10:50:41.607274+0000","last_clean":"2023-08-10T10:50:41.607274+0000","last_became_active":"2023-08-10T10:48:42.579735+0000","last_became_peered":"2023-08-10T10:48:42.579735+0000","last_unstale":"2023-08-10T10:50:41.607274+0000","last_undegraded":"2023-08-10T10:50:41.607274+0000","last_fullsized":"2023-08-10T10:50:41.607274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.478217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622932+0000","last_change":"2023-08-10T10:48:42.580250+0000","last_active":"2023-08-10T10:50:41.622932+0000","last_peered":"2023-08-10T10:50:41.622932+0000","last_clean":"2023-08-10T10:50:41.622932+0000","last_became_active":"2023-08-10T10:48:42.579962+0000","last_became_peered":"2023-08-10T10:48:42.579962+0000","last_unstale":"2023-08-10T10:50:41.622932+0000","last_undegraded":"2023-08-10T10:50:41.622932+0000","last_fullsized":"2023-08-10T10:50:41.622932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:34:59.289236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613267+0000","last_change":"2023-08-10T10:48:42.582699+0000","last_active":"2023-08-10T10:50:41.613267+0000","last_peered":"2023-08-10T10:50:41.613267+0000","last_clean":"2023-08-10T10:50:41.613267+0000","last_became_active":"2023-08-10T10:48:42.582426+0000","last_became_peered":"2023-08-10T10:48:42.582426+0000","last_unstale":"2023-08-10T10:50:41.613267+0000","last_undegraded":"2023-08-10T10:50:41.613267+0000","last_fullsized":"2023-08-10T10:50:41.613267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:57.741362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.611264+0000","last_change":"2023-08-10T10:48:42.577483+0000","last_active":"2023-08-10T10:50:41.611264+0000","last_peered":"2023-08-10T10:50:41.611264+0000","last_clean":"2023-08-10T10:50:41.611264+0000","last_became_active":"2023-08-10T10:48:42.577195+0000","last_became_peered":"2023-08-10T10:48:42.577195+0000","last_unstale":"2023-08-10T10:50:41.611264+0000","last_undegraded":"2023-08-10T10:50:41.611264+0000","last_fullsized":"2023-08-10T10:50:41.611264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:51:45.123427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613773+0000","last_change":"2023-08-10T10:48:42.581129+0000","last_active":"2023-08-10T10:50:41.613773+0000","last_peered":"2023-08-10T10:50:41.613773+0000","last_clean":"2023-08-10T10:50:41.613773+0000","last_became_active":"2023-08-10T10:48:42.579350+0000","last_became_peered":"2023-08-10T10:48:42.579350+0000","last_unstale":"2023-08-10T10:50:41.613773+0000","last_undegraded":"2023-08-10T10:50:41.613773+0000","last_fullsized":"2023-08-10T10:50:41.613773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:08.947725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621899+0000","last_change":"2023-08-10T10:48:42.578167+0000","last_active":"2023-08-10T10:50:41.621899+0000","last_peered":"2023-08-10T10:50:41.621899+0000","last_clean":"2023-08-10T10:50:41.621899+0000","last_became_active":"2023-08-10T10:48:42.577571+0000","last_became_peered":"2023-08-10T10:48:42.577571+0000","last_unstale":"2023-08-10T10:50:41.621899+0000","last_undegraded":"2023-08-10T10:50:41.621899+0000","last_fullsized":"2023-08-10T10:50:41.621899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:55:49.584540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616759+0000","last_change":"2023-08-10T10:48:42.587207+0000","last_active":"2023-08-10T10:50:41.616759+0000","last_peered":"2023-08-10T10:50:41.616759+0000","last_clean":"2023-08-10T10:50:41.616759+0000","last_became_active":"2023-08-10T10:48:42.586848+0000","last_became_peered":"2023-08-10T10:48:42.586848+0000","last_unstale":"2023-08-10T10:50:41.616759+0000","last_undegraded":"2023-08-10T10:50:41.616759+0000","last_fullsized":"2023-08-10T10:50:41.616759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:15.743811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.605689+0000","last_change":"2023-08-10T10:48:42.580785+0000","last_active":"2023-08-10T10:50:41.605689+0000","last_peered":"2023-08-10T10:50:41.605689+0000","last_clean":"2023-08-10T10:50:41.605689+0000","last_became_active":"2023-08-10T10:48:42.580395+0000","last_became_peered":"2023-08-10T10:48:42.580395+0000","last_unstale":"2023-08-10T10:50:41.605689+0000","last_undegraded":"2023-08-10T10:50:41.605689+0000","last_fullsized":"2023-08-10T10:50:41.605689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:09.498136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250142,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69764,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1035,"num_read_kb":595,"num_write":260,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383721,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":520937,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.99299999999999999,"5min":1.494,"15min":1.494},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.97899999999999998,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76200000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.753,"15min":0.74299999999999999},"min":{"1min":0.63500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.042,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1140000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82699999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.069}]},{"osd":4,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.85199999999999998,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.226,"5min":1.272,"15min":1.272},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.55200000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.125}]},{"osd":5,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2669999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.75700000000000001,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.113}]},{"osd":6,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82299999999999995,"15min":0.82399999999999995},"min":{"1min":0.51600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.056,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.754,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.161,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.032}]},{"osd":7,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.90900000000000003,"15min":0.88800000000000001},"min":{"1min":0.68999999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.252,"5min":1.597,"15min":1.597},"last":1.155},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89000000000000001,"15min":0.88700000000000001},"min":{"1min":0.67000000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.173,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0549999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:50:42 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.94899999999999995,"15min":0.94099999999999995},"min":{"1min":0.80300000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90100000000000002,"15min":0.89500000000000002},"min":{"1min":0.65700000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.2230000000000001}]},{"osd":9,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.99399999999999999,"15min":0.96099999999999997},"min":{"1min":0.89900000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3180000000000001,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.95999999999999996,"15min":0.92100000000000004},"min":{"1min":0.77200000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2470000000000001,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":1.1950000000000001}]},{"osd":10,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93500000000000005,"15min":0.92400000000000004},"min":{"1min":0.753,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1559999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.099},{"interface":"front","average":{"1min":1.081,"5min":1.0109999999999999,"15min":0.98499999999999999},"min":{"1min":0.90300000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4019999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.2090000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1171456,"data_stored":1167894,"data_compressed":59704,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.627},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.504}]},{"osd":1,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.80100000000000005,"5min":1.355,"15min":1.355},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80400000000000005,"5min":1.494,"15min":1.494},"last":0.442}]},{"osd":2,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.47099999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.222,"15min":1.222},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.63700000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.095,"5min":1.198,"15min":1.198},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.78500000000000003,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.87,"15min":0.875},"min":{"1min":0.60599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.8259999999999996,"5min":5.8259999999999996,"15min":5.8259999999999996},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.77400000000000002,"15min":0.80900000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4259999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":0.82899999999999996},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3440000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.753}]},{"osd":5,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91400000000000003,"15min":0.94999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0600000000000001,"5min":1.369,"15min":1.369},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1459999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.90000000000000002,"15min":0.96399999999999997},"min":{"1min":0.56200000000000006,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.88,"5min":1.579,"15min":1.579},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.94199999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96999999999999997,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.53000000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.98499999999999999,"15min":1.0169999999999999},"min":{"1min":0.73599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2589999999999999,"5min":1.869,"15min":1.869},"last":0.871},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.997,"15min":1.0580000000000001},"min":{"1min":0.71699999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.006,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.79600000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.98099999999999998,"15min":1.0349999999999999},"min":{"1min":0.72999999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.91700000000000004,"5min":1.619,"15min":1.619},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.995,"15min":1.0649999999999999},"min":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0329999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.83599999999999997}]},{"osd":11,"last update":"Thu Aug 10 10:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.98699999999999999,"15min":1.002},"min":{"1min":0.81899999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3680000000000001,"5min":1.79,"15min":1.79},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.77400000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1060000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.89600000000000002}]}]},{"osd":9,"up_from":67,"seq":287762808883,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":523929,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.35499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.433}]},{"osd":1,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.86599999999999999},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.93200000000000005,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.024,"5min":1.077,"15min":1.077},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.747,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.157,"5min":1.167,"15min":1.167},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65000000000000002,"15min":0.68799999999999994},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3109999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.621},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.39700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75,"15min":0.78600000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86099999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.80200000000000005,"15min":0.84199999999999997},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0209999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81799999999999995,"15min":0.85399999999999998},"min":{"1min":0.53700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.111,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81999999999999995,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2110000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.081}]},{"osd":7,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.85399999999999998,"15min":0.90200000000000002},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.099,"5min":1.607,"15min":1.607},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.143,"5min":1.236,"15min":1.236},"last":0.81399999999999995}]},{"osd":8,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0229999999999999,"5min":1.319,"15min":1.319},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":0.94499999999999995},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84999999999999998,"15min":0.872},"min":{"1min":0.60099999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.90000000000000002,"15min":0.92200000000000004},"min":{"1min":0.66800000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3480000000000001,"5min":1.381,"15min":1.381},"last":0.90000000000000002}]},{"osd":11,"last update":"Thu Aug 10 10:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.85299999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.98699999999999999,"5min":1.244,"15min":1.244},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81899999999999995,"15min":0.82899999999999996},"min":{"1min":0.58399999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1439999999999999,"5min":1.216,"15min":1.216},"last":0.60199999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":519880,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.46200000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":5.1909999999999998,"5min":5.1909999999999998,"15min":5.1909999999999998},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.625,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.113,"15min":1.113},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.77600000000000002,"15min":0.76200000000000001},"min":{"1min":0.58799999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.99099999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.66300000000000003},"min":{"1min":0.45600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88200000000000001,"5min":1.103,"15min":1.103},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.65900000000000003},"min":{"1min":0.41599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.496}]},{"osd":3,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":5.1189999999999998,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.60199999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85299999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.755}]},{"osd":4,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.63600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98099999999999998,"5min":1.238,"15min":1.238},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85599999999999998,"15min":0.87},"min":{"1min":0.64800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.0589999999999999,"5min":1.214,"15min":1.214},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.749,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.036,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77800000000000002,"15min":0.81999999999999995},"min":{"1min":0.57999999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1359999999999999,"5min":1.236,"15min":1.236},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86199999999999999,"15min":0.89200000000000002},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.91300000000000003,"15min":0.92400000000000004},"min":{"1min":0.59899999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.1609999999999996,"5min":5.1609999999999996,"15min":5.1609999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89600000000000002,"15min":0.93799999999999994},"min":{"1min":0.67800000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1759999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90900000000000003,"15min":0.93500000000000005},"min":{"1min":0.65400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.091,"5min":1.29,"15min":1.29},"last":0.83799999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.88500000000000001,"15min":0.86899999999999999},"min":{"1min":0.76400000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1499999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.583},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.91600000000000004,"15min":0.89500000000000002},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0899999999999999,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.669}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.91700000000000004,"15min":0.88500000000000001},"min":{"1min":0.70699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.196,"5min":1.214,"15min":1.214},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.92600000000000005,"15min":0.91200000000000003},"min":{"1min":0.72199999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.246,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.82299999999999995}]},{"osd":11,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.76200000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.091,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.119,"5min":1.232,"15min":1.232},"last":0.65800000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332157,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":1117822,"data_compressed":59704,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0489999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99299999999999999,"5min":1.466,"15min":1.466},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68200000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.372},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.72999999999999998,"15min":0.76800000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90800000000000003,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.996,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.81999999999999995,"15min":0.82899999999999996},"min":{"1min":0.54300000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.2650000000000001,"5min":3.2650000000000001,"15min":3.2650000000000001},"last":0.624},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75900000000000001,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.87,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79400000000000004,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90600000000000003,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.877},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.82399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57799999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.004,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.66200000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.86799999999999999,"15min":0.89200000000000002},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.53900000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:50:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88700000000000001,"15min":0.872},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.101,"5min":1.379,"15min":1.379},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.87,"15min":0.874},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95199999999999996,"5min":1.357,"15min":1.357},"last":0.92400000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93899999999999995,"15min":0.96099999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.65900000000000003}]},{"osd":10,"last update":"Thu Aug 10 10:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88200000000000001,"15min":0.89300000000000002},"min":{"1min":0.63400000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.085,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.69399999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.127,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58299999999999996}]},{"osd":11,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98299999999999998,"15min":0.98499999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.151,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.97699999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495684,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":515772,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48799999999999999,"15min":0.46100000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3740000000000001,"5min":3.875,"15min":3.875},"last":0.629},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.278,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.38}]},{"osd":1,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.73199999999999998},"min":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.119,"5min":1.869,"15min":1.869},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.55400000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0449999999999999,"5min":1.296,"15min":1.296},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.48799999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.1359999999999999,"5min":2.198,"15min":2.198},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.51400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.749}]},{"osd":3,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0129999999999999,"5min":3.327,"15min":3.327},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":3.423,"15min":3.423},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.752},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0369999999999999,"5min":1.948,"15min":1.948},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77300000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0660000000000001,"5min":1.345,"15min":1.345},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.745,"15min":0.752},"min":{"1min":0.56899999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.1879999999999999,"5min":2.161,"15min":2.161},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.93700000000000006,"5min":1.982,"15min":1.982},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.58399999999999996}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4099999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85299999999999998},"min":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1499999999999999,"5min":1.429,"15min":1.429},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.88700000000000001,"15min":0.88900000000000001},"min":{"1min":0.52800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.878}]},{"osd":10,"last update":"Thu Aug 10 10:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.65200000000000002,"5min":0.63,"15min":0.63},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.73199999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.26,"5min":1.46,"15min":1.46},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.878,"15min":0.88900000000000001},"min":{"1min":0.68400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98099999999999998,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.73999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":577342,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.68799999999999994,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.26600000000000001},"max":{"1min":5.173,"5min":5.173,"15min":5.173},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.70799999999999996,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.28399999999999997},"max":{"1min":9.2070000000000007,"5min":9.2070000000000007,"15min":9.2070000000000007},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.748,"15min":0.63400000000000001},"min":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.32200000000000001},"max":{"1min":1.0189999999999999,"5min":1.25,"15min":1.25},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71899999999999997,"15min":0.61899999999999999},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.747,"15min":0.65700000000000003},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":4.3719999999999999,"5min":4.3719999999999999,"15min":4.3719999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.78200000000000003,"15min":0.68200000000000005},"min":{"1min":0.52700000000000002,"5min":0.443,"15min":0.377},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.47399999999999998},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.69599999999999995},"min":{"1min":0.59999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.99199999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77000000000000002,"15min":0.68200000000000005},"min":{"1min":0.65000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0029999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.79200000000000004,"15min":0.77300000000000002},"min":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":1.264,"15min":1.264},"last":0.873},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79900000000000004,"15min":0.74399999999999999},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0720000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.95699999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":0.78500000000000003},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1200000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0409999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.89800000000000002,"15min":0.877},"min":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.044,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.83999999999999997},"min":{"1min":0.70199999999999996,"5min":0.624,"15min":0.624},"max":{"1min":1.0129999999999999,"5min":1.46,"15min":1.46},"last":1.008}]},{"osd":9,"last update":"Thu Aug 10 10:50:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.88100000000000001,"15min":0.84899999999999998},"min":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98699999999999999,"5min":5.476,"15min":5.476},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.97199999999999998,"15min":0.93600000000000005},"min":{"1min":0.66500000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1639999999999999,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.98599999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":0.91500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0669999999999999,"5min":1.51,"15min":1.51},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.88500000000000001,"15min":0.90200000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1020000000000001,"5min":1.266,"15min":1.266},"last":0.88900000000000001}]},{"osd":11,"last update":"Thu Aug 10 10:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.0149999999999999,"15min":1.03},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.1499999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.99399999999999999,"15min":1.006},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.159,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738468,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":517759,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.65200000000000002,"15min":0.60299999999999998},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.67100000000000004,"15min":0.624},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70699999999999996,"15min":0.69299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.73799999999999999,"15min":0.70999999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.94699999999999995,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.67400000000000004},"min":{"1min":0.52000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90900000000000003,"5min":2.29,"15min":2.29},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:50:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.68899999999999995,"15min":0.65500000000000003},"min":{"1min":0.45600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73399999999999999,"15min":0.69399999999999995},"min":{"1min":0.57299999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.41099999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88800000000000001,"5min":2.657,"15min":2.657},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0860000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80200000000000005,"15min":0.81499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89200000000000002,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86299999999999999,"15min":0.879},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.99299999999999999,"5min":2.355,"15min":2.355},"last":0.70899999999999996}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.66100000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":1.77,"15min":1.77},"last":0.749},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.67300000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1970000000000001,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.81000000000000005}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.86799999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89400000000000002,"15min":0.89100000000000001},"min":{"1min":0.68700000000000006,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.874,"15min":0.879},"min":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.90600000000000003}]},{"osd":11,"last update":"Thu Aug 10 10:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.87,"15min":0.86099999999999999},"min":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.0389999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89500000000000002,"15min":0.90100000000000002},"min":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.04,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.92700000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":577518,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.72699999999999998,"15min":0.63800000000000001},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":9.548,"5min":9.548,"15min":9.548},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.70399999999999996,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":9.5,"5min":9.5,"15min":9.5},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.70499999999999996,"15min":0.625},"min":{"1min":0.55200000000000005,"5min":0.315,"15min":0.315},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.624},"min":{"1min":0.52000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.73599999999999999,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":3.9990000000000001,"5min":3.9990000000000001,"15min":3.9990000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.48799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98299999999999998,"5min":1.008,"15min":1.008},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.135,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59099999999999997,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96099999999999997,"5min":1.488,"15min":1.488},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.61799999999999999,"15min":0.55300000000000005},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.081,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83199999999999996,"15min":0.72199999999999998},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.3559999999999999,"5min":4.851,"15min":4.851},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.70799999999999996},"min":{"1min":0.58599999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2849999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.95499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90400000000000003,"15min":0.91500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.159,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.78300000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.087,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.95399999999999996}]},{"osd":9,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.80800000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.9379999999999997,"5min":4.9379999999999997,"15min":4.9379999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.508,"5min":0.94999999999999996,"15min":0.85799999999999998},"min":{"1min":0.78400000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":0.878}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.77800000000000002,"15min":0.74199999999999999},"min":{"1min":0.70199999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.93100000000000005,"15min":0.89700000000000002},"min":{"1min":0.77500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.204,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.86199999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.61499999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1,"5min":1.0289999999999999,"15min":1.034},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.748}]}]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":514714,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45700000000000002,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.375},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.443},"min":{"1min":0.311,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.91700000000000004,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.66000000000000003},"min":{"1min":0.46700000000000003,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69399999999999995,"15min":0.65400000000000003},"min":{"1min":0.54200000000000004,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.753,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1180000000000001,"5min":6.367,"15min":6.367},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.66900000000000004},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":1.004,"15min":1.004},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72299999999999998,"15min":0.70399999999999996},"min":{"1min":0.51500000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0489999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.86799999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.161,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Aug 10 10:50:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77300000000000002,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":6.3410000000000002,"15min":6.3410000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.53200000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95699999999999996,"5min":1.054,"15min":1.054},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.63400000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.76000000000000001},"min":{"1min":0.65500000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1519999999999999,"5min":1.327,"15min":1.327},"last":0.76700000000000002}]},{"osd":8,"last update":"Thu Aug 10 10:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.04,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.85799999999999998},"min":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.0880000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.753}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.82299999999999995,"15min":0.85999999999999999},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.069,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.879,"15min":0.89500000000000002},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.873,"15min":0.875},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73299999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":520377,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50900000000000001,"15min":0.48199999999999998},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":1.143,"5min":1.143,"15min":1.2310000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.497},"min":{"1min":0.42799999999999999,"5min":0.34300000000000003,"15min":0.29099999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.68799999999999994},"min":{"1min":0.47099999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93600000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.749,"15min":0.71099999999999997},"min":{"1min":0.60099999999999998,"5min":0.48199999999999998,"15min":0.47499999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.421},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.67900000000000005},"min":{"1min":0.54300000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67600000000000005,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.04,"5min":1.069,"15min":1.069},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77100000000000002,"15min":0.754},"min":{"1min":0.61199999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.204,"5min":1.377,"15min":1.377},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.77400000000000002,"15min":0.74199999999999999},"min":{"1min":0.61499999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.49099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98399999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.75800000000000001,"15min":0.72999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.76800000000000002,"15min":0.755},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.76400000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.91400000000000003,"15min":0.874},"min":{"1min":0.76200000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90300000000000002,"15min":0.88900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.92700000000000005}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84599999999999997,"15min":0.85299999999999998},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.0720000000000001,"5min":1.175,"15min":1.175},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.88400000000000001,"15min":0.872},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.93999999999999995}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.92900000000000005,"15min":0.92800000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.226,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88600000000000001,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.097,"5min":1.137,"15min":1.137},"last":0.79200000000000004}]},{"osd":11,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0089999999999999,"15min":1.0049999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.03}]}]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":1112003,"data_compressed":59704,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.093,"5min":0.70399999999999996,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":8.9320000000000004,"5min":8.9320000000000004,"15min":8.9320000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69699999999999995,"15min":0.67400000000000004},"min":{"1min":0.503,"5min":0.439,"15min":0.439},"max":{"1min":0.92900000000000005,"5min":1.073,"15min":1.073},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.014,"15min":1.014},"last":0.87}]},{"osd":2,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51900000000000002,"15min":0.499},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77200000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80800000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.751,"15min":0.72499999999999998},"min":{"1min":0.53100000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72799999999999998,"15min":0.69399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88400000000000001,"5min":1.141,"15min":1.141},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71099999999999997,"15min":0.69099999999999995},"min":{"1min":0.55900000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94499999999999995,"5min":1.321,"15min":1.321},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.57299999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77400000000000002,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.0129999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.56299999999999994,"5min":0.502,"15min":0.502},"max":{"1min":0.96999999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85199999999999998}]},{"osd":8,"last update":"Thu Aug 10 10:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.54500000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.89900000000000002,"5min":1.012,"15min":1.012},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83199999999999996,"5min":0.997,"15min":0.997},"last":0.97399999999999998}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83699999999999997,"15min":0.83399999999999996},"min":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.95899999999999996}]},{"osd":10,"last update":"Thu Aug 10 10:50:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.026,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.085,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:50:58.630 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:50:58.859 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.858+0000 7fc9f0fff700 1 -- 172.21.15.107:0/4073533510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec101960 msgr2=0x7fc9ec101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.858+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/4073533510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec101960 0x7fc9ec101dc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00099c0 tx=0x7fc9e0009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.858+0000 7fc9f0fff700 1 -- 172.21.15.107:0/4073533510 shutdown_connections 2023-08-10T10:50:58.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.858+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/4073533510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec100770 0x7fc9ec100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.858+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/4073533510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ec102300 0x7fc9ec108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.858+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/4073533510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec101960 0x7fc9ec101dc0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.858+0000 7fc9f0fff700 1 -- 172.21.15.107:0/4073533510 >> 172.21.15.107:0/4073533510 conn(0x7fc9ec0fbca0 msgr2=0x7fc9ec0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:58.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.859+0000 7fc9f0fff700 1 -- 172.21.15.107:0/4073533510 shutdown_connections 2023-08-10T10:50:58.861 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.859+0000 7fc9f0fff700 1 -- 172.21.15.107:0/4073533510 wait complete. 2023-08-10T10:50:58.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.859+0000 7fc9f0fff700 1 Processor -- start 2023-08-10T10:50:58.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9f0fff700 1 -- start start 2023-08-10T10:50:58.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9f0fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ec100770 0x7fc9ec198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:58.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9f0fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec101960 0x7fc9ec198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:58.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9f0fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec102300 0x7fc9ec19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:58.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9f0fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec1a0090 con 0x7fc9ec102300 2023-08-10T10:50:58.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9f0fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec1a01d0 con 0x7fc9ec101960 2023-08-10T10:50:58.863 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9f0fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec1a0360 con 0x7fc9ec100770 2023-08-10T10:50:58.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9ead9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec102300 0x7fc9ec19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:58.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9ead9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec102300 0x7fc9ec19fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44420/0 (socket says 172.21.15.107:44420) 2023-08-10T10:50:58.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9ead9d700 1 -- 172.21.15.107:0/2161608407 learned_addr learned my addr 172.21.15.107:0/2161608407 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:58.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.860+0000 7fc9ea59c700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ec100770 0x7fc9ec198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:58.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9e9d9b700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec101960 0x7fc9ec198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:58.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9ead9d700 1 -- 172.21.15.107:0/2161608407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ec100770 msgr2=0x7fc9ec198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.864 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9ead9d700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ec100770 0x7fc9ec198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9ead9d700 1 -- 172.21.15.107:0/2161608407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec101960 msgr2=0x7fc9ec198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:58.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9ead9d700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec101960 0x7fc9ec198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:58.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9ead9d700 1 -- 172.21.15.107:0/2161608407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00095f0 con 0x7fc9ec102300 2023-08-10T10:50:58.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9e9d9b700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec101960 0x7fc9ec198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:50:58.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9ead9d700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec102300 0x7fc9ec19fac0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4007ee0 tx=0x7fc9e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:58.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9db7fe700 1 -- 172.21.15.107:0/2161608407 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4017070 con 0x7fc9ec102300 2023-08-10T10:50:58.865 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec1a0640 con 0x7fc9ec102300 2023-08-10T10:50:58.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9db7fe700 1 -- 172.21.15.107:0/2161608407 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9e400f040 con 0x7fc9ec102300 2023-08-10T10:50:58.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9db7fe700 1 -- 172.21.15.107:0/2161608407 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4005710 con 0x7fc9ec102300 2023-08-10T10:50:58.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.861+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec1a0b00 con 0x7fc9ec102300 2023-08-10T10:50:58.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.862+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec192c80 con 0x7fc9ec102300 2023-08-10T10:50:58.866 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.865+0000 7fc9db7fe700 1 -- 172.21.15.107:0/2161608407 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc9e4005870 con 0x7fc9ec102300 2023-08-10T10:50:58.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.866+0000 7fc9db7fe700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc9d40a11a0 0x7fc9d40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:58.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.866+0000 7fc9db7fe700 1 -- 172.21.15.107:0/2161608407 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fc9e40cc480 con 0x7fc9ec102300 2023-08-10T10:50:58.867 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.866+0000 7fc9ea59c700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc9d40a11a0 0x7fc9d40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:58.868 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.867+0000 7fc9ea59c700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc9d40a11a0 0x7fc9d40a3660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec1017c0 tx=0x7fc9dc007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:58.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:58.870+0000 7fc9db7fe700 1 -- 172.21.15.107:0/2161608407 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc9e4095850 con 0x7fc9ec102300 2023-08-10T10:50:58.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:58 smithi195 ceph-mon[129938]: pgmap v376: 129 pgs: 129 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 10 op/s 2023-08-10T10:50:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:58 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/579582684' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:58 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/571359824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:58 smithi157 ceph-mon[129604]: pgmap v376: 129 pgs: 129 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 10 op/s 2023-08-10T10:50:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:58 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/579582684' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:58 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/571359824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:59.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.066+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9ec060bb0 con 0x7fc9d40a11a0 2023-08-10T10:50:59.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:58 smithi107 ceph-mon[127953]: pgmap v376: 129 pgs: 129 active+clean; 645 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 10 op/s 2023-08-10T10:50:59.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:58 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/579582684' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:50:59.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:58 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/571359824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:50:59.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.079+0000 7fc9db7fe700 1 -- 172.21.15.107:0/2161608407 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426541 (secure 0 0 0) 0x7fc9ec060bb0 con 0x7fc9d40a11a0 2023-08-10T10:50:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc9d40a11a0 msgr2=0x7fc9d40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc9d40a11a0 0x7fc9d40a3660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec1017c0 tx=0x7fc9dc007400 comp rx=0 tx=0).stop 2023-08-10T10:50:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec102300 msgr2=0x7fc9ec19fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec102300 0x7fc9ec19fac0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4007ee0 tx=0x7fc9e400d3b0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 shutdown_connections 2023-08-10T10:50:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fc9d40a11a0 0x7fc9d40a3660 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc9ec102300 0x7fc9ec19fac0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ec100770 0x7fc9ec198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 --2- 172.21.15.107:0/2161608407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9ec101960 0x7fc9ec198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 >> 172.21.15.107:0/2161608407 conn(0x7fc9ec0fbca0 msgr2=0x7fc9ec107280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:59.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 shutdown_connections 2023-08-10T10:50:59.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.084+0000 7fc9f0fff700 1 -- 172.21.15.107:0/2161608407 wait complete. 2023-08-10T10:50:59.089 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-08-10T10:50:59.104 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2023-08-10T10:50:57.618387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660378,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1171,"num_read_kb":714,"num_write":443,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336748,"kb_used_data":12556,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605076,"statfs":{"total":1151940427776,"available":1151595597824,"internally_reserved":0,"allocated":12857344,"data_stored":8185947,"data_compressed":390612,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":60,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003040"},"pg_stats":[{"pgid":"3.3f","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622275+0000","last_change":"2023-08-10T10:48:42.585259+0000","last_active":"2023-08-10T10:50:41.622275+0000","last_peered":"2023-08-10T10:50:41.622275+0000","last_clean":"2023-08-10T10:50:41.622275+0000","last_became_active":"2023-08-10T10:48:42.584501+0000","last_became_peered":"2023-08-10T10:48:42.584501+0000","last_unstale":"2023-08-10T10:50:41.622275+0000","last_undegraded":"2023-08-10T10:50:41.622275+0000","last_fullsized":"2023-08-10T10:50:41.622275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:56.485043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617518+0000","last_change":"2023-08-10T10:48:42.577812+0000","last_active":"2023-08-10T10:50:41.617518+0000","last_peered":"2023-08-10T10:50:41.617518+0000","last_clean":"2023-08-10T10:50:41.617518+0000","last_became_active":"2023-08-10T10:48:42.577499+0000","last_became_peered":"2023-08-10T10:48:42.577499+0000","last_unstale":"2023-08-10T10:50:41.617518+0000","last_undegraded":"2023-08-10T10:50:41.617518+0000","last_fullsized":"2023-08-10T10:50:41.617518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:06:40.664014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621396+0000","last_change":"2023-08-10T10:48:42.577302+0000","last_active":"2023-08-10T10:50:41.621396+0000","last_peered":"2023-08-10T10:50:41.621396+0000","last_clean":"2023-08-10T10:50:41.621396+0000","last_became_active":"2023-08-10T10:48:42.577022+0000","last_became_peered":"2023-08-10T10:48:42.577022+0000","last_unstale":"2023-08-10T10:50:41.621396+0000","last_undegraded":"2023-08-10T10:50:41.621396+0000","last_fullsized":"2023-08-10T10:50:41.621396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:04:39.641834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.602333+0000","last_change":"2023-08-10T10:48:42.577198+0000","last_active":"2023-08-10T10:50:41.602333+0000","last_peered":"2023-08-10T10:50:41.602333+0000","last_clean":"2023-08-10T10:50:41.602333+0000","last_became_active":"2023-08-10T10:48:42.576887+0000","last_became_peered":"2023-08-10T10:48:42.576887+0000","last_unstale":"2023-08-10T10:50:41.602333+0000","last_undegraded":"2023-08-10T10:50:41.602333+0000","last_fullsized":"2023-08-10T10:50:41.602333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:53.163140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.607900+0000","last_change":"2023-08-10T10:48:42.587532+0000","last_active":"2023-08-10T10:50:41.607900+0000","last_peered":"2023-08-10T10:50:41.607900+0000","last_clean":"2023-08-10T10:50:41.607900+0000","last_became_active":"2023-08-10T10:48:42.587199+0000","last_became_peered":"2023-08-10T10:48:42.587199+0000","last_unstale":"2023-08-10T10:50:41.607900+0000","last_undegraded":"2023-08-10T10:50:41.607900+0000","last_fullsized":"2023-08-10T10:50:41.607900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:17.189550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617602+0000","last_change":"2023-08-10T10:48:42.581998+0000","last_active":"2023-08-10T10:50:41.617602+0000","last_peered":"2023-08-10T10:50:41.617602+0000","last_clean":"2023-08-10T10:50:41.617602+0000","last_became_active":"2023-08-10T10:48:42.581683+0000","last_became_peered":"2023-08-10T10:48:42.581683+0000","last_unstale":"2023-08-10T10:50:41.617602+0000","last_undegraded":"2023-08-10T10:50:41.617602+0000","last_fullsized":"2023-08-10T10:50:41.617602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:29.246550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.614453+0000","last_change":"2023-08-10T10:48:42.578452+0000","last_active":"2023-08-10T10:50:41.614453+0000","last_peered":"2023-08-10T10:50:41.614453+0000","last_clean":"2023-08-10T10:50:41.614453+0000","last_became_active":"2023-08-10T10:48:42.577456+0000","last_became_peered":"2023-08-10T10:48:42.577456+0000","last_unstale":"2023-08-10T10:50:41.614453+0000","last_undegraded":"2023-08-10T10:50:41.614453+0000","last_fullsized":"2023-08-10T10:50:41.614453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:10:32.160703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613947+0000","last_change":"2023-08-10T10:48:42.578839+0000","last_active":"2023-08-10T10:50:41.613947+0000","last_peered":"2023-08-10T10:50:41.613947+0000","last_clean":"2023-08-10T10:50:41.613947+0000","last_became_active":"2023-08-10T10:48:42.578450+0000","last_became_peered":"2023-08-10T10:48:42.578450+0000","last_unstale":"2023-08-10T10:50:41.613947+0000","last_undegraded":"2023-08-10T10:50:41.613947+0000","last_fullsized":"2023-08-10T10:50:41.613947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:27.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.614776+0000","last_change":"2023-08-10T10:48:42.588533+0000","last_active":"2023-08-10T10:50:41.614776+0000","last_peered":"2023-08-10T10:50:41.614776+0000","last_clean":"2023-08-10T10:50:41.614776+0000","last_became_active":"2023-08-10T10:48:42.588205+0000","last_became_peered":"2023-08-10T10:48:42.588205+0000","last_unstale":"2023-08-10T10:50:41.614776+0000","last_undegraded":"2023-08-10T10:50:41.614776+0000","last_fullsized":"2023-08-10T10:50:41.614776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:24:40.499168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616444+0000","last_change":"2023-08-10T10:48:42.588606+0000","last_active":"2023-08-10T10:50:41.616444+0000","last_peered":"2023-08-10T10:50:41.616444+0000","last_clean":"2023-08-10T10:50:41.616444+0000","last_became_active":"2023-08-10T10:48:42.588261+0000","last_became_peered":"2023-08-10T10:48:42.588261+0000","last_unstale":"2023-08-10T10:50:41.616444+0000","last_undegraded":"2023-08-10T10:50:41.616444+0000","last_fullsized":"2023-08-10T10:50:41.616444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:38:05.898926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622139+0000","last_change":"2023-08-10T10:48:42.577245+0000","last_active":"2023-08-10T10:50:41.622139+0000","last_peered":"2023-08-10T10:50:41.622139+0000","last_clean":"2023-08-10T10:50:41.622139+0000","last_became_active":"2023-08-10T10:48:42.576512+0000","last_became_peered":"2023-08-10T10:48:42.576512+0000","last_unstale":"2023-08-10T10:50:41.622139+0000","last_undegraded":"2023-08-10T10:50:41.622139+0000","last_fullsized":"2023-08-10T10:50:41.622139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:18:10.408544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.608265+0000","last_change":"2023-08-10T10:48:42.590704+0000","last_active":"2023-08-10T10:50:41.608265+0000","last_peered":"2023-08-10T10:50:41.608265+0000","last_clean":"2023-08-10T10:50:41.608265+0000","last_became_active":"2023-08-10T10:48:42.590360+0000","last_became_peered":"2023-08-10T10:48:42.590360+0000","last_unstale":"2023-08-10T10:50:41.608265+0000","last_undegraded":"2023-08-10T10:50:41.608265+0000","last_fullsized":"2023-08-10T10:50:41.608265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:45.721572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.610049+0000","last_change":"2023-08-10T10:48:42.580072+0000","last_active":"2023-08-10T10:50:41.610049+0000","last_peered":"2023-08-10T10:50:41.610049+0000","last_clean":"2023-08-10T10:50:41.610049+0000","last_became_active":"2023-08-10T10:48:42.579745+0000","last_became_peered":"2023-08-10T10:48:42.579745+0000","last_unstale":"2023-08-10T10:50:41.610049+0000","last_undegraded":"2023-08-10T10:50:41.610049+0000","last_fullsized":"2023-08-10T10:50:41.610049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:32.312474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617574+0000","last_change":"2023-08-10T10:48:42.577050+0000","last_active":"2023-08-10T10:50:41.617574+0000","last_peered":"2023-08-10T10:50:41.617574+0000","last_clean":"2023-08-10T10:50:41.617574+0000","last_became_active":"2023-08-10T10:48:42.576686+0000","last_became_peered":"2023-08-10T10:48:42.576686+0000","last_unstale":"2023-08-10T10:50:41.617574+0000","last_undegraded":"2023-08-10T10:50:41.617574+0000","last_fullsized":"2023-08-10T10:50:41.617574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:29.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615362+0000","last_change":"2023-08-10T10:48:42.582939+0000","last_active":"2023-08-10T10:50:41.615362+0000","last_peered":"2023-08-10T10:50:41.615362+0000","last_clean":"2023-08-10T10:50:41.615362+0000","last_became_active":"2023-08-10T10:48:42.582560+0000","last_became_peered":"2023-08-10T10:48:42.582560+0000","last_unstale":"2023-08-10T10:50:41.615362+0000","last_undegraded":"2023-08-10T10:50:41.615362+0000","last_fullsized":"2023-08-10T10:50:41.615362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:30.943272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622383+0000","last_change":"2023-08-10T10:48:42.577163+0000","last_active":"2023-08-10T10:50:41.622383+0000","last_peered":"2023-08-10T10:50:41.622383+0000","last_clean":"2023-08-10T10:50:41.622383+0000","last_became_active":"2023-08-10T10:48:42.576866+0000","last_became_peered":"2023-08-10T10:48:42.576866+0000","last_unstale":"2023-08-10T10:50:41.622383+0000","last_undegraded":"2023-08-10T10:50:41.622383+0000","last_fullsized":"2023-08-10T10:50:41.622383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:57.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622356+0000","last_change":"2023-08-10T10:48:42.585496+0000","last_active":"2023-08-10T10:50:41.622356+0000","last_peered":"2023-08-10T10:50:41.622356+0000","last_clean":"2023-08-10T10:50:41.622356+0000","last_became_active":"2023-08-10T10:48:42.584963+0000","last_became_peered":"2023-08-10T10:48:42.584963+0000","last_unstale":"2023-08-10T10:50:41.622356+0000","last_undegraded":"2023-08-10T10:50:41.622356+0000","last_fullsized":"2023-08-10T10:50:41.622356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:52.754606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.620347+0000","last_change":"2023-08-10T10:48:42.576038+0000","last_active":"2023-08-10T10:50:41.620347+0000","last_peered":"2023-08-10T10:50:41.620347+0000","last_clean":"2023-08-10T10:50:41.620347+0000","last_became_active":"2023-08-10T10:48:42.575660+0000","last_became_peered":"2023-08-10T10:48:42.575660+0000","last_unstale":"2023-08-10T10:50:41.620347+0000","last_undegraded":"2023-08-10T10:50:41.620347+0000","last_fullsized":"2023-08-10T10:50:41.620347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:57.869830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.609383+0000","last_change":"2023-08-10T10:48:42.573855+0000","last_active":"2023-08-10T10:50:41.609383+0000","last_peered":"2023-08-10T10:50:41.609383+0000","last_clean":"2023-08-10T10:50:41.609383+0000","last_became_active":"2023-08-10T10:48:42.573475+0000","last_became_peered":"2023-08-10T10:48:42.573475+0000","last_unstale":"2023-08-10T10:50:41.609383+0000","last_undegraded":"2023-08-10T10:50:41.609383+0000","last_fullsized":"2023-08-10T10:50:41.609383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:19.171470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695765+0000","last_change":"2023-08-10T10:48:46.628005+0000","last_active":"2023-08-10T10:50:13.695765+0000","last_peered":"2023-08-10T10:50:13.695765+0000","last_clean":"2023-08-10T10:50:13.695765+0000","last_became_active":"2023-08-10T10:48:46.627558+0000","last_became_peered":"2023-08-10T10:48:46.627558+0000","last_unstale":"2023-08-10T10:50:13.695765+0000","last_undegraded":"2023-08-10T10:50:13.695765+0000","last_fullsized":"2023-08-10T10:50:13.695765+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:25.084975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"93'14","reported_seq":141,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.815656+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:50:51.815656+0000","last_peered":"2023-08-10T10:50:51.815656+0000","last_clean":"2023-08-10T10:50:51.815656+0000","last_became_active":"2023-08-10T10:48:41.585341+0000","last_became_peered":"2023-08-10T10:48:41.585341+0000","last_unstale":"2023-08-10T10:50:51.815656+0000","last_undegraded":"2023-08-10T10:50:51.815656+0000","last_fullsized":"2023-08-10T10:50:51.815656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:22.340986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613589+0000","last_change":"2023-08-10T10:48:42.580893+0000","last_active":"2023-08-10T10:50:41.613589+0000","last_peered":"2023-08-10T10:50:41.613589+0000","last_clean":"2023-08-10T10:50:41.613589+0000","last_became_active":"2023-08-10T10:48:42.580591+0000","last_became_peered":"2023-08-10T10:48:42.580591+0000","last_unstale":"2023-08-10T10:50:41.613589+0000","last_undegraded":"2023-08-10T10:50:41.613589+0000","last_fullsized":"2023-08-10T10:50:41.613589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:29.317087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769710+0000","last_change":"2023-08-10T10:48:46.635407+0000","last_active":"2023-08-10T10:50:13.769710+0000","last_peered":"2023-08-10T10:50:13.769710+0000","last_clean":"2023-08-10T10:50:13.769710+0000","last_became_active":"2023-08-10T10:48:46.634936+0000","last_became_peered":"2023-08-10T10:48:46.634936+0000","last_unstale":"2023-08-10T10:50:13.769710+0000","last_undegraded":"2023-08-10T10:50:13.769710+0000","last_fullsized":"2023-08-10T10:50:13.769710+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:54:05.307722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.536246+0000","last_change":"2023-08-10T10:48:41.588054+0000","last_active":"2023-08-10T10:50:14.536246+0000","last_peered":"2023-08-10T10:50:14.536246+0000","last_clean":"2023-08-10T10:50:14.536246+0000","last_became_active":"2023-08-10T10:48:41.587764+0000","last_became_peered":"2023-08-10T10:48:41.587764+0000","last_unstale":"2023-08-10T10:50:14.536246+0000","last_undegraded":"2023-08-10T10:50:14.536246+0000","last_fullsized":"2023-08-10T10:50:14.536246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:04:31.407258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621392+0000","last_change":"2023-08-10T10:48:42.581834+0000","last_active":"2023-08-10T10:50:41.621392+0000","last_peered":"2023-08-10T10:50:41.621392+0000","last_clean":"2023-08-10T10:50:41.621392+0000","last_became_active":"2023-08-10T10:48:42.581438+0000","last_became_peered":"2023-08-10T10:48:42.581438+0000","last_unstale":"2023-08-10T10:50:41.621392+0000","last_undegraded":"2023-08-10T10:50:41.621392+0000","last_fullsized":"2023-08-10T10:50:41.621392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:26.141023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769735+0000","last_change":"2023-08-10T10:49:12.737051+0000","last_active":"2023-08-10T10:50:13.769735+0000","last_peered":"2023-08-10T10:50:13.769735+0000","last_clean":"2023-08-10T10:50:13.769735+0000","last_became_active":"2023-08-10T10:49:12.736586+0000","last_became_peered":"2023-08-10T10:49:12.736586+0000","last_unstale":"2023-08-10T10:50:13.769735+0000","last_undegraded":"2023-08-10T10:50:13.769735+0000","last_fullsized":"2023-08-10T10:50:13.769735+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:03.060137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535593+0000","last_change":"2023-08-10T10:49:12.734942+0000","last_active":"2023-08-10T10:50:14.535593+0000","last_peered":"2023-08-10T10:50:14.535593+0000","last_clean":"2023-08-10T10:50:14.535593+0000","last_became_active":"2023-08-10T10:49:12.720078+0000","last_became_peered":"2023-08-10T10:49:12.720078+0000","last_unstale":"2023-08-10T10:50:14.535593+0000","last_undegraded":"2023-08-10T10:50:14.535593+0000","last_fullsized":"2023-08-10T10:50:14.535593+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:20:07.099664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.620117+0000","last_change":"2023-08-10T10:48:42.581222+0000","last_active":"2023-08-10T10:50:41.620117+0000","last_peered":"2023-08-10T10:50:41.620117+0000","last_clean":"2023-08-10T10:50:41.620117+0000","last_became_active":"2023-08-10T10:48:42.580885+0000","last_became_peered":"2023-08-10T10:48:42.580885+0000","last_unstale":"2023-08-10T10:50:41.620117+0000","last_undegraded":"2023-08-10T10:50:41.620117+0000","last_fullsized":"2023-08-10T10:50:41.620117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:16.221857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769667+0000","last_change":"2023-08-10T10:48:46.626985+0000","last_active":"2023-08-10T10:50:13.769667+0000","last_peered":"2023-08-10T10:50:13.769667+0000","last_clean":"2023-08-10T10:50:13.769667+0000","last_became_active":"2023-08-10T10:48:46.626292+0000","last_became_peered":"2023-08-10T10:48:46.626292+0000","last_unstale":"2023-08-10T10:50:13.769667+0000","last_undegraded":"2023-08-10T10:50:13.769667+0000","last_fullsized":"2023-08-10T10:50:13.769667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:51:41.700285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699726+0000","last_change":"2023-08-10T10:48:41.588563+0000","last_active":"2023-08-10T10:50:13.699726+0000","last_peered":"2023-08-10T10:50:13.699726+0000","last_clean":"2023-08-10T10:50:13.699726+0000","last_became_active":"2023-08-10T10:48:41.588250+0000","last_became_peered":"2023-08-10T10:48:41.588250+0000","last_unstale":"2023-08-10T10:50:13.699726+0000","last_undegraded":"2023-08-10T10:50:13.699726+0000","last_fullsized":"2023-08-10T10:50:13.699726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:04.678700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.618719+0000","last_change":"2023-08-10T10:49:12.714641+0000","last_active":"2023-08-10T10:50:41.618719+0000","last_peered":"2023-08-10T10:50:41.618719+0000","last_clean":"2023-08-10T10:50:41.618719+0000","last_became_active":"2023-08-10T10:49:12.714185+0000","last_became_peered":"2023-08-10T10:49:12.714185+0000","last_unstale":"2023-08-10T10:50:41.618719+0000","last_undegraded":"2023-08-10T10:50:41.618719+0000","last_fullsized":"2023-08-10T10:50:41.618719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:59.150048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696244+0000","last_change":"2023-08-10T10:48:46.630641+0000","last_active":"2023-08-10T10:50:13.696244+0000","last_peered":"2023-08-10T10:50:13.696244+0000","last_clean":"2023-08-10T10:50:13.696244+0000","last_became_active":"2023-08-10T10:48:46.630231+0000","last_became_peered":"2023-08-10T10:48:46.630231+0000","last_unstale":"2023-08-10T10:50:13.696244+0000","last_undegraded":"2023-08-10T10:50:13.696244+0000","last_fullsized":"2023-08-10T10:50:13.696244+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:31:33.419951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":141,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:53.792403+0000","last_change":"2023-08-10T10:48:41.586083+0000","last_active":"2023-08-10T10:50:53.792403+0000","last_peered":"2023-08-10T10:50:53.792403+0000","last_clean":"2023-08-10T10:50:53.792403+0000","last_became_active":"2023-08-10T10:48:41.585714+0000","last_became_peered":"2023-08-10T10:48:41.585714+0000","last_unstale":"2023-08-10T10:50:53.792403+0000","last_undegraded":"2023-08-10T10:50:53.792403+0000","last_fullsized":"2023-08-10T10:50:53.792403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:41:40.651578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.606688+0000","last_change":"2023-08-10T10:48:42.578007+0000","last_active":"2023-08-10T10:50:41.606688+0000","last_peered":"2023-08-10T10:50:41.606688+0000","last_clean":"2023-08-10T10:50:41.606688+0000","last_became_active":"2023-08-10T10:48:42.577687+0000","last_became_peered":"2023-08-10T10:48:42.577687+0000","last_unstale":"2023-08-10T10:50:41.606688+0000","last_undegraded":"2023-08-10T10:50:41.606688+0000","last_fullsized":"2023-08-10T10:50:41.606688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:34:45.948119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696195+0000","last_change":"2023-08-10T10:48:46.633618+0000","last_active":"2023-08-10T10:50:13.696195+0000","last_peered":"2023-08-10T10:50:13.696195+0000","last_clean":"2023-08-10T10:50:13.696195+0000","last_became_active":"2023-08-10T10:48:46.633223+0000","last_became_peered":"2023-08-10T10:48:46.633223+0000","last_unstale":"2023-08-10T10:50:13.696195+0000","last_undegraded":"2023-08-10T10:50:13.696195+0000","last_fullsized":"2023-08-10T10:50:13.696195+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:13:53.778786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.718969+0000","last_change":"2023-08-10T10:48:41.591262+0000","last_active":"2023-08-10T10:50:13.718969+0000","last_peered":"2023-08-10T10:50:13.718969+0000","last_clean":"2023-08-10T10:50:13.718969+0000","last_became_active":"2023-08-10T10:48:41.590879+0000","last_became_peered":"2023-08-10T10:48:41.590879+0000","last_unstale":"2023-08-10T10:50:13.718969+0000","last_undegraded":"2023-08-10T10:50:13.718969+0000","last_fullsized":"2023-08-10T10:50:13.718969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:45.414755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.612780+0000","last_change":"2023-08-10T10:48:42.581852+0000","last_active":"2023-08-10T10:50:41.612780+0000","last_peered":"2023-08-10T10:50:41.612780+0000","last_clean":"2023-08-10T10:50:41.612780+0000","last_became_active":"2023-08-10T10:48:42.581516+0000","last_became_peered":"2023-08-10T10:48:42.581516+0000","last_unstale":"2023-08-10T10:50:41.612780+0000","last_undegraded":"2023-08-10T10:50:41.612780+0000","last_fullsized":"2023-08-10T10:50:41.612780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:31.423759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535687+0000","last_change":"2023-08-10T10:48:46.629922+0000","last_active":"2023-08-10T10:50:14.535687+0000","last_peered":"2023-08-10T10:50:14.535687+0000","last_clean":"2023-08-10T10:50:14.535687+0000","last_became_active":"2023-08-10T10:48:46.629079+0000","last_became_peered":"2023-08-10T10:48:46.629079+0000","last_unstale":"2023-08-10T10:50:14.535687+0000","last_undegraded":"2023-08-10T10:50:14.535687+0000","last_fullsized":"2023-08-10T10:50:14.535687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:34.096219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767304+0000","last_change":"2023-08-10T10:48:41.580410+0000","last_active":"2023-08-10T10:50:13.767304+0000","last_peered":"2023-08-10T10:50:13.767304+0000","last_clean":"2023-08-10T10:50:13.767304+0000","last_became_active":"2023-08-10T10:48:41.580032+0000","last_became_peered":"2023-08-10T10:48:41.580032+0000","last_unstale":"2023-08-10T10:50:13.767304+0000","last_undegraded":"2023-08-10T10:50:13.767304+0000","last_fullsized":"2023-08-10T10:50:13.767304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:55:53.357399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613845+0000","last_change":"2023-08-10T10:48:42.582297+0000","last_active":"2023-08-10T10:50:41.613845+0000","last_peered":"2023-08-10T10:50:41.613845+0000","last_clean":"2023-08-10T10:50:41.613845+0000","last_became_active":"2023-08-10T10:48:42.581966+0000","last_became_peered":"2023-08-10T10:48:42.581966+0000","last_unstale":"2023-08-10T10:50:41.613845+0000","last_undegraded":"2023-08-10T10:50:41.613845+0000","last_fullsized":"2023-08-10T10:50:41.613845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:40.949436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.180236+0000","last_change":"2023-08-10T10:48:46.622376+0000","last_active":"2023-08-10T10:50:14.180236+0000","last_peered":"2023-08-10T10:50:14.180236+0000","last_clean":"2023-08-10T10:50:14.180236+0000","last_became_active":"2023-08-10T10:48:46.621872+0000","last_became_peered":"2023-08-10T10:48:46.621872+0000","last_unstale":"2023-08-10T10:50:14.180236+0000","last_undegraded":"2023-08-10T10:50:14.180236+0000","last_fullsized":"2023-08-10T10:50:14.180236+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:09.411007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722298+0000","last_change":"2023-08-10T10:48:41.585309+0000","last_active":"2023-08-10T10:50:13.722298+0000","last_peered":"2023-08-10T10:50:13.722298+0000","last_clean":"2023-08-10T10:50:13.722298+0000","last_became_active":"2023-08-10T10:48:41.585007+0000","last_became_peered":"2023-08-10T10:48:41.585007+0000","last_unstale":"2023-08-10T10:50:13.722298+0000","last_undegraded":"2023-08-10T10:50:13.722298+0000","last_fullsized":"2023-08-10T10:50:13.722298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:27.841219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.611216+0000","last_change":"2023-08-10T10:48:42.575404+0000","last_active":"2023-08-10T10:50:41.611216+0000","last_peered":"2023-08-10T10:50:41.611216+0000","last_clean":"2023-08-10T10:50:41.611216+0000","last_became_active":"2023-08-10T10:48:42.575072+0000","last_became_peered":"2023-08-10T10:48:42.575072+0000","last_unstale":"2023-08-10T10:50:41.611216+0000","last_undegraded":"2023-08-10T10:50:41.611216+0000","last_fullsized":"2023-08-10T10:50:41.611216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:34.330583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535460+0000","last_change":"2023-08-10T10:48:46.627175+0000","last_active":"2023-08-10T10:50:14.535460+0000","last_peered":"2023-08-10T10:50:14.535460+0000","last_clean":"2023-08-10T10:50:14.535460+0000","last_became_active":"2023-08-10T10:48:46.626639+0000","last_became_peered":"2023-08-10T10:48:46.626639+0000","last_unstale":"2023-08-10T10:50:14.535460+0000","last_undegraded":"2023-08-10T10:50:14.535460+0000","last_fullsized":"2023-08-10T10:50:14.535460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:57.748936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"93'6","reported_seq":233,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.789872+0000","last_change":"2023-08-10T10:48:41.585185+0000","last_active":"2023-08-10T10:50:52.789872+0000","last_peered":"2023-08-10T10:50:52.789872+0000","last_clean":"2023-08-10T10:50:52.789872+0000","last_became_active":"2023-08-10T10:48:41.584834+0000","last_became_peered":"2023-08-10T10:48:41.584834+0000","last_unstale":"2023-08-10T10:50:52.789872+0000","last_undegraded":"2023-08-10T10:50:52.789872+0000","last_fullsized":"2023-08-10T10:50:52.789872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:54.728641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":197,"num_read_kb":197,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.619413+0000","last_change":"2023-08-10T10:48:42.574634+0000","last_active":"2023-08-10T10:50:41.619413+0000","last_peered":"2023-08-10T10:50:41.619413+0000","last_clean":"2023-08-10T10:50:41.619413+0000","last_became_active":"2023-08-10T10:48:42.574290+0000","last_became_peered":"2023-08-10T10:48:42.574290+0000","last_unstale":"2023-08-10T10:50:41.619413+0000","last_undegraded":"2023-08-10T10:50:41.619413+0000","last_fullsized":"2023-08-10T10:50:41.619413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:11.236874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695207+0000","last_change":"2023-08-10T10:48:46.627158+0000","last_active":"2023-08-10T10:50:13.695207+0000","last_peered":"2023-08-10T10:50:13.695207+0000","last_clean":"2023-08-10T10:50:13.695207+0000","last_became_active":"2023-08-10T10:48:46.626686+0000","last_became_peered":"2023-08-10T10:48:46.626686+0000","last_unstale":"2023-08-10T10:50:13.695207+0000","last_undegraded":"2023-08-10T10:50:13.695207+0000","last_fullsized":"2023-08-10T10:50:13.695207+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:08:23.207529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696463+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:50:13.696463+0000","last_peered":"2023-08-10T10:50:13.696463+0000","last_clean":"2023-08-10T10:50:13.696463+0000","last_became_active":"2023-08-10T10:48:41.586573+0000","last_became_peered":"2023-08-10T10:48:41.586573+0000","last_unstale":"2023-08-10T10:50:13.696463+0000","last_undegraded":"2023-08-10T10:50:13.696463+0000","last_fullsized":"2023-08-10T10:50:13.696463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:31:32.564891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615637+0000","last_change":"2023-08-10T10:48:42.584454+0000","last_active":"2023-08-10T10:50:41.615637+0000","last_peered":"2023-08-10T10:50:41.615637+0000","last_clean":"2023-08-10T10:50:41.615637+0000","last_became_active":"2023-08-10T10:48:42.584098+0000","last_became_peered":"2023-08-10T10:48:42.584098+0000","last_unstale":"2023-08-10T10:50:41.615637+0000","last_undegraded":"2023-08-10T10:50:41.615637+0000","last_fullsized":"2023-08-10T10:50:41.615637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:32:46.667672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770023+0000","last_change":"2023-08-10T10:48:46.635451+0000","last_active":"2023-08-10T10:50:13.770023+0000","last_peered":"2023-08-10T10:50:13.770023+0000","last_clean":"2023-08-10T10:50:13.770023+0000","last_became_active":"2023-08-10T10:48:46.634768+0000","last_became_peered":"2023-08-10T10:48:46.634768+0000","last_unstale":"2023-08-10T10:50:13.770023+0000","last_undegraded":"2023-08-10T10:50:13.770023+0000","last_fullsized":"2023-08-10T10:50:13.770023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:56:41.981210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722713+0000","last_change":"2023-08-10T10:48:41.586720+0000","last_active":"2023-08-10T10:50:13.722713+0000","last_peered":"2023-08-10T10:50:13.722713+0000","last_clean":"2023-08-10T10:50:13.722713+0000","last_became_active":"2023-08-10T10:48:41.586365+0000","last_became_peered":"2023-08-10T10:48:41.586365+0000","last_unstale":"2023-08-10T10:50:13.722713+0000","last_undegraded":"2023-08-10T10:50:13.722713+0000","last_fullsized":"2023-08-10T10:50:13.722713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:58:16.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.619239+0000","last_change":"2023-08-10T10:49:12.715509+0000","last_active":"2023-08-10T10:50:41.619239+0000","last_peered":"2023-08-10T10:50:41.619239+0000","last_clean":"2023-08-10T10:50:41.619239+0000","last_became_active":"2023-08-10T10:49:12.714785+0000","last_became_peered":"2023-08-10T10:49:12.714785+0000","last_unstale":"2023-08-10T10:50:41.619239+0000","last_undegraded":"2023-08-10T10:50:41.619239+0000","last_fullsized":"2023-08-10T10:50:41.619239+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:26.400386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695336+0000","last_change":"2023-08-10T10:48:46.630613+0000","last_active":"2023-08-10T10:50:13.695336+0000","last_peered":"2023-08-10T10:50:13.695336+0000","last_clean":"2023-08-10T10:50:13.695336+0000","last_became_active":"2023-08-10T10:48:46.630152+0000","last_became_peered":"2023-08-10T10:48:46.630152+0000","last_unstale":"2023-08-10T10:50:13.695336+0000","last_undegraded":"2023-08-10T10:50:13.695336+0000","last_fullsized":"2023-08-10T10:50:13.695336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:39.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'38","reported_seq":278,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.800789+0000","last_change":"2023-08-10T10:48:41.583291+0000","last_active":"2023-08-10T10:50:52.800789+0000","last_peered":"2023-08-10T10:50:52.800789+0000","last_clean":"2023-08-10T10:50:52.800789+0000","last_became_active":"2023-08-10T10:48:41.582894+0000","last_became_peered":"2023-08-10T10:48:41.582894+0000","last_unstale":"2023-08-10T10:50:52.800789+0000","last_undegraded":"2023-08-10T10:50:52.800789+0000","last_fullsized":"2023-08-10T10:50:52.800789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:56:24.559908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60540,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":210,"num_read_kb":164,"num_write":40,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.606334+0000","last_change":"2023-08-10T10:48:42.582097+0000","last_active":"2023-08-10T10:50:41.606334+0000","last_peered":"2023-08-10T10:50:41.606334+0000","last_clean":"2023-08-10T10:50:41.606334+0000","last_became_active":"2023-08-10T10:48:42.581622+0000","last_became_peered":"2023-08-10T10:48:42.581622+0000","last_unstale":"2023-08-10T10:50:41.606334+0000","last_undegraded":"2023-08-10T10:50:41.606334+0000","last_fullsized":"2023-08-10T10:50:41.606334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:46:01.211831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.723017+0000","last_change":"2023-08-10T10:48:46.628850+0000","last_active":"2023-08-10T10:50:13.723017+0000","last_peered":"2023-08-10T10:50:13.723017+0000","last_clean":"2023-08-10T10:50:13.723017+0000","last_became_active":"2023-08-10T10:48:46.628060+0000","last_became_peered":"2023-08-10T10:48:46.628060+0000","last_unstale":"2023-08-10T10:50:13.723017+0000","last_undegraded":"2023-08-10T10:50:13.723017+0000","last_fullsized":"2023-08-10T10:50:13.723017+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:54:47.710911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535364+0000","last_change":"2023-08-10T10:49:12.726708+0000","last_active":"2023-08-10T10:50:14.535364+0000","last_peered":"2023-08-10T10:50:14.535364+0000","last_clean":"2023-08-10T10:50:14.535364+0000","last_became_active":"2023-08-10T10:49:12.718963+0000","last_became_peered":"2023-08-10T10:49:12.718963+0000","last_unstale":"2023-08-10T10:50:14.535364+0000","last_undegraded":"2023-08-10T10:50:14.535364+0000","last_fullsized":"2023-08-10T10:50:14.535364+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:38.518813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.605808+0000","last_change":"2023-08-10T10:48:42.583174+0000","last_active":"2023-08-10T10:50:41.605808+0000","last_peered":"2023-08-10T10:50:41.605808+0000","last_clean":"2023-08-10T10:50:41.605808+0000","last_became_active":"2023-08-10T10:48:42.582869+0000","last_became_peered":"2023-08-10T10:48:42.582869+0000","last_unstale":"2023-08-10T10:50:41.605808+0000","last_undegraded":"2023-08-10T10:50:41.605808+0000","last_fullsized":"2023-08-10T10:50:41.605808+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:46:02.898669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535356+0000","last_change":"2023-08-10T10:48:46.629285+0000","last_active":"2023-08-10T10:50:14.535356+0000","last_peered":"2023-08-10T10:50:14.535356+0000","last_clean":"2023-08-10T10:50:14.535356+0000","last_became_active":"2023-08-10T10:48:46.628849+0000","last_became_peered":"2023-08-10T10:48:46.628849+0000","last_unstale":"2023-08-10T10:50:14.535356+0000","last_undegraded":"2023-08-10T10:50:14.535356+0000","last_fullsized":"2023-08-10T10:50:14.535356+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:54:42.082131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722598+0000","last_change":"2023-08-10T10:48:41.592802+0000","last_active":"2023-08-10T10:50:13.722598+0000","last_peered":"2023-08-10T10:50:13.722598+0000","last_clean":"2023-08-10T10:50:13.722598+0000","last_became_active":"2023-08-10T10:48:41.592443+0000","last_became_peered":"2023-08-10T10:48:41.592443+0000","last_unstale":"2023-08-10T10:50:13.722598+0000","last_undegraded":"2023-08-10T10:50:13.722598+0000","last_fullsized":"2023-08-10T10:50:13.722598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:45:13.131927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.618929+0000","last_change":"2023-08-10T10:48:42.586447+0000","last_active":"2023-08-10T10:50:41.618929+0000","last_peered":"2023-08-10T10:50:41.618929+0000","last_clean":"2023-08-10T10:50:41.618929+0000","last_became_active":"2023-08-10T10:48:42.586138+0000","last_became_peered":"2023-08-10T10:48:42.586138+0000","last_unstale":"2023-08-10T10:50:41.618929+0000","last_undegraded":"2023-08-10T10:50:41.618929+0000","last_fullsized":"2023-08-10T10:50:41.618929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:07:42.241288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699973+0000","last_change":"2023-08-10T10:49:12.732915+0000","last_active":"2023-08-10T10:50:13.699973+0000","last_peered":"2023-08-10T10:50:13.699973+0000","last_clean":"2023-08-10T10:50:13.699973+0000","last_became_active":"2023-08-10T10:49:12.732428+0000","last_became_peered":"2023-08-10T10:49:12.732428+0000","last_unstale":"2023-08-10T10:50:13.699973+0000","last_undegraded":"2023-08-10T10:50:13.699973+0000","last_fullsized":"2023-08-10T10:50:13.699973+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:35.093865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"93'8","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.824763+0000","last_change":"2023-08-10T10:48:41.588502+0000","last_active":"2023-08-10T10:50:51.824763+0000","last_peered":"2023-08-10T10:50:51.824763+0000","last_clean":"2023-08-10T10:50:51.824763+0000","last_became_active":"2023-08-10T10:48:41.588155+0000","last_became_peered":"2023-08-10T10:48:41.588155+0000","last_unstale":"2023-08-10T10:50:51.824763+0000","last_undegraded":"2023-08-10T10:50:51.824763+0000","last_fullsized":"2023-08-10T10:50:51.824763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:11:09.373862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.618396+0000","last_change":"2023-08-10T10:48:42.578175+0000","last_active":"2023-08-10T10:50:41.618396+0000","last_peered":"2023-08-10T10:50:41.618396+0000","last_clean":"2023-08-10T10:50:41.618396+0000","last_became_active":"2023-08-10T10:48:42.577873+0000","last_became_peered":"2023-08-10T10:48:42.577873+0000","last_unstale":"2023-08-10T10:50:41.618396+0000","last_undegraded":"2023-08-10T10:50:41.618396+0000","last_fullsized":"2023-08-10T10:50:41.618396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:06:36.648519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767792+0000","last_change":"2023-08-10T10:49:12.719745+0000","last_active":"2023-08-10T10:50:13.767792+0000","last_peered":"2023-08-10T10:50:13.767792+0000","last_clean":"2023-08-10T10:50:13.767792+0000","last_became_active":"2023-08-10T10:49:12.719289+0000","last_became_peered":"2023-08-10T10:49:12.719289+0000","last_unstale":"2023-08-10T10:50:13.767792+0000","last_undegraded":"2023-08-10T10:50:13.767792+0000","last_fullsized":"2023-08-10T10:50:13.767792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:36.231582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699447+0000","last_change":"2023-08-10T10:48:41.594170+0000","last_active":"2023-08-10T10:50:13.699447+0000","last_peered":"2023-08-10T10:50:13.699447+0000","last_clean":"2023-08-10T10:50:13.699447+0000","last_became_active":"2023-08-10T10:48:41.593776+0000","last_became_peered":"2023-08-10T10:48:41.593776+0000","last_unstale":"2023-08-10T10:50:13.699447+0000","last_undegraded":"2023-08-10T10:50:13.699447+0000","last_fullsized":"2023-08-10T10:50:13.699447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:25:31.902019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621126+0000","last_change":"2023-08-10T10:48:42.589149+0000","last_active":"2023-08-10T10:50:41.621126+0000","last_peered":"2023-08-10T10:50:41.621126+0000","last_clean":"2023-08-10T10:50:41.621126+0000","last_became_active":"2023-08-10T10:48:42.588466+0000","last_became_peered":"2023-08-10T10:48:42.588466+0000","last_unstale":"2023-08-10T10:50:41.621126+0000","last_undegraded":"2023-08-10T10:50:41.621126+0000","last_fullsized":"2023-08-10T10:50:41.621126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:04:40.741096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.537728+0000","last_change":"2023-08-10T10:50:14.537293+0000","last_active":"2023-08-10T10:50:14.537728+0000","last_peered":"2023-08-10T10:50:14.537728+0000","last_clean":"2023-08-10T10:50:14.537728+0000","last_became_active":"2023-08-10T10:50:14.536816+0000","last_became_peered":"2023-08-10T10:50:14.536816+0000","last_unstale":"2023-08-10T10:50:14.537728+0000","last_undegraded":"2023-08-10T10:50:14.537728+0000","last_fullsized":"2023-08-10T10:50:14.537728+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:00:10.839229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.f","version":"93'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.665863+0000","last_change":"2023-08-10T10:48:41.590670+0000","last_active":"2023-08-10T10:50:52.665863+0000","last_peered":"2023-08-10T10:50:52.665863+0000","last_clean":"2023-08-10T10:50:52.665863+0000","last_became_active":"2023-08-10T10:48:41.589958+0000","last_became_peered":"2023-08-10T10:48:41.589958+0000","last_unstale":"2023-08-10T10:50:52.665863+0000","last_undegraded":"2023-08-10T10:50:52.665863+0000","last_fullsized":"2023-08-10T10:50:52.665863+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:36:57.008276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.606741+0000","last_change":"2023-08-10T10:48:42.581041+0000","last_active":"2023-08-10T10:50:41.606741+0000","last_peered":"2023-08-10T10:50:41.606741+0000","last_clean":"2023-08-10T10:50:41.606741+0000","last_became_active":"2023-08-10T10:48:42.580311+0000","last_became_peered":"2023-08-10T10:48:42.580311+0000","last_unstale":"2023-08-10T10:50:41.606741+0000","last_undegraded":"2023-08-10T10:50:41.606741+0000","last_fullsized":"2023-08-10T10:50:41.606741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:22.659342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699796+0000","last_change":"2023-08-10T10:48:46.907496+0000","last_active":"2023-08-10T10:50:13.699796+0000","last_peered":"2023-08-10T10:50:13.699796+0000","last_clean":"2023-08-10T10:50:13.699796+0000","last_became_active":"2023-08-10T10:48:46.907098+0000","last_became_peered":"2023-08-10T10:48:46.907098+0000","last_unstale":"2023-08-10T10:50:13.699796+0000","last_undegraded":"2023-08-10T10:50:13.699796+0000","last_fullsized":"2023-08-10T10:50:13.699796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:22:26.606996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695728+0000","last_change":"2023-08-10T10:48:41.585252+0000","last_active":"2023-08-10T10:50:13.695728+0000","last_peered":"2023-08-10T10:50:13.695728+0000","last_clean":"2023-08-10T10:50:13.695728+0000","last_became_active":"2023-08-10T10:48:41.583599+0000","last_became_peered":"2023-08-10T10:48:41.583599+0000","last_unstale":"2023-08-10T10:50:13.695728+0000","last_undegraded":"2023-08-10T10:50:13.695728+0000","last_fullsized":"2023-08-10T10:50:13.695728+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:50.051408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616656+0000","last_change":"2023-08-10T10:48:42.581317+0000","last_active":"2023-08-10T10:50:41.616656+0000","last_peered":"2023-08-10T10:50:41.616656+0000","last_clean":"2023-08-10T10:50:41.616656+0000","last_became_active":"2023-08-10T10:48:42.581012+0000","last_became_peered":"2023-08-10T10:48:42.581012+0000","last_unstale":"2023-08-10T10:50:41.616656+0000","last_undegraded":"2023-08-10T10:50:41.616656+0000","last_fullsized":"2023-08-10T10:50:41.616656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:28.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767680+0000","last_change":"2023-08-10T10:48:46.623489+0000","last_active":"2023-08-10T10:50:13.767680+0000","last_peered":"2023-08-10T10:50:13.767680+0000","last_clean":"2023-08-10T10:50:13.767680+0000","last_became_active":"2023-08-10T10:48:46.621968+0000","last_became_peered":"2023-08-10T10:48:46.621968+0000","last_unstale":"2023-08-10T10:50:13.767680+0000","last_undegraded":"2023-08-10T10:50:13.767680+0000","last_fullsized":"2023-08-10T10:50:13.767680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:57.091076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.819141+0000","last_change":"2023-08-10T10:48:41.579828+0000","last_active":"2023-08-10T10:50:52.819141+0000","last_peered":"2023-08-10T10:50:52.819141+0000","last_clean":"2023-08-10T10:50:52.819141+0000","last_became_active":"2023-08-10T10:48:41.579340+0000","last_became_peered":"2023-08-10T10:48:41.579340+0000","last_unstale":"2023-08-10T10:50:52.819141+0000","last_undegraded":"2023-08-10T10:50:52.819141+0000","last_fullsized":"2023-08-10T10:50:52.819141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:35:32.747605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1023,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617106+0000","last_change":"2023-08-10T10:49:12.733771+0000","last_active":"2023-08-10T10:50:41.617106+0000","last_peered":"2023-08-10T10:50:41.617106+0000","last_clean":"2023-08-10T10:50:41.617106+0000","last_became_active":"2023-08-10T10:49:12.733357+0000","last_became_peered":"2023-08-10T10:49:12.733357+0000","last_unstale":"2023-08-10T10:50:41.617106+0000","last_undegraded":"2023-08-10T10:50:41.617106+0000","last_fullsized":"2023-08-10T10:50:41.617106+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:26.666048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767683+0000","last_change":"2023-08-10T10:48:46.907982+0000","last_active":"2023-08-10T10:50:13.767683+0000","last_peered":"2023-08-10T10:50:13.767683+0000","last_clean":"2023-08-10T10:50:13.767683+0000","last_became_active":"2023-08-10T10:48:46.907184+0000","last_became_peered":"2023-08-10T10:48:46.907184+0000","last_unstale":"2023-08-10T10:50:13.767683+0000","last_undegraded":"2023-08-10T10:50:13.767683+0000","last_fullsized":"2023-08-10T10:50:13.767683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:37:44.678304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616051+0000","last_change":"2023-08-10T10:48:42.582808+0000","last_active":"2023-08-10T10:50:41.616051+0000","last_peered":"2023-08-10T10:50:41.616051+0000","last_clean":"2023-08-10T10:50:41.616051+0000","last_became_active":"2023-08-10T10:48:42.582517+0000","last_became_peered":"2023-08-10T10:48:42.582517+0000","last_unstale":"2023-08-10T10:50:41.616051+0000","last_undegraded":"2023-08-10T10:50:41.616051+0000","last_fullsized":"2023-08-10T10:50:41.616051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:48:51.550019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'6","reported_seq":139,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:55.829768+0000","last_change":"2023-08-10T10:48:41.594873+0000","last_active":"2023-08-10T10:50:55.829768+0000","last_peered":"2023-08-10T10:50:55.829768+0000","last_clean":"2023-08-10T10:50:55.829768+0000","last_became_active":"2023-08-10T10:48:41.594550+0000","last_became_peered":"2023-08-10T10:48:41.594550+0000","last_unstale":"2023-08-10T10:50:55.829768+0000","last_undegraded":"2023-08-10T10:50:55.829768+0000","last_fullsized":"2023-08-10T10:50:55.829768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:03:31.289927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696533+0000","last_change":"2023-08-10T10:48:46.626960+0000","last_active":"2023-08-10T10:50:13.696533+0000","last_peered":"2023-08-10T10:50:13.696533+0000","last_clean":"2023-08-10T10:50:13.696533+0000","last_became_active":"2023-08-10T10:48:46.626519+0000","last_became_peered":"2023-08-10T10:48:46.626519+0000","last_unstale":"2023-08-10T10:50:13.696533+0000","last_undegraded":"2023-08-10T10:50:13.696533+0000","last_fullsized":"2023-08-10T10:50:13.696533+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:10:15.398639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.620791+0000","last_change":"2023-08-10T10:48:42.578921+0000","last_active":"2023-08-10T10:50:41.620791+0000","last_peered":"2023-08-10T10:50:41.620791+0000","last_clean":"2023-08-10T10:50:41.620791+0000","last_became_active":"2023-08-10T10:48:42.578322+0000","last_became_peered":"2023-08-10T10:48:42.578322+0000","last_unstale":"2023-08-10T10:50:41.620791+0000","last_undegraded":"2023-08-10T10:50:41.620791+0000","last_fullsized":"2023-08-10T10:50:41.620791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:30.672144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770099+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:50:13.770099+0000","last_peered":"2023-08-10T10:50:13.770099+0000","last_clean":"2023-08-10T10:50:13.770099+0000","last_became_active":"2023-08-10T10:48:41.585217+0000","last_became_peered":"2023-08-10T10:48:41.585217+0000","last_unstale":"2023-08-10T10:50:13.770099+0000","last_undegraded":"2023-08-10T10:50:13.770099+0000","last_fullsized":"2023-08-10T10:50:13.770099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:08.790470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":362,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695907+0000","last_change":"2023-08-10T10:47:22.594211+0000","last_active":"2023-08-10T10:50:13.695907+0000","last_peered":"2023-08-10T10:50:13.695907+0000","last_clean":"2023-08-10T10:50:13.695907+0000","last_became_active":"2023-08-10T10:47:22.593742+0000","last_became_peered":"2023-08-10T10:47:22.593742+0000","last_unstale":"2023-08-10T10:50:13.695907+0000","last_undegraded":"2023-08-10T10:50:13.695907+0000","last_fullsized":"2023-08-10T10:50:13.695907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_clean_scrub_stamp":"2023-08-10T10:43:44.512037+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:36.018260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722905+0000","last_change":"2023-08-10T10:48:46.907769+0000","last_active":"2023-08-10T10:50:13.722905+0000","last_peered":"2023-08-10T10:50:13.722905+0000","last_clean":"2023-08-10T10:50:13.722905+0000","last_became_active":"2023-08-10T10:48:46.907241+0000","last_became_peered":"2023-08-10T10:48:46.907241+0000","last_unstale":"2023-08-10T10:50:13.722905+0000","last_undegraded":"2023-08-10T10:50:13.722905+0000","last_fullsized":"2023-08-10T10:50:13.722905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:45:20.554540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.604493+0000","last_change":"2023-08-10T10:48:42.587277+0000","last_active":"2023-08-10T10:50:41.604493+0000","last_peered":"2023-08-10T10:50:41.604493+0000","last_clean":"2023-08-10T10:50:41.604493+0000","last_became_active":"2023-08-10T10:48:42.586308+0000","last_became_peered":"2023-08-10T10:48:42.586308+0000","last_unstale":"2023-08-10T10:50:41.604493+0000","last_undegraded":"2023-08-10T10:50:41.604493+0000","last_fullsized":"2023-08-10T10:50:41.604493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:30:31.610095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696125+0000","last_change":"2023-08-10T10:48:41.587116+0000","last_active":"2023-08-10T10:50:13.696125+0000","last_peered":"2023-08-10T10:50:13.696125+0000","last_clean":"2023-08-10T10:50:13.696125+0000","last_became_active":"2023-08-10T10:48:41.586771+0000","last_became_peered":"2023-08-10T10:48:41.586771+0000","last_unstale":"2023-08-10T10:50:13.696125+0000","last_undegraded":"2023-08-10T10:50:13.696125+0000","last_fullsized":"2023-08-10T10:50:13.696125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:31.434737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535389+0000","last_change":"2023-08-10T10:48:46.625140+0000","last_active":"2023-08-10T10:50:14.535389+0000","last_peered":"2023-08-10T10:50:14.535389+0000","last_clean":"2023-08-10T10:50:14.535389+0000","last_became_active":"2023-08-10T10:48:46.624615+0000","last_became_peered":"2023-08-10T10:48:46.624615+0000","last_unstale":"2023-08-10T10:50:14.535389+0000","last_undegraded":"2023-08-10T10:50:14.535389+0000","last_fullsized":"2023-08-10T10:50:14.535389+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:08:05.843613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.700103+0000","last_change":"2023-08-10T10:48:41.589435+0000","last_active":"2023-08-10T10:50:13.700103+0000","last_peered":"2023-08-10T10:50:13.700103+0000","last_clean":"2023-08-10T10:50:13.700103+0000","last_became_active":"2023-08-10T10:48:41.589070+0000","last_became_peered":"2023-08-10T10:48:41.589070+0000","last_unstale":"2023-08-10T10:50:13.700103+0000","last_undegraded":"2023-08-10T10:50:13.700103+0000","last_fullsized":"2023-08-10T10:50:13.700103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:43:40.722261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.612864+0000","last_change":"2023-08-10T10:48:42.586352+0000","last_active":"2023-08-10T10:50:41.612864+0000","last_peered":"2023-08-10T10:50:41.612864+0000","last_clean":"2023-08-10T10:50:41.612864+0000","last_became_active":"2023-08-10T10:48:42.585955+0000","last_became_peered":"2023-08-10T10:48:42.585955+0000","last_unstale":"2023-08-10T10:50:41.612864+0000","last_undegraded":"2023-08-10T10:50:41.612864+0000","last_fullsized":"2023-08-10T10:50:41.612864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:39:33.549404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.534826+0000","last_change":"2023-08-10T10:48:46.907519+0000","last_active":"2023-08-10T10:50:14.534826+0000","last_peered":"2023-08-10T10:50:14.534826+0000","last_clean":"2023-08-10T10:50:14.534826+0000","last_became_active":"2023-08-10T10:48:46.907087+0000","last_became_peered":"2023-08-10T10:48:46.907087+0000","last_unstale":"2023-08-10T10:50:14.534826+0000","last_undegraded":"2023-08-10T10:50:14.534826+0000","last_fullsized":"2023-08-10T10:50:14.534826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:32.544474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.917019+0000","last_change":"2023-08-10T10:48:41.583746+0000","last_active":"2023-08-10T10:50:51.917019+0000","last_peered":"2023-08-10T10:50:51.917019+0000","last_clean":"2023-08-10T10:50:51.917019+0000","last_became_active":"2023-08-10T10:48:41.583321+0000","last_became_peered":"2023-08-10T10:48:41.583321+0000","last_unstale":"2023-08-10T10:50:51.917019+0000","last_undegraded":"2023-08-10T10:50:51.917019+0000","last_fullsized":"2023-08-10T10:50:51.917019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:55:33.137575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616495+0000","last_change":"2023-08-10T10:48:42.579942+0000","last_active":"2023-08-10T10:50:41.616495+0000","last_peered":"2023-08-10T10:50:41.616495+0000","last_clean":"2023-08-10T10:50:41.616495+0000","last_became_active":"2023-08-10T10:48:42.579561+0000","last_became_peered":"2023-08-10T10:48:42.579561+0000","last_unstale":"2023-08-10T10:50:41.616495+0000","last_undegraded":"2023-08-10T10:50:41.616495+0000","last_fullsized":"2023-08-10T10:50:41.616495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:58.430924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695861+0000","last_change":"2023-08-10T10:48:46.621499+0000","last_active":"2023-08-10T10:50:13.695861+0000","last_peered":"2023-08-10T10:50:13.695861+0000","last_clean":"2023-08-10T10:50:13.695861+0000","last_became_active":"2023-08-10T10:48:46.621076+0000","last_became_peered":"2023-08-10T10:48:46.621076+0000","last_unstale":"2023-08-10T10:50:13.695861+0000","last_undegraded":"2023-08-10T10:50:13.695861+0000","last_fullsized":"2023-08-10T10:50:13.695861+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:56.077491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770338+0000","last_change":"2023-08-10T10:48:41.585574+0000","last_active":"2023-08-10T10:50:13.770338+0000","last_peered":"2023-08-10T10:50:13.770338+0000","last_clean":"2023-08-10T10:50:13.770338+0000","last_became_active":"2023-08-10T10:48:41.585254+0000","last_became_peered":"2023-08-10T10:48:41.585254+0000","last_unstale":"2023-08-10T10:50:13.770338+0000","last_undegraded":"2023-08-10T10:50:13.770338+0000","last_fullsized":"2023-08-10T10:50:13.770338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:01.410863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615467+0000","last_change":"2023-08-10T10:48:42.584003+0000","last_active":"2023-08-10T10:50:41.615467+0000","last_peered":"2023-08-10T10:50:41.615467+0000","last_clean":"2023-08-10T10:50:41.615467+0000","last_became_active":"2023-08-10T10:48:42.583712+0000","last_became_peered":"2023-08-10T10:48:42.583712+0000","last_unstale":"2023-08-10T10:50:41.615467+0000","last_undegraded":"2023-08-10T10:50:41.615467+0000","last_fullsized":"2023-08-10T10:50:41.615467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:38:56.521128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770153+0000","last_change":"2023-08-10T10:48:46.908113+0000","last_active":"2023-08-10T10:50:13.770153+0000","last_peered":"2023-08-10T10:50:13.770153+0000","last_clean":"2023-08-10T10:50:13.770153+0000","last_became_active":"2023-08-10T10:48:46.907552+0000","last_became_peered":"2023-08-10T10:48:46.907552+0000","last_unstale":"2023-08-10T10:50:13.770153+0000","last_undegraded":"2023-08-10T10:50:13.770153+0000","last_fullsized":"2023-08-10T10:50:13.770153+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:59.307817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.012760+0000","last_change":"2023-08-10T10:48:41.584254+0000","last_active":"2023-08-10T10:50:14.012760+0000","last_peered":"2023-08-10T10:50:14.012760+0000","last_clean":"2023-08-10T10:50:14.012760+0000","last_became_active":"2023-08-10T10:48:41.583129+0000","last_became_peered":"2023-08-10T10:48:41.583129+0000","last_unstale":"2023-08-10T10:50:14.012760+0000","last_undegraded":"2023-08-10T10:50:14.012760+0000","last_fullsized":"2023-08-10T10:50:14.012760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:23.152095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.598754+0000","last_change":"2023-08-10T10:48:42.582264+0000","last_active":"2023-08-10T10:50:41.598754+0000","last_peered":"2023-08-10T10:50:41.598754+0000","last_clean":"2023-08-10T10:50:41.598754+0000","last_became_active":"2023-08-10T10:48:42.581542+0000","last_became_peered":"2023-08-10T10:48:42.581542+0000","last_unstale":"2023-08-10T10:50:41.598754+0000","last_undegraded":"2023-08-10T10:50:41.598754+0000","last_fullsized":"2023-08-10T10:50:41.598754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:21.881081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695569+0000","last_change":"2023-08-10T10:48:46.632019+0000","last_active":"2023-08-10T10:50:13.695569+0000","last_peered":"2023-08-10T10:50:13.695569+0000","last_clean":"2023-08-10T10:50:13.695569+0000","last_became_active":"2023-08-10T10:48:46.631510+0000","last_became_peered":"2023-08-10T10:48:46.631510+0000","last_unstale":"2023-08-10T10:50:13.695569+0000","last_undegraded":"2023-08-10T10:50:13.695569+0000","last_fullsized":"2023-08-10T10:50:13.695569+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:42.173606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535166+0000","last_change":"2023-08-10T10:48:41.591206+0000","last_active":"2023-08-10T10:50:14.535166+0000","last_peered":"2023-08-10T10:50:14.535166+0000","last_clean":"2023-08-10T10:50:14.535166+0000","last_became_active":"2023-08-10T10:48:41.590897+0000","last_became_peered":"2023-08-10T10:48:41.590897+0000","last_unstale":"2023-08-10T10:50:14.535166+0000","last_undegraded":"2023-08-10T10:50:14.535166+0000","last_fullsized":"2023-08-10T10:50:14.535166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:47.099891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.612127+0000","last_change":"2023-08-10T10:48:42.586470+0000","last_active":"2023-08-10T10:50:41.612127+0000","last_peered":"2023-08-10T10:50:41.612127+0000","last_clean":"2023-08-10T10:50:41.612127+0000","last_became_active":"2023-08-10T10:48:42.586109+0000","last_became_peered":"2023-08-10T10:48:42.586109+0000","last_unstale":"2023-08-10T10:50:41.612127+0000","last_undegraded":"2023-08-10T10:50:41.612127+0000","last_fullsized":"2023-08-10T10:50:41.612127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:02.527807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769837+0000","last_change":"2023-08-10T10:48:46.629886+0000","last_active":"2023-08-10T10:50:13.769837+0000","last_peered":"2023-08-10T10:50:13.769837+0000","last_clean":"2023-08-10T10:50:13.769837+0000","last_became_active":"2023-08-10T10:48:46.629403+0000","last_became_peered":"2023-08-10T10:48:46.629403+0000","last_unstale":"2023-08-10T10:50:13.769837+0000","last_undegraded":"2023-08-10T10:50:13.769837+0000","last_fullsized":"2023-08-10T10:50:13.769837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:13.690617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"93'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.357181+0000","last_change":"2023-08-10T10:48:41.593231+0000","last_active":"2023-08-10T10:50:52.357181+0000","last_peered":"2023-08-10T10:50:52.357181+0000","last_clean":"2023-08-10T10:50:52.357181+0000","last_became_active":"2023-08-10T10:48:41.592893+0000","last_became_peered":"2023-08-10T10:48:41.592893+0000","last_unstale":"2023-08-10T10:50:52.357181+0000","last_undegraded":"2023-08-10T10:50:52.357181+0000","last_fullsized":"2023-08-10T10:50:52.357181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:37:49.643933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.611175+0000","last_change":"2023-08-10T10:49:12.732774+0000","last_active":"2023-08-10T10:50:41.611175+0000","last_peered":"2023-08-10T10:50:41.611175+0000","last_clean":"2023-08-10T10:50:41.611175+0000","last_became_active":"2023-08-10T10:49:12.732277+0000","last_became_peered":"2023-08-10T10:49:12.732277+0000","last_unstale":"2023-08-10T10:50:41.611175+0000","last_undegraded":"2023-08-10T10:50:41.611175+0000","last_fullsized":"2023-08-10T10:50:41.611175+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:43:48.144206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770033+0000","last_change":"2023-08-10T10:48:46.908347+0000","last_active":"2023-08-10T10:50:13.770033+0000","last_peered":"2023-08-10T10:50:13.770033+0000","last_clean":"2023-08-10T10:50:13.770033+0000","last_became_active":"2023-08-10T10:48:46.907266+0000","last_became_peered":"2023-08-10T10:48:46.907266+0000","last_unstale":"2023-08-10T10:50:13.770033+0000","last_undegraded":"2023-08-10T10:50:13.770033+0000","last_fullsized":"2023-08-10T10:50:13.770033+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:39:11.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699637+0000","last_change":"2023-08-10T10:48:41.585055+0000","last_active":"2023-08-10T10:50:13.699637+0000","last_peered":"2023-08-10T10:50:13.699637+0000","last_clean":"2023-08-10T10:50:13.699637+0000","last_became_active":"2023-08-10T10:48:41.584676+0000","last_became_peered":"2023-08-10T10:48:41.584676+0000","last_unstale":"2023-08-10T10:50:13.699637+0000","last_undegraded":"2023-08-10T10:50:13.699637+0000","last_fullsized":"2023-08-10T10:50:13.699637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:20.879455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622529+0000","last_change":"2023-08-10T10:48:42.586764+0000","last_active":"2023-08-10T10:50:41.622529+0000","last_peered":"2023-08-10T10:50:41.622529+0000","last_clean":"2023-08-10T10:50:41.622529+0000","last_became_active":"2023-08-10T10:48:42.586177+0000","last_became_peered":"2023-08-10T10:48:42.586177+0000","last_unstale":"2023-08-10T10:50:41.622529+0000","last_undegraded":"2023-08-10T10:50:41.622529+0000","last_fullsized":"2023-08-10T10:50:41.622529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:36.400611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.012662+0000","last_change":"2023-08-10T10:48:46.626872+0000","last_active":"2023-08-10T10:50:14.012662+0000","last_peered":"2023-08-10T10:50:14.012662+0000","last_clean":"2023-08-10T10:50:14.012662+0000","last_became_active":"2023-08-10T10:48:46.626354+0000","last_became_peered":"2023-08-10T10:48:46.626354+0000","last_unstale":"2023-08-10T10:50:14.012662+0000","last_undegraded":"2023-08-10T10:50:14.012662+0000","last_fullsized":"2023-08-10T10:50:14.012662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:24:11.803864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"93'8","reported_seq":139,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.853543+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:50:51.853543+0000","last_peered":"2023-08-10T10:50:51.853543+0000","last_clean":"2023-08-10T10:50:51.853543+0000","last_became_active":"2023-08-10T10:48:41.586311+0000","last_became_peered":"2023-08-10T10:48:41.586311+0000","last_unstale":"2023-08-10T10:50:51.853543+0000","last_undegraded":"2023-08-10T10:50:51.853543+0000","last_fullsized":"2023-08-10T10:50:51.853543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.700845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2136,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622108+0000","last_change":"2023-08-10T10:48:42.577290+0000","last_active":"2023-08-10T10:50:41.622108+0000","last_peered":"2023-08-10T10:50:41.622108+0000","last_clean":"2023-08-10T10:50:41.622108+0000","last_became_active":"2023-08-10T10:48:42.576928+0000","last_became_peered":"2023-08-10T10:48:42.576928+0000","last_unstale":"2023-08-10T10:50:41.622108+0000","last_undegraded":"2023-08-10T10:50:41.622108+0000","last_fullsized":"2023-08-10T10:50:41.622108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:22:30.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.179915+0000","last_change":"2023-08-10T10:48:46.627842+0000","last_active":"2023-08-10T10:50:14.179915+0000","last_peered":"2023-08-10T10:50:14.179915+0000","last_clean":"2023-08-10T10:50:14.179915+0000","last_became_active":"2023-08-10T10:48:46.627472+0000","last_became_peered":"2023-08-10T10:48:46.627472+0000","last_unstale":"2023-08-10T10:50:14.179915+0000","last_undegraded":"2023-08-10T10:50:14.179915+0000","last_fullsized":"2023-08-10T10:50:14.179915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:06:48.140390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722566+0000","last_change":"2023-08-10T10:48:41.592742+0000","last_active":"2023-08-10T10:50:13.722566+0000","last_peered":"2023-08-10T10:50:13.722566+0000","last_clean":"2023-08-10T10:50:13.722566+0000","last_became_active":"2023-08-10T10:48:41.592409+0000","last_became_peered":"2023-08-10T10:48:41.592409+0000","last_unstale":"2023-08-10T10:50:13.722566+0000","last_undegraded":"2023-08-10T10:50:13.722566+0000","last_fullsized":"2023-08-10T10:50:13.722566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:07:28.885109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613982+0000","last_change":"2023-08-10T10:48:42.583444+0000","last_active":"2023-08-10T10:50:41.613982+0000","last_peered":"2023-08-10T10:50:41.613982+0000","last_clean":"2023-08-10T10:50:41.613982+0000","last_became_active":"2023-08-10T10:48:42.583073+0000","last_became_peered":"2023-08-10T10:48:42.583073+0000","last_unstale":"2023-08-10T10:50:41.613982+0000","last_undegraded":"2023-08-10T10:50:41.613982+0000","last_fullsized":"2023-08-10T10:50:41.613982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:23:10.749501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722087+0000","last_change":"2023-08-10T10:48:46.626340+0000","last_active":"2023-08-10T10:50:13.722087+0000","last_peered":"2023-08-10T10:50:13.722087+0000","last_clean":"2023-08-10T10:50:13.722087+0000","last_became_active":"2023-08-10T10:48:46.625867+0000","last_became_peered":"2023-08-10T10:48:46.625867+0000","last_unstale":"2023-08-10T10:50:13.722087+0000","last_undegraded":"2023-08-10T10:50:13.722087+0000","last_fullsized":"2023-08-10T10:50:13.722087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:40.288099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767768+0000","last_change":"2023-08-10T10:48:41.590734+0000","last_active":"2023-08-10T10:50:13.767768+0000","last_peered":"2023-08-10T10:50:13.767768+0000","last_clean":"2023-08-10T10:50:13.767768+0000","last_became_active":"2023-08-10T10:48:41.590433+0000","last_became_peered":"2023-08-10T10:48:41.590433+0000","last_unstale":"2023-08-10T10:50:13.767768+0000","last_undegraded":"2023-08-10T10:50:13.767768+0000","last_fullsized":"2023-08-10T10:50:13.767768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:08:56.564752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613324+0000","last_change":"2023-08-10T10:48:42.576628+0000","last_active":"2023-08-10T10:50:41.613324+0000","last_peered":"2023-08-10T10:50:41.613324+0000","last_clean":"2023-08-10T10:50:41.613324+0000","last_became_active":"2023-08-10T10:48:42.576285+0000","last_became_peered":"2023-08-10T10:48:42.576285+0000","last_unstale":"2023-08-10T10:50:41.613324+0000","last_undegraded":"2023-08-10T10:50:41.613324+0000","last_fullsized":"2023-08-10T10:50:41.613324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:56.152902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.609242+0000","last_change":"2023-08-10T10:48:42.579615+0000","last_active":"2023-08-10T10:50:41.609242+0000","last_peered":"2023-08-10T10:50:41.609242+0000","last_clean":"2023-08-10T10:50:41.609242+0000","last_became_active":"2023-08-10T10:48:42.579291+0000","last_became_peered":"2023-08-10T10:48:42.579291+0000","last_unstale":"2023-08-10T10:50:41.609242+0000","last_undegraded":"2023-08-10T10:50:41.609242+0000","last_fullsized":"2023-08-10T10:50:41.609242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:07:16.219311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.607050+0000","last_change":"2023-08-10T10:48:42.581358+0000","last_active":"2023-08-10T10:50:41.607050+0000","last_peered":"2023-08-10T10:50:41.607050+0000","last_clean":"2023-08-10T10:50:41.607050+0000","last_became_active":"2023-08-10T10:48:42.580942+0000","last_became_peered":"2023-08-10T10:48:42.580942+0000","last_unstale":"2023-08-10T10:50:41.607050+0000","last_undegraded":"2023-08-10T10:50:41.607050+0000","last_fullsized":"2023-08-10T10:50:41.607050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:15:15.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.610115+0000","last_change":"2023-08-10T10:48:42.574494+0000","last_active":"2023-08-10T10:50:41.610115+0000","last_peered":"2023-08-10T10:50:41.610115+0000","last_clean":"2023-08-10T10:50:41.610115+0000","last_became_active":"2023-08-10T10:48:42.574203+0000","last_became_peered":"2023-08-10T10:48:42.574203+0000","last_unstale":"2023-08-10T10:50:41.610115+0000","last_undegraded":"2023-08-10T10:50:41.610115+0000","last_fullsized":"2023-08-10T10:50:41.610115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:08:52.621504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615876+0000","last_change":"2023-08-10T10:48:42.587557+0000","last_active":"2023-08-10T10:50:41.615876+0000","last_peered":"2023-08-10T10:50:41.615876+0000","last_clean":"2023-08-10T10:50:41.615876+0000","last_became_active":"2023-08-10T10:48:42.587133+0000","last_became_peered":"2023-08-10T10:48:42.587133+0000","last_unstale":"2023-08-10T10:50:41.615876+0000","last_undegraded":"2023-08-10T10:50:41.615876+0000","last_fullsized":"2023-08-10T10:50:41.615876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:06:59.879669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.608431+0000","last_change":"2023-08-10T10:48:42.587283+0000","last_active":"2023-08-10T10:50:41.608431+0000","last_peered":"2023-08-10T10:50:41.608431+0000","last_clean":"2023-08-10T10:50:41.608431+0000","last_became_active":"2023-08-10T10:48:42.586118+0000","last_became_peered":"2023-08-10T10:48:42.586118+0000","last_unstale":"2023-08-10T10:50:41.608431+0000","last_undegraded":"2023-08-10T10:50:41.608431+0000","last_fullsized":"2023-08-10T10:50:41.608431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:07:02.654188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.607274+0000","last_change":"2023-08-10T10:48:42.580843+0000","last_active":"2023-08-10T10:50:41.607274+0000","last_peered":"2023-08-10T10:50:41.607274+0000","last_clean":"2023-08-10T10:50:41.607274+0000","last_became_active":"2023-08-10T10:48:42.579735+0000","last_became_peered":"2023-08-10T10:48:42.579735+0000","last_unstale":"2023-08-10T10:50:41.607274+0000","last_undegraded":"2023-08-10T10:50:41.607274+0000","last_fullsized":"2023-08-10T10:50:41.607274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.478217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622932+0000","last_change":"2023-08-10T10:48:42.580250+0000","last_active":"2023-08-10T10:50:41.622932+0000","last_peered":"2023-08-10T10:50:41.622932+0000","last_clean":"2023-08-10T10:50:41.622932+0000","last_became_active":"2023-08-10T10:48:42.579962+0000","last_became_peered":"2023-08-10T10:48:42.579962+0000","last_unstale":"2023-08-10T10:50:41.622932+0000","last_undegraded":"2023-08-10T10:50:41.622932+0000","last_fullsized":"2023-08-10T10:50:41.622932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:34:59.289236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613267+0000","last_change":"2023-08-10T10:48:42.582699+0000","last_active":"2023-08-10T10:50:41.613267+0000","last_peered":"2023-08-10T10:50:41.613267+0000","last_clean":"2023-08-10T10:50:41.613267+0000","last_became_active":"2023-08-10T10:48:42.582426+0000","last_became_peered":"2023-08-10T10:48:42.582426+0000","last_unstale":"2023-08-10T10:50:41.613267+0000","last_undegraded":"2023-08-10T10:50:41.613267+0000","last_fullsized":"2023-08-10T10:50:41.613267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:57.741362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.611264+0000","last_change":"2023-08-10T10:48:42.577483+0000","last_active":"2023-08-10T10:50:41.611264+0000","last_peered":"2023-08-10T10:50:41.611264+0000","last_clean":"2023-08-10T10:50:41.611264+0000","last_became_active":"2023-08-10T10:48:42.577195+0000","last_became_peered":"2023-08-10T10:48:42.577195+0000","last_unstale":"2023-08-10T10:50:41.611264+0000","last_undegraded":"2023-08-10T10:50:41.611264+0000","last_fullsized":"2023-08-10T10:50:41.611264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:51:45.123427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613773+0000","last_change":"2023-08-10T10:48:42.581129+0000","last_active":"2023-08-10T10:50:41.613773+0000","last_peered":"2023-08-10T10:50:41.613773+0000","last_clean":"2023-08-10T10:50:41.613773+0000","last_became_active":"2023-08-10T10:48:42.579350+0000","last_became_peered":"2023-08-10T10:48:42.579350+0000","last_unstale":"2023-08-10T10:50:41.613773+0000","last_undegraded":"2023-08-10T10:50:41.613773+0000","last_fullsized":"2023-08-10T10:50:41.613773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:08.947725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621899+0000","last_change":"2023-08-10T10:48:42.578167+0000","last_active":"2023-08-10T10:50:41.621899+0000","last_peered":"2023-08-10T10:50:41.621899+0000","last_clean":"2023-08-10T10:50:41.621899+0000","last_became_active":"2023-08-10T10:48:42.577571+0000","last_became_peered":"2023-08-10T10:48:42.577571+0000","last_unstale":"2023-08-10T10:50:41.621899+0000","last_undegraded":"2023-08-10T10:50:41.621899+0000","last_fullsized":"2023-08-10T10:50:41.621899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:55:49.584540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616759+0000","last_change":"2023-08-10T10:48:42.587207+0000","last_active":"2023-08-10T10:50:41.616759+0000","last_peered":"2023-08-10T10:50:41.616759+0000","last_clean":"2023-08-10T10:50:41.616759+0000","last_became_active":"2023-08-10T10:48:42.586848+0000","last_became_peered":"2023-08-10T10:48:42.586848+0000","last_unstale":"2023-08-10T10:50:41.616759+0000","last_undegraded":"2023-08-10T10:50:41.616759+0000","last_fullsized":"2023-08-10T10:50:41.616759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:15.743811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.605689+0000","last_change":"2023-08-10T10:48:42.580785+0000","last_active":"2023-08-10T10:50:41.605689+0000","last_peered":"2023-08-10T10:50:41.605689+0000","last_clean":"2023-08-10T10:50:41.605689+0000","last_became_active":"2023-08-10T10:48:42.580395+0000","last_became_peered":"2023-08-10T10:48:42.580395+0000","last_unstale":"2023-08-10T10:50:41.605689+0000","last_undegraded":"2023-08-10T10:50:41.605689+0000","last_fullsized":"2023-08-10T10:50:41.605689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:09.498136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250142,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69764,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1035,"num_read_kb":595,"num_write":260,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383721,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":520937,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.99299999999999999,"5min":1.494,"15min":1.494},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.97899999999999998,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76200000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.753,"15min":0.74299999999999999},"min":{"1min":0.63500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.042,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1140000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82699999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.069}]},{"osd":4,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.85199999999999998,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.226,"5min":1.272,"15min":1.272},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.55200000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.125}]},{"osd":5,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2669999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.75700000000000001,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.113}]},{"osd":6,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82299999999999995,"15min":0.82399999999999995},"min":{"1min":0.51600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.056,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.754,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.161,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.032}]},{"osd":7,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.90900000000000003,"15min":0.88800000000000001},"min":{"1min":0.68999999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.252,"5min":1.597,"15min":1.597},"last":1.155},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89000000000000001,"15min":0.88700000000000001},"min":{"1min":0.67000000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.173,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0549999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:50:42 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.94899999999999995,"15min":0.94099999999999995},"min":{"1min":0.80300000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90100000000000002,"15min":0.89500000000000002},"min":{"1min":0.65700000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.2230000000000001}]},{"osd":9,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.99399999999999999,"15min":0.96099999999999997},"min":{"1min":0.89900000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3180000000000001,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.95999999999999996,"15min":0.92100000000000004},"min":{"1min":0.77200000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2470000000000001,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":1.1950000000000001}]},{"osd":10,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93500000000000005,"15min":0.92400000000000004},"min":{"1min":0.753,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1559999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.099},{"interface":"front","average":{"1min":1.081,"5min":1.0109999999999999,"15min":0.98499999999999999},"min":{"1min":0.90300000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4019999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.2090000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1171456,"data_stored":1167894,"data_compressed":59704,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.627},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.504}]},{"osd":1,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.80100000000000005,"5min":1.355,"15min":1.355},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80400000000000005,"5min":1.494,"15min":1.494},"last":0.442}]},{"osd":2,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.47099999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.222,"15min":1.222},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.63700000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.095,"5min":1.198,"15min":1.198},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.78500000000000003,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.87,"15min":0.875},"min":{"1min":0.60599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.8259999999999996,"5min":5.8259999999999996,"15min":5.8259999999999996},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.77400000000000002,"15min":0.80900000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4259999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":0.82899999999999996},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3440000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.753}]},{"osd":5,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91400000000000003,"15min":0.94999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0600000000000001,"5min":1.369,"15min":1.369},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1459999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.90000000000000002,"15min":0.96399999999999997},"min":{"1min":0.56200000000000006,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.88,"5min":1.579,"15min":1.579},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.94199999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96999999999999997,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.53000000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.98499999999999999,"15min":1.0169999999999999},"min":{"1min":0.73599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2589999999999999,"5min":1.869,"15min":1.869},"last":0.871},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.997,"15min":1.0580000000000001},"min":{"1min":0.71699999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.006,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.79600000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.98099999999999998,"15min":1.0349999999999999},"min":{"1min":0.72999999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.91700000000000004,"5min":1.619,"15min":1.619},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.995,"15min":1.0649999999999999},"min":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0329999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.83599999999999997}]},{"osd":11,"last update":"Thu Aug 10 10:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.98699999999999999,"15min":1.002},"min":{"1min":0.81899999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3680000000000001,"5min":1.79,"15min":1.79},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.77400000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1060000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.89600000000000002}]}]},{"osd":9,"up_from":67,"seq":287762808883,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":523929,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.35499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.433}]},{"osd":1,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.86599999999999999},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.93200000000000005,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.024,"5min":1.077,"15min":1.077},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.747,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.157,"5min":1.167,"15min":1.167},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65000000000000002,"15min":0.68799999999999994},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3109999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.621},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.39700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75,"15min":0.78600000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86099999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.80200000000000005,"15min":0.84199999999999997},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0209999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81799999999999995,"15min":0.85399999999999998},"min":{"1min":0.53700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.111,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81999999999999995,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2110000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.081}]},{"osd":7,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.85399999999999998,"15min":0.90200000000000002},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.099,"5min":1.607,"15min":1.607},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.143,"5min":1.236,"15min":1.236},"last":0.81399999999999995}]},{"osd":8,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0229999999999999,"5min":1.319,"15min":1.319},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":0.94499999999999995},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84999999999999998,"15min":0.872},"min":{"1min":0.60099999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.90000000000000002,"15min":0.92200000000000004},"min":{"1min":0.66800000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3480000000000001,"5min":1.381,"15min":1.381},"last":0.90000000000000002}]},{"osd":11,"last update":"Thu Aug 10 10:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.85299999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.98699999999999999,"5min":1.244,"15min":1.244},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81899999999999995,"15min":0.82899999999999996},"min":{"1min":0.58399999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1439999999999999,"5min":1.216,"15min":1.216},"last":0.60199999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":519880,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.46200000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":5.1909999999999998,"5min":5.1909999999999998,"15min":5.1909999999999998},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.625,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.113,"15min":1.113},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.77600000000000002,"15min":0.76200000000000001},"min":{"1min":0.58799999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.99099999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.66300000000000003},"min":{"1min":0.45600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88200000000000001,"5min":1.103,"15min":1.103},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.65900000000000003},"min":{"1min":0.41599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.496}]},{"osd":3,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":5.1189999999999998,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.60199999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85299999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.755}]},{"osd":4,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.63600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98099999999999998,"5min":1.238,"15min":1.238},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85599999999999998,"15min":0.87},"min":{"1min":0.64800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.0589999999999999,"5min":1.214,"15min":1.214},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.749,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.036,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77800000000000002,"15min":0.81999999999999995},"min":{"1min":0.57999999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1359999999999999,"5min":1.236,"15min":1.236},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86199999999999999,"15min":0.89200000000000002},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.91300000000000003,"15min":0.92400000000000004},"min":{"1min":0.59899999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.1609999999999996,"5min":5.1609999999999996,"15min":5.1609999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89600000000000002,"15min":0.93799999999999994},"min":{"1min":0.67800000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1759999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90900000000000003,"15min":0.93500000000000005},"min":{"1min":0.65400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.091,"5min":1.29,"15min":1.29},"last":0.83799999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.88500000000000001,"15min":0.86899999999999999},"min":{"1min":0.76400000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1499999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.583},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.91600000000000004,"15min":0.89500000000000002},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0899999999999999,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.669}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.91700000000000004,"15min":0.88500000000000001},"min":{"1min":0.70699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.196,"5min":1.214,"15min":1.214},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.92600000000000005,"15min":0.91200000000000003},"min":{"1min":0.72199999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.246,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.82299999999999995}]},{"osd":11,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.76200000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.091,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.119,"5min":1.232,"15min":1.232},"last":0.65800000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332157,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":1117822,"data_compressed":59704,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0489999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99299999999999999,"5min":1.466,"15min":1.466},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68200000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.372},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.72999999999999998,"15min":0.76800000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90800000000000003,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.996,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.81999999999999995,"15min":0.82899999999999996},"min":{"1min":0.54300000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.2650000000000001,"5min":3.2650000000000001,"15min":3.2650000000000001},"last":0.624},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75900000000000001,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.87,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79400000000000004,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90600000000000003,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.877},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.82399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57799999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.004,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.66200000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.86799999999999999,"15min":0.89200000000000002},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.53900000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:50:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88700000000000001,"15min":0.872},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.101,"5min":1.379,"15min":1.379},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.87,"15min":0.874},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95199999999999996,"5min":1.357,"15min":1.357},"last":0.92400000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93899999999999995,"15min":0.96099999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.65900000000000003}]},{"osd":10,"last update":"Thu Aug 10 10:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88200000000000001,"15min":0.89300000000000002},"min":{"1min":0.63400000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.085,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.69399999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.127,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58299999999999996}]},{"osd":11,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98299999999999998,"15min":0.98499999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.151,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.97699999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495684,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":515772,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48799999999999999,"15min":0.46100000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3740000000000001,"5min":3.875,"15min":3.875},"last":0.629},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.278,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.38}]},{"osd":1,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.73199999999999998},"min":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.119,"5min":1.869,"15min":1.869},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.55400000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0449999999999999,"5min":1.296,"15min":1.296},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.48799999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.1359999999999999,"5min":2.198,"15min":2.198},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.51400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.749}]},{"osd":3,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0129999999999999,"5min":3.327,"15min":3.327},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":3.423,"15min":3.423},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.752},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0369999999999999,"5min":1.948,"15min":1.948},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77300000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0660000000000001,"5min":1.345,"15min":1.345},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.745,"15min":0.752},"min":{"1min":0.56899999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.1879999999999999,"5min":2.161,"15min":2.161},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.93700000000000006,"5min":1.982,"15min":1.982},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.58399999999999996}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4099999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85299999999999998},"min":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1499999999999999,"5min":1.429,"15min":1.429},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.88700000000000001,"15min":0.88900000000000001},"min":{"1min":0.52800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.878}]},{"osd":10,"last update":"Thu Aug 10 10:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.65200000000000002,"5min":0.63,"15min":0.63},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.73199999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.26,"5min":1.46,"15min":1.46},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.878,"15min":0.88900000000000001},"min":{"1min":0.68400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98099999999999998,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.73999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":577342,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.68799999999999994,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.26600000000000001},"max":{"1min":5.173,"5min":5.173,"15min":5.173},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.70799999999999996,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.28399999999999997},"max":{"1min":9.2070000000000007,"5min":9.2070000000000007,"15min":9.2070000000000007},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.748,"15min":0.63400000000000001},"min":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.32200000000000001},"max":{"1min":1.0189999999999999,"5min":1.25,"15min":1.25},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71899999999999997,"15min":0.61899999999999999},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.747,"15min":0.65700000000000003},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":4.3719999999999999,"5min":4.3719999999999999,"15min":4.3719999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.78200000000000003,"15min":0.68200000000000005},"min":{"1min":0.52700000000000002,"5min":0.443,"15min":0.377},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.47399999999999998},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.69599999999999995},"min":{"1min":0.59999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.99199999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77000000000000002,"15min":0.68200000000000005},"min":{"1min":0.65000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0029999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.79200000000000004,"15min":0.77300000000000002},"min":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":1.264,"15min":1.264},"last":0.873},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79900000000000004,"15min":0.74399999999999999},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0720000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.95699999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":0.78500000000000003},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1200000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0409999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.89800000000000002,"15min":0.877},"min":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.044,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.83999999999999997},"min":{"1min":0.70199999999999996,"5min":0.624,"15min":0.624},"max":{"1min":1.0129999999999999,"5min":1.46,"15min":1.46},"last":1.008}]},{"osd":9,"last update":"Thu Aug 10 10:50:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.88100000000000001,"15min":0.84899999999999998},"min":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98699999999999999,"5min":5.476,"15min":5.476},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.97199999999999998,"15min":0.93600000000000005},"min":{"1min":0.66500000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1639999999999999,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.98599999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":0.91500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0669999999999999,"5min":1.51,"15min":1.51},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.88500000000000001,"15min":0.90200000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1020000000000001,"5min":1.266,"15min":1.266},"last":0.88900000000000001}]},{"osd":11,"last update":"Thu Aug 10 10:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.0149999999999999,"15min":1.03},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.1499999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.99399999999999999,"15min":1.006},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.159,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738468,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":517759,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.65200000000000002,"15min":0.60299999999999998},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.67100000000000004,"15min":0.624},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70699999999999996,"15min":0.69299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.73799999999999999,"15min":0.70999999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.94699999999999995,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.67400000000000004},"min":{"1min":0.52000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90900000000000003,"5min":2.29,"15min":2.29},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:50:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.68899999999999995,"15min":0.65500000000000003},"min":{"1min":0.45600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73399999999999999,"15min":0.69399999999999995},"min":{"1min":0.57299999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.41099999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88800000000000001,"5min":2.657,"15min":2.657},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0860000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80200000000000005,"15min":0.81499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89200000000000002,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86299999999999999,"15min":0.879},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.99299999999999999,"5min":2.355,"15min":2.355},"last":0.70899999999999996}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.66100000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":1.77,"15min":1.77},"last":0.749},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.67300000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1970000000000001,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.81000000000000005}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.86799999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89400000000000002,"15min":0.89100000000000001},"min":{"1min":0.68700000000000006,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.874,"15min":0.879},"min":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.90600000000000003}]},{"osd":11,"last update":"Thu Aug 10 10:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.87,"15min":0.86099999999999999},"min":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.0389999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89500000000000002,"15min":0.90100000000000002},"min":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.04,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.92700000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":577518,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.72699999999999998,"15min":0.63800000000000001},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":9.548,"5min":9.548,"15min":9.548},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.70399999999999996,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":9.5,"5min":9.5,"15min":9.5},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.70499999999999996,"15min":0.625},"min":{"1min":0.55200000000000005,"5min":0.315,"15min":0.315},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.624},"min":{"1min":0.52000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.73599999999999999,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":3.9990000000000001,"5min":3.9990000000000001,"15min":3.9990000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.48799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98299999999999998,"5min":1.008,"15min":1.008},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.135,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59099999999999997,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96099999999999997,"5min":1.488,"15min":1.488},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.61799999999999999,"15min":0.55300000000000005},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.081,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83199999999999996,"15min":0.72199999999999998},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.3559999999999999,"5min":4.851,"15min":4.851},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.70799999999999996},"min":{"1min":0.58599999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2849999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.95499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90400000000000003,"15min":0.91500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.159,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.78300000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.087,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.95399999999999996}]},{"osd":9,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.80800000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.9379999999999997,"5min":4.9379999999999997,"15min":4.9379999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.508,"5min":0.94999999999999996,"15min":0.85799999999999998},"min":{"1min":0.78400000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":0.878}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.77800000000000002,"15min":0.74199999999999999},"min":{"1min":0.70199999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.93100000000000005,"15min":0.89700000000000002},"min":{"1min":0.77500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.204,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.86199999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.61499999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1,"5min":1.0289999999999999,"15min":1.034},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.748}]}]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":514714,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45700000000000002,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.375},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.443},"min":{"1min":0.311,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.91700000000000004,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.66000000000000003},"min":{"1min":0.46700000000000003,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69399999999999995,"15min":0.65400000000000003},"min":{"1min":0.54200000000000004,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.753,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1180000000000001,"5min":6.367,"15min":6.367},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.66900000000000004},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":1.004,"15min":1.004},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72299999999999998,"15min":0.70399999999999996},"min":{"1min":0.51500000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0489999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.86799999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.161,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Aug 10 10:50:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77300000000000002,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":6.3410000000000002,"15min":6.3410000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.53200000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95699999999999996,"5min":1.054,"15min":1.054},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.63400000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.76000000000000001},"min":{"1min":0.65500000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1519999999999999,"5min":1.327,"15min":1.327},"last":0.76700000000000002}]},{"osd":8,"last update":"Thu Aug 10 10:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.04,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.85799999999999998},"min":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.0880000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.753}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.82299999999999995,"15min":0.85999999999999999},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.069,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.879,"15min":0.89500000000000002},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.873,"15min":0.875},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73299999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":520377,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50900000000000001,"15min":0.48199999999999998},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":1.143,"5min":1.143,"15min":1.2310000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.497},"min":{"1min":0.42799999999999999,"5min":0.34300000000000003,"15min":0.29099999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.68799999999999994},"min":{"1min":0.47099999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93600000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.749,"15min":0.71099999999999997},"min":{"1min":0.60099999999999998,"5min":0.48199999999999998,"15min":0.47499999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.421},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.67900000000000005},"min":{"1min":0.54300000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67600000000000005,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.04,"5min":1.069,"15min":1.069},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77100000000000002,"15min":0.754},"min":{"1min":0.61199999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.204,"5min":1.377,"15min":1.377},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.77400000000000002,"15min":0.74199999999999999},"min":{"1min":0.61499999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.49099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98399999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.75800000000000001,"15min":0.72999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.76800000000000002,"15min":0.755},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.76400000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.91400000000000003,"15min":0.874},"min":{"1min":0.76200000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90300000000000002,"15min":0.88900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.92700000000000005}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84599999999999997,"15min":0.85299999999999998},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.0720000000000001,"5min":1.175,"15min":1.175},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.88400000000000001,"15min":0.872},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.93999999999999995}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.92900000000000005,"15min":0.92800000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.226,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88600000000000001,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.097,"5min":1.137,"15min":1.137},"last":0.79200000000000004}]},{"osd":11,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0089999999999999,"15min":1.0049999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.03}]}]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":1112003,"data_compressed":59704,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.093,"5min":0.70399999999999996,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":8.9320000000000004,"5min":8.9320000000000004,"15min":8.9320000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69699999999999995,"15min":0.67400000000000004},"min":{"1min":0.503,"5min":0.439,"15min":0.439},"max":{"1min":0.92900000000000005,"5min":1.073,"15min":1.073},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.014,"15min":1.014},"last":0.87}]},{"osd":2,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51900000000000002,"15min":0.499},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77200000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80800000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.751,"15min":0.72499999999999998},"min":{"1min":0.53100000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72799999999999998,"15min":0.69399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88400000000000001,"5min":1.141,"15min":1.141},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71099999999999997,"15min":0.69099999999999995},"min":{"1min":0.55900000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94499999999999995,"5min":1.321,"15min":1.321},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.57299999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77400000000000002,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.0129999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.56299999999999994,"5min":0.502,"15min":0.502},"max":{"1min":0.96999999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85199999999999998}]},{"osd":8,"last update":"Thu Aug 10 10:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.54500000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.89900000000000002,"5min":1.012,"15min":1.012},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83199999999999996,"5min":0.997,"15min":0.997},"last":0.97399999999999998}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83699999999999997,"15min":0.83399999999999996},"min":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.95899999999999996}]},{"osd":10,"last update":"Thu Aug 10 10:50:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.026,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.085,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:50:59.116 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-08-10T10:50:59.116 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:50:59.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.338+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2042625919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84101960 msgr2=0x7fac84101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.338+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2042625919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84101960 0x7fac84101dc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fac740099c0 tx=0x7fac74009cd0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.338+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2042625919 shutdown_connections 2023-08-10T10:50:59.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.338+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2042625919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac84102300 0x7fac84108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.338+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2042625919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac84100770 0x7fac84100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.338+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2042625919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84101960 0x7fac84101dc0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.338+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2042625919 >> 172.21.15.107:0/2042625919 conn(0x7fac840fbca0 msgr2=0x7fac840fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:59.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.338+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2042625919 shutdown_connections 2023-08-10T10:50:59.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.338+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2042625919 wait complete. 2023-08-10T10:50:59.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.339+0000 7fac8b5ff700 1 Processor -- start 2023-08-10T10:50:59.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.339+0000 7fac8b5ff700 1 -- start start 2023-08-10T10:50:59.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.339+0000 7fac8b5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac84100770 0x7fac84074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:59.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.339+0000 7fac8b5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac84101960 0x7fac84072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:59.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac8b5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84102300 0x7fac840730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:59.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac8b5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac84073840 con 0x7fac84102300 2023-08-10T10:50:59.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac8b5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac840739b0 con 0x7fac84100770 2023-08-10T10:50:59.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac8b5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac841a03e0 con 0x7fac84101960 2023-08-10T10:50:59.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac89b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84102300 0x7fac840730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:59.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac89b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84102300 0x7fac840730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44434/0 (socket says 172.21.15.107:44434) 2023-08-10T10:50:59.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac89b9c700 1 -- 172.21.15.107:0/2445361532 learned_addr learned my addr 172.21.15.107:0/2445361532 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:59.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac8939b700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac84100770 0x7fac84074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:59.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac88b9a700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac84101960 0x7fac84072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:59.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac89b9c700 1 -- 172.21.15.107:0/2445361532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac84101960 msgr2=0x7fac84072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac89b9c700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac84101960 0x7fac84072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac89b9c700 1 -- 172.21.15.107:0/2445361532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac84100770 msgr2=0x7fac84074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac89b9c700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac84100770 0x7fac84074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac89b9c700 1 -- 172.21.15.107:0/2445361532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac740095f0 con 0x7fac84102300 2023-08-10T10:50:59.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.340+0000 7fac89b9c700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84102300 0x7fac840730a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00ef30 tx=0x7fac7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:59.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.341+0000 7fac7a7fc700 1 -- 172.21.15.107:0/2445361532 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c018070 con 0x7fac84102300 2023-08-10T10:50:59.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.341+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac841a0660 con 0x7fac84102300 2023-08-10T10:50:59.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.341+0000 7fac7a7fc700 1 -- 172.21.15.107:0/2445361532 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac7c00f040 con 0x7fac84102300 2023-08-10T10:50:59.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.341+0000 7fac7a7fc700 1 -- 172.21.15.107:0/2445361532 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00cbc0 con 0x7fac84102300 2023-08-10T10:50:59.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.341+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac841a0b70 con 0x7fac84102300 2023-08-10T10:50:59.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.342+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8410be90 con 0x7fac84102300 2023-08-10T10:50:59.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.344+0000 7fac7a7fc700 1 -- 172.21.15.107:0/2445361532 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fac7c00cd80 con 0x7fac84102300 2023-08-10T10:50:59.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.345+0000 7fac7a7fc700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fac700a1220 0x7fac700a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:59.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.345+0000 7fac7a7fc700 1 -- 172.21.15.107:0/2445361532 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fac7c0cc6a0 con 0x7fac84102300 2023-08-10T10:50:59.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.346+0000 7fac8939b700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fac700a1220 0x7fac700a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:59.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.346+0000 7fac8939b700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fac700a1220 0x7fac700a36e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fac841017c0 tx=0x7fac8000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:59.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.349+0000 7fac7a7fc700 1 -- 172.21.15.107:0/2445361532 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fac7c095b60 con 0x7fac84102300 2023-08-10T10:50:59.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.543+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac84060bb0 con 0x7fac700a1220 2023-08-10T10:50:59.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.555+0000 7fac7a7fc700 1 -- 172.21.15.107:0/2445361532 <== mgr.14150 v2:172.21.15.107:6800/438388714 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426541 (secure 0 0 0) 0x7fac84060bb0 con 0x7fac700a1220 2023-08-10T10:50:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:50:59.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fac700a1220 msgr2=0x7fac700a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fac700a1220 0x7fac700a36e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fac841017c0 tx=0x7fac8000b410 comp rx=0 tx=0).stop 2023-08-10T10:50:59.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84102300 msgr2=0x7fac840730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84102300 0x7fac840730a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00ef30 tx=0x7fac7c00c3a0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 shutdown_connections 2023-08-10T10:50:59.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fac700a1220 0x7fac700a36e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac84100770 0x7fac84074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fac84102300 0x7fac840730a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 --2- 172.21.15.107:0/2445361532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac84101960 0x7fac84072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.560+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 >> 172.21.15.107:0/2445361532 conn(0x7fac840fbca0 msgr2=0x7fac840fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:59.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.561+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 shutdown_connections 2023-08-10T10:50:59.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.561+0000 7fac8b5ff700 1 -- 172.21.15.107:0/2445361532 wait complete. 2023-08-10T10:50:59.565 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2023-08-10T10:50:59.580 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2023-08-10T10:50:57.618387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660378,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1171,"num_read_kb":714,"num_write":443,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336748,"kb_used_data":12556,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124605076,"statfs":{"total":1151940427776,"available":1151595597824,"internally_reserved":0,"allocated":12857344,"data_stored":8185947,"data_compressed":390612,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":60,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003040"},"pg_stats":[{"pgid":"3.3f","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622275+0000","last_change":"2023-08-10T10:48:42.585259+0000","last_active":"2023-08-10T10:50:41.622275+0000","last_peered":"2023-08-10T10:50:41.622275+0000","last_clean":"2023-08-10T10:50:41.622275+0000","last_became_active":"2023-08-10T10:48:42.584501+0000","last_became_peered":"2023-08-10T10:48:42.584501+0000","last_unstale":"2023-08-10T10:50:41.622275+0000","last_undegraded":"2023-08-10T10:50:41.622275+0000","last_fullsized":"2023-08-10T10:50:41.622275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:56.485043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"93'4","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617518+0000","last_change":"2023-08-10T10:48:42.577812+0000","last_active":"2023-08-10T10:50:41.617518+0000","last_peered":"2023-08-10T10:50:41.617518+0000","last_clean":"2023-08-10T10:50:41.617518+0000","last_became_active":"2023-08-10T10:48:42.577499+0000","last_became_peered":"2023-08-10T10:48:42.577499+0000","last_unstale":"2023-08-10T10:50:41.617518+0000","last_undegraded":"2023-08-10T10:50:41.617518+0000","last_fullsized":"2023-08-10T10:50:41.617518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:06:40.664014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"93'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621396+0000","last_change":"2023-08-10T10:48:42.577302+0000","last_active":"2023-08-10T10:50:41.621396+0000","last_peered":"2023-08-10T10:50:41.621396+0000","last_clean":"2023-08-10T10:50:41.621396+0000","last_became_active":"2023-08-10T10:48:42.577022+0000","last_became_peered":"2023-08-10T10:48:42.577022+0000","last_unstale":"2023-08-10T10:50:41.621396+0000","last_undegraded":"2023-08-10T10:50:41.621396+0000","last_fullsized":"2023-08-10T10:50:41.621396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:04:39.641834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"93'8","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.602333+0000","last_change":"2023-08-10T10:48:42.577198+0000","last_active":"2023-08-10T10:50:41.602333+0000","last_peered":"2023-08-10T10:50:41.602333+0000","last_clean":"2023-08-10T10:50:41.602333+0000","last_became_active":"2023-08-10T10:48:42.576887+0000","last_became_peered":"2023-08-10T10:48:42.576887+0000","last_unstale":"2023-08-10T10:50:41.602333+0000","last_undegraded":"2023-08-10T10:50:41.602333+0000","last_fullsized":"2023-08-10T10:50:41.602333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:53.163140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"93'4","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.607900+0000","last_change":"2023-08-10T10:48:42.587532+0000","last_active":"2023-08-10T10:50:41.607900+0000","last_peered":"2023-08-10T10:50:41.607900+0000","last_clean":"2023-08-10T10:50:41.607900+0000","last_became_active":"2023-08-10T10:48:42.587199+0000","last_became_peered":"2023-08-10T10:48:42.587199+0000","last_unstale":"2023-08-10T10:50:41.607900+0000","last_undegraded":"2023-08-10T10:50:41.607900+0000","last_fullsized":"2023-08-10T10:50:41.607900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:17.189550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617602+0000","last_change":"2023-08-10T10:48:42.581998+0000","last_active":"2023-08-10T10:50:41.617602+0000","last_peered":"2023-08-10T10:50:41.617602+0000","last_clean":"2023-08-10T10:50:41.617602+0000","last_became_active":"2023-08-10T10:48:42.581683+0000","last_became_peered":"2023-08-10T10:48:42.581683+0000","last_unstale":"2023-08-10T10:50:41.617602+0000","last_undegraded":"2023-08-10T10:50:41.617602+0000","last_fullsized":"2023-08-10T10:50:41.617602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:32:29.246550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"93'5","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.614453+0000","last_change":"2023-08-10T10:48:42.578452+0000","last_active":"2023-08-10T10:50:41.614453+0000","last_peered":"2023-08-10T10:50:41.614453+0000","last_clean":"2023-08-10T10:50:41.614453+0000","last_became_active":"2023-08-10T10:48:42.577456+0000","last_became_peered":"2023-08-10T10:48:42.577456+0000","last_unstale":"2023-08-10T10:50:41.614453+0000","last_undegraded":"2023-08-10T10:50:41.614453+0000","last_fullsized":"2023-08-10T10:50:41.614453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:10:32.160703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613947+0000","last_change":"2023-08-10T10:48:42.578839+0000","last_active":"2023-08-10T10:50:41.613947+0000","last_peered":"2023-08-10T10:50:41.613947+0000","last_clean":"2023-08-10T10:50:41.613947+0000","last_became_active":"2023-08-10T10:48:42.578450+0000","last_became_peered":"2023-08-10T10:48:42.578450+0000","last_unstale":"2023-08-10T10:50:41.613947+0000","last_undegraded":"2023-08-10T10:50:41.613947+0000","last_fullsized":"2023-08-10T10:50:41.613947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:27.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"93'11","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.614776+0000","last_change":"2023-08-10T10:48:42.588533+0000","last_active":"2023-08-10T10:50:41.614776+0000","last_peered":"2023-08-10T10:50:41.614776+0000","last_clean":"2023-08-10T10:50:41.614776+0000","last_became_active":"2023-08-10T10:48:42.588205+0000","last_became_peered":"2023-08-10T10:48:42.588205+0000","last_unstale":"2023-08-10T10:50:41.614776+0000","last_undegraded":"2023-08-10T10:50:41.614776+0000","last_fullsized":"2023-08-10T10:50:41.614776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:24:40.499168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"93'16","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616444+0000","last_change":"2023-08-10T10:48:42.588606+0000","last_active":"2023-08-10T10:50:41.616444+0000","last_peered":"2023-08-10T10:50:41.616444+0000","last_clean":"2023-08-10T10:50:41.616444+0000","last_became_active":"2023-08-10T10:48:42.588261+0000","last_became_peered":"2023-08-10T10:48:42.588261+0000","last_unstale":"2023-08-10T10:50:41.616444+0000","last_undegraded":"2023-08-10T10:50:41.616444+0000","last_fullsized":"2023-08-10T10:50:41.616444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:38:05.898926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622139+0000","last_change":"2023-08-10T10:48:42.577245+0000","last_active":"2023-08-10T10:50:41.622139+0000","last_peered":"2023-08-10T10:50:41.622139+0000","last_clean":"2023-08-10T10:50:41.622139+0000","last_became_active":"2023-08-10T10:48:42.576512+0000","last_became_peered":"2023-08-10T10:48:42.576512+0000","last_unstale":"2023-08-10T10:50:41.622139+0000","last_undegraded":"2023-08-10T10:50:41.622139+0000","last_fullsized":"2023-08-10T10:50:41.622139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:18:10.408544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.608265+0000","last_change":"2023-08-10T10:48:42.590704+0000","last_active":"2023-08-10T10:50:41.608265+0000","last_peered":"2023-08-10T10:50:41.608265+0000","last_clean":"2023-08-10T10:50:41.608265+0000","last_became_active":"2023-08-10T10:48:42.590360+0000","last_became_peered":"2023-08-10T10:48:42.590360+0000","last_unstale":"2023-08-10T10:50:41.608265+0000","last_undegraded":"2023-08-10T10:50:41.608265+0000","last_fullsized":"2023-08-10T10:50:41.608265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:45.721572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"93'10","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.610049+0000","last_change":"2023-08-10T10:48:42.580072+0000","last_active":"2023-08-10T10:50:41.610049+0000","last_peered":"2023-08-10T10:50:41.610049+0000","last_clean":"2023-08-10T10:50:41.610049+0000","last_became_active":"2023-08-10T10:48:42.579745+0000","last_became_peered":"2023-08-10T10:48:42.579745+0000","last_unstale":"2023-08-10T10:50:41.610049+0000","last_undegraded":"2023-08-10T10:50:41.610049+0000","last_fullsized":"2023-08-10T10:50:41.610049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:32.312474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617574+0000","last_change":"2023-08-10T10:48:42.577050+0000","last_active":"2023-08-10T10:50:41.617574+0000","last_peered":"2023-08-10T10:50:41.617574+0000","last_clean":"2023-08-10T10:50:41.617574+0000","last_became_active":"2023-08-10T10:48:42.576686+0000","last_became_peered":"2023-08-10T10:48:42.576686+0000","last_unstale":"2023-08-10T10:50:41.617574+0000","last_undegraded":"2023-08-10T10:50:41.617574+0000","last_fullsized":"2023-08-10T10:50:41.617574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:29.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615362+0000","last_change":"2023-08-10T10:48:42.582939+0000","last_active":"2023-08-10T10:50:41.615362+0000","last_peered":"2023-08-10T10:50:41.615362+0000","last_clean":"2023-08-10T10:50:41.615362+0000","last_became_active":"2023-08-10T10:48:42.582560+0000","last_became_peered":"2023-08-10T10:48:42.582560+0000","last_unstale":"2023-08-10T10:50:41.615362+0000","last_undegraded":"2023-08-10T10:50:41.615362+0000","last_fullsized":"2023-08-10T10:50:41.615362+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:30.943272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622383+0000","last_change":"2023-08-10T10:48:42.577163+0000","last_active":"2023-08-10T10:50:41.622383+0000","last_peered":"2023-08-10T10:50:41.622383+0000","last_clean":"2023-08-10T10:50:41.622383+0000","last_became_active":"2023-08-10T10:48:42.576866+0000","last_became_peered":"2023-08-10T10:48:42.576866+0000","last_unstale":"2023-08-10T10:50:41.622383+0000","last_undegraded":"2023-08-10T10:50:41.622383+0000","last_fullsized":"2023-08-10T10:50:41.622383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:57.633997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622356+0000","last_change":"2023-08-10T10:48:42.585496+0000","last_active":"2023-08-10T10:50:41.622356+0000","last_peered":"2023-08-10T10:50:41.622356+0000","last_clean":"2023-08-10T10:50:41.622356+0000","last_became_active":"2023-08-10T10:48:42.584963+0000","last_became_peered":"2023-08-10T10:48:42.584963+0000","last_unstale":"2023-08-10T10:50:41.622356+0000","last_undegraded":"2023-08-10T10:50:41.622356+0000","last_fullsized":"2023-08-10T10:50:41.622356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:40:52.754606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.620347+0000","last_change":"2023-08-10T10:48:42.576038+0000","last_active":"2023-08-10T10:50:41.620347+0000","last_peered":"2023-08-10T10:50:41.620347+0000","last_clean":"2023-08-10T10:50:41.620347+0000","last_became_active":"2023-08-10T10:48:42.575660+0000","last_became_peered":"2023-08-10T10:48:42.575660+0000","last_unstale":"2023-08-10T10:50:41.620347+0000","last_undegraded":"2023-08-10T10:50:41.620347+0000","last_fullsized":"2023-08-10T10:50:41.620347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:57.869830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"93'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.609383+0000","last_change":"2023-08-10T10:48:42.573855+0000","last_active":"2023-08-10T10:50:41.609383+0000","last_peered":"2023-08-10T10:50:41.609383+0000","last_clean":"2023-08-10T10:50:41.609383+0000","last_became_active":"2023-08-10T10:48:42.573475+0000","last_became_peered":"2023-08-10T10:48:42.573475+0000","last_unstale":"2023-08-10T10:50:41.609383+0000","last_undegraded":"2023-08-10T10:50:41.609383+0000","last_fullsized":"2023-08-10T10:50:41.609383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:11:19.171470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695765+0000","last_change":"2023-08-10T10:48:46.628005+0000","last_active":"2023-08-10T10:50:13.695765+0000","last_peered":"2023-08-10T10:50:13.695765+0000","last_clean":"2023-08-10T10:50:13.695765+0000","last_became_active":"2023-08-10T10:48:46.627558+0000","last_became_peered":"2023-08-10T10:48:46.627558+0000","last_unstale":"2023-08-10T10:50:13.695765+0000","last_undegraded":"2023-08-10T10:50:13.695765+0000","last_fullsized":"2023-08-10T10:50:13.695765+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:55:25.084975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"93'14","reported_seq":141,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.815656+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:50:51.815656+0000","last_peered":"2023-08-10T10:50:51.815656+0000","last_clean":"2023-08-10T10:50:51.815656+0000","last_became_active":"2023-08-10T10:48:41.585341+0000","last_became_peered":"2023-08-10T10:48:41.585341+0000","last_unstale":"2023-08-10T10:50:51.815656+0000","last_undegraded":"2023-08-10T10:50:51.815656+0000","last_fullsized":"2023-08-10T10:50:51.815656+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:22.340986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613589+0000","last_change":"2023-08-10T10:48:42.580893+0000","last_active":"2023-08-10T10:50:41.613589+0000","last_peered":"2023-08-10T10:50:41.613589+0000","last_clean":"2023-08-10T10:50:41.613589+0000","last_became_active":"2023-08-10T10:48:42.580591+0000","last_became_peered":"2023-08-10T10:48:42.580591+0000","last_unstale":"2023-08-10T10:50:41.613589+0000","last_undegraded":"2023-08-10T10:50:41.613589+0000","last_fullsized":"2023-08-10T10:50:41.613589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:29.317087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769710+0000","last_change":"2023-08-10T10:48:46.635407+0000","last_active":"2023-08-10T10:50:13.769710+0000","last_peered":"2023-08-10T10:50:13.769710+0000","last_clean":"2023-08-10T10:50:13.769710+0000","last_became_active":"2023-08-10T10:48:46.634936+0000","last_became_peered":"2023-08-10T10:48:46.634936+0000","last_unstale":"2023-08-10T10:50:13.769710+0000","last_undegraded":"2023-08-10T10:50:13.769710+0000","last_fullsized":"2023-08-10T10:50:13.769710+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:54:05.307722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.536246+0000","last_change":"2023-08-10T10:48:41.588054+0000","last_active":"2023-08-10T10:50:14.536246+0000","last_peered":"2023-08-10T10:50:14.536246+0000","last_clean":"2023-08-10T10:50:14.536246+0000","last_became_active":"2023-08-10T10:48:41.587764+0000","last_became_peered":"2023-08-10T10:48:41.587764+0000","last_unstale":"2023-08-10T10:50:14.536246+0000","last_undegraded":"2023-08-10T10:50:14.536246+0000","last_fullsized":"2023-08-10T10:50:14.536246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:04:31.407258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621392+0000","last_change":"2023-08-10T10:48:42.581834+0000","last_active":"2023-08-10T10:50:41.621392+0000","last_peered":"2023-08-10T10:50:41.621392+0000","last_clean":"2023-08-10T10:50:41.621392+0000","last_became_active":"2023-08-10T10:48:42.581438+0000","last_became_peered":"2023-08-10T10:48:42.581438+0000","last_unstale":"2023-08-10T10:50:41.621392+0000","last_undegraded":"2023-08-10T10:50:41.621392+0000","last_fullsized":"2023-08-10T10:50:41.621392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:33:26.141023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769735+0000","last_change":"2023-08-10T10:49:12.737051+0000","last_active":"2023-08-10T10:50:13.769735+0000","last_peered":"2023-08-10T10:50:13.769735+0000","last_clean":"2023-08-10T10:50:13.769735+0000","last_became_active":"2023-08-10T10:49:12.736586+0000","last_became_peered":"2023-08-10T10:49:12.736586+0000","last_unstale":"2023-08-10T10:50:13.769735+0000","last_undegraded":"2023-08-10T10:50:13.769735+0000","last_fullsized":"2023-08-10T10:50:13.769735+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:03.060137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535593+0000","last_change":"2023-08-10T10:49:12.734942+0000","last_active":"2023-08-10T10:50:14.535593+0000","last_peered":"2023-08-10T10:50:14.535593+0000","last_clean":"2023-08-10T10:50:14.535593+0000","last_became_active":"2023-08-10T10:49:12.720078+0000","last_became_peered":"2023-08-10T10:49:12.720078+0000","last_unstale":"2023-08-10T10:50:14.535593+0000","last_undegraded":"2023-08-10T10:50:14.535593+0000","last_fullsized":"2023-08-10T10:50:14.535593+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:20:07.099664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.620117+0000","last_change":"2023-08-10T10:48:42.581222+0000","last_active":"2023-08-10T10:50:41.620117+0000","last_peered":"2023-08-10T10:50:41.620117+0000","last_clean":"2023-08-10T10:50:41.620117+0000","last_became_active":"2023-08-10T10:48:42.580885+0000","last_became_peered":"2023-08-10T10:48:42.580885+0000","last_unstale":"2023-08-10T10:50:41.620117+0000","last_undegraded":"2023-08-10T10:50:41.620117+0000","last_fullsized":"2023-08-10T10:50:41.620117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:16.221857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769667+0000","last_change":"2023-08-10T10:48:46.626985+0000","last_active":"2023-08-10T10:50:13.769667+0000","last_peered":"2023-08-10T10:50:13.769667+0000","last_clean":"2023-08-10T10:50:13.769667+0000","last_became_active":"2023-08-10T10:48:46.626292+0000","last_became_peered":"2023-08-10T10:48:46.626292+0000","last_unstale":"2023-08-10T10:50:13.769667+0000","last_undegraded":"2023-08-10T10:50:13.769667+0000","last_fullsized":"2023-08-10T10:50:13.769667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:51:41.700285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699726+0000","last_change":"2023-08-10T10:48:41.588563+0000","last_active":"2023-08-10T10:50:13.699726+0000","last_peered":"2023-08-10T10:50:13.699726+0000","last_clean":"2023-08-10T10:50:13.699726+0000","last_became_active":"2023-08-10T10:48:41.588250+0000","last_became_peered":"2023-08-10T10:48:41.588250+0000","last_unstale":"2023-08-10T10:50:13.699726+0000","last_undegraded":"2023-08-10T10:50:13.699726+0000","last_fullsized":"2023-08-10T10:50:13.699726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:04.678700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"93'15","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.618719+0000","last_change":"2023-08-10T10:49:12.714641+0000","last_active":"2023-08-10T10:50:41.618719+0000","last_peered":"2023-08-10T10:50:41.618719+0000","last_clean":"2023-08-10T10:50:41.618719+0000","last_became_active":"2023-08-10T10:49:12.714185+0000","last_became_peered":"2023-08-10T10:49:12.714185+0000","last_unstale":"2023-08-10T10:50:41.618719+0000","last_undegraded":"2023-08-10T10:50:41.618719+0000","last_fullsized":"2023-08-10T10:50:41.618719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:31:59.150048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696244+0000","last_change":"2023-08-10T10:48:46.630641+0000","last_active":"2023-08-10T10:50:13.696244+0000","last_peered":"2023-08-10T10:50:13.696244+0000","last_clean":"2023-08-10T10:50:13.696244+0000","last_became_active":"2023-08-10T10:48:46.630231+0000","last_became_peered":"2023-08-10T10:48:46.630231+0000","last_unstale":"2023-08-10T10:50:13.696244+0000","last_undegraded":"2023-08-10T10:50:13.696244+0000","last_fullsized":"2023-08-10T10:50:13.696244+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:31:33.419951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":141,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:53.792403+0000","last_change":"2023-08-10T10:48:41.586083+0000","last_active":"2023-08-10T10:50:53.792403+0000","last_peered":"2023-08-10T10:50:53.792403+0000","last_clean":"2023-08-10T10:50:53.792403+0000","last_became_active":"2023-08-10T10:48:41.585714+0000","last_became_peered":"2023-08-10T10:48:41.585714+0000","last_unstale":"2023-08-10T10:50:53.792403+0000","last_undegraded":"2023-08-10T10:50:53.792403+0000","last_fullsized":"2023-08-10T10:50:53.792403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:41:40.651578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.606688+0000","last_change":"2023-08-10T10:48:42.578007+0000","last_active":"2023-08-10T10:50:41.606688+0000","last_peered":"2023-08-10T10:50:41.606688+0000","last_clean":"2023-08-10T10:50:41.606688+0000","last_became_active":"2023-08-10T10:48:42.577687+0000","last_became_peered":"2023-08-10T10:48:42.577687+0000","last_unstale":"2023-08-10T10:50:41.606688+0000","last_undegraded":"2023-08-10T10:50:41.606688+0000","last_fullsized":"2023-08-10T10:50:41.606688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:34:45.948119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696195+0000","last_change":"2023-08-10T10:48:46.633618+0000","last_active":"2023-08-10T10:50:13.696195+0000","last_peered":"2023-08-10T10:50:13.696195+0000","last_clean":"2023-08-10T10:50:13.696195+0000","last_became_active":"2023-08-10T10:48:46.633223+0000","last_became_peered":"2023-08-10T10:48:46.633223+0000","last_unstale":"2023-08-10T10:50:13.696195+0000","last_undegraded":"2023-08-10T10:50:13.696195+0000","last_fullsized":"2023-08-10T10:50:13.696195+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:13:53.778786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.718969+0000","last_change":"2023-08-10T10:48:41.591262+0000","last_active":"2023-08-10T10:50:13.718969+0000","last_peered":"2023-08-10T10:50:13.718969+0000","last_clean":"2023-08-10T10:50:13.718969+0000","last_became_active":"2023-08-10T10:48:41.590879+0000","last_became_peered":"2023-08-10T10:48:41.590879+0000","last_unstale":"2023-08-10T10:50:13.718969+0000","last_undegraded":"2023-08-10T10:50:13.718969+0000","last_fullsized":"2023-08-10T10:50:13.718969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:45:45.414755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.612780+0000","last_change":"2023-08-10T10:48:42.581852+0000","last_active":"2023-08-10T10:50:41.612780+0000","last_peered":"2023-08-10T10:50:41.612780+0000","last_clean":"2023-08-10T10:50:41.612780+0000","last_became_active":"2023-08-10T10:48:42.581516+0000","last_became_peered":"2023-08-10T10:48:42.581516+0000","last_unstale":"2023-08-10T10:50:41.612780+0000","last_undegraded":"2023-08-10T10:50:41.612780+0000","last_fullsized":"2023-08-10T10:50:41.612780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:46:31.423759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535687+0000","last_change":"2023-08-10T10:48:46.629922+0000","last_active":"2023-08-10T10:50:14.535687+0000","last_peered":"2023-08-10T10:50:14.535687+0000","last_clean":"2023-08-10T10:50:14.535687+0000","last_became_active":"2023-08-10T10:48:46.629079+0000","last_became_peered":"2023-08-10T10:48:46.629079+0000","last_unstale":"2023-08-10T10:50:14.535687+0000","last_undegraded":"2023-08-10T10:50:14.535687+0000","last_fullsized":"2023-08-10T10:50:14.535687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:34.096219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767304+0000","last_change":"2023-08-10T10:48:41.580410+0000","last_active":"2023-08-10T10:50:13.767304+0000","last_peered":"2023-08-10T10:50:13.767304+0000","last_clean":"2023-08-10T10:50:13.767304+0000","last_became_active":"2023-08-10T10:48:41.580032+0000","last_became_peered":"2023-08-10T10:48:41.580032+0000","last_unstale":"2023-08-10T10:50:13.767304+0000","last_undegraded":"2023-08-10T10:50:13.767304+0000","last_fullsized":"2023-08-10T10:50:13.767304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:55:53.357399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613845+0000","last_change":"2023-08-10T10:48:42.582297+0000","last_active":"2023-08-10T10:50:41.613845+0000","last_peered":"2023-08-10T10:50:41.613845+0000","last_clean":"2023-08-10T10:50:41.613845+0000","last_became_active":"2023-08-10T10:48:42.581966+0000","last_became_peered":"2023-08-10T10:48:42.581966+0000","last_unstale":"2023-08-10T10:50:41.613845+0000","last_undegraded":"2023-08-10T10:50:41.613845+0000","last_fullsized":"2023-08-10T10:50:41.613845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:54:40.949436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.180236+0000","last_change":"2023-08-10T10:48:46.622376+0000","last_active":"2023-08-10T10:50:14.180236+0000","last_peered":"2023-08-10T10:50:14.180236+0000","last_clean":"2023-08-10T10:50:14.180236+0000","last_became_active":"2023-08-10T10:48:46.621872+0000","last_became_peered":"2023-08-10T10:48:46.621872+0000","last_unstale":"2023-08-10T10:50:14.180236+0000","last_undegraded":"2023-08-10T10:50:14.180236+0000","last_fullsized":"2023-08-10T10:50:14.180236+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:09.411007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722298+0000","last_change":"2023-08-10T10:48:41.585309+0000","last_active":"2023-08-10T10:50:13.722298+0000","last_peered":"2023-08-10T10:50:13.722298+0000","last_clean":"2023-08-10T10:50:13.722298+0000","last_became_active":"2023-08-10T10:48:41.585007+0000","last_became_peered":"2023-08-10T10:48:41.585007+0000","last_unstale":"2023-08-10T10:50:13.722298+0000","last_undegraded":"2023-08-10T10:50:13.722298+0000","last_fullsized":"2023-08-10T10:50:13.722298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:49:27.841219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"93'11","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.611216+0000","last_change":"2023-08-10T10:48:42.575404+0000","last_active":"2023-08-10T10:50:41.611216+0000","last_peered":"2023-08-10T10:50:41.611216+0000","last_clean":"2023-08-10T10:50:41.611216+0000","last_became_active":"2023-08-10T10:48:42.575072+0000","last_became_peered":"2023-08-10T10:48:42.575072+0000","last_unstale":"2023-08-10T10:50:41.611216+0000","last_undegraded":"2023-08-10T10:50:41.611216+0000","last_fullsized":"2023-08-10T10:50:41.611216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:34.330583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535460+0000","last_change":"2023-08-10T10:48:46.627175+0000","last_active":"2023-08-10T10:50:14.535460+0000","last_peered":"2023-08-10T10:50:14.535460+0000","last_clean":"2023-08-10T10:50:14.535460+0000","last_became_active":"2023-08-10T10:48:46.626639+0000","last_became_peered":"2023-08-10T10:48:46.626639+0000","last_unstale":"2023-08-10T10:50:14.535460+0000","last_undegraded":"2023-08-10T10:50:14.535460+0000","last_fullsized":"2023-08-10T10:50:14.535460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:57.748936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"93'6","reported_seq":233,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.789872+0000","last_change":"2023-08-10T10:48:41.585185+0000","last_active":"2023-08-10T10:50:52.789872+0000","last_peered":"2023-08-10T10:50:52.789872+0000","last_clean":"2023-08-10T10:50:52.789872+0000","last_became_active":"2023-08-10T10:48:41.584834+0000","last_became_peered":"2023-08-10T10:48:41.584834+0000","last_unstale":"2023-08-10T10:50:52.789872+0000","last_undegraded":"2023-08-10T10:50:52.789872+0000","last_fullsized":"2023-08-10T10:50:52.789872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:54.728641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":197,"num_read_kb":197,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"93'10","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.619413+0000","last_change":"2023-08-10T10:48:42.574634+0000","last_active":"2023-08-10T10:50:41.619413+0000","last_peered":"2023-08-10T10:50:41.619413+0000","last_clean":"2023-08-10T10:50:41.619413+0000","last_became_active":"2023-08-10T10:48:42.574290+0000","last_became_peered":"2023-08-10T10:48:42.574290+0000","last_unstale":"2023-08-10T10:50:41.619413+0000","last_undegraded":"2023-08-10T10:50:41.619413+0000","last_fullsized":"2023-08-10T10:50:41.619413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:11.236874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695207+0000","last_change":"2023-08-10T10:48:46.627158+0000","last_active":"2023-08-10T10:50:13.695207+0000","last_peered":"2023-08-10T10:50:13.695207+0000","last_clean":"2023-08-10T10:50:13.695207+0000","last_became_active":"2023-08-10T10:48:46.626686+0000","last_became_peered":"2023-08-10T10:48:46.626686+0000","last_unstale":"2023-08-10T10:50:13.695207+0000","last_undegraded":"2023-08-10T10:50:13.695207+0000","last_fullsized":"2023-08-10T10:50:13.695207+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:08:23.207529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696463+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:50:13.696463+0000","last_peered":"2023-08-10T10:50:13.696463+0000","last_clean":"2023-08-10T10:50:13.696463+0000","last_became_active":"2023-08-10T10:48:41.586573+0000","last_became_peered":"2023-08-10T10:48:41.586573+0000","last_unstale":"2023-08-10T10:50:13.696463+0000","last_undegraded":"2023-08-10T10:50:13.696463+0000","last_fullsized":"2023-08-10T10:50:13.696463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:31:32.564891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615637+0000","last_change":"2023-08-10T10:48:42.584454+0000","last_active":"2023-08-10T10:50:41.615637+0000","last_peered":"2023-08-10T10:50:41.615637+0000","last_clean":"2023-08-10T10:50:41.615637+0000","last_became_active":"2023-08-10T10:48:42.584098+0000","last_became_peered":"2023-08-10T10:48:42.584098+0000","last_unstale":"2023-08-10T10:50:41.615637+0000","last_undegraded":"2023-08-10T10:50:41.615637+0000","last_fullsized":"2023-08-10T10:50:41.615637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:32:46.667672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770023+0000","last_change":"2023-08-10T10:48:46.635451+0000","last_active":"2023-08-10T10:50:13.770023+0000","last_peered":"2023-08-10T10:50:13.770023+0000","last_clean":"2023-08-10T10:50:13.770023+0000","last_became_active":"2023-08-10T10:48:46.634768+0000","last_became_peered":"2023-08-10T10:48:46.634768+0000","last_unstale":"2023-08-10T10:50:13.770023+0000","last_undegraded":"2023-08-10T10:50:13.770023+0000","last_fullsized":"2023-08-10T10:50:13.770023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:56:41.981210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722713+0000","last_change":"2023-08-10T10:48:41.586720+0000","last_active":"2023-08-10T10:50:13.722713+0000","last_peered":"2023-08-10T10:50:13.722713+0000","last_clean":"2023-08-10T10:50:13.722713+0000","last_became_active":"2023-08-10T10:48:41.586365+0000","last_became_peered":"2023-08-10T10:48:41.586365+0000","last_unstale":"2023-08-10T10:50:13.722713+0000","last_undegraded":"2023-08-10T10:50:13.722713+0000","last_fullsized":"2023-08-10T10:50:13.722713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:58:16.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.619239+0000","last_change":"2023-08-10T10:49:12.715509+0000","last_active":"2023-08-10T10:50:41.619239+0000","last_peered":"2023-08-10T10:50:41.619239+0000","last_clean":"2023-08-10T10:50:41.619239+0000","last_became_active":"2023-08-10T10:49:12.714785+0000","last_became_peered":"2023-08-10T10:49:12.714785+0000","last_unstale":"2023-08-10T10:50:41.619239+0000","last_undegraded":"2023-08-10T10:50:41.619239+0000","last_fullsized":"2023-08-10T10:50:41.619239+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:26.400386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695336+0000","last_change":"2023-08-10T10:48:46.630613+0000","last_active":"2023-08-10T10:50:13.695336+0000","last_peered":"2023-08-10T10:50:13.695336+0000","last_clean":"2023-08-10T10:50:13.695336+0000","last_became_active":"2023-08-10T10:48:46.630152+0000","last_became_peered":"2023-08-10T10:48:46.630152+0000","last_unstale":"2023-08-10T10:50:13.695336+0000","last_undegraded":"2023-08-10T10:50:13.695336+0000","last_fullsized":"2023-08-10T10:50:13.695336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:39.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'38","reported_seq":278,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.800789+0000","last_change":"2023-08-10T10:48:41.583291+0000","last_active":"2023-08-10T10:50:52.800789+0000","last_peered":"2023-08-10T10:50:52.800789+0000","last_clean":"2023-08-10T10:50:52.800789+0000","last_became_active":"2023-08-10T10:48:41.582894+0000","last_became_peered":"2023-08-10T10:48:41.582894+0000","last_unstale":"2023-08-10T10:50:52.800789+0000","last_undegraded":"2023-08-10T10:50:52.800789+0000","last_fullsized":"2023-08-10T10:50:52.800789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:56:24.559908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60540,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":210,"num_read_kb":164,"num_write":40,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.606334+0000","last_change":"2023-08-10T10:48:42.582097+0000","last_active":"2023-08-10T10:50:41.606334+0000","last_peered":"2023-08-10T10:50:41.606334+0000","last_clean":"2023-08-10T10:50:41.606334+0000","last_became_active":"2023-08-10T10:48:42.581622+0000","last_became_peered":"2023-08-10T10:48:42.581622+0000","last_unstale":"2023-08-10T10:50:41.606334+0000","last_undegraded":"2023-08-10T10:50:41.606334+0000","last_fullsized":"2023-08-10T10:50:41.606334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:46:01.211831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.723017+0000","last_change":"2023-08-10T10:48:46.628850+0000","last_active":"2023-08-10T10:50:13.723017+0000","last_peered":"2023-08-10T10:50:13.723017+0000","last_clean":"2023-08-10T10:50:13.723017+0000","last_became_active":"2023-08-10T10:48:46.628060+0000","last_became_peered":"2023-08-10T10:48:46.628060+0000","last_unstale":"2023-08-10T10:50:13.723017+0000","last_undegraded":"2023-08-10T10:50:13.723017+0000","last_fullsized":"2023-08-10T10:50:13.723017+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:54:47.710911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535364+0000","last_change":"2023-08-10T10:49:12.726708+0000","last_active":"2023-08-10T10:50:14.535364+0000","last_peered":"2023-08-10T10:50:14.535364+0000","last_clean":"2023-08-10T10:50:14.535364+0000","last_became_active":"2023-08-10T10:49:12.718963+0000","last_became_peered":"2023-08-10T10:49:12.718963+0000","last_unstale":"2023-08-10T10:50:14.535364+0000","last_undegraded":"2023-08-10T10:50:14.535364+0000","last_fullsized":"2023-08-10T10:50:14.535364+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:38.518813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"93'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.605808+0000","last_change":"2023-08-10T10:48:42.583174+0000","last_active":"2023-08-10T10:50:41.605808+0000","last_peered":"2023-08-10T10:50:41.605808+0000","last_clean":"2023-08-10T10:50:41.605808+0000","last_became_active":"2023-08-10T10:48:42.582869+0000","last_became_peered":"2023-08-10T10:48:42.582869+0000","last_unstale":"2023-08-10T10:50:41.605808+0000","last_undegraded":"2023-08-10T10:50:41.605808+0000","last_fullsized":"2023-08-10T10:50:41.605808+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:46:02.898669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535356+0000","last_change":"2023-08-10T10:48:46.629285+0000","last_active":"2023-08-10T10:50:14.535356+0000","last_peered":"2023-08-10T10:50:14.535356+0000","last_clean":"2023-08-10T10:50:14.535356+0000","last_became_active":"2023-08-10T10:48:46.628849+0000","last_became_peered":"2023-08-10T10:48:46.628849+0000","last_unstale":"2023-08-10T10:50:14.535356+0000","last_undegraded":"2023-08-10T10:50:14.535356+0000","last_fullsized":"2023-08-10T10:50:14.535356+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:54:42.082131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722598+0000","last_change":"2023-08-10T10:48:41.592802+0000","last_active":"2023-08-10T10:50:13.722598+0000","last_peered":"2023-08-10T10:50:13.722598+0000","last_clean":"2023-08-10T10:50:13.722598+0000","last_became_active":"2023-08-10T10:48:41.592443+0000","last_became_peered":"2023-08-10T10:48:41.592443+0000","last_unstale":"2023-08-10T10:50:13.722598+0000","last_undegraded":"2023-08-10T10:50:13.722598+0000","last_fullsized":"2023-08-10T10:50:13.722598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:45:13.131927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"93'15","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.618929+0000","last_change":"2023-08-10T10:48:42.586447+0000","last_active":"2023-08-10T10:50:41.618929+0000","last_peered":"2023-08-10T10:50:41.618929+0000","last_clean":"2023-08-10T10:50:41.618929+0000","last_became_active":"2023-08-10T10:48:42.586138+0000","last_became_peered":"2023-08-10T10:48:42.586138+0000","last_unstale":"2023-08-10T10:50:41.618929+0000","last_undegraded":"2023-08-10T10:50:41.618929+0000","last_fullsized":"2023-08-10T10:50:41.618929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:07:42.241288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699973+0000","last_change":"2023-08-10T10:49:12.732915+0000","last_active":"2023-08-10T10:50:13.699973+0000","last_peered":"2023-08-10T10:50:13.699973+0000","last_clean":"2023-08-10T10:50:13.699973+0000","last_became_active":"2023-08-10T10:49:12.732428+0000","last_became_peered":"2023-08-10T10:49:12.732428+0000","last_unstale":"2023-08-10T10:50:13.699973+0000","last_undegraded":"2023-08-10T10:50:13.699973+0000","last_fullsized":"2023-08-10T10:50:13.699973+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:35.093865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"93'8","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.824763+0000","last_change":"2023-08-10T10:48:41.588502+0000","last_active":"2023-08-10T10:50:51.824763+0000","last_peered":"2023-08-10T10:50:51.824763+0000","last_clean":"2023-08-10T10:50:51.824763+0000","last_became_active":"2023-08-10T10:48:41.588155+0000","last_became_peered":"2023-08-10T10:48:41.588155+0000","last_unstale":"2023-08-10T10:50:51.824763+0000","last_undegraded":"2023-08-10T10:50:51.824763+0000","last_fullsized":"2023-08-10T10:50:51.824763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:11:09.373862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.618396+0000","last_change":"2023-08-10T10:48:42.578175+0000","last_active":"2023-08-10T10:50:41.618396+0000","last_peered":"2023-08-10T10:50:41.618396+0000","last_clean":"2023-08-10T10:50:41.618396+0000","last_became_active":"2023-08-10T10:48:42.577873+0000","last_became_peered":"2023-08-10T10:48:42.577873+0000","last_unstale":"2023-08-10T10:50:41.618396+0000","last_undegraded":"2023-08-10T10:50:41.618396+0000","last_fullsized":"2023-08-10T10:50:41.618396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:06:36.648519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767792+0000","last_change":"2023-08-10T10:49:12.719745+0000","last_active":"2023-08-10T10:50:13.767792+0000","last_peered":"2023-08-10T10:50:13.767792+0000","last_clean":"2023-08-10T10:50:13.767792+0000","last_became_active":"2023-08-10T10:49:12.719289+0000","last_became_peered":"2023-08-10T10:49:12.719289+0000","last_unstale":"2023-08-10T10:50:13.767792+0000","last_undegraded":"2023-08-10T10:50:13.767792+0000","last_fullsized":"2023-08-10T10:50:13.767792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:40:36.231582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699447+0000","last_change":"2023-08-10T10:48:41.594170+0000","last_active":"2023-08-10T10:50:13.699447+0000","last_peered":"2023-08-10T10:50:13.699447+0000","last_clean":"2023-08-10T10:50:13.699447+0000","last_became_active":"2023-08-10T10:48:41.593776+0000","last_became_peered":"2023-08-10T10:48:41.593776+0000","last_unstale":"2023-08-10T10:50:13.699447+0000","last_undegraded":"2023-08-10T10:50:13.699447+0000","last_fullsized":"2023-08-10T10:50:13.699447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:25:31.902019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"93'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621126+0000","last_change":"2023-08-10T10:48:42.589149+0000","last_active":"2023-08-10T10:50:41.621126+0000","last_peered":"2023-08-10T10:50:41.621126+0000","last_clean":"2023-08-10T10:50:41.621126+0000","last_became_active":"2023-08-10T10:48:42.588466+0000","last_became_peered":"2023-08-10T10:48:42.588466+0000","last_unstale":"2023-08-10T10:50:41.621126+0000","last_undegraded":"2023-08-10T10:50:41.621126+0000","last_fullsized":"2023-08-10T10:50:41.621126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:04:40.741096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.537728+0000","last_change":"2023-08-10T10:50:14.537293+0000","last_active":"2023-08-10T10:50:14.537728+0000","last_peered":"2023-08-10T10:50:14.537728+0000","last_clean":"2023-08-10T10:50:14.537728+0000","last_became_active":"2023-08-10T10:50:14.536816+0000","last_became_peered":"2023-08-10T10:50:14.536816+0000","last_unstale":"2023-08-10T10:50:14.537728+0000","last_undegraded":"2023-08-10T10:50:14.537728+0000","last_fullsized":"2023-08-10T10:50:14.537728+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:00:10.839229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.f","version":"93'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.665863+0000","last_change":"2023-08-10T10:48:41.590670+0000","last_active":"2023-08-10T10:50:52.665863+0000","last_peered":"2023-08-10T10:50:52.665863+0000","last_clean":"2023-08-10T10:50:52.665863+0000","last_became_active":"2023-08-10T10:48:41.589958+0000","last_became_peered":"2023-08-10T10:48:41.589958+0000","last_unstale":"2023-08-10T10:50:52.665863+0000","last_undegraded":"2023-08-10T10:50:52.665863+0000","last_fullsized":"2023-08-10T10:50:52.665863+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:36:57.008276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"93'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.606741+0000","last_change":"2023-08-10T10:48:42.581041+0000","last_active":"2023-08-10T10:50:41.606741+0000","last_peered":"2023-08-10T10:50:41.606741+0000","last_clean":"2023-08-10T10:50:41.606741+0000","last_became_active":"2023-08-10T10:48:42.580311+0000","last_became_peered":"2023-08-10T10:48:42.580311+0000","last_unstale":"2023-08-10T10:50:41.606741+0000","last_undegraded":"2023-08-10T10:50:41.606741+0000","last_fullsized":"2023-08-10T10:50:41.606741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:22.659342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699796+0000","last_change":"2023-08-10T10:48:46.907496+0000","last_active":"2023-08-10T10:50:13.699796+0000","last_peered":"2023-08-10T10:50:13.699796+0000","last_clean":"2023-08-10T10:50:13.699796+0000","last_became_active":"2023-08-10T10:48:46.907098+0000","last_became_peered":"2023-08-10T10:48:46.907098+0000","last_unstale":"2023-08-10T10:50:13.699796+0000","last_undegraded":"2023-08-10T10:50:13.699796+0000","last_fullsized":"2023-08-10T10:50:13.699796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:22:26.606996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695728+0000","last_change":"2023-08-10T10:48:41.585252+0000","last_active":"2023-08-10T10:50:13.695728+0000","last_peered":"2023-08-10T10:50:13.695728+0000","last_clean":"2023-08-10T10:50:13.695728+0000","last_became_active":"2023-08-10T10:48:41.583599+0000","last_became_peered":"2023-08-10T10:48:41.583599+0000","last_unstale":"2023-08-10T10:50:13.695728+0000","last_undegraded":"2023-08-10T10:50:13.695728+0000","last_fullsized":"2023-08-10T10:50:13.695728+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:42:50.051408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"93'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616656+0000","last_change":"2023-08-10T10:48:42.581317+0000","last_active":"2023-08-10T10:50:41.616656+0000","last_peered":"2023-08-10T10:50:41.616656+0000","last_clean":"2023-08-10T10:50:41.616656+0000","last_became_active":"2023-08-10T10:48:42.581012+0000","last_became_peered":"2023-08-10T10:48:42.581012+0000","last_unstale":"2023-08-10T10:50:41.616656+0000","last_undegraded":"2023-08-10T10:50:41.616656+0000","last_fullsized":"2023-08-10T10:50:41.616656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:28.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767680+0000","last_change":"2023-08-10T10:48:46.623489+0000","last_active":"2023-08-10T10:50:13.767680+0000","last_peered":"2023-08-10T10:50:13.767680+0000","last_clean":"2023-08-10T10:50:13.767680+0000","last_became_active":"2023-08-10T10:48:46.621968+0000","last_became_peered":"2023-08-10T10:48:46.621968+0000","last_unstale":"2023-08-10T10:50:13.767680+0000","last_undegraded":"2023-08-10T10:50:13.767680+0000","last_fullsized":"2023-08-10T10:50:13.767680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:57.091076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":135,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.819141+0000","last_change":"2023-08-10T10:48:41.579828+0000","last_active":"2023-08-10T10:50:52.819141+0000","last_peered":"2023-08-10T10:50:52.819141+0000","last_clean":"2023-08-10T10:50:52.819141+0000","last_became_active":"2023-08-10T10:48:41.579340+0000","last_became_peered":"2023-08-10T10:48:41.579340+0000","last_unstale":"2023-08-10T10:50:52.819141+0000","last_undegraded":"2023-08-10T10:50:52.819141+0000","last_fullsized":"2023-08-10T10:50:52.819141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:35:32.747605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1023,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"93'7","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.617106+0000","last_change":"2023-08-10T10:49:12.733771+0000","last_active":"2023-08-10T10:50:41.617106+0000","last_peered":"2023-08-10T10:50:41.617106+0000","last_clean":"2023-08-10T10:50:41.617106+0000","last_became_active":"2023-08-10T10:49:12.733357+0000","last_became_peered":"2023-08-10T10:49:12.733357+0000","last_unstale":"2023-08-10T10:50:41.617106+0000","last_undegraded":"2023-08-10T10:50:41.617106+0000","last_fullsized":"2023-08-10T10:50:41.617106+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:13:26.666048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767683+0000","last_change":"2023-08-10T10:48:46.907982+0000","last_active":"2023-08-10T10:50:13.767683+0000","last_peered":"2023-08-10T10:50:13.767683+0000","last_clean":"2023-08-10T10:50:13.767683+0000","last_became_active":"2023-08-10T10:48:46.907184+0000","last_became_peered":"2023-08-10T10:48:46.907184+0000","last_unstale":"2023-08-10T10:50:13.767683+0000","last_undegraded":"2023-08-10T10:50:13.767683+0000","last_fullsized":"2023-08-10T10:50:13.767683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:37:44.678304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616051+0000","last_change":"2023-08-10T10:48:42.582808+0000","last_active":"2023-08-10T10:50:41.616051+0000","last_peered":"2023-08-10T10:50:41.616051+0000","last_clean":"2023-08-10T10:50:41.616051+0000","last_became_active":"2023-08-10T10:48:42.582517+0000","last_became_peered":"2023-08-10T10:48:42.582517+0000","last_unstale":"2023-08-10T10:50:41.616051+0000","last_undegraded":"2023-08-10T10:50:41.616051+0000","last_fullsized":"2023-08-10T10:50:41.616051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:48:51.550019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'6","reported_seq":139,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:55.829768+0000","last_change":"2023-08-10T10:48:41.594873+0000","last_active":"2023-08-10T10:50:55.829768+0000","last_peered":"2023-08-10T10:50:55.829768+0000","last_clean":"2023-08-10T10:50:55.829768+0000","last_became_active":"2023-08-10T10:48:41.594550+0000","last_became_peered":"2023-08-10T10:48:41.594550+0000","last_unstale":"2023-08-10T10:50:55.829768+0000","last_undegraded":"2023-08-10T10:50:55.829768+0000","last_fullsized":"2023-08-10T10:50:55.829768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:03:31.289927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696533+0000","last_change":"2023-08-10T10:48:46.626960+0000","last_active":"2023-08-10T10:50:13.696533+0000","last_peered":"2023-08-10T10:50:13.696533+0000","last_clean":"2023-08-10T10:50:13.696533+0000","last_became_active":"2023-08-10T10:48:46.626519+0000","last_became_peered":"2023-08-10T10:48:46.626519+0000","last_unstale":"2023-08-10T10:50:13.696533+0000","last_undegraded":"2023-08-10T10:50:13.696533+0000","last_fullsized":"2023-08-10T10:50:13.696533+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:10:15.398639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.620791+0000","last_change":"2023-08-10T10:48:42.578921+0000","last_active":"2023-08-10T10:50:41.620791+0000","last_peered":"2023-08-10T10:50:41.620791+0000","last_clean":"2023-08-10T10:50:41.620791+0000","last_became_active":"2023-08-10T10:48:42.578322+0000","last_became_peered":"2023-08-10T10:48:42.578322+0000","last_unstale":"2023-08-10T10:50:41.620791+0000","last_undegraded":"2023-08-10T10:50:41.620791+0000","last_fullsized":"2023-08-10T10:50:41.620791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:30.672144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770099+0000","last_change":"2023-08-10T10:48:41.585692+0000","last_active":"2023-08-10T10:50:13.770099+0000","last_peered":"2023-08-10T10:50:13.770099+0000","last_clean":"2023-08-10T10:50:13.770099+0000","last_became_active":"2023-08-10T10:48:41.585217+0000","last_became_peered":"2023-08-10T10:48:41.585217+0000","last_unstale":"2023-08-10T10:50:13.770099+0000","last_undegraded":"2023-08-10T10:50:13.770099+0000","last_fullsized":"2023-08-10T10:50:13.770099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:08.790470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":362,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695907+0000","last_change":"2023-08-10T10:47:22.594211+0000","last_active":"2023-08-10T10:50:13.695907+0000","last_peered":"2023-08-10T10:50:13.695907+0000","last_clean":"2023-08-10T10:50:13.695907+0000","last_became_active":"2023-08-10T10:47:22.593742+0000","last_became_peered":"2023-08-10T10:47:22.593742+0000","last_unstale":"2023-08-10T10:50:13.695907+0000","last_undegraded":"2023-08-10T10:50:13.695907+0000","last_fullsized":"2023-08-10T10:50:13.695907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:43:44.512037+0000","last_clean_scrub_stamp":"2023-08-10T10:43:44.512037+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:36:36.018260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722905+0000","last_change":"2023-08-10T10:48:46.907769+0000","last_active":"2023-08-10T10:50:13.722905+0000","last_peered":"2023-08-10T10:50:13.722905+0000","last_clean":"2023-08-10T10:50:13.722905+0000","last_became_active":"2023-08-10T10:48:46.907241+0000","last_became_peered":"2023-08-10T10:48:46.907241+0000","last_unstale":"2023-08-10T10:50:13.722905+0000","last_undegraded":"2023-08-10T10:50:13.722905+0000","last_fullsized":"2023-08-10T10:50:13.722905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:45:20.554540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.604493+0000","last_change":"2023-08-10T10:48:42.587277+0000","last_active":"2023-08-10T10:50:41.604493+0000","last_peered":"2023-08-10T10:50:41.604493+0000","last_clean":"2023-08-10T10:50:41.604493+0000","last_became_active":"2023-08-10T10:48:42.586308+0000","last_became_peered":"2023-08-10T10:48:42.586308+0000","last_unstale":"2023-08-10T10:50:41.604493+0000","last_undegraded":"2023-08-10T10:50:41.604493+0000","last_fullsized":"2023-08-10T10:50:41.604493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:30:31.610095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.696125+0000","last_change":"2023-08-10T10:48:41.587116+0000","last_active":"2023-08-10T10:50:13.696125+0000","last_peered":"2023-08-10T10:50:13.696125+0000","last_clean":"2023-08-10T10:50:13.696125+0000","last_became_active":"2023-08-10T10:48:41.586771+0000","last_became_peered":"2023-08-10T10:48:41.586771+0000","last_unstale":"2023-08-10T10:50:13.696125+0000","last_undegraded":"2023-08-10T10:50:13.696125+0000","last_fullsized":"2023-08-10T10:50:13.696125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:31.434737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535389+0000","last_change":"2023-08-10T10:48:46.625140+0000","last_active":"2023-08-10T10:50:14.535389+0000","last_peered":"2023-08-10T10:50:14.535389+0000","last_clean":"2023-08-10T10:50:14.535389+0000","last_became_active":"2023-08-10T10:48:46.624615+0000","last_became_peered":"2023-08-10T10:48:46.624615+0000","last_unstale":"2023-08-10T10:50:14.535389+0000","last_undegraded":"2023-08-10T10:50:14.535389+0000","last_fullsized":"2023-08-10T10:50:14.535389+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:08:05.843613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.700103+0000","last_change":"2023-08-10T10:48:41.589435+0000","last_active":"2023-08-10T10:50:13.700103+0000","last_peered":"2023-08-10T10:50:13.700103+0000","last_clean":"2023-08-10T10:50:13.700103+0000","last_became_active":"2023-08-10T10:48:41.589070+0000","last_became_peered":"2023-08-10T10:48:41.589070+0000","last_unstale":"2023-08-10T10:50:13.700103+0000","last_undegraded":"2023-08-10T10:50:13.700103+0000","last_fullsized":"2023-08-10T10:50:13.700103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:43:40.722261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.612864+0000","last_change":"2023-08-10T10:48:42.586352+0000","last_active":"2023-08-10T10:50:41.612864+0000","last_peered":"2023-08-10T10:50:41.612864+0000","last_clean":"2023-08-10T10:50:41.612864+0000","last_became_active":"2023-08-10T10:48:42.585955+0000","last_became_peered":"2023-08-10T10:48:42.585955+0000","last_unstale":"2023-08-10T10:50:41.612864+0000","last_undegraded":"2023-08-10T10:50:41.612864+0000","last_fullsized":"2023-08-10T10:50:41.612864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:39:33.549404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.534826+0000","last_change":"2023-08-10T10:48:46.907519+0000","last_active":"2023-08-10T10:50:14.534826+0000","last_peered":"2023-08-10T10:50:14.534826+0000","last_clean":"2023-08-10T10:50:14.534826+0000","last_became_active":"2023-08-10T10:48:46.907087+0000","last_became_peered":"2023-08-10T10:48:46.907087+0000","last_unstale":"2023-08-10T10:50:14.534826+0000","last_undegraded":"2023-08-10T10:50:14.534826+0000","last_fullsized":"2023-08-10T10:50:14.534826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:36:32.544474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.917019+0000","last_change":"2023-08-10T10:48:41.583746+0000","last_active":"2023-08-10T10:50:51.917019+0000","last_peered":"2023-08-10T10:50:51.917019+0000","last_clean":"2023-08-10T10:50:51.917019+0000","last_became_active":"2023-08-10T10:48:41.583321+0000","last_became_peered":"2023-08-10T10:48:41.583321+0000","last_unstale":"2023-08-10T10:50:51.917019+0000","last_undegraded":"2023-08-10T10:50:51.917019+0000","last_fullsized":"2023-08-10T10:50:51.917019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:55:33.137575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"93'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616495+0000","last_change":"2023-08-10T10:48:42.579942+0000","last_active":"2023-08-10T10:50:41.616495+0000","last_peered":"2023-08-10T10:50:41.616495+0000","last_clean":"2023-08-10T10:50:41.616495+0000","last_became_active":"2023-08-10T10:48:42.579561+0000","last_became_peered":"2023-08-10T10:48:42.579561+0000","last_unstale":"2023-08-10T10:50:41.616495+0000","last_undegraded":"2023-08-10T10:50:41.616495+0000","last_fullsized":"2023-08-10T10:50:41.616495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:24:58.430924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695861+0000","last_change":"2023-08-10T10:48:46.621499+0000","last_active":"2023-08-10T10:50:13.695861+0000","last_peered":"2023-08-10T10:50:13.695861+0000","last_clean":"2023-08-10T10:50:13.695861+0000","last_became_active":"2023-08-10T10:48:46.621076+0000","last_became_peered":"2023-08-10T10:48:46.621076+0000","last_unstale":"2023-08-10T10:50:13.695861+0000","last_undegraded":"2023-08-10T10:50:13.695861+0000","last_fullsized":"2023-08-10T10:50:13.695861+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:32:56.077491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770338+0000","last_change":"2023-08-10T10:48:41.585574+0000","last_active":"2023-08-10T10:50:13.770338+0000","last_peered":"2023-08-10T10:50:13.770338+0000","last_clean":"2023-08-10T10:50:13.770338+0000","last_became_active":"2023-08-10T10:48:41.585254+0000","last_became_peered":"2023-08-10T10:48:41.585254+0000","last_unstale":"2023-08-10T10:50:13.770338+0000","last_undegraded":"2023-08-10T10:50:13.770338+0000","last_fullsized":"2023-08-10T10:50:13.770338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:19:01.410863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615467+0000","last_change":"2023-08-10T10:48:42.584003+0000","last_active":"2023-08-10T10:50:41.615467+0000","last_peered":"2023-08-10T10:50:41.615467+0000","last_clean":"2023-08-10T10:50:41.615467+0000","last_became_active":"2023-08-10T10:48:42.583712+0000","last_became_peered":"2023-08-10T10:48:42.583712+0000","last_unstale":"2023-08-10T10:50:41.615467+0000","last_undegraded":"2023-08-10T10:50:41.615467+0000","last_fullsized":"2023-08-10T10:50:41.615467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:38:56.521128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770153+0000","last_change":"2023-08-10T10:48:46.908113+0000","last_active":"2023-08-10T10:50:13.770153+0000","last_peered":"2023-08-10T10:50:13.770153+0000","last_clean":"2023-08-10T10:50:13.770153+0000","last_became_active":"2023-08-10T10:48:46.907552+0000","last_became_peered":"2023-08-10T10:48:46.907552+0000","last_unstale":"2023-08-10T10:50:13.770153+0000","last_undegraded":"2023-08-10T10:50:13.770153+0000","last_fullsized":"2023-08-10T10:50:13.770153+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:59.307817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.012760+0000","last_change":"2023-08-10T10:48:41.584254+0000","last_active":"2023-08-10T10:50:14.012760+0000","last_peered":"2023-08-10T10:50:14.012760+0000","last_clean":"2023-08-10T10:50:14.012760+0000","last_became_active":"2023-08-10T10:48:41.583129+0000","last_became_peered":"2023-08-10T10:48:41.583129+0000","last_unstale":"2023-08-10T10:50:14.012760+0000","last_undegraded":"2023-08-10T10:50:14.012760+0000","last_fullsized":"2023-08-10T10:50:14.012760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:16:23.152095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"93'2","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.598754+0000","last_change":"2023-08-10T10:48:42.582264+0000","last_active":"2023-08-10T10:50:41.598754+0000","last_peered":"2023-08-10T10:50:41.598754+0000","last_clean":"2023-08-10T10:50:41.598754+0000","last_became_active":"2023-08-10T10:48:42.581542+0000","last_became_peered":"2023-08-10T10:48:42.581542+0000","last_unstale":"2023-08-10T10:50:41.598754+0000","last_undegraded":"2023-08-10T10:50:41.598754+0000","last_fullsized":"2023-08-10T10:50:41.598754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:21.881081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.695569+0000","last_change":"2023-08-10T10:48:46.632019+0000","last_active":"2023-08-10T10:50:13.695569+0000","last_peered":"2023-08-10T10:50:13.695569+0000","last_clean":"2023-08-10T10:50:13.695569+0000","last_became_active":"2023-08-10T10:48:46.631510+0000","last_became_peered":"2023-08-10T10:48:46.631510+0000","last_unstale":"2023-08-10T10:50:13.695569+0000","last_undegraded":"2023-08-10T10:50:13.695569+0000","last_fullsized":"2023-08-10T10:50:13.695569+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:03:42.173606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.535166+0000","last_change":"2023-08-10T10:48:41.591206+0000","last_active":"2023-08-10T10:50:14.535166+0000","last_peered":"2023-08-10T10:50:14.535166+0000","last_clean":"2023-08-10T10:50:14.535166+0000","last_became_active":"2023-08-10T10:48:41.590897+0000","last_became_peered":"2023-08-10T10:48:41.590897+0000","last_unstale":"2023-08-10T10:50:14.535166+0000","last_undegraded":"2023-08-10T10:50:14.535166+0000","last_fullsized":"2023-08-10T10:50:14.535166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:20:47.099891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.612127+0000","last_change":"2023-08-10T10:48:42.586470+0000","last_active":"2023-08-10T10:50:41.612127+0000","last_peered":"2023-08-10T10:50:41.612127+0000","last_clean":"2023-08-10T10:50:41.612127+0000","last_became_active":"2023-08-10T10:48:42.586109+0000","last_became_peered":"2023-08-10T10:48:42.586109+0000","last_unstale":"2023-08-10T10:50:41.612127+0000","last_undegraded":"2023-08-10T10:50:41.612127+0000","last_fullsized":"2023-08-10T10:50:41.612127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:02.527807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.769837+0000","last_change":"2023-08-10T10:48:46.629886+0000","last_active":"2023-08-10T10:50:13.769837+0000","last_peered":"2023-08-10T10:50:13.769837+0000","last_clean":"2023-08-10T10:50:13.769837+0000","last_became_active":"2023-08-10T10:48:46.629403+0000","last_became_peered":"2023-08-10T10:48:46.629403+0000","last_unstale":"2023-08-10T10:50:13.769837+0000","last_undegraded":"2023-08-10T10:50:13.769837+0000","last_fullsized":"2023-08-10T10:50:13.769837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:17:13.690617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"93'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:52.357181+0000","last_change":"2023-08-10T10:48:41.593231+0000","last_active":"2023-08-10T10:50:52.357181+0000","last_peered":"2023-08-10T10:50:52.357181+0000","last_clean":"2023-08-10T10:50:52.357181+0000","last_became_active":"2023-08-10T10:48:41.592893+0000","last_became_peered":"2023-08-10T10:48:41.592893+0000","last_unstale":"2023-08-10T10:50:52.357181+0000","last_undegraded":"2023-08-10T10:50:52.357181+0000","last_fullsized":"2023-08-10T10:50:52.357181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:37:49.643933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.611175+0000","last_change":"2023-08-10T10:49:12.732774+0000","last_active":"2023-08-10T10:50:41.611175+0000","last_peered":"2023-08-10T10:50:41.611175+0000","last_clean":"2023-08-10T10:50:41.611175+0000","last_became_active":"2023-08-10T10:49:12.732277+0000","last_became_peered":"2023-08-10T10:49:12.732277+0000","last_unstale":"2023-08-10T10:50:41.611175+0000","last_undegraded":"2023-08-10T10:50:41.611175+0000","last_fullsized":"2023-08-10T10:50:41.611175+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:43:48.144206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.770033+0000","last_change":"2023-08-10T10:48:46.908347+0000","last_active":"2023-08-10T10:50:13.770033+0000","last_peered":"2023-08-10T10:50:13.770033+0000","last_clean":"2023-08-10T10:50:13.770033+0000","last_became_active":"2023-08-10T10:48:46.907266+0000","last_became_peered":"2023-08-10T10:48:46.907266+0000","last_unstale":"2023-08-10T10:50:13.770033+0000","last_undegraded":"2023-08-10T10:50:13.770033+0000","last_fullsized":"2023-08-10T10:50:13.770033+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:39:11.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.699637+0000","last_change":"2023-08-10T10:48:41.585055+0000","last_active":"2023-08-10T10:50:13.699637+0000","last_peered":"2023-08-10T10:50:13.699637+0000","last_clean":"2023-08-10T10:50:13.699637+0000","last_became_active":"2023-08-10T10:48:41.584676+0000","last_became_peered":"2023-08-10T10:48:41.584676+0000","last_unstale":"2023-08-10T10:50:13.699637+0000","last_undegraded":"2023-08-10T10:50:13.699637+0000","last_fullsized":"2023-08-10T10:50:13.699637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:23:20.879455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"93'5","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622529+0000","last_change":"2023-08-10T10:48:42.586764+0000","last_active":"2023-08-10T10:50:41.622529+0000","last_peered":"2023-08-10T10:50:41.622529+0000","last_clean":"2023-08-10T10:50:41.622529+0000","last_became_active":"2023-08-10T10:48:42.586177+0000","last_became_peered":"2023-08-10T10:48:42.586177+0000","last_unstale":"2023-08-10T10:50:41.622529+0000","last_undegraded":"2023-08-10T10:50:41.622529+0000","last_fullsized":"2023-08-10T10:50:41.622529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:03:36.400611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.012662+0000","last_change":"2023-08-10T10:48:46.626872+0000","last_active":"2023-08-10T10:50:14.012662+0000","last_peered":"2023-08-10T10:50:14.012662+0000","last_clean":"2023-08-10T10:50:14.012662+0000","last_became_active":"2023-08-10T10:48:46.626354+0000","last_became_peered":"2023-08-10T10:48:46.626354+0000","last_unstale":"2023-08-10T10:50:14.012662+0000","last_undegraded":"2023-08-10T10:50:14.012662+0000","last_fullsized":"2023-08-10T10:50:14.012662+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:24:11.803864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"93'8","reported_seq":139,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:51.853543+0000","last_change":"2023-08-10T10:48:41.586954+0000","last_active":"2023-08-10T10:50:51.853543+0000","last_peered":"2023-08-10T10:50:51.853543+0000","last_clean":"2023-08-10T10:50:51.853543+0000","last_became_active":"2023-08-10T10:48:41.586311+0000","last_became_peered":"2023-08-10T10:48:41.586311+0000","last_unstale":"2023-08-10T10:50:51.853543+0000","last_undegraded":"2023-08-10T10:50:51.853543+0000","last_fullsized":"2023-08-10T10:50:51.853543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:00:40.700845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2136,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622108+0000","last_change":"2023-08-10T10:48:42.577290+0000","last_active":"2023-08-10T10:50:41.622108+0000","last_peered":"2023-08-10T10:50:41.622108+0000","last_clean":"2023-08-10T10:50:41.622108+0000","last_became_active":"2023-08-10T10:48:42.576928+0000","last_became_peered":"2023-08-10T10:48:42.576928+0000","last_unstale":"2023-08-10T10:50:41.622108+0000","last_undegraded":"2023-08-10T10:50:41.622108+0000","last_fullsized":"2023-08-10T10:50:41.622108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:22:30.224384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:14.179915+0000","last_change":"2023-08-10T10:48:46.627842+0000","last_active":"2023-08-10T10:50:14.179915+0000","last_peered":"2023-08-10T10:50:14.179915+0000","last_clean":"2023-08-10T10:50:14.179915+0000","last_became_active":"2023-08-10T10:48:46.627472+0000","last_became_peered":"2023-08-10T10:48:46.627472+0000","last_unstale":"2023-08-10T10:50:14.179915+0000","last_undegraded":"2023-08-10T10:50:14.179915+0000","last_fullsized":"2023-08-10T10:50:14.179915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:06:48.140390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722566+0000","last_change":"2023-08-10T10:48:41.592742+0000","last_active":"2023-08-10T10:50:13.722566+0000","last_peered":"2023-08-10T10:50:13.722566+0000","last_clean":"2023-08-10T10:50:13.722566+0000","last_became_active":"2023-08-10T10:48:41.592409+0000","last_became_peered":"2023-08-10T10:48:41.592409+0000","last_unstale":"2023-08-10T10:50:13.722566+0000","last_undegraded":"2023-08-10T10:50:13.722566+0000","last_fullsized":"2023-08-10T10:50:13.722566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:07:28.885109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"93'6","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613982+0000","last_change":"2023-08-10T10:48:42.583444+0000","last_active":"2023-08-10T10:50:41.613982+0000","last_peered":"2023-08-10T10:50:41.613982+0000","last_clean":"2023-08-10T10:50:41.613982+0000","last_became_active":"2023-08-10T10:48:42.583073+0000","last_became_peered":"2023-08-10T10:48:42.583073+0000","last_unstale":"2023-08-10T10:50:41.613982+0000","last_undegraded":"2023-08-10T10:50:41.613982+0000","last_fullsized":"2023-08-10T10:50:41.613982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:23:10.749501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.722087+0000","last_change":"2023-08-10T10:48:46.626340+0000","last_active":"2023-08-10T10:50:13.722087+0000","last_peered":"2023-08-10T10:50:13.722087+0000","last_clean":"2023-08-10T10:50:13.722087+0000","last_became_active":"2023-08-10T10:48:46.625867+0000","last_became_peered":"2023-08-10T10:48:46.625867+0000","last_unstale":"2023-08-10T10:50:13.722087+0000","last_undegraded":"2023-08-10T10:50:13.722087+0000","last_fullsized":"2023-08-10T10:50:13.722087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:45.598308+0000","last_clean_scrub_stamp":"2023-08-10T10:48:45.598308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:42:40.288099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:13.767768+0000","last_change":"2023-08-10T10:48:41.590734+0000","last_active":"2023-08-10T10:50:13.767768+0000","last_peered":"2023-08-10T10:50:13.767768+0000","last_clean":"2023-08-10T10:50:13.767768+0000","last_became_active":"2023-08-10T10:48:41.590433+0000","last_became_peered":"2023-08-10T10:48:41.590433+0000","last_unstale":"2023-08-10T10:50:13.767768+0000","last_undegraded":"2023-08-10T10:50:13.767768+0000","last_fullsized":"2023-08-10T10:50:13.767768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:40.547685+0000","last_clean_scrub_stamp":"2023-08-10T10:48:40.547685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:08:56.564752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"93'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613324+0000","last_change":"2023-08-10T10:48:42.576628+0000","last_active":"2023-08-10T10:50:41.613324+0000","last_peered":"2023-08-10T10:50:41.613324+0000","last_clean":"2023-08-10T10:50:41.613324+0000","last_became_active":"2023-08-10T10:48:42.576285+0000","last_became_peered":"2023-08-10T10:48:42.576285+0000","last_unstale":"2023-08-10T10:50:41.613324+0000","last_undegraded":"2023-08-10T10:50:41.613324+0000","last_fullsized":"2023-08-10T10:50:41.613324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:56.152902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"93'9","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.609242+0000","last_change":"2023-08-10T10:48:42.579615+0000","last_active":"2023-08-10T10:50:41.609242+0000","last_peered":"2023-08-10T10:50:41.609242+0000","last_clean":"2023-08-10T10:50:41.609242+0000","last_became_active":"2023-08-10T10:48:42.579291+0000","last_became_peered":"2023-08-10T10:48:42.579291+0000","last_unstale":"2023-08-10T10:50:41.609242+0000","last_undegraded":"2023-08-10T10:50:41.609242+0000","last_fullsized":"2023-08-10T10:50:41.609242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:07:16.219311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"93'12","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.607050+0000","last_change":"2023-08-10T10:48:42.581358+0000","last_active":"2023-08-10T10:50:41.607050+0000","last_peered":"2023-08-10T10:50:41.607050+0000","last_clean":"2023-08-10T10:50:41.607050+0000","last_became_active":"2023-08-10T10:48:42.580942+0000","last_became_peered":"2023-08-10T10:48:42.580942+0000","last_unstale":"2023-08-10T10:50:41.607050+0000","last_undegraded":"2023-08-10T10:50:41.607050+0000","last_fullsized":"2023-08-10T10:50:41.607050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:15:15.943726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.610115+0000","last_change":"2023-08-10T10:48:42.574494+0000","last_active":"2023-08-10T10:50:41.610115+0000","last_peered":"2023-08-10T10:50:41.610115+0000","last_clean":"2023-08-10T10:50:41.610115+0000","last_became_active":"2023-08-10T10:48:42.574203+0000","last_became_peered":"2023-08-10T10:48:42.574203+0000","last_unstale":"2023-08-10T10:50:41.610115+0000","last_undegraded":"2023-08-10T10:50:41.610115+0000","last_fullsized":"2023-08-10T10:50:41.610115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:08:52.621504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"93'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.615876+0000","last_change":"2023-08-10T10:48:42.587557+0000","last_active":"2023-08-10T10:50:41.615876+0000","last_peered":"2023-08-10T10:50:41.615876+0000","last_clean":"2023-08-10T10:50:41.615876+0000","last_became_active":"2023-08-10T10:48:42.587133+0000","last_became_peered":"2023-08-10T10:48:42.587133+0000","last_unstale":"2023-08-10T10:50:41.615876+0000","last_undegraded":"2023-08-10T10:50:41.615876+0000","last_fullsized":"2023-08-10T10:50:41.615876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:06:59.879669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"93'4","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.608431+0000","last_change":"2023-08-10T10:48:42.587283+0000","last_active":"2023-08-10T10:50:41.608431+0000","last_peered":"2023-08-10T10:50:41.608431+0000","last_clean":"2023-08-10T10:50:41.608431+0000","last_became_active":"2023-08-10T10:48:42.586118+0000","last_became_peered":"2023-08-10T10:48:42.586118+0000","last_unstale":"2023-08-10T10:50:41.608431+0000","last_undegraded":"2023-08-10T10:50:41.608431+0000","last_fullsized":"2023-08-10T10:50:41.608431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:07:02.654188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.607274+0000","last_change":"2023-08-10T10:48:42.580843+0000","last_active":"2023-08-10T10:50:41.607274+0000","last_peered":"2023-08-10T10:50:41.607274+0000","last_clean":"2023-08-10T10:50:41.607274+0000","last_became_active":"2023-08-10T10:48:42.579735+0000","last_became_peered":"2023-08-10T10:48:42.579735+0000","last_unstale":"2023-08-10T10:50:41.607274+0000","last_undegraded":"2023-08-10T10:50:41.607274+0000","last_fullsized":"2023-08-10T10:50:41.607274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.478217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"93'15","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.622932+0000","last_change":"2023-08-10T10:48:42.580250+0000","last_active":"2023-08-10T10:50:41.622932+0000","last_peered":"2023-08-10T10:50:41.622932+0000","last_clean":"2023-08-10T10:50:41.622932+0000","last_became_active":"2023-08-10T10:48:42.579962+0000","last_became_peered":"2023-08-10T10:48:42.579962+0000","last_unstale":"2023-08-10T10:50:41.622932+0000","last_undegraded":"2023-08-10T10:50:41.622932+0000","last_fullsized":"2023-08-10T10:50:41.622932+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:34:59.289236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"93'2","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613267+0000","last_change":"2023-08-10T10:48:42.582699+0000","last_active":"2023-08-10T10:50:41.613267+0000","last_peered":"2023-08-10T10:50:41.613267+0000","last_clean":"2023-08-10T10:50:41.613267+0000","last_became_active":"2023-08-10T10:48:42.582426+0000","last_became_peered":"2023-08-10T10:48:42.582426+0000","last_unstale":"2023-08-10T10:50:41.613267+0000","last_undegraded":"2023-08-10T10:50:41.613267+0000","last_fullsized":"2023-08-10T10:50:41.613267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:30:57.741362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"93'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.611264+0000","last_change":"2023-08-10T10:48:42.577483+0000","last_active":"2023-08-10T10:50:41.611264+0000","last_peered":"2023-08-10T10:50:41.611264+0000","last_clean":"2023-08-10T10:50:41.611264+0000","last_became_active":"2023-08-10T10:48:42.577195+0000","last_became_peered":"2023-08-10T10:48:42.577195+0000","last_unstale":"2023-08-10T10:50:41.611264+0000","last_undegraded":"2023-08-10T10:50:41.611264+0000","last_fullsized":"2023-08-10T10:50:41.611264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:51:45.123427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.613773+0000","last_change":"2023-08-10T10:48:42.581129+0000","last_active":"2023-08-10T10:50:41.613773+0000","last_peered":"2023-08-10T10:50:41.613773+0000","last_clean":"2023-08-10T10:50:41.613773+0000","last_became_active":"2023-08-10T10:48:42.579350+0000","last_became_peered":"2023-08-10T10:48:42.579350+0000","last_unstale":"2023-08-10T10:50:41.613773+0000","last_undegraded":"2023-08-10T10:50:41.613773+0000","last_fullsized":"2023-08-10T10:50:41.613773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:15:08.947725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.621899+0000","last_change":"2023-08-10T10:48:42.578167+0000","last_active":"2023-08-10T10:50:41.621899+0000","last_peered":"2023-08-10T10:50:41.621899+0000","last_clean":"2023-08-10T10:50:41.621899+0000","last_became_active":"2023-08-10T10:48:42.577571+0000","last_became_peered":"2023-08-10T10:48:42.577571+0000","last_unstale":"2023-08-10T10:50:41.621899+0000","last_undegraded":"2023-08-10T10:50:41.621899+0000","last_fullsized":"2023-08-10T10:50:41.621899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:55:49.584540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.616759+0000","last_change":"2023-08-10T10:48:42.587207+0000","last_active":"2023-08-10T10:50:41.616759+0000","last_peered":"2023-08-10T10:50:41.616759+0000","last_clean":"2023-08-10T10:50:41.616759+0000","last_became_active":"2023-08-10T10:48:42.586848+0000","last_became_peered":"2023-08-10T10:48:42.586848+0000","last_unstale":"2023-08-10T10:50:41.616759+0000","last_undegraded":"2023-08-10T10:50:41.616759+0000","last_fullsized":"2023-08-10T10:50:41.616759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:15.743811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"93'8","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-10T10:50:41.605689+0000","last_change":"2023-08-10T10:48:42.580785+0000","last_active":"2023-08-10T10:50:41.605689+0000","last_peered":"2023-08-10T10:50:41.605689+0000","last_clean":"2023-08-10T10:50:41.605689+0000","last_became_active":"2023-08-10T10:48:42.580395+0000","last_became_peered":"2023-08-10T10:48:42.580395+0000","last_unstale":"2023-08-10T10:50:41.605689+0000","last_undegraded":"2023-08-10T10:50:41.605689+0000","last_fullsized":"2023-08-10T10:50:41.605689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:48:41.553441+0000","last_clean_scrub_stamp":"2023-08-10T10:48:41.553441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:35:09.498136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250142,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69764,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1035,"num_read_kb":595,"num_write":260,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383721,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":520937,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.99299999999999999,"5min":1.494,"15min":1.494},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.97899999999999998,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76200000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.753,"15min":0.74299999999999999},"min":{"1min":0.63500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.042,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1140000000000001,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82699999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.069}]},{"osd":4,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.85199999999999998,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.226,"5min":1.272,"15min":1.272},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.55200000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.125}]},{"osd":5,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2669999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.75700000000000001,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.179,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.113}]},{"osd":6,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82299999999999995,"15min":0.82399999999999995},"min":{"1min":0.51600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.056,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.754,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.161,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.032}]},{"osd":7,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.90900000000000003,"15min":0.88800000000000001},"min":{"1min":0.68999999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.252,"5min":1.597,"15min":1.597},"last":1.155},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89000000000000001,"15min":0.88700000000000001},"min":{"1min":0.67000000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.173,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0549999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:50:42 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.94899999999999995,"15min":0.94099999999999995},"min":{"1min":0.80300000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90100000000000002,"15min":0.89500000000000002},"min":{"1min":0.65700000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.2230000000000001}]},{"osd":9,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.99399999999999999,"15min":0.96099999999999997},"min":{"1min":0.89900000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3180000000000001,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.95999999999999996,"15min":0.92100000000000004},"min":{"1min":0.77200000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.2470000000000001,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":1.1950000000000001}]},{"osd":10,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93500000000000005,"15min":0.92400000000000004},"min":{"1min":0.753,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1559999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.099},{"interface":"front","average":{"1min":1.081,"5min":1.0109999999999999,"15min":0.98499999999999999},"min":{"1min":0.90300000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4019999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.2090000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1171456,"data_stored":1167894,"data_compressed":59704,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.627},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.504}]},{"osd":1,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.622,"15min":0.65200000000000002},"min":{"1min":0.45600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.80100000000000005,"5min":1.355,"15min":1.355},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.65500000000000003,"15min":0.69499999999999995},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80400000000000005,"5min":1.494,"15min":1.494},"last":0.442}]},{"osd":2,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.47099999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.222,"15min":1.222},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.63700000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.095,"5min":1.198,"15min":1.198},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.78500000000000003,"15min":0.83099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.87,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.87,"15min":0.875},"min":{"1min":0.60599999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":5.8259999999999996,"5min":5.8259999999999996,"15min":5.8259999999999996},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.77400000000000002,"15min":0.80900000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4259999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":0.82899999999999996},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3440000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.753}]},{"osd":5,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91400000000000003,"15min":0.94999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0600000000000001,"5min":1.369,"15min":1.369},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1459999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.90000000000000002,"15min":0.96399999999999997},"min":{"1min":0.56200000000000006,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.88,"5min":1.579,"15min":1.579},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.90000000000000002,"15min":0.94199999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96999999999999997,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:48:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.53000000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.98499999999999999,"15min":1.0169999999999999},"min":{"1min":0.73599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2589999999999999,"5min":1.869,"15min":1.869},"last":0.871},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.997,"15min":1.0580000000000001},"min":{"1min":0.71699999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.006,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.79600000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.98099999999999998,"15min":1.0349999999999999},"min":{"1min":0.72999999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.91700000000000004,"5min":1.619,"15min":1.619},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.995,"15min":1.0649999999999999},"min":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0329999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.83599999999999997}]},{"osd":11,"last update":"Thu Aug 10 10:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.98699999999999999,"15min":1.002},"min":{"1min":0.81899999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3680000000000001,"5min":1.79,"15min":1.79},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95799999999999996,"15min":0.96799999999999997},"min":{"1min":0.77400000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1060000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.89600000000000002}]}]},{"osd":9,"up_from":67,"seq":287762808883,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":523929,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.51600000000000001,"15min":0.54500000000000004},"min":{"1min":0.308,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71699999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.35499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.433}]},{"osd":1,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79600000000000004,"15min":0.86599999999999999},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.93200000000000005,"5min":4.0510000000000002,"15min":4.0510000000000002},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.024,"5min":1.077,"15min":1.077},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.747,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.157,"5min":1.167,"15min":1.167},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65000000000000002,"15min":0.68799999999999994},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.3109999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.621},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.39700000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75,"15min":0.78600000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86099999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.80200000000000005,"15min":0.84199999999999997},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0209999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.81799999999999995,"15min":0.85399999999999998},"min":{"1min":0.53700000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.111,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81999999999999995,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2110000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:47:54 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.081}]},{"osd":7,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.85399999999999998,"15min":0.90200000000000002},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.099,"5min":1.607,"15min":1.607},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.83999999999999997,"15min":0.88},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.143,"5min":1.236,"15min":1.236},"last":0.81399999999999995}]},{"osd":8,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.878,"15min":0.91900000000000004},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0229999999999999,"5min":1.319,"15min":1.319},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89900000000000002,"15min":0.94499999999999995},"min":{"1min":0.63200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:50:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84999999999999998,"15min":0.872},"min":{"1min":0.60099999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.90000000000000002,"15min":0.92200000000000004},"min":{"1min":0.66800000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3480000000000001,"5min":1.381,"15min":1.381},"last":0.90000000000000002}]},{"osd":11,"last update":"Thu Aug 10 10:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.85299999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.98699999999999999,"5min":1.244,"15min":1.244},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81899999999999995,"15min":0.82899999999999996},"min":{"1min":0.58399999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1439999999999999,"5min":1.216,"15min":1.216},"last":0.60199999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":519880,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.46200000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.46600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":5.1909999999999998,"5min":5.1909999999999998,"15min":5.1909999999999998},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.625,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0129999999999999,"5min":1.113,"15min":1.113},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.77600000000000002,"15min":0.76200000000000001},"min":{"1min":0.58799999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.99099999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.66300000000000003},"min":{"1min":0.45600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88200000000000001,"5min":1.103,"15min":1.103},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.621,"15min":0.65900000000000003},"min":{"1min":0.41599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.496}]},{"osd":3,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.76300000000000001,"15min":0.76800000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":5.1189999999999998,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":1.3720000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.60199999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85299999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.755}]},{"osd":4,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82099999999999995,"15min":0.84299999999999997},"min":{"1min":0.63600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98099999999999998,"5min":1.238,"15min":1.238},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85599999999999998,"15min":0.87},"min":{"1min":0.64800000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.0589999999999999,"5min":1.214,"15min":1.214},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.749,"15min":0.80300000000000005},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.036,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77800000000000002,"15min":0.81999999999999995},"min":{"1min":0.57999999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1359999999999999,"5min":1.236,"15min":1.236},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86199999999999999,"15min":0.89200000000000002},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1140000000000001,"5min":0.91300000000000003,"15min":0.92400000000000004},"min":{"1min":0.59899999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.1609999999999996,"5min":5.1609999999999996,"15min":5.1609999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:50:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89600000000000002,"15min":0.93799999999999994},"min":{"1min":0.67800000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1759999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90900000000000003,"15min":0.93500000000000005},"min":{"1min":0.65400000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.091,"5min":1.29,"15min":1.29},"last":0.83799999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.88500000000000001,"15min":0.86899999999999999},"min":{"1min":0.76400000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1499999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.583},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.91600000000000004,"15min":0.89500000000000002},"min":{"1min":0.69699999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.0899999999999999,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.669}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.91700000000000004,"15min":0.88500000000000001},"min":{"1min":0.70699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.196,"5min":1.214,"15min":1.214},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.92600000000000005,"15min":0.91200000000000003},"min":{"1min":0.72199999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.246,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.82299999999999995}]},{"osd":11,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.76200000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.091,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"min":{"1min":0.74199999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.119,"5min":1.232,"15min":1.232},"last":0.65800000000000003}]}]},{"osd":7,"up_from":51,"seq":219043332157,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":1117822,"data_compressed":59704,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:48:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0489999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99299999999999999,"5min":1.466,"15min":1.466},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68200000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.372},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.72999999999999998,"15min":0.76800000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90800000000000003,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.996,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.81999999999999995,"15min":0.82899999999999996},"min":{"1min":0.54300000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.2650000000000001,"5min":3.2650000000000001,"15min":3.2650000000000001},"last":0.624},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75900000000000001,"15min":0.78400000000000003},"min":{"1min":0.57699999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.39400000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.87,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79400000000000004,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90600000000000003,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.877},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.82399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57799999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.004,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.66200000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.86799999999999999,"15min":0.89200000000000002},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.53900000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:50:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88700000000000001,"15min":0.872},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.101,"5min":1.379,"15min":1.379},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.87,"15min":0.874},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.95199999999999996,"5min":1.357,"15min":1.357},"last":0.92400000000000004}]},{"osd":9,"last update":"Thu Aug 10 10:49:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.94799999999999995},"min":{"1min":0.66100000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93899999999999995,"15min":0.96099999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.65900000000000003}]},{"osd":10,"last update":"Thu Aug 10 10:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88200000000000001,"15min":0.89300000000000002},"min":{"1min":0.63400000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.085,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.69399999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.127,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58299999999999996}]},{"osd":11,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98299999999999998,"15min":0.98499999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.151,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.97699999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495684,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":515772,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48799999999999999,"15min":0.46100000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3740000000000001,"5min":3.875,"15min":3.875},"last":0.629},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53700000000000003,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.278,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.38}]},{"osd":1,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.74399999999999999,"15min":0.73199999999999998},"min":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.119,"5min":1.869,"15min":1.869},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.55400000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0449999999999999,"5min":1.296,"15min":1.296},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.48799999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.1359999999999999,"5min":2.198,"15min":2.198},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.51400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90200000000000002,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.749}]},{"osd":3,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0129999999999999,"5min":3.327,"15min":3.327},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":3.423,"15min":3.423},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.752},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0369999999999999,"5min":1.948,"15min":1.948},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77300000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0660000000000001,"5min":1.345,"15min":1.345},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.745,"15min":0.752},"min":{"1min":0.56899999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.1879999999999999,"5min":2.161,"15min":2.161},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.93700000000000006,"5min":1.982,"15min":1.982},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.129,"5min":2.129,"15min":2.129},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.58399999999999996}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4099999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.85299999999999998},"min":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1499999999999999,"5min":1.429,"15min":1.429},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.88700000000000001,"15min":0.88900000000000001},"min":{"1min":0.52800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.3449999999999998,"5min":4.3449999999999998,"15min":4.3449999999999998},"last":0.878}]},{"osd":10,"last update":"Thu Aug 10 10:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.65200000000000002,"5min":0.63,"15min":0.63},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.91300000000000003,"15min":0.91900000000000004},"min":{"1min":0.73199999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.26,"5min":1.46,"15min":1.46},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.878,"15min":0.88900000000000001},"min":{"1min":0.68400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98099999999999998,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.73999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":577342,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.68799999999999994,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.26600000000000001},"max":{"1min":5.173,"5min":5.173,"15min":5.173},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.70799999999999996,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.28399999999999997},"max":{"1min":9.2070000000000007,"5min":9.2070000000000007,"15min":9.2070000000000007},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:50:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.748,"15min":0.63400000000000001},"min":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.32200000000000001},"max":{"1min":1.0189999999999999,"5min":1.25,"15min":1.25},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71899999999999997,"15min":0.61899999999999999},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.747,"15min":0.65700000000000003},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":4.3719999999999999,"5min":4.3719999999999999,"15min":4.3719999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.78200000000000003,"15min":0.68200000000000005},"min":{"1min":0.52700000000000002,"5min":0.443,"15min":0.377},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.47399999999999998},"min":{"1min":0.41499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76000000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.69599999999999995},"min":{"1min":0.59999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.99199999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77000000000000002,"15min":0.68200000000000005},"min":{"1min":0.65000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0029999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.79200000000000004,"15min":0.77300000000000002},"min":{"1min":0.45100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.004,"5min":1.264,"15min":1.264},"last":0.873},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79900000000000004,"15min":0.74399999999999999},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0720000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.95699999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":0.78500000000000003},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1200000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0409999999999999}]},{"osd":8,"last update":"Thu Aug 10 10:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.89800000000000002,"15min":0.877},"min":{"1min":0.75900000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.044,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.83999999999999997},"min":{"1min":0.70199999999999996,"5min":0.624,"15min":0.624},"max":{"1min":1.0129999999999999,"5min":1.46,"15min":1.46},"last":1.008}]},{"osd":9,"last update":"Thu Aug 10 10:50:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.88100000000000001,"15min":0.84899999999999998},"min":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98699999999999999,"5min":5.476,"15min":5.476},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.97199999999999998,"15min":0.93600000000000005},"min":{"1min":0.66500000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1639999999999999,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.98599999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":0.91500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0669999999999999,"5min":1.51,"15min":1.51},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.88500000000000001,"15min":0.90200000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1020000000000001,"5min":1.266,"15min":1.266},"last":0.88900000000000001}]},{"osd":11,"last update":"Thu Aug 10 10:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":1.0149999999999999,"15min":1.03},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.1499999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.99399999999999999,"15min":1.006},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.159,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95399999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738468,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":517759,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.65200000000000002,"15min":0.60299999999999998},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.67100000000000004,"15min":0.624},"min":{"1min":0.45200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70699999999999996,"15min":0.69299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.73799999999999999,"15min":0.70999999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.94699999999999995,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.67400000000000004},"min":{"1min":0.52000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90900000000000003,"5min":2.29,"15min":2.29},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89900000000000002,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:50:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.68899999999999995,"15min":0.65500000000000003},"min":{"1min":0.45600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.73399999999999999,"15min":0.69399999999999995},"min":{"1min":0.57299999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.41099999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88800000000000001,"5min":2.657,"15min":2.657},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0860000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80200000000000005,"15min":0.81499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89200000000000002,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86299999999999999,"15min":0.879},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.99299999999999999,"5min":2.355,"15min":2.355},"last":0.70899999999999996}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.66100000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.995,"5min":1.77,"15min":1.77},"last":0.749},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.67300000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1970000000000001,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.81000000000000005}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.86799999999999999}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89400000000000002,"15min":0.89100000000000001},"min":{"1min":0.68700000000000006,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.874,"15min":0.879},"min":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.90600000000000003}]},{"osd":11,"last update":"Thu Aug 10 10:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.87,"15min":0.86099999999999999},"min":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.0389999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89500000000000002,"15min":0.90100000000000002},"min":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.04,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.92700000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":577518,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.72699999999999998,"15min":0.63800000000000001},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":9.548,"5min":9.548,"15min":9.548},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.70399999999999996,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":9.5,"5min":9.5,"15min":9.5},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.70499999999999996,"15min":0.625},"min":{"1min":0.55200000000000005,"5min":0.315,"15min":0.315},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.69599999999999995,"15min":0.624},"min":{"1min":0.52000000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.73599999999999999,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":3.9990000000000001,"5min":3.9990000000000001,"15min":3.9990000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.48799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.628,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.98299999999999998,"5min":1.008,"15min":1.008},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.60799999999999998,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.135,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59099999999999997,"15min":0.54100000000000004},"min":{"1min":0.38800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96099999999999997,"5min":1.488,"15min":1.488},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.61799999999999999,"15min":0.55300000000000005},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.081,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83199999999999996,"15min":0.72199999999999998},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.3559999999999999,"5min":4.851,"15min":4.851},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.70799999999999996},"min":{"1min":0.58599999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2849999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.95499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90400000000000003,"15min":0.91500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.159,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.78300000000000003}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.85299999999999998,"15min":0.83399999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.087,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.95399999999999996}]},{"osd":9,"last update":"Thu Aug 10 10:49:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.80800000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.9379999999999997,"5min":4.9379999999999997,"15min":4.9379999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.508,"5min":0.94999999999999996,"15min":0.85799999999999998},"min":{"1min":0.78400000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":0.878}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.77800000000000002,"15min":0.74199999999999999},"min":{"1min":0.70199999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.93100000000000005,"15min":0.89700000000000002},"min":{"1min":0.77500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.204,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.86199999999999999}]},{"osd":11,"last update":"Thu Aug 10 10:50:43 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.61499999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1,"5min":1.0289999999999999,"15min":1.034},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.748}]}]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":514714,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45700000000000002,"15min":0.42199999999999999},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.375},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.443},"min":{"1min":0.311,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.91700000000000004,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70599999999999996,"15min":0.66000000000000003},"min":{"1min":0.46700000000000003,"5min":0.41999999999999998,"15min":0.40600000000000003},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69399999999999995,"15min":0.65400000000000003},"min":{"1min":0.54200000000000004,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.753,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1180000000000001,"5min":6.367,"15min":6.367},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.66900000000000004},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":1.004,"15min":1.004},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72299999999999998,"15min":0.70399999999999996},"min":{"1min":0.51500000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0489999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.86799999999999999,"15min":0.74099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.161,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Aug 10 10:50:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77300000000000002,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":6.3410000000000002,"15min":6.3410000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.53200000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95699999999999996,"5min":1.054,"15min":1.054},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.63400000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80600000000000005,"15min":0.77200000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.76000000000000001},"min":{"1min":0.65500000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1519999999999999,"5min":1.327,"15min":1.327},"last":0.76700000000000002}]},{"osd":8,"last update":"Thu Aug 10 10:48:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84499999999999997,"15min":0.85099999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.04,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.85799999999999998},"min":{"1min":0.69799999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.0880000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.753}]},{"osd":9,"last update":"Thu Aug 10 10:49:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.82299999999999995,"15min":0.85999999999999999},"min":{"1min":0.50600000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.069,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.879,"15min":0.89500000000000002},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Aug 10 10:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.873,"15min":0.875},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.69599999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73299999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":520377,"data_compressed":23500,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50900000000000001,"15min":0.48199999999999998},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":1.143,"5min":1.143,"15min":1.2310000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.497},"min":{"1min":0.42799999999999999,"5min":0.34300000000000003,"15min":0.29099999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.68799999999999994},"min":{"1min":0.47099999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93600000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.749,"15min":0.71099999999999997},"min":{"1min":0.60099999999999998,"5min":0.48199999999999998,"15min":0.47499999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.421},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.67900000000000005},"min":{"1min":0.54300000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67600000000000005,"15min":0.65200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.04,"5min":1.069,"15min":1.069},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.77100000000000002,"15min":0.754},"min":{"1min":0.61199999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.204,"5min":1.377,"15min":1.377},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.77400000000000002,"15min":0.74199999999999999},"min":{"1min":0.61499999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:50:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.49099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98399999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.75800000000000001,"15min":0.72999999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.76800000000000002,"15min":0.755},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.76400000000000001}]},{"osd":8,"last update":"Thu Aug 10 10:50:33 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.91400000000000003,"15min":0.874},"min":{"1min":0.76200000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90300000000000002,"15min":0.88900000000000001},"min":{"1min":0.73099999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.92700000000000005}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84599999999999997,"15min":0.85299999999999998},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.0720000000000001,"5min":1.175,"15min":1.175},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.88400000000000001,"15min":0.872},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.93999999999999995}]},{"osd":10,"last update":"Thu Aug 10 10:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.92900000000000005,"15min":0.92800000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.226,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88600000000000001,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.097,"5min":1.137,"15min":1.137},"last":0.79200000000000004}]},{"osd":11,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0089999999999999,"15min":1.0049999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.03}]}]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":1112003,"data_compressed":59704,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.093,"5min":0.70399999999999996,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":8.9320000000000004,"5min":8.9320000000000004,"15min":8.9320000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69699999999999995,"15min":0.67400000000000004},"min":{"1min":0.503,"5min":0.439,"15min":0.439},"max":{"1min":0.92900000000000005,"5min":1.073,"15min":1.073},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.014,"15min":1.014},"last":0.87}]},{"osd":2,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51900000000000002,"15min":0.499},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77200000000000002,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80800000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.751,"15min":0.72499999999999998},"min":{"1min":0.53100000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72799999999999998,"15min":0.69399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88400000000000001,"5min":1.141,"15min":1.141},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71099999999999997,"15min":0.69099999999999995},"min":{"1min":0.55900000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.94499999999999995,"5min":1.321,"15min":1.321},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.57299999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77400000000000002,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.0129999999999999,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77100000000000002,"15min":0.75600000000000001},"min":{"1min":0.56299999999999994,"5min":0.502,"15min":0.502},"max":{"1min":0.96999999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.85199999999999998}]},{"osd":8,"last update":"Thu Aug 10 10:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.54500000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.89900000000000002,"5min":1.012,"15min":1.012},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83199999999999996,"5min":0.997,"15min":0.997},"last":0.97399999999999998}]},{"osd":9,"last update":"Thu Aug 10 10:49:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.84299999999999997},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83699999999999997,"15min":0.83399999999999996},"min":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.95899999999999996}]},{"osd":10,"last update":"Thu Aug 10 10:50:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.026,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.085,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34561,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36204,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:50:59.590 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:50:59.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.820+0000 7fcedf1ff700 1 -- 172.21.15.107:0/4055664214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 msgr2=0x7fced8108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.820+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/4055664214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 0x7fced8108bb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fced000b0d0 tx=0x7fced000b3e0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.820+0000 7fcedf1ff700 1 -- 172.21.15.107:0/4055664214 shutdown_connections 2023-08-10T10:50:59.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.820+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/4055664214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8100770 0x7fced8100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.820+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/4055664214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 0x7fced8108bb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.820+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/4055664214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fced8101960 0x7fced8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.820+0000 7fcedf1ff700 1 -- 172.21.15.107:0/4055664214 >> 172.21.15.107:0/4055664214 conn(0x7fced80fbca0 msgr2=0x7fced80fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:50:59.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.820+0000 7fcedf1ff700 1 -- 172.21.15.107:0/4055664214 shutdown_connections 2023-08-10T10:50:59.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.820+0000 7fcedf1ff700 1 -- 172.21.15.107:0/4055664214 wait complete. 2023-08-10T10:50:59.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.821+0000 7fcedf1ff700 1 Processor -- start 2023-08-10T10:50:59.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.821+0000 7fcedf1ff700 1 -- start start 2023-08-10T10:50:59.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.821+0000 7fcedf1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8100770 0x7fced8196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:59.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.821+0000 7fcedf1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fced8101960 0x7fced81968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:59.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.821+0000 7fcedf1ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 0x7fced819d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:59.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.821+0000 7fcedf1ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced819df00 con 0x7fced8102300 2023-08-10T10:50:59.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.821+0000 7fcedf1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced819e040 con 0x7fced8100770 2023-08-10T10:50:59.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.821+0000 7fcedf1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced819e1d0 con 0x7fced8101960 2023-08-10T10:50:59.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedd79c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 0x7fced819d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:59.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedd79c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 0x7fced819d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44440/0 (socket says 172.21.15.107:44440) 2023-08-10T10:50:59.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedd79c700 1 -- 172.21.15.107:0/2339669719 learned_addr learned my addr 172.21.15.107:0/2339669719 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:50:59.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fced7fff700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fced8101960 0x7fced81968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:59.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedcf9b700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8100770 0x7fced8196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:59.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedd79c700 1 -- 172.21.15.107:0/2339669719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fced8101960 msgr2=0x7fced81968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedd79c700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fced8101960 0x7fced81968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedd79c700 1 -- 172.21.15.107:0/2339669719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8100770 msgr2=0x7fced8196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:50:59.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedd79c700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8100770 0x7fced8196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:50:59.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedd79c700 1 -- 172.21.15.107:0/2339669719 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0009d00 con 0x7fced8102300 2023-08-10T10:50:59.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fcedd79c700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 0x7fced819d930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fced0007850 tx=0x7fced000baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:59.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.822+0000 7fced5ffb700 1 -- 172.21.15.107:0/2339669719 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000e040 con 0x7fced8102300 2023-08-10T10:50:59.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.823+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced819e450 con 0x7fced8102300 2023-08-10T10:50:59.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.823+0000 7fced5ffb700 1 -- 172.21.15.107:0/2339669719 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fced0003c00 con 0x7fced8102300 2023-08-10T10:50:59.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.823+0000 7fced5ffb700 1 -- 172.21.15.107:0/2339669719 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced001b6a0 con 0x7fced8102300 2023-08-10T10:50:59.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.823+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced819e8d0 con 0x7fced8102300 2023-08-10T10:50:59.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.824+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced8107cc0 con 0x7fced8102300 2023-08-10T10:50:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.825+0000 7fced5ffb700 1 -- 172.21.15.107:0/2339669719 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fced0024410 con 0x7fced8102300 2023-08-10T10:50:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.827+0000 7fced5ffb700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcec80a11a0 0x7fcec80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:50:59.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.828+0000 7fced5ffb700 1 -- 172.21.15.107:0/2339669719 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fced00cdf90 con 0x7fced8102300 2023-08-10T10:50:59.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.828+0000 7fcedcf9b700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcec80a11a0 0x7fcec80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:50:59.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.828+0000 7fcedcf9b700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcec80a11a0 0x7fcec80a3660 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fced81017c0 tx=0x7fcecc005d70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:50:59.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:50:59.831+0000 7fced5ffb700 1 -- 172.21.15.107:0/2339669719 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fced00973f0 con 0x7fced8102300 2023-08-10T10:50:59.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:59 smithi195 ceph-mon[129938]: from='client.15633 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:50:59.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:50:59 smithi195 ceph-mon[129938]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:51:00.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.033+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fced802c970 con 0x7fced8102300 2023-08-10T10:51:00.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.034+0000 7fced5ffb700 1 -- 172.21.15.107:0/2339669719 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24563 (secure 0 0 0) 0x7fced0003d70 con 0x7fced8102300 2023-08-10T10:51:00.036 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:00.036 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":93,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:50:13.687527+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:00.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcec80a11a0 msgr2=0x7fcec80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcec80a11a0 0x7fcec80a3660 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fced81017c0 tx=0x7fcecc005d70 comp rx=0 tx=0).stop 2023-08-10T10:51:00.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 msgr2=0x7fced819d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 0x7fced819d930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fced0007850 tx=0x7fced000baa0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 shutdown_connections 2023-08-10T10:51:00.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcec80a11a0 0x7fcec80a3660 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced8100770 0x7fced8196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fced8102300 0x7fced819d930 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 --2- 172.21.15.107:0/2339669719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fced8101960 0x7fced81968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 >> 172.21.15.107:0/2339669719 conn(0x7fced80fbca0 msgr2=0x7fced8104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 shutdown_connections 2023-08-10T10:51:00.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.037+0000 7fcedf1ff700 1 -- 172.21.15.107:0/2339669719 wait complete. 2023-08-10T10:51:00.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:59 smithi157 ceph-mon[129604]: from='client.15633 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:51:00.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:50:59 smithi157 ceph-mon[129604]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:51:00.054 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:59 smithi107 ceph-mon[127953]: from='client.15633 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:51:00.055 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:50:59 smithi107 ceph-mon[127953]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:51:00.057 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:51:00.058 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:51:00.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.257+0000 7f13f23ff700 1 -- 172.21.15.107:0/2462635040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ec10cd50 msgr2=0x7f13ec10f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.257+0000 7f13f23ff700 1 --2- 172.21.15.107:0/2462635040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ec10cd50 0x7f13ec10f140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f13e400b0a0 tx=0x7f13e400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.257+0000 7f13f23ff700 1 -- 172.21.15.107:0/2462635040 shutdown_connections 2023-08-10T10:51:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.257+0000 7f13f23ff700 1 --2- 172.21.15.107:0/2462635040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ec10cd50 0x7f13ec10f140 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.257+0000 7f13f23ff700 1 --2- 172.21.15.107:0/2462635040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ec0747b0 0x7f13ec072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.257+0000 7f13f23ff700 1 --2- 172.21.15.107:0/2462635040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13ec0731d0 0x7f13ec073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.257+0000 7f13f23ff700 1 -- 172.21.15.107:0/2462635040 >> 172.21.15.107:0/2462635040 conn(0x7f13ec0fbcf0 msgr2=0x7f13ec0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.257+0000 7f13f23ff700 1 -- 172.21.15.107:0/2462635040 shutdown_connections 2023-08-10T10:51:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.257+0000 7f13f23ff700 1 -- 172.21.15.107:0/2462635040 wait complete. 2023-08-10T10:51:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.258+0000 7f13f23ff700 1 Processor -- start 2023-08-10T10:51:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.258+0000 7f13f23ff700 1 -- start start 2023-08-10T10:51:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.258+0000 7f13f23ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13ec0731d0 0x7f13ec19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.258+0000 7f13f23ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ec0747b0 0x7f13ec19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.258+0000 7f13f23ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ec10cd50 0x7f13ec1a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.258+0000 7f13f23ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec1a4590 con 0x7f13ec10cd50 2023-08-10T10:51:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.258+0000 7f13f23ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec1a46d0 con 0x7f13ec0731d0 2023-08-10T10:51:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.258+0000 7f13f23ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec1a4860 con 0x7f13ec0747b0 2023-08-10T10:51:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13ebfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13ec0731d0 0x7f13ec19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13ebfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13ec0731d0 0x7f13ec19ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:47220/0 (socket says 172.21.15.107:47220) 2023-08-10T10:51:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13ebfff700 1 -- 172.21.15.107:0/3623952696 learned_addr learned my addr 172.21.15.107:0/3623952696 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13f099c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ec10cd50 0x7f13ec1a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13eb7fe700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ec0747b0 0x7f13ec19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13ebfff700 1 -- 172.21.15.107:0/3623952696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ec0747b0 msgr2=0x7f13ec19cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13ebfff700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ec0747b0 0x7f13ec19cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13ebfff700 1 -- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ec10cd50 msgr2=0x7f13ec1a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13ebfff700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ec10cd50 0x7f13ec1a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13ebfff700 1 -- 172.21.15.107:0/3623952696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e4009d00 con 0x7f13ec0731d0 2023-08-10T10:51:00.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13f099c700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ec10cd50 0x7f13ec1a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:00.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.259+0000 7f13ebfff700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13ec0731d0 0x7f13ec19ca10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00d980 tx=0x7f13dc00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:00.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.260+0000 7f13e97fa700 1 -- 172.21.15.107:0/3623952696 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc004220 con 0x7f13ec0731d0 2023-08-10T10:51:00.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.260+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ec1a4b40 con 0x7f13ec0731d0 2023-08-10T10:51:00.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.260+0000 7f13e97fa700 1 -- 172.21.15.107:0/3623952696 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13dc007640 con 0x7f13ec0731d0 2023-08-10T10:51:00.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.260+0000 7f13e97fa700 1 -- 172.21.15.107:0/3623952696 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc005660 con 0x7f13ec0731d0 2023-08-10T10:51:00.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.260+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ec1a50a0 con 0x7f13ec0731d0 2023-08-10T10:51:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.261+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ec1028a0 con 0x7f13ec0731d0 2023-08-10T10:51:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.263+0000 7f13e97fa700 1 -- 172.21.15.107:0/3623952696 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f13dc004750 con 0x7f13ec0731d0 2023-08-10T10:51:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.264+0000 7f13e97fa700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f13d40a11d0 0x7f13d40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.264+0000 7f13e97fa700 1 -- 172.21.15.107:0/3623952696 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f13dc0cce40 con 0x7f13ec0731d0 2023-08-10T10:51:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.265+0000 7f13eb7fe700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f13d40a11d0 0x7f13d40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.265+0000 7f13eb7fe700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f13d40a11d0 0x7f13d40a3690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0744d0 tx=0x7f13e0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:00.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.267+0000 7f13e97fa700 1 -- 172.21.15.107:0/3623952696 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f13dc096210 con 0x7f13ec0731d0 2023-08-10T10:51:00.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.470+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13ec02cb20 con 0x7f13ec0731d0 2023-08-10T10:51:00.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.471+0000 7f13e97fa700 1 -- 172.21.15.107:0/3623952696 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13dc016070 con 0x7f13ec0731d0 2023-08-10T10:51:00.472 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T10:51:00.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.473+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f13d40a11d0 msgr2=0x7f13d40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.473+0000 7f13f23ff700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f13d40a11d0 0x7f13d40a3690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0744d0 tx=0x7f13e0009260 comp rx=0 tx=0).stop 2023-08-10T10:51:00.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.473+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13ec0731d0 msgr2=0x7f13ec19ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.473+0000 7f13f23ff700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13ec0731d0 0x7f13ec19ca10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00d980 tx=0x7f13dc00dc90 comp rx=0 tx=0).stop 2023-08-10T10:51:00.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.474+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 shutdown_connections 2023-08-10T10:51:00.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.474+0000 7f13f23ff700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f13d40a11d0 0x7f13d40a3690 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.474+0000 7f13f23ff700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13ec0731d0 0x7f13ec19ca10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.474+0000 7f13f23ff700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ec10cd50 0x7f13ec1a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.474+0000 7f13f23ff700 1 --2- 172.21.15.107:0/3623952696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13ec0747b0 0x7f13ec19cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.474+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 >> 172.21.15.107:0/3623952696 conn(0x7f13ec0fbcf0 msgr2=0x7f13ec0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.474+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 shutdown_connections 2023-08-10T10:51:00.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.474+0000 7f13f23ff700 1 -- 172.21.15.107:0/3623952696 wait complete. 2023-08-10T10:51:00.495 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:51:00.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.696+0000 7fe899fff700 1 -- 172.21.15.107:0/3790826880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 msgr2=0x7fe894101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.696+0000 7fe899fff700 1 --2- 172.21.15.107:0/3790826880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 0x7fe894101dd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009920 tx=0x7fe87c009c30 comp rx=0 tx=0).stop 2023-08-10T10:51:00.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.696+0000 7fe899fff700 1 -- 172.21.15.107:0/3790826880 shutdown_connections 2023-08-10T10:51:00.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.696+0000 7fe899fff700 1 --2- 172.21.15.107:0/3790826880 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe894100780 0x7fe894100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.696+0000 7fe899fff700 1 --2- 172.21.15.107:0/3790826880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894102310 0x7fe894108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.696+0000 7fe899fff700 1 --2- 172.21.15.107:0/3790826880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 0x7fe894101dd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.696+0000 7fe899fff700 1 -- 172.21.15.107:0/3790826880 >> 172.21.15.107:0/3790826880 conn(0x7fe8940fbcf0 msgr2=0x7fe8940fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:00.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.696+0000 7fe899fff700 1 -- 172.21.15.107:0/3790826880 shutdown_connections 2023-08-10T10:51:00.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.696+0000 7fe899fff700 1 -- 172.21.15.107:0/3790826880 wait complete. 2023-08-10T10:51:00.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.697+0000 7fe899fff700 1 Processor -- start 2023-08-10T10:51:00.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.697+0000 7fe899fff700 1 -- start start 2023-08-10T10:51:00.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.697+0000 7fe899fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe894100780 0x7fe8941986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:00.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.697+0000 7fe899fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 0x7fe894198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:00.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.697+0000 7fe899fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894102310 0x7fe89419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:00.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.697+0000 7fe899fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8941a0250 con 0x7fe894101970 2023-08-10T10:51:00.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.697+0000 7fe899fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8941a0390 con 0x7fe894100780 2023-08-10T10:51:00.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.697+0000 7fe899fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8941a0520 con 0x7fe894102310 2023-08-10T10:51:00.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe88bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 0x7fe894198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:00.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe8937fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe894100780 0x7fe8941986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:00.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe88bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 0x7fe894198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44480/0 (socket says 172.21.15.107:44480) 2023-08-10T10:51:00.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe88bfff700 1 -- 172.21.15.107:0/6764545 learned_addr learned my addr 172.21.15.107:0/6764545 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:00.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe893fff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894102310 0x7fe89419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:00.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe8937fe700 1 -- 172.21.15.107:0/6764545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894102310 msgr2=0x7fe89419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe8937fe700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894102310 0x7fe89419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe8937fe700 1 -- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 msgr2=0x7fe894198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe8937fe700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 0x7fe894198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe8937fe700 1 -- 172.21.15.107:0/6764545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c009520 con 0x7fe894100780 2023-08-10T10:51:00.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe88bfff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 0x7fe894198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:00.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.698+0000 7fe8937fe700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe894100780 0x7fe8941986d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e7b0 tx=0x7fe88400eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:00.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.699+0000 7fe8917fa700 1 -- 172.21.15.107:0/6764545 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884004220 con 0x7fe894100780 2023-08-10T10:51:00.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.699+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8941a0800 con 0x7fe894100780 2023-08-10T10:51:00.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.699+0000 7fe8917fa700 1 -- 172.21.15.107:0/6764545 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe884004cc0 con 0x7fe894100780 2023-08-10T10:51:00.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.699+0000 7fe8917fa700 1 -- 172.21.15.107:0/6764545 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8840055f0 con 0x7fe894100780 2023-08-10T10:51:00.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.699+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8941a0cc0 con 0x7fe894100780 2023-08-10T10:51:00.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.700+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe894192cb0 con 0x7fe894100780 2023-08-10T10:51:00.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.702+0000 7fe8917fa700 1 -- 172.21.15.107:0/6764545 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe884004750 con 0x7fe894100780 2023-08-10T10:51:00.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.703+0000 7fe8917fa700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8800a1150 0x7fe8800a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:00.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.703+0000 7fe8917fa700 1 -- 172.21.15.107:0/6764545 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fe884014070 con 0x7fe894100780 2023-08-10T10:51:00.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.703+0000 7fe88bfff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8800a1150 0x7fe8800a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:00.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.704+0000 7fe88bfff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8800a1150 0x7fe8800a3610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00f9d0 tx=0x7fe87c019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:00.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.705+0000 7fe8917fa700 1 -- 172.21.15.107:0/6764545 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe884096040 con 0x7fe894100780 2023-08-10T10:51:00.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:00 smithi107 ceph-mon[127953]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:51:00.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:00 smithi107 ceph-mon[127953]: pgmap v377: 129 pgs: 129 active+clean; 649 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2023-08-10T10:51:00.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2339669719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:51:00.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:00 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3623952696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:51:00.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.905+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe89402cc00 con 0x7fe894100780 2023-08-10T10:51:00.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.906+0000 7fe8917fa700 1 -- 172.21.15.107:0/6764545 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe884099660 con 0x7fe894100780 2023-08-10T10:51:00.907 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:51:00.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8800a1150 msgr2=0x7fe8800a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8800a1150 0x7fe8800a3610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00f9d0 tx=0x7fe87c019040 comp rx=0 tx=0).stop 2023-08-10T10:51:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe894100780 msgr2=0x7fe8941986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe894100780 0x7fe8941986d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe88400e7b0 tx=0x7fe88400eac0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 shutdown_connections 2023-08-10T10:51:00.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fe8800a1150 0x7fe8800a3610 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe894100780 0x7fe8941986d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe894102310 0x7fe89419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 --2- 172.21.15.107:0/6764545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe894101970 0x7fe894198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:00.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 >> 172.21.15.107:0/6764545 conn(0x7fe8940fbcf0 msgr2=0x7fe894107440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:00.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 shutdown_connections 2023-08-10T10:51:00.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:00.908+0000 7fe899fff700 1 -- 172.21.15.107:0/6764545 wait complete. 2023-08-10T10:51:00.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:00 smithi195 ceph-mon[129938]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:51:00.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:00 smithi195 ceph-mon[129938]: pgmap v377: 129 pgs: 129 active+clean; 649 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2023-08-10T10:51:00.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:00 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2339669719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:51:00.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:00 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3623952696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:51:00.927 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:51:01.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:00 smithi157 ceph-mon[129604]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-08-10T10:51:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:00 smithi157 ceph-mon[129604]: pgmap v377: 129 pgs: 129 active+clean; 649 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2023-08-10T10:51:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:00 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2339669719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:51:01.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:00 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3623952696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T10:51:01.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.126+0000 7f82633ff700 1 -- 172.21.15.107:0/954867369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 msgr2=0x7f825c0735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.126+0000 7f82633ff700 1 --2- 172.21.15.107:0/954867369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 0x7f825c0735f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f824c009990 tx=0x7f824c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.126+0000 7f82633ff700 1 -- 172.21.15.107:0/954867369 shutdown_connections 2023-08-10T10:51:01.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.126+0000 7f82633ff700 1 --2- 172.21.15.107:0/954867369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f825c074750 0x7f825c072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.126+0000 7f82633ff700 1 --2- 172.21.15.107:0/954867369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f825c108630 0x7f825c10aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.126+0000 7f82633ff700 1 --2- 172.21.15.107:0/954867369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 0x7f825c0735f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.126+0000 7f82633ff700 1 -- 172.21.15.107:0/954867369 >> 172.21.15.107:0/954867369 conn(0x7f825c0fbcb0 msgr2=0x7f825c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:01.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.126+0000 7f82633ff700 1 -- 172.21.15.107:0/954867369 shutdown_connections 2023-08-10T10:51:01.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.126+0000 7f82633ff700 1 -- 172.21.15.107:0/954867369 wait complete. 2023-08-10T10:51:01.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.127+0000 7f82633ff700 1 Processor -- start 2023-08-10T10:51:01.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.127+0000 7f82633ff700 1 -- start start 2023-08-10T10:51:01.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f82633ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 0x7f825c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f82633ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f825c074750 0x7f825c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f82633ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f825c108630 0x7f825c19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f82633ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1a0130 con 0x7f825c073170 2023-08-10T10:51:01.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f82633ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1a0270 con 0x7f825c108630 2023-08-10T10:51:01.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f82633ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1a0400 con 0x7f825c074750 2023-08-10T10:51:01.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826119b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 0x7f825c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:01.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826119b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 0x7f825c1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44494/0 (socket says 172.21.15.107:44494) 2023-08-10T10:51:01.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826119b700 1 -- 172.21.15.107:0/3799343658 learned_addr learned my addr 172.21.15.107:0/3799343658 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:01.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826199c700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f825c108630 0x7f825c19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:01.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826119b700 1 -- 172.21.15.107:0/3799343658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f825c074750 msgr2=0x7f825c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826099a700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f825c074750 0x7f825c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:01.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826119b700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f825c074750 0x7f825c198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826119b700 1 -- 172.21.15.107:0/3799343658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f825c108630 msgr2=0x7f825c19fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826119b700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f825c108630 0x7f825c19fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826119b700 1 -- 172.21.15.107:0/3799343658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0095f0 con 0x7f825c073170 2023-08-10T10:51:01.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.128+0000 7f826199c700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f825c108630 0x7f825c19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:01.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.129+0000 7f826119b700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 0x7f825c1985b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f825800e9a0 tx=0x7f825800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:01.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.129+0000 7f82527fc700 1 -- 172.21.15.107:0/3799343658 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258009790 con 0x7f825c073170 2023-08-10T10:51:01.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.129+0000 7f82527fc700 1 -- 172.21.15.107:0/3799343658 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f825800cbd0 con 0x7f825c073170 2023-08-10T10:51:01.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.129+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c1a06e0 con 0x7f825c073170 2023-08-10T10:51:01.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.129+0000 7f82527fc700 1 -- 172.21.15.107:0/3799343658 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258018680 con 0x7f825c073170 2023-08-10T10:51:01.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.129+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c1a0c40 con 0x7f825c073170 2023-08-10T10:51:01.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.130+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c106d30 con 0x7f825c073170 2023-08-10T10:51:01.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.132+0000 7f82527fc700 1 -- 172.21.15.107:0/3799343658 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f825800cd40 con 0x7f825c073170 2023-08-10T10:51:01.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.133+0000 7f82527fc700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82480a11d0 0x7f82480a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.133+0000 7f82527fc700 1 -- 172.21.15.107:0/3799343658 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f8258014070 con 0x7f825c073170 2023-08-10T10:51:01.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.134+0000 7f826099a700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82480a11d0 0x7f82480a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:01.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.134+0000 7f826099a700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82480a11d0 0x7f82480a3690 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f824c00b2e0 tx=0x7f824c005910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:01.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.137+0000 7f82527fc700 1 -- 172.21.15.107:0/3799343658 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8258051790 con 0x7f825c073170 2023-08-10T10:51:01.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.338+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f825c0613b0 con 0x7f825c073170 2023-08-10T10:51:01.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.339+0000 7f82527fc700 1 -- 172.21.15.107:0/3799343658 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8258099e40 con 0x7f825c073170 2023-08-10T10:51:01.340 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T10:51:01.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82480a11d0 msgr2=0x7f82480a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82480a11d0 0x7f82480a3690 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f824c00b2e0 tx=0x7f824c005910 comp rx=0 tx=0).stop 2023-08-10T10:51:01.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 msgr2=0x7f825c1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 0x7f825c1985b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f825800e9a0 tx=0x7f825800ed60 comp rx=0 tx=0).stop 2023-08-10T10:51:01.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 shutdown_connections 2023-08-10T10:51:01.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f82480a11d0 0x7f82480a3690 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f825c108630 0x7f825c19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f825c073170 0x7f825c1985b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 --2- 172.21.15.107:0/3799343658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f825c074750 0x7f825c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 >> 172.21.15.107:0/3799343658 conn(0x7f825c0fbcb0 msgr2=0x7f825c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:01.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 shutdown_connections 2023-08-10T10:51:01.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.341+0000 7f82633ff700 1 -- 172.21.15.107:0/3799343658 wait complete. 2023-08-10T10:51:01.361 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:51:01.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.560+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3667617672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ad0102310 msgr2=0x7f9ad0108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.560+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3667617672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ad0102310 0x7f9ad0108bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009f90 tx=0x7f9ac800b330 comp rx=0 tx=0).stop 2023-08-10T10:51:01.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.560+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3667617672 shutdown_connections 2023-08-10T10:51:01.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.560+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3667617672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ad0102310 0x7f9ad0108bc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.560+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3667617672 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ad0100780 0x7f9ad0100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.560+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3667617672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad0101970 0x7f9ad0101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.560+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3667617672 >> 172.21.15.107:0/3667617672 conn(0x7f9ad00fbcf0 msgr2=0x7f9ad00fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:01.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.560+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3667617672 shutdown_connections 2023-08-10T10:51:01.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.560+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3667617672 wait complete. 2023-08-10T10:51:01.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.561+0000 7f9ad65ff700 1 Processor -- start 2023-08-10T10:51:01.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.561+0000 7f9ad65ff700 1 -- start start 2023-08-10T10:51:01.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.561+0000 7f9ad65ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad0100780 0x7f9ad01964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.561+0000 7f9ad65ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ad0101970 0x7f9ad01969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.561+0000 7f9ad65ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ad0102310 0x7f9ad019da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ad65ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad019e030 con 0x7f9ad0101970 2023-08-10T10:51:01.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ad65ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad019e170 con 0x7f9ad0100780 2023-08-10T10:51:01.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ad65ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad019e300 con 0x7f9ad0102310 2023-08-10T10:51:01.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ac7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ad0101970 0x7f9ad01969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:01.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ac7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ad0101970 0x7f9ad01969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44502/0 (socket says 172.21.15.107:44502) 2023-08-10T10:51:01.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ac7fff700 1 -- 172.21.15.107:0/3639802500 learned_addr learned my addr 172.21.15.107:0/3639802500 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:01.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9acffff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad0100780 0x7f9ad01964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:01.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ad4b9c700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ad0102310 0x7f9ad019da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:01.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ac7fff700 1 -- 172.21.15.107:0/3639802500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ad0102310 msgr2=0x7f9ad019da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ac7fff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ad0102310 0x7f9ad019da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ac7fff700 1 -- 172.21.15.107:0/3639802500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad0100780 msgr2=0x7f9ad01964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ac7fff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad0100780 0x7f9ad01964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ac7fff700 1 -- 172.21.15.107:0/3639802500 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac8009c40 con 0x7f9ad0101970 2023-08-10T10:51:01.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.562+0000 7f9ac7fff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ad0101970 0x7f9ad01969f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800e9a0 tx=0x7f9ab800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:01.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.563+0000 7f9acdffb700 1 -- 172.21.15.107:0/3639802500 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8009790 con 0x7f9ad0101970 2023-08-10T10:51:01.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.563+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad019e5e0 con 0x7f9ad0101970 2023-08-10T10:51:01.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.563+0000 7f9acdffb700 1 -- 172.21.15.107:0/3639802500 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ab800cbd0 con 0x7f9ad0101970 2023-08-10T10:51:01.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.563+0000 7f9acdffb700 1 -- 172.21.15.107:0/3639802500 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800eee0 con 0x7f9ad0101970 2023-08-10T10:51:01.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.563+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad019eb40 con 0x7f9ad0101970 2023-08-10T10:51:01.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.564+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad010bea0 con 0x7f9ad0101970 2023-08-10T10:51:01.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.566+0000 7f9acdffb700 1 -- 172.21.15.107:0/3639802500 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f9ab800cd40 con 0x7f9ad0101970 2023-08-10T10:51:01.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.567+0000 7f9acdffb700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9abc0a11d0 0x7f9abc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.567+0000 7f9acdffb700 1 -- 172.21.15.107:0/3639802500 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f9ab8014070 con 0x7f9ad0101970 2023-08-10T10:51:01.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.567+0000 7f9acffff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9abc0a11d0 0x7f9abc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:01.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.568+0000 7f9acffff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9abc0a11d0 0x7f9abc0a3690 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ad01017d0 tx=0x7f9ac0009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:01.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.571+0000 7f9acdffb700 1 -- 172.21.15.107:0/3639802500 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9ab8051790 con 0x7f9ad0101970 2023-08-10T10:51:01.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.775+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9ad01076c0 con 0x7f9ad0101970 2023-08-10T10:51:01.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.775+0000 7f9acdffb700 1 -- 172.21.15.107:0/3639802500 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v93) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9ab8096280 con 0x7f9ad0101970 2023-08-10T10:51:01.777 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T10:51:01.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9abc0a11d0 msgr2=0x7f9abc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9abc0a11d0 0x7f9abc0a3690 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ad01017d0 tx=0x7f9ac0009310 comp rx=0 tx=0).stop 2023-08-10T10:51:01.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ad0101970 msgr2=0x7f9ad01969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ad0101970 0x7f9ad01969f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800e9a0 tx=0x7f9ab800ed60 comp rx=0 tx=0).stop 2023-08-10T10:51:01.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 shutdown_connections 2023-08-10T10:51:01.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f9abc0a11d0 0x7f9abc0a3690 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad0100780 0x7f9ad01964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ad0102310 0x7f9ad019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 --2- 172.21.15.107:0/3639802500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ad0101970 0x7f9ad01969f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 >> 172.21.15.107:0/3639802500 conn(0x7f9ad00fbcf0 msgr2=0x7f9ad00fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:01.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 shutdown_connections 2023-08-10T10:51:01.781 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.778+0000 7f9ad65ff700 1 -- 172.21.15.107:0/3639802500 wait complete. 2023-08-10T10:51:01.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:51:01.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:01 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/6764545' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:51:01.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:01 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3799343658' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:51:01.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.994+0000 7f2deddff700 1 -- 172.21.15.107:0/3625988013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8102300 msgr2=0x7f2de8108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:01.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.994+0000 7f2deddff700 1 --2- 172.21.15.107:0/3625988013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8102300 0x7f2de8108bb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009fc0 tx=0x7f2de000b330 comp rx=0 tx=0).stop 2023-08-10T10:51:01.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.994+0000 7f2deddff700 1 -- 172.21.15.107:0/3625988013 shutdown_connections 2023-08-10T10:51:01.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.994+0000 7f2deddff700 1 --2- 172.21.15.107:0/3625988013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8102300 0x7f2de8108bb0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.994+0000 7f2deddff700 1 --2- 172.21.15.107:0/3625988013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de8100770 0x7f2de8100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.994+0000 7f2deddff700 1 --2- 172.21.15.107:0/3625988013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de8101960 0x7f2de8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:01.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.994+0000 7f2deddff700 1 -- 172.21.15.107:0/3625988013 >> 172.21.15.107:0/3625988013 conn(0x7f2de80fbca0 msgr2=0x7f2de80fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:01.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.994+0000 7f2deddff700 1 -- 172.21.15.107:0/3625988013 shutdown_connections 2023-08-10T10:51:01.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.994+0000 7f2deddff700 1 -- 172.21.15.107:0/3625988013 wait complete. 2023-08-10T10:51:01.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.995+0000 7f2deddff700 1 Processor -- start 2023-08-10T10:51:01.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.995+0000 7f2deddff700 1 -- start start 2023-08-10T10:51:01.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.995+0000 7f2deddff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de8100770 0x7f2de8198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.995+0000 7f2deddff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8101960 0x7f2de8198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.995+0000 7f2deddff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de8102300 0x7f2de819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:01.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.995+0000 7f2deddff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de81a01c0 con 0x7f2de8101960 2023-08-10T10:51:01.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.995+0000 7f2deddff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de81a0300 con 0x7f2de8102300 2023-08-10T10:51:01.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.995+0000 7f2deddff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de81a0490 con 0x7f2de8100770 2023-08-10T10:51:01.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8101960 0x7f2de8198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:01.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8101960 0x7f2de8198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44516/0 (socket says 172.21.15.107:44516) 2023-08-10T10:51:01.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de6ffd700 1 -- 172.21.15.107:0/1703707774 learned_addr learned my addr 172.21.15.107:0/1703707774 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:01.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de77fe700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de8100770 0x7f2de8198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de7fff700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de8102300 0x7f2de819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de6ffd700 1 -- 172.21.15.107:0/1703707774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de8100770 msgr2=0x7f2de8198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de6ffd700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de8100770 0x7f2de8198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de6ffd700 1 -- 172.21.15.107:0/1703707774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de8102300 msgr2=0x7f2de819fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de6ffd700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de8102300 0x7f2de819fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de6ffd700 1 -- 172.21.15.107:0/1703707774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0009c40 con 0x7f2de8101960 2023-08-10T10:51:02.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de7fff700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de8102300 0x7f2de819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:02.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de6ffd700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8101960 0x7f2de8198b80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e9a0 tx=0x7f2ddc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.996+0000 7f2de4ff9700 1 -- 172.21.15.107:0/1703707774 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc009790 con 0x7f2de8101960 2023-08-10T10:51:02.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.997+0000 7f2de4ff9700 1 -- 172.21.15.107:0/1703707774 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ddc00cbd0 con 0x7f2de8101960 2023-08-10T10:51:02.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.997+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de81a0770 con 0x7f2de8101960 2023-08-10T10:51:02.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.997+0000 7f2de4ff9700 1 -- 172.21.15.107:0/1703707774 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00eee0 con 0x7f2de8101960 2023-08-10T10:51:02.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.997+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de81a0c80 con 0x7f2de8101960 2023-08-10T10:51:02.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:01.998+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de810be90 con 0x7f2de8101960 2023-08-10T10:51:02.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.000+0000 7f2de4ff9700 1 -- 172.21.15.107:0/1703707774 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2ddc00cd40 con 0x7f2de8101960 2023-08-10T10:51:02.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.001+0000 7f2de4ff9700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2dd00a11a0 0x7f2dd00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.001+0000 7f2de4ff9700 1 -- 172.21.15.107:0/1703707774 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f2ddc014070 con 0x7f2de8101960 2023-08-10T10:51:02.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.001+0000 7f2de77fe700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2dd00a11a0 0x7f2dd00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.002+0000 7f2de77fe700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2dd00a11a0 0x7f2dd00a3660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2de81017c0 tx=0x7f2dd8009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.003+0000 7f2de4ff9700 1 -- 172.21.15.107:0/1703707774 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2ddc0964c0 con 0x7f2de8101960 2023-08-10T10:51:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:01 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/6764545' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:51:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:01 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3799343658' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:51:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:01 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/6764545' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T10:51:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:01 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3799343658' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T10:51:02.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.259+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2de810c080 con 0x7f2de8101960 2023-08-10T10:51:02.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.260+0000 7f2de4ff9700 1 -- 172.21.15.107:0/1703707774 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10914 (secure 0 0 0) 0x7f2ddc026090 con 0x7f2de8101960 2023-08-10T10:51:02.261 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:02.261 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:49:16.643966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:51:02.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2dd00a11a0 msgr2=0x7f2dd00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2dd00a11a0 0x7f2dd00a3660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2de81017c0 tx=0x7f2dd8009310 comp rx=0 tx=0).stop 2023-08-10T10:51:02.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8101960 msgr2=0x7f2de8198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8101960 0x7f2de8198b80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e9a0 tx=0x7f2ddc00ed60 comp rx=0 tx=0).stop 2023-08-10T10:51:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 shutdown_connections 2023-08-10T10:51:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f2dd00a11a0 0x7f2dd00a3660 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2de8102300 0x7f2de819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de8100770 0x7f2de8198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 --2- 172.21.15.107:0/1703707774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2de8101960 0x7f2de8198b80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 >> 172.21.15.107:0/1703707774 conn(0x7f2de80fbca0 msgr2=0x7f2de81071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 shutdown_connections 2023-08-10T10:51:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.262+0000 7f2deddff700 1 -- 172.21.15.107:0/1703707774 wait complete. 2023-08-10T10:51:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:51:02.282 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:51:02.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.484+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3912924662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ac100770 msgr2=0x7fb9ac100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.484+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3912924662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ac100770 0x7fb9ac100b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009990 tx=0x7fb99c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.485+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3912924662 shutdown_connections 2023-08-10T10:51:02.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.485+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3912924662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9ac102300 0x7fb9ac108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.485+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3912924662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ac100770 0x7fb9ac100b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.485+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3912924662 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac101960 0x7fb9ac101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.485+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3912924662 >> 172.21.15.107:0/3912924662 conn(0x7fb9ac0fbca0 msgr2=0x7fb9ac0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:02.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.485+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3912924662 shutdown_connections 2023-08-10T10:51:02.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.485+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3912924662 wait complete. 2023-08-10T10:51:02.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9b29ff700 1 Processor -- start 2023-08-10T10:51:02.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9b29ff700 1 -- start start 2023-08-10T10:51:02.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9b29ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9ac100770 0x7fb9ac196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9b29ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac101960 0x7fb9ac196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9b29ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ac102300 0x7fb9ac19d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9b29ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac19dfb0 con 0x7fb9ac101960 2023-08-10T10:51:02.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9b29ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac19e0f0 con 0x7fb9ac100770 2023-08-10T10:51:02.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9b29ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac19e280 con 0x7fb9ac102300 2023-08-10T10:51:02.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9ab7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac101960 0x7fb9ac196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9ab7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac101960 0x7fb9ac196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44542/0 (socket says 172.21.15.107:44542) 2023-08-10T10:51:02.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9ab7fe700 1 -- 172.21.15.107:0/3529911107 learned_addr learned my addr 172.21.15.107:0/3529911107 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:02.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.486+0000 7fb9b0f9c700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ac102300 0x7fb9ac19d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9abfff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9ac100770 0x7fb9ac196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9ab7fe700 1 -- 172.21.15.107:0/3529911107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ac102300 msgr2=0x7fb9ac19d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9ab7fe700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ac102300 0x7fb9ac19d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9ab7fe700 1 -- 172.21.15.107:0/3529911107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9ac100770 msgr2=0x7fb9ac196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9ab7fe700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9ac100770 0x7fb9ac196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9ab7fe700 1 -- 172.21.15.107:0/3529911107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c0095f0 con 0x7fb9ac101960 2023-08-10T10:51:02.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9abfff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9ac100770 0x7fb9ac196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:02.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9ab7fe700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac101960 0x7fb9ac196970 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000e9a0 tx=0x7fb9a000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9a97fa700 1 -- 172.21.15.107:0/3529911107 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0009790 con 0x7fb9ac101960 2023-08-10T10:51:02.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac19e560 con 0x7fb9ac101960 2023-08-10T10:51:02.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9a97fa700 1 -- 172.21.15.107:0/3529911107 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9a000cbd0 con 0x7fb9ac101960 2023-08-10T10:51:02.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9a97fa700 1 -- 172.21.15.107:0/3529911107 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0018680 con 0x7fb9ac101960 2023-08-10T10:51:02.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.487+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac19eac0 con 0x7fb9ac101960 2023-08-10T10:51:02.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.488+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac10be90 con 0x7fb9ac101960 2023-08-10T10:51:02.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.490+0000 7fb9a97fa700 1 -- 172.21.15.107:0/3529911107 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb9a000cd40 con 0x7fb9ac101960 2023-08-10T10:51:02.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.492+0000 7fb9a97fa700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9940a11a0 0x7fb9940a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.492+0000 7fb9a97fa700 1 -- 172.21.15.107:0/3529911107 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fb9a0014070 con 0x7fb9ac101960 2023-08-10T10:51:02.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.492+0000 7fb9abfff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9940a11a0 0x7fb9940a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.492+0000 7fb9abfff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9940a11a0 0x7fb9940a3660 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00b2e0 tx=0x7fb99c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.495+0000 7fb9a97fa700 1 -- 172.21.15.107:0/3529911107 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb9a0051790 con 0x7fb9ac101960 2023-08-10T10:51:02.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.717+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9ac10c050 con 0x7fb9ac101960 2023-08-10T10:51:02.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.719+0000 7fb9a97fa700 1 -- 172.21.15.107:0/3529911107 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+24563 (secure 0 0 0) 0x7fb9a0096300 con 0x7fb9ac101960 2023-08-10T10:51:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:02.720 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":93,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T10:50:13.687527+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:51:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9940a11a0 msgr2=0x7fb9940a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9940a11a0 0x7fb9940a3660 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00b2e0 tx=0x7fb99c005fd0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac101960 msgr2=0x7fb9ac196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac101960 0x7fb9ac196970 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000e9a0 tx=0x7fb9a000ecb0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 shutdown_connections 2023-08-10T10:51:02.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fb9940a11a0 0x7fb9940a3660 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9ac100770 0x7fb9ac196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9ac102300 0x7fb9ac19d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 --2- 172.21.15.107:0/3529911107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9ac101960 0x7fb9ac196970 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 >> 172.21.15.107:0/3529911107 conn(0x7fb9ac0fbca0 msgr2=0x7fb9ac0fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:02.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 shutdown_connections 2023-08-10T10:51:02.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.722+0000 7fb9b29ff700 1 -- 172.21.15.107:0/3529911107 wait complete. 2023-08-10T10:51:02.742 DEBUG:tasks.fwd_scrub:Yielding 2023-08-10T10:51:02.743 INFO:teuthology.run_tasks:Running task exec... 2023-08-10T10:51:02.754 INFO:teuthology.task.exec:Executing custom commands... 2023-08-10T10:51:02.754 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T10:51:02.755 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-08-10T10:51:02.755 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-08-10T10:51:02.755 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-10T10:51:02.756 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-10T10:51:02.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:02 smithi195 ceph-mon[129938]: pgmap v378: 129 pgs: 129 active+clean; 649 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-08-10T10:51:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:02 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3639802500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:51:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:02 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1703707774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:51:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:51:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:02 smithi195 ceph-mon[129938]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:51:02.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.960+0000 7f8547fff700 1 -- 172.21.15.107:0/126579517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85481010a0 msgr2=0x7f8548103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.960+0000 7f8547fff700 1 --2- 172.21.15.107:0/126579517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85481010a0 0x7f8548103490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8538009990 tx=0x7f8538009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.960+0000 7f8547fff700 1 -- 172.21.15.107:0/126579517 shutdown_connections 2023-08-10T10:51:02.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.960+0000 7f8547fff700 1 --2- 172.21.15.107:0/126579517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8548106300 0x7f8548108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.960+0000 7f8547fff700 1 --2- 172.21.15.107:0/126579517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85481010a0 0x7f8548103490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.960+0000 7f8547fff700 1 --2- 172.21.15.107:0/126579517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85481039d0 0x7f8548105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.960+0000 7f8547fff700 1 -- 172.21.15.107:0/126579517 >> 172.21.15.107:0/126579517 conn(0x7f85480faa30 msgr2=0x7f85480fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:02.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.961+0000 7f8547fff700 1 -- 172.21.15.107:0/126579517 shutdown_connections 2023-08-10T10:51:02.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.961+0000 7f8547fff700 1 -- 172.21.15.107:0/126579517 wait complete. 2023-08-10T10:51:02.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8547fff700 1 Processor -- start 2023-08-10T10:51:02.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8547fff700 1 -- start start 2023-08-10T10:51:02.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8547fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85481010a0 0x7f85481961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8547fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85481039d0 0x7f85481966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8547fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8548106300 0x7f854819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8547fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854819dd20 con 0x7f85481039d0 2023-08-10T10:51:02.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8547fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854819de60 con 0x7f85481010a0 2023-08-10T10:51:02.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8547fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854819dff0 con 0x7f8548106300 2023-08-10T10:51:02.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f85467fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85481039d0 0x7f85481966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8546ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85481010a0 0x7f85481961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f85467fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85481039d0 0x7f85481966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58804/0 (socket says 172.21.15.107:58804) 2023-08-10T10:51:02.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f85467fc700 1 -- 172.21.15.107:0/413271969 learned_addr learned my addr 172.21.15.107:0/413271969 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:02.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.962+0000 7f8546ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85481010a0 0x7f85481961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:55844/0 (socket says 172.21.15.107:55844) 2023-08-10T10:51:02.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f85477fe700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8548106300 0x7f854819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f8546ffd700 1 -- 172.21.15.107:0/413271969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8548106300 msgr2=0x7f854819d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f8546ffd700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8548106300 0x7f854819d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f8546ffd700 1 -- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85481039d0 msgr2=0x7f85481966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f8546ffd700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85481039d0 0x7f85481966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f8546ffd700 1 -- 172.21.15.107:0/413271969 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c009520 con 0x7f85481010a0 2023-08-10T10:51:02.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f85467fc700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85481039d0 0x7f85481966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:02.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f8546ffd700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85481010a0 0x7f85481961a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f85380098e0 tx=0x7f8538005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.963+0000 7f852ffff700 1 -- 172.21.15.107:0/413271969 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853801d070 con 0x7f85481010a0 2023-08-10T10:51:02.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.964+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85380095f0 con 0x7f85481010a0 2023-08-10T10:51:02.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.964+0000 7f852ffff700 1 -- 172.21.15.107:0/413271969 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853800bdb0 con 0x7f85481010a0 2023-08-10T10:51:02.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.964+0000 7f852ffff700 1 -- 172.21.15.107:0/413271969 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538022d10 con 0x7f85481010a0 2023-08-10T10:51:02.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.964+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854819e500 con 0x7f85481010a0 2023-08-10T10:51:02.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.965+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85480fc5b0 con 0x7f85481010a0 2023-08-10T10:51:02.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.967+0000 7f852ffff700 1 -- 172.21.15.107:0/413271969 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8538022470 con 0x7f85481010a0 2023-08-10T10:51:02.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.968+0000 7f852ffff700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f85300a1150 0x7f85300a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.968+0000 7f852ffff700 1 -- 172.21.15.107:0/413271969 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f85380ce310 con 0x7f85481010a0 2023-08-10T10:51:02.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.968+0000 7f85467fc700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f85300a1150 0x7f85300a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.969+0000 7f85467fc700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f85300a1150 0x7f85300a3610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f853c009fd0 tx=0x7f853c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.971+0000 7f852ffff700 1 -- 172.21.15.107:0/413271969 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f85380977d0 con 0x7f85481010a0 2023-08-10T10:51:02.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.971+0000 7f552f7ff700 1 -- 172.21.15.107:0/3965450557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528074750 msgr2=0x7f5528072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.971+0000 7f552f7ff700 1 --2- 172.21.15.107:0/3965450557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528074750 0x7f5528072ba0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f551c00b0a0 tx=0x7f551c00b3b0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.972+0000 7f552f7ff700 1 -- 172.21.15.107:0/3965450557 shutdown_connections 2023-08-10T10:51:02.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.972+0000 7f552f7ff700 1 --2- 172.21.15.107:0/3965450557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528108630 0x7f552810aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.972+0000 7f552f7ff700 1 --2- 172.21.15.107:0/3965450557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528074750 0x7f5528072ba0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.972+0000 7f552f7ff700 1 --2- 172.21.15.107:0/3965450557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5528073170 0x7f55280735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.972+0000 7f552f7ff700 1 -- 172.21.15.107:0/3965450557 >> 172.21.15.107:0/3965450557 conn(0x7f55280fbcb0 msgr2=0x7f55280fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:02.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.972+0000 7f552f7ff700 1 -- 172.21.15.107:0/3965450557 shutdown_connections 2023-08-10T10:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.972+0000 7f552f7ff700 1 -- 172.21.15.107:0/3965450557 wait complete. 2023-08-10T10:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.973+0000 7f552f7ff700 1 Processor -- start 2023-08-10T10:51:02.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552f7ff700 1 -- start start 2023-08-10T10:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552f7ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528073170 0x7f5528198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552f7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5528074750 0x7f5528198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552f7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528108630 0x7f552819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552f7ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55281a0290 con 0x7f5528073170 2023-08-10T10:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552f7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55281a03d0 con 0x7f5528074750 2023-08-10T10:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552f7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55281a0560 con 0x7f5528108630 2023-08-10T10:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552d59b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528073170 0x7f5528198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552d59b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528073170 0x7f5528198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58816/0 (socket says 172.21.15.107:58816) 2023-08-10T10:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552d59b700 1 -- 172.21.15.107:0/985266425 learned_addr learned my addr 172.21.15.107:0/985266425 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552dd9c700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528108630 0x7f552819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.974+0000 7f552cd9a700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5528074750 0x7f5528198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.975+0000 7f552d59b700 1 -- 172.21.15.107:0/985266425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528108630 msgr2=0x7f552819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.975+0000 7f552d59b700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528108630 0x7f552819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.975+0000 7f552d59b700 1 -- 172.21.15.107:0/985266425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5528074750 msgr2=0x7f5528198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.975+0000 7f552d59b700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5528074750 0x7f5528198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.975+0000 7f552d59b700 1 -- 172.21.15.107:0/985266425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c009d00 con 0x7f5528073170 2023-08-10T10:51:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.975+0000 7f552d59b700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528073170 0x7f5528198710 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f551c00b780 tx=0x7f551c00bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.975+0000 7f55267fc700 1 -- 172.21.15.107:0/985266425 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c00e040 con 0x7f5528073170 2023-08-10T10:51:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.975+0000 7f55267fc700 1 -- 172.21.15.107:0/985266425 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f551c003e10 con 0x7f5528073170 2023-08-10T10:51:02.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.975+0000 7f552f7ff700 1 -- 172.21.15.107:0/985266425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55281a07e0 con 0x7f5528073170 2023-08-10T10:51:02.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.976+0000 7f55267fc700 1 -- 172.21.15.107:0/985266425 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0052a0 con 0x7f5528073170 2023-08-10T10:51:02.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.976+0000 7f552f7ff700 1 -- 172.21.15.107:0/985266425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55281a0c60 con 0x7f5528073170 2023-08-10T10:51:02.979 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.979+0000 7f55267fc700 1 -- 172.21.15.107:0/985266425 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f551c005400 con 0x7f5528073170 2023-08-10T10:51:02.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.981+0000 7f5543176b80 1 Processor -- start 2023-08-10T10:51:02.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.981+0000 7f5543176b80 1 -- start start 2023-08-10T10:51:02.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.981+0000 7f5543176b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499ff5c0 0x55f9499ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.981+0000 7f5543176b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a00450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.981+0000 7f5543176b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f949a009e0 0x55f949a00e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.981+0000 7f5543176b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94997ae40 con 0x55f9499ff5c0 2023-08-10T10:51:02.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.981+0000 7f5543176b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f949957610 con 0x55f949a009e0 2023-08-10T10:51:02.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.981+0000 7f5543176b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f949954f30 con 0x55f9499fff20 2023-08-10T10:51:02.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552d59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a00450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552dd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499ff5c0 0x55f9499ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f55267fc700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f55180a11d0 0x7f55180a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552d59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a00450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58178/0 (socket says 172.21.15.107:58178) 2023-08-10T10:51:02.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552d59b700 1 -- 172.21.15.107:0/1558495768 learned_addr learned my addr 172.21.15.107:0/1558495768 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:02.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552cd9a700 1 --2- 172.21.15.107:0/1558495768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f949a009e0 0x55f949a00e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f55267fc700 1 -- 172.21.15.107:0/985266425 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f551c0cddd0 con 0x7f5528073170 2023-08-10T10:51:02.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552dd9c700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f55180a11d0 0x7f55180a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552d59b700 1 -- 172.21.15.107:0/1558495768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f949a009e0 msgr2=0x55f949a00e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:02.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552d59b700 1 --2- 172.21.15.107:0/1558495768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f949a009e0 0x55f949a00e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552d59b700 1 -- 172.21.15.107:0/1558495768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499ff5c0 msgr2=0x55f9499ff9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:02.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552d59b700 1 --2- 172.21.15.107:0/1558495768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499ff5c0 0x55f9499ff9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552d59b700 1 -- 172.21.15.107:0/1558495768 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9497d16b0 con 0x55f9499fff20 2023-08-10T10:51:02.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552cd9a700 1 --2- 172.21.15.107:0/1558495768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f949a009e0 0x55f949a00e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:02.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.982+0000 7f552d59b700 1 --2- 172.21.15.107:0/1558495768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a00450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f551c09ae80 tx=0x7f551c0099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfc5f3e5db0a9819 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.983+0000 7f552dd9c700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f55180a11d0 0x7f55180a3690 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5520005e90 tx=0x7f55200047c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.983+0000 7f55137fe700 1 -- 172.21.15.107:0/1558495768 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c09a850 con 0x55f9499fff20 2023-08-10T10:51:02.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.983+0000 7f55137fe700 1 -- 172.21.15.107:0/1558495768 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f551c0a32b0 con 0x55f9499fff20 2023-08-10T10:51:02.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.983+0000 7f55137fe700 1 -- 172.21.15.107:0/1558495768 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c09ea90 con 0x55f9499fff20 2023-08-10T10:51:02.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.983+0000 7f5543176b80 1 -- 172.21.15.107:0/1558495768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 msgr2=0x55f949a00450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.983+0000 7f5543176b80 1 --2- 172.21.15.107:0/1558495768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a00450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f551c09ae80 tx=0x7f551c0099e0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.984+0000 7f5543176b80 1 -- 172.21.15.107:0/1558495768 shutdown_connections 2023-08-10T10:51:02.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.984+0000 7f5543176b80 1 --2- 172.21.15.107:0/1558495768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f949a009e0 0x55f949a00e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.984+0000 7f5543176b80 1 --2- 172.21.15.107:0/1558495768 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499ff5c0 0x55f9499ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.984+0000 7f5543176b80 1 --2- 172.21.15.107:0/1558495768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a00450 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.984+0000 7f5543176b80 1 -- 172.21.15.107:0/1558495768 >> 172.21.15.107:0/1558495768 conn(0x55f94995cd50 msgr2=0x55f9499fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:02.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.984+0000 7f5543176b80 1 -- 172.21.15.107:0/1558495768 shutdown_connections 2023-08-10T10:51:02.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.984+0000 7f5543176b80 1 -- 172.21.15.107:0/1558495768 wait complete. 2023-08-10T10:51:02.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.984+0000 7f5543176b80 1 -- start start 2023-08-10T10:51:02.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.984+0000 7f5543176b80 1 Processor -- start 2023-08-10T10:51:02.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f5543176b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a08e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f5543176b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a09350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f5543176b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f949a009e0 0x55f949a10390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f5543176b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f949950820 con 0x55f949a009e0 2023-08-10T10:51:02.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f5543176b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9498efb40 con 0x55f9499ff5c0 2023-08-10T10:51:02.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f5543176b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9498ef840 con 0x55f9499fff20 2023-08-10T10:51:02.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f5543176b80 10 client.0 _ll_register_callbacks cb 0x55f9498ed700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:02.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f552d59b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a08e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f552cd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a09350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f552cd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a09350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58192/0 (socket says 172.21.15.107:58192) 2023-08-10T10:51:02.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f552cd9a700 1 -- 172.21.15.107:0/1256612788 learned_addr learned my addr 172.21.15.107:0/1256612788 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:02.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.985+0000 7f552dd9c700 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f949a009e0 0x55f949a10390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f552cd9a700 1 -- 172.21.15.107:0/1256612788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 msgr2=0x55f949a08e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:02.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f552cd9a700 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a08e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f552cd9a700 1 -- 172.21.15.107:0/1256612788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f949a009e0 msgr2=0x55f949a10390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:02.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f552cd9a700 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f949a009e0 0x55f949a10390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f552cd9a700 1 -- 172.21.15.107:0/1256612788 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55140098e0 con 0x55f9499fff20 2023-08-10T10:51:02.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f552dd9c700 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f949a009e0 0x55f949a10390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:02.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f552d59b700 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a08e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:02.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f552cd9a700 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a09350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5514012a10 tx=0x7f5514012d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d58cc309c281ea6e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:02.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f5510ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:51:02.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f5510ff9700 1 -- 172.21.15.107:0/1256612788 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514017070 con 0x55f9499fff20 2023-08-10T10:51:02.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f5543176b80 1 -- 172.21.15.107:0/1256612788 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9499f24f0 con 0x55f9499fff20 2023-08-10T10:51:02.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.986+0000 7f5510ff9700 1 -- 172.21.15.107:0/1256612788 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f5514004030 con 0x55f9499fff20 2023-08-10T10:51:02.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5510ff9700 1 -- 172.21.15.107:0/1256612788 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55140041f0 con 0x55f9499fff20 2023-08-10T10:51:02.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5543176b80 10 client.25450 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:02.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5543176b80 1 -- 172.21.15.107:0/1256612788 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f55281a0c60 con 0x55f9499fff20 2023-08-10T10:51:02.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5510ff9700 1 -- 172.21.15.107:0/1256612788 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f9499f24f0 con 0x55f9499fff20 2023-08-10T10:51:02.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5510ff9700 1 -- 172.21.15.107:0/1256612788 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f55140037a0 con 0x55f9499fff20 2023-08-10T10:51:02.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5543176b80 10 client.25450 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:02.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5543176b80 10 client.25450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:02.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5543176b80 20 client.25450 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:02.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5543176b80 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f949a14ba0 0x55f949a16fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:02.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5543176b80 4 client.25450 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:02.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.987+0000 7f5543176b80 1 -- 172.21.15.107:0/1256612788 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9499cea50 con 0x55f949a14ba0 2023-08-10T10:51:02.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.988+0000 7f552d59b700 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f949a14ba0 0x55f949a16fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:02.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.988+0000 7f5510ff9700 10 client.25450 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:02.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.988+0000 7f552d59b700 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f949a14ba0 0x55f949a16fc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d5d1b5961ea7d35 server_cookie=4c050acf0dfe6169 in_seq=0 out_seq=0 2023-08-10T10:51:02.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5510ff9700 1 -- 172.21.15.107:0/1256612788 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f9499cea50 con 0x55f949a14ba0 2023-08-10T10:51:02.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5510ff9700 10 client.25450 handle_command_reply: tid=0 2023-08-10T10:51:02.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 client.25450 shutdown 2023-08-10T10:51:02.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 -- 172.21.15.107:0/1256612788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 msgr2=0x55f949a09350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:02.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a09350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5514012a10 tx=0x7f5514012d20 comp rx=0 tx=0).stop 2023-08-10T10:51:02.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 -- 172.21.15.107:0/1256612788 shutdown_connections 2023-08-10T10:51:02.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f949a14ba0 0x55f949a16fc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a08e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f949a009e0 0x55f949a10390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5510ff9700 0 client.25450 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:02.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 --2- 172.21.15.107:0/1256612788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9499fff20 0x55f949a09350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:02.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 -- 172.21.15.107:0/1256612788 >> 172.21.15.107:0/1256612788 conn(0x55f94995cd50 msgr2=0x55f9499f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:02.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 -- 172.21.15.107:0/1256612788 shutdown_connections 2023-08-10T10:51:02.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 1 -- 172.21.15.107:0/1256612788 wait complete. 2023-08-10T10:51:02.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:02.989+0000 7f5543176b80 20 client.25450 trim_cache size 0 max 16384 2023-08-10T10:51:03.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.007+0000 7f5543176b80 1 Processor -- start 2023-08-10T10:51:03.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.007+0000 7f5543176b80 1 -- start start 2023-08-10T10:51:03.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f5543176b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f5543176b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a102b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f5543176b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f949a009e0 0x55f9499f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f5543176b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9497d39a0 con 0x55f9499fff20 2023-08-10T10:51:03.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f5543176b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9499f4b00 con 0x55f9499ff5c0 2023-08-10T10:51:03.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f5543176b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f949a06af0 con 0x55f949a009e0 2023-08-10T10:51:03.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f552cd9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f552cd9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a102b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58852/0 (socket says 172.21.15.107:58852) 2023-08-10T10:51:03.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f552cd9a700 1 -- 172.21.15.107:0/2088781060 learned_addr learned my addr 172.21.15.107:0/2088781060 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:03.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f552d59b700 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.008+0000 7f552dd9c700 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f949a009e0 0x55f9499f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f552d59b700 1 -- 172.21.15.107:0/2088781060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f949a009e0 msgr2=0x55f9499f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f552d59b700 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f949a009e0 0x55f9499f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f552d59b700 1 -- 172.21.15.107:0/2088781060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 msgr2=0x55f949a102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f552d59b700 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a102b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f552d59b700 1 -- 172.21.15.107:0/2088781060 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f94977de60 con 0x55f9499ff5c0 2023-08-10T10:51:03.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f552cd9a700 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:03.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f552d59b700 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a092d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55f949a078d0 tx=0x7f551c009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9a4cc799e48a6f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:03.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f5513fff700 1 -- 172.21.15.107:0/2088781060 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c09ef20 con 0x55f9499ff5c0 2023-08-10T10:51:03.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f5513fff700 1 -- 172.21.15.107:0/2088781060 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f551c099290 con 0x55f9499ff5c0 2023-08-10T10:51:03.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.009+0000 7f5513fff700 1 -- 172.21.15.107:0/2088781060 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c09a640 con 0x55f9499ff5c0 2023-08-10T10:51:03.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.010+0000 7f5543176b80 1 -- 172.21.15.107:0/2088781060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 msgr2=0x55f949a092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.010+0000 7f5543176b80 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a092d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55f949a078d0 tx=0x7f551c009040 comp rx=0 tx=0).stop 2023-08-10T10:51:03.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.010+0000 7f5543176b80 1 -- 172.21.15.107:0/2088781060 shutdown_connections 2023-08-10T10:51:03.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.010+0000 7f5543176b80 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a092d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.010+0000 7f5543176b80 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f949a009e0 0x55f9499f91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.010+0000 7f5543176b80 1 --2- 172.21.15.107:0/2088781060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.010+0000 7f5543176b80 1 -- 172.21.15.107:0/2088781060 >> 172.21.15.107:0/2088781060 conn(0x55f94995cd50 msgr2=0x55f949a08bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.010+0000 7f5543176b80 1 -- 172.21.15.107:0/2088781060 shutdown_connections 2023-08-10T10:51:03.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.010+0000 7f5543176b80 1 -- 172.21.15.107:0/2088781060 wait complete. 2023-08-10T10:51:03.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.011+0000 7f5543176b80 1 -- start start 2023-08-10T10:51:03.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.011+0000 7f5543176b80 1 Processor -- start 2023-08-10T10:51:03.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.011+0000 7f5543176b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a10150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f5543176b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a0cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f5543176b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f949a009e0 0x55f949a0d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f5543176b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f949a0d800 con 0x55f9499fff20 2023-08-10T10:51:03.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f5543176b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f949a71050 con 0x55f9499ff5c0 2023-08-10T10:51:03.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f5543176b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f949a711e0 con 0x55f949a009e0 2023-08-10T10:51:03.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f5543176b80 10 client.0 _ll_register_callbacks cb 0x55f9498ed700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:03.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f552cd9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a0cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f552cd9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a0cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58858/0 (socket says 172.21.15.107:58858) 2023-08-10T10:51:03.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f552cd9a700 1 -- 172.21.15.107:0/3273891407 learned_addr learned my addr 172.21.15.107:0/3273891407 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:03.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f552d59b700 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a10150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f552cd9a700 1 -- 172.21.15.107:0/3273891407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f949a009e0 msgr2=0x55f949a0d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f552cd9a700 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f949a009e0 0x55f949a0d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f552cd9a700 1 -- 172.21.15.107:0/3273891407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 msgr2=0x55f949a10150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f552cd9a700 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a10150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.012+0000 7f552cd9a700 1 -- 172.21.15.107:0/3273891407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5514021040 con 0x55f9499fff20 2023-08-10T10:51:03.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.013+0000 7f552cd9a700 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a0cbf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5514005c20 tx=0x7f5514003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf4190851626c96 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:03.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.013+0000 7f5510ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:51:03.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.013+0000 7f5510ff9700 1 -- 172.21.15.107:0/3273891407 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514017040 con 0x55f9499fff20 2023-08-10T10:51:03.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.013+0000 7f5543176b80 1 -- 172.21.15.107:0/3273891407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f551c0a32b0 con 0x55f9499fff20 2023-08-10T10:51:03.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.013+0000 7f5510ff9700 1 -- 172.21.15.107:0/3273891407 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7f5514005ce0 con 0x55f9499fff20 2023-08-10T10:51:03.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.013+0000 7f5510ff9700 1 -- 172.21.15.107:0/3273891407 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f551400fa40 con 0x55f9499fff20 2023-08-10T10:51:03.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.013+0000 7f5543176b80 10 client.15711 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:03.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.013+0000 7f5543176b80 1 -- 172.21.15.107:0/3273891407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f9497d16b0 con 0x55f9499fff20 2023-08-10T10:51:03.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.013+0000 7f5510ff9700 1 -- 172.21.15.107:0/3273891407 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f551c0a32b0 con 0x55f9499fff20 2023-08-10T10:51:03.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.014+0000 7f5510ff9700 1 -- 172.21.15.107:0/3273891407 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5514010430 con 0x55f9499fff20 2023-08-10T10:51:03.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.014+0000 7f5543176b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:03.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.014+0000 7f5543176b80 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:03.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.014+0000 7f5543176b80 20 client.15711 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:03.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.014+0000 7f5543176b80 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f949a72b50 0x55f949a74f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.014+0000 7f5543176b80 4 client.15711 mds_command: new command op to 24575 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-10T10:51:03.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.014+0000 7f5543176b80 1 -- 172.21.15.107:0/3273891407 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f949949800 con 0x55f949a72b50 2023-08-10T10:51:03.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.015+0000 7f552d59b700 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f949a72b50 0x55f949a74f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.015+0000 7f5510ff9700 10 client.15711 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:03.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.015+0000 7f552d59b700 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f949a72b50 0x55f949a74f70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac0154ebe6da0dd8 server_cookie=a862751e0e66ee95 in_seq=0 out_seq=0 2023-08-10T10:51:03.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.016+0000 7f5510ff9700 1 -- 172.21.15.107:0/3273891407 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f949949800 con 0x55f949a72b50 2023-08-10T10:51:03.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.016+0000 7f5510ff9700 10 client.15711 handle_command_reply: tid=0 2023-08-10T10:51:03.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.016+0000 7f5543176b80 1 client.15711 shutdown 2023-08-10T10:51:03.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 -- 172.21.15.107:0/3273891407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 msgr2=0x55f949a0cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a0cbf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5514005c20 tx=0x7f5514003930 comp rx=0 tx=0).stop 2023-08-10T10:51:03.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 -- 172.21.15.107:0/3273891407 shutdown_connections 2023-08-10T10:51:03.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f949a72b50 0x55f949a74f70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f9499ff5c0 0x55f949a10150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f949a009e0 0x55f949a0d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5510ff9700 0 client.15711 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:03.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 --2- 172.21.15.107:0/3273891407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9499fff20 0x55f949a0cbf0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 -- 172.21.15.107:0/3273891407 >> 172.21.15.107:0/3273891407 conn(0x55f94995cd50 msgr2=0x55f9499fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 -- 172.21.15.107:0/3273891407 shutdown_connections 2023-08-10T10:51:03.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 1 -- 172.21.15.107:0/3273891407 wait complete. 2023-08-10T10:51:03.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.017+0000 7f5543176b80 20 client.15711 trim_cache size 0 max 16384 2023-08-10T10:51:03.024 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:51:03.024 INFO:teuthology.orchestra.run.smithi107.stdout: "return_code": 0, 2023-08-10T10:51:03.024 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_tag": "72209c0e-0564-4c78-8c26-7ff9ad1f7eb0", 2023-08-10T10:51:03.024 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": "asynchronous" 2023-08-10T10:51:03.024 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:51:03.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 -- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f55180a11d0 msgr2=0x7f55180a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f55180a11d0 0x7f55180a3690 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5520005e90 tx=0x7f55200047c0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 -- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528073170 msgr2=0x7f5528198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528073170 0x7f5528198710 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f551c00b780 tx=0x7f551c00bd40 comp rx=0 tx=0).stop 2023-08-10T10:51:03.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 -- 172.21.15.107:0/985266425 shutdown_connections 2023-08-10T10:51:03.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f55180a11d0 0x7f55180a3690 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528108630 0x7f552819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5528073170 0x7f5528198710 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 --2- 172.21.15.107:0/985266425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5528074750 0x7f5528198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 -- 172.21.15.107:0/985266425 >> 172.21.15.107:0/985266425 conn(0x7f55280fbcb0 msgr2=0x7f55280fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 -- 172.21.15.107:0/985266425 shutdown_connections 2023-08-10T10:51:03.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.018+0000 7f552f7ff700 1 -- 172.21.15.107:0/985266425 wait complete. 2023-08-10T10:51:03.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:02 smithi107 ceph-mon[127953]: pgmap v378: 129 pgs: 129 active+clean; 649 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-08-10T10:51:03.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:02 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3639802500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:51:03.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:03.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:02 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1703707774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:51:03.036 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:51:03.036 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:02 smithi107 ceph-mon[127953]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:51:03.037 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:51:03.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:02 smithi157 ceph-mon[129604]: pgmap v378: 129 pgs: 129 active+clean; 649 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-08-10T10:51:03.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:02 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3639802500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T10:51:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:02 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1703707774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:51:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:51:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:02 smithi157 ceph-mon[129604]: from='mgr.14150 172.21.15.107:0/2883065539' entity='mgr.x' 2023-08-10T10:51:03.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.253+0000 7fcba2bff700 1 -- 172.21.15.107:0/2915844898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb9c073190 msgr2=0x7fcb9c0735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.253+0000 7fcba2bff700 1 --2- 172.21.15.107:0/2915844898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb9c073190 0x7fcb9c0735f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009990 tx=0x7fcb88009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.253+0000 7fcba2bff700 1 -- 172.21.15.107:0/2915844898 shutdown_connections 2023-08-10T10:51:03.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.253+0000 7fcba2bff700 1 --2- 172.21.15.107:0/2915844898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb9c074770 0x7fcb9c072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.253+0000 7fcba2bff700 1 --2- 172.21.15.107:0/2915844898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb9c108610 0x7fcb9c10aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.253+0000 7fcba2bff700 1 --2- 172.21.15.107:0/2915844898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb9c073190 0x7fcb9c0735f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.253+0000 7fcba2bff700 1 -- 172.21.15.107:0/2915844898 >> 172.21.15.107:0/2915844898 conn(0x7fcb9c0fbcb0 msgr2=0x7fcb9c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.253+0000 7fcba2bff700 1 -- 172.21.15.107:0/2915844898 shutdown_connections 2023-08-10T10:51:03.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.254+0000 7fcba2bff700 1 -- 172.21.15.107:0/2915844898 wait complete. 2023-08-10T10:51:03.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.255+0000 7fcba2bff700 1 Processor -- start 2023-08-10T10:51:03.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.255+0000 7fcba2bff700 1 -- start start 2023-08-10T10:51:03.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.255+0000 7fcba2bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb9c073190 0x7fcb9c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.255+0000 7fcba2bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb9c074770 0x7fcb9c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.256+0000 7fcba2bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb9c108610 0x7fcb9c19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.256+0000 7fcba2bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c1a0170 con 0x7fcb9c108610 2023-08-10T10:51:03.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.256+0000 7fcba2bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c06a190 con 0x7fcb9c073190 2023-08-10T10:51:03.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.256+0000 7fcba2bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c06a320 con 0x7fcb9c074770 2023-08-10T10:51:03.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.256+0000 7fcba099b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb9c073190 0x7fcb9c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.256+0000 7fcba099b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb9c073190 0x7fcb9c1985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:55902/0 (socket says 172.21.15.107:55902) 2023-08-10T10:51:03.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.256+0000 7fcba099b700 1 -- 172.21.15.107:0/97837826 learned_addr learned my addr 172.21.15.107:0/97837826 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:03.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.256+0000 7fcba119c700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb9c108610 0x7fcb9c19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcba099b700 1 -- 172.21.15.107:0/97837826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb9c074770 msgr2=0x7fcb9c198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcba099b700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb9c074770 0x7fcb9c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcba099b700 1 -- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb9c108610 msgr2=0x7fcb9c19fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcba099b700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb9c108610 0x7fcb9c19fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcba099b700 1 -- 172.21.15.107:0/97837826 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb880095f0 con 0x7fcb9c073190 2023-08-10T10:51:03.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcba099b700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb9c073190 0x7fcb9c1985f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000e9a0 tx=0x7fcb9000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:03.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcb99ffb700 1 -- 172.21.15.107:0/97837826 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90009790 con 0x7fcb9c073190 2023-08-10T10:51:03.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcba2bff700 1 -- 172.21.15.107:0/97837826 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9c06a600 con 0x7fcb9c073190 2023-08-10T10:51:03.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcb99ffb700 1 -- 172.21.15.107:0/97837826 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb9000cbd0 con 0x7fcb9c073190 2023-08-10T10:51:03.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.257+0000 7fcb99ffb700 1 -- 172.21.15.107:0/97837826 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90018680 con 0x7fcb9c073190 2023-08-10T10:51:03.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.258+0000 7fcba2bff700 1 -- 172.21.15.107:0/97837826 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c06ab60 con 0x7fcb9c073190 2023-08-10T10:51:03.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.261+0000 7fcb99ffb700 1 -- 172.21.15.107:0/97837826 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fcb9000cd40 con 0x7fcb9c073190 2023-08-10T10:51:03.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcbb6563b80 1 Processor -- start 2023-08-10T10:51:03.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcb99ffb700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb8c0a1150 0x7fcb8c0a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcbb6563b80 1 -- start start 2023-08-10T10:51:03.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcb99ffb700 1 -- 172.21.15.107:0/97837826 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fcb90014070 con 0x7fcb9c073190 2023-08-10T10:51:03.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaec960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaecea0 0x5639dbaed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 0x5639dbaeddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dba67dc0 con 0x5639dbaecea0 2023-08-10T10:51:03.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dba44590 con 0x5639dbaec540 2023-08-10T10:51:03.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.262+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dba41eb0 con 0x5639dbaed960 2023-08-10T10:51:03.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba119c700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb8c0a1150 0x7fcb8c0a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba099b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcb9bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaecea0 0x5639dbaed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba099b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaec960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:55912/0 (socket says 172.21.15.107:55912) 2023-08-10T10:51:03.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba099b700 1 -- 172.21.15.107:0/4128075449 learned_addr learned my addr 172.21.15.107:0/4128075449 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:03.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba119c700 1 --2- 172.21.15.107:0/4128075449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 0x5639dbaeddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba119c700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb8c0a1150 0x7fcb8c0a3610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcb94003e90 tx=0x7fcb94009c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:03.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba099b700 1 -- 172.21.15.107:0/4128075449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 msgr2=0x5639dbaeddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba099b700 1 --2- 172.21.15.107:0/4128075449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 0x5639dbaeddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba099b700 1 -- 172.21.15.107:0/4128075449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaecea0 msgr2=0x5639dbaed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba099b700 1 --2- 172.21.15.107:0/4128075449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaecea0 0x5639dbaed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.263+0000 7fcba099b700 1 -- 172.21.15.107:0/4128075449 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639db8be630 con 0x5639dbaec540 2023-08-10T10:51:03.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.264+0000 7fcba099b700 1 --2- 172.21.15.107:0/4128075449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaec960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb900964c0 tx=0x7fcb90099bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37c0624d9028196 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:03.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.264+0000 7fcb86ffd700 1 -- 172.21.15.107:0/4128075449 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90099fc0 con 0x5639dbaec540 2023-08-10T10:51:03.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.264+0000 7fcb86ffd700 1 -- 172.21.15.107:0/4128075449 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb9009dff0 con 0x5639dbaec540 2023-08-10T10:51:03.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.264+0000 7fcb86ffd700 1 -- 172.21.15.107:0/4128075449 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900a21e0 con 0x5639dbaec540 2023-08-10T10:51:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 -- 172.21.15.107:0/4128075449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 msgr2=0x5639dbaec960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/4128075449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaec960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb900964c0 tx=0x7fcb90099bd0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 -- 172.21.15.107:0/4128075449 shutdown_connections 2023-08-10T10:51:03.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/4128075449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaec960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/4128075449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 0x5639dbaeddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/4128075449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaecea0 0x5639dbaed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 -- 172.21.15.107:0/4128075449 >> 172.21.15.107:0/4128075449 conn(0x5639dba49cd0 msgr2=0x5639dbae72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 -- 172.21.15.107:0/4128075449 shutdown_connections 2023-08-10T10:51:03.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 -- 172.21.15.107:0/4128075449 wait complete. 2023-08-10T10:51:03.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.265+0000 7fcbb6563b80 1 -- start start 2023-08-10T10:51:03.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcbb6563b80 1 Processor -- start 2023-08-10T10:51:03.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaec540 0x5639dbaf5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaecea0 0x5639dbaf64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 0x5639dbafd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dba3d7a0 con 0x5639dbaec540 2023-08-10T10:51:03.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639db9dcac0 con 0x5639dbaecea0 2023-08-10T10:51:03.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639db9dc7c0 con 0x5639dbaed960 2023-08-10T10:51:03.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcbb6563b80 10 client.0 _ll_register_callbacks cb 0x5639db9da680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:03.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcba099b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaec540 0x5639dbaf5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.266+0000 7fcb9bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaecea0 0x5639dbaf64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcb9bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaecea0 0x5639dbaf64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:55920/0 (socket says 172.21.15.107:55920) 2023-08-10T10:51:03.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcb9bfff700 1 -- 172.21.15.107:0/806150139 learned_addr learned my addr 172.21.15.107:0/806150139 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:03.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcba119c700 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 0x5639dbafd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcb9bfff700 1 -- 172.21.15.107:0/806150139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 msgr2=0x5639dbafd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcb9bfff700 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 0x5639dbafd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcb9bfff700 1 -- 172.21.15.107:0/806150139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaec540 msgr2=0x5639dbaf5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcb9bfff700 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaec540 0x5639dbaf5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcb9bfff700 1 -- 172.21.15.107:0/806150139 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c06ab60 con 0x5639dbaecea0 2023-08-10T10:51:03.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcb9bfff700 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaecea0 0x5639dbaf64c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009990 tx=0x7fcb88005340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=743361d761ed4e3b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:03.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.267+0000 7fcb7bfff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:51:03.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.268+0000 7fcb7bfff700 1 -- 172.21.15.107:0/806150139 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8801f040 con 0x5639dbaecea0 2023-08-10T10:51:03.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.268+0000 7fcbb6563b80 1 -- 172.21.15.107:0/806150139 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639dbadf470 con 0x5639dbaecea0 2023-08-10T10:51:03.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.268+0000 7fcb7bfff700 1 -- 172.21.15.107:0/806150139 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fcb88005690 con 0x5639dbaecea0 2023-08-10T10:51:03.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.268+0000 7fcb7bfff700 1 -- 172.21.15.107:0/806150139 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb88003a90 con 0x5639dbaecea0 2023-08-10T10:51:03.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.268+0000 7fcbb6563b80 10 client.25445 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:03.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.268+0000 7fcbb6563b80 1 -- 172.21.15.107:0/806150139 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5639db86ade0 con 0x5639dbaecea0 2023-08-10T10:51:03.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.268+0000 7fcb7bfff700 1 -- 172.21.15.107:0/806150139 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5639dbadf470 con 0x5639dbaecea0 2023-08-10T10:51:03.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.268+0000 7fcb7bfff700 1 -- 172.21.15.107:0/806150139 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcb88004590 con 0x5639dbaecea0 2023-08-10T10:51:03.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.269+0000 7fcbb6563b80 10 client.25445 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:03.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.269+0000 7fcbb6563b80 10 client.25445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:03.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.269+0000 7fcbb6563b80 20 client.25445 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:03.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.269+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5639dbb01d00 0x5639dbb04120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.269+0000 7fcbb6563b80 4 client.25445 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:03.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.269+0000 7fcbb6563b80 1 -- 172.21.15.107:0/806150139 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639dbabb9d0 con 0x5639dbb01d00 2023-08-10T10:51:03.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.269+0000 7fcba099b700 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5639dbb01d00 0x5639dbb04120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.269+0000 7fcba099b700 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5639dbb01d00 0x5639dbb04120 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16742d88f0e29d49 server_cookie=70f27e93bce00ee2 in_seq=0 out_seq=0 2023-08-10T10:51:03.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.269+0000 7fcb7bfff700 10 client.25445 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:03.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.270+0000 7fcb7bfff700 1 -- 172.21.15.107:0/806150139 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5639dbabb9d0 con 0x5639dbb01d00 2023-08-10T10:51:03.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.270+0000 7fcb7bfff700 10 client.25445 handle_command_reply: tid=0 2023-08-10T10:51:03.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.270+0000 7fcbb6563b80 1 client.25445 shutdown 2023-08-10T10:51:03.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.270+0000 7fcbb6563b80 1 -- 172.21.15.107:0/806150139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaecea0 msgr2=0x5639dbaf64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.270+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaecea0 0x5639dbaf64c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009990 tx=0x7fcb88005340 comp rx=0 tx=0).stop 2023-08-10T10:51:03.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcbb6563b80 1 -- 172.21.15.107:0/806150139 shutdown_connections 2023-08-10T10:51:03.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5639dbb01d00 0x5639dbb04120 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaed960 0x5639dbafd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcb7bfff700 0 client.25445 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:03.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaec540 0x5639dbaf5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/806150139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaecea0 0x5639dbaf64c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcbb6563b80 1 -- 172.21.15.107:0/806150139 >> 172.21.15.107:0/806150139 conn(0x5639dba49cd0 msgr2=0x5639dbae69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcbb6563b80 1 -- 172.21.15.107:0/806150139 shutdown_connections 2023-08-10T10:51:03.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcbb6563b80 1 -- 172.21.15.107:0/806150139 wait complete. 2023-08-10T10:51:03.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.271+0000 7fcbb6563b80 20 client.25445 trim_cache size 0 max 16384 2023-08-10T10:51:03.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.288+0000 7fcbb6563b80 1 Processor -- start 2023-08-10T10:51:03.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcbb6563b80 1 -- start start 2023-08-10T10:51:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaf5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 0x5639dbafd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbaf6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639db8c0920 con 0x5639dbaed960 2023-08-10T10:51:03.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dbae85c0 con 0x5639dbaec540 2023-08-10T10:51:03.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dbae89d0 con 0x5639dbaecea0 2023-08-10T10:51:03.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcba119c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbaf6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcba119c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbaf6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58904/0 (socket says 172.21.15.107:58904) 2023-08-10T10:51:03.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcba119c700 1 -- 172.21.15.107:0/3068607564 learned_addr learned my addr 172.21.15.107:0/3068607564 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:03.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcba099b700 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaf5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.289+0000 7fcb9bfff700 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 0x5639dbafd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcba119c700 1 -- 172.21.15.107:0/3068607564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 msgr2=0x5639dbafd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcba119c700 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 0x5639dbafd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcba119c700 1 -- 172.21.15.107:0/3068607564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 msgr2=0x5639dbaf5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcba119c700 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaf5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcba119c700 1 -- 172.21.15.107:0/3068607564 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639db853c60 con 0x5639dbaed960 2023-08-10T10:51:03.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcba099b700 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaf5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:03.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcba119c700 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbaf6270 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcb94004940 tx=0x7fcb94015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a924659e883ed5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:03.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcb877fe700 1 -- 172.21.15.107:0/3068607564 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94018d80 con 0x5639dbaed960 2023-08-10T10:51:03.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcb877fe700 1 -- 172.21.15.107:0/3068607564 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb9400f040 con 0x5639dbaed960 2023-08-10T10:51:03.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.290+0000 7fcb877fe700 1 -- 172.21.15.107:0/3068607564 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007640 con 0x5639dbaed960 2023-08-10T10:51:03.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 -- 172.21.15.107:0/3068607564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 msgr2=0x5639dbaf6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbaf6270 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcb94004940 tx=0x7fcb94015000 comp rx=0 tx=0).stop 2023-08-10T10:51:03.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 -- 172.21.15.107:0/3068607564 shutdown_connections 2023-08-10T10:51:03.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbaf5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbaf6270 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/3068607564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 0x5639dbafd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 -- 172.21.15.107:0/3068607564 >> 172.21.15.107:0/3068607564 conn(0x5639dba49cd0 msgr2=0x5639dbaf0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 -- 172.21.15.107:0/3068607564 shutdown_connections 2023-08-10T10:51:03.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 -- 172.21.15.107:0/3068607564 wait complete. 2023-08-10T10:51:03.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.291+0000 7fcbb6563b80 1 -- start start 2023-08-10T10:51:03.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcbb6563b80 1 Processor -- start 2023-08-10T10:51:03.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbafd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 0x5639dbaf9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcbb6563b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbafa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dbafa740 con 0x5639dbaed960 2023-08-10T10:51:03.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dbafd700 con 0x5639dbaec540 2023-08-10T10:51:03.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcbb6563b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dbafd890 con 0x5639dbaecea0 2023-08-10T10:51:03.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcbb6563b80 10 client.0 _ll_register_callbacks cb 0x5639db9da680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:03.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcba119c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbafa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcba099b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbafd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcba099b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbafd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:55936/0 (socket says 172.21.15.107:55936) 2023-08-10T10:51:03.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.292+0000 7fcba099b700 1 -- 172.21.15.107:0/1090624341 learned_addr learned my addr 172.21.15.107:0/1090624341 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:03.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcb9bfff700 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 0x5639dbaf9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcba099b700 1 -- 172.21.15.107:0/1090624341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 msgr2=0x5639dbaf9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcba099b700 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 0x5639dbaf9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcba099b700 1 -- 172.21.15.107:0/1090624341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 msgr2=0x5639dbafa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:03.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcba099b700 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbafa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcba099b700 1 -- 172.21.15.107:0/1090624341 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639db8be630 con 0x5639dbaec540 2023-08-10T10:51:03.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcb9bfff700 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 0x5639dbaf9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:03.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcba099b700 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbafd080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb900caa20 tx=0x7fcb90096410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=619f83b85884e791 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:03.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcb7bfff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:51:03.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcb7bfff700 1 -- 172.21.15.107:0/1090624341 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9009a040 con 0x5639dbaec540 2023-08-10T10:51:03.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcb7bfff700 1 -- 172.21.15.107:0/1090624341 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fcb90098360 con 0x5639dbaec540 2023-08-10T10:51:03.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcbb6563b80 1 -- 172.21.15.107:0/1090624341 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb9009dff0 con 0x5639dbaec540 2023-08-10T10:51:03.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcb7bfff700 1 -- 172.21.15.107:0/1090624341 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb900b8200 con 0x5639dbaec540 2023-08-10T10:51:03.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcbb6563b80 10 client.25451 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:03.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.293+0000 7fcbb6563b80 1 -- 172.21.15.107:0/1090624341 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fcb940045f0 con 0x5639dbaec540 2023-08-10T10:51:03.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.294+0000 7fcb7bfff700 1 -- 172.21.15.107:0/1090624341 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb9009dff0 con 0x5639dbaec540 2023-08-10T10:51:03.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.294+0000 7fcb7bfff700 1 -- 172.21.15.107:0/1090624341 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcb900cab70 con 0x5639dbaec540 2023-08-10T10:51:03.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.294+0000 7fcbb6563b80 10 client.25451 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:03.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.294+0000 7fcbb6563b80 10 client.25451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:03.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.294+0000 7fcbb6563b80 20 client.25451 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:03.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.294+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5639dbb56f70 0x5639dbb59390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.294+0000 7fcbb6563b80 4 client.25451 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:51:03.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.294+0000 7fcbb6563b80 1 -- 172.21.15.107:0/1090624341 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5639dba36780 con 0x5639dbb56f70 2023-08-10T10:51:03.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.294+0000 7fcb9bfff700 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5639dbb56f70 0x5639dbb59390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcb7bfff700 10 client.25451 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:03.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcb9bfff700 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5639dbb56f70 0x5639dbb59390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86058cb9149fad7e server_cookie=6d87ddb72fbc747e in_seq=0 out_seq=0 2023-08-10T10:51:03.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcb7bfff700 1 -- 172.21.15.107:0/1090624341 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5639dba36780 con 0x5639dbb56f70 2023-08-10T10:51:03.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcb7bfff700 10 client.25451 handle_command_reply: tid=0 2023-08-10T10:51:03.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 client.25451 shutdown 2023-08-10T10:51:03.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 -- 172.21.15.107:0/1090624341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 msgr2=0x5639dbafd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbafd080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb900caa20 tx=0x7fcb90096410 comp rx=0 tx=0).stop 2023-08-10T10:51:03.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 -- 172.21.15.107:0/1090624341 shutdown_connections 2023-08-10T10:51:03.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5639dbb56f70 0x5639dbb59390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5639dbaec540 0x5639dbafd080 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcb7bfff700 0 client.25451 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:03.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639dbaed960 0x5639dbafa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 --2- 172.21.15.107:0/1090624341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639dbaecea0 0x5639dbaf9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 -- 172.21.15.107:0/1090624341 >> 172.21.15.107:0/1090624341 conn(0x5639dba49cd0 msgr2=0x5639dbaf5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 -- 172.21.15.107:0/1090624341 shutdown_connections 2023-08-10T10:51:03.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.295+0000 7fcbb6563b80 1 -- 172.21.15.107:0/1090624341 wait complete. 2023-08-10T10:51:03.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcbb6563b80 20 client.25451 trim_cache size 0 max 16384 2023-08-10T10:51:03.306 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:51:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:51:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:51:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "72209c0e-0564-4c78-8c26-7ff9ad1f7eb0": { 2023-08-10T10:51:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:51:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "72209c0e-0564-4c78-8c26-7ff9ad1f7eb0", 2023-08-10T10:51:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:51:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:51:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:51:03.308 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:51:03.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 -- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb8c0a1150 msgr2=0x7fcb8c0a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb8c0a1150 0x7fcb8c0a3610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcb94003e90 tx=0x7fcb94009c20 comp rx=0 tx=0).stop 2023-08-10T10:51:03.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 -- 172.21.15.107:0/97837826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb9c073190 msgr2=0x7fcb9c1985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb9c073190 0x7fcb9c1985f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000e9a0 tx=0x7fcb9000ecb0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 -- 172.21.15.107:0/97837826 shutdown_connections 2023-08-10T10:51:03.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fcb8c0a1150 0x7fcb8c0a3610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb9c073190 0x7fcb9c1985f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcb9c108610 0x7fcb9c19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 --2- 172.21.15.107:0/97837826 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb9c074770 0x7fcb9c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 -- 172.21.15.107:0/97837826 >> 172.21.15.107:0/97837826 conn(0x7fcb9c0fbcb0 msgr2=0x7fcb9c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 -- 172.21.15.107:0/97837826 shutdown_connections 2023-08-10T10:51:03.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.296+0000 7fcba2bff700 1 -- 172.21.15.107:0/97837826 wait complete. 2023-08-10T10:51:03.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.300+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f854802cbc0 con 0x7f85481010a0 2023-08-10T10:51:03.315 INFO:tasks.cephfs.filesystem:scrub status for tag:72209c0e-0564-4c78-8c26-7ff9ad1f7eb0 - {'path': '/', 'tag': '72209c0e-0564-4c78-8c26-7ff9ad1f7eb0', 'options': 'recursive,force'} 2023-08-10T10:51:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.678+0000 7f852ffff700 1 -- 172.21.15.107:0/413271969 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mgrmap(e 19) v1 ==== 135733+0+0 (secure 0 0 0) 0x7f8538097ba0 con 0x7f85481010a0 2023-08-10T10:51:03.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.679+0000 7f852ffff700 1 -- 172.21.15.107:0/413271969 <== mon.2 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f853808d4d0 con 0x7f85481010a0 2023-08-10T10:51:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f85300a1150 msgr2=0x7f85300a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f85300a1150 0x7f85300a3610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f853c009fd0 tx=0x7f853c009260 comp rx=0 tx=0).stop 2023-08-10T10:51:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85481010a0 msgr2=0x7f85481961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85481010a0 0x7f85481961a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f85380098e0 tx=0x7f8538005740 comp rx=0 tx=0).stop 2023-08-10T10:51:03.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 shutdown_connections 2023-08-10T10:51:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7f85300a1150 0x7f85300a3610 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85481010a0 0x7f85481961a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8548106300 0x7f854819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 --2- 172.21.15.107:0/413271969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85481039d0 0x7f85481966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 >> 172.21.15.107:0/413271969 conn(0x7f85480faa30 msgr2=0x7f8548101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 shutdown_connections 2023-08-10T10:51:03.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.682+0000 7f8547fff700 1 -- 172.21.15.107:0/413271969 wait complete. 2023-08-10T10:51:03.703 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-08-10T10:51:03.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.914+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1930865328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec104320 msgr2=0x7fd1ec1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.914+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1930865328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec104320 0x7fd1ec1047a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400b0a0 tx=0x7fd1e400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.914+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1930865328 shutdown_connections 2023-08-10T10:51:03.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.914+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1930865328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec104320 0x7fd1ec1047a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.914+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1930865328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ec0fefe0 0x7fd1ec101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.914+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1930865328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1ec101950 0x7fd1ec103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.914+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1930865328 >> 172.21.15.107:0/1930865328 conn(0x7fd1ec0fabc0 msgr2=0x7fd1ec0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:03.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.915+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1930865328 shutdown_connections 2023-08-10T10:51:03.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.915+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1930865328 wait complete. 2023-08-10T10:51:03.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.916+0000 7fd1f11ff700 1 Processor -- start 2023-08-10T10:51:03.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.917+0000 7fd1f11ff700 1 -- start start 2023-08-10T10:51:03.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.917+0000 7fd1f11ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec0fefe0 0x7fd1ec19cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.917+0000 7fd1f11ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1ec101950 0x7fd1ec19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.917+0000 7fd1f11ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ec104320 0x7fd1ec19de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.917+0000 7fd1f11ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec19e4f0 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.917+0000 7fd1f11ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec19e660 con 0x7fd1ec101950 2023-08-10T10:51:03.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.917+0000 7fd1f11ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec19e820 con 0x7fd1ec104320 2023-08-10T10:51:03.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ead9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec0fefe0 0x7fd1ec19cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ead9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec0fefe0 0x7fd1ec19cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58970/0 (socket says 172.21.15.107:58970) 2023-08-10T10:51:03.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ead9d700 1 -- 172.21.15.107:0/1648081752 learned_addr learned my addr 172.21.15.107:0/1648081752 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:03.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ea59c700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1ec101950 0x7fd1ec19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1eb59e700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ec104320 0x7fd1ec19de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:03.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ead9d700 1 -- 172.21.15.107:0/1648081752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ec104320 msgr2=0x7fd1ec19de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ead9d700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ec104320 0x7fd1ec19de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ead9d700 1 -- 172.21.15.107:0/1648081752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1ec101950 msgr2=0x7fd1ec19d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:03.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ead9d700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1ec101950 0x7fd1ec19d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:03.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ead9d700 1 -- 172.21.15.107:0/1648081752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e4009d00 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.918+0000 7fd1ead9d700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec0fefe0 0x7fd1ec19cad0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00e9a0 tx=0x7fd1dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:03.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.919+0000 7fd1d3fff700 1 -- 172.21.15.107:0/1648081752 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc009790 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.919+0000 7fd1d3fff700 1 -- 172.21.15.107:0/1648081752 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1dc010430 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.919+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec19eb00 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.919+0000 7fd1d3fff700 1 -- 172.21.15.107:0/1648081752 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00cea0 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.919+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec1a5340 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.920+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec0fc740 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.922+0000 7fd1d3fff700 1 -- 172.21.15.107:0/1648081752 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) v1 ==== 135733+0+0 (secure 0 0 0) 0x7fd1dc0105a0 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.924+0000 7fd1d3fff700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1d40a1220 0x7fd1d40a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:03.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.924+0000 7fd1d3fff700 1 -- 172.21.15.107:0/1648081752 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fd1dc014070 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.924+0000 7fd1ea59c700 1 -- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1d40a1220 msgr2=0x7fd1d40a36e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:03.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.924+0000 7fd1ea59c700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1d40a1220 0x7fd1d40a36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:51:03.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:03.928+0000 7fd1d3fff700 1 -- 172.21.15.107:0/1648081752 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd1dc051790 con 0x7fd1ec0fefe0 2023-08-10T10:51:03.963 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:03 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3529911107' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:51:03.964 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:03 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/413271969' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-10T10:51:03.964 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:03 smithi157 ceph-mon[129604]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-10T10:51:03.964 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:03 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: ignoring --setuser ceph since I am not root 2023-08-10T10:51:03.964 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:03 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: ignoring --setgroup ceph since I am not root 2023-08-10T10:51:03.964 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:03 smithi157 ceph-mgr[131085]: -- 172.21.15.157:0/2752727589 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b1f25e91e0 con 0x55b1f25bf000 2023-08-10T10:51:03.965 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:03 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:03.961+0000 7f33296e5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:51:03.965 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: ignoring --setuser ceph since I am not root 2023-08-10T10:51:03.965 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: ignoring --setgroup ceph since I am not root 2023-08-10T10:51:03.966 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:03 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3529911107' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:51:03.966 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:03 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/413271969' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-10T10:51:03.966 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:03 smithi107 ceph-mon[127953]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-10T10:51:03.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:03 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3529911107' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T10:51:03.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:03 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/413271969' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-10T10:51:03.967 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:03 smithi195 ceph-mon[129938]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-08-10T10:51:03.968 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: ignoring --setuser ceph since I am not root 2023-08-10T10:51:03.968 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: ignoring --setgroup ceph since I am not root 2023-08-10T10:51:03.968 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:03.964+0000 7f304c99a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:51:04.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.125+0000 7fd1ea59c700 1 -- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1d40a1220 msgr2=0x7fd1d40a36e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:04.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.125+0000 7fd1ea59c700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1d40a1220 0x7fd1d40a36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T10:51:04.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.177+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fd1ec02cbf0 con 0x7fd1ec0fefe0 2023-08-10T10:51:04.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.182+0000 7fd1d3fff700 1 -- 172.21.15.107:0/1648081752 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd1dc099ce0 con 0x7fd1ec0fefe0 2023-08-10T10:51:04.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1d40a1220 msgr2=0x7fd1d40a36e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:51:04.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1d40a1220 0x7fd1d40a36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec0fefe0 msgr2=0x7fd1ec19cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:04.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec0fefe0 0x7fd1ec19cad0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00e9a0 tx=0x7fd1dc00ecb0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.186 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 shutdown_connections 2023-08-10T10:51:04.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fd1d40a1220 0x7fd1d40a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1ec104320 0x7fd1ec19de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1ec0fefe0 0x7fd1ec19cad0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 --2- 172.21.15.107:0/1648081752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd1ec101950 0x7fd1ec19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 >> 172.21.15.107:0/1648081752 conn(0x7fd1ec0fabc0 msgr2=0x7fd1ec0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:04.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 shutdown_connections 2023-08-10T10:51:04.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.185+0000 7fd1f11ff700 1 -- 172.21.15.107:0/1648081752 wait complete. 2023-08-10T10:51:04.214 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-08-10T10:51:04.281 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:03.963+0000 7f1aeca39200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:51:04.282 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:04.074+0000 7f1aeca39200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:51:04.282 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:04.201+0000 7f1aeca39200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:51:04.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:04.066+0000 7f33296e5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:51:04.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:04.196+0000 7f33296e5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:51:04.325 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:04.076+0000 7f304c99a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:51:04.326 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:04.193+0000 7f304c99a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:51:04.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.430+0000 7fa1c4dff700 1 -- 172.21.15.107:0/241298983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0102310 msgr2=0x7fa1c0108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:04.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.430+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/241298983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0102310 0x7fa1c0108bc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009f90 tx=0x7fa1b800b330 comp rx=0 tx=0).stop 2023-08-10T10:51:04.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.430+0000 7fa1c4dff700 1 -- 172.21.15.107:0/241298983 shutdown_connections 2023-08-10T10:51:04.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.430+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/241298983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1c0100780 0x7fa1c0100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.430+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/241298983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0102310 0x7fa1c0108bc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.430+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/241298983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1c0101970 0x7fa1c0101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.430+0000 7fa1c4dff700 1 -- 172.21.15.107:0/241298983 >> 172.21.15.107:0/241298983 conn(0x7fa1c00fbcb0 msgr2=0x7fa1c00fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:04.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.430+0000 7fa1c4dff700 1 -- 172.21.15.107:0/241298983 shutdown_connections 2023-08-10T10:51:04.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.430+0000 7fa1c4dff700 1 -- 172.21.15.107:0/241298983 wait complete. 2023-08-10T10:51:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.431+0000 7fa1c4dff700 1 Processor -- start 2023-08-10T10:51:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.431+0000 7fa1c4dff700 1 -- start start 2023-08-10T10:51:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.431+0000 7fa1c4dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0100780 0x7fa1c0072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.431+0000 7fa1c4dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1c0101970 0x7fa1c00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.431+0000 7fa1c4dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1c0102310 0x7fa1c00735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.431+0000 7fa1c4dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c01a0540 con 0x7fa1c0101970 2023-08-10T10:51:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.431+0000 7fa1c4dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c01a0680 con 0x7fa1c0102310 2023-08-10T10:51:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.431+0000 7fa1c4dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c01a07c0 con 0x7fa1c0100780 2023-08-10T10:51:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1be59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0100780 0x7fa1c0072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1be59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0100780 0x7fa1c0072b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58362/0 (socket says 172.21.15.107:58362) 2023-08-10T10:51:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1be59c700 1 -- 172.21.15.107:0/224486481 learned_addr learned my addr 172.21.15.107:0/224486481 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1bdd9b700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1c0101970 0x7fa1c00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1bed9d700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1c0102310 0x7fa1c00735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1be59c700 1 -- 172.21.15.107:0/224486481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1c0102310 msgr2=0x7fa1c00735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1be59c700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1c0102310 0x7fa1c00735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1be59c700 1 -- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1c0101970 msgr2=0x7fa1c00730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:04.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1be59c700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1c0101970 0x7fa1c00730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1be59c700 1 -- 172.21.15.107:0/224486481 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b8009c40 con 0x7fa1c0100780 2023-08-10T10:51:04.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.432+0000 7fa1be59c700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0100780 0x7fa1c0072b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000d980 tx=0x7fa1b000dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:04.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.433+0000 7fa1af7fe700 1 -- 172.21.15.107:0/224486481 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000de60 con 0x7fa1c0100780 2023-08-10T10:51:04.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.433+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c01a0a50 con 0x7fa1c0100780 2023-08-10T10:51:04.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.433+0000 7fa1af7fe700 1 -- 172.21.15.107:0/224486481 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1b00044b0 con 0x7fa1c0100780 2023-08-10T10:51:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.433+0000 7fa1af7fe700 1 -- 172.21.15.107:0/224486481 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00039c0 con 0x7fa1c0100780 2023-08-10T10:51:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.433+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c01a0f60 con 0x7fa1c0100780 2023-08-10T10:51:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.434+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c0107d70 con 0x7fa1c0100780 2023-08-10T10:51:04.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.437+0000 7fa1af7fe700 1 -- 172.21.15.107:0/224486481 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 135733+0+0 (secure 0 0 0) 0x7fa1b0003b20 con 0x7fa1c0100780 2023-08-10T10:51:04.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.439+0000 7fa1af7fe700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa1a80a11a0 0x7fa1a80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:04.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.439+0000 7fa1af7fe700 1 -- 172.21.15.107:0/224486481 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7fa1b00cc930 con 0x7fa1c0100780 2023-08-10T10:51:04.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.439+0000 7fa1bdd9b700 1 -- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa1a80a11a0 msgr2=0x7fa1a80a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:04.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.439+0000 7fa1bdd9b700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa1a80a11a0 0x7fa1a80a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:51:04.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.443+0000 7fa1af7fe700 1 -- 172.21.15.107:0/224486481 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa1b0095d00 con 0x7fa1c0100780 2023-08-10T10:51:04.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:04.344+0000 7f1aeca39200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:51:04.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.640+0000 7fa1bdd9b700 1 -- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa1a80a11a0 msgr2=0x7fa1a80a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:04.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.640+0000 7fa1bdd9b700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa1a80a11a0 0x7fa1a80a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T10:51:04.662 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:04.324+0000 7f304c99a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:51:04.663 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:04.569+0000 7f304c99a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:51:04.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.662+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fa1c004e550 con 0x7fa1c0100780 2023-08-10T10:51:04.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.673+0000 7fa1af7fe700 1 -- 172.21.15.107:0/224486481 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa1b0099320 con 0x7fa1c0100780 2023-08-10T10:51:04.677 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:04.322+0000 7f33296e5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:51:04.677 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:04.567+0000 7f33296e5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:51:04.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.676+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa1a80a11a0 msgr2=0x7fa1a80a3660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:51:04.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.676+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa1a80a11a0 0x7fa1a80a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0100780 msgr2=0x7fa1c0072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:04.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0100780 0x7fa1c0072b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000d980 tx=0x7fa1b000dd40 comp rx=0 tx=0).stop 2023-08-10T10:51:04.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 shutdown_connections 2023-08-10T10:51:04.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7fa1a80a11a0 0x7fa1a80a3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1c0102310 0x7fa1c00735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1c0100780 0x7fa1c0072b60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 --2- 172.21.15.107:0/224486481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa1c0101970 0x7fa1c00730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 >> 172.21.15.107:0/224486481 conn(0x7fa1c00fbcb0 msgr2=0x7fa1c0104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:04.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 shutdown_connections 2023-08-10T10:51:04.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.677+0000 7fa1c4dff700 1 -- 172.21.15.107:0/224486481 wait complete. 2023-08-10T10:51:04.707 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-08-10T10:51:04.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.915+0000 7ff480bff700 1 -- 172.21.15.107:0/3849389097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47c0fefe0 msgr2=0x7ff47c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:04.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.915+0000 7ff480bff700 1 --2- 172.21.15.107:0/3849389097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47c0fefe0 0x7ff47c101410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff46c009990 tx=0x7ff46c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.915+0000 7ff480bff700 1 -- 172.21.15.107:0/3849389097 shutdown_connections 2023-08-10T10:51:04.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.915+0000 7ff480bff700 1 --2- 172.21.15.107:0/3849389097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff47c104320 0x7ff47c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.915+0000 7ff480bff700 1 --2- 172.21.15.107:0/3849389097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47c0fefe0 0x7ff47c101410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.915+0000 7ff480bff700 1 --2- 172.21.15.107:0/3849389097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff47c101950 0x7ff47c103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.915+0000 7ff480bff700 1 -- 172.21.15.107:0/3849389097 >> 172.21.15.107:0/3849389097 conn(0x7ff47c0fabc0 msgr2=0x7ff47c0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:04.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.916+0000 7ff480bff700 1 -- 172.21.15.107:0/3849389097 shutdown_connections 2023-08-10T10:51:04.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.916+0000 7ff480bff700 1 -- 172.21.15.107:0/3849389097 wait complete. 2023-08-10T10:51:04.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.917+0000 7ff480bff700 1 Processor -- start 2023-08-10T10:51:04.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.917+0000 7ff480bff700 1 -- start start 2023-08-10T10:51:04.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff480bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff47c0fefe0 0x7ff47c19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:04.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff480bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47c101950 0x7ff47c19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:04.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff480bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff47c104320 0x7ff47c19ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:04.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff480bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c19e450 con 0x7ff47c104320 2023-08-10T10:51:04.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff480bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c19e5c0 con 0x7ff47c0fefe0 2023-08-10T10:51:04.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff480bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c19e780 con 0x7ff47c101950 2023-08-10T10:51:04.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff479d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47c101950 0x7ff47c19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:04.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff47a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff47c0fefe0 0x7ff47c19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:04.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff479d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47c101950 0x7ff47c19cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58382/0 (socket says 172.21.15.107:58382) 2023-08-10T10:51:04.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff47a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff47c0fefe0 0x7ff47c19ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:55992/0 (socket says 172.21.15.107:55992) 2023-08-10T10:51:04.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff479d9b700 1 -- 172.21.15.107:0/719220159 learned_addr learned my addr 172.21.15.107:0/719220159 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:04.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff47ad9d700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff47c104320 0x7ff47c19ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:04.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff479d9b700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff47c0fefe0 msgr2=0x7ff47c19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:04.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff479d9b700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff47c0fefe0 0x7ff47c19ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff479d9b700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff47c104320 msgr2=0x7ff47c19ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:04.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.918+0000 7ff479d9b700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff47c104320 0x7ff47c19ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:04.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.919+0000 7ff479d9b700 1 -- 172.21.15.107:0/719220159 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0095f0 con 0x7ff47c101950 2023-08-10T10:51:04.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.919+0000 7ff47ad9d700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff47c104320 0x7ff47c19ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:04.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.919+0000 7ff479d9b700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47c101950 0x7ff47c19cf70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff47000e9a0 tx=0x7ff47000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:04.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.919+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470009790 con 0x7ff47c101950 2023-08-10T10:51:04.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.919+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff47000cbd0 con 0x7ff47c101950 2023-08-10T10:51:04.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.919+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c19ea60 con 0x7ff47c101950 2023-08-10T10:51:04.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.919+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470018680 con 0x7ff47c101950 2023-08-10T10:51:04.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.919+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c1a5220 con 0x7ff47c101950 2023-08-10T10:51:04.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.920+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c0fc740 con 0x7ff47c101950 2023-08-10T10:51:04.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.924+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 135733+0+0 (secure 0 0 0) 0x7ff47000cd40 con 0x7ff47c101950 2023-08-10T10:51:04.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.926+0000 7ff46b7fe700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 0x7ff4640a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:04.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.926+0000 7ff47a59c700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 msgr2=0x7ff4640a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:04.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.926+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9028+0+0 (secure 0 0 0) 0x7ff470014070 con 0x7ff47c101950 2023-08-10T10:51:04.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.926+0000 7ff47a59c700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 0x7ff4640a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:51:04.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:04.926+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff470096550 con 0x7ff47c101950 2023-08-10T10:51:04.988 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-mon[129938]: scrub queued for path: / 2023-08-10T10:51:04.989 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:04.989 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:51:04.989 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:04.989 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-mon[129938]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-08-10T10:51:04.989 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-mon[129938]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-08-10T10:51:04.989 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1648081752' entity='client.admin' 2023-08-10T10:51:05.010 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-mon[129604]: scrub queued for path: / 2023-08-10T10:51:05.010 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:05.010 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:51:05.010 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:05.011 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-mon[129604]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-08-10T10:51:05.011 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-mon[129604]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-08-10T10:51:05.011 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:04 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1648081752' entity='client.admin' 2023-08-10T10:51:05.058 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:04.605+0000 7f1aeca39200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:51:05.059 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-mon[127953]: scrub queued for path: / 2023-08-10T10:51:05.059 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:05.059 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:51:05.059 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:05.059 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-mon[127953]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-08-10T10:51:05.060 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-mon[127953]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-08-10T10:51:05.060 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:04 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1648081752' entity='client.admin' 2023-08-10T10:51:05.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:05.127+0000 7ff47a59c700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 msgr2=0x7ff4640a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:05.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:05.127+0000 7ff47a59c700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 0x7ff4640a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-10T10:51:05.187 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:05.186+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 --> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff47c060bb0 con 0x7ff4640a11a0 2023-08-10T10:51:05.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:05.009+0000 7f33296e5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:51:05.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:05.131+0000 7f33296e5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:51:05.289 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:04.987+0000 7f304c99a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:51:05.289 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:05.110+0000 7f304c99a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:51:05.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:05.057+0000 7f1aeca39200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:51:05.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:05.184+0000 7f1aeca39200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:51:05.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:05.528+0000 7ff47a59c700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 msgr2=0x7ff4640a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:05.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:05.528+0000 7ff47a59c700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 0x7ff4640a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-10T10:51:05.662 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:05.287+0000 7f304c99a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:51:05.663 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:05.416+0000 7f304c99a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:51:05.678 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:05.357+0000 7f1aeca39200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:51:05.678 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:05.487+0000 7f1aeca39200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:51:05.678 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:05.305+0000 7f33296e5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:51:05.679 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:05.438+0000 7f33296e5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:51:05.974 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:05 smithi195 ceph-mon[129938]: from='client.? ' entity='client.admin' 2023-08-10T10:51:06.001 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:05 smithi157 ceph-mon[129604]: from='client.? ' entity='client.admin' 2023-08-10T10:51:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:05 smithi107 ceph-mon[127953]: from='client.? ' entity='client.admin' 2023-08-10T10:51:06.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:06 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:06.000+0000 7f33296e5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:51:06.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:06.329+0000 7ff47a59c700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 msgr2=0x7ff4640a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:06.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:06.329+0000 7ff47a59c700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 0x7ff4640a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-10T10:51:06.392 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:06.092+0000 7f1aeca39200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:51:06.412 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:05.973+0000 7f304c99a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:51:07.038 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:06 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:06.748+0000 7f33296e5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:51:07.038 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:06 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:06.965+0000 7f33296e5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:51:07.162 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:06 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:06.719+0000 7f304c99a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:51:07.163 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:06 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:06.930+0000 7f304c99a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:51:07.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:06.852+0000 7f1aeca39200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:51:07.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:07.059+0000 7f1aeca39200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:51:07.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:07.931+0000 7ff47a59c700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 msgr2=0x7ff4640a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:07.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:07.931+0000 7ff47a59c700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 0x7ff4640a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-08-10T10:51:08.162 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:07 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:07.883+0000 7f304c99a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:51:08.163 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:08.003+0000 7f304c99a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:51:08.263 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:07 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:07.916+0000 7f33296e5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:51:08.263 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:08.035+0000 7f33296e5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:51:08.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:08.002+0000 7f1aeca39200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:51:08.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:08.122+0000 7f1aeca39200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:51:08.538 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:08.261+0000 7f33296e5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:51:08.587 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:08.225+0000 7f304c99a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:51:08.709 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:08.345+0000 7f1aeca39200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:51:08.882 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:08.586+0000 7f304c99a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:51:08.913 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:08.626+0000 7f33296e5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:51:08.989 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:08.708+0000 7f1aeca39200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:51:09.162 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:08.881+0000 7f304c99a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:51:09.163 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:09 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:09.072+0000 7f304c99a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:51:09.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:08.913+0000 7f33296e5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:51:09.288 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:09.105+0000 7f33296e5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:51:09.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:08.988+0000 7f1aeca39200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:51:09.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:09.180+0000 7f1aeca39200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:51:09.662 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:09 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:09.409+0000 7f304c99a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:51:09.788 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:09.449+0000 7f33296e5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:51:09.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:09.521+0000 7f1aeca39200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:51:10.662 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:10.337+0000 7f304c99a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:51:10.663 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:10.509+0000 7f304c99a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:51:10.788 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:10.387+0000 7f33296e5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:51:10.789 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:10.559+0000 7f33296e5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:51:10.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:10.448+0000 7f1aeca39200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:51:10.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:10.620+0000 7f1aeca39200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:51:11.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:11.134+0000 7ff47a59c700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 msgr2=0x7ff4640a3660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/438388714 2023-08-10T10:51:11.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:11.134+0000 7ff47a59c700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 0x7ff4640a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-08-10T10:51:11.162 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:10.759+0000 7f304c99a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:51:11.163 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:10.905+0000 7f304c99a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:51:11.234 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:10.808+0000 7f33296e5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:51:11.234 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:10.956+0000 7f33296e5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:51:11.298 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:10.870+0000 7f1aeca39200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:51:11.299 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:11.018+0000 7f1aeca39200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:51:11.538 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:11 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:11.233+0000 7f33296e5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:51:11.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:11.297+0000 7f1aeca39200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:51:11.662 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:11 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:11.180+0000 7f304c99a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:51:12.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:12.320+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mgrmap(e 20) v1 ==== 135733+0+0 (secure 0 0 0) 0x7ff470096920 con 0x7ff47c101950 2023-08-10T10:51:12.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:12.390+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mon.1 v2:172.21.15.195:3300/0 8 ==== mgrmap(e 21) v1 ==== 135400+0+0 (secure 0 0 0) 0x7ff4700ca950 con 0x7ff47c101950 2023-08-10T10:51:12.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:12.390+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 msgr2=0x7ff4640a3660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:51:12.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:12.390+0000 7ff46b7fe700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/438388714,v1:172.21.15.107:6801/438388714] conn(0x7ff4640a11a0 0x7ff4640a3660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:12.529 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 10:51:12 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z[132070]: 2023-08-10T10:51:12.253+0000 7f304c99a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:51:12.529 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:12 smithi195 ceph-mon[129938]: Standby manager daemon z restarted 2023-08-10T10:51:12.529 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:12 smithi195 ceph-mon[129938]: Standby manager daemon z started 2023-08-10T10:51:12.529 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:12 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T10:51:12.530 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:12 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:51:12.530 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:12 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T10:51:12.530 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:12 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:51:12.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.374+0000 7f1aeca39200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:51:12.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-mon[127953]: Standby manager daemon z restarted 2023-08-10T10:51:12.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-mon[127953]: Standby manager daemon z started 2023-08-10T10:51:12.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T10:51:12.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:51:12.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T10:51:12.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:51:12.720 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 10:51:12 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y[131061]: 2023-08-10T10:51:12.317+0000 7f33296e5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:51:12.720 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:12 smithi157 ceph-mon[129604]: Standby manager daemon z restarted 2023-08-10T10:51:12.721 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:12 smithi157 ceph-mon[129604]: Standby manager daemon z started 2023-08-10T10:51:12.721 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:12 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-08-10T10:51:12.721 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:12 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:51:12.721 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:12 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-08-10T10:51:12.721 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:12 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.195:0/1946354511' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:51:13.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.592+0000 7f1a4edc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.592+0000 7f1a4edc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.592+0000 7f1a4edc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.078 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.592+0000 7f1a4edc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.078 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.592+0000 7f1a4edc5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.078 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.593+0000 7f1a4bdbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.078 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.593+0000 7f1a4bdbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.078 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.593+0000 7f1a4bdbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.078 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.593+0000 7f1a4bdbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.078 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:51:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:51:12.593+0000 7f1a4bdbf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:51:13.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.396+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mon.1 v2:172.21.15.195:3300/0 9 ==== mgrmap(e 22) v1 ==== 135527+0+0 (secure 0 0 0) 0x7ff470068480 con 0x7ff47c101950 2023-08-10T10:51:13.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.397+0000 7ff46b7fe700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff464027f50 0x7ff464028330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:13.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.397+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 --> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff47c060bb0 con 0x7ff464027f50 2023-08-10T10:51:13.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.400+0000 7ff47a59c700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff464027f50 0x7ff464028330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.403+0000 7ff47a59c700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff464027f50 0x7ff464028330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff46c006010 tx=0x7ff46c005960 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:13.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.468+0000 7ff46b7fe700 1 -- 172.21.15.107:0/719220159 <== mgr.15747 v2:172.21.15.107:6800/391042332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff47c060bb0 con 0x7ff464027f50 2023-08-10T10:51:13.470 INFO:teuthology.orchestra.run.smithi107.stdout:Schedule set for path / 2023-08-10T10:51:13.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.471+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff464027f50 msgr2=0x7ff464028330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:13.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.471+0000 7ff480bff700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff464027f50 0x7ff464028330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff46c006010 tx=0x7ff46c005960 comp rx=0 tx=0).stop 2023-08-10T10:51:13.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.471+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47c101950 msgr2=0x7ff47c19cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:13.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.471+0000 7ff480bff700 1 --2- 172.21.15.107:0/719220159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff47c101950 0x7ff47c19cf70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff47000e9a0 tx=0x7ff47000ecb0 comp rx=0 tx=0).stop 2023-08-10T10:51:13.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.471+0000 7ff47ad9d700 1 -- 172.21.15.107:0/719220159 reap_dead start 2023-08-10T10:51:13.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.471+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 shutdown_connections 2023-08-10T10:51:13.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.471+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 >> 172.21.15.107:0/719220159 conn(0x7ff47c0fabc0 msgr2=0x7ff47c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:13.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.471+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 shutdown_connections 2023-08-10T10:51:13.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.471+0000 7ff480bff700 1 -- 172.21.15.107:0/719220159 wait complete. 2023-08-10T10:51:13.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-08-10T10:51:13.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: mgrmap e20: x(active, since 10m), standbys: y, z 2023-08-10T10:51:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T10:51:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:51:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: Standby manager daemon y restarted 2023-08-10T10:51:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: Standby manager daemon y started 2023-08-10T10:51:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T10:51:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:51:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: Active manager daemon x restarted 2023-08-10T10:51:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: Activating manager daemon x 2023-08-10T10:51:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: osdmap e94: 12 total, 12 up, 12 in 2023-08-10T10:51:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: mgrmap e21: x(active, starting, since 0.0136169s), standbys: y, z 2023-08-10T10:51:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:51:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:51:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:51:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T10:51:13.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T10:51:13.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T10:51:13.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T10:51:13.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T10:51:13.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T10:51:13.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T10:51:13.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T10:51:13.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T10:51:13.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T10:51:13.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T10:51:13.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T10:51:13.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T10:51:13.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T10:51:13.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T10:51:13.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:51:13.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:51:13.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:51:13.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:51:13.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:51:13.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:51:13.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:51:13.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:51:13.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:51:13.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:51:13.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:51:13.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:51:13.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T10:51:13.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T10:51:13.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T10:51:13.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: Manager daemon x is now available 2023-08-10T10:51:13.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:13.584 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:13.584 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T10:51:13.584 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T10:51:13.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: mgrmap e20: x(active, since 10m), standbys: y, z 2023-08-10T10:51:13.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T10:51:13.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:51:13.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: Standby manager daemon y restarted 2023-08-10T10:51:13.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: Standby manager daemon y started 2023-08-10T10:51:13.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T10:51:13.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:51:13.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: Active manager daemon x restarted 2023-08-10T10:51:13.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: Activating manager daemon x 2023-08-10T10:51:13.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: osdmap e94: 12 total, 12 up, 12 in 2023-08-10T10:51:13.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: mgrmap e21: x(active, starting, since 0.0136169s), standbys: y, z 2023-08-10T10:51:13.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:51:13.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:51:13.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:51:13.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T10:51:13.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T10:51:13.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T10:51:13.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T10:51:13.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T10:51:13.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T10:51:13.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T10:51:13.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T10:51:13.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T10:51:13.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T10:51:13.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T10:51:13.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T10:51:13.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T10:51:13.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T10:51:13.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T10:51:13.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:51:13.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:51:13.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:51:13.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:51:13.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:51:13.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:51:13.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:51:13.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:51:13.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:51:13.669 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:51:13.669 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:51:13.669 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:51:13.669 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T10:51:13.669 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T10:51:13.669 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T10:51:13.669 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: Manager daemon x is now available 2023-08-10T10:51:13.670 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:13.670 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:13.670 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T10:51:13.670 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T10:51:13.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.721+0000 7f5b38fff700 1 -- 172.21.15.107:0/3308034703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 msgr2=0x7f5b34073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:13.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.721+0000 7f5b38fff700 1 --2- 172.21.15.107:0/3308034703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 0x7f5b34073650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009990 tx=0x7f5b28009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:13.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.721+0000 7f5b38fff700 1 -- 172.21.15.107:0/3308034703 shutdown_connections 2023-08-10T10:51:13.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.721+0000 7f5b38fff700 1 --2- 172.21.15.107:0/3308034703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b340747b0 0x7f5b34072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:13.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.721+0000 7f5b38fff700 1 --2- 172.21.15.107:0/3308034703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b3410cd50 0x7f5b3410f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:13.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.721+0000 7f5b38fff700 1 --2- 172.21.15.107:0/3308034703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 0x7f5b34073650 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:13.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.721+0000 7f5b38fff700 1 -- 172.21.15.107:0/3308034703 >> 172.21.15.107:0/3308034703 conn(0x7f5b340fbcb0 msgr2=0x7f5b340fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:13.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.721+0000 7f5b38fff700 1 -- 172.21.15.107:0/3308034703 shutdown_connections 2023-08-10T10:51:13.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.721+0000 7f5b38fff700 1 -- 172.21.15.107:0/3308034703 wait complete. 2023-08-10T10:51:13.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.723+0000 7f5b38fff700 1 Processor -- start 2023-08-10T10:51:13.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.723+0000 7f5b38fff700 1 -- start start 2023-08-10T10:51:13.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b38fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 0x7f5b3419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:13.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b38fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b340747b0 0x7f5b3419d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:13.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b38fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3410cd50 0x7f5b3419deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:13.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b38fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3419e510 con 0x7f5b340747b0 2023-08-10T10:51:13.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b38fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3419e680 con 0x7f5b3410cd50 2023-08-10T10:51:13.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b38fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3419e840 con 0x7f5b340731d0 2023-08-10T10:51:13.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b3259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 0x7f5b3419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:13.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b31d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b340747b0 0x7f5b3419d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:13.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b3259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 0x7f5b3419caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:59808/0 (socket says 172.21.15.107:59808) 2023-08-10T10:51:13.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b3259c700 1 -- 172.21.15.107:0/1224591314 learned_addr learned my addr 172.21.15.107:0/1224591314 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:13.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b32d9d700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3410cd50 0x7f5b3419deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:13.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b31d9b700 1 -- 172.21.15.107:0/1224591314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 msgr2=0x7f5b3419caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:13.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b31d9b700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 0x7f5b3419caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:13.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b31d9b700 1 -- 172.21.15.107:0/1224591314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3410cd50 msgr2=0x7f5b3419deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:13.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b31d9b700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3410cd50 0x7f5b3419deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:13.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b31d9b700 1 -- 172.21.15.107:0/1224591314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280095f0 con 0x7f5b340747b0 2023-08-10T10:51:13.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b3259c700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 0x7f5b3419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:13.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.724+0000 7f5b32d9d700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3410cd50 0x7f5b3419deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:13.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.725+0000 7f5b31d9b700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b340747b0 0x7f5b3419d030 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5b28000c00 tx=0x7f5b28005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:13.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.725+0000 7f5b237fe700 1 -- 172.21.15.107:0/1224591314 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2801d070 con 0x7f5b340747b0 2023-08-10T10:51:13.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.725+0000 7f5b38fff700 1 -- 172.21.15.107:0/1224591314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3419eac0 con 0x7f5b340747b0 2023-08-10T10:51:13.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.725+0000 7f5b237fe700 1 -- 172.21.15.107:0/1224591314 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b2800bdb0 con 0x7f5b340747b0 2023-08-10T10:51:13.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.725+0000 7f5b237fe700 1 -- 172.21.15.107:0/1224591314 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28022d40 con 0x7f5b340747b0 2023-08-10T10:51:13.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.725+0000 7f5b38fff700 1 -- 172.21.15.107:0/1224591314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b341a52e0 con 0x7f5b340747b0 2023-08-10T10:51:13.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.727+0000 7f5b217fa700 1 -- 172.21.15.107:0/1224591314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b180052f0 con 0x7f5b340747b0 2023-08-10T10:51:13.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.728+0000 7f5b237fe700 1 -- 172.21.15.107:0/1224591314 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 22) v1 ==== 135527+0+0 (secure 0 0 0) 0x7f5b28022470 con 0x7f5b340747b0 2023-08-10T10:51:13.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.729+0000 7f5b237fe700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5b1c0a0f50 0x7f5b1c0a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:13.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.730+0000 7f5b237fe700 1 -- 172.21.15.107:0/1224591314 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f5b280cde90 con 0x7f5b340747b0 2023-08-10T10:51:13.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.730+0000 7f5b3259c700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5b1c0a0f50 0x7f5b1c0a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:13.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.730+0000 7f5b3259c700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5b1c0a0f50 0x7f5b1c0a3410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011550 tx=0x7f5b24009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:13.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.734+0000 7f5b237fe700 1 -- 172.21.15.107:0/1224591314 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5b28097500 con 0x7f5b340747b0 2023-08-10T10:51:13.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: mgrmap e20: x(active, since 10m), standbys: y, z 2023-08-10T10:51:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-08-10T10:51:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-08-10T10:51:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: Standby manager daemon y restarted 2023-08-10T10:51:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: Standby manager daemon y started 2023-08-10T10:51:13.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-08-10T10:51:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.? 172.21.15.157:0/3151265129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-08-10T10:51:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: Active manager daemon x restarted 2023-08-10T10:51:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: Activating manager daemon x 2023-08-10T10:51:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: osdmap e94: 12 total, 12 up, 12 in 2023-08-10T10:51:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: mgrmap e21: x(active, starting, since 0.0136169s), standbys: y, z 2023-08-10T10:51:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-08-10T10:51:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-08-10T10:51:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-08-10T10:51:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-08-10T10:51:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-08-10T10:51:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-08-10T10:51:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-08-10T10:51:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-08-10T10:51:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-08-10T10:51:13.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-08-10T10:51:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-08-10T10:51:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-08-10T10:51:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-08-10T10:51:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-08-10T10:51:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-08-10T10:51:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-08-10T10:51:13.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-08-10T10:51:13.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-08-10T10:51:13.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-08-10T10:51:13.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-08-10T10:51:13.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-08-10T10:51:13.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-08-10T10:51:13.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-08-10T10:51:13.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-08-10T10:51:13.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-08-10T10:51:13.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-08-10T10:51:13.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-08-10T10:51:13.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-08-10T10:51:13.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-08-10T10:51:13.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-08-10T10:51:13.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-08-10T10:51:13.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-08-10T10:51:13.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-08-10T10:51:13.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: Manager daemon x is now available 2023-08-10T10:51:13.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:13.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:13.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-08-10T10:51:13.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-08-10T10:51:13.978 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:13.977+0000 7f5b217fa700 1 -- 172.21.15.107:0/1224591314 --> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b18000c60 con 0x7f5b1c0a0f50 2023-08-10T10:51:14.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.032+0000 7f5b237fe700 1 -- 172.21.15.107:0/1224591314 <== mgr.15747 v2:172.21.15.107:6800/391042332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f5b18000c60 con 0x7f5b1c0a0f50 2023-08-10T10:51:14.036 INFO:teuthology.orchestra.run.smithi107.stdout:Retention added to path / 2023-08-10T10:51:14.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 -- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5b1c0a0f50 msgr2=0x7f5b1c0a3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5b1c0a0f50 0x7f5b1c0a3410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011550 tx=0x7f5b24009260 comp rx=0 tx=0).stop 2023-08-10T10:51:14.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 -- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b340747b0 msgr2=0x7f5b3419d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b340747b0 0x7f5b3419d030 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5b28000c00 tx=0x7f5b28005740 comp rx=0 tx=0).stop 2023-08-10T10:51:14.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 -- 172.21.15.107:0/1224591314 shutdown_connections 2023-08-10T10:51:14.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5b1c0a0f50 0x7f5b1c0a3410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b3410cd50 0x7f5b3419deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b340731d0 0x7f5b3419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 --2- 172.21.15.107:0/1224591314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b340747b0 0x7f5b3419d030 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 -- 172.21.15.107:0/1224591314 >> 172.21.15.107:0/1224591314 conn(0x7f5b340fbcb0 msgr2=0x7f5b340fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:14.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 -- 172.21.15.107:0/1224591314 shutdown_connections 2023-08-10T10:51:14.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.034+0000 7f5b217fa700 1 -- 172.21.15.107:0/1224591314 wait complete. 2023-08-10T10:51:14.054 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-08-10T10:51:14.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.255+0000 7f29079ff700 1 -- 172.21.15.107:0/966975766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2900101970 msgr2=0x7f2900101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.255+0000 7f29079ff700 1 --2- 172.21.15.107:0/966975766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2900101970 0x7f2900101dd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f28f00099c0 tx=0x7f28f0009cd0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.255+0000 7f29079ff700 1 -- 172.21.15.107:0/966975766 shutdown_connections 2023-08-10T10:51:14.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.255+0000 7f29079ff700 1 --2- 172.21.15.107:0/966975766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2900102310 0x7f2900108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.255+0000 7f29079ff700 1 --2- 172.21.15.107:0/966975766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2900100780 0x7f2900100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.255+0000 7f29079ff700 1 --2- 172.21.15.107:0/966975766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2900101970 0x7f2900101dd0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.255+0000 7f29079ff700 1 -- 172.21.15.107:0/966975766 >> 172.21.15.107:0/966975766 conn(0x7f29000fbcb0 msgr2=0x7f29000fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:14.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.256+0000 7f29079ff700 1 -- 172.21.15.107:0/966975766 shutdown_connections 2023-08-10T10:51:14.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.256+0000 7f29079ff700 1 -- 172.21.15.107:0/966975766 wait complete. 2023-08-10T10:51:14.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.257+0000 7f29079ff700 1 Processor -- start 2023-08-10T10:51:14.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.257+0000 7f29079ff700 1 -- start start 2023-08-10T10:51:14.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f29079ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2900100780 0x7f29001964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:14.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f29079ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2900101970 0x7f2900196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:14.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f29079ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2900102310 0x7f2900197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:14.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f29079ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900197ee0 con 0x7f2900102310 2023-08-10T10:51:14.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f29079ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900198050 con 0x7f2900100780 2023-08-10T10:51:14.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f29079ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900198210 con 0x7f2900101970 2023-08-10T10:51:14.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f290579b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2900100780 0x7f29001964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:14.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f2905f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2900102310 0x7f2900197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:14.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f290579b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2900100780 0x7f29001964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:48516/0 (socket says 172.21.15.107:48516) 2023-08-10T10:51:14.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f290579b700 1 -- 172.21.15.107:0/1384578371 learned_addr learned my addr 172.21.15.107:0/1384578371 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:14.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.258+0000 7f2904f9a700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2900101970 0x7f2900196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:14.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f2905f9c700 1 -- 172.21.15.107:0/1384578371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2900101970 msgr2=0x7f2900196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f2905f9c700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2900101970 0x7f2900196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f2905f9c700 1 -- 172.21.15.107:0/1384578371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2900100780 msgr2=0x7f29001964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f2905f9c700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2900100780 0x7f29001964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f2905f9c700 1 -- 172.21.15.107:0/1384578371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00095f0 con 0x7f2900102310 2023-08-10T10:51:14.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f290579b700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2900100780 0x7f29001964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:14.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f2905f9c700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2900102310 0x7f2900197880 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f28f8007f10 tx=0x7f28f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:14.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f28f67fc700 1 -- 172.21.15.107:0/1384578371 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8004db0 con 0x7f2900102310 2023-08-10T10:51:14.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f28f67fc700 1 -- 172.21.15.107:0/1384578371 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28f800f040 con 0x7f2900102310 2023-08-10T10:51:14.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29001984f0 con 0x7f2900102310 2023-08-10T10:51:14.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f28f67fc700 1 -- 172.21.15.107:0/1384578371 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8005960 con 0x7f2900102310 2023-08-10T10:51:14.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.259+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290019ecb0 con 0x7f2900102310 2023-08-10T10:51:14.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.260+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2900107700 con 0x7f2900102310 2023-08-10T10:51:14.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.264+0000 7f28f67fc700 1 -- 172.21.15.107:0/1384578371 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 22) v1 ==== 135527+0+0 (secure 0 0 0) 0x7f28f800db20 con 0x7f2900102310 2023-08-10T10:51:14.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.265+0000 7f28f67fc700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28ec0a0f50 0x7f28ec0a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:14.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.265+0000 7f28f67fc700 1 -- 172.21.15.107:0/1384578371 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f28f80cc980 con 0x7f2900102310 2023-08-10T10:51:14.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.265+0000 7f290579b700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28ec0a0f50 0x7f28ec0a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:14.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.266+0000 7f290579b700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28ec0a0f50 0x7f28ec0a3410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f28fc005950 tx=0x7f28fc009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:14.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.268+0000 7f28f67fc700 1 -- 172.21.15.107:0/1384578371 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f28f8095fa0 con 0x7f2900102310 2023-08-10T10:51:14.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.514+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 --> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f2900060bb0 con 0x7f28ec0a0f50 2023-08-10T10:51:14.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.522+0000 7f28f67fc700 1 -- 172.21.15.107:0/1384578371 <== mgr.15747 v2:172.21.15.107:6800/391042332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7f2900060bb0 con 0x7f28ec0a0f50 2023-08-10T10:51:14.523 INFO:teuthology.orchestra.run.smithi107.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-08-10T00:00:00", "created": "2023-08-10T10:51:13", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-08-10T10:51:14.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28ec0a0f50 msgr2=0x7f28ec0a3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28ec0a0f50 0x7f28ec0a3410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f28fc005950 tx=0x7f28fc009260 comp rx=0 tx=0).stop 2023-08-10T10:51:14.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2900102310 msgr2=0x7f2900197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2900102310 0x7f2900197880 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f28f8007f10 tx=0x7f28f800d3b0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 shutdown_connections 2023-08-10T10:51:14.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28ec0a0f50 0x7f28ec0a3410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2900100780 0x7f29001964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2900102310 0x7f2900197880 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 --2- 172.21.15.107:0/1384578371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2900101970 0x7f2900196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 >> 172.21.15.107:0/1384578371 conn(0x7f29000fbcb0 msgr2=0x7f29000fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 shutdown_connections 2023-08-10T10:51:14.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.525+0000 7f29079ff700 1 -- 172.21.15.107:0/1384578371 wait complete. 2023-08-10T10:51:14.544 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-08-10T10:51:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:14 smithi195 ceph-mon[129938]: mgrmap e22: x(active, since 1.02072s), standbys: y, z 2023-08-10T10:51:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:14 smithi195 ceph-mon[129938]: [10/Aug/2023:10:51:13] ENGINE Bus STARTING 2023-08-10T10:51:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:14 smithi195 ceph-mon[129938]: [10/Aug/2023:10:51:13] ENGINE Serving on https://172.21.15.107:7150 2023-08-10T10:51:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:14 smithi195 ceph-mon[129938]: [10/Aug/2023:10:51:13] ENGINE Serving on http://172.21.15.107:8765 2023-08-10T10:51:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:14 smithi195 ceph-mon[129938]: [10/Aug/2023:10:51:13] ENGINE Bus STARTED 2023-08-10T10:51:14.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.764+0000 7f9af55ff700 1 -- 172.21.15.107:0/3963361974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0102330 msgr2=0x7f9af0108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.764+0000 7f9af55ff700 1 --2- 172.21.15.107:0/3963361974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0102330 0x7f9af0108be0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800b0d0 tx=0x7f9ae800b3e0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.765+0000 7f9af55ff700 1 -- 172.21.15.107:0/3963361974 shutdown_connections 2023-08-10T10:51:14.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.765+0000 7f9af55ff700 1 --2- 172.21.15.107:0/3963361974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0102330 0x7f9af0108be0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.765+0000 7f9af55ff700 1 --2- 172.21.15.107:0/3963361974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9af01007a0 0x7f9af0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.765+0000 7f9af55ff700 1 --2- 172.21.15.107:0/3963361974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9af0101990 0x7f9af0101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.765+0000 7f9af55ff700 1 -- 172.21.15.107:0/3963361974 >> 172.21.15.107:0/3963361974 conn(0x7f9af00fbcf0 msgr2=0x7f9af00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:14.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.765+0000 7f9af55ff700 1 -- 172.21.15.107:0/3963361974 shutdown_connections 2023-08-10T10:51:14.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.765+0000 7f9af55ff700 1 -- 172.21.15.107:0/3963361974 wait complete. 2023-08-10T10:51:14.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9af55ff700 1 Processor -- start 2023-08-10T10:51:14.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9af55ff700 1 -- start start 2023-08-10T10:51:14.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9af55ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9af01007a0 0x7f9af0196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:14.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9af55ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0101990 0x7f9af0196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:14.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9af55ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9af0102330 0x7f9af0197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:14.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9af55ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af0198170 con 0x7f9af0101990 2023-08-10T10:51:14.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9af55ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01982e0 con 0x7f9af01007a0 2023-08-10T10:51:14.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9af55ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01984a0 con 0x7f9af0102330 2023-08-10T10:51:14.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9aee7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0101990 0x7f9af0196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:14.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9aee7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0101990 0x7f9af0196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45178/0 (socket says 172.21.15.107:45178) 2023-08-10T10:51:14.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.766+0000 7f9aee7fc700 1 -- 172.21.15.107:0/537145254 learned_addr learned my addr 172.21.15.107:0/537145254 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:14.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9aef7fe700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9af0102330 0x7f9af0197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:14.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9aeeffd700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9af01007a0 0x7f9af0196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:14.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9aee7fc700 1 -- 172.21.15.107:0/537145254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9af0102330 msgr2=0x7f9af0197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9aee7fc700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9af0102330 0x7f9af0197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9aee7fc700 1 -- 172.21.15.107:0/537145254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9af01007a0 msgr2=0x7f9af0196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:14.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9aee7fc700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9af01007a0 0x7f9af0196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:14.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9aee7fc700 1 -- 172.21.15.107:0/537145254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009d00 con 0x7f9af0101990 2023-08-10T10:51:14.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9aeeffd700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9af01007a0 0x7f9af0196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:14.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9aee7fc700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0101990 0x7f9af0196c90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400b530 tx=0x7f9ae400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:14.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9ad7fff700 1 -- 172.21.15.107:0/537145254 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4011830 con 0x7f9af0101990 2023-08-10T10:51:14.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9ad7fff700 1 -- 172.21.15.107:0/537145254 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ae4011e20 con 0x7f9af0101990 2023-08-10T10:51:14.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af0198780 con 0x7f9af0101990 2023-08-10T10:51:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.767+0000 7f9ad7fff700 1 -- 172.21.15.107:0/537145254 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400f2e0 con 0x7f9af0101990 2023-08-10T10:51:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.768+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af019efc0 con 0x7f9af0101990 2023-08-10T10:51:14.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.768+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af004e550 con 0x7f9af0101990 2023-08-10T10:51:14.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.770+0000 7f9ad7fff700 1 -- 172.21.15.107:0/537145254 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 23) v1 ==== 135836+0+0 (secure 0 0 0) 0x7f9ae4011990 con 0x7f9af0101990 2023-08-10T10:51:14.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.772+0000 7f9ad7fff700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f9ad80a1340 0x7f9ad80a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:14.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.772+0000 7f9ad7fff700 1 -- 172.21.15.107:0/537145254 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f9ae40cca10 con 0x7f9af0101990 2023-08-10T10:51:14.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.772+0000 7f9aeeffd700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f9ad80a1340 0x7f9ad80a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:14.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.772+0000 7f9aeeffd700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f9ad80a1340 0x7f9ad80a3800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9af01017f0 tx=0x7f9ae0008040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:14.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:14.776+0000 7f9ad7fff700 1 -- 172.21.15.107:0/537145254 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9ae4095bd0 con 0x7f9af0101990 2023-08-10T10:51:14.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:14 smithi157 ceph-mon[129604]: mgrmap e22: x(active, since 1.02072s), standbys: y, z 2023-08-10T10:51:14.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:14 smithi157 ceph-mon[129604]: [10/Aug/2023:10:51:13] ENGINE Bus STARTING 2023-08-10T10:51:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:14 smithi157 ceph-mon[129604]: [10/Aug/2023:10:51:13] ENGINE Serving on https://172.21.15.107:7150 2023-08-10T10:51:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:14 smithi157 ceph-mon[129604]: [10/Aug/2023:10:51:13] ENGINE Serving on http://172.21.15.107:8765 2023-08-10T10:51:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:14 smithi157 ceph-mon[129604]: [10/Aug/2023:10:51:13] ENGINE Bus STARTED 2023-08-10T10:51:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:14 smithi107 ceph-mon[127953]: mgrmap e22: x(active, since 1.02072s), standbys: y, z 2023-08-10T10:51:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:14 smithi107 ceph-mon[127953]: [10/Aug/2023:10:51:13] ENGINE Bus STARTING 2023-08-10T10:51:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:14 smithi107 ceph-mon[127953]: [10/Aug/2023:10:51:13] ENGINE Serving on https://172.21.15.107:7150 2023-08-10T10:51:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:14 smithi107 ceph-mon[127953]: [10/Aug/2023:10:51:13] ENGINE Serving on http://172.21.15.107:8765 2023-08-10T10:51:14.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:14 smithi107 ceph-mon[127953]: [10/Aug/2023:10:51:13] ENGINE Bus STARTED 2023-08-10T10:51:15.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.017+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 --> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9af019f210 con 0x7f9ad80a1340 2023-08-10T10:51:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.024+0000 7f9ad7fff700 1 -- 172.21.15.107:0/537145254 <== mgr.15747 v2:172.21.15.107:6800/391042332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f9af019f210 con 0x7f9ad80a1340 2023-08-10T10:51:15.026 INFO:teuthology.orchestra.run.smithi107.stdout:/ 1M 6M3h 2023-08-10T10:51:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f9ad80a1340 msgr2=0x7f9ad80a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f9ad80a1340 0x7f9ad80a3800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9af01017f0 tx=0x7f9ae0008040 comp rx=0 tx=0).stop 2023-08-10T10:51:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0101990 msgr2=0x7f9af0196c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0101990 0x7f9af0196c90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400b530 tx=0x7f9ae400b840 comp rx=0 tx=0).stop 2023-08-10T10:51:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 shutdown_connections 2023-08-10T10:51:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f9ad80a1340 0x7f9ad80a3800 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9af01007a0 0x7f9af0196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9af0102330 0x7f9af0197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 --2- 172.21.15.107:0/537145254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9af0101990 0x7f9af0196c90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 >> 172.21.15.107:0/537145254 conn(0x7f9af00fbcf0 msgr2=0x7f9af00fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 shutdown_connections 2023-08-10T10:51:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:15.027+0000 7f9af55ff700 1 -- 172.21.15.107:0/537145254 wait complete. 2023-08-10T10:51:15.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-08-10T10:51:15.134 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-08-10T10:51:15.144 INFO:teuthology.run_tasks:Running task exec... 2023-08-10T10:51:15.209 INFO:teuthology.task.exec:Executing custom commands... 2023-08-10T10:51:15.210 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T10:51:15.210 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-08-10T10:51:15.320 INFO:teuthology.orchestra.run.smithi107.stdout:total 0 2023-08-10T10:51:15.351 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem Size Used Avail Use% Mounted on 2023-08-10T10:51:15.351 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-fuse 1.1T 332M 1.1T 1% /tmp/cephfs 2023-08-10T10:51:15.356 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-08-10T10:51:15.494 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-08-10T10:51:15.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-08-10T10:51:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:15 smithi107 ceph-mon[127953]: from='client.15804 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:51:15.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:15 smithi107 ceph-mon[127953]: pgmap v4: 129 pgs: 129 active+clean; 1.0 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:51:15.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:15 smithi107 ceph-mon[127953]: from='client.15810 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:51:15.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:15 smithi107 ceph-mon[127953]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-08-10T10:51:15.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:15 smithi195 ceph-mon[129938]: from='client.15804 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:51:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:15 smithi195 ceph-mon[129938]: pgmap v4: 129 pgs: 129 active+clean; 1.0 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:51:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:15 smithi195 ceph-mon[129938]: from='client.15810 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:51:15.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:15 smithi195 ceph-mon[129938]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-08-10T10:51:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:15 smithi157 ceph-mon[129604]: from='client.15804 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:51:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:15 smithi157 ceph-mon[129604]: pgmap v4: 129 pgs: 129 active+clean; 1.0 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:51:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:15 smithi157 ceph-mon[129604]: from='client.15810 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:51:16.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:15 smithi157 ceph-mon[129604]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-08-10T10:51:16.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:16 smithi195 ceph-mon[129938]: from='client.15822 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:51:16.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:16.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:16.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:16.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:16.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:16.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:16 smithi157 ceph-mon[129604]: from='client.15822 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:51:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:16 smithi107 ceph-mon[127953]: from='client.15822 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T10:51:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:17.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:17 smithi195 ceph-mon[129938]: pgmap v5: 129 pgs: 129 active+clean; 1.0 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:51:17.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:17 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:51:17.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:17 smithi195 ceph-mon[129938]: mgrmap e24: x(active, since 4s), standbys: y, z 2023-08-10T10:51:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:17 smithi157 ceph-mon[129604]: pgmap v5: 129 pgs: 129 active+clean; 1.0 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:51:18.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:17 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:51:18.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:17 smithi157 ceph-mon[129604]: mgrmap e24: x(active, since 4s), standbys: y, z 2023-08-10T10:51:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:17 smithi107 ceph-mon[127953]: pgmap v5: 129 pgs: 129 active+clean; 1.0 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:51:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:17 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:51:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:17 smithi107 ceph-mon[127953]: mgrmap e24: x(active, since 4s), standbys: y, z 2023-08-10T10:51:18.723 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:18.723 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:18.723 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:18.724 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.724 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:18.724 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.724 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.724 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.724 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.724 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.725 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.725 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T10:51:18.725 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.725 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T10:51:18.725 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T10:51:18.725 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T10:51:18.725 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:18.725 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:18.726 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.726 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.726 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.726 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:18.726 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:51:18.726 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:18 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:51:19.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T10:51:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T10:51:19.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T10:51:19.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T10:51:19.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:51:19.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:18 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:51:19.069 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-08-10T10:51:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T10:51:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T10:51:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T10:51:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T10:51:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T10:51:19.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:51:19.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:18 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:51:19.174 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-08-10T10:51:19.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-08-10T10:51:19.288 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-08-10T10:51:19.400 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/: 2023-08-10T10:51:19.400 INFO:teuthology.orchestra.run.smithi107.stdout:total 2 2023-08-10T10:51:19.400 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:19.400 INFO:teuthology.orchestra.run.smithi107.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 .. 2023-08-10T10:51:19.400 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 data 2023-08-10T10:51:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:19.401 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data: 2023-08-10T10:51:19.401 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:19.402 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:19.402 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 .. 2023-08-10T10:51:19.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-08-10T10:51:19.537 INFO:teuthology.orchestra.run.smithi107.stdout:[Service] 2023-08-10T10:51:19.537 INFO:teuthology.orchestra.run.smithi107.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-08-10T10:51:19.537 INFO:teuthology.orchestra.run.smithi107.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-08-10T10:51:19.542 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-08-10T10:51:19.771 INFO:teuthology.orchestra.run.smithi107.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-08-10T10:51:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:19 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T10:51:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:19 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T10:51:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:19 smithi157 ceph-mon[129604]: Updating smithi107:/etc/ceph/ceph.conf 2023-08-10T10:51:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:19 smithi157 ceph-mon[129604]: Updating smithi157:/etc/ceph/ceph.conf 2023-08-10T10:51:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:19 smithi157 ceph-mon[129604]: Updating smithi195:/etc/ceph/ceph.conf 2023-08-10T10:51:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:19 smithi157 ceph-mon[129604]: pgmap v6: 129 pgs: 129 active+clean; 1.0 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:51:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:19 smithi157 ceph-mon[129604]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:51:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:19 smithi157 ceph-mon[129604]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:51:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:19 smithi157 ceph-mon[129604]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:51:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:19 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T10:51:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:19 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T10:51:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:19 smithi107 ceph-mon[127953]: Updating smithi107:/etc/ceph/ceph.conf 2023-08-10T10:51:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:19 smithi107 ceph-mon[127953]: Updating smithi157:/etc/ceph/ceph.conf 2023-08-10T10:51:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:19 smithi107 ceph-mon[127953]: Updating smithi195:/etc/ceph/ceph.conf 2023-08-10T10:51:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:19 smithi107 ceph-mon[127953]: pgmap v6: 129 pgs: 129 active+clean; 1.0 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:51:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:19 smithi107 ceph-mon[127953]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:51:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:19 smithi107 ceph-mon[127953]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:51:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:19 smithi107 ceph-mon[127953]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:51:20.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:19 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T10:51:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:19 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T10:51:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:19 smithi195 ceph-mon[129938]: Updating smithi107:/etc/ceph/ceph.conf 2023-08-10T10:51:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:19 smithi195 ceph-mon[129938]: Updating smithi157:/etc/ceph/ceph.conf 2023-08-10T10:51:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:19 smithi195 ceph-mon[129938]: Updating smithi195:/etc/ceph/ceph.conf 2023-08-10T10:51:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:19 smithi195 ceph-mon[129938]: pgmap v6: 129 pgs: 129 active+clean; 1.0 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail 2023-08-10T10:51:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:19 smithi195 ceph-mon[129938]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:51:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:19 smithi195 ceph-mon[129938]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:51:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:19 smithi195 ceph-mon[129938]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.conf 2023-08-10T10:51:21.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:51:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:51:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:51:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:51:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:51:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:51:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:51:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:51:21.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:51:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:51:21.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:51:21.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:51:21.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:51:21.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:51:21.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:21.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:51:21.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:51:21.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:51:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:51:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2023-08-10T10:51:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: Updating smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:51:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: Updating smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:51:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: Updating smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/config/ceph.client.admin.keyring 2023-08-10T10:51:21.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:21.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:51:21.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:51:21.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:51:21.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:51:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:21 smithi157 ceph-mon[129604]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 133 KiB/s wr, 71 op/s 2023-08-10T10:51:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:21 smithi107 ceph-mon[127953]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 133 KiB/s wr, 71 op/s 2023-08-10T10:51:22.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:21 smithi195 ceph-mon[129938]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 133 KiB/s wr, 71 op/s 2023-08-10T10:51:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:23 smithi157 ceph-mon[129604]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 55 op/s 2023-08-10T10:51:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:23 smithi107 ceph-mon[127953]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 55 op/s 2023-08-10T10:51:24.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:23 smithi195 ceph-mon[129938]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 55 op/s 2023-08-10T10:51:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:25 smithi157 ceph-mon[129604]: pgmap v9: 129 pgs: 129 active+clean; 22 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.9 MiB/s wr, 73 op/s 2023-08-10T10:51:26.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:25 smithi107 ceph-mon[127953]: pgmap v9: 129 pgs: 129 active+clean; 22 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.9 MiB/s wr, 73 op/s 2023-08-10T10:51:26.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:25 smithi195 ceph-mon[129938]: pgmap v9: 129 pgs: 129 active+clean; 22 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.9 MiB/s wr, 73 op/s 2023-08-10T10:51:28.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:27 smithi157 ceph-mon[129604]: pgmap v10: 129 pgs: 129 active+clean; 22 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.8 MiB/s wr, 67 op/s 2023-08-10T10:51:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:27 smithi107 ceph-mon[127953]: pgmap v10: 129 pgs: 129 active+clean; 22 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.8 MiB/s wr, 67 op/s 2023-08-10T10:51:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:27 smithi195 ceph-mon[129938]: pgmap v10: 129 pgs: 129 active+clean; 22 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.8 MiB/s wr, 67 op/s 2023-08-10T10:51:30.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:29 smithi157 ceph-mon[129604]: pgmap v11: 129 pgs: 129 active+clean; 22 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.8 MiB/s wr, 67 op/s 2023-08-10T10:51:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:29 smithi107 ceph-mon[127953]: pgmap v11: 129 pgs: 129 active+clean; 22 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.8 MiB/s wr, 67 op/s 2023-08-10T10:51:30.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:29 smithi195 ceph-mon[129938]: pgmap v11: 129 pgs: 129 active+clean; 22 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.8 MiB/s wr, 67 op/s 2023-08-10T10:51:32.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:31 smithi157 ceph-mon[129604]: pgmap v12: 129 pgs: 129 active+clean; 37 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 3.8 MiB/s wr, 137 op/s 2023-08-10T10:51:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:31 smithi107 ceph-mon[127953]: pgmap v12: 129 pgs: 129 active+clean; 37 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 3.8 MiB/s wr, 137 op/s 2023-08-10T10:51:32.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:31 smithi195 ceph-mon[129938]: pgmap v12: 129 pgs: 129 active+clean; 37 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 3.8 MiB/s wr, 137 op/s 2023-08-10T10:51:33.315 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:51:33.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.545+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2863446192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec1006c0 msgr2=0x7fd9ec100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.545+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2863446192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec1006c0 0x7fd9ec100b40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009990 tx=0x7fd9e0009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.545+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2863446192 shutdown_connections 2023-08-10T10:51:33.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.545+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2863446192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9ec101080 0x7fd9ec10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.545+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2863446192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1066d0 0x7fd9ec106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.545+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2863446192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec1006c0 0x7fd9ec100b40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.545+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2863446192 >> 172.21.15.107:0/2863446192 conn(0x7fd9ec0fc1f0 msgr2=0x7fd9ec0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.545+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2863446192 shutdown_connections 2023-08-10T10:51:33.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.545+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2863446192 wait complete. 2023-08-10T10:51:33.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.546+0000 7fd9f29ff700 1 Processor -- start 2023-08-10T10:51:33.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.546+0000 7fd9f29ff700 1 -- start start 2023-08-10T10:51:33.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9f29ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1006c0 0x7fd9ec19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9f29ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9ec101080 0x7fd9ec19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9f29ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec1066d0 0x7fd9ec198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9f29ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec198d90 con 0x7fd9ec1066d0 2023-08-10T10:51:33.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9f29ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec198f00 con 0x7fd9ec101080 2023-08-10T10:51:33.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9f29ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec1990c0 con 0x7fd9ec1006c0 2023-08-10T10:51:33.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9eb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9ec101080 0x7fd9ec19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9ebfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1006c0 0x7fd9ec19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9eb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9ec101080 0x7fd9ec19ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38842/0 (socket says 172.21.15.107:38842) 2023-08-10T10:51:33.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9eb7fe700 1 -- 172.21.15.107:0/2491555937 learned_addr learned my addr 172.21.15.107:0/2491555937 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:33.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9f0f9c700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec1066d0 0x7fd9ec198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9eb7fe700 1 -- 172.21.15.107:0/2491555937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1006c0 msgr2=0x7fd9ec19e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.547+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1006c0 0x7fd9ec19e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9eb7fe700 1 -- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec1066d0 msgr2=0x7fd9ec198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec1066d0 0x7fd9ec198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9eb7fe700 1 -- 172.21.15.107:0/2491555937 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e00095f0 con 0x7fd9ec101080 2023-08-10T10:51:33.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1006c0 0x7fd9ec19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:33.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9ec101080 0x7fd9ec19ebf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0000c00 tx=0x7fd9e0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9e97fa700 1 -- 172.21.15.107:0/2491555937 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e001d070 con 0x7fd9ec101080 2023-08-10T10:51:33.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2491555937 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec199340 con 0x7fd9ec101080 2023-08-10T10:51:33.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9e97fa700 1 -- 172.21.15.107:0/2491555937 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9e0022470 con 0x7fd9ec101080 2023-08-10T10:51:33.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9e97fa700 1 -- 172.21.15.107:0/2491555937 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0017650 con 0x7fd9ec101080 2023-08-10T10:51:33.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.548+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2491555937 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec1a56a0 con 0x7fd9ec101080 2023-08-10T10:51:33.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.552+0000 7fd9e97fa700 1 -- 172.21.15.107:0/2491555937 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 24) v1 ==== 135892+0+0 (secure 0 0 0) 0x7fd9e00225e0 con 0x7fd9ec101080 2023-08-10T10:51:33.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.554+0000 7fda062b0b80 1 Processor -- start 2023-08-10T10:51:33.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.554+0000 7fda062b0b80 1 -- start start 2023-08-10T10:51:33.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.554+0000 7fd9e97fa700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9d40a1350 0x7fd9d40a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.554+0000 7fd9e97fa700 1 -- 172.21.15.107:0/2491555937 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fd9e00ce660 con 0x7fd9ec101080 2023-08-10T10:51:33.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.554+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402dfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.554+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402db450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fda062b0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56084024ddc0 con 0x5608402df6d0 2023-08-10T10:51:33.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fda062b0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56084022a590 con 0x5608402db010 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fda062b0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560840227eb0 con 0x5608402dfff0 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9f0f9c700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9d40a1350 0x7fd9d40a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9ebfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402dfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9ebfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402dfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43878/0 (socket says 172.21.15.107:43878) 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9ebfff700 1 -- 172.21.15.107:0/2118925718 learned_addr learned my addr 172.21.15.107:0/2118925718 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9f0f9c700 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9ebfff700 1 -- 172.21.15.107:0/2118925718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 msgr2=0x5608402daad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402daad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9ebfff700 1 -- 172.21.15.107:0/2118925718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 msgr2=0x5608402db450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402db450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9ebfff700 1 -- 172.21.15.107:0/2118925718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608400a4630 con 0x5608402df6d0 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.555+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.556+0000 7fd9f0f9c700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9d40a1350 0x7fd9d40a3810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009ec0 tx=0x7fd9e4013480 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.556+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402dfab0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0104d0 tx=0x7fd9dc0107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a1694dc38dd103 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.556+0000 7fd9d27fc700 1 -- 172.21.15.107:0/2118925718 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc004020 con 0x5608402df6d0 2023-08-10T10:51:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.556+0000 7fd9d27fc700 1 -- 172.21.15.107:0/2118925718 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9dc015070 con 0x5608402df6d0 2023-08-10T10:51:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.556+0000 7fd9d27fc700 1 -- 172.21.15.107:0/2118925718 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc011440 con 0x5608402df6d0 2023-08-10T10:51:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 -- 172.21.15.107:0/2118925718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 msgr2=0x5608402dfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402dfab0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0104d0 tx=0x7fd9dc0107e0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 -- 172.21.15.107:0/2118925718 shutdown_connections 2023-08-10T10:51:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402db450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402dfab0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2118925718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402daad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 -- 172.21.15.107:0/2118925718 >> 172.21.15.107:0/2118925718 conn(0x56084022fcd0 msgr2=0x5608402cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 -- 172.21.15.107:0/2118925718 shutdown_connections 2023-08-10T10:51:33.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 -- 172.21.15.107:0/2118925718 wait complete. 2023-08-10T10:51:33.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.557+0000 7fda062b0b80 1 -- start start 2023-08-10T10:51:33.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.558+0000 7fda062b0b80 1 Processor -- start 2023-08-10T10:51:33.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.558+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402e4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.558+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402e4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.558+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.558+0000 7fda062b0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608402237a0 con 0x5608402df6d0 2023-08-10T10:51:33.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.558+0000 7fda062b0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608401c2ac0 con 0x5608402db010 2023-08-10T10:51:33.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.558+0000 7fda062b0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608401c27c0 con 0x5608402dfff0 2023-08-10T10:51:33.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.558+0000 7fda062b0b80 10 client.0 _ll_register_callbacks cb 0x5608401c0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:33.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9ebfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9eb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402e4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9ebfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402e4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38872/0 (socket says 172.21.15.107:38872) 2023-08-10T10:51:33.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9ebfff700 1 -- 172.21.15.107:0/1292174855 learned_addr learned my addr 172.21.15.107:0/1292174855 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:33.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9f0f9c700 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9eb7fe700 1 -- 172.21.15.107:0/1292174855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 msgr2=0x5608402e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9eb7fe700 1 -- 172.21.15.107:0/1292174855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 msgr2=0x5608402e4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402e4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9eb7fe700 1 -- 172.21.15.107:0/1292174855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc00bd10 con 0x5608402df6d0 2023-08-10T10:51:33.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402e4990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00cb990 tx=0x7fd9e00cbf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e2bf1c1d58c32 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:51:33.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/1292174855 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e009ac50 con 0x5608402df6d0 2023-08-10T10:51:33.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/1292174855 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fd9e00228c0 con 0x5608402df6d0 2023-08-10T10:51:33.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.559+0000 7fda062b0b80 1 -- 172.21.15.107:0/1292174855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608402c5470 con 0x5608402df6d0 2023-08-10T10:51:33.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/1292174855 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9e009b2f0 con 0x5608402df6d0 2023-08-10T10:51:33.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fda062b0b80 10 client.15834 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:33.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fda062b0b80 1 -- 172.21.15.107:0/1292174855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560840050de0 con 0x5608402df6d0 2023-08-10T10:51:33.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/1292174855 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5608402c5470 con 0x5608402df6d0 2023-08-10T10:51:33.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/1292174855 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd9e009a7e0 con 0x5608402df6d0 2023-08-10T10:51:33.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fda062b0b80 10 client.15834 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:33.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fda062b0b80 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:33.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fda062b0b80 20 client.15834 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:33.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fda062b0b80 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5608402f4710 0x5608402f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fda062b0b80 4 client.15834 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:33.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.560+0000 7fda062b0b80 1 -- 172.21.15.107:0/1292174855 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608402a19d0 con 0x5608402f4710 2023-08-10T10:51:33.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.561+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5608402f4710 0x5608402f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.561+0000 7fd9cb7fe700 10 client.15834 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:33.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.561+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5608402f4710 0x5608402f6b00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e82eea0f1f5915a2 server_cookie=bff2a98f28ec4410 in_seq=0 out_seq=0 2023-08-10T10:51:33.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/1292174855 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5608402a19d0 con 0x5608402f4710 2023-08-10T10:51:33.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fd9cb7fe700 10 client.15834 handle_command_reply: tid=0 2023-08-10T10:51:33.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fda062b0b80 1 client.15834 shutdown 2023-08-10T10:51:33.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fda062b0b80 1 -- 172.21.15.107:0/1292174855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 msgr2=0x5608402e4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fda062b0b80 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402e4990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00cb990 tx=0x7fd9e00cbf20 comp rx=0 tx=0).stop 2023-08-10T10:51:33.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fda062b0b80 1 -- 172.21.15.107:0/1292174855 shutdown_connections 2023-08-10T10:51:33.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fda062b0b80 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5608402f4710 0x5608402f6b00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fda062b0b80 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402e4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fda062b0b80 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fda062b0b80 1 --2- 172.21.15.107:0/1292174855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402df6d0 0x5608402e4990 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fda062b0b80 1 -- 172.21.15.107:0/1292174855 >> 172.21.15.107:0/1292174855 conn(0x56084022fcd0 msgr2=0x5608402e0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.562+0000 7fd9cb7fe700 0 client.15834 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:33.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.563+0000 7fda062b0b80 1 -- 172.21.15.107:0/1292174855 shutdown_connections 2023-08-10T10:51:33.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.563+0000 7fda062b0b80 1 -- 172.21.15.107:0/1292174855 wait complete. 2023-08-10T10:51:33.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.563+0000 7fda062b0b80 20 client.15834 trim_cache size 0 max 16384 2023-08-10T10:51:33.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.582+0000 7fda062b0b80 1 Processor -- start 2023-08-10T10:51:33.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.582+0000 7fda062b0b80 1 -- start start 2023-08-10T10:51:33.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.582+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402db010 0x5608402dee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.582+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402df6d0 0x5608402e4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.582+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.582+0000 7fda062b0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608400a6920 con 0x5608402db010 2023-08-10T10:51:33.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.582+0000 7fda062b0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608402ced90 con 0x5608402df6d0 2023-08-10T10:51:33.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.582+0000 7fda062b0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608402de1b0 con 0x5608402dfff0 2023-08-10T10:51:33.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9ebfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402db010 0x5608402dee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9ebfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402db010 0x5608402dee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43898/0 (socket says 172.21.15.107:43898) 2023-08-10T10:51:33.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9ebfff700 1 -- 172.21.15.107:0/238292108 learned_addr learned my addr 172.21.15.107:0/238292108 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:33.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/238292108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402df6d0 0x5608402e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9f0f9c700 1 --2- 172.21.15.107:0/238292108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9ebfff700 1 -- 172.21.15.107:0/238292108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 msgr2=0x5608402d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/238292108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9ebfff700 1 -- 172.21.15.107:0/238292108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402df6d0 msgr2=0x5608402e4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/238292108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402df6d0 0x5608402e4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9ebfff700 1 -- 172.21.15.107:0/238292108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560840039c60 con 0x5608402db010 2023-08-10T10:51:33.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.583+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/238292108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402db010 0x5608402dee50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0104d0 tx=0x7fd9dc005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54e073ff6473360 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.584+0000 7fd9d2ffd700 1 -- 172.21.15.107:0/238292108 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc020070 con 0x5608402db010 2023-08-10T10:51:33.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.584+0000 7fd9d2ffd700 1 -- 172.21.15.107:0/238292108 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9dc021040 con 0x5608402db010 2023-08-10T10:51:33.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.584+0000 7fd9d2ffd700 1 -- 172.21.15.107:0/238292108 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc028cb0 con 0x5608402db010 2023-08-10T10:51:33.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 -- 172.21.15.107:0/238292108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402db010 msgr2=0x5608402dee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 --2- 172.21.15.107:0/238292108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402db010 0x5608402dee50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0104d0 tx=0x7fd9dc005ee0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 -- 172.21.15.107:0/238292108 shutdown_connections 2023-08-10T10:51:33.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 --2- 172.21.15.107:0/238292108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402dfff0 0x5608402d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 --2- 172.21.15.107:0/238292108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402db010 0x5608402dee50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 --2- 172.21.15.107:0/238292108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402df6d0 0x5608402e4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 -- 172.21.15.107:0/238292108 >> 172.21.15.107:0/238292108 conn(0x56084022fcd0 msgr2=0x5608402d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 -- 172.21.15.107:0/238292108 shutdown_connections 2023-08-10T10:51:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 -- 172.21.15.107:0/238292108 wait complete. 2023-08-10T10:51:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.585+0000 7fda062b0b80 1 -- start start 2023-08-10T10:51:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.586+0000 7fda062b0b80 1 Processor -- start 2023-08-10T10:51:33.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.586+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402eba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.586+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402df6d0 0x5608402e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.586+0000 7fda062b0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402dfff0 0x5608402ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.586+0000 7fda062b0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608402ea9d0 con 0x5608402dfff0 2023-08-10T10:51:33.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.586+0000 7fda062b0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608402eab40 con 0x5608402db010 2023-08-10T10:51:33.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.586+0000 7fda062b0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608403483c0 con 0x5608402df6d0 2023-08-10T10:51:33.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.586+0000 7fda062b0b80 10 client.0 _ll_register_callbacks cb 0x5608401c0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:33.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9f0f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402dfff0 0x5608402ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9f0f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402dfff0 0x5608402ea2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43912/0 (socket says 172.21.15.107:43912) 2023-08-10T10:51:33.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9f0f9c700 1 -- 172.21.15.107:0/2170564361 learned_addr learned my addr 172.21.15.107:0/2170564361 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:33.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9eb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402df6d0 0x5608402e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402eba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9f0f9c700 1 -- 172.21.15.107:0/2170564361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402df6d0 msgr2=0x5608402e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9f0f9c700 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402df6d0 0x5608402e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9f0f9c700 1 -- 172.21.15.107:0/2170564361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 msgr2=0x5608402eba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:33.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9f0f9c700 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402eba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9f0f9c700 1 -- 172.21.15.107:0/2170564361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5608400a4630 con 0x5608402dfff0 2023-08-10T10:51:33.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9eb7fe700 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402df6d0 0x5608402e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:33.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402eba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:33.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9f0f9c700 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402dfff0 0x5608402ea2e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40092e0 tx=0x7fd9e4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cd279d7c95c557 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.587+0000 7fd9cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:51:33.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.588+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/2170564361 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e400e040 con 0x5608402dfff0 2023-08-10T10:51:33.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.588+0000 7fda062b0b80 1 -- 172.21.15.107:0/2170564361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9dc015070 con 0x5608402dfff0 2023-08-10T10:51:33.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.588+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/2170564361 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fd9e4003a00 con 0x5608402dfff0 2023-08-10T10:51:33.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.588+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/2170564361 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9e4008e80 con 0x5608402dfff0 2023-08-10T10:51:33.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.588+0000 7fda062b0b80 10 client.15840 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:33.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.588+0000 7fda062b0b80 1 -- 172.21.15.107:0/2170564361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560840077250 con 0x5608402dfff0 2023-08-10T10:51:33.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.588+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/2170564361 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9dc015070 con 0x5608402dfff0 2023-08-10T10:51:33.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.589+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/2170564361 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd9e4004620 con 0x5608402dfff0 2023-08-10T10:51:33.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.589+0000 7fda062b0b80 10 client.15840 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:33.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.589+0000 7fda062b0b80 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:33.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.589+0000 7fda062b0b80 20 client.15840 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:33.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.589+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560840349a00 0x56084034be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.589+0000 7fda062b0b80 4 client.15840 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:51:33.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.589+0000 7fda062b0b80 1 -- 172.21.15.107:0/2170564361 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56084021c780 con 0x560840349a00 2023-08-10T10:51:33.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.589+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560840349a00 0x56084034be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fd9cb7fe700 10 client.15840 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:33.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fd9ebfff700 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560840349a00 0x56084034be20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f8125f331efa0e server_cookie=181ac7582bc04376 in_seq=0 out_seq=0 2023-08-10T10:51:33.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fd9cb7fe700 1 -- 172.21.15.107:0/2170564361 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56084021c780 con 0x560840349a00 2023-08-10T10:51:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fd9cb7fe700 10 client.15840 handle_command_reply: tid=0 2023-08-10T10:51:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fda062b0b80 1 client.15840 shutdown 2023-08-10T10:51:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fda062b0b80 1 -- 172.21.15.107:0/2170564361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402dfff0 msgr2=0x5608402ea2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402dfff0 0x5608402ea2e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40092e0 tx=0x7fd9e4004b40 comp rx=0 tx=0).stop 2023-08-10T10:51:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fda062b0b80 1 -- 172.21.15.107:0/2170564361 shutdown_connections 2023-08-10T10:51:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560840349a00 0x56084034be20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5608402db010 0x5608402eba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5608402dfff0 0x5608402ea2e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fd9cb7fe700 0 client.15840 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:33.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fda062b0b80 1 --2- 172.21.15.107:0/2170564361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5608402df6d0 0x5608402e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.590+0000 7fda062b0b80 1 -- 172.21.15.107:0/2170564361 >> 172.21.15.107:0/2170564361 conn(0x56084022fcd0 msgr2=0x5608402d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fda062b0b80 1 -- 172.21.15.107:0/2170564361 shutdown_connections 2023-08-10T10:51:33.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fda062b0b80 1 -- 172.21.15.107:0/2170564361 wait complete. 2023-08-10T10:51:33.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fda062b0b80 20 client.15840 trim_cache size 0 max 16384 2023-08-10T10:51:33.599 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:51:33.599 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "no active scrubs running", 2023-08-10T10:51:33.599 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": {} 2023-08-10T10:51:33.599 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:51:33.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9d40a1350 msgr2=0x7fd9d40a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9d40a1350 0x7fd9d40a3810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009ec0 tx=0x7fd9e4013480 comp rx=0 tx=0).stop 2023-08-10T10:51:33.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2491555937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9ec101080 msgr2=0x7fd9ec19ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9ec101080 0x7fd9ec19ebf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0000c00 tx=0x7fd9e0004730 comp rx=0 tx=0).stop 2023-08-10T10:51:33.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2491555937 shutdown_connections 2023-08-10T10:51:33.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9ec1066d0 0x7fd9ec198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1006c0 0x7fd9ec19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9d40a1350 0x7fd9d40a3810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 --2- 172.21.15.107:0/2491555937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9ec101080 0x7fd9ec19ebf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.591+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2491555937 >> 172.21.15.107:0/2491555937 conn(0x7fd9ec0fc1f0 msgr2=0x7fd9ec10baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.592+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2491555937 shutdown_connections 2023-08-10T10:51:33.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.592+0000 7fd9f29ff700 1 -- 172.21.15.107:0/2491555937 wait complete. 2023-08-10T10:51:33.613 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-10T10:51:33.613 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:51:33.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.835+0000 7f57f299d700 1 -- 172.21.15.107:0/933155120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57ec0678d0 msgr2=0x7f57ec067d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.835+0000 7f57f299d700 1 --2- 172.21.15.107:0/933155120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57ec0678d0 0x7f57ec067d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009920 tx=0x7f57dc009c30 comp rx=0 tx=0).stop 2023-08-10T10:51:33.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.835+0000 7f57f299d700 1 -- 172.21.15.107:0/933155120 shutdown_connections 2023-08-10T10:51:33.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.835+0000 7f57f299d700 1 --2- 172.21.15.107:0/933155120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ec068290 0x7f57ec10d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.835+0000 7f57f299d700 1 --2- 172.21.15.107:0/933155120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57ec106660 0x7f57ec106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.835+0000 7f57f299d700 1 --2- 172.21.15.107:0/933155120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57ec0678d0 0x7f57ec067d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.835+0000 7f57f299d700 1 -- 172.21.15.107:0/933155120 >> 172.21.15.107:0/933155120 conn(0x7f57ec074f70 msgr2=0x7f57ec075380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:33.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.836+0000 7f57f299d700 1 -- 172.21.15.107:0/933155120 shutdown_connections 2023-08-10T10:51:33.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.836+0000 7f57f299d700 1 -- 172.21.15.107:0/933155120 wait complete. 2023-08-10T10:51:33.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.837+0000 7f57f299d700 1 Processor -- start 2023-08-10T10:51:33.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.837+0000 7f57f299d700 1 -- start start 2023-08-10T10:51:33.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f299d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ec0678d0 0x7f57ec0ff7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f299d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57ec068290 0x7f57ec0ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f299d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57ec106660 0x7f57ec1a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f299d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec100540 con 0x7f57ec106660 2023-08-10T10:51:33.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f299d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec1a4b50 con 0x7f57ec068290 2023-08-10T10:51:33.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f299d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec1a4c90 con 0x7f57ec0678d0 2023-08-10T10:51:33.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f219c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57ec106660 0x7f57ec1a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ec0678d0 0x7f57ec0ff7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f119a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57ec068290 0x7f57ec0ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ec0678d0 0x7f57ec0ff7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55584/0 (socket says 172.21.15.107:55584) 2023-08-10T10:51:33.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.838+0000 7f57f199b700 1 -- 172.21.15.107:0/1276323085 learned_addr learned my addr 172.21.15.107:0/1276323085 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:33.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57f119a700 1 -- 172.21.15.107:0/1276323085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ec0678d0 msgr2=0x7f57ec0ff7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57f119a700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ec0678d0 0x7f57ec0ff7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57f119a700 1 -- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57ec106660 msgr2=0x7f57ec1a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:33.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57f119a700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57ec106660 0x7f57ec1a4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:33.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57f119a700 1 -- 172.21.15.107:0/1276323085 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80095f0 con 0x7f57ec068290 2023-08-10T10:51:33.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57f219c700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57ec106660 0x7f57ec1a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:33.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57f119a700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57ec068290 0x7f57ec0ffd10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57dc000c00 tx=0x7f57dc00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57e2ffd700 1 -- 172.21.15.107:0/1276323085 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc01c070 con 0x7f57ec068290 2023-08-10T10:51:33.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc009520 con 0x7f57ec068290 2023-08-10T10:51:33.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57e2ffd700 1 -- 172.21.15.107:0/1276323085 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57dc00b9f0 con 0x7f57ec068290 2023-08-10T10:51:33.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57e2ffd700 1 -- 172.21.15.107:0/1276323085 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0046d0 con 0x7f57ec068290 2023-08-10T10:51:33.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.839+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ec1a5120 con 0x7f57ec068290 2023-08-10T10:51:33.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.840+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ec067480 con 0x7f57ec068290 2023-08-10T10:51:33.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.842+0000 7f57e2ffd700 1 -- 172.21.15.107:0/1276323085 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 24) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f57dc020070 con 0x7f57ec068290 2023-08-10T10:51:33.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.844+0000 7f57e2ffd700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f57d80a14c0 0x7f57d80a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:33.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.844+0000 7f57e2ffd700 1 -- 172.21.15.107:0/1276323085 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f57dc0cde70 con 0x7f57ec068290 2023-08-10T10:51:33.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.844+0000 7f57f199b700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f57d80a14c0 0x7f57d80a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:33.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.845+0000 7f57f199b700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f57d80a14c0 0x7f57d80a3980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57e8005d10 tx=0x7f57e8009310 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:33.849 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:33.848+0000 7f57e2ffd700 1 -- 172.21.15.107:0/1276323085 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f57dc096e40 con 0x7f57ec068290 2023-08-10T10:51:34.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:33 smithi157 ceph-mon[129604]: pgmap v13: 129 pgs: 129 active+clean; 37 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 3.7 MiB/s wr, 96 op/s 2023-08-10T10:51:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:33 smithi107 ceph-mon[127953]: pgmap v13: 129 pgs: 129 active+clean; 37 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 3.7 MiB/s wr, 96 op/s 2023-08-10T10:51:34.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:33 smithi195 ceph-mon[129938]: pgmap v13: 129 pgs: 129 active+clean; 37 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 3.7 MiB/s wr, 96 op/s 2023-08-10T10:51:34.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.169+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57ec100d00 con 0x7f57ec068290 2023-08-10T10:51:34.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.171+0000 7f57e2ffd700 1 -- 172.21.15.107:0/1276323085 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10914 (secure 0 0 0) 0x7f57dc09a460 con 0x7f57ec068290 2023-08-10T10:51:34.172 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:34.172 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:49:16.643966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:51:34.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f57d80a14c0 msgr2=0x7f57d80a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f57d80a14c0 0x7f57d80a3980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57e8005d10 tx=0x7f57e8009310 comp rx=0 tx=0).stop 2023-08-10T10:51:34.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57ec068290 msgr2=0x7f57ec0ffd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57ec068290 0x7f57ec0ffd10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57dc000c00 tx=0x7f57dc00fa00 comp rx=0 tx=0).stop 2023-08-10T10:51:34.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 shutdown_connections 2023-08-10T10:51:34.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f57ec106660 0x7f57ec1a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57ec0678d0 0x7f57ec0ff7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f57d80a14c0 0x7f57d80a3980 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 --2- 172.21.15.107:0/1276323085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57ec068290 0x7f57ec0ffd10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 >> 172.21.15.107:0/1276323085 conn(0x7f57ec074f70 msgr2=0x7f57ec107420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.173+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 shutdown_connections 2023-08-10T10:51:34.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.174+0000 7f57f299d700 1 -- 172.21.15.107:0/1276323085 wait complete. 2023-08-10T10:51:34.176 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2023-08-10T10:51:34.196 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-10T10:51:34.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.430+0000 7f282ef9d700 1 -- 172.21.15.107:0/637955133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28281087a0 msgr2=0x7f2828108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.430+0000 7f282ef9d700 1 --2- 172.21.15.107:0/637955133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28281087a0 0x7f2828108b80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2824009990 tx=0x7f2824009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.430+0000 7f282ef9d700 1 -- 172.21.15.107:0/637955133 shutdown_connections 2023-08-10T10:51:34.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.430+0000 7f282ef9d700 1 --2- 172.21.15.107:0/637955133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2828103150 0x7f282810f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.430+0000 7f282ef9d700 1 --2- 172.21.15.107:0/637955133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28281087a0 0x7f2828108b80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.430+0000 7f282ef9d700 1 --2- 172.21.15.107:0/637955133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2828102790 0x7f2828102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.430+0000 7f282ef9d700 1 -- 172.21.15.107:0/637955133 >> 172.21.15.107:0/637955133 conn(0x7f28280fe200 msgr2=0x7f2828100620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.430+0000 7f282ef9d700 1 -- 172.21.15.107:0/637955133 shutdown_connections 2023-08-10T10:51:34.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.430+0000 7f282ef9d700 1 -- 172.21.15.107:0/637955133 wait complete. 2023-08-10T10:51:34.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.431+0000 7f282ef9d700 1 Processor -- start 2023-08-10T10:51:34.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.431+0000 7f282ef9d700 1 -- start start 2023-08-10T10:51:34.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.431+0000 7f282ef9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2828102790 0x7f2828198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.431+0000 7f282ef9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2828103150 0x7f2828198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.431+0000 7f282ef9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28281087a0 0x7f282819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.431+0000 7f282ef9d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282819d630 con 0x7f2828103150 2023-08-10T10:51:34.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.431+0000 7f282ef9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282819d7a0 con 0x7f28281087a0 2023-08-10T10:51:34.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282ef9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282819d960 con 0x7f2828102790 2023-08-10T10:51:34.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282d79a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2828103150 0x7f2828198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282df9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2828102790 0x7f2828198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282d79a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2828103150 0x7f2828198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43948/0 (socket says 172.21.15.107:43948) 2023-08-10T10:51:34.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282d79a700 1 -- 172.21.15.107:0/735688538 learned_addr learned my addr 172.21.15.107:0/735688538 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282e79c700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28281087a0 0x7f282819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282d79a700 1 -- 172.21.15.107:0/735688538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2828102790 msgr2=0x7f2828198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282d79a700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2828102790 0x7f2828198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282d79a700 1 -- 172.21.15.107:0/735688538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28281087a0 msgr2=0x7f282819cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282d79a700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28281087a0 0x7f282819cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282d79a700 1 -- 172.21.15.107:0/735688538 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240095f0 con 0x7f2828103150 2023-08-10T10:51:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282e79c700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28281087a0 0x7f282819cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:34.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.432+0000 7f282df9b700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2828102790 0x7f2828198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:34.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.433+0000 7f282d79a700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2828103150 0x7f2828198b90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f281800d950 tx=0x7f281800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.433+0000 7f281effd700 1 -- 172.21.15.107:0/735688538 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800f890 con 0x7f2828103150 2023-08-10T10:51:34.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.433+0000 7f281effd700 1 -- 172.21.15.107:0/735688538 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f281800fe80 con 0x7f2828103150 2023-08-10T10:51:34.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.433+0000 7f281effd700 1 -- 172.21.15.107:0/735688538 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800e3b0 con 0x7f2828103150 2023-08-10T10:51:34.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.433+0000 7f282ef9d700 1 -- 172.21.15.107:0/735688538 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282819dc40 con 0x7f2828103150 2023-08-10T10:51:34.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.433+0000 7f282ef9d700 1 -- 172.21.15.107:0/735688538 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28281a5480 con 0x7f2828103150 2023-08-10T10:51:34.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.437+0000 7f281effd700 1 -- 172.21.15.107:0/735688538 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 24) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f2818010460 con 0x7f2828103150 2023-08-10T10:51:34.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.438+0000 7f281effd700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28140a1470 0x7f28140a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.438+0000 7f2843a8db80 1 Processor -- start 2023-08-10T10:51:34.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.438+0000 7f281effd700 1 -- 172.21.15.107:0/735688538 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f28180ccf80 con 0x7f2828103150 2023-08-10T10:51:34.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f2843a8db80 1 -- start start 2023-08-10T10:51:34.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f282df9b700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28140a1470 0x7f28140a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ad7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 0x5652a6adbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6adc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f2843a8db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6a52dc0 con 0x5652a6adc290 2023-08-10T10:51:34.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f2843a8db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6a2f590 con 0x5652a6ad74b0 2023-08-10T10:51:34.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f2843a8db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6a2ceb0 con 0x5652a6ad7dd0 2023-08-10T10:51:34.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f282df9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ad7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f282e79c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6adc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f282d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 0x5652a6adbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f282df9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ad7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38934/0 (socket says 172.21.15.107:38934) 2023-08-10T10:51:34.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.439+0000 7f282df9b700 1 -- 172.21.15.107:0/1428665065 learned_addr learned my addr 172.21.15.107:0/1428665065 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f282df9b700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28140a1470 0x7f28140a3930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2824006010 tx=0x7f282400b260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f282df9b700 1 -- 172.21.15.107:0/1428665065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 msgr2=0x5652a6adbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f282df9b700 1 --2- 172.21.15.107:0/1428665065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 0x5652a6adbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f282df9b700 1 -- 172.21.15.107:0/1428665065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 msgr2=0x5652a6adc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f282df9b700 1 --2- 172.21.15.107:0/1428665065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6adc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f282df9b700 1 -- 172.21.15.107:0/1428665065 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652a68a9630 con 0x5652a6ad74b0 2023-08-10T10:51:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f282df9b700 1 --2- 172.21.15.107:0/1428665065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ad7890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f282400beb0 tx=0x7f2824020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea770174ac28cbd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f2813fff700 1 -- 172.21.15.107:0/1428665065 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824004b90 con 0x5652a6ad74b0 2023-08-10T10:51:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f2813fff700 1 -- 172.21.15.107:0/1428665065 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f282401e040 con 0x5652a6ad74b0 2023-08-10T10:51:34.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.440+0000 7f2813fff700 1 -- 172.21.15.107:0/1428665065 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282400fd30 con 0x5652a6ad74b0 2023-08-10T10:51:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.441+0000 7f2843a8db80 1 -- 172.21.15.107:0/1428665065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 msgr2=0x5652a6ad7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.441+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1428665065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ad7890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f282400beb0 tx=0x7f2824020000 comp rx=0 tx=0).stop 2023-08-10T10:51:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.441+0000 7f2843a8db80 1 -- 172.21.15.107:0/1428665065 shutdown_connections 2023-08-10T10:51:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.441+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1428665065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ad7890 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.441+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1428665065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6adc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.441+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1428665065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 0x5652a6adbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.441+0000 7f2843a8db80 1 -- 172.21.15.107:0/1428665065 >> 172.21.15.107:0/1428665065 conn(0x5652a6a34cd0 msgr2=0x5652a6ad2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.441+0000 7f2843a8db80 1 -- 172.21.15.107:0/1428665065 shutdown_connections 2023-08-10T10:51:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.441+0000 7f2843a8db80 1 -- 172.21.15.107:0/1428665065 wait complete. 2023-08-10T10:51:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.442+0000 7f2843a8db80 1 -- start start 2023-08-10T10:51:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.442+0000 7f2843a8db80 1 Processor -- start 2023-08-10T10:51:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ae3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 0x5652a6ae0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6ae1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f2843a8db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6a287a0 con 0x5652a6adc290 2023-08-10T10:51:34.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f2843a8db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a69c7ac0 con 0x5652a6ad74b0 2023-08-10T10:51:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f2843a8db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a69c77c0 con 0x5652a6ad7dd0 2023-08-10T10:51:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f2843a8db80 10 client.0 _ll_register_callbacks cb 0x5652a69c5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f282e79c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6ae1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f282df9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ae3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f282d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 0x5652a6ae0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f282e79c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6ae1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43966/0 (socket says 172.21.15.107:43966) 2023-08-10T10:51:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.443+0000 7f282e79c700 1 -- 172.21.15.107:0/4230728508 learned_addr learned my addr 172.21.15.107:0/4230728508 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f282df9b700 1 -- 172.21.15.107:0/4230728508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 msgr2=0x5652a6ae0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f282df9b700 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 0x5652a6ae0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f282df9b700 1 -- 172.21.15.107:0/4230728508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 msgr2=0x5652a6ae1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f282df9b700 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6ae1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f282df9b700 1 -- 172.21.15.107:0/4230728508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282810ff60 con 0x5652a6ad74b0 2023-08-10T10:51:34.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f282d79a700 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 0x5652a6ae0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:34.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f282e79c700 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6ae1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:34.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f282df9b700 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ae3a80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f282400ffd0 tx=0x7f2824005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=586da1f52992d2c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f28117fa700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:51:34.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f28117fa700 1 -- 172.21.15.107:0/4230728508 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282403c070 con 0x5652a6ad74b0 2023-08-10T10:51:34.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f2843a8db80 1 -- 172.21.15.107:0/4230728508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652a6aca470 con 0x5652a6ad74b0 2023-08-10T10:51:34.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.444+0000 7f28117fa700 1 -- 172.21.15.107:0/4230728508 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f282400f770 con 0x5652a6ad74b0 2023-08-10T10:51:34.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f28117fa700 1 -- 172.21.15.107:0/4230728508 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f282400f930 con 0x5652a6ad74b0 2023-08-10T10:51:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f2843a8db80 10 client.25565 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f2843a8db80 1 -- 172.21.15.107:0/4230728508 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5652a6855de0 con 0x5652a6ad74b0 2023-08-10T10:51:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f28117fa700 1 -- 172.21.15.107:0/4230728508 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5652a6aca470 con 0x5652a6ad74b0 2023-08-10T10:51:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f28117fa700 1 -- 172.21.15.107:0/4230728508 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f282403f020 con 0x5652a6ad74b0 2023-08-10T10:51:34.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f2843a8db80 10 client.25565 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:34.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f2843a8db80 10 client.25565 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-08-10T10:51:34.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f2843a8db80 20 client.25565 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:34.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f2843a8db80 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5652a6af9700 0x5652a6afbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f2843a8db80 4 client.25565 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:34.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.445+0000 7f2843a8db80 1 -- 172.21.15.107:0/4230728508 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652a6aa69d0 con 0x5652a6af9700 2023-08-10T10:51:34.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.446+0000 7f282d79a700 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5652a6af9700 0x5652a6afbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.446+0000 7f28117fa700 10 client.25565 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:51:34.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.446+0000 7f282d79a700 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5652a6af9700 0x5652a6afbaf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a83252395ea1a931 server_cookie=2cabdc22db543c3d in_seq=0 out_seq=0 2023-08-10T10:51:34.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f28117fa700 1 -- 172.21.15.107:0/4230728508 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5652a6aa69d0 con 0x5652a6af9700 2023-08-10T10:51:34.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f28117fa700 10 client.25565 handle_command_reply: tid=0 2023-08-10T10:51:34.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 client.25565 shutdown 2023-08-10T10:51:34.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 -- 172.21.15.107:0/4230728508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 msgr2=0x5652a6ae3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ae3a80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f282400ffd0 tx=0x7f2824005700 comp rx=0 tx=0).stop 2023-08-10T10:51:34.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 -- 172.21.15.107:0/4230728508 shutdown_connections 2023-08-10T10:51:34.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5652a6af9700 0x5652a6afbaf0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6ae3a80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6adc290 0x5652a6ae1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 --2- 172.21.15.107:0/4230728508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6ad7dd0 0x5652a6ae0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 -- 172.21.15.107:0/4230728508 >> 172.21.15.107:0/4230728508 conn(0x5652a6a34cd0 msgr2=0x5652a6add740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f28117fa700 0 client.25565 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:51:34.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.447+0000 7f2843a8db80 1 -- 172.21.15.107:0/4230728508 shutdown_connections 2023-08-10T10:51:34.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.448+0000 7f2843a8db80 1 -- 172.21.15.107:0/4230728508 wait complete. 2023-08-10T10:51:34.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.448+0000 7f2843a8db80 20 client.25565 trim_cache size 0 max 16384 2023-08-10T10:51:34.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f2843a8db80 1 Processor -- start 2023-08-10T10:51:34.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f2843a8db80 1 -- start start 2023-08-10T10:51:34.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad74b0 0x5652a6af0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad7dd0 0x5652a6ae3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 0x5652a6ad2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f2843a8db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a68ab920 con 0x5652a6ad74b0 2023-08-10T10:51:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f2843a8db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6ae22e0 con 0x5652a6ad7dd0 2023-08-10T10:51:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f2843a8db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6ae1980 con 0x5652a6adc290 2023-08-10T10:51:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f282df9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad74b0 0x5652a6af0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f282df9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad74b0 0x5652a6af0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43974/0 (socket says 172.21.15.107:43974) 2023-08-10T10:51:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f282df9b700 1 -- 172.21.15.107:0/2304190644 learned_addr learned my addr 172.21.15.107:0/2304190644 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.463+0000 7f282d79a700 1 --2- 172.21.15.107:0/2304190644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad7dd0 0x5652a6ae3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f282e79c700 1 --2- 172.21.15.107:0/2304190644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 0x5652a6ad2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f282df9b700 1 -- 172.21.15.107:0/2304190644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 msgr2=0x5652a6ad2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f282df9b700 1 --2- 172.21.15.107:0/2304190644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 0x5652a6ad2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f282df9b700 1 -- 172.21.15.107:0/2304190644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad7dd0 msgr2=0x5652a6ae3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f282df9b700 1 --2- 172.21.15.107:0/2304190644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad7dd0 0x5652a6ae3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f282df9b700 1 -- 172.21.15.107:0/2304190644 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652a683ec60 con 0x5652a6ad74b0 2023-08-10T10:51:34.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f282df9b700 1 --2- 172.21.15.107:0/2304190644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad74b0 0x5652a6af0cd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2824005f50 tx=0x7f282400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae5cae7dd44d016 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f281cff9700 1 -- 172.21.15.107:0/2304190644 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282403c020 con 0x5652a6ad74b0 2023-08-10T10:51:34.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f281cff9700 1 -- 172.21.15.107:0/2304190644 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f282400fe00 con 0x5652a6ad74b0 2023-08-10T10:51:34.468 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.464+0000 7f281cff9700 1 -- 172.21.15.107:0/2304190644 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824024b80 con 0x5652a6ad74b0 2023-08-10T10:51:34.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 -- 172.21.15.107:0/2304190644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad74b0 msgr2=0x5652a6af0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 --2- 172.21.15.107:0/2304190644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad74b0 0x5652a6af0cd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2824005f50 tx=0x7f282400f460 comp rx=0 tx=0).stop 2023-08-10T10:51:34.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 -- 172.21.15.107:0/2304190644 shutdown_connections 2023-08-10T10:51:34.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 --2- 172.21.15.107:0/2304190644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 0x5652a6ad2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.472 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 --2- 172.21.15.107:0/2304190644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad74b0 0x5652a6af0cd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 --2- 172.21.15.107:0/2304190644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad7dd0 0x5652a6ae3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 -- 172.21.15.107:0/2304190644 >> 172.21.15.107:0/2304190644 conn(0x5652a6a34cd0 msgr2=0x5652a6ada380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 -- 172.21.15.107:0/2304190644 shutdown_connections 2023-08-10T10:51:34.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 -- 172.21.15.107:0/2304190644 wait complete. 2023-08-10T10:51:34.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.465+0000 7f2843a8db80 1 -- start start 2023-08-10T10:51:34.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f2843a8db80 1 Processor -- start 2023-08-10T10:51:34.473 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6b45a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad7dd0 0x5652a6b45fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f2843a8db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 0x5652a6aefd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f2843a8db80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6af0330 con 0x5652a6ad7dd0 2023-08-10T10:51:34.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f2843a8db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6af04a0 con 0x5652a6ad74b0 2023-08-10T10:51:34.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f2843a8db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652a6af0660 con 0x5652a6adc290 2023-08-10T10:51:34.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f2843a8db80 10 client.0 _ll_register_callbacks cb 0x5652a69c5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:34.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f282df9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6b45a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f282df9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6b45a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38950/0 (socket says 172.21.15.107:38950) 2023-08-10T10:51:34.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f282df9b700 1 -- 172.21.15.107:0/1175048769 learned_addr learned my addr 172.21.15.107:0/1175048769 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.466+0000 7f282d79a700 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad7dd0 0x5652a6b45fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f282e79c700 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 0x5652a6aefd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f282df9b700 1 -- 172.21.15.107:0/1175048769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 msgr2=0x5652a6aefd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f282df9b700 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 0x5652a6aefd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f282df9b700 1 -- 172.21.15.107:0/1175048769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad7dd0 msgr2=0x5652a6b45fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f282df9b700 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad7dd0 0x5652a6b45fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f282df9b700 1 -- 172.21.15.107:0/1175048769 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5652a6855de0 con 0x5652a6ad74b0 2023-08-10T10:51:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f282df9b700 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6b45a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2824011040 tx=0x7f2824024ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd05870af7e87ac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f28117fa700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:51:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f28117fa700 1 -- 172.21.15.107:0/1175048769 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282404f070 con 0x5652a6ad74b0 2023-08-10T10:51:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f2843a8db80 1 -- 172.21.15.107:0/1175048769 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f282401e040 con 0x5652a6ad74b0 2023-08-10T10:51:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.467+0000 7f28117fa700 1 -- 172.21.15.107:0/1175048769 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f282400f980 con 0x5652a6ad74b0 2023-08-10T10:51:34.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f28117fa700 1 -- 172.21.15.107:0/1175048769 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f282400fb40 con 0x5652a6ad74b0 2023-08-10T10:51:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f2843a8db80 10 client.25571 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f2843a8db80 1 -- 172.21.15.107:0/1175048769 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5652a687c250 con 0x5652a6ad74b0 2023-08-10T10:51:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f28117fa700 1 -- 172.21.15.107:0/1175048769 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f282401e040 con 0x5652a6ad74b0 2023-08-10T10:51:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f28117fa700 1 -- 172.21.15.107:0/1175048769 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2824052020 con 0x5652a6ad74b0 2023-08-10T10:51:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f2843a8db80 10 client.25571 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f2843a8db80 10 client.25571 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-08-10T10:51:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f2843a8db80 20 client.25571 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:34.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5652a6b4d3b0 0x5652a6b4f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f2843a8db80 4 client.25571 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:51:34.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.468+0000 7f2843a8db80 1 -- 172.21.15.107:0/1175048769 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5652a6a21780 con 0x5652a6b4d3b0 2023-08-10T10:51:34.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.469+0000 7f282d79a700 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5652a6b4d3b0 0x5652a6b4f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.469+0000 7f282d79a700 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5652a6b4d3b0 0x5652a6b4f7a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c26d15d505b7a67e server_cookie=1512c9a5b49e9341 in_seq=0 out_seq=0 2023-08-10T10:51:34.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.469+0000 7f28117fa700 10 client.25571 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:51:34.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f28117fa700 1 -- 172.21.15.107:0/1175048769 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5652a6a21780 con 0x5652a6b4d3b0 2023-08-10T10:51:34.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f28117fa700 10 client.25571 handle_command_reply: tid=0 2023-08-10T10:51:34.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 client.25571 shutdown 2023-08-10T10:51:34.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 -- 172.21.15.107:0/1175048769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 msgr2=0x5652a6b45a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6b45a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2824011040 tx=0x7f2824024ad0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 -- 172.21.15.107:0/1175048769 shutdown_connections 2023-08-10T10:51:34.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x5652a6b4d3b0 0x5652a6b4f7a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5652a6ad74b0 0x5652a6b45a70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5652a6adc290 0x5652a6aefd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f28117fa700 0 client.25571 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:51:34.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 --2- 172.21.15.107:0/1175048769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5652a6ad7dd0 0x5652a6b45fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 -- 172.21.15.107:0/1175048769 >> 172.21.15.107:0/1175048769 conn(0x5652a6a34cd0 msgr2=0x5652a6ad2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 -- 172.21.15.107:0/1175048769 shutdown_connections 2023-08-10T10:51:34.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 1 -- 172.21.15.107:0/1175048769 wait complete. 2023-08-10T10:51:34.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.470+0000 7f2843a8db80 20 client.25571 trim_cache size 0 max 16384 2023-08-10T10:51:34.480 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:51:34.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 -- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28140a1470 msgr2=0x7f28140a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28140a1470 0x7f28140a3930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2824006010 tx=0x7f282400b260 comp rx=0 tx=0).stop 2023-08-10T10:51:34.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 -- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2828103150 msgr2=0x7f2828198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2828103150 0x7f2828198b90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f281800d950 tx=0x7f281800dc60 comp rx=0 tx=0).stop 2023-08-10T10:51:34.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 -- 172.21.15.107:0/735688538 shutdown_connections 2023-08-10T10:51:34.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28140a1470 0x7f28140a3930 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28281087a0 0x7f282819cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2828102790 0x7f2828198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 --2- 172.21.15.107:0/735688538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2828103150 0x7f2828198b90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 -- 172.21.15.107:0/735688538 >> 172.21.15.107:0/735688538 conn(0x7f28280fe200 msgr2=0x7f28281062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 -- 172.21.15.107:0/735688538 shutdown_connections 2023-08-10T10:51:34.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.471+0000 7f282ef9d700 1 -- 172.21.15.107:0/735688538 wait complete. 2023-08-10T10:51:34.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-10T10:51:34.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.725+0000 7fcc84dff700 1 -- 172.21.15.107:0/3433390423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc801021a0 msgr2=0x7fcc8010a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.725+0000 7fcc84dff700 1 --2- 172.21.15.107:0/3433390423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc801021a0 0x7fcc8010a680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc740098f0 tx=0x7fcc74009c00 comp rx=0 tx=0).stop 2023-08-10T10:51:34.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.725+0000 7fcc84dff700 1 -- 172.21.15.107:0/3433390423 shutdown_connections 2023-08-10T10:51:34.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.725+0000 7fcc84dff700 1 --2- 172.21.15.107:0/3433390423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc8010aca0 0x7fcc8010d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.725+0000 7fcc84dff700 1 --2- 172.21.15.107:0/3433390423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc80101880 0x7fcc80101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.725+0000 7fcc84dff700 1 --2- 172.21.15.107:0/3433390423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc801021a0 0x7fcc8010a680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.725+0000 7fcc84dff700 1 -- 172.21.15.107:0/3433390423 >> 172.21.15.107:0/3433390423 conn(0x7fcc800fb0c0 msgr2=0x7fcc800fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.725+0000 7fcc84dff700 1 -- 172.21.15.107:0/3433390423 shutdown_connections 2023-08-10T10:51:34.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.725+0000 7fcc84dff700 1 -- 172.21.15.107:0/3433390423 wait complete. 2023-08-10T10:51:34.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.726+0000 7fcc84dff700 1 Processor -- start 2023-08-10T10:51:34.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.726+0000 7fcc84dff700 1 -- start start 2023-08-10T10:51:34.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc84dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc80101880 0x7fcc800ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc84dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc801021a0 0x7fcc800ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc84dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8010aca0 0x7fcc801a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc84dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80100240 con 0x7fcc801021a0 2023-08-10T10:51:34.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc84dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801a4ee0 con 0x7fcc80101880 2023-08-10T10:51:34.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc84dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801a5020 con 0x7fcc8010aca0 2023-08-10T10:51:34.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc801021a0 0x7fcc800ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc801021a0 0x7fcc800ffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43988/0 (socket says 172.21.15.107:43988) 2023-08-10T10:51:34.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/1048058259 learned_addr learned my addr 172.21.15.107:0/1048058259 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc80101880 0x7fcc800ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.727+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8010aca0 0x7fcc801a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/1048058259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8010aca0 msgr2=0x7fcc801a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc7dd9b700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8010aca0 0x7fcc801a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/1048058259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc80101880 msgr2=0x7fcc800ff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc7dd9b700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc80101880 0x7fcc800ff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/1048058259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74009520 con 0x7fcc801021a0 2023-08-10T10:51:34.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc7dd9b700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc801021a0 0x7fcc800ffa10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009810 tx=0x7fcc7400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc6f7fe700 1 -- 172.21.15.107:0/1048058259 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7401c070 con 0x7fcc801021a0 2023-08-10T10:51:34.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc84dff700 1 -- 172.21.15.107:0/1048058259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc801a5220 con 0x7fcc801021a0 2023-08-10T10:51:34.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc6f7fe700 1 -- 172.21.15.107:0/1048058259 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc7400baf0 con 0x7fcc801021a0 2023-08-10T10:51:34.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc6f7fe700 1 -- 172.21.15.107:0/1048058259 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74004930 con 0x7fcc801021a0 2023-08-10T10:51:34.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.728+0000 7fcc84dff700 1 -- 172.21.15.107:0/1048058259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc801a56a0 con 0x7fcc801021a0 2023-08-10T10:51:34.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.732+0000 7fcc6f7fe700 1 -- 172.21.15.107:0/1048058259 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 24) v1 ==== 135892+0+0 (secure 0 0 0) 0x7fcc74020070 con 0x7fcc801021a0 2023-08-10T10:51:34.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.733+0000 7fcc986a9b80 1 Processor -- start 2023-08-10T10:51:34.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc986a9b80 1 -- start start 2023-08-10T10:51:34.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f08330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f08870 0x561db4f022c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f02800 0x561db4f02c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4e7ddc0 con 0x561db4f07f50 2023-08-10T10:51:34.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4e5a590 con 0x561db4f08870 2023-08-10T10:51:34.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4e57eb0 con 0x561db4f02800 2023-08-10T10:51:34.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc6f7fe700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcc680a1350 0x7fcc680a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc7e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f08870 0x561db4f022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc6f7fe700 1 -- 172.21.15.107:0/1048058259 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fcc740cde60 con 0x7fcc801021a0 2023-08-10T10:51:34.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc7e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f08870 0x561db4f022c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38984/0 (socket says 172.21.15.107:38984) 2023-08-10T10:51:34.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7e59c700 1 -- 172.21.15.107:0/1201114291 learned_addr learned my addr 172.21.15.107:0/1201114291 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.734+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f08330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcc680a1350 0x7fcc680a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7e59c700 1 -- 172.21.15.107:0/1201114291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f02800 msgr2=0x561db4f02c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7dd9b700 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f02800 0x561db4f02c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f02800 0x561db4f02c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7e59c700 1 -- 172.21.15.107:0/1201114291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 msgr2=0x561db4f08330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f08330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7e59c700 1 -- 172.21.15.107:0/1201114291 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561db4cd4630 con 0x561db4f08870 2023-08-10T10:51:34.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7dd9b700 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f02800 0x561db4f02c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:34.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f08870 0x561db4f022c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000bd70 tx=0x7fcc700106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f52e17b0f57639cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.735+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcc680a1350 0x7fcc680a3810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x561db4f03520 tx=0x7fcc7800b040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.736+0000 7fcc6cff9700 1 -- 172.21.15.107:0/1201114291 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70010e10 con 0x561db4f08870 2023-08-10T10:51:34.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.736+0000 7fcc6cff9700 1 -- 172.21.15.107:0/1201114291 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc70015070 con 0x561db4f08870 2023-08-10T10:51:34.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.736+0000 7fcc6cff9700 1 -- 172.21.15.107:0/1201114291 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc700116a0 con 0x561db4f08870 2023-08-10T10:51:34.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.736+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1201114291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f08870 msgr2=0x561db4f022c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.736+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f08870 0x561db4f022c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000bd70 tx=0x7fcc700106b0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.737+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1201114291 shutdown_connections 2023-08-10T10:51:34.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.737+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f02800 0x561db4f02c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.737+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f08330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.737+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1201114291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f08870 0x561db4f022c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.737+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1201114291 >> 172.21.15.107:0/1201114291 conn(0x561db4e5fcd0 msgr2=0x561db4efd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.737+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1201114291 shutdown_connections 2023-08-10T10:51:34.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.737+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1201114291 wait complete. 2023-08-10T10:51:34.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.737+0000 7fcc986a9b80 1 -- start start 2023-08-10T10:51:34.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.737+0000 7fcc986a9b80 1 Processor -- start 2023-08-10T10:51:34.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f0e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f0bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4f0c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4e537a0 con 0x561db4f07f50 2023-08-10T10:51:34.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4df2ac0 con 0x561db4f02800 2023-08-10T10:51:34.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4df27c0 con 0x561db4f08870 2023-08-10T10:51:34.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc986a9b80 10 client.0 _ll_register_callbacks cb 0x561db4df0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:34.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f0bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f0bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44006/0 (socket says 172.21.15.107:44006) 2023-08-10T10:51:34.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/1217219150 learned_addr learned my addr 172.21.15.107:0/1217219150 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.738+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4f0c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.739+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f0e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.739+0000 7fcc7ed9d700 1 -- 172.21.15.107:0/1217219150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 msgr2=0x561db4f0e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.739+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f0e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.739+0000 7fcc7ed9d700 1 -- 172.21.15.107:0/1217219150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 msgr2=0x561db4f0bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.739+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f0bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.739+0000 7fcc7ed9d700 1 -- 172.21.15.107:0/1217219150 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7000b9a0 con 0x561db4f08870 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.739+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4f0c280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc78006250 tx=0x7fcc78004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8005a933e77279a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.739+0000 7fcc65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.740+0000 7fcc65ffb700 1 -- 172.21.15.107:0/1217219150 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78022070 con 0x561db4f08870 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.740+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1217219150 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561db4ef5470 con 0x561db4f08870 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.740+0000 7fcc65ffb700 1 -- 172.21.15.107:0/1217219150 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fcc78004bb0 con 0x561db4f08870 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.740+0000 7fcc65ffb700 1 -- 172.21.15.107:0/1217219150 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc7800e070 con 0x561db4f08870 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.740+0000 7fcc986a9b80 10 client.25603 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:34.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.740+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1217219150 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561db4c80de0 con 0x561db4f08870 2023-08-10T10:51:34.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.740+0000 7fcc65ffb700 1 -- 172.21.15.107:0/1217219150 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561db4ef5470 con 0x561db4f08870 2023-08-10T10:51:34.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.740+0000 7fcc65ffb700 1 -- 172.21.15.107:0/1217219150 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcc7801b450 con 0x561db4f08870 2023-08-10T10:51:34.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.741+0000 7fcc986a9b80 10 client.25603 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:34.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.741+0000 7fcc986a9b80 10 client.25603 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T10:51:34.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.741+0000 7fcc986a9b80 20 client.25603 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:34.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.741+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x561db4f1c290 0x561db4f1e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.741+0000 7fcc986a9b80 4 client.25603 mds_command: new command op to 24497 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:34.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.741+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1217219150 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561db4ed19d0 con 0x561db4f1c290 2023-08-10T10:51:34.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.741+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x561db4f1c290 0x561db4f1e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.742+0000 7fcc65ffb700 10 client.25603 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:51:34.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.742+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x561db4f1c290 0x561db4f1e6b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=62d1013a040cb65f server_cookie=4d4d3036d7fd6aca in_seq=0 out_seq=0 2023-08-10T10:51:34.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc65ffb700 1 -- 172.21.15.107:0/1217219150 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561db4ed19d0 con 0x561db4f1c290 2023-08-10T10:51:34.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc65ffb700 10 client.25603 handle_command_reply: tid=0 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 client.25603 shutdown 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1217219150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 msgr2=0x561db4f0c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4f0c280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc78006250 tx=0x7fcc78004ad0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1217219150 shutdown_connections 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x561db4f1c290 0x561db4f1e6b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f0e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4f0c280 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/1217219150 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f0bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1217219150 >> 172.21.15.107:0/1217219150 conn(0x561db4e5fcd0 msgr2=0x561db4efc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc65ffb700 0 client.25603 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1217219150 shutdown_connections 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.743+0000 7fcc986a9b80 1 -- 172.21.15.107:0/1217219150 wait complete. 2023-08-10T10:51:34.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.744+0000 7fcc986a9b80 20 client.25603 trim_cache size 0 max 16384 2023-08-10T10:51:34.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.759+0000 7fcc986a9b80 1 Processor -- start 2023-08-10T10:51:34.760 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc986a9b80 1 -- start start 2023-08-10T10:51:34.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f23010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f13360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4efd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4cd6920 con 0x561db4f07f50 2023-08-10T10:51:34.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4f138a0 con 0x561db4f02800 2023-08-10T10:51:34.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4ef7ab0 con 0x561db4f08870 2023-08-10T10:51:34.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f13360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc7e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f23010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f13360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44014/0 (socket says 172.21.15.107:44014) 2023-08-10T10:51:34.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/3711876576 learned_addr learned my addr 172.21.15.107:0/3711876576 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.760+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/3711876576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4efd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc7e59c700 1 -- 172.21.15.107:0/3711876576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 msgr2=0x561db4efd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/3711876576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4efd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc7e59c700 1 -- 172.21.15.107:0/3711876576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 msgr2=0x561db4f13360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/3711876576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f13360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc7e59c700 1 -- 172.21.15.107:0/3711876576 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561db4c69c60 con 0x561db4f02800 2023-08-10T10:51:34.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/3711876576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4efd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:34.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/3711876576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f23010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc70000c00 tx=0x7fcc7000b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=159e18fea67dcce4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc6d7fa700 1 -- 172.21.15.107:0/3711876576 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70020040 con 0x561db4f02800 2023-08-10T10:51:34.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc6d7fa700 1 -- 172.21.15.107:0/3711876576 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc70010ed0 con 0x561db4f02800 2023-08-10T10:51:34.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.761+0000 7fcc6d7fa700 1 -- 172.21.15.107:0/3711876576 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7001c6e0 con 0x561db4f02800 2023-08-10T10:51:34.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.762+0000 7fcc986a9b80 1 -- 172.21.15.107:0/3711876576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 msgr2=0x561db4f23010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.762+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/3711876576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f23010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc70000c00 tx=0x7fcc7000b430 comp rx=0 tx=0).stop 2023-08-10T10:51:34.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.762+0000 7fcc986a9b80 1 -- 172.21.15.107:0/3711876576 shutdown_connections 2023-08-10T10:51:34.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.762+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/3711876576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f23010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.762+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/3711876576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4efd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.762+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/3711876576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f13360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.762+0000 7fcc986a9b80 1 -- 172.21.15.107:0/3711876576 >> 172.21.15.107:0/3711876576 conn(0x561db4e5fcd0 msgr2=0x561db4f05c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.762+0000 7fcc986a9b80 1 -- 172.21.15.107:0/3711876576 shutdown_connections 2023-08-10T10:51:34.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.762+0000 7fcc986a9b80 1 -- 172.21.15.107:0/3711876576 wait complete. 2023-08-10T10:51:34.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.763+0000 7fcc986a9b80 1 -- start start 2023-08-10T10:51:34.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.763+0000 7fcc986a9b80 1 Processor -- start 2023-08-10T10:51:34.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f04a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f04fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc986a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4f03970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4f057b0 con 0x561db4f07f50 2023-08-10T10:51:34.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4f03eb0 con 0x561db4f02800 2023-08-10T10:51:34.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc986a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db4f04070 con 0x561db4f08870 2023-08-10T10:51:34.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc986a9b80 10 client.0 _ll_register_callbacks cb 0x561db4df0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:34.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f04fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f04fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44030/0 (socket says 172.21.15.107:44030) 2023-08-10T10:51:34.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/288311398 learned_addr learned my addr 172.21.15.107:0/288311398 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:34.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f04a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7ed9d700 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4f03970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/288311398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 msgr2=0x561db4f03970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7dd9b700 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4f03970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/288311398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 msgr2=0x561db4f04a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:34.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7dd9b700 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f04a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7dd9b700 1 -- 172.21.15.107:0/288311398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561db4cd4630 con 0x561db4f07f50 2023-08-10T10:51:34.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.764+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f04a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:34.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.765+0000 7fcc7dd9b700 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f04fa0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c010 tx=0x7fcc7409aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eba5650bc08c796 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:34.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.765+0000 7fcc65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:51:34.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.765+0000 7fcc65ffb700 1 -- 172.21.15.107:0/288311398 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc740acbb0 con 0x561db4f07f50 2023-08-10T10:51:34.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.765+0000 7fcc65ffb700 1 -- 172.21.15.107:0/288311398 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fcc7409ab50 con 0x561db4f07f50 2023-08-10T10:51:34.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.765+0000 7fcc986a9b80 1 -- 172.21.15.107:0/288311398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc70015070 con 0x561db4f07f50 2023-08-10T10:51:34.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.765+0000 7fcc65ffb700 1 -- 172.21.15.107:0/288311398 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc7409eb80 con 0x561db4f07f50 2023-08-10T10:51:34.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.765+0000 7fcc986a9b80 10 client.15882 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:34.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.765+0000 7fcc986a9b80 1 -- 172.21.15.107:0/288311398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561db4ca7250 con 0x561db4f07f50 2023-08-10T10:51:34.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.765+0000 7fcc65ffb700 1 -- 172.21.15.107:0/288311398 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc70015070 con 0x561db4f07f50 2023-08-10T10:51:34.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.766+0000 7fcc65ffb700 1 -- 172.21.15.107:0/288311398 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcc74005240 con 0x561db4f07f50 2023-08-10T10:51:34.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.766+0000 7fcc986a9b80 10 client.15882 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:34.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.766+0000 7fcc986a9b80 10 client.15882 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T10:51:34.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.766+0000 7fcc986a9b80 20 client.15882 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:34.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.766+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x561db4f709f0 0x561db4f72e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:34.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.766+0000 7fcc986a9b80 4 client.15882 mds_command: new command op to 24497 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:51:34.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.766+0000 7fcc986a9b80 1 -- 172.21.15.107:0/288311398 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561db4e4c780 con 0x561db4f709f0 2023-08-10T10:51:34.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.766+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x561db4f709f0 0x561db4f72e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:34.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc7e59c700 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x561db4f709f0 0x561db4f72e10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=43826b09c07a1917 server_cookie=f5fbfd328d6bd68d in_seq=0 out_seq=0 2023-08-10T10:51:34.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc65ffb700 10 client.15882 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:51:34.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc65ffb700 1 -- 172.21.15.107:0/288311398 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561db4e4c780 con 0x561db4f709f0 2023-08-10T10:51:34.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc65ffb700 10 client.15882 handle_command_reply: tid=0 2023-08-10T10:51:34.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 client.15882 shutdown 2023-08-10T10:51:34.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 -- 172.21.15.107:0/288311398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 msgr2=0x561db4f04fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f04fa0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c010 tx=0x7fcc7409aa10 comp rx=0 tx=0).stop 2023-08-10T10:51:34.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 -- 172.21.15.107:0/288311398 shutdown_connections 2023-08-10T10:51:34.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x561db4f709f0 0x561db4f72e10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561db4f02800 0x561db4f04a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561db4f08870 0x561db4f03970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 --2- 172.21.15.107:0/288311398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561db4f07f50 0x561db4f04fa0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 -- 172.21.15.107:0/288311398 >> 172.21.15.107:0/288311398 conn(0x561db4e5fcd0 msgr2=0x561db4f06ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc65ffb700 0 client.15882 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:51:34.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 -- 172.21.15.107:0/288311398 shutdown_connections 2023-08-10T10:51:34.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 1 -- 172.21.15.107:0/288311398 wait complete. 2023-08-10T10:51:34.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.767+0000 7fcc986a9b80 20 client.15882 trim_cache size 0 max 16384 2023-08-10T10:51:34.776 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:51:34.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 -- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcc680a1350 msgr2=0x7fcc680a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcc680a1350 0x7fcc680a3810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x561db4f03520 tx=0x7fcc7800b040 comp rx=0 tx=0).stop 2023-08-10T10:51:34.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 -- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc801021a0 msgr2=0x7fcc800ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:34.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc801021a0 0x7fcc800ffa10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009810 tx=0x7fcc7400fa00 comp rx=0 tx=0).stop 2023-08-10T10:51:34.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 -- 172.21.15.107:0/1048058259 shutdown_connections 2023-08-10T10:51:34.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcc680a1350 0x7fcc680a3810 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcc80101880 0x7fcc800ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc8010aca0 0x7fcc801a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 --2- 172.21.15.107:0/1048058259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc801021a0 0x7fcc800ffa10 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:34.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 -- 172.21.15.107:0/1048058259 >> 172.21.15.107:0/1048058259 conn(0x7fcc800fb0c0 msgr2=0x7fcc800fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:34.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 -- 172.21.15.107:0/1048058259 shutdown_connections 2023-08-10T10:51:34.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:34.768+0000 7fcc84dff700 1 -- 172.21.15.107:0/1048058259 wait complete. 2023-08-10T10:51:34.786 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:34 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1276323085' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:51:34.789 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-10T10:51:35.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.023+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/3601164929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 msgr2=0x7f1c64101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.023+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/3601164929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 0x7f1c64101c60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009990 tx=0x7f1c54009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.023+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/3601164929 shutdown_connections 2023-08-10T10:51:35.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.023+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/3601164929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c6410aca0 0x7f1c6410d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.023+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/3601164929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 0x7f1c64101c60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.023+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/3601164929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c641021a0 0x7f1c6410a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.023+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/3601164929 >> 172.21.15.107:0/3601164929 conn(0x7f1c640fb0c0 msgr2=0x7f1c640fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.023+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/3601164929 shutdown_connections 2023-08-10T10:51:35.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.023+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/3601164929 wait complete. 2023-08-10T10:51:35.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.024+0000 7f1c6a9ff700 1 Processor -- start 2023-08-10T10:51:35.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.024+0000 7f1c6a9ff700 1 -- start start 2023-08-10T10:51:35.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c6a9ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 0x7f1c6419c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c6a9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c641021a0 0x7f1c6419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c6a9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c6410aca0 0x7f1c641965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c6a9ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64196c40 con 0x7f1c64101880 2023-08-10T10:51:35.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c6a9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64196db0 con 0x7f1c6410aca0 2023-08-10T10:51:35.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c6a9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64196f70 con 0x7f1c641021a0 2023-08-10T10:51:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 0x7f1c6419c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 0x7f1c6419c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44042/0 (socket says 172.21.15.107:44042) 2023-08-10T10:51:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c63fff700 1 -- 172.21.15.107:0/2550529807 learned_addr learned my addr 172.21.15.107:0/2550529807 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c641021a0 0x7f1c6419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c68f9c700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c6410aca0 0x7f1c641965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c63fff700 1 -- 172.21.15.107:0/2550529807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c641021a0 msgr2=0x7f1c6419caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c641021a0 0x7f1c6419caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c63fff700 1 -- 172.21.15.107:0/2550529807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c6410aca0 msgr2=0x7f1c641965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c6410aca0 0x7f1c641965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c63fff700 1 -- 172.21.15.107:0/2550529807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c540095f0 con 0x7f1c64101880 2023-08-10T10:51:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c68f9c700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c6410aca0 0x7f1c641965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.025+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c641021a0 0x7f1c6419caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:35.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.026+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 0x7f1c6419c560 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1c54000c00 tx=0x7f1c54009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.026+0000 7f1c617fa700 1 -- 172.21.15.107:0/2550529807 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5401d070 con 0x7f1c64101880 2023-08-10T10:51:35.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.026+0000 7f1c617fa700 1 -- 172.21.15.107:0/2550529807 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c54022470 con 0x7f1c64101880 2023-08-10T10:51:35.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.026+0000 7f1c617fa700 1 -- 172.21.15.107:0/2550529807 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54017650 con 0x7f1c64101880 2023-08-10T10:51:35.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.026+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/2550529807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c641971f0 con 0x7f1c64101880 2023-08-10T10:51:35.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.027+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/2550529807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c641a3550 con 0x7f1c64101880 2023-08-10T10:51:35.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.030+0000 7f1c617fa700 1 -- 172.21.15.107:0/2550529807 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 24) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f1c5400fb00 con 0x7f1c64101880 2023-08-10T10:51:35.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c617fa700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1c4c0a14a0 0x7f1c4c0a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c7e3e3b80 1 Processor -- start 2023-08-10T10:51:35.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c7e3e3b80 1 -- start start 2023-08-10T10:51:35.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c617fa700 1 -- 172.21.15.107:0/2550529807 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f1c540ce5f0 con 0x7f1c64101880 2023-08-10T10:51:35.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1c4c0a14a0 0x7f1c4c0a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d8153e0 0x55d37d8157c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d815d00 0x55d37d80f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d80f820 0x55d37d80fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d786dc0 con 0x55d37d80f820 2023-08-10T10:51:35.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d763590 con 0x55d37d815d00 2023-08-10T10:51:35.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.032+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d760eb0 con 0x55d37d8153e0 2023-08-10T10:51:35.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c637fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d815d00 0x55d37d80f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c68f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d80f820 0x55d37d80fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c637fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d815d00 0x55d37d80f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39024/0 (socket says 172.21.15.107:39024) 2023-08-10T10:51:35.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c637fe700 1 -- 172.21.15.107:0/4113545240 learned_addr learned my addr 172.21.15.107:0/4113545240 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c63fff700 1 --2- 172.21.15.107:0/4113545240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d8153e0 0x55d37d8157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1c4c0a14a0 0x7f1c4c0a3960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c6410c3a0 tx=0x7f1c58009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c637fe700 1 -- 172.21.15.107:0/4113545240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d8153e0 msgr2=0x55d37d8157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c637fe700 1 --2- 172.21.15.107:0/4113545240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d8153e0 0x55d37d8157c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c637fe700 1 -- 172.21.15.107:0/4113545240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d80f820 msgr2=0x55d37d80fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c637fe700 1 --2- 172.21.15.107:0/4113545240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d80f820 0x55d37d80fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c637fe700 1 -- 172.21.15.107:0/4113545240 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d37d5dd630 con 0x55d37d815d00 2023-08-10T10:51:35.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.033+0000 7f1c68f9c700 1 --2- 172.21.15.107:0/4113545240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d80f820 0x55d37d80fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:35.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.034+0000 7f1c637fe700 1 --2- 172.21.15.107:0/4113545240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d815d00 0x55d37d80f2e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c58024480 tx=0x7f1c5801b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf67de199ab0a51b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.034+0000 7f1c4a7fc700 1 -- 172.21.15.107:0/4113545240 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5801b070 con 0x55d37d815d00 2023-08-10T10:51:35.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.034+0000 7f1c4a7fc700 1 -- 172.21.15.107:0/4113545240 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c5802d910 con 0x55d37d815d00 2023-08-10T10:51:35.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.034+0000 7f1c4a7fc700 1 -- 172.21.15.107:0/4113545240 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58016540 con 0x55d37d815d00 2023-08-10T10:51:35.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.035+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/4113545240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d815d00 msgr2=0x55d37d80f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.035+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/4113545240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d815d00 0x55d37d80f2e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c58024480 tx=0x7f1c5801b000 comp rx=0 tx=0).stop 2023-08-10T10:51:35.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.035+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/4113545240 shutdown_connections 2023-08-10T10:51:35.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.035+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/4113545240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d80f820 0x55d37d80fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.035+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/4113545240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d8153e0 0x55d37d8157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.035+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/4113545240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d815d00 0x55d37d80f2e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.035+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/4113545240 >> 172.21.15.107:0/4113545240 conn(0x55d37d768cd0 msgr2=0x55d37d8064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.035+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/4113545240 shutdown_connections 2023-08-10T10:51:35.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.035+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/4113545240 wait complete. 2023-08-10T10:51:35.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.036+0000 7f1c7e3e3b80 1 -- start start 2023-08-10T10:51:35.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.036+0000 7f1c7e3e3b80 1 Processor -- start 2023-08-10T10:51:35.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d80f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 0x55d37d80cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d75c7a0 con 0x55d37d8153e0 2023-08-10T10:51:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d6fbac0 con 0x55d37d80f820 2023-08-10T10:51:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d6fb7c0 con 0x55d37d815d00 2023-08-10T10:51:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c7e3e3b80 10 client.0 _ll_register_callbacks cb 0x55d37d6f9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d80f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c637fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d80f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39036/0 (socket says 172.21.15.107:39036) 2023-08-10T10:51:35.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c63fff700 1 -- 172.21.15.107:0/2983290103 learned_addr learned my addr 172.21.15.107:0/2983290103 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c68f9c700 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 0x55d37d80cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c637fe700 1 -- 172.21.15.107:0/2983290103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 msgr2=0x55d37d80cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 0x55d37d80cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c637fe700 1 -- 172.21.15.107:0/2983290103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 msgr2=0x55d37d80f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d80f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c637fe700 1 -- 172.21.15.107:0/2983290103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c009860 con 0x55d37d8153e0 2023-08-10T10:51:35.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.037+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d80f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:35.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.038+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80c4f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1c58015fd0 tx=0x7f1c5802dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550cc3081d7ed626 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.038+0000 7f1c437fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:51:35.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.038+0000 7f1c437fe700 1 -- 172.21.15.107:0/2983290103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58005540 con 0x55d37d8153e0 2023-08-10T10:51:35.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.038+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2983290103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d37d7fe470 con 0x55d37d8153e0 2023-08-10T10:51:35.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.038+0000 7f1c437fe700 1 -- 172.21.15.107:0/2983290103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f1c580036a0 con 0x55d37d8153e0 2023-08-10T10:51:35.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.038+0000 7f1c437fe700 1 -- 172.21.15.107:0/2983290103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c580056a0 con 0x55d37d8153e0 2023-08-10T10:51:35.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.038+0000 7f1c7e3e3b80 10 client.15894 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:35.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.038+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2983290103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f1c58015d00 con 0x55d37d8153e0 2023-08-10T10:51:35.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.039+0000 7f1c437fe700 1 -- 172.21.15.107:0/2983290103 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d37d7fe470 con 0x55d37d8153e0 2023-08-10T10:51:35.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.039+0000 7f1c437fe700 1 -- 172.21.15.107:0/2983290103 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1c58036930 con 0x55d37d8153e0 2023-08-10T10:51:35.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.039+0000 7f1c7e3e3b80 10 client.15894 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:35.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.039+0000 7f1c7e3e3b80 10 client.15894 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T10:51:35.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.039+0000 7f1c7e3e3b80 20 client.15894 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:35.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.039+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55d37d825020 0x55d37d827440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.039+0000 7f1c7e3e3b80 4 client.15894 mds_command: new command op to 24532 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:35.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.039+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2983290103 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d37d7da9d0 con 0x55d37d825020 2023-08-10T10:51:35.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.039+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55d37d825020 0x55d37d827440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.040+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55d37d825020 0x55d37d827440 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dbf9fb3e01d6cc0d server_cookie=3a113ece9c20d3b3 in_seq=0 out_seq=0 2023-08-10T10:51:35.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.040+0000 7f1c437fe700 10 client.15894 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:51:35.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c437fe700 1 -- 172.21.15.107:0/2983290103 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d37d7da9d0 con 0x55d37d825020 2023-08-10T10:51:35.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c437fe700 10 client.15894 handle_command_reply: tid=0 2023-08-10T10:51:35.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 client.15894 shutdown 2023-08-10T10:51:35.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2983290103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 msgr2=0x55d37d80c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80c4f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1c58015fd0 tx=0x7f1c5802dcb0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2983290103 shutdown_connections 2023-08-10T10:51:35.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55d37d825020 0x55d37d827440 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d80f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 0x55d37d80cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2983290103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80c4f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2983290103 >> 172.21.15.107:0/2983290103 conn(0x55d37d768cd0 msgr2=0x55d37d8059b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c437fe700 0 client.15894 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:51:35.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2983290103 shutdown_connections 2023-08-10T10:51:35.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.041+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2983290103 wait complete. 2023-08-10T10:51:35.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.042+0000 7f1c7e3e3b80 20 client.15894 trim_cache size 0 max 16384 2023-08-10T10:51:35.058 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:34 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1276323085' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:51:35.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.056+0000 7f1c7e3e3b80 1 Processor -- start 2023-08-10T10:51:35.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.056+0000 7f1c7e3e3b80 1 -- start start 2023-08-10T10:51:35.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d814c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 0x55d37d806130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d5df920 con 0x55d37d8153e0 2023-08-10T10:51:35.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d80fc00 con 0x55d37d80f820 2023-08-10T10:51:35.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d807540 con 0x55d37d815d00 2023-08-10T10:51:35.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c637fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c637fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44060/0 (socket says 172.21.15.107:44060) 2023-08-10T10:51:35.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c637fe700 1 -- 172.21.15.107:0/2677275164 learned_addr learned my addr 172.21.15.107:0/2677275164 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c68f9c700 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 0x55d37d806130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d814c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c637fe700 1 -- 172.21.15.107:0/2677275164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 msgr2=0x55d37d806130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 0x55d37d806130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c637fe700 1 -- 172.21.15.107:0/2677275164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 msgr2=0x55d37d814c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d814c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c637fe700 1 -- 172.21.15.107:0/2677275164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d37d589de0 con 0x55d37d8153e0 2023-08-10T10:51:35.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.057+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d814c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:35.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.058+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80ee10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1c58036e80 tx=0x7f1c5802db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a333a06a980592e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.058+0000 7f1c4affd700 1 -- 172.21.15.107:0/2677275164 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5801b030 con 0x55d37d8153e0 2023-08-10T10:51:35.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.058+0000 7f1c4affd700 1 -- 172.21.15.107:0/2677275164 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c58024a70 con 0x55d37d8153e0 2023-08-10T10:51:35.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.058+0000 7f1c4affd700 1 -- 172.21.15.107:0/2677275164 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58036910 con 0x55d37d8153e0 2023-08-10T10:51:35.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2677275164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 msgr2=0x55d37d80ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80ee10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1c58036e80 tx=0x7f1c5802db00 comp rx=0 tx=0).stop 2023-08-10T10:51:35.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2677275164 shutdown_connections 2023-08-10T10:51:35.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d80f820 0x55d37d814c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d815d00 0x55d37d806130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2677275164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d8153e0 0x55d37d80ee10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2677275164 >> 172.21.15.107:0/2677275164 conn(0x55d37d768cd0 msgr2=0x55d37d8144f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2677275164 shutdown_connections 2023-08-10T10:51:35.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2677275164 wait complete. 2023-08-10T10:51:35.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 -- start start 2023-08-10T10:51:35.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.059+0000 7f1c7e3e3b80 1 Processor -- start 2023-08-10T10:51:35.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d80f820 0x55d37d81a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d8153e0 0x55d37d81a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c7e3e3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d815d00 0x55d37d81ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d877cd0 con 0x55d37d815d00 2023-08-10T10:51:35.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d877e10 con 0x55d37d8153e0 2023-08-10T10:51:35.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c7e3e3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d37d877fa0 con 0x55d37d80f820 2023-08-10T10:51:35.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c7e3e3b80 10 client.0 _ll_register_callbacks cb 0x55d37d6f9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:35.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c68f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d815d00 0x55d37d81ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c68f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d815d00 0x55d37d81ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44062/0 (socket says 172.21.15.107:44062) 2023-08-10T10:51:35.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d80f820 0x55d37d81a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c68f9c700 1 -- 172.21.15.107:0/2835764856 learned_addr learned my addr 172.21.15.107:0/2835764856 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.060+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d8153e0 0x55d37d81a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c68f9c700 1 -- 172.21.15.107:0/2835764856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d80f820 msgr2=0x55d37d81a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c68f9c700 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d80f820 0x55d37d81a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c68f9c700 1 -- 172.21.15.107:0/2835764856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d8153e0 msgr2=0x55d37d81a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c68f9c700 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d8153e0 0x55d37d81a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c68f9c700 1 -- 172.21.15.107:0/2835764856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5803b040 con 0x55d37d815d00 2023-08-10T10:51:35.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c637fe700 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d8153e0 0x55d37d81a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:35.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c68f9c700 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d815d00 0x55d37d81ad80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c007c30 tx=0x7f1c5c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a462f84629bdc96 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c437fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:51:35.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c437fe700 1 -- 172.21.15.107:0/2835764856 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c003c10 con 0x55d37d815d00 2023-08-10T10:51:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2835764856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c5802d910 con 0x55d37d815d00 2023-08-10T10:51:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.061+0000 7f1c437fe700 1 -- 172.21.15.107:0/2835764856 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f1c5c003d70 con 0x55d37d815d00 2023-08-10T10:51:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c437fe700 1 -- 172.21.15.107:0/2835764856 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c5c004bb0 con 0x55d37d815d00 2023-08-10T10:51:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c7e3e3b80 10 client.15900 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2835764856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d37d572c60 con 0x55d37d815d00 2023-08-10T10:51:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c437fe700 1 -- 172.21.15.107:0/2835764856 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c5802d910 con 0x55d37d815d00 2023-08-10T10:51:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c437fe700 1 -- 172.21.15.107:0/2835764856 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1c5c0042c0 con 0x55d37d815d00 2023-08-10T10:51:35.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c7e3e3b80 10 client.15900 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c7e3e3b80 10 client.15900 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T10:51:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c7e3e3b80 20 client.15900 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55d37d879700 0x55d37d87bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c7e3e3b80 4 client.15900 mds_command: new command op to 24532 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:51:35.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.062+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2835764856 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d37d755780 con 0x55d37d879700 2023-08-10T10:51:35.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.063+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55d37d879700 0x55d37d87bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.063+0000 7f1c63fff700 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55d37d879700 0x55d37d87bb20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22ffd10305e79b11 server_cookie=a1624078ed66ff0f in_seq=0 out_seq=0 2023-08-10T10:51:35.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.063+0000 7f1c437fe700 10 client.15900 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:51:35.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.063+0000 7f1c437fe700 1 -- 172.21.15.107:0/2835764856 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d37d755780 con 0x55d37d879700 2023-08-10T10:51:35.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.063+0000 7f1c437fe700 10 client.15900 handle_command_reply: tid=0 2023-08-10T10:51:35.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.063+0000 7f1c7e3e3b80 1 client.15900 shutdown 2023-08-10T10:51:35.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.063+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2835764856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d815d00 msgr2=0x55d37d81ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.063+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d815d00 0x55d37d81ad80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c007c30 tx=0x7f1c5c007f40 comp rx=0 tx=0).stop 2023-08-10T10:51:35.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2835764856 shutdown_connections 2023-08-10T10:51:35.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55d37d879700 0x55d37d87bb20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d37d815d00 0x55d37d81ad80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d37d80f820 0x55d37d81a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c7e3e3b80 1 --2- 172.21.15.107:0/2835764856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d37d8153e0 0x55d37d81a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c437fe700 0 client.15900 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:51:35.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2835764856 >> 172.21.15.107:0/2835764856 conn(0x55d37d768cd0 msgr2=0x55d37d80aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2835764856 shutdown_connections 2023-08-10T10:51:35.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c7e3e3b80 1 -- 172.21.15.107:0/2835764856 wait complete. 2023-08-10T10:51:35.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.064+0000 7f1c7e3e3b80 20 client.15900 trim_cache size 0 max 16384 2023-08-10T10:51:35.076 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:51:35.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1c4c0a14a0 msgr2=0x7f1c4c0a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1c4c0a14a0 0x7f1c4c0a3960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c6410c3a0 tx=0x7f1c58009260 comp rx=0 tx=0).stop 2023-08-10T10:51:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 msgr2=0x7f1c6419c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 0x7f1c6419c560 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1c54000c00 tx=0x7f1c54009570 comp rx=0 tx=0).stop 2023-08-10T10:51:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/2550529807 shutdown_connections 2023-08-10T10:51:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1c4c0a14a0 0x7f1c4c0a3960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1c6410aca0 0x7f1c641965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1c64101880 0x7f1c6419c560 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 --2- 172.21.15.107:0/2550529807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c641021a0 0x7f1c6419caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/2550529807 >> 172.21.15.107:0/2550529807 conn(0x7f1c640fb0c0 msgr2=0x7f1c640fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/2550529807 shutdown_connections 2023-08-10T10:51:35.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.065+0000 7f1c6a9ff700 1 -- 172.21.15.107:0/2550529807 wait complete. 2023-08-10T10:51:35.086 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-10T10:51:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:34 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1276323085' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:51:35.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.333+0000 7f2251dff700 1 -- 172.21.15.107:0/2397686727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f224c106700 msgr2=0x7f224c106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.333+0000 7f2251dff700 1 --2- 172.21.15.107:0/2397686727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f224c106700 0x7f224c106ae0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2240009990 tx=0x7f2240009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.333+0000 7f2251dff700 1 -- 172.21.15.107:0/2397686727 shutdown_connections 2023-08-10T10:51:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.333+0000 7f2251dff700 1 --2- 172.21.15.107:0/2397686727 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f224c1010b0 0x7f224c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.333+0000 7f2251dff700 1 --2- 172.21.15.107:0/2397686727 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f224c106700 0x7f224c106ae0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.333+0000 7f2251dff700 1 --2- 172.21.15.107:0/2397686727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224c1006f0 0x7f224c100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.333+0000 7f2251dff700 1 -- 172.21.15.107:0/2397686727 >> 172.21.15.107:0/2397686727 conn(0x7f224c0fc1e0 msgr2=0x7f224c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.333+0000 7f2251dff700 1 -- 172.21.15.107:0/2397686727 shutdown_connections 2023-08-10T10:51:35.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.333+0000 7f2251dff700 1 -- 172.21.15.107:0/2397686727 wait complete. 2023-08-10T10:51:35.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.335+0000 7f2251dff700 1 Processor -- start 2023-08-10T10:51:35.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.335+0000 7f2251dff700 1 -- start start 2023-08-10T10:51:35.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f2251dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f224c1006f0 0x7f224c072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f2251dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224c1010b0 0x7f224c072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f2251dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f224c106700 0x7f224c1a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f2251dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0737e0 con 0x7f224c106700 2023-08-10T10:51:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f2251dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c1a4e00 con 0x7f224c1006f0 2023-08-10T10:51:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f2251dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c1a4f40 con 0x7f224c1010b0 2023-08-10T10:51:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f224c1006f0 0x7f224c072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f224c1006f0 0x7f224c072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39070/0 (socket says 172.21.15.107:39070) 2023-08-10T10:51:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224b7fe700 1 -- 172.21.15.107:0/3719672343 learned_addr learned my addr 172.21.15.107:0/3719672343 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224bfff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f224c106700 0x7f224c1a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224affd700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224c1010b0 0x7f224c072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224b7fe700 1 -- 172.21.15.107:0/3719672343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224c1010b0 msgr2=0x7f224c072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224b7fe700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224c1010b0 0x7f224c072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224b7fe700 1 -- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f224c106700 msgr2=0x7f224c1a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224b7fe700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f224c106700 0x7f224c1a48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224b7fe700 1 -- 172.21.15.107:0/3719672343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22400095f0 con 0x7f224c1006f0 2023-08-10T10:51:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.336+0000 7f224affd700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224c1010b0 0x7f224c072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.337+0000 7f224bfff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f224c106700 0x7f224c1a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:35.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.337+0000 7f224b7fe700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f224c1006f0 0x7f224c072a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2240000c00 tx=0x7f2240004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.337+0000 7f2248ff9700 1 -- 172.21.15.107:0/3719672343 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224001d070 con 0x7f224c1006f0 2023-08-10T10:51:35.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.337+0000 7f2251dff700 1 -- 172.21.15.107:0/3719672343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c1a5140 con 0x7f224c1006f0 2023-08-10T10:51:35.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.337+0000 7f2248ff9700 1 -- 172.21.15.107:0/3719672343 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2240022470 con 0x7f224c1006f0 2023-08-10T10:51:35.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.337+0000 7f2248ff9700 1 -- 172.21.15.107:0/3719672343 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240017650 con 0x7f224c1006f0 2023-08-10T10:51:35.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.337+0000 7f2251dff700 1 -- 172.21.15.107:0/3719672343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c1a5620 con 0x7f224c1006f0 2023-08-10T10:51:35.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.341+0000 7f2248ff9700 1 -- 172.21.15.107:0/3719672343 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 24) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f22400225e0 con 0x7f224c1006f0 2023-08-10T10:51:35.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.343+0000 7f22657b7b80 1 Processor -- start 2023-08-10T10:51:35.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.343+0000 7f2248ff9700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f22340a1350 0x7f22340a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.343+0000 7f2248ff9700 1 -- 172.21.15.107:0/3719672343 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f22400ce690 con 0x7f224c1006f0 2023-08-10T10:51:35.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.343+0000 7f22657b7b80 1 -- start start 2023-08-10T10:51:35.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.343+0000 7f224bfff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f22340a1350 0x7f22340a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.343+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bcf50 0x55a8435bd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.343+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435b7800 0x55a8435b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f22657b7b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a843532dc0 con 0x55a8435bd870 2023-08-10T10:51:35.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f22657b7b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84350f590 con 0x55a8435b7800 2023-08-10T10:51:35.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f22657b7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84350ceb0 con 0x55a8435bcf50 2023-08-10T10:51:35.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435b7800 0x55a8435b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44092/0 (socket says 172.21.15.107:44092) 2023-08-10T10:51:35.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224affd700 1 -- 172.21.15.107:0/1338110548 learned_addr learned my addr 172.21.15.107:0/1338110548 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224bfff700 1 --2- 172.21.15.107:0/1338110548 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435b7800 0x55a8435b7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39080/0 (socket says 172.21.15.107:39080) 2023-08-10T10:51:35.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224b7fe700 1 --2- 172.21.15.107:0/1338110548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bcf50 0x55a8435bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224affd700 1 -- 172.21.15.107:0/1338110548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bcf50 msgr2=0x55a8435bd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224affd700 1 --2- 172.21.15.107:0/1338110548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bcf50 0x55a8435bd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224affd700 1 -- 172.21.15.107:0/1338110548 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435b7800 msgr2=0x55a8435b7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224affd700 1 --2- 172.21.15.107:0/1338110548 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435b7800 0x55a8435b7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224affd700 1 -- 172.21.15.107:0/1338110548 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a843389630 con 0x55a8435bd870 2023-08-10T10:51:35.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.344+0000 7f224bfff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f22340a1350 0x7f22340a3810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f224c074b80 tx=0x7f22440045c0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.345+0000 7f224affd700 1 --2- 172.21.15.107:0/1338110548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b72c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f223c00bd60 tx=0x7f223c00f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5250f6a33c9cd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.345+0000 7f2231ffb700 1 -- 172.21.15.107:0/1338110548 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c00fda0 con 0x55a8435bd870 2023-08-10T10:51:35.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.345+0000 7f2231ffb700 1 -- 172.21.15.107:0/1338110548 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f223c0118d0 con 0x55a8435bd870 2023-08-10T10:51:35.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.345+0000 7f2231ffb700 1 -- 172.21.15.107:0/1338110548 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c010630 con 0x55a8435bd870 2023-08-10T10:51:35.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.346+0000 7f22657b7b80 1 -- 172.21.15.107:0/1338110548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 msgr2=0x55a8435b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.346+0000 7f22657b7b80 1 --2- 172.21.15.107:0/1338110548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b72c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f223c00bd60 tx=0x7f223c00f640 comp rx=0 tx=0).stop 2023-08-10T10:51:35.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.346+0000 7f22657b7b80 1 -- 172.21.15.107:0/1338110548 shutdown_connections 2023-08-10T10:51:35.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.346+0000 7f22657b7b80 1 --2- 172.21.15.107:0/1338110548 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435b7800 0x55a8435b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.346+0000 7f22657b7b80 1 --2- 172.21.15.107:0/1338110548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bcf50 0x55a8435bd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.346+0000 7f22657b7b80 1 --2- 172.21.15.107:0/1338110548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b72c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.346+0000 7f22657b7b80 1 -- 172.21.15.107:0/1338110548 >> 172.21.15.107:0/1338110548 conn(0x55a843514cd0 msgr2=0x55a8435b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.346+0000 7f22657b7b80 1 -- 172.21.15.107:0/1338110548 shutdown_connections 2023-08-10T10:51:35.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.346+0000 7f22657b7b80 1 -- 172.21.15.107:0/1338110548 wait complete. 2023-08-10T10:51:35.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.347+0000 7f22657b7b80 1 -- start start 2023-08-10T10:51:35.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.347+0000 7f22657b7b80 1 Processor -- start 2023-08-10T10:51:35.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.347+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 0x55a8435c3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.347+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bcf50 0x55a8435c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.347+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bd870 0x55a8435c1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.347+0000 7f22657b7b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8435087a0 con 0x55a8435bcf50 2023-08-10T10:51:35.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.347+0000 7f22657b7b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8434a7ac0 con 0x55a8435bd870 2023-08-10T10:51:35.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.347+0000 7f22657b7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8434a77c0 con 0x55a8435b7800 2023-08-10T10:51:35.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f22657b7b80 10 client.0 _ll_register_callbacks cb 0x55a8434a5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:35.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bcf50 0x55a8435c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 0x55a8435c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bd870 0x55a8435c1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bcf50 0x55a8435c0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44096/0 (socket says 172.21.15.107:44096) 2023-08-10T10:51:35.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 0x55a8435c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55770/0 (socket says 172.21.15.107:55770) 2023-08-10T10:51:35.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224affd700 1 -- 172.21.15.107:0/3145795590 learned_addr learned my addr 172.21.15.107:0/3145795590 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224bfff700 1 -- 172.21.15.107:0/3145795590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 msgr2=0x55a8435c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224bfff700 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 0x55a8435c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224bfff700 1 -- 172.21.15.107:0/3145795590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bcf50 msgr2=0x55a8435c0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224bfff700 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bcf50 0x55a8435c0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224bfff700 1 -- 172.21.15.107:0/3145795590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c00b9c0 con 0x55a8435bd870 2023-08-10T10:51:35.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.348+0000 7f224affd700 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bcf50 0x55a8435c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:35.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.349+0000 7f224bfff700 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bd870 0x55a8435c1150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2244009fd0 tx=0x7f2244004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5e5268636f66c17 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.349+0000 7f222affd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:51:35.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.349+0000 7f222affd700 1 -- 172.21.15.107:0/3145795590 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224400ee00 con 0x55a8435bd870 2023-08-10T10:51:35.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.349+0000 7f222affd700 1 -- 172.21.15.107:0/3145795590 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f224401acb0 con 0x55a8435bd870 2023-08-10T10:51:35.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.349+0000 7f22657b7b80 1 -- 172.21.15.107:0/3145795590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8435aa470 con 0x55a8435bd870 2023-08-10T10:51:35.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.349+0000 7f222affd700 1 -- 172.21.15.107:0/3145795590 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f224401ae70 con 0x55a8435bd870 2023-08-10T10:51:35.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.349+0000 7f22657b7b80 10 client.25613 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:35.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.349+0000 7f22657b7b80 1 -- 172.21.15.107:0/3145795590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a843335de0 con 0x55a8435bd870 2023-08-10T10:51:35.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.349+0000 7f222affd700 1 -- 172.21.15.107:0/3145795590 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a8435aa470 con 0x55a8435bd870 2023-08-10T10:51:35.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.350+0000 7f222affd700 1 -- 172.21.15.107:0/3145795590 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2244008b80 con 0x55a8435bd870 2023-08-10T10:51:35.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.350+0000 7f22657b7b80 10 client.25613 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:35.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.350+0000 7f22657b7b80 10 client.25613 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-10T10:51:35.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.350+0000 7f22657b7b80 20 client.25613 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.350+0000 7f22657b7b80 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55a8435d1310 0x55a8435d3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.350+0000 7f22657b7b80 4 client.25613 mds_command: new command op to 24571 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.350+0000 7f22657b7b80 1 -- 172.21.15.107:0/3145795590 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8435869d0 con 0x55a8435d1310 2023-08-10T10:51:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.350+0000 7f224b7fe700 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55a8435d1310 0x55a8435d3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.351+0000 7f224b7fe700 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55a8435d1310 0x55a8435d3730 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c551ec7675b258a5 server_cookie=f6e7ee758e14dddd in_seq=0 out_seq=0 2023-08-10T10:51:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.351+0000 7f222affd700 10 client.25613 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:51:35.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.351+0000 7f222affd700 1 -- 172.21.15.107:0/3145795590 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a8435869d0 con 0x55a8435d1310 2023-08-10T10:51:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.351+0000 7f222affd700 10 client.25613 handle_command_reply: tid=0 2023-08-10T10:51:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 client.25613 shutdown 2023-08-10T10:51:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 -- 172.21.15.107:0/3145795590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bd870 msgr2=0x55a8435c1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bd870 0x55a8435c1150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2244009fd0 tx=0x7f2244004b40 comp rx=0 tx=0).stop 2023-08-10T10:51:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 -- 172.21.15.107:0/3145795590 shutdown_connections 2023-08-10T10:51:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55a8435d1310 0x55a8435d3730 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bd870 0x55a8435c1150 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 0x55a8435c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 --2- 172.21.15.107:0/3145795590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bcf50 0x55a8435c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f222affd700 0 client.25613 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:51:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 -- 172.21.15.107:0/3145795590 >> 172.21.15.107:0/3145795590 conn(0x55a843514cd0 msgr2=0x55a8435b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 -- 172.21.15.107:0/3145795590 shutdown_connections 2023-08-10T10:51:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 1 -- 172.21.15.107:0/3145795590 wait complete. 2023-08-10T10:51:35.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.352+0000 7f22657b7b80 20 client.25613 trim_cache size 0 max 16384 2023-08-10T10:51:35.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.368+0000 7f22657b7b80 1 Processor -- start 2023-08-10T10:51:35.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.368+0000 7f22657b7b80 1 -- start start 2023-08-10T10:51:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 0x55a8435c8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a8435bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f22657b7b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84338b920 con 0x55a8435bd870 2023-08-10T10:51:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f22657b7b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8435aef80 con 0x55a8435bcf50 2023-08-10T10:51:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f22657b7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8435b3940 con 0x55a8435b7800 2023-08-10T10:51:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f224affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a8435bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f224affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a8435bc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39092/0 (socket says 172.21.15.107:39092) 2023-08-10T10:51:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f224affd700 1 -- 172.21.15.107:0/2736754845 learned_addr learned my addr 172.21.15.107:0/2736754845 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f224bfff700 1 --2- 172.21.15.107:0/2736754845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.369+0000 7f224b7fe700 1 --2- 172.21.15.107:0/2736754845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 0x55a8435c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.370+0000 7f224affd700 1 -- 172.21.15.107:0/2736754845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 msgr2=0x55a8435c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.370+0000 7f224affd700 1 --2- 172.21.15.107:0/2736754845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 0x55a8435c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.370+0000 7f224affd700 1 -- 172.21.15.107:0/2736754845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 msgr2=0x55a8435b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.370+0000 7f224affd700 1 --2- 172.21.15.107:0/2736754845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.370+0000 7f224affd700 1 -- 172.21.15.107:0/2736754845 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a84331ec60 con 0x55a8435bcf50 2023-08-10T10:51:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.370+0000 7f224affd700 1 --2- 172.21.15.107:0/2736754845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a8435bc2a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f223c00f990 tx=0x7f223c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a843910f36ce0d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.370+0000 7f22327fc700 1 -- 172.21.15.107:0/2736754845 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c00fda0 con 0x55a8435bcf50 2023-08-10T10:51:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.370+0000 7f22327fc700 1 -- 172.21.15.107:0/2736754845 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f223c021040 con 0x55a8435bcf50 2023-08-10T10:51:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.370+0000 7f22327fc700 1 -- 172.21.15.107:0/2736754845 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0052a0 con 0x55a8435bcf50 2023-08-10T10:51:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.371+0000 7f22657b7b80 1 -- 172.21.15.107:0/2736754845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 msgr2=0x55a8435bc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.371+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2736754845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a8435bc2a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f223c00f990 tx=0x7f223c00b910 comp rx=0 tx=0).stop 2023-08-10T10:51:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.371+0000 7f22657b7b80 1 -- 172.21.15.107:0/2736754845 shutdown_connections 2023-08-10T10:51:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.371+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2736754845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435bd870 0x55a8435b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.371+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2736754845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435b7800 0x55a8435c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.371+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2736754845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a8435bc2a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.371+0000 7f22657b7b80 1 -- 172.21.15.107:0/2736754845 >> 172.21.15.107:0/2736754845 conn(0x55a843514cd0 msgr2=0x55a8435bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.371+0000 7f22657b7b80 1 -- 172.21.15.107:0/2736754845 shutdown_connections 2023-08-10T10:51:35.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.371+0000 7f22657b7b80 1 -- 172.21.15.107:0/2736754845 wait complete. 2023-08-10T10:51:35.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.372+0000 7f22657b7b80 1 -- start start 2023-08-10T10:51:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.372+0000 7f22657b7b80 1 Processor -- start 2023-08-10T10:51:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435b7800 0x55a84361e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a84361ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f22657b7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bd870 0x55a843618f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f22657b7b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a843619530 con 0x55a8435b7800 2023-08-10T10:51:35.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f22657b7b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8436196a0 con 0x55a8435bcf50 2023-08-10T10:51:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f22657b7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a843619860 con 0x55a8435bd870 2023-08-10T10:51:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f22657b7b80 10 client.0 _ll_register_callbacks cb 0x55a8434a5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435b7800 0x55a84361e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435b7800 0x55a84361e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44108/0 (socket says 172.21.15.107:44108) 2023-08-10T10:51:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224b7fe700 1 -- 172.21.15.107:0/2390975386 learned_addr learned my addr 172.21.15.107:0/2390975386 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224affd700 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a84361ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224bfff700 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bd870 0x55a843618f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224b7fe700 1 -- 172.21.15.107:0/2390975386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bd870 msgr2=0x55a843618f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224b7fe700 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bd870 0x55a843618f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224b7fe700 1 -- 172.21.15.107:0/2390975386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 msgr2=0x55a84361ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224b7fe700 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a84361ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.373+0000 7f224b7fe700 1 -- 172.21.15.107:0/2390975386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a843389630 con 0x55a8435b7800 2023-08-10T10:51:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.374+0000 7f224b7fe700 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435b7800 0x55a84361e840 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2240097df0 tx=0x7f2240022ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b42d47d940e440a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.374+0000 7f222affd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:51:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.374+0000 7f222affd700 1 -- 172.21.15.107:0/2390975386 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224009b380 con 0x55a8435b7800 2023-08-10T10:51:35.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.374+0000 7f22657b7b80 1 -- 172.21.15.107:0/2390975386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f223c0118d0 con 0x55a8435b7800 2023-08-10T10:51:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.374+0000 7f222affd700 1 -- 172.21.15.107:0/2390975386 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f224009f3b0 con 0x55a8435b7800 2023-08-10T10:51:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.374+0000 7f222affd700 1 -- 172.21.15.107:0/2390975386 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22400a3740 con 0x55a8435b7800 2023-08-10T10:51:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.374+0000 7f22657b7b80 10 client.15918 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.374+0000 7f22657b7b80 1 -- 172.21.15.107:0/2390975386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a84335c250 con 0x55a8435b7800 2023-08-10T10:51:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.374+0000 7f222affd700 1 -- 172.21.15.107:0/2390975386 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f223c0118d0 con 0x55a8435b7800 2023-08-10T10:51:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.375+0000 7f222affd700 1 -- 172.21.15.107:0/2390975386 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f224009b5e0 con 0x55a8435b7800 2023-08-10T10:51:35.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.375+0000 7f22657b7b80 10 client.15918 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.375+0000 7f22657b7b80 10 client.15918 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-10T10:51:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.375+0000 7f22657b7b80 20 client.15918 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.375+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55a8436262b0 0x55a8436286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.375+0000 7f22657b7b80 4 client.15918 mds_command: new command op to 24571 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:51:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.375+0000 7f22657b7b80 1 -- 172.21.15.107:0/2390975386 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a843501780 con 0x55a8436262b0 2023-08-10T10:51:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.375+0000 7f224affd700 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55a8436262b0 0x55a8436286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.376+0000 7f224affd700 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55a8436262b0 0x55a8436286a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e7a11d62e69fe759 server_cookie=f3510a1a4d9c46e1 in_seq=0 out_seq=0 2023-08-10T10:51:35.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.376+0000 7f222affd700 10 client.15918 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:51:35.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.376+0000 7f222affd700 1 -- 172.21.15.107:0/2390975386 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a843501780 con 0x55a8436262b0 2023-08-10T10:51:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.376+0000 7f222affd700 10 client.15918 handle_command_reply: tid=0 2023-08-10T10:51:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.376+0000 7f22657b7b80 1 client.15918 shutdown 2023-08-10T10:51:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.376+0000 7f22657b7b80 1 -- 172.21.15.107:0/2390975386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435b7800 msgr2=0x55a84361e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.376+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435b7800 0x55a84361e840 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2240097df0 tx=0x7f2240022ab0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f22657b7b80 1 -- 172.21.15.107:0/2390975386 shutdown_connections 2023-08-10T10:51:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55a8436262b0 0x55a8436286a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8435bd870 0x55a843618f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8435b7800 0x55a84361e840 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f22657b7b80 1 --2- 172.21.15.107:0/2390975386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a8435bcf50 0x55a84361ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f222affd700 0 client.15918 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:51:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f22657b7b80 1 -- 172.21.15.107:0/2390975386 >> 172.21.15.107:0/2390975386 conn(0x55a843514cd0 msgr2=0x55a8435bc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f22657b7b80 1 -- 172.21.15.107:0/2390975386 shutdown_connections 2023-08-10T10:51:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f22657b7b80 1 -- 172.21.15.107:0/2390975386 wait complete. 2023-08-10T10:51:35.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.377+0000 7f22657b7b80 20 client.15918 trim_cache size 0 max 16384 2023-08-10T10:51:35.385 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:51:35.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 -- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f22340a1350 msgr2=0x7f22340a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f22340a1350 0x7f22340a3810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f224c074b80 tx=0x7f22440045c0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 -- 172.21.15.107:0/3719672343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f224c1006f0 msgr2=0x7f224c072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f224c1006f0 0x7f224c072a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2240000c00 tx=0x7f2240004730 comp rx=0 tx=0).stop 2023-08-10T10:51:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 -- 172.21.15.107:0/3719672343 shutdown_connections 2023-08-10T10:51:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f22340a1350 0x7f22340a3810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f224c1006f0 0x7f224c072a70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f224c106700 0x7f224c1a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 --2- 172.21.15.107:0/3719672343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f224c1010b0 0x7f224c072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 -- 172.21.15.107:0/3719672343 >> 172.21.15.107:0/3719672343 conn(0x7f224c0fc1e0 msgr2=0x7f224c104200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 -- 172.21.15.107:0/3719672343 shutdown_connections 2023-08-10T10:51:35.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.378+0000 7f2251dff700 1 -- 172.21.15.107:0/3719672343 wait complete. 2023-08-10T10:51:35.399 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-10T10:51:35.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.623+0000 7fb739fff700 1 -- 172.21.15.107:0/1926512350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734102910 msgr2=0x7fb734102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.623+0000 7fb739fff700 1 --2- 172.21.15.107:0/1926512350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734102910 0x7fb734102d90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb728009990 tx=0x7fb728009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.623+0000 7fb739fff700 1 -- 172.21.15.107:0/1926512350 shutdown_connections 2023-08-10T10:51:35.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.623+0000 7fb739fff700 1 --2- 172.21.15.107:0/1926512350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb734108920 0x7fb734108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.623+0000 7fb739fff700 1 --2- 172.21.15.107:0/1926512350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7341032d0 0x7fb73410f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.623+0000 7fb739fff700 1 --2- 172.21.15.107:0/1926512350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734102910 0x7fb734102d90 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.623+0000 7fb739fff700 1 -- 172.21.15.107:0/1926512350 >> 172.21.15.107:0/1926512350 conn(0x7fb7340fe3c0 msgr2=0x7fb7341007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.623+0000 7fb739fff700 1 -- 172.21.15.107:0/1926512350 shutdown_connections 2023-08-10T10:51:35.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.623+0000 7fb739fff700 1 -- 172.21.15.107:0/1926512350 wait complete. 2023-08-10T10:51:35.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.624+0000 7fb739fff700 1 Processor -- start 2023-08-10T10:51:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.624+0000 7fb739fff700 1 -- start start 2023-08-10T10:51:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb739fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb734102910 0x7fb73419e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb739fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7341032d0 0x7fb73419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb739fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734108920 0x7fb734198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb739fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb734198eb0 con 0x7fb734108920 2023-08-10T10:51:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb739fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb734199020 con 0x7fb734102910 2023-08-10T10:51:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb739fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7341991e0 con 0x7fb7341032d0 2023-08-10T10:51:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb733fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734108920 0x7fb734198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb732ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7341032d0 0x7fb73419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb733fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734108920 0x7fb734198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44130/0 (socket says 172.21.15.107:44130) 2023-08-10T10:51:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb733fff700 1 -- 172.21.15.107:0/3008256706 learned_addr learned my addr 172.21.15.107:0/3008256706 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.625+0000 7fb7337fe700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb734102910 0x7fb73419e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb733fff700 1 -- 172.21.15.107:0/3008256706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7341032d0 msgr2=0x7fb73419ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb733fff700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7341032d0 0x7fb73419ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb733fff700 1 -- 172.21.15.107:0/3008256706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb734102910 msgr2=0x7fb73419e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb733fff700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb734102910 0x7fb73419e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb733fff700 1 -- 172.21.15.107:0/3008256706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280095f0 con 0x7fb734108920 2023-08-10T10:51:35.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb7337fe700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb734102910 0x7fb73419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:35.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb733fff700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734108920 0x7fb734198840 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00ef30 tx=0x7fb72c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb730ff9700 1 -- 172.21.15.107:0/3008256706 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c018070 con 0x7fb734108920 2023-08-10T10:51:35.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb730ff9700 1 -- 172.21.15.107:0/3008256706 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb72c00f040 con 0x7fb734108920 2023-08-10T10:51:35.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb739fff700 1 -- 172.21.15.107:0/3008256706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb734199460 con 0x7fb734108920 2023-08-10T10:51:35.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb730ff9700 1 -- 172.21.15.107:0/3008256706 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00cbc0 con 0x7fb734108920 2023-08-10T10:51:35.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.626+0000 7fb739fff700 1 -- 172.21.15.107:0/3008256706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7341a57c0 con 0x7fb734108920 2023-08-10T10:51:35.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.630+0000 7fb730ff9700 1 -- 172.21.15.107:0/3008256706 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 24) v1 ==== 135892+0+0 (secure 0 0 0) 0x7fb72c007500 con 0x7fb734108920 2023-08-10T10:51:35.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb74d8c0b80 1 Processor -- start 2023-08-10T10:51:35.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb74d8c0b80 1 -- start start 2023-08-10T10:51:35.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb730ff9700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb71c0a13d0 0x7fb71c0a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e55f50 0x5607a8e56330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 0x5607a8e502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e50c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8dcbdc0 con 0x5607a8e50800 2023-08-10T10:51:35.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8da8590 con 0x5607a8e55f50 2023-08-10T10:51:35.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8da5eb0 con 0x5607a8e56870 2023-08-10T10:51:35.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.631+0000 7fb730ff9700 1 -- 172.21.15.107:0/3008256706 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fb72c0ccc20 con 0x7fb734108920 2023-08-10T10:51:35.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb732ffd700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb71c0a13d0 0x7fb71c0a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e55f50 0x5607a8e56330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e55f50 0x5607a8e56330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39128/0 (socket says 172.21.15.107:39128) 2023-08-10T10:51:35.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb7337fe700 1 -- 172.21.15.107:0/311320411 learned_addr learned my addr 172.21.15.107:0/311320411 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb733fff700 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e50c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb732ffd700 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 0x5607a8e502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb7337fe700 1 -- 172.21.15.107:0/311320411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 msgr2=0x5607a8e502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb7337fe700 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 0x5607a8e502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb7337fe700 1 -- 172.21.15.107:0/311320411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 msgr2=0x5607a8e50c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb7337fe700 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e50c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb7337fe700 1 -- 172.21.15.107:0/311320411 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607a8c22630 con 0x5607a8e55f50 2023-08-10T10:51:35.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.632+0000 7fb732ffd700 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 0x5607a8e502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:51:35.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.633+0000 7fb7337fe700 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e55f50 0x5607a8e56330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb7240115f0 tx=0x7fb724011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=132685453f556be3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.633+0000 7fb732ffd700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb71c0a13d0 0x7fb71c0a3890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb734100d30 tx=0x7fb728005bc0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.633+0000 7fb719ffb700 1 -- 172.21.15.107:0/311320411 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724019630 con 0x5607a8e55f50 2023-08-10T10:51:35.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.633+0000 7fb719ffb700 1 -- 172.21.15.107:0/311320411 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb724019c20 con 0x5607a8e55f50 2023-08-10T10:51:35.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.633+0000 7fb719ffb700 1 -- 172.21.15.107:0/311320411 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72400eae0 con 0x5607a8e55f50 2023-08-10T10:51:35.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/311320411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e55f50 msgr2=0x5607a8e56330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e55f50 0x5607a8e56330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb7240115f0 tx=0x7fb724011900 comp rx=0 tx=0).stop 2023-08-10T10:51:35.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/311320411 shutdown_connections 2023-08-10T10:51:35.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e55f50 0x5607a8e56330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e50c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/311320411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 0x5607a8e502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/311320411 >> 172.21.15.107:0/311320411 conn(0x5607a8dadcd0 msgr2=0x5607a8e4b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/311320411 shutdown_connections 2023-08-10T10:51:35.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/311320411 wait complete. 2023-08-10T10:51:35.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.634+0000 7fb74d8c0b80 1 -- start start 2023-08-10T10:51:35.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.635+0000 7fb74d8c0b80 1 Processor -- start 2023-08-10T10:51:35.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 0x5607a8e59bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e56870 0x5607a8e5a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8da17a0 con 0x5607a8e56870 2023-08-10T10:51:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8d40ac0 con 0x5607a8e50800 2023-08-10T10:51:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8d407c0 con 0x5607a8e55f50 2023-08-10T10:51:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb74d8c0b80 10 client.0 _ll_register_callbacks cb 0x5607a8d3e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb733fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e56870 0x5607a8e5a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39140/0 (socket says 172.21.15.107:39140) 2023-08-10T10:51:35.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb7337fe700 1 -- 172.21.15.107:0/4039568475 learned_addr learned my addr 172.21.15.107:0/4039568475 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb732ffd700 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 0x5607a8e59bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb7337fe700 1 -- 172.21.15.107:0/4039568475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 msgr2=0x5607a8e59bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb7337fe700 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 0x5607a8e59bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb7337fe700 1 -- 172.21.15.107:0/4039568475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e56870 msgr2=0x5607a8e5a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb7337fe700 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e56870 0x5607a8e5a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.636+0000 7fb7337fe700 1 -- 172.21.15.107:0/4039568475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb724009d50 con 0x5607a8e50800 2023-08-10T10:51:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.637+0000 7fb7337fe700 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5c9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb724000c00 tx=0x7fb724019a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf6b2e5a4db71ae9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.637+0000 7fb712ffd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:51:35.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.637+0000 7fb712ffd700 1 -- 172.21.15.107:0/4039568475 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724004440 con 0x5607a8e50800 2023-08-10T10:51:35.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.637+0000 7fb712ffd700 1 -- 172.21.15.107:0/4039568475 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fb724005040 con 0x5607a8e50800 2023-08-10T10:51:35.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.637+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/4039568475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607a8e43470 con 0x5607a8e50800 2023-08-10T10:51:35.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb712ffd700 1 -- 172.21.15.107:0/4039568475 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7240045a0 con 0x5607a8e50800 2023-08-10T10:51:35.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb74d8c0b80 10 client.25631 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:35.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/4039568475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5607a8bcede0 con 0x5607a8e50800 2023-08-10T10:51:35.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb712ffd700 1 -- 172.21.15.107:0/4039568475 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5607a8e43470 con 0x5607a8e50800 2023-08-10T10:51:35.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb712ffd700 1 -- 172.21.15.107:0/4039568475 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb724003680 con 0x5607a8e50800 2023-08-10T10:51:35.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb74d8c0b80 10 client.25631 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:35.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb74d8c0b80 10 client.25631 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:35.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb74d8c0b80 20 client.25631 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:35.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5607a8e6a1a0 0x5607a8e6c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb74d8c0b80 4 client.25631 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:35.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/4039568475 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607a8e1f9d0 con 0x5607a8e6a1a0 2023-08-10T10:51:35.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.638+0000 7fb732ffd700 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5607a8e6a1a0 0x5607a8e6c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.639+0000 7fb712ffd700 10 client.25631 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:35.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.639+0000 7fb732ffd700 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5607a8e6a1a0 0x5607a8e6c5c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=249e218080db1981 server_cookie=bafa70e2b42b979a in_seq=0 out_seq=0 2023-08-10T10:51:35.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb712ffd700 1 -- 172.21.15.107:0/4039568475 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5607a8e1f9d0 con 0x5607a8e6a1a0 2023-08-10T10:51:35.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb712ffd700 10 client.25631 handle_command_reply: tid=0 2023-08-10T10:51:35.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 client.25631 shutdown 2023-08-10T10:51:35.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/4039568475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 msgr2=0x5607a8e5c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5c9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb724000c00 tx=0x7fb724019a90 comp rx=0 tx=0).stop 2023-08-10T10:51:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/4039568475 shutdown_connections 2023-08-10T10:51:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5607a8e6a1a0 0x5607a8e6c5c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5c9b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e56870 0x5607a8e5a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/4039568475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 0x5607a8e59bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/4039568475 >> 172.21.15.107:0/4039568475 conn(0x5607a8dadcd0 msgr2=0x5607a8e4a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb712ffd700 0 client.25631 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/4039568475 shutdown_connections 2023-08-10T10:51:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.640+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/4039568475 wait complete. 2023-08-10T10:51:35.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.641+0000 7fb74d8c0b80 20 client.25631 trim_cache size 0 max 16384 2023-08-10T10:51:35.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.654+0000 7fb74d8c0b80 1 Processor -- start 2023-08-10T10:51:35.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb74d8c0b80 1 -- start start 2023-08-10T10:51:35.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e59b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 0x5607a8e70ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e56870 0x5607a8e4b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8c24920 con 0x5607a8e50800 2023-08-10T10:51:35.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8e4c3e0 con 0x5607a8e56870 2023-08-10T10:51:35.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8e47f80 con 0x5607a8e55f50 2023-08-10T10:51:35.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e59b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e59b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44166/0 (socket says 172.21.15.107:44166) 2023-08-10T10:51:35.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb7337fe700 1 -- 172.21.15.107:0/2501255073 learned_addr learned my addr 172.21.15.107:0/2501255073 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb732ffd700 1 --2- 172.21.15.107:0/2501255073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 0x5607a8e70ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.655+0000 7fb733fff700 1 --2- 172.21.15.107:0/2501255073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e56870 0x5607a8e4b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.656+0000 7fb7337fe700 1 -- 172.21.15.107:0/2501255073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 msgr2=0x5607a8e70ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.656+0000 7fb7337fe700 1 --2- 172.21.15.107:0/2501255073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 0x5607a8e70ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.656+0000 7fb7337fe700 1 -- 172.21.15.107:0/2501255073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e56870 msgr2=0x5607a8e4b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.656+0000 7fb7337fe700 1 --2- 172.21.15.107:0/2501255073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e56870 0x5607a8e4b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.656+0000 7fb7337fe700 1 -- 172.21.15.107:0/2501255073 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607a8bb7c60 con 0x5607a8e50800 2023-08-10T10:51:35.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.656+0000 7fb7337fe700 1 --2- 172.21.15.107:0/2501255073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e59b70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb724011c50 tx=0x7fb724005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e11b49ae0ad5a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.656+0000 7fb71a7fc700 1 -- 172.21.15.107:0/2501255073 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724005d50 con 0x5607a8e50800 2023-08-10T10:51:35.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.656+0000 7fb71a7fc700 1 -- 172.21.15.107:0/2501255073 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb724003880 con 0x5607a8e50800 2023-08-10T10:51:35.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.656+0000 7fb71a7fc700 1 -- 172.21.15.107:0/2501255073 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724005040 con 0x5607a8e50800 2023-08-10T10:51:35.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.657+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2501255073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 msgr2=0x5607a8e59b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.657+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2501255073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e59b70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb724011c50 tx=0x7fb724005a40 comp rx=0 tx=0).stop 2023-08-10T10:51:35.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.657+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2501255073 shutdown_connections 2023-08-10T10:51:35.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.657+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2501255073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e56870 0x5607a8e4b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.657+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2501255073 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e50800 0x5607a8e59b70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.657+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2501255073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e55f50 0x5607a8e70ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.657+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2501255073 >> 172.21.15.107:0/2501255073 conn(0x5607a8dadcd0 msgr2=0x5607a8e59460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.657+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2501255073 shutdown_connections 2023-08-10T10:51:35.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.657+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2501255073 wait complete. 2023-08-10T10:51:35.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.658+0000 7fb74d8c0b80 1 -- start start 2023-08-10T10:51:35.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.658+0000 7fb74d8c0b80 1 Processor -- start 2023-08-10T10:51:35.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.658+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.658+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e55f50 0x5607a8e5f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.658+0000 7fb74d8c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 0x5607a8ebce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.658+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8e60180 con 0x5607a8e55f50 2023-08-10T10:51:35.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.658+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8ebd350 con 0x5607a8e50800 2023-08-10T10:51:35.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.658+0000 7fb74d8c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607a8ebd490 con 0x5607a8e56870 2023-08-10T10:51:35.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.658+0000 7fb74d8c0b80 10 client.0 _ll_register_callbacks cb 0x5607a8d3e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:35.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb732ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e55f50 0x5607a8e5f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb7337fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39154/0 (socket says 172.21.15.107:39154) 2023-08-10T10:51:35.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb7337fe700 1 -- 172.21.15.107:0/2178553045 learned_addr learned my addr 172.21.15.107:0/2178553045 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:35.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb733fff700 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 0x5607a8ebce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb7337fe700 1 -- 172.21.15.107:0/2178553045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 msgr2=0x5607a8ebce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb7337fe700 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 0x5607a8ebce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb7337fe700 1 -- 172.21.15.107:0/2178553045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e55f50 msgr2=0x5607a8e5f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:35.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb7337fe700 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e55f50 0x5607a8e5f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb7337fe700 1 -- 172.21.15.107:0/2178553045 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607a8bcede0 con 0x5607a8e50800 2023-08-10T10:51:35.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.659+0000 7fb732ffd700 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e55f50 0x5607a8e5f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:35.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.660+0000 7fb7337fe700 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5f350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb724011510 tx=0x7fb724003d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be735d32960cda4a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:35.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.660+0000 7fb712ffd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:51:35.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.660+0000 7fb712ffd700 1 -- 172.21.15.107:0/2178553045 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724021d00 con 0x5607a8e50800 2023-08-10T10:51:35.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.660+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2178553045 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb724019c20 con 0x5607a8e50800 2023-08-10T10:51:35.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.660+0000 7fb712ffd700 1 -- 172.21.15.107:0/2178553045 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fb724000e40 con 0x5607a8e50800 2023-08-10T10:51:35.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.660+0000 7fb712ffd700 1 -- 172.21.15.107:0/2178553045 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb724021e60 con 0x5607a8e50800 2023-08-10T10:51:35.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.660+0000 7fb74d8c0b80 10 client.25637 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:35.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.660+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2178553045 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5607a8bf5250 con 0x5607a8e50800 2023-08-10T10:51:35.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.660+0000 7fb712ffd700 1 -- 172.21.15.107:0/2178553045 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb724019c20 con 0x5607a8e50800 2023-08-10T10:51:35.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.661+0000 7fb712ffd700 1 -- 172.21.15.107:0/2178553045 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb7240374d0 con 0x5607a8e50800 2023-08-10T10:51:35.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.661+0000 7fb74d8c0b80 10 client.25637 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:35.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.661+0000 7fb74d8c0b80 10 client.25637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:35.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.661+0000 7fb74d8c0b80 20 client.25637 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:35.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.661+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5607a8ebe650 0x5607a8ec0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:35.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.661+0000 7fb74d8c0b80 4 client.25637 mds_command: new command op to 24575 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:51:35.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.661+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2178553045 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5607a8d9a780 con 0x5607a8ebe650 2023-08-10T10:51:35.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.661+0000 7fb732ffd700 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5607a8ebe650 0x5607a8ec0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:35.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb732ffd700 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5607a8ebe650 0x5607a8ec0a40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a74c88be861f942 server_cookie=e48e0b0140b46ddd in_seq=0 out_seq=0 2023-08-10T10:51:35.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb712ffd700 10 client.25637 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:35.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb712ffd700 1 -- 172.21.15.107:0/2178553045 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5607a8d9a780 con 0x5607a8ebe650 2023-08-10T10:51:35.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb712ffd700 10 client.25637 handle_command_reply: tid=0 2023-08-10T10:51:35.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 client.25637 shutdown 2023-08-10T10:51:35.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2178553045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 msgr2=0x5607a8e5f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5f350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb724011510 tx=0x7fb724003d50 comp rx=0 tx=0).stop 2023-08-10T10:51:35.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2178553045 shutdown_connections 2023-08-10T10:51:35.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5607a8ebe650 0x5607a8ec0a40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5607a8e50800 0x5607a8e5f350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607a8e56870 0x5607a8ebce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 --2- 172.21.15.107:0/2178553045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5607a8e55f50 0x5607a8e5f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb712ffd700 0 client.25637 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:35.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2178553045 >> 172.21.15.107:0/2178553045 conn(0x5607a8dadcd0 msgr2=0x5607a8e554c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2178553045 shutdown_connections 2023-08-10T10:51:35.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.662+0000 7fb74d8c0b80 1 -- 172.21.15.107:0/2178553045 wait complete. 2023-08-10T10:51:35.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb74d8c0b80 20 client.25637 trim_cache size 0 max 16384 2023-08-10T10:51:35.674 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:51:35.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 -- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb71c0a13d0 msgr2=0x7fb71c0a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb71c0a13d0 0x7fb71c0a3890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb734100d30 tx=0x7fb728005bc0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 -- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734108920 msgr2=0x7fb734198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:35.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734108920 0x7fb734198840 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00ef30 tx=0x7fb72c00c3a0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 -- 172.21.15.107:0/3008256706 shutdown_connections 2023-08-10T10:51:35.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb71c0a13d0 0x7fb71c0a3890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb734102910 0x7fb73419e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb734108920 0x7fb734198840 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 --2- 172.21.15.107:0/3008256706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7341032d0 0x7fb73419ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:35.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.663+0000 7fb739fff700 1 -- 172.21.15.107:0/3008256706 >> 172.21.15.107:0/3008256706 conn(0x7fb7340fe3c0 msgr2=0x7fb7340fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:35.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.664+0000 7fb739fff700 1 -- 172.21.15.107:0/3008256706 shutdown_connections 2023-08-10T10:51:35.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:35.664+0000 7fb739fff700 1 -- 172.21.15.107:0/3008256706 wait complete. 2023-08-10T10:51:36.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:35 smithi157 ceph-mon[129604]: pgmap v14: 129 pgs: 129 active+clean; 43 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 4.7 MiB/s wr, 118 op/s 2023-08-10T10:51:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:35 smithi107 ceph-mon[127953]: pgmap v14: 129 pgs: 129 active+clean; 43 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 4.7 MiB/s wr, 118 op/s 2023-08-10T10:51:36.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:35 smithi195 ceph-mon[129938]: pgmap v14: 129 pgs: 129 active+clean; 43 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 4.7 MiB/s wr, 118 op/s 2023-08-10T10:51:36.683 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-10T10:51:36.684 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-10T10:51:36.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.919+0000 7fa0773ff700 1 -- 172.21.15.107:0/3235985167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701010a0 msgr2=0x7fa07010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.919+0000 7fa0773ff700 1 --2- 172.21.15.107:0/3235985167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701010a0 0x7fa07010d5b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa06800b0a0 tx=0x7fa06800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.919+0000 7fa0773ff700 1 -- 172.21.15.107:0/3235985167 shutdown_connections 2023-08-10T10:51:36.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.919+0000 7fa0773ff700 1 --2- 172.21.15.107:0/3235985167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0701066f0 0x7fa070106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.919+0000 7fa0773ff700 1 --2- 172.21.15.107:0/3235985167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701010a0 0x7fa07010d5b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.919+0000 7fa0773ff700 1 --2- 172.21.15.107:0/3235985167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0701006e0 0x7fa070100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.919+0000 7fa0773ff700 1 -- 172.21.15.107:0/3235985167 >> 172.21.15.107:0/3235985167 conn(0x7fa0700fc1d0 msgr2=0x7fa0700fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.919+0000 7fa0773ff700 1 -- 172.21.15.107:0/3235985167 shutdown_connections 2023-08-10T10:51:36.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.919+0000 7fa0773ff700 1 -- 172.21.15.107:0/3235985167 wait complete. 2023-08-10T10:51:36.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.920+0000 7fa0773ff700 1 Processor -- start 2023-08-10T10:51:36.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.920+0000 7fa0773ff700 1 -- start start 2023-08-10T10:51:36.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa0773ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0701006e0 0x7fa070072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa0773ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0701010a0 0x7fa070072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa0773ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701066f0 0x7fa0701a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa0773ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700737e0 con 0x7fa0701066f0 2023-08-10T10:51:36.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa0773ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0701a4e90 con 0x7fa0701010a0 2023-08-10T10:51:36.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa0773ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0701a4fd0 con 0x7fa0701006e0 2023-08-10T10:51:36.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa07599c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701066f0 0x7fa0701a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa07499a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0701010a0 0x7fa070072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa07599c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701066f0 0x7fa0701a4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44196/0 (socket says 172.21.15.107:44196) 2023-08-10T10:51:36.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa07499a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0701010a0 0x7fa070072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39166/0 (socket says 172.21.15.107:39166) 2023-08-10T10:51:36.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa07519b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0701006e0 0x7fa070072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.921+0000 7fa07599c700 1 -- 172.21.15.107:0/2567856733 learned_addr learned my addr 172.21.15.107:0/2567856733 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:36.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa07599c700 1 -- 172.21.15.107:0/2567856733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0701006e0 msgr2=0x7fa070072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa07599c700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0701006e0 0x7fa070072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa07599c700 1 -- 172.21.15.107:0/2567856733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0701010a0 msgr2=0x7fa070072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa07599c700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0701010a0 0x7fa070072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa07599c700 1 -- 172.21.15.107:0/2567856733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068009d00 con 0x7fa0701066f0 2023-08-10T10:51:36.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa07599c700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701066f0 0x7fa0701a4950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa068009fd0 tx=0x7fa068012620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa0667fc700 1 -- 172.21.15.107:0/2567856733 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800e040 con 0x7fa0701066f0 2023-08-10T10:51:36.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa0773ff700 1 -- 172.21.15.107:0/2567856733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0701a51d0 con 0x7fa0701066f0 2023-08-10T10:51:36.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa0667fc700 1 -- 172.21.15.107:0/2567856733 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa068003a00 con 0x7fa0701066f0 2023-08-10T10:51:36.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.922+0000 7fa0667fc700 1 -- 172.21.15.107:0/2567856733 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680054d0 con 0x7fa0701066f0 2023-08-10T10:51:36.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.923+0000 7fa0773ff700 1 -- 172.21.15.107:0/2567856733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0701a56a0 con 0x7fa0701066f0 2023-08-10T10:51:36.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.927+0000 7fa0667fc700 1 -- 172.21.15.107:0/2567856733 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 24) v1 ==== 135892+0+0 (secure 0 0 0) 0x7fa068003b70 con 0x7fa0701066f0 2023-08-10T10:51:36.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.928+0000 7fa08ada0b80 1 Processor -- start 2023-08-10T10:51:36.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.928+0000 7fa08ada0b80 1 -- start start 2023-08-10T10:51:36.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.928+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 0x561e1ef623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.928+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef5c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.928+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef5c880 0x561e1ef5cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.928+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1eed7e40 con 0x561e1ef5c880 2023-08-10T10:51:36.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.928+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1eeb4610 con 0x561e1ef61fd0 2023-08-10T10:51:36.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.928+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1eeb1f30 con 0x561e1ef628f0 2023-08-10T10:51:36.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07499a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 0x561e1ef623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07519b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef5c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07499a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 0x561e1ef623b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39170/0 (socket says 172.21.15.107:39170) 2023-08-10T10:51:36.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07499a700 1 -- 172.21.15.107:0/597585115 learned_addr learned my addr 172.21.15.107:0/597585115 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:36.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07499a700 1 --2- 172.21.15.107:0/597585115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef5c880 0x561e1ef5cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa0667fc700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa05c0a13d0 0x7fa05c0a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07519b700 1 -- 172.21.15.107:0/597585115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 msgr2=0x561e1ef623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07519b700 1 --2- 172.21.15.107:0/597585115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 0x561e1ef623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07519b700 1 -- 172.21.15.107:0/597585115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef5c880 msgr2=0x561e1ef5cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07519b700 1 --2- 172.21.15.107:0/597585115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef5c880 0x561e1ef5cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07519b700 1 -- 172.21.15.107:0/597585115 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e1ed2e6b0 con 0x561e1ef628f0 2023-08-10T10:51:36.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07499a700 1 --2- 172.21.15.107:0/597585115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 0x561e1ef623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:36.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa0667fc700 1 -- 172.21.15.107:0/2567856733 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fa0680ce4b0 con 0x7fa0701066f0 2023-08-10T10:51:36.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.929+0000 7fa07599c700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa05c0a13d0 0x7fa05c0a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.930+0000 7fa07519b700 1 --2- 172.21.15.107:0/597585115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef5c340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa06c007bf0 tx=0x7fa06c007f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=520bff8e5b3f2573 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.930+0000 7fa05b7fe700 1 -- 172.21.15.107:0/597585115 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c004310 con 0x561e1ef628f0 2023-08-10T10:51:36.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.930+0000 7fa05b7fe700 1 -- 172.21.15.107:0/597585115 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa06c010e10 con 0x561e1ef628f0 2023-08-10T10:51:36.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.930+0000 7fa05b7fe700 1 -- 172.21.15.107:0/597585115 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c005020 con 0x561e1ef628f0 2023-08-10T10:51:36.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa08ada0b80 1 -- 172.21.15.107:0/597585115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 msgr2=0x561e1ef5c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa07599c700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa05c0a13d0 0x7fa05c0a3890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0680cb840 tx=0x7fa06800b3b0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/597585115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef5c340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa06c007bf0 tx=0x7fa06c007f00 comp rx=0 tx=0).stop 2023-08-10T10:51:36.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa08ada0b80 1 -- 172.21.15.107:0/597585115 shutdown_connections 2023-08-10T10:51:36.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/597585115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 0x561e1ef623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/597585115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef5c880 0x561e1ef5cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/597585115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef5c340 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa08ada0b80 1 -- 172.21.15.107:0/597585115 >> 172.21.15.107:0/597585115 conn(0x561e1eeb9d50 msgr2=0x561e1ef57550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa08ada0b80 1 -- 172.21.15.107:0/597585115 shutdown_connections 2023-08-10T10:51:36.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.931+0000 7fa08ada0b80 1 -- 172.21.15.107:0/597585115 wait complete. 2023-08-10T10:51:36.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.932+0000 7fa08ada0b80 1 -- start start 2023-08-10T10:51:36.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.932+0000 7fa08ada0b80 1 Processor -- start 2023-08-10T10:51:36.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.932+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 0x561e1ef65ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.932+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef61fd0 0x561e1ef661e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.932+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef66720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.932+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1eead820 con 0x561e1ef61fd0 2023-08-10T10:51:36.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.932+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1ee4cb40 con 0x561e1ef5c880 2023-08-10T10:51:36.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.932+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1ee4c840 con 0x561e1ef628f0 2023-08-10T10:51:36.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.932+0000 7fa08ada0b80 10 client.0 _ll_register_callbacks cb 0x561e1ee4a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:36.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07519b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef61fd0 0x561e1ef661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef66720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07519b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef61fd0 0x561e1ef661e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44200/0 (socket says 172.21.15.107:44200) 2023-08-10T10:51:36.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07519b700 1 -- 172.21.15.107:0/1657103561 learned_addr learned my addr 172.21.15.107:0/1657103561 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:36.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07499a700 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 0x561e1ef65ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07499a700 1 -- 172.21.15.107:0/1657103561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 msgr2=0x561e1ef65ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07499a700 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 0x561e1ef65ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07499a700 1 -- 172.21.15.107:0/1657103561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef61fd0 msgr2=0x561e1ef661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07499a700 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef61fd0 0x561e1ef661e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07499a700 1 -- 172.21.15.107:0/1657103561 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa060009ba0 con 0x561e1ef628f0 2023-08-10T10:51:36.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07519b700 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef61fd0 0x561e1ef661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:36.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa07499a700 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef66720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x561e1ef5d5a0 tx=0x7fa060004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8e2622189aaf124 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.933+0000 7fa058ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:51:36.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.934+0000 7fa058ff9700 1 -- 172.21.15.107:0/1657103561 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600163d0 con 0x561e1ef628f0 2023-08-10T10:51:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.934+0000 7fa08ada0b80 1 -- 172.21.15.107:0/1657103561 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e1ef4f4f0 con 0x561e1ef628f0 2023-08-10T10:51:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.934+0000 7fa058ff9700 1 -- 172.21.15.107:0/1657103561 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fa060016530 con 0x561e1ef628f0 2023-08-10T10:51:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.934+0000 7fa058ff9700 1 -- 172.21.15.107:0/1657103561 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0600166f0 con 0x561e1ef628f0 2023-08-10T10:51:36.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.934+0000 7fa08ada0b80 10 client.25669 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:36.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.934+0000 7fa08ada0b80 1 -- 172.21.15.107:0/1657103561 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fa06c0078a0 con 0x561e1ef628f0 2023-08-10T10:51:36.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.934+0000 7fa058ff9700 1 -- 172.21.15.107:0/1657103561 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e1ef4f4f0 con 0x561e1ef628f0 2023-08-10T10:51:36.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.934+0000 7fa058ff9700 1 -- 172.21.15.107:0/1657103561 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa0600146b0 con 0x561e1ef628f0 2023-08-10T10:51:36.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.935+0000 7fa08ada0b80 10 client.25669 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:36.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.935+0000 7fa08ada0b80 10 client.25669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:36.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.935+0000 7fa08ada0b80 20 client.25669 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:36.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.935+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561e1ef763d0 0x561e1ef787f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.935+0000 7fa08ada0b80 4 client.25669 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:36.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.935+0000 7fa08ada0b80 1 -- 172.21.15.107:0/1657103561 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e1ef2ba50 con 0x561e1ef763d0 2023-08-10T10:51:36.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.935+0000 7fa07519b700 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561e1ef763d0 0x561e1ef787f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.936+0000 7fa07519b700 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561e1ef763d0 0x561e1ef787f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32d90571c085a069 server_cookie=6a27b67b81dda755 in_seq=0 out_seq=0 2023-08-10T10:51:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.936+0000 7fa058ff9700 10 client.25669 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.936+0000 7fa058ff9700 1 -- 172.21.15.107:0/1657103561 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561e1ef2ba50 con 0x561e1ef763d0 2023-08-10T10:51:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.936+0000 7fa058ff9700 10 client.25669 handle_command_reply: tid=0 2023-08-10T10:51:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.936+0000 7fa08ada0b80 1 client.25669 shutdown 2023-08-10T10:51:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 -- 172.21.15.107:0/1657103561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 msgr2=0x561e1ef66720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef66720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x561e1ef5d5a0 tx=0x7fa060004770 comp rx=0 tx=0).stop 2023-08-10T10:51:36.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 -- 172.21.15.107:0/1657103561 shutdown_connections 2023-08-10T10:51:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561e1ef763d0 0x561e1ef787f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 0x561e1ef65ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef628f0 0x561e1ef66720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/1657103561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef61fd0 0x561e1ef661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa058ff9700 0 client.25669 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 -- 172.21.15.107:0/1657103561 >> 172.21.15.107:0/1657103561 conn(0x561e1eeb9d50 msgr2=0x561e1ef56a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 -- 172.21.15.107:0/1657103561 shutdown_connections 2023-08-10T10:51:36.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 1 -- 172.21.15.107:0/1657103561 wait complete. 2023-08-10T10:51:36.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.937+0000 7fa08ada0b80 20 client.25669 trim_cache size 0 max 16384 2023-08-10T10:51:36.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.956+0000 7fa08ada0b80 1 Processor -- start 2023-08-10T10:51:36.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.956+0000 7fa08ada0b80 1 -- start start 2023-08-10T10:51:36.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.956+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 0x561e1ef5c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.956+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef61fd0 0x561e1ef66550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.956+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 0x561e1ef571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.956+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1ed309a0 con 0x561e1ef628f0 2023-08-10T10:51:36.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.956+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1ef58490 con 0x561e1ef5c880 2023-08-10T10:51:36.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.956+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1ef54000 con 0x561e1ef61fd0 2023-08-10T10:51:36.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07499a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 0x561e1ef5c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07519b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef61fd0 0x561e1ef66550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07499a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 0x561e1ef571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07519b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef61fd0 0x561e1ef66550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55864/0 (socket says 172.21.15.107:55864) 2023-08-10T10:51:36.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07519b700 1 -- 172.21.15.107:0/3310276013 learned_addr learned my addr 172.21.15.107:0/3310276013 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:36.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07499a700 1 -- 172.21.15.107:0/3310276013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef61fd0 msgr2=0x561e1ef66550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07499a700 1 --2- 172.21.15.107:0/3310276013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef61fd0 0x561e1ef66550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07499a700 1 -- 172.21.15.107:0/3310276013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 msgr2=0x561e1ef5c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07499a700 1 --2- 172.21.15.107:0/3310276013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 0x561e1ef5c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07499a700 1 -- 172.21.15.107:0/3310276013 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e1ef53720 con 0x561e1ef628f0 2023-08-10T10:51:36.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07519b700 1 --2- 172.21.15.107:0/3310276013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef61fd0 0x561e1ef66550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:36.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.957+0000 7fa07499a700 1 --2- 172.21.15.107:0/3310276013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 0x561e1ef571b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa060014a70 tx=0x7fa060000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ad15e42e3d5a48 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa05bfff700 1 -- 172.21.15.107:0/3310276013 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600145b0 con 0x561e1ef628f0 2023-08-10T10:51:36.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa05bfff700 1 -- 172.21.15.107:0/3310276013 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa06001e070 con 0x561e1ef628f0 2023-08-10T10:51:36.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa05bfff700 1 -- 172.21.15.107:0/3310276013 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600148c0 con 0x561e1ef628f0 2023-08-10T10:51:36.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa08ada0b80 1 -- 172.21.15.107:0/3310276013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 msgr2=0x561e1ef571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/3310276013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 0x561e1ef571b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa060014a70 tx=0x7fa060000bc0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa08ada0b80 1 -- 172.21.15.107:0/3310276013 shutdown_connections 2023-08-10T10:51:36.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/3310276013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef5c880 0x561e1ef5c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/3310276013 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 0x561e1ef571b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/3310276013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef61fd0 0x561e1ef66550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa08ada0b80 1 -- 172.21.15.107:0/3310276013 >> 172.21.15.107:0/3310276013 conn(0x561e1eeb9d50 msgr2=0x561e1ef60cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa08ada0b80 1 -- 172.21.15.107:0/3310276013 shutdown_connections 2023-08-10T10:51:36.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.958+0000 7fa08ada0b80 1 -- 172.21.15.107:0/3310276013 wait complete. 2023-08-10T10:51:36.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.959+0000 7fa08ada0b80 1 -- start start 2023-08-10T10:51:36.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.959+0000 7fa08ada0b80 1 Processor -- start 2023-08-10T10:51:36.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef5c880 0x561e1ef6b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 0x561e1ef6bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa08ada0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 0x561e1ef6c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1efca050 con 0x561e1ef628f0 2023-08-10T10:51:36.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1efca190 con 0x561e1ef61fd0 2023-08-10T10:51:36.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa08ada0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1efca320 con 0x561e1ef5c880 2023-08-10T10:51:36.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa08ada0b80 10 client.0 _ll_register_callbacks cb 0x561e1ee4a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:36.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa07499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef5c880 0x561e1ef6b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa07499a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 0x561e1ef6c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa07499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef5c880 0x561e1ef6b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55866/0 (socket says 172.21.15.107:55866) 2023-08-10T10:51:36.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa07499a700 1 -- 172.21.15.107:0/671115321 learned_addr learned my addr 172.21.15.107:0/671115321 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:36.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa07499a700 1 -- 172.21.15.107:0/671115321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 msgr2=0x561e1ef6bee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:51:36.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa07499a700 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 0x561e1ef6bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa07499a700 1 -- 172.21.15.107:0/671115321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 msgr2=0x561e1ef6c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:36.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa07499a700 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 0x561e1ef6c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.960+0000 7fa07499a700 1 -- 172.21.15.107:0/671115321 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e1ed2e6b0 con 0x561e1ef5c880 2023-08-10T10:51:36.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.961+0000 7fa07499a700 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef5c880 0x561e1ef6b9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa0600098b0 tx=0x7fa060009d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec1f6ca155afcf86 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:36.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.961+0000 7fa058ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:51:36.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.961+0000 7fa058ff9700 1 -- 172.21.15.107:0/671115321 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060014ce0 con 0x561e1ef5c880 2023-08-10T10:51:36.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.961+0000 7fa08ada0b80 1 -- 172.21.15.107:0/671115321 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa06c010e10 con 0x561e1ef5c880 2023-08-10T10:51:36.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.961+0000 7fa058ff9700 1 -- 172.21.15.107:0/671115321 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fa06002fb40 con 0x561e1ef5c880 2023-08-10T10:51:36.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.961+0000 7fa058ff9700 1 -- 172.21.15.107:0/671115321 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa06002fd00 con 0x561e1ef5c880 2023-08-10T10:51:36.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.961+0000 7fa08ada0b80 10 client.25675 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:36.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.961+0000 7fa08ada0b80 1 -- 172.21.15.107:0/671115321 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fa06c0078a0 con 0x561e1ef5c880 2023-08-10T10:51:36.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.962+0000 7fa058ff9700 1 -- 172.21.15.107:0/671115321 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa06c010e10 con 0x561e1ef5c880 2023-08-10T10:51:36.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.962+0000 7fa058ff9700 1 -- 172.21.15.107:0/671115321 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa06002f660 con 0x561e1ef5c880 2023-08-10T10:51:36.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.962+0000 7fa08ada0b80 10 client.25675 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:36.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.962+0000 7fa08ada0b80 10 client.25675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:36.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.962+0000 7fa08ada0b80 20 client.25675 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:36.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.962+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561e1efcb920 0x561e1efcdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:36.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.962+0000 7fa08ada0b80 4 client.25675 mds_command: new command op to 24575 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-10T10:51:36.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.962+0000 7fa08ada0b80 1 -- 172.21.15.107:0/671115321 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561e1eea6800 con 0x561e1efcb920 2023-08-10T10:51:36.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.962+0000 7fa07519b700 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561e1efcb920 0x561e1efcdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:36.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.963+0000 7fa07519b700 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561e1efcb920 0x561e1efcdd10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c80462180f7a0098 server_cookie=ee8e75c5db762412 in_seq=0 out_seq=0 2023-08-10T10:51:36.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.963+0000 7fa058ff9700 10 client.25675 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:36.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa058ff9700 1 -- 172.21.15.107:0/671115321 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561e1eea6800 con 0x561e1efcb920 2023-08-10T10:51:36.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa058ff9700 10 client.25675 handle_command_reply: tid=0 2023-08-10T10:51:36.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 client.25675 shutdown 2023-08-10T10:51:36.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 -- 172.21.15.107:0/671115321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef5c880 msgr2=0x561e1ef6b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef5c880 0x561e1ef6b9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa0600098b0 tx=0x7fa060009d30 comp rx=0 tx=0).stop 2023-08-10T10:51:36.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 -- 172.21.15.107:0/671115321 shutdown_connections 2023-08-10T10:51:36.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561e1efcb920 0x561e1efcdd10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561e1ef628f0 0x561e1ef6c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e1ef5c880 0x561e1ef6b9a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 --2- 172.21.15.107:0/671115321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e1ef61fd0 0x561e1ef6bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa058ff9700 0 client.25675 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 -- 172.21.15.107:0/671115321 >> 172.21.15.107:0/671115321 conn(0x561e1eeb9d50 msgr2=0x561e1ef64d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 -- 172.21.15.107:0/671115321 shutdown_connections 2023-08-10T10:51:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.964+0000 7fa08ada0b80 1 -- 172.21.15.107:0/671115321 wait complete. 2023-08-10T10:51:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa08ada0b80 20 client.25675 trim_cache size 0 max 16384 2023-08-10T10:51:36.974 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:51:36.974 INFO:teuthology.orchestra.run.smithi107.stdout: "return_code": 0, 2023-08-10T10:51:36.974 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_tag": "e9f161d5-b599-4542-ae4f-d92ee15d0a02", 2023-08-10T10:51:36.974 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": "asynchronous" 2023-08-10T10:51:36.974 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:51:36.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 -- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa05c0a13d0 msgr2=0x7fa05c0a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa05c0a13d0 0x7fa05c0a3890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0680cb840 tx=0x7fa06800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 -- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701066f0 msgr2=0x7fa0701a4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:36.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701066f0 0x7fa0701a4950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa068009fd0 tx=0x7fa068012620 comp rx=0 tx=0).stop 2023-08-10T10:51:36.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 -- 172.21.15.107:0/2567856733 shutdown_connections 2023-08-10T10:51:36.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0701066f0 0x7fa0701a4950 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0701006e0 0x7fa070072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa05c0a13d0 0x7fa05c0a3890 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 --2- 172.21.15.107:0/2567856733 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0701010a0 0x7fa070072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:36.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.965+0000 7fa0773ff700 1 -- 172.21.15.107:0/2567856733 >> 172.21.15.107:0/2567856733 conn(0x7fa0700fc1d0 msgr2=0x7fa0700fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:36.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.966+0000 7fa0773ff700 1 -- 172.21.15.107:0/2567856733 shutdown_connections 2023-08-10T10:51:36.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:36.966+0000 7fa0773ff700 1 -- 172.21.15.107:0/2567856733 wait complete. 2023-08-10T10:51:36.985 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:51:37.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.224+0000 7fda1bfff700 1 -- 172.21.15.107:0/3651615462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1c102790 msgr2=0x7fda1c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.224+0000 7fda1bfff700 1 --2- 172.21.15.107:0/3651615462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1c102790 0x7fda1c102c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda10009990 tx=0x7fda10009ca0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.224+0000 7fda1bfff700 1 -- 172.21.15.107:0/3651615462 shutdown_connections 2023-08-10T10:51:37.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.224+0000 7fda1bfff700 1 --2- 172.21.15.107:0/3651615462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda1c103150 0x7fda1c10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.224+0000 7fda1bfff700 1 --2- 172.21.15.107:0/3651615462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c1087a0 0x7fda1c108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.224+0000 7fda1bfff700 1 --2- 172.21.15.107:0/3651615462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1c102790 0x7fda1c102c10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.224+0000 7fda1bfff700 1 -- 172.21.15.107:0/3651615462 >> 172.21.15.107:0/3651615462 conn(0x7fda1c0fe200 msgr2=0x7fda1c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:37.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.225+0000 7fda1bfff700 1 -- 172.21.15.107:0/3651615462 shutdown_connections 2023-08-10T10:51:37.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.225+0000 7fda1bfff700 1 -- 172.21.15.107:0/3651615462 wait complete. 2023-08-10T10:51:37.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1bfff700 1 Processor -- start 2023-08-10T10:51:37.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1bfff700 1 -- start start 2023-08-10T10:51:37.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda1c102790 0x7fda1c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c103150 0x7fda1c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1c1087a0 0x7fda1c19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1bfff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c19d650 con 0x7fda1c103150 2023-08-10T10:51:37.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1bfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c19d7c0 con 0x7fda1c102790 2023-08-10T10:51:37.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1bfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c19d980 con 0x7fda1c1087a0 2023-08-10T10:51:37.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1a7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c103150 0x7fda1c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1a7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c103150 0x7fda1c198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44240/0 (socket says 172.21.15.107:44240) 2023-08-10T10:51:37.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1a7fc700 1 -- 172.21.15.107:0/1303930504 learned_addr learned my addr 172.21.15.107:0/1303930504 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:37.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.226+0000 7fda1b7fe700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1c1087a0 0x7fda1c19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda1affd700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda1c102790 0x7fda1c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda1a7fc700 1 -- 172.21.15.107:0/1303930504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1c1087a0 msgr2=0x7fda1c19d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1c1087a0 0x7fda1c19d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda1a7fc700 1 -- 172.21.15.107:0/1303930504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda1c102790 msgr2=0x7fda1c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda1c102790 0x7fda1c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda1a7fc700 1 -- 172.21.15.107:0/1303930504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c009520 con 0x7fda1c103150 2023-08-10T10:51:37.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c103150 0x7fda1c198bb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fda10005740 tx=0x7fda10005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda03fff700 1 -- 172.21.15.107:0/1303930504 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1001d070 con 0x7fda1c103150 2023-08-10T10:51:37.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda03fff700 1 -- 172.21.15.107:0/1303930504 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda10022470 con 0x7fda1c103150 2023-08-10T10:51:37.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda1bfff700 1 -- 172.21.15.107:0/1303930504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda100095f0 con 0x7fda1c103150 2023-08-10T10:51:37.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.227+0000 7fda03fff700 1 -- 172.21.15.107:0/1303930504 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10017650 con 0x7fda1c103150 2023-08-10T10:51:37.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.228+0000 7fda1bfff700 1 -- 172.21.15.107:0/1303930504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c1a52c0 con 0x7fda1c103150 2023-08-10T10:51:37.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.231+0000 7fda03fff700 1 -- 172.21.15.107:0/1303930504 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 24) v1 ==== 135892+0+0 (secure 0 0 0) 0x7fda100225e0 con 0x7fda1c103150 2023-08-10T10:51:37.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.232+0000 7fda35000b80 1 Processor -- start 2023-08-10T10:51:37.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.232+0000 7fda35000b80 1 -- start start 2023-08-10T10:51:37.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda35000b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac04b0 0x55626eac0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda35000b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac0dd0 0x55626eac4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda35000b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626eac56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda35000b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626ea3bdc0 con 0x55626eac0dd0 2023-08-10T10:51:37.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda35000b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626ea18590 con 0x55626eac5290 2023-08-10T10:51:37.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda35000b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626ea15eb0 con 0x55626eac04b0 2023-08-10T10:51:37.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda1affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac0dd0 0x55626eac4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac04b0 0x55626eac0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda1affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac0dd0 0x55626eac4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44252/0 (socket says 172.21.15.107:44252) 2023-08-10T10:51:37.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.233+0000 7fda1affd700 1 -- 172.21.15.107:0/3673243128 learned_addr learned my addr 172.21.15.107:0/3673243128 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:37.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626eac56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1b7fe700 1 -- 172.21.15.107:0/3673243128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 msgr2=0x55626eac56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1b7fe700 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626eac56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1b7fe700 1 -- 172.21.15.107:0/3673243128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac0dd0 msgr2=0x55626eac4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1b7fe700 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac0dd0 0x55626eac4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1b7fe700 1 -- 172.21.15.107:0/3673243128 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55626e892630 con 0x55626eac04b0 2023-08-10T10:51:37.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1affd700 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac0dd0 0x55626eac4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:51:37.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda03fff700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fda040a13f0 0x7fda040a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda03fff700 1 -- 172.21.15.107:0/1303930504 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fda100ce4f0 con 0x7fda1c103150 2023-08-10T10:51:37.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1b7fe700 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac04b0 0x55626eac0890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda14011580 tx=0x7fda14009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae955f02e705a0f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626eac56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:51:37.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda1affd700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fda040a13f0 0x7fda040a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda017fa700 1 -- 172.21.15.107:0/3673243128 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1400e040 con 0x55626eac04b0 2023-08-10T10:51:37.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda017fa700 1 -- 172.21.15.107:0/3673243128 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda1400f040 con 0x55626eac04b0 2023-08-10T10:51:37.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.234+0000 7fda017fa700 1 -- 172.21.15.107:0/3673243128 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14004320 con 0x55626eac04b0 2023-08-10T10:51:37.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda35000b80 1 -- 172.21.15.107:0/3673243128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac04b0 msgr2=0x55626eac0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda35000b80 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac04b0 0x55626eac0890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda14011580 tx=0x7fda14009920 comp rx=0 tx=0).stop 2023-08-10T10:51:37.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda1affd700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fda040a13f0 0x7fda040a38b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda0c005c50 tx=0x7fda0c009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda35000b80 1 -- 172.21.15.107:0/3673243128 shutdown_connections 2023-08-10T10:51:37.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda35000b80 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626eac56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda35000b80 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac04b0 0x55626eac0890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda35000b80 1 --2- 172.21.15.107:0/3673243128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac0dd0 0x55626eac4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda35000b80 1 -- 172.21.15.107:0/3673243128 >> 172.21.15.107:0/3673243128 conn(0x55626ea1dcd0 msgr2=0x55626eabb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:37.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda35000b80 1 -- 172.21.15.107:0/3673243128 shutdown_connections 2023-08-10T10:51:37.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.235+0000 7fda35000b80 1 -- 172.21.15.107:0/3673243128 wait complete. 2023-08-10T10:51:37.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.236+0000 7fda35000b80 1 -- start start 2023-08-10T10:51:37.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.237+0000 7fda35000b80 1 Processor -- start 2023-08-10T10:51:37.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.237+0000 7fda35000b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eac9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.237+0000 7fda35000b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eaca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.237+0000 7fda35000b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626eaca820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.237+0000 7fda35000b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626ea117a0 con 0x55626eac04b0 2023-08-10T10:51:37.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.237+0000 7fda35000b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626e9b0ac0 con 0x55626eac5290 2023-08-10T10:51:37.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.237+0000 7fda35000b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626e9b07c0 con 0x55626eac0dd0 2023-08-10T10:51:37.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.237+0000 7fda35000b80 10 client.0 _ll_register_callbacks cb 0x55626e9ae680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:37.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eac9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1a7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eaca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1a7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eaca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55916/0 (socket says 172.21.15.107:55916) 2023-08-10T10:51:37.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eac9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44254/0 (socket says 172.21.15.107:44254) 2023-08-10T10:51:37.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1a7fc700 1 -- 172.21.15.107:0/308049070 learned_addr learned my addr 172.21.15.107:0/308049070 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:37.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1b7fe700 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626eaca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1a7fc700 1 -- 172.21.15.107:0/308049070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 msgr2=0x55626eaca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626eaca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1a7fc700 1 -- 172.21.15.107:0/308049070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 msgr2=0x55626eac9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eac9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1a7fc700 1 -- 172.21.15.107:0/308049070 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c009af0 con 0x55626eac0dd0 2023-08-10T10:51:37.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eaca2e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda100cb960 tx=0x7fda10022ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eddc51647f59baac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.238+0000 7fd9feff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:51:37.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fd9feff5700 1 -- 172.21.15.107:0/308049070 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda100ce390 con 0x55626eac0dd0 2023-08-10T10:51:37.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fd9feff5700 1 -- 172.21.15.107:0/308049070 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fda1009b1e0 con 0x55626eac0dd0 2023-08-10T10:51:37.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fda35000b80 1 -- 172.21.15.107:0/308049070 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55626eab3470 con 0x55626eac0dd0 2023-08-10T10:51:37.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fd9feff5700 1 -- 172.21.15.107:0/308049070 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda1009ad20 con 0x55626eac0dd0 2023-08-10T10:51:37.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fda35000b80 10 client.25687 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:37.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fda35000b80 1 -- 172.21.15.107:0/308049070 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fda14011230 con 0x55626eac0dd0 2023-08-10T10:51:37.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fd9feff5700 1 -- 172.21.15.107:0/308049070 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda100b2020 con 0x55626eac0dd0 2023-08-10T10:51:37.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fd9feff5700 1 -- 172.21.15.107:0/308049070 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fda1009b4d0 con 0x55626eac0dd0 2023-08-10T10:51:37.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fda35000b80 10 client.25687 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:37.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fda35000b80 10 client.25687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:37.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fda35000b80 20 client.25687 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:37.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fda35000b80 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55626eada0a0 0x55626eadc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fda35000b80 4 client.25687 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:51:37.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.239+0000 7fda35000b80 1 -- 172.21.15.107:0/308049070 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55626ea8f9d0 con 0x55626eada0a0 2023-08-10T10:51:37.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.240+0000 7fda1affd700 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55626eada0a0 0x55626eadc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.240+0000 7fda1affd700 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55626eada0a0 0x55626eadc4c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec1c941f6012b3ef server_cookie=e6a03da2a9dfb72c in_seq=0 out_seq=0 2023-08-10T10:51:37.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.240+0000 7fd9feff5700 10 client.25687 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:37.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fd9feff5700 1 -- 172.21.15.107:0/308049070 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55626ea8f9d0 con 0x55626eada0a0 2023-08-10T10:51:37.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fd9feff5700 10 client.25687 handle_command_reply: tid=0 2023-08-10T10:51:37.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 client.25687 shutdown 2023-08-10T10:51:37.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 -- 172.21.15.107:0/308049070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 msgr2=0x55626eaca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eaca2e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda100cb960 tx=0x7fda10022ba0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 -- 172.21.15.107:0/308049070 shutdown_connections 2023-08-10T10:51:37.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55626eada0a0 0x55626eadc4c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626eaca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eac9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fd9feff5700 0 client.25687 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:37.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 --2- 172.21.15.107:0/308049070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eaca2e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 -- 172.21.15.107:0/308049070 >> 172.21.15.107:0/308049070 conn(0x55626ea1dcd0 msgr2=0x55626eaba980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:37.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 -- 172.21.15.107:0/308049070 shutdown_connections 2023-08-10T10:51:37.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 1 -- 172.21.15.107:0/308049070 wait complete. 2023-08-10T10:51:37.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.242+0000 7fda35000b80 20 client.25687 trim_cache size 0 max 16384 2023-08-10T10:51:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.262+0000 7fda35000b80 1 Processor -- start 2023-08-10T10:51:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.262+0000 7fda35000b80 1 -- start start 2023-08-10T10:51:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.262+0000 7fda35000b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac04b0 0x55626ead1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda35000b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eabb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda35000b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac5290 0x55626eac8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda35000b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626e894920 con 0x55626eac5290 2023-08-10T10:51:37.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda35000b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626eab5a30 con 0x55626eac04b0 2023-08-10T10:51:37.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda35000b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626eabbd00 con 0x55626eac0dd0 2023-08-10T10:51:37.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac04b0 0x55626ead1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac5290 0x55626eac8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac04b0 0x55626ead1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:39242/0 (socket says 172.21.15.107:39242) 2023-08-10T10:51:37.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1affd700 1 -- 172.21.15.107:0/2123394140 learned_addr learned my addr 172.21.15.107:0/2123394140 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:37.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/2123394140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eabb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1affd700 1 -- 172.21.15.107:0/2123394140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 msgr2=0x55626eabb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1affd700 1 --2- 172.21.15.107:0/2123394140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eabb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1affd700 1 -- 172.21.15.107:0/2123394140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac5290 msgr2=0x55626eac8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1affd700 1 --2- 172.21.15.107:0/2123394140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac5290 0x55626eac8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.263+0000 7fda1affd700 1 -- 172.21.15.107:0/2123394140 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55626e83ede0 con 0x55626eac04b0 2023-08-10T10:51:37.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.264+0000 7fda1affd700 1 --2- 172.21.15.107:0/2123394140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac04b0 0x55626ead1500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda0c005c20 tx=0x7fda0c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50c2438ac0ba8a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.264+0000 7fda01ffb700 1 -- 172.21.15.107:0/2123394140 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c024040 con 0x55626eac04b0 2023-08-10T10:51:37.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.264+0000 7fda01ffb700 1 -- 172.21.15.107:0/2123394140 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda0c029460 con 0x55626eac04b0 2023-08-10T10:51:37.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.264+0000 7fda01ffb700 1 -- 172.21.15.107:0/2123394140 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c016070 con 0x55626eac04b0 2023-08-10T10:51:37.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.264+0000 7fda35000b80 1 -- 172.21.15.107:0/2123394140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac04b0 msgr2=0x55626ead1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.264+0000 7fda35000b80 1 --2- 172.21.15.107:0/2123394140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac04b0 0x55626ead1500 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda0c005c20 tx=0x7fda0c019000 comp rx=0 tx=0).stop 2023-08-10T10:51:37.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.265+0000 7fda35000b80 1 -- 172.21.15.107:0/2123394140 shutdown_connections 2023-08-10T10:51:37.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.265+0000 7fda35000b80 1 --2- 172.21.15.107:0/2123394140 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac04b0 0x55626ead1500 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.265+0000 7fda35000b80 1 --2- 172.21.15.107:0/2123394140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac5290 0x55626eac8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.265+0000 7fda35000b80 1 --2- 172.21.15.107:0/2123394140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eabb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.265+0000 7fda35000b80 1 -- 172.21.15.107:0/2123394140 >> 172.21.15.107:0/2123394140 conn(0x55626ea1dcd0 msgr2=0x55626eac8320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:37.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.265+0000 7fda35000b80 1 -- 172.21.15.107:0/2123394140 shutdown_connections 2023-08-10T10:51:37.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.265+0000 7fda35000b80 1 -- 172.21.15.107:0/2123394140 wait complete. 2023-08-10T10:51:37.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.265+0000 7fda35000b80 1 -- start start 2023-08-10T10:51:37.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.265+0000 7fda35000b80 1 Processor -- start 2023-08-10T10:51:37.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda35000b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eb285d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda35000b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eb28b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda35000b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626ead0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda35000b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626ead0d00 con 0x55626eac04b0 2023-08-10T10:51:37.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda35000b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626ead0e70 con 0x55626eac5290 2023-08-10T10:51:37.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda35000b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55626ead1030 con 0x55626eac0dd0 2023-08-10T10:51:37.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda35000b80 10 client.0 _ll_register_callbacks cb 0x55626e9ae680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:51:37.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eb285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eb285d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44262/0 (socket says 172.21.15.107:44262) 2023-08-10T10:51:37.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1affd700 1 -- 172.21.15.107:0/1601361962 learned_addr learned my addr 172.21.15.107:0/1601361962 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:51:37.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eb28b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1b7fe700 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626ead0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1affd700 1 -- 172.21.15.107:0/1601361962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 msgr2=0x55626eb28b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1affd700 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eb28b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1affd700 1 -- 172.21.15.107:0/1601361962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 msgr2=0x55626ead0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:51:37.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1affd700 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626ead0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.266+0000 7fda1affd700 1 -- 172.21.15.107:0/1601361962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c011200 con 0x55626eac04b0 2023-08-10T10:51:37.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.267+0000 7fda1affd700 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eb285d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fda0c01ecc0 tx=0x7fda0c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec5c3a39848e138 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:51:37.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.267+0000 7fd9feff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:51:37.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.267+0000 7fd9feff5700 1 -- 172.21.15.107:0/1601361962 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c016050 con 0x55626eac04b0 2023-08-10T10:51:37.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.267+0000 7fda35000b80 1 -- 172.21.15.107:0/1601361962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda1400f040 con 0x55626eac04b0 2023-08-10T10:51:37.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.267+0000 7fd9feff5700 1 -- 172.21.15.107:0/1601361962 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fda0c02ac90 con 0x55626eac04b0 2023-08-10T10:51:37.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.267+0000 7fd9feff5700 1 -- 172.21.15.107:0/1601361962 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda0c024040 con 0x55626eac04b0 2023-08-10T10:51:37.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.267+0000 7fda35000b80 10 client.15972 fetch_fsmap learned FSMap version 27 2023-08-10T10:51:37.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fda35000b80 1 -- 172.21.15.107:0/1601361962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55626e827c60 con 0x55626eac04b0 2023-08-10T10:51:37.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fd9feff5700 1 -- 172.21.15.107:0/1601361962 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda1400f040 con 0x55626eac04b0 2023-08-10T10:51:37.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fd9feff5700 1 -- 172.21.15.107:0/1601361962 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fda0c02f020 con 0x55626eac04b0 2023-08-10T10:51:37.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fda35000b80 10 client.15972 fetch_fsmap finished waiting for FSMap version 27 2023-08-10T10:51:37.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fda35000b80 10 client.15972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:51:37.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fda35000b80 20 client.15972 populate_metadata read hostname 'smithi107' 2023-08-10T10:51:37.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fda35000b80 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55626eb303b0 0x55626eb327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:51:37.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fda35000b80 4 client.15972 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:51:37.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fda35000b80 1 -- 172.21.15.107:0/1601361962 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55626ea0a780 con 0x55626eb303b0 2023-08-10T10:51:37.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.268+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55626eb303b0 0x55626eb327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:51:37.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.269+0000 7fd9feff5700 10 client.15972 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:37.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.269+0000 7fda1a7fc700 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55626eb303b0 0x55626eb327d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78cdb384ae54b79b server_cookie=689c422ab3089355 in_seq=0 out_seq=0 2023-08-10T10:51:37.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fd9feff5700 1 -- 172.21.15.107:0/1601361962 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55626ea0a780 con 0x55626eb303b0 2023-08-10T10:51:37.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fd9feff5700 10 client.15972 handle_command_reply: tid=0 2023-08-10T10:51:37.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 client.15972 shutdown 2023-08-10T10:51:37.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 -- 172.21.15.107:0/1601361962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 msgr2=0x55626eb285d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eb285d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fda0c01ecc0 tx=0x7fda0c01ecf0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 -- 172.21.15.107:0/1601361962 shutdown_connections 2023-08-10T10:51:37.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55626eb303b0 0x55626eb327d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55626eac5290 0x55626ead0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55626eac04b0 0x55626eb285d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 --2- 172.21.15.107:0/1601361962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55626eac0dd0 0x55626eb28b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fd9feff5700 0 client.15972 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:51:37.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 -- 172.21.15.107:0/1601361962 >> 172.21.15.107:0/1601361962 conn(0x55626ea1dcd0 msgr2=0x55626eaca330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:37.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 -- 172.21.15.107:0/1601361962 shutdown_connections 2023-08-10T10:51:37.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 1 -- 172.21.15.107:0/1601361962 wait complete. 2023-08-10T10:51:37.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.270+0000 7fda35000b80 20 client.15972 trim_cache size 0 max 16384 2023-08-10T10:51:37.279 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:51:37.279 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:51:37.280 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:51:37.280 INFO:teuthology.orchestra.run.smithi107.stdout: "e9f161d5-b599-4542-ae4f-d92ee15d0a02": { 2023-08-10T10:51:37.280 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:51:37.280 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "e9f161d5-b599-4542-ae4f-d92ee15d0a02", 2023-08-10T10:51:37.280 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:51:37.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:51:37.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:51:37.281 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:51:37.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 -- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fda040a13f0 msgr2=0x7fda040a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fda040a13f0 0x7fda040a38b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda0c005c50 tx=0x7fda0c009260 comp rx=0 tx=0).stop 2023-08-10T10:51:37.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 -- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c103150 msgr2=0x7fda1c198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:51:37.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c103150 0x7fda1c198bb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fda10005740 tx=0x7fda10005770 comp rx=0 tx=0).stop 2023-08-10T10:51:37.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 -- 172.21.15.107:0/1303930504 shutdown_connections 2023-08-10T10:51:37.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fda040a13f0 0x7fda040a38b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda1c102790 0x7fda1c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1c1087a0 0x7fda1c19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 --2- 172.21.15.107:0/1303930504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda1c103150 0x7fda1c198bb0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:51:37.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 -- 172.21.15.107:0/1303930504 >> 172.21.15.107:0/1303930504 conn(0x7fda1c0fe200 msgr2=0x7fda1c0fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:51:37.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 -- 172.21.15.107:0/1303930504 shutdown_connections 2023-08-10T10:51:37.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:51:37.271+0000 7fda1bfff700 1 -- 172.21.15.107:0/1303930504 wait complete. 2023-08-10T10:51:37.293 INFO:tasks.cephfs.filesystem:scrub status for tag:e9f161d5-b599-4542-ae4f-d92ee15d0a02 - {'path': '/', 'tag': 'e9f161d5-b599-4542-ae4f-d92ee15d0a02', 'options': 'recursive,force'} 2023-08-10T10:51:38.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:37 smithi157 ceph-mon[129604]: pgmap v15: 129 pgs: 129 active+clean; 43 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 3.0 MiB/s wr, 92 op/s 2023-08-10T10:51:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:37 smithi107 ceph-mon[127953]: pgmap v15: 129 pgs: 129 active+clean; 43 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 3.0 MiB/s wr, 92 op/s 2023-08-10T10:51:38.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:37 smithi195 ceph-mon[129938]: pgmap v15: 129 pgs: 129 active+clean; 43 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 3.0 MiB/s wr, 92 op/s 2023-08-10T10:51:38.830 INFO:teuthology.orchestra.run.smithi107.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-08-10T10:51:38.835 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-08-10T10:51:39.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:38 smithi157 ceph-mon[129604]: scrub queued for path: / 2023-08-10T10:51:39.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:38 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:39.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:38 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:51:39.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:38 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:39.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:38 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:51:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:38 smithi107 ceph-mon[127953]: scrub queued for path: / 2023-08-10T10:51:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:38 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:38 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:51:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:38 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:38 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:51:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:38 smithi195 ceph-mon[129938]: scrub queued for path: / 2023-08-10T10:51:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:38 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:38 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:51:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:38 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:51:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:38 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:51:39.548 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/: 2023-08-10T10:51:39.549 INFO:teuthology.orchestra.run.smithi107.stdout:total 2 2023-08-10T10:51:39.549 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 . 2023-08-10T10:51:39.549 INFO:teuthology.orchestra.run.smithi107.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:39.549 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 data 2023-08-10T10:51:39.549 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:39.549 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data: 2023-08-10T10:51:39.550 INFO:teuthology.orchestra.run.smithi107.stdout:total 40 2023-08-10T10:51:39.550 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 . 2023-08-10T10:51:39.550 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:39.550 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22070793 Aug 10 10:51 base 2023-08-10T10:51:39.550 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Aug 10 10:51 global 2023-08-10T10:51:39.550 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 log 2023-08-10T10:51:39.550 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_commit_ts 2023-08-10T10:51:39.550 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_dynshmem 2023-08-10T10:51:39.551 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Aug 10 10:51 pg_hba.conf 2023-08-10T10:51:39.551 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Aug 10 10:51 pg_ident.conf 2023-08-10T10:51:39.551 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 10:51 pg_logical 2023-08-10T10:51:39.551 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 pg_multixact 2023-08-10T10:51:39.551 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 pg_notify 2023-08-10T10:51:39.552 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_replslot 2023-08-10T10:51:39.552 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_serial 2023-08-10T10:51:39.552 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_snapshots 2023-08-10T10:51:39.552 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_stat 2023-08-10T10:51:39.552 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_stat_tmp 2023-08-10T10:51:39.552 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 pg_subtrans 2023-08-10T10:51:39.552 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_tblspc 2023-08-10T10:51:39.553 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_twophase 2023-08-10T10:51:39.553 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 10 10:51 PG_VERSION 2023-08-10T10:51:39.553 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 10:51 pg_wal 2023-08-10T10:51:39.553 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 pg_xact 2023-08-10T10:51:39.553 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Aug 10 10:51 postgresql.auto.conf 2023-08-10T10:51:39.553 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Aug 10 10:51 postgresql.conf 2023-08-10T10:51:39.554 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:39.554 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/base: 2023-08-10T10:51:39.554 INFO:teuthology.orchestra.run.smithi107.stdout:total 3 2023-08-10T10:51:39.554 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22070793 Aug 10 10:51 . 2023-08-10T10:51:39.554 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:39.554 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 1 2023-08-10T10:51:39.554 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 12346 2023-08-10T10:51:39.554 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 12347 2023-08-10T10:51:39.555 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:39.555 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/base/1: 2023-08-10T10:51:39.555 INFO:teuthology.orchestra.run.smithi107.stdout:total 7186 2023-08-10T10:51:39.555 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 . 2023-08-10T10:51:39.555 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22070793 Aug 10 10:51 .. 2023-08-10T10:51:39.555 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 112 2023-08-10T10:51:39.555 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 113 2023-08-10T10:51:39.555 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 10 10:51 12182 2023-08-10T10:51:39.556 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12182_fsm 2023-08-10T10:51:39.556 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12182_vm 2023-08-10T10:51:39.556 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12184 2023-08-10T10:51:39.556 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12186 2023-08-10T10:51:39.556 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187 2023-08-10T10:51:39.556 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12187_fsm 2023-08-10T10:51:39.556 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187_vm 2023-08-10T10:51:39.557 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12189 2023-08-10T10:51:39.557 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12191 2023-08-10T10:51:39.557 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192 2023-08-10T10:51:39.557 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12192_fsm 2023-08-10T10:51:39.557 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192_vm 2023-08-10T10:51:39.557 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12194 2023-08-10T10:51:39.557 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12196 2023-08-10T10:51:39.557 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197 2023-08-10T10:51:39.558 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12197_fsm 2023-08-10T10:51:39.558 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197_vm 2023-08-10T10:51:39.558 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12199 2023-08-10T10:51:39.558 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12201 2023-08-10T10:51:39.558 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202 2023-08-10T10:51:39.558 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12202_fsm 2023-08-10T10:51:39.558 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202_vm 2023-08-10T10:51:39.559 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12204 2023-08-10T10:51:39.559 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12206 2023-08-10T10:51:39.559 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207 2023-08-10T10:51:39.559 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12207_fsm 2023-08-10T10:51:39.559 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207_vm 2023-08-10T10:51:39.559 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12209 2023-08-10T10:51:39.559 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12211 2023-08-10T10:51:39.560 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12212 2023-08-10T10:51:39.560 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12214 2023-08-10T10:51:39.560 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12216 2023-08-10T10:51:39.560 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 10 10:51 1247 2023-08-10T10:51:39.560 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1247_fsm 2023-08-10T10:51:39.560 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1247_vm 2023-08-10T10:51:39.561 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Aug 10 10:51 1249 2023-08-10T10:51:39.561 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1249_fsm 2023-08-10T10:51:39.561 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1249_vm 2023-08-10T10:51:39.561 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Aug 10 10:51 1255 2023-08-10T10:51:39.561 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1255_fsm 2023-08-10T10:51:39.561 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1255_vm 2023-08-10T10:51:39.561 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 10 10:51 1259 2023-08-10T10:51:39.561 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1259_fsm 2023-08-10T10:51:39.562 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1259_vm 2023-08-10T10:51:39.562 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417 2023-08-10T10:51:39.562 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417_vm 2023-08-10T10:51:39.562 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418 2023-08-10T10:51:39.562 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418_vm 2023-08-10T10:51:39.562 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 174 2023-08-10T10:51:39.563 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 175 2023-08-10T10:51:39.563 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2187 2023-08-10T10:51:39.563 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224 2023-08-10T10:51:39.563 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224_vm 2023-08-10T10:51:39.563 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328 2023-08-10T10:51:39.563 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328_vm 2023-08-10T10:51:39.564 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336 2023-08-10T10:51:39.564 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336_vm 2023-08-10T10:51:39.564 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2337 2023-08-10T10:51:39.564 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2600 2023-08-10T10:51:39.564 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2600_fsm 2023-08-10T10:51:39.565 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2600_vm 2023-08-10T10:51:39.565 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601 2023-08-10T10:51:39.565 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2601_fsm 2023-08-10T10:51:39.565 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601_vm 2023-08-10T10:51:39.565 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2602 2023-08-10T10:51:39.565 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2602_fsm 2023-08-10T10:51:39.565 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2602_vm 2023-08-10T10:51:39.565 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2603 2023-08-10T10:51:39.566 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2603_fsm 2023-08-10T10:51:39.566 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2603_vm 2023-08-10T10:51:39.566 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604 2023-08-10T10:51:39.566 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604_vm 2023-08-10T10:51:39.566 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2605 2023-08-10T10:51:39.566 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2605_fsm 2023-08-10T10:51:39.566 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2605_vm 2023-08-10T10:51:39.566 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606 2023-08-10T10:51:39.567 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2606_fsm 2023-08-10T10:51:39.567 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606_vm 2023-08-10T10:51:39.567 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607 2023-08-10T10:51:39.567 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607_fsm 2023-08-10T10:51:39.567 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2607_vm 2023-08-10T10:51:39.567 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Aug 10 10:51 2608 2023-08-10T10:51:39.567 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2608_fsm 2023-08-10T10:51:39.568 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2608_vm 2023-08-10T10:51:39.568 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Aug 10 10:51 2609 2023-08-10T10:51:39.568 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2609_fsm 2023-08-10T10:51:39.568 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2609_vm 2023-08-10T10:51:39.568 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610 2023-08-10T10:51:39.568 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610_fsm 2023-08-10T10:51:39.568 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2610_vm 2023-08-10T10:51:39.568 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611 2023-08-10T10:51:39.569 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611_vm 2023-08-10T10:51:39.569 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612 2023-08-10T10:51:39.569 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2612_fsm 2023-08-10T10:51:39.569 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612_vm 2023-08-10T10:51:39.569 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613 2023-08-10T10:51:39.569 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613_vm 2023-08-10T10:51:39.570 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615 2023-08-10T10:51:39.570 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2615_fsm 2023-08-10T10:51:39.570 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615_vm 2023-08-10T10:51:39.570 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616 2023-08-10T10:51:39.570 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616_fsm 2023-08-10T10:51:39.570 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2616_vm 2023-08-10T10:51:39.571 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 10 10:51 2617 2023-08-10T10:51:39.571 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2617_fsm 2023-08-10T10:51:39.571 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2617_vm 2023-08-10T10:51:39.571 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 10 10:51 2618 2023-08-10T10:51:39.571 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2618_fsm 2023-08-10T10:51:39.571 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2618_vm 2023-08-10T10:51:39.571 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 10 10:51 2619 2023-08-10T10:51:39.571 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2619_fsm 2023-08-10T10:51:39.572 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2619_vm 2023-08-10T10:51:39.572 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620 2023-08-10T10:51:39.572 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620_vm 2023-08-10T10:51:39.572 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2650 2023-08-10T10:51:39.572 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2651 2023-08-10T10:51:39.572 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2652 2023-08-10T10:51:39.572 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2653 2023-08-10T10:51:39.572 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2654 2023-08-10T10:51:39.573 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2655 2023-08-10T10:51:39.573 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2656 2023-08-10T10:51:39.573 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2657 2023-08-10T10:51:39.573 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 10 10:51 2658 2023-08-10T10:51:39.573 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2659 2023-08-10T10:51:39.573 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2660 2023-08-10T10:51:39.573 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2661 2023-08-10T10:51:39.574 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2662 2023-08-10T10:51:39.574 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2663 2023-08-10T10:51:39.574 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2664 2023-08-10T10:51:39.574 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2665 2023-08-10T10:51:39.574 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2666 2023-08-10T10:51:39.574 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2667 2023-08-10T10:51:39.574 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2668 2023-08-10T10:51:39.574 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2669 2023-08-10T10:51:39.575 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2670 2023-08-10T10:51:39.575 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 303104 Aug 10 10:51 2673 2023-08-10T10:51:39.575 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Aug 10 10:51 2674 2023-08-10T10:51:39.575 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Aug 10 10:51 2675 2023-08-10T10:51:39.575 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2678 2023-08-10T10:51:39.575 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2679 2023-08-10T10:51:39.575 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2680 2023-08-10T10:51:39.575 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2681 2023-08-10T10:51:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2682 2023-08-10T10:51:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2683 2023-08-10T10:51:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2684 2023-08-10T10:51:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2685 2023-08-10T10:51:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2686 2023-08-10T10:51:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2687 2023-08-10T10:51:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2688 2023-08-10T10:51:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2689 2023-08-10T10:51:39.577 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2690 2023-08-10T10:51:39.577 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Aug 10 10:51 2691 2023-08-10T10:51:39.577 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2692 2023-08-10T10:51:39.577 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2693 2023-08-10T10:51:39.577 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2696 2023-08-10T10:51:39.577 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2699 2023-08-10T10:51:39.577 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2701 2023-08-10T10:51:39.578 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2702 2023-08-10T10:51:39.578 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2703 2023-08-10T10:51:39.578 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2704 2023-08-10T10:51:39.578 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2753 2023-08-10T10:51:39.579 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2753_fsm 2023-08-10T10:51:39.579 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2753_vm 2023-08-10T10:51:39.579 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2754 2023-08-10T10:51:39.579 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2755 2023-08-10T10:51:39.580 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2756 2023-08-10T10:51:39.580 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2757 2023-08-10T10:51:39.580 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830 2023-08-10T10:51:39.581 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830_vm 2023-08-10T10:51:39.581 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2831 2023-08-10T10:51:39.581 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832 2023-08-10T10:51:39.581 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832_vm 2023-08-10T10:51:39.582 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2833 2023-08-10T10:51:39.582 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834 2023-08-10T10:51:39.582 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834_vm 2023-08-10T10:51:39.582 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2835 2023-08-10T10:51:39.583 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836 2023-08-10T10:51:39.583 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836_vm 2023-08-10T10:51:39.583 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2837 2023-08-10T10:51:39.583 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Aug 10 10:51 2838 2023-08-10T10:51:39.584 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2838_fsm 2023-08-10T10:51:39.584 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2838_vm 2023-08-10T10:51:39.584 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2839 2023-08-10T10:51:39.584 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840 2023-08-10T10:51:39.585 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840_fsm 2023-08-10T10:51:39.585 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2840_vm 2023-08-10T10:51:39.585 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2841 2023-08-10T10:51:39.585 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995 2023-08-10T10:51:39.586 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995_vm 2023-08-10T10:51:39.586 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2996 2023-08-10T10:51:39.586 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079 2023-08-10T10:51:39.587 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3079_fsm 2023-08-10T10:51:39.587 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079_vm 2023-08-10T10:51:39.587 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3080 2023-08-10T10:51:39.587 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3081 2023-08-10T10:51:39.588 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3085 2023-08-10T10:51:39.588 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118 2023-08-10T10:51:39.588 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118_vm 2023-08-10T10:51:39.588 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3119 2023-08-10T10:51:39.588 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3164 2023-08-10T10:51:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256 2023-08-10T10:51:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256_vm 2023-08-10T10:51:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3257 2023-08-10T10:51:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3258 2023-08-10T10:51:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350 2023-08-10T10:51:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350_vm 2023-08-10T10:51:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3351 2023-08-10T10:51:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3379 2023-08-10T10:51:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3380 2023-08-10T10:51:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381 2023-08-10T10:51:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381_vm 2023-08-10T10:51:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3394 2023-08-10T10:51:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3394_fsm 2023-08-10T10:51:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3394_vm 2023-08-10T10:51:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3395 2023-08-10T10:51:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439 2023-08-10T10:51:39.591 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439_vm 2023-08-10T10:51:39.591 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3440 2023-08-10T10:51:39.591 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 3455 2023-08-10T10:51:39.591 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3456 2023-08-10T10:51:39.591 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3456_fsm 2023-08-10T10:51:39.591 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3456_vm 2023-08-10T10:51:39.591 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466 2023-08-10T10:51:39.591 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466_vm 2023-08-10T10:51:39.592 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3467 2023-08-10T10:51:39.592 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3468 2023-08-10T10:51:39.592 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501 2023-08-10T10:51:39.592 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501_vm 2023-08-10T10:51:39.592 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3502 2023-08-10T10:51:39.592 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3503 2023-08-10T10:51:39.592 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3534 2023-08-10T10:51:39.593 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541 2023-08-10T10:51:39.593 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3541_fsm 2023-08-10T10:51:39.593 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541_vm 2023-08-10T10:51:39.593 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3542 2023-08-10T10:51:39.593 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3574 2023-08-10T10:51:39.593 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3575 2023-08-10T10:51:39.593 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576 2023-08-10T10:51:39.593 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576_vm 2023-08-10T10:51:39.594 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596 2023-08-10T10:51:39.594 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596_vm 2023-08-10T10:51:39.594 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3597 2023-08-10T10:51:39.594 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598 2023-08-10T10:51:39.594 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598_vm 2023-08-10T10:51:39.594 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3599 2023-08-10T10:51:39.594 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600 2023-08-10T10:51:39.594 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3600_fsm 2023-08-10T10:51:39.595 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600_vm 2023-08-10T10:51:39.595 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601 2023-08-10T10:51:39.595 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3601_fsm 2023-08-10T10:51:39.595 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601_vm 2023-08-10T10:51:39.595 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602 2023-08-10T10:51:39.595 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3602_fsm 2023-08-10T10:51:40.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:39 smithi157 ceph-mon[129604]: pgmap v16: 129 pgs: 129 active+clean; 43 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 3.0 MiB/s wr, 92 op/s 2023-08-10T10:51:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:39 smithi107 ceph-mon[127953]: pgmap v16: 129 pgs: 129 active+clean; 43 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 3.0 MiB/s wr, 92 op/s 2023-08-10T10:51:40.094 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602_vm 2023-08-10T10:51:40.095 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3603 2023-08-10T10:51:40.095 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3603_fsm 2023-08-10T10:51:40.095 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3603_vm 2023-08-10T10:51:40.095 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3604 2023-08-10T10:51:40.095 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3605 2023-08-10T10:51:40.095 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3606 2023-08-10T10:51:40.095 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3607 2023-08-10T10:51:40.096 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3608 2023-08-10T10:51:40.096 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 3609 2023-08-10T10:51:40.096 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3712 2023-08-10T10:51:40.096 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764 2023-08-10T10:51:40.096 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3764_fsm 2023-08-10T10:51:40.096 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764_vm 2023-08-10T10:51:40.096 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3766 2023-08-10T10:51:40.096 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3767 2023-08-10T10:51:40.097 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3997 2023-08-10T10:51:40.097 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 5002 2023-08-10T10:51:40.097 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 548 2023-08-10T10:51:40.097 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 549 2023-08-10T10:51:40.097 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102 2023-08-10T10:51:40.097 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102_vm 2023-08-10T10:51:40.097 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104 2023-08-10T10:51:40.098 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104_vm 2023-08-10T10:51:40.098 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106 2023-08-10T10:51:40.098 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106_vm 2023-08-10T10:51:40.098 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6110 2023-08-10T10:51:40.098 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6111 2023-08-10T10:51:40.098 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6112 2023-08-10T10:51:40.098 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6113 2023-08-10T10:51:40.098 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6117 2023-08-10T10:51:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826 2023-08-10T10:51:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826_vm 2023-08-10T10:51:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 827 2023-08-10T10:51:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 828 2023-08-10T10:51:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 10 10:51 pg_filenode.map 2023-08-10T10:51:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 10 10:51 PG_VERSION 2023-08-10T10:51:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-08-10T10:51:40.100 INFO:teuthology.orchestra.run.smithi107.stdout:total 7186 2023-08-10T10:51:40.100 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 . 2023-08-10T10:51:40.100 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22070793 Aug 10 10:51 .. 2023-08-10T10:51:40.100 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 112 2023-08-10T10:51:40.100 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 113 2023-08-10T10:51:40.100 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 10 10:51 12182 2023-08-10T10:51:40.101 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12182_fsm 2023-08-10T10:51:40.101 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12182_vm 2023-08-10T10:51:40.101 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12184 2023-08-10T10:51:40.101 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12186 2023-08-10T10:51:40.101 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187 2023-08-10T10:51:40.101 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12187_fsm 2023-08-10T10:51:40.101 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187_vm 2023-08-10T10:51:40.102 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12189 2023-08-10T10:51:40.102 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12191 2023-08-10T10:51:40.102 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192 2023-08-10T10:51:40.102 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12192_fsm 2023-08-10T10:51:40.102 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192_vm 2023-08-10T10:51:40.102 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12194 2023-08-10T10:51:40.102 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12196 2023-08-10T10:51:40.102 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197 2023-08-10T10:51:40.103 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12197_fsm 2023-08-10T10:51:40.103 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197_vm 2023-08-10T10:51:40.103 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12199 2023-08-10T10:51:40.103 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12201 2023-08-10T10:51:40.103 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202 2023-08-10T10:51:40.103 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12202_fsm 2023-08-10T10:51:40.103 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202_vm 2023-08-10T10:51:40.104 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12204 2023-08-10T10:51:40.104 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12206 2023-08-10T10:51:40.104 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207 2023-08-10T10:51:40.104 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12207_fsm 2023-08-10T10:51:40.104 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207_vm 2023-08-10T10:51:40.104 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12209 2023-08-10T10:51:40.104 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12211 2023-08-10T10:51:40.104 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12212 2023-08-10T10:51:40.105 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12214 2023-08-10T10:51:40.105 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12216 2023-08-10T10:51:40.105 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 10 10:51 1247 2023-08-10T10:51:40.105 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1247_fsm 2023-08-10T10:51:40.105 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1247_vm 2023-08-10T10:51:40.105 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Aug 10 10:51 1249 2023-08-10T10:51:40.105 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1249_fsm 2023-08-10T10:51:40.105 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1249_vm 2023-08-10T10:51:40.106 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Aug 10 10:51 1255 2023-08-10T10:51:40.106 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1255_fsm 2023-08-10T10:51:40.106 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1255_vm 2023-08-10T10:51:40.106 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 10 10:51 1259 2023-08-10T10:51:40.106 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1259_fsm 2023-08-10T10:51:40.106 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1259_vm 2023-08-10T10:51:40.106 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417 2023-08-10T10:51:40.107 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417_vm 2023-08-10T10:51:40.107 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418 2023-08-10T10:51:40.107 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418_vm 2023-08-10T10:51:40.107 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 174 2023-08-10T10:51:40.107 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 175 2023-08-10T10:51:40.107 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2187 2023-08-10T10:51:40.107 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224 2023-08-10T10:51:40.107 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224_vm 2023-08-10T10:51:40.108 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328 2023-08-10T10:51:40.108 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328_vm 2023-08-10T10:51:40.108 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336 2023-08-10T10:51:40.108 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336_vm 2023-08-10T10:51:40.108 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2337 2023-08-10T10:51:40.108 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2600 2023-08-10T10:51:40.108 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2600_fsm 2023-08-10T10:51:40.108 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2600_vm 2023-08-10T10:51:40.109 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601 2023-08-10T10:51:40.109 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2601_fsm 2023-08-10T10:51:40.109 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601_vm 2023-08-10T10:51:40.109 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2602 2023-08-10T10:51:40.109 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2602_fsm 2023-08-10T10:51:40.109 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2602_vm 2023-08-10T10:51:40.109 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2603 2023-08-10T10:51:40.109 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2603_fsm 2023-08-10T10:51:40.110 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2603_vm 2023-08-10T10:51:40.110 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604 2023-08-10T10:51:40.110 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604_vm 2023-08-10T10:51:40.110 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2605 2023-08-10T10:51:40.110 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2605_fsm 2023-08-10T10:51:40.110 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2605_vm 2023-08-10T10:51:40.110 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606 2023-08-10T10:51:40.110 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2606_fsm 2023-08-10T10:51:40.111 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606_vm 2023-08-10T10:51:40.111 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607 2023-08-10T10:51:40.111 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607_fsm 2023-08-10T10:51:40.111 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2607_vm 2023-08-10T10:51:40.111 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Aug 10 10:51 2608 2023-08-10T10:51:40.111 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2608_fsm 2023-08-10T10:51:40.111 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2608_vm 2023-08-10T10:51:40.111 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Aug 10 10:51 2609 2023-08-10T10:51:40.112 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2609_fsm 2023-08-10T10:51:40.112 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2609_vm 2023-08-10T10:51:40.112 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610 2023-08-10T10:51:40.112 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610_fsm 2023-08-10T10:51:40.112 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2610_vm 2023-08-10T10:51:40.112 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611 2023-08-10T10:51:40.112 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611_vm 2023-08-10T10:51:40.113 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612 2023-08-10T10:51:40.113 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2612_fsm 2023-08-10T10:51:40.113 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612_vm 2023-08-10T10:51:40.113 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613 2023-08-10T10:51:40.113 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613_vm 2023-08-10T10:51:40.113 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615 2023-08-10T10:51:40.113 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2615_fsm 2023-08-10T10:51:40.114 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615_vm 2023-08-10T10:51:40.114 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616 2023-08-10T10:51:40.114 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616_fsm 2023-08-10T10:51:40.114 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2616_vm 2023-08-10T10:51:40.114 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 10 10:51 2617 2023-08-10T10:51:40.114 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2617_fsm 2023-08-10T10:51:40.114 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2617_vm 2023-08-10T10:51:40.114 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 10 10:51 2618 2023-08-10T10:51:40.115 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2618_fsm 2023-08-10T10:51:40.115 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2618_vm 2023-08-10T10:51:40.115 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 10 10:51 2619 2023-08-10T10:51:40.115 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2619_fsm 2023-08-10T10:51:40.115 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2619_vm 2023-08-10T10:51:40.115 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620 2023-08-10T10:51:40.115 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620_vm 2023-08-10T10:51:40.115 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2650 2023-08-10T10:51:40.116 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2651 2023-08-10T10:51:40.116 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2652 2023-08-10T10:51:40.116 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2653 2023-08-10T10:51:40.116 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2654 2023-08-10T10:51:40.116 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2655 2023-08-10T10:51:40.116 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2656 2023-08-10T10:51:40.116 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2657 2023-08-10T10:51:40.116 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 10 10:51 2658 2023-08-10T10:51:40.117 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2659 2023-08-10T10:51:40.117 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2660 2023-08-10T10:51:40.117 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2661 2023-08-10T10:51:40.117 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2662 2023-08-10T10:51:40.117 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2663 2023-08-10T10:51:40.117 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2664 2023-08-10T10:51:40.117 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2665 2023-08-10T10:51:40.117 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2666 2023-08-10T10:51:40.118 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2667 2023-08-10T10:51:40.118 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2668 2023-08-10T10:51:40.118 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2669 2023-08-10T10:51:40.118 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2670 2023-08-10T10:51:40.118 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 303104 Aug 10 10:51 2673 2023-08-10T10:51:40.118 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Aug 10 10:51 2674 2023-08-10T10:51:40.118 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Aug 10 10:51 2675 2023-08-10T10:51:40.118 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2678 2023-08-10T10:51:40.119 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2679 2023-08-10T10:51:40.119 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2680 2023-08-10T10:51:40.119 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2681 2023-08-10T10:51:40.119 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2682 2023-08-10T10:51:40.119 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2683 2023-08-10T10:51:40.119 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2684 2023-08-10T10:51:40.119 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2685 2023-08-10T10:51:40.119 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2686 2023-08-10T10:51:40.120 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2687 2023-08-10T10:51:40.120 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2688 2023-08-10T10:51:40.120 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2689 2023-08-10T10:51:40.120 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2690 2023-08-10T10:51:40.120 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Aug 10 10:51 2691 2023-08-10T10:51:40.120 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2692 2023-08-10T10:51:40.120 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2693 2023-08-10T10:51:40.120 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2696 2023-08-10T10:51:40.121 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2699 2023-08-10T10:51:40.121 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2701 2023-08-10T10:51:40.121 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2702 2023-08-10T10:51:40.121 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2703 2023-08-10T10:51:40.121 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2704 2023-08-10T10:51:40.121 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2753 2023-08-10T10:51:40.121 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2753_fsm 2023-08-10T10:51:40.122 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2753_vm 2023-08-10T10:51:40.122 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2754 2023-08-10T10:51:40.122 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2755 2023-08-10T10:51:40.122 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2756 2023-08-10T10:51:40.122 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2757 2023-08-10T10:51:40.122 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830 2023-08-10T10:51:40.122 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830_vm 2023-08-10T10:51:40.122 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2831 2023-08-10T10:51:40.123 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832 2023-08-10T10:51:40.123 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832_vm 2023-08-10T10:51:40.123 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2833 2023-08-10T10:51:40.123 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834 2023-08-10T10:51:40.123 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834_vm 2023-08-10T10:51:40.123 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2835 2023-08-10T10:51:40.123 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836 2023-08-10T10:51:40.123 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836_vm 2023-08-10T10:51:40.124 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2837 2023-08-10T10:51:40.124 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Aug 10 10:51 2838 2023-08-10T10:51:40.124 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2838_fsm 2023-08-10T10:51:40.124 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2838_vm 2023-08-10T10:51:40.124 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2839 2023-08-10T10:51:40.124 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840 2023-08-10T10:51:40.124 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840_fsm 2023-08-10T10:51:40.124 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2840_vm 2023-08-10T10:51:40.125 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2841 2023-08-10T10:51:40.125 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995 2023-08-10T10:51:40.125 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995_vm 2023-08-10T10:51:40.125 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2996 2023-08-10T10:51:40.125 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079 2023-08-10T10:51:40.125 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3079_fsm 2023-08-10T10:51:40.125 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079_vm 2023-08-10T10:51:40.125 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3080 2023-08-10T10:51:40.126 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3081 2023-08-10T10:51:40.126 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3085 2023-08-10T10:51:40.126 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118 2023-08-10T10:51:40.126 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118_vm 2023-08-10T10:51:40.126 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3119 2023-08-10T10:51:40.126 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3164 2023-08-10T10:51:40.126 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256 2023-08-10T10:51:40.126 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256_vm 2023-08-10T10:51:40.127 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3257 2023-08-10T10:51:40.127 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3258 2023-08-10T10:51:40.127 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350 2023-08-10T10:51:40.127 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350_vm 2023-08-10T10:51:40.127 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3351 2023-08-10T10:51:40.127 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3379 2023-08-10T10:51:40.127 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3380 2023-08-10T10:51:40.127 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381 2023-08-10T10:51:40.128 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381_vm 2023-08-10T10:51:40.128 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3394 2023-08-10T10:51:40.128 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3394_fsm 2023-08-10T10:51:40.128 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3394_vm 2023-08-10T10:51:40.128 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3395 2023-08-10T10:51:40.128 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439 2023-08-10T10:51:40.128 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439_vm 2023-08-10T10:51:40.129 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3440 2023-08-10T10:51:40.129 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 3455 2023-08-10T10:51:40.129 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3456 2023-08-10T10:51:40.129 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3456_fsm 2023-08-10T10:51:40.129 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3456_vm 2023-08-10T10:51:40.129 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466 2023-08-10T10:51:40.129 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466_vm 2023-08-10T10:51:40.129 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3467 2023-08-10T10:51:40.130 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3468 2023-08-10T10:51:40.130 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501 2023-08-10T10:51:40.130 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501_vm 2023-08-10T10:51:40.130 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3502 2023-08-10T10:51:40.130 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3503 2023-08-10T10:51:40.130 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3534 2023-08-10T10:51:40.130 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541 2023-08-10T10:51:40.130 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3541_fsm 2023-08-10T10:51:40.131 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541_vm 2023-08-10T10:51:40.131 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3542 2023-08-10T10:51:40.131 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3574 2023-08-10T10:51:40.131 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3575 2023-08-10T10:51:40.131 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576 2023-08-10T10:51:40.131 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576_vm 2023-08-10T10:51:40.131 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596 2023-08-10T10:51:40.131 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596_vm 2023-08-10T10:51:40.132 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3597 2023-08-10T10:51:40.132 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598 2023-08-10T10:51:40.132 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598_vm 2023-08-10T10:51:40.132 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3599 2023-08-10T10:51:40.132 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600 2023-08-10T10:51:40.132 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3600_fsm 2023-08-10T10:51:40.132 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600_vm 2023-08-10T10:51:40.132 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601 2023-08-10T10:51:40.133 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3601_fsm 2023-08-10T10:51:40.133 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601_vm 2023-08-10T10:51:40.133 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602 2023-08-10T10:51:40.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:39 smithi195 ceph-mon[129938]: pgmap v16: 129 pgs: 129 active+clean; 43 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 3.0 MiB/s wr, 92 op/s 2023-08-10T10:51:40.647 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3602_fsm 2023-08-10T10:51:40.648 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602_vm 2023-08-10T10:51:40.648 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3603 2023-08-10T10:51:40.648 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3603_fsm 2023-08-10T10:51:40.648 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3603_vm 2023-08-10T10:51:40.648 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3604 2023-08-10T10:51:40.648 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3605 2023-08-10T10:51:40.648 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3606 2023-08-10T10:51:40.649 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3607 2023-08-10T10:51:40.649 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3608 2023-08-10T10:51:40.649 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 3609 2023-08-10T10:51:40.649 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3712 2023-08-10T10:51:40.649 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764 2023-08-10T10:51:40.649 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3764_fsm 2023-08-10T10:51:40.649 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764_vm 2023-08-10T10:51:40.649 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3766 2023-08-10T10:51:40.650 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3767 2023-08-10T10:51:40.650 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3997 2023-08-10T10:51:40.650 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 5002 2023-08-10T10:51:40.650 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 548 2023-08-10T10:51:40.650 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 549 2023-08-10T10:51:40.650 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102 2023-08-10T10:51:40.650 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102_vm 2023-08-10T10:51:40.651 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104 2023-08-10T10:51:40.651 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104_vm 2023-08-10T10:51:40.651 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106 2023-08-10T10:51:40.651 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106_vm 2023-08-10T10:51:40.651 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6110 2023-08-10T10:51:40.651 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6111 2023-08-10T10:51:40.651 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6112 2023-08-10T10:51:40.651 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6113 2023-08-10T10:51:40.652 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6117 2023-08-10T10:51:40.652 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826 2023-08-10T10:51:40.652 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826_vm 2023-08-10T10:51:40.652 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 827 2023-08-10T10:51:40.652 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 828 2023-08-10T10:51:40.652 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 10 10:51 pg_filenode.map 2023-08-10T10:51:40.652 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 10 10:51 PG_VERSION 2023-08-10T10:51:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.653 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-08-10T10:51:40.653 INFO:teuthology.orchestra.run.smithi107.stdout:total 7186 2023-08-10T10:51:40.653 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 . 2023-08-10T10:51:40.653 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22070793 Aug 10 10:51 .. 2023-08-10T10:51:40.653 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 112 2023-08-10T10:51:40.653 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 113 2023-08-10T10:51:40.654 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 10 10:51 12182 2023-08-10T10:51:40.655 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12182_fsm 2023-08-10T10:51:40.655 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12182_vm 2023-08-10T10:51:40.655 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12184 2023-08-10T10:51:40.655 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12186 2023-08-10T10:51:40.655 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187 2023-08-10T10:51:40.655 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12187_fsm 2023-08-10T10:51:40.655 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187_vm 2023-08-10T10:51:40.655 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12189 2023-08-10T10:51:40.656 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12191 2023-08-10T10:51:40.656 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192 2023-08-10T10:51:40.656 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12192_fsm 2023-08-10T10:51:40.656 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192_vm 2023-08-10T10:51:40.656 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12194 2023-08-10T10:51:40.656 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12196 2023-08-10T10:51:40.656 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197 2023-08-10T10:51:40.657 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12197_fsm 2023-08-10T10:51:40.657 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197_vm 2023-08-10T10:51:40.657 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12199 2023-08-10T10:51:40.657 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12201 2023-08-10T10:51:40.657 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202 2023-08-10T10:51:40.657 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12202_fsm 2023-08-10T10:51:40.657 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202_vm 2023-08-10T10:51:40.657 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12204 2023-08-10T10:51:40.658 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12206 2023-08-10T10:51:40.658 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207 2023-08-10T10:51:40.658 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12207_fsm 2023-08-10T10:51:40.658 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207_vm 2023-08-10T10:51:40.658 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12209 2023-08-10T10:51:40.658 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12211 2023-08-10T10:51:40.658 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12212 2023-08-10T10:51:40.658 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12214 2023-08-10T10:51:40.659 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12216 2023-08-10T10:51:40.659 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 10 10:51 1247 2023-08-10T10:51:40.659 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1247_fsm 2023-08-10T10:51:40.659 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1247_vm 2023-08-10T10:51:40.659 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Aug 10 10:51 1249 2023-08-10T10:51:40.659 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1249_fsm 2023-08-10T10:51:40.659 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1249_vm 2023-08-10T10:51:40.659 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Aug 10 10:51 1255 2023-08-10T10:51:40.660 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1255_fsm 2023-08-10T10:51:40.660 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1255_vm 2023-08-10T10:51:40.660 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 10 10:51 1259 2023-08-10T10:51:40.660 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1259_fsm 2023-08-10T10:51:40.660 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1259_vm 2023-08-10T10:51:40.660 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417 2023-08-10T10:51:40.660 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417_vm 2023-08-10T10:51:40.661 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418 2023-08-10T10:51:40.661 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418_vm 2023-08-10T10:51:40.661 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 174 2023-08-10T10:51:40.661 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 175 2023-08-10T10:51:40.661 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2187 2023-08-10T10:51:40.661 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224 2023-08-10T10:51:40.661 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224_vm 2023-08-10T10:51:40.661 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328 2023-08-10T10:51:40.662 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328_vm 2023-08-10T10:51:40.662 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336 2023-08-10T10:51:40.662 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336_vm 2023-08-10T10:51:40.662 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2337 2023-08-10T10:51:40.662 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2600 2023-08-10T10:51:40.662 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2600_fsm 2023-08-10T10:51:40.662 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2600_vm 2023-08-10T10:51:40.662 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601 2023-08-10T10:51:40.663 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2601_fsm 2023-08-10T10:51:40.663 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601_vm 2023-08-10T10:51:40.663 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2602 2023-08-10T10:51:40.663 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2602_fsm 2023-08-10T10:51:40.663 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2602_vm 2023-08-10T10:51:40.663 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2603 2023-08-10T10:51:40.663 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2603_fsm 2023-08-10T10:51:40.663 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2603_vm 2023-08-10T10:51:40.664 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604 2023-08-10T10:51:40.664 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604_vm 2023-08-10T10:51:40.664 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2605 2023-08-10T10:51:40.664 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2605_fsm 2023-08-10T10:51:40.664 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2605_vm 2023-08-10T10:51:40.664 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606 2023-08-10T10:51:40.664 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2606_fsm 2023-08-10T10:51:40.664 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606_vm 2023-08-10T10:51:40.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607 2023-08-10T10:51:40.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607_fsm 2023-08-10T10:51:40.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2607_vm 2023-08-10T10:51:40.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Aug 10 10:51 2608 2023-08-10T10:51:40.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2608_fsm 2023-08-10T10:51:40.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2608_vm 2023-08-10T10:51:40.665 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Aug 10 10:51 2609 2023-08-10T10:51:40.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2609_fsm 2023-08-10T10:51:40.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2609_vm 2023-08-10T10:51:40.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610 2023-08-10T10:51:40.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610_fsm 2023-08-10T10:51:40.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2610_vm 2023-08-10T10:51:40.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611 2023-08-10T10:51:40.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611_vm 2023-08-10T10:51:40.666 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612 2023-08-10T10:51:40.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2612_fsm 2023-08-10T10:51:40.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612_vm 2023-08-10T10:51:40.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613 2023-08-10T10:51:40.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613_vm 2023-08-10T10:51:40.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615 2023-08-10T10:51:40.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2615_fsm 2023-08-10T10:51:40.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615_vm 2023-08-10T10:51:40.667 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616 2023-08-10T10:51:40.668 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616_fsm 2023-08-10T10:51:40.668 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2616_vm 2023-08-10T10:51:40.668 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 10 10:51 2617 2023-08-10T10:51:40.668 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2617_fsm 2023-08-10T10:51:40.668 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2617_vm 2023-08-10T10:51:40.668 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 10 10:51 2618 2023-08-10T10:51:40.668 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2618_fsm 2023-08-10T10:51:40.669 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2618_vm 2023-08-10T10:51:40.669 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 10 10:51 2619 2023-08-10T10:51:40.669 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2619_fsm 2023-08-10T10:51:40.669 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2619_vm 2023-08-10T10:51:40.669 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620 2023-08-10T10:51:40.669 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620_vm 2023-08-10T10:51:40.669 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2650 2023-08-10T10:51:40.669 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2651 2023-08-10T10:51:40.670 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2652 2023-08-10T10:51:40.670 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2653 2023-08-10T10:51:40.670 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2654 2023-08-10T10:51:40.670 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2655 2023-08-10T10:51:40.670 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2656 2023-08-10T10:51:40.670 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2657 2023-08-10T10:51:40.670 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 10 10:51 2658 2023-08-10T10:51:40.670 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2659 2023-08-10T10:51:40.671 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2660 2023-08-10T10:51:40.671 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2661 2023-08-10T10:51:40.671 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2662 2023-08-10T10:51:40.671 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2663 2023-08-10T10:51:40.671 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2664 2023-08-10T10:51:40.671 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2665 2023-08-10T10:51:40.671 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2666 2023-08-10T10:51:40.671 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2667 2023-08-10T10:51:40.672 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2668 2023-08-10T10:51:40.672 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2669 2023-08-10T10:51:40.672 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2670 2023-08-10T10:51:40.672 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 303104 Aug 10 10:51 2673 2023-08-10T10:51:40.672 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Aug 10 10:51 2674 2023-08-10T10:51:40.672 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Aug 10 10:51 2675 2023-08-10T10:51:40.672 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2678 2023-08-10T10:51:40.672 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2679 2023-08-10T10:51:40.673 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2680 2023-08-10T10:51:40.673 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2681 2023-08-10T10:51:40.673 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2682 2023-08-10T10:51:40.673 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2683 2023-08-10T10:51:40.673 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2684 2023-08-10T10:51:40.673 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2685 2023-08-10T10:51:40.673 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2686 2023-08-10T10:51:40.673 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2687 2023-08-10T10:51:40.674 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2688 2023-08-10T10:51:40.674 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2689 2023-08-10T10:51:40.674 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2690 2023-08-10T10:51:40.674 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Aug 10 10:51 2691 2023-08-10T10:51:40.674 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2692 2023-08-10T10:51:40.674 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2693 2023-08-10T10:51:40.674 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2696 2023-08-10T10:51:40.674 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2699 2023-08-10T10:51:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2701 2023-08-10T10:51:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2702 2023-08-10T10:51:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2703 2023-08-10T10:51:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2704 2023-08-10T10:51:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2753 2023-08-10T10:51:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2753_fsm 2023-08-10T10:51:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2753_vm 2023-08-10T10:51:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2754 2023-08-10T10:51:40.676 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2755 2023-08-10T10:51:40.676 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2756 2023-08-10T10:51:40.676 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2757 2023-08-10T10:51:40.676 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830 2023-08-10T10:51:40.676 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830_vm 2023-08-10T10:51:40.676 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2831 2023-08-10T10:51:40.676 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832 2023-08-10T10:51:40.677 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832_vm 2023-08-10T10:51:40.677 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2833 2023-08-10T10:51:40.677 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834 2023-08-10T10:51:40.677 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834_vm 2023-08-10T10:51:40.677 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2835 2023-08-10T10:51:40.677 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836 2023-08-10T10:51:40.677 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836_vm 2023-08-10T10:51:40.677 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2837 2023-08-10T10:51:40.678 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Aug 10 10:51 2838 2023-08-10T10:51:40.678 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2838_fsm 2023-08-10T10:51:40.678 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2838_vm 2023-08-10T10:51:40.678 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2839 2023-08-10T10:51:40.678 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840 2023-08-10T10:51:40.678 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840_fsm 2023-08-10T10:51:40.678 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2840_vm 2023-08-10T10:51:40.678 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2841 2023-08-10T10:51:40.679 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995 2023-08-10T10:51:40.679 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995_vm 2023-08-10T10:51:40.679 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2996 2023-08-10T10:51:40.679 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079 2023-08-10T10:51:40.679 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3079_fsm 2023-08-10T10:51:40.679 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079_vm 2023-08-10T10:51:40.679 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3080 2023-08-10T10:51:40.679 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3081 2023-08-10T10:51:40.680 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3085 2023-08-10T10:51:40.680 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118 2023-08-10T10:51:40.680 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118_vm 2023-08-10T10:51:40.680 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3119 2023-08-10T10:51:40.680 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3164 2023-08-10T10:51:40.680 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256 2023-08-10T10:51:40.680 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256_vm 2023-08-10T10:51:40.681 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3257 2023-08-10T10:51:40.681 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3258 2023-08-10T10:51:40.681 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350 2023-08-10T10:51:40.681 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350_vm 2023-08-10T10:51:40.681 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3351 2023-08-10T10:51:40.681 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3379 2023-08-10T10:51:40.681 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3380 2023-08-10T10:51:40.681 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381 2023-08-10T10:51:40.682 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381_vm 2023-08-10T10:51:40.682 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3394 2023-08-10T10:51:40.682 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3394_fsm 2023-08-10T10:51:40.682 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3394_vm 2023-08-10T10:51:40.682 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3395 2023-08-10T10:51:40.682 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439 2023-08-10T10:51:40.682 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439_vm 2023-08-10T10:51:40.682 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3440 2023-08-10T10:51:40.683 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 3455 2023-08-10T10:51:40.683 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3456 2023-08-10T10:51:40.683 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3456_fsm 2023-08-10T10:51:40.683 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3456_vm 2023-08-10T10:51:40.683 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466 2023-08-10T10:51:40.683 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466_vm 2023-08-10T10:51:40.683 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3467 2023-08-10T10:51:40.683 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3468 2023-08-10T10:51:40.684 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501 2023-08-10T10:51:40.684 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501_vm 2023-08-10T10:51:40.684 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3502 2023-08-10T10:51:40.684 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3503 2023-08-10T10:51:40.684 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3534 2023-08-10T10:51:40.684 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541 2023-08-10T10:51:40.684 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3541_fsm 2023-08-10T10:51:40.685 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541_vm 2023-08-10T10:51:40.685 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3542 2023-08-10T10:51:40.685 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3574 2023-08-10T10:51:40.685 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3575 2023-08-10T10:51:40.685 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576 2023-08-10T10:51:40.685 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576_vm 2023-08-10T10:51:40.685 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596 2023-08-10T10:51:40.685 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596_vm 2023-08-10T10:51:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3597 2023-08-10T10:51:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598 2023-08-10T10:51:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598_vm 2023-08-10T10:51:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3599 2023-08-10T10:51:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600 2023-08-10T10:51:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3600_fsm 2023-08-10T10:51:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600_vm 2023-08-10T10:51:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601 2023-08-10T10:51:40.687 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3601_fsm 2023-08-10T10:51:40.687 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601_vm 2023-08-10T10:51:40.687 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602 2023-08-10T10:51:40.740 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3602_fsm 2023-08-10T10:51:40.741 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602_vm 2023-08-10T10:51:40.741 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3603 2023-08-10T10:51:40.741 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3603_fsm 2023-08-10T10:51:40.741 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3603_vm 2023-08-10T10:51:40.741 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3604 2023-08-10T10:51:40.742 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3605 2023-08-10T10:51:40.742 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3606 2023-08-10T10:51:40.742 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3607 2023-08-10T10:51:40.742 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3608 2023-08-10T10:51:40.742 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 3609 2023-08-10T10:51:40.742 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3712 2023-08-10T10:51:40.742 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764 2023-08-10T10:51:40.742 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3764_fsm 2023-08-10T10:51:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764_vm 2023-08-10T10:51:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3766 2023-08-10T10:51:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3767 2023-08-10T10:51:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3997 2023-08-10T10:51:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 5002 2023-08-10T10:51:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 548 2023-08-10T10:51:40.743 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 549 2023-08-10T10:51:40.744 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102 2023-08-10T10:51:40.744 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102_vm 2023-08-10T10:51:40.744 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104 2023-08-10T10:51:40.744 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104_vm 2023-08-10T10:51:40.744 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106 2023-08-10T10:51:40.744 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106_vm 2023-08-10T10:51:40.744 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6110 2023-08-10T10:51:40.745 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6111 2023-08-10T10:51:40.745 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6112 2023-08-10T10:51:40.745 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6113 2023-08-10T10:51:40.745 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6117 2023-08-10T10:51:40.745 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826 2023-08-10T10:51:40.745 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826_vm 2023-08-10T10:51:40.745 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 827 2023-08-10T10:51:40.745 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 828 2023-08-10T10:51:40.746 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 10 10:51 pg_filenode.map 2023-08-10T10:51:40.746 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 10 10:51 PG_VERSION 2023-08-10T10:51:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.746 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/global: 2023-08-10T10:51:40.746 INFO:teuthology.orchestra.run.smithi107.stdout:total 554 2023-08-10T10:51:40.746 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Aug 10 10:51 . 2023-08-10T10:51:40.746 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.746 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1136 2023-08-10T10:51:40.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1136_fsm 2023-08-10T10:51:40.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1136_vm 2023-08-10T10:51:40.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 1137 2023-08-10T10:51:40.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1213 2023-08-10T10:51:40.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1213_fsm 2023-08-10T10:51:40.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1213_vm 2023-08-10T10:51:40.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1214 2023-08-10T10:51:40.747 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1214_fsm 2023-08-10T10:51:40.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1214_vm 2023-08-10T10:51:40.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 1232 2023-08-10T10:51:40.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 1233 2023-08-10T10:51:40.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1260 2023-08-10T10:51:40.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1260_fsm 2023-08-10T10:51:40.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1260_vm 2023-08-10T10:51:40.748 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1261 2023-08-10T10:51:40.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1261_fsm 2023-08-10T10:51:40.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1261_vm 2023-08-10T10:51:40.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1262 2023-08-10T10:51:40.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1262_fsm 2023-08-10T10:51:40.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1262_vm 2023-08-10T10:51:40.749 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2396 2023-08-10T10:51:40.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2396_fsm 2023-08-10T10:51:40.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2396_vm 2023-08-10T10:51:40.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2397 2023-08-10T10:51:40.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2671 2023-08-10T10:51:40.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2672 2023-08-10T10:51:40.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2676 2023-08-10T10:51:40.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2677 2023-08-10T10:51:40.750 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2694 2023-08-10T10:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2695 2023-08-10T10:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2697 2023-08-10T10:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2698 2023-08-10T10:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2846 2023-08-10T10:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2846_vm 2023-08-10T10:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2847 2023-08-10T10:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2964 2023-08-10T10:51:40.751 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2964_vm 2023-08-10T10:51:40.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2965 2023-08-10T10:51:40.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2966 2023-08-10T10:51:40.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2966_vm 2023-08-10T10:51:40.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2967 2023-08-10T10:51:40.752 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3592 2023-08-10T10:51:40.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3592_vm 2023-08-10T10:51:40.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3593 2023-08-10T10:51:40.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 4060 2023-08-10T10:51:40.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 4060_vm 2023-08-10T10:51:40.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 4061 2023-08-10T10:51:40.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6000 2023-08-10T10:51:40.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6000_vm 2023-08-10T10:51:40.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6001 2023-08-10T10:51:40.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6002 2023-08-10T10:51:40.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6100 2023-08-10T10:51:40.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6100_vm 2023-08-10T10:51:40.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6114 2023-08-10T10:51:40.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6115 2023-08-10T10:51:40.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 pg_control 2023-08-10T10:51:40.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 10 10:51 pg_filenode.map 2023-08-10T10:51:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.805 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/log: 2023-08-10T10:51:40.805 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.805 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.806 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.806 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-08-10T10:51:40.806 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.806 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.806 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.806 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-08-10T10:51:40.807 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.807 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.807 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.807 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-08-10T10:51:40.807 INFO:teuthology.orchestra.run.smithi107.stdout:total 3 2023-08-10T10:51:40.807 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 10:51 . 2023-08-10T10:51:40.807 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.808 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 mappings 2023-08-10T10:51:40.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 10:51 replorigin_checkpoint 2023-08-10T10:51:40.808 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 snapshots 2023-08-10T10:51:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.808 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-08-10T10:51:40.808 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.808 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.808 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 10:51 .. 2023-08-10T10:51:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.809 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-08-10T10:51:40.809 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.809 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.809 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 10:51 .. 2023-08-10T10:51:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.809 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-08-10T10:51:40.809 INFO:teuthology.orchestra.run.smithi107.stdout:total 2 2023-08-10T10:51:40.810 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 . 2023-08-10T10:51:40.810 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.810 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 members 2023-08-10T10:51:40.810 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 offsets 2023-08-10T10:51:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.810 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-08-10T10:51:40.810 INFO:teuthology.orchestra.run.smithi107.stdout:total 9 2023-08-10T10:51:40.810 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 . 2023-08-10T10:51:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 .. 2023-08-10T10:51:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 0000 2023-08-10T10:51:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-08-10T10:51:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:total 9 2023-08-10T10:51:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 . 2023-08-10T10:51:40.872 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 .. 2023-08-10T10:51:40.872 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 0000 2023-08-10T10:51:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.873 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-08-10T10:51:40.873 INFO:teuthology.orchestra.run.smithi107.stdout:total 9 2023-08-10T10:51:40.873 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 . 2023-08-10T10:51:40.873 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.873 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 0000 2023-08-10T10:51:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.874 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-08-10T10:51:40.874 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.874 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.874 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.874 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-08-10T10:51:40.874 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.874 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.875 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.875 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-08-10T10:51:40.875 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.875 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.875 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.876 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-08-10T10:51:40.876 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.876 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.876 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.876 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-08-10T10:51:40.876 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.876 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.877 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.877 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-08-10T10:51:40.877 INFO:teuthology.orchestra.run.smithi107.stdout:total 9 2023-08-10T10:51:40.877 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 . 2023-08-10T10:51:40.877 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.877 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 0000 2023-08-10T10:51:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.878 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-08-10T10:51:40.878 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.878 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.878 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.878 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-08-10T10:51:40.878 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.879 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.879 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.879 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-08-10T10:51:40.879 INFO:teuthology.orchestra.run.smithi107.stdout:total 16386 2023-08-10T10:51:40.879 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 10:51 . 2023-08-10T10:51:40.879 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.879 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 10:51 000000010000000000000001 2023-08-10T10:51:40.880 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 archive_status 2023-08-10T10:51:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.880 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-08-10T10:51:40.880 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T10:51:40.880 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T10:51:40.880 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 10:51 .. 2023-08-10T10:51:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:51:40.881 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-08-10T10:51:40.881 INFO:teuthology.orchestra.run.smithi107.stdout:total 9 2023-08-10T10:51:40.881 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 . 2023-08-10T10:51:40.881 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39483722 Aug 10 10:51 .. 2023-08-10T10:51:40.881 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 0000 2023-08-10T10:51:40.882 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-08-10T10:51:41.241 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i' 2023-08-10T10:51:41.427 INFO:teuthology.orchestra.run.smithi107.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-08-10T10:51:41.480 INFO:teuthology.orchestra.run.smithi107.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-08-10T10:51:41.486 INFO:teuthology.orchestra.run.smithi107.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-08-10T10:51:41.493 INFO:teuthology.orchestra.run.smithi107.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-08-10T10:51:41.818 INFO:teuthology.orchestra.run.smithi107.stderr:creating tables... 2023-08-10T10:51:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:41 smithi157 ceph-mon[129604]: pgmap v17: 129 pgs: 129 active+clean; 47 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 3.4 MiB/s wr, 163 op/s 2023-08-10T10:51:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:41 smithi107 ceph-mon[127953]: pgmap v17: 129 pgs: 129 active+clean; 47 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 3.4 MiB/s wr, 163 op/s 2023-08-10T10:51:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:41 smithi195 ceph-mon[129938]: pgmap v17: 129 pgs: 129 active+clean; 47 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 3.4 MiB/s wr, 163 op/s 2023-08-10T10:51:42.552 INFO:teuthology.orchestra.run.smithi107.stderr:100000 of 50000000 tuples (0%) done (elapsed 0.73 s, remaining 363.81 s) 2023-08-10T10:51:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:42 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:51:43.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:42 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:51:43.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:42 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:51:44.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:43 smithi157 ceph-mon[129604]: pgmap v18: 129 pgs: 129 active+clean; 47 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2023-08-10T10:51:44.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:43 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:51:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:43 smithi107 ceph-mon[127953]: pgmap v18: 129 pgs: 129 active+clean; 47 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2023-08-10T10:51:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:43 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:51:44.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:43 smithi195 ceph-mon[129938]: pgmap v18: 129 pgs: 129 active+clean; 47 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2023-08-10T10:51:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:43 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:51:44.305 INFO:teuthology.orchestra.run.smithi107.stderr:200000 of 50000000 tuples (0%) done (elapsed 2.48 s, remaining 618.10 s) 2023-08-10T10:51:46.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:45 smithi157 ceph-mon[129604]: pgmap v19: 129 pgs: 129 active+clean; 70 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 4.2 MiB/s wr, 116 op/s 2023-08-10T10:51:46.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:45 smithi107 ceph-mon[127953]: pgmap v19: 129 pgs: 129 active+clean; 70 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 4.2 MiB/s wr, 116 op/s 2023-08-10T10:51:46.080 INFO:teuthology.orchestra.run.smithi107.stderr:300000 of 50000000 tuples (0%) done (elapsed 4.26 s, remaining 705.43 s) 2023-08-10T10:51:46.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:45 smithi195 ceph-mon[129938]: pgmap v19: 129 pgs: 129 active+clean; 70 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 4.2 MiB/s wr, 116 op/s 2023-08-10T10:51:47.355 INFO:teuthology.orchestra.run.smithi107.stderr:400000 of 50000000 tuples (0%) done (elapsed 5.53 s, remaining 686.04 s) 2023-08-10T10:51:48.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:47 smithi157 ceph-mon[129604]: pgmap v20: 129 pgs: 129 active+clean; 70 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 3.2 MiB/s wr, 94 op/s 2023-08-10T10:51:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:47 smithi107 ceph-mon[127953]: pgmap v20: 129 pgs: 129 active+clean; 70 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 3.2 MiB/s wr, 94 op/s 2023-08-10T10:51:48.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:47 smithi195 ceph-mon[129938]: pgmap v20: 129 pgs: 129 active+clean; 70 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 3.2 MiB/s wr, 94 op/s 2023-08-10T10:51:49.079 INFO:teuthology.orchestra.run.smithi107.stderr:500000 of 50000000 tuples (1%) done (elapsed 7.26 s, remaining 718.38 s) 2023-08-10T10:51:50.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:49 smithi157 ceph-mon[129604]: pgmap v21: 129 pgs: 129 active+clean; 95 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 7.3 MiB/s wr, 96 op/s 2023-08-10T10:51:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:49 smithi107 ceph-mon[127953]: pgmap v21: 129 pgs: 129 active+clean; 95 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 7.3 MiB/s wr, 96 op/s 2023-08-10T10:51:50.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:49 smithi195 ceph-mon[129938]: pgmap v21: 129 pgs: 129 active+clean; 95 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 7.3 MiB/s wr, 96 op/s 2023-08-10T10:51:50.313 INFO:teuthology.orchestra.run.smithi107.stderr:600000 of 50000000 tuples (1%) done (elapsed 8.49 s, remaining 699.06 s) 2023-08-10T10:51:51.966 INFO:teuthology.orchestra.run.smithi107.stderr:700000 of 50000000 tuples (1%) done (elapsed 10.14 s, remaining 714.38 s) 2023-08-10T10:51:52.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:51 smithi157 ceph-mon[129604]: pgmap v22: 129 pgs: 129 active+clean; 146 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 16 MiB/s wr, 111 op/s 2023-08-10T10:51:52.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:51 smithi107 ceph-mon[127953]: pgmap v22: 129 pgs: 129 active+clean; 146 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 16 MiB/s wr, 111 op/s 2023-08-10T10:51:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:51 smithi195 ceph-mon[129938]: pgmap v22: 129 pgs: 129 active+clean; 146 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 16 MiB/s wr, 111 op/s 2023-08-10T10:51:53.704 INFO:teuthology.orchestra.run.smithi107.stderr:800000 of 50000000 tuples (1%) done (elapsed 11.88 s, remaining 730.74 s) 2023-08-10T10:51:54.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:53 smithi157 ceph-mon[129604]: pgmap v23: 129 pgs: 129 active+clean; 146 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 15 MiB/s wr, 39 op/s 2023-08-10T10:51:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:53 smithi107 ceph-mon[127953]: pgmap v23: 129 pgs: 129 active+clean; 146 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 15 MiB/s wr, 39 op/s 2023-08-10T10:51:54.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:53 smithi195 ceph-mon[129938]: pgmap v23: 129 pgs: 129 active+clean; 146 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 15 MiB/s wr, 39 op/s 2023-08-10T10:51:54.946 INFO:teuthology.orchestra.run.smithi107.stderr:900000 of 50000000 tuples (1%) done (elapsed 13.12 s, remaining 715.98 s) 2023-08-10T10:51:56.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:55 smithi157 ceph-mon[129604]: pgmap v24: 129 pgs: 129 active+clean; 226 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 28 MiB/s wr, 54 op/s 2023-08-10T10:51:56.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:55 smithi107 ceph-mon[127953]: pgmap v24: 129 pgs: 129 active+clean; 226 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 28 MiB/s wr, 54 op/s 2023-08-10T10:51:56.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:55 smithi195 ceph-mon[129938]: pgmap v24: 129 pgs: 129 active+clean; 226 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 28 MiB/s wr, 54 op/s 2023-08-10T10:51:56.656 INFO:teuthology.orchestra.run.smithi107.stderr:1000000 of 50000000 tuples (2%) done (elapsed 14.83 s, remaining 726.88 s) 2023-08-10T10:51:58.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:57 smithi157 ceph-mon[129604]: pgmap v25: 129 pgs: 129 active+clean; 226 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 25 MiB/s wr, 31 op/s 2023-08-10T10:51:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:57 smithi107 ceph-mon[127953]: pgmap v25: 129 pgs: 129 active+clean; 226 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 25 MiB/s wr, 31 op/s 2023-08-10T10:51:58.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:57 smithi195 ceph-mon[129938]: pgmap v25: 129 pgs: 129 active+clean; 226 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 25 MiB/s wr, 31 op/s 2023-08-10T10:51:58.420 INFO:teuthology.orchestra.run.smithi107.stderr:1100000 of 50000000 tuples (2%) done (elapsed 16.60 s, remaining 737.85 s) 2023-08-10T10:51:59.665 INFO:teuthology.orchestra.run.smithi107.stderr:1200000 of 50000000 tuples (2%) done (elapsed 17.84 s, remaining 725.60 s) 2023-08-10T10:52:00.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:51:59 smithi157 ceph-mon[129604]: pgmap v26: 129 pgs: 129 active+clean; 234 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 27 MiB/s wr, 32 op/s 2023-08-10T10:52:00.047 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:51:59 smithi107 ceph-mon[127953]: pgmap v26: 129 pgs: 129 active+clean; 234 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 27 MiB/s wr, 32 op/s 2023-08-10T10:52:00.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:51:59 smithi195 ceph-mon[129938]: pgmap v26: 129 pgs: 129 active+clean; 234 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 27 MiB/s wr, 32 op/s 2023-08-10T10:52:00.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:52:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:52:00.044+0000 7f1a2da43700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:52:00.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:52:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:52:00.044+0000 7f1a2da43700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:52:00.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:52:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:52:00.044+0000 7f1a2da43700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:52:00.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:52:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:52:00.044+0000 7f1a2da43700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:52:00.327 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 10:52:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T10:52:00.044+0000 7f1a2da43700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-10T10:52:01.321 INFO:teuthology.orchestra.run.smithi107.stderr:1300000 of 50000000 tuples (2%) done (elapsed 19.50 s, remaining 730.43 s) 2023-08-10T10:52:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:01 smithi157 ceph-mon[129604]: pgmap v27: 129 pgs: 129 active+clean; 298 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 33 MiB/s wr, 41 op/s 2023-08-10T10:52:02.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:01 smithi157 ceph-mon[129604]: mgrmap e25: x(active, since 48s), standbys: y, z 2023-08-10T10:52:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:01 smithi107 ceph-mon[127953]: pgmap v27: 129 pgs: 129 active+clean; 298 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 33 MiB/s wr, 41 op/s 2023-08-10T10:52:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:01 smithi107 ceph-mon[127953]: mgrmap e25: x(active, since 48s), standbys: y, z 2023-08-10T10:52:02.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:01 smithi195 ceph-mon[129938]: pgmap v27: 129 pgs: 129 active+clean; 298 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 33 MiB/s wr, 41 op/s 2023-08-10T10:52:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:01 smithi195 ceph-mon[129938]: mgrmap e25: x(active, since 48s), standbys: y, z 2023-08-10T10:52:03.029 INFO:teuthology.orchestra.run.smithi107.stderr:1400000 of 50000000 tuples (2%) done (elapsed 21.21 s, remaining 736.17 s) 2023-08-10T10:52:04.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:03 smithi157 ceph-mon[129604]: pgmap v28: 129 pgs: 129 active+clean; 298 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-08-10T10:52:04.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:03 smithi107 ceph-mon[127953]: pgmap v28: 129 pgs: 129 active+clean; 298 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-08-10T10:52:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:03 smithi195 ceph-mon[129938]: pgmap v28: 129 pgs: 129 active+clean; 298 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-08-10T10:52:04.283 INFO:teuthology.orchestra.run.smithi107.stderr:1500000 of 50000000 tuples (3%) done (elapsed 22.46 s, remaining 726.22 s) 2023-08-10T10:52:06.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:05 smithi157 ceph-mon[129604]: pgmap v29: 129 pgs: 129 active+clean; 394 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 MiB/s wr, 52 op/s 2023-08-10T10:52:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:05 smithi107 ceph-mon[127953]: pgmap v29: 129 pgs: 129 active+clean; 394 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 MiB/s wr, 52 op/s 2023-08-10T10:52:06.144 INFO:teuthology.orchestra.run.smithi107.stderr:1600000 of 50000000 tuples (3%) done (elapsed 24.32 s, remaining 735.74 s) 2023-08-10T10:52:06.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:05 smithi195 ceph-mon[129938]: pgmap v29: 129 pgs: 129 active+clean; 394 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 MiB/s wr, 52 op/s 2023-08-10T10:52:07.294 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:52:07.426 INFO:teuthology.orchestra.run.smithi107.stderr:1700000 of 50000000 tuples (3%) done (elapsed 25.60 s, remaining 727.45 s) 2023-08-10T10:52:07.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.543+0000 7fe07ddff700 1 -- 172.21.15.107:0/1866704541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0781066d0 msgr2=0x7fe078106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.543+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1866704541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0781066d0 0x7fe078106ab0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe068009990 tx=0x7fe068009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.544+0000 7fe07ddff700 1 -- 172.21.15.107:0/1866704541 shutdown_connections 2023-08-10T10:52:07.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.544+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1866704541 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe078101080 0x7fe07810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.544+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1866704541 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe0781066d0 0x7fe078106ab0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.544+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1866704541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0781006c0 0x7fe078100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.544+0000 7fe07ddff700 1 -- 172.21.15.107:0/1866704541 >> 172.21.15.107:0/1866704541 conn(0x7fe0780fc1f0 msgr2=0x7fe0780fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:07.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.544+0000 7fe07ddff700 1 -- 172.21.15.107:0/1866704541 shutdown_connections 2023-08-10T10:52:07.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.544+0000 7fe07ddff700 1 -- 172.21.15.107:0/1866704541 wait complete. 2023-08-10T10:52:07.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.545+0000 7fe07ddff700 1 Processor -- start 2023-08-10T10:52:07.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.545+0000 7fe07ddff700 1 -- start start 2023-08-10T10:52:07.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe07ddff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0781006c0 0x7fe07819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe07ddff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe078101080 0x7fe07819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe07ddff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0781066d0 0x7fe078198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe07ddff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078198d70 con 0x7fe078101080 2023-08-10T10:52:07.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe07ddff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078198ee0 con 0x7fe0781006c0 2023-08-10T10:52:07.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe07ddff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0781990a0 con 0x7fe0781066d0 2023-08-10T10:52:07.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe078101080 0x7fe07819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe078101080 0x7fe07819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37000/0 (socket says 172.21.15.107:37000) 2023-08-10T10:52:07.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe076ffd700 1 -- 172.21.15.107:0/1838244629 learned_addr learned my addr 172.21.15.107:0/1838244629 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:07.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe0777fe700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0781006c0 0x7fe07819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe077fff700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0781066d0 0x7fe078198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe076ffd700 1 -- 172.21.15.107:0/1838244629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0781066d0 msgr2=0x7fe078198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe076ffd700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0781066d0 0x7fe078198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe076ffd700 1 -- 172.21.15.107:0/1838244629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0781006c0 msgr2=0x7fe07819e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe076ffd700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0781006c0 0x7fe07819e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.546+0000 7fe076ffd700 1 -- 172.21.15.107:0/1838244629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0680095f0 con 0x7fe078101080 2023-08-10T10:52:07.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.547+0000 7fe076ffd700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe078101080 0x7fe07819ebd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00e9a0 tx=0x7fe06c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:07.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.547+0000 7fe074ff9700 1 -- 172.21.15.107:0/1838244629 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c009790 con 0x7fe078101080 2023-08-10T10:52:07.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.547+0000 7fe074ff9700 1 -- 172.21.15.107:0/1838244629 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe06c00cbd0 con 0x7fe078101080 2023-08-10T10:52:07.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.547+0000 7fe07ddff700 1 -- 172.21.15.107:0/1838244629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe078199380 con 0x7fe078101080 2023-08-10T10:52:07.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.547+0000 7fe074ff9700 1 -- 172.21.15.107:0/1838244629 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c018680 con 0x7fe078101080 2023-08-10T10:52:07.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.547+0000 7fe07ddff700 1 -- 172.21.15.107:0/1838244629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0781a5680 con 0x7fe078101080 2023-08-10T10:52:07.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.551+0000 7fe074ff9700 1 -- 172.21.15.107:0/1838244629 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fe06c00cd40 con 0x7fe078101080 2023-08-10T10:52:07.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.552+0000 7fe074ff9700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fe0600a13e0 0x7fe0600a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.552+0000 7fe074ff9700 1 -- 172.21.15.107:0/1838244629 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fe06c014070 con 0x7fe078101080 2023-08-10T10:52:07.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.553+0000 7fe0777fe700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fe0600a13e0 0x7fe0600a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.553+0000 7fe09167eb80 1 Processor -- start 2023-08-10T10:52:07.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.553+0000 7fe09167eb80 1 -- start start 2023-08-10T10:52:07.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.553+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463932f50 0x565463933330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.553+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x56546392d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.553+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x56546392dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.553+0000 7fe09167eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654638a8dc0 con 0x565463933870 2023-08-10T10:52:07.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.553+0000 7fe09167eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x565463885590 con 0x565463932f50 2023-08-10T10:52:07.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.553+0000 7fe09167eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565463882eb0 con 0x56546392d800 2023-08-10T10:52:07.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe0777fe700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fe0600a13e0 0x7fe0600a38a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe068006010 tx=0x7fe06800b260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:07.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x56546392d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe0777fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463932f50 0x565463933330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x56546392d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37008/0 (socket says 172.21.15.107:37008) 2023-08-10T10:52:07.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe076ffd700 1 -- 172.21.15.107:0/4250462732 learned_addr learned my addr 172.21.15.107:0/4250462732 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:07.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe077fff700 1 --2- 172.21.15.107:0/4250462732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x56546392dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe076ffd700 1 -- 172.21.15.107:0/4250462732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 msgr2=0x56546392dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:07.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe076ffd700 1 --2- 172.21.15.107:0/4250462732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x56546392dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe076ffd700 1 -- 172.21.15.107:0/4250462732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463932f50 msgr2=0x565463933330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:07.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe076ffd700 1 --2- 172.21.15.107:0/4250462732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463932f50 0x565463933330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe076ffd700 1 -- 172.21.15.107:0/4250462732 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654636ff630 con 0x565463933870 2023-08-10T10:52:07.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.554+0000 7fe076ffd700 1 --2- 172.21.15.107:0/4250462732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x56546392d2c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe06c09a120 tx=0x7fe06c09a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2c3f437f2c3eb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:07.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.555+0000 7fe05dffb700 1 -- 172.21.15.107:0/4250462732 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0a25e0 con 0x565463933870 2023-08-10T10:52:07.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.555+0000 7fe05dffb700 1 -- 172.21.15.107:0/4250462732 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe06c0ade90 con 0x565463933870 2023-08-10T10:52:07.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.555+0000 7fe05dffb700 1 -- 172.21.15.107:0/4250462732 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0a2390 con 0x565463933870 2023-08-10T10:52:07.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.555+0000 7fe09167eb80 1 -- 172.21.15.107:0/4250462732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 msgr2=0x56546392d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.555+0000 7fe09167eb80 1 --2- 172.21.15.107:0/4250462732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x56546392d2c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe06c09a120 tx=0x7fe06c09a210 comp rx=0 tx=0).stop 2023-08-10T10:52:07.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.556+0000 7fe09167eb80 1 -- 172.21.15.107:0/4250462732 shutdown_connections 2023-08-10T10:52:07.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.556+0000 7fe09167eb80 1 --2- 172.21.15.107:0/4250462732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463932f50 0x565463933330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.556+0000 7fe09167eb80 1 --2- 172.21.15.107:0/4250462732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x56546392dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.556+0000 7fe09167eb80 1 --2- 172.21.15.107:0/4250462732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x56546392d2c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.556+0000 7fe09167eb80 1 -- 172.21.15.107:0/4250462732 >> 172.21.15.107:0/4250462732 conn(0x56546388acd0 msgr2=0x5654639284d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:07.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.556+0000 7fe09167eb80 1 -- 172.21.15.107:0/4250462732 shutdown_connections 2023-08-10T10:52:07.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.556+0000 7fe09167eb80 1 -- 172.21.15.107:0/4250462732 wait complete. 2023-08-10T10:52:07.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.556+0000 7fe09167eb80 1 -- start start 2023-08-10T10:52:07.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.557+0000 7fe09167eb80 1 Processor -- start 2023-08-10T10:52:07.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.557+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x5654639398d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.557+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x565463936bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.557+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x565463937300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.557+0000 7fe09167eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546387e7a0 con 0x565463932f50 2023-08-10T10:52:07.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.557+0000 7fe09167eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546381dac0 con 0x565463933870 2023-08-10T10:52:07.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.557+0000 7fe09167eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546381d7c0 con 0x56546392d800 2023-08-10T10:52:07.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.557+0000 7fe09167eb80 10 client.0 _ll_register_callbacks cb 0x56546381b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:07.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe077fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x565463937300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe077fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x565463937300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:54326/0 (socket says 172.21.15.107:54326) 2023-08-10T10:52:07.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe077fff700 1 -- 172.21.15.107:0/146930581 learned_addr learned my addr 172.21.15.107:0/146930581 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:07.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x565463936bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe077fff700 1 -- 172.21.15.107:0/146930581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 msgr2=0x5654639398d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:52:07.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe077fff700 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x5654639398d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe077fff700 1 -- 172.21.15.107:0/146930581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 msgr2=0x565463936bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:07.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe077fff700 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x565463936bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe077fff700 1 -- 172.21.15.107:0/146930581 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0781a5680 con 0x565463933870 2023-08-10T10:52:07.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe077fff700 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x565463937300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe070007a80 tx=0x7fe070007ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7877d738a5c8254b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:07.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.558+0000 7fe056ffd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:52:07.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.559+0000 7fe056ffd700 1 -- 172.21.15.107:0/146930581 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000e070 con 0x565463933870 2023-08-10T10:52:07.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.559+0000 7fe09167eb80 1 -- 172.21.15.107:0/146930581 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565463920470 con 0x565463933870 2023-08-10T10:52:07.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.559+0000 7fe056ffd700 1 -- 172.21.15.107:0/146930581 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fe070015660 con 0x565463933870 2023-08-10T10:52:07.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.559+0000 7fe056ffd700 1 -- 172.21.15.107:0/146930581 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe070015820 con 0x565463933870 2023-08-10T10:52:07.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.559+0000 7fe09167eb80 10 client.25685 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:07.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.559+0000 7fe09167eb80 1 -- 172.21.15.107:0/146930581 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5654636abde0 con 0x565463933870 2023-08-10T10:52:07.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.559+0000 7fe056ffd700 1 -- 172.21.15.107:0/146930581 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565463920470 con 0x565463933870 2023-08-10T10:52:07.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.560+0000 7fe056ffd700 1 -- 172.21.15.107:0/146930581 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe070016a50 con 0x565463933870 2023-08-10T10:52:07.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.560+0000 7fe09167eb80 10 client.25685 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:07.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.560+0000 7fe09167eb80 10 client.25685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:07.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.560+0000 7fe09167eb80 20 client.25685 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:07.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.560+0000 7fe09167eb80 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5654639473d0 0x5654639497f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.560+0000 7fe09167eb80 4 client.25685 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:07.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.560+0000 7fe09167eb80 1 -- 172.21.15.107:0/146930581 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654638fc9d0 con 0x5654639473d0 2023-08-10T10:52:07.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.560+0000 7fe0777fe700 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5654639473d0 0x5654639497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.561+0000 7fe056ffd700 10 client.25685 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:07.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.561+0000 7fe0777fe700 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5654639473d0 0x5654639497f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6fb274369b3ace5 server_cookie=d949c5fb0fa61aed in_seq=0 out_seq=0 2023-08-10T10:52:07.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.561+0000 7fe056ffd700 1 -- 172.21.15.107:0/146930581 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5654638fc9d0 con 0x5654639473d0 2023-08-10T10:52:07.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.561+0000 7fe056ffd700 10 client.25685 handle_command_reply: tid=0 2023-08-10T10:52:07.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.561+0000 7fe09167eb80 1 client.25685 shutdown 2023-08-10T10:52:07.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 -- 172.21.15.107:0/146930581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 msgr2=0x565463937300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x565463937300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe070007a80 tx=0x7fe070007ab0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 -- 172.21.15.107:0/146930581 shutdown_connections 2023-08-10T10:52:07.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5654639473d0 0x5654639497f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x565463937300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x5654639398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe056ffd700 0 client.25685 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:07.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 --2- 172.21.15.107:0/146930581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x565463936bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 -- 172.21.15.107:0/146930581 >> 172.21.15.107:0/146930581 conn(0x56546388acd0 msgr2=0x5654639279b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:07.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 -- 172.21.15.107:0/146930581 shutdown_connections 2023-08-10T10:52:07.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 1 -- 172.21.15.107:0/146930581 wait complete. 2023-08-10T10:52:07.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.562+0000 7fe09167eb80 20 client.25685 trim_cache size 0 max 16384 2023-08-10T10:52:07.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.587+0000 7fe09167eb80 1 Processor -- start 2023-08-10T10:52:07.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.587+0000 7fe09167eb80 1 -- start start 2023-08-10T10:52:07.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.587+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56546392d800 0x56546393e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.587+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565463932f50 0x5654639322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.587+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x565463939470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.587+0000 7fe09167eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x565463701920 con 0x565463933870 2023-08-10T10:52:07.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.587+0000 7fe09167eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x565463937b40 con 0x56546392d800 2023-08-10T10:52:07.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.587+0000 7fe09167eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565463937f10 con 0x565463932f50 2023-08-10T10:52:07.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.587+0000 7fe077fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x565463939470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe0777fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56546392d800 0x56546393e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565463932f50 0x5654639322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe077fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x565463939470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37018/0 (socket says 172.21.15.107:37018) 2023-08-10T10:52:07.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe077fff700 1 -- 172.21.15.107:0/946514610 learned_addr learned my addr 172.21.15.107:0/946514610 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:07.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe0777fe700 1 -- 172.21.15.107:0/946514610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565463932f50 msgr2=0x5654639322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:07.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe0777fe700 1 --2- 172.21.15.107:0/946514610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565463932f50 0x5654639322d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe0777fe700 1 -- 172.21.15.107:0/946514610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 msgr2=0x565463939470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:07.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe0777fe700 1 --2- 172.21.15.107:0/946514610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x565463939470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe0777fe700 1 -- 172.21.15.107:0/946514610 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565463694c60 con 0x56546392d800 2023-08-10T10:52:07.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.588+0000 7fe0777fe700 1 --2- 172.21.15.107:0/946514610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56546392d800 0x56546393e360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe068005910 tx=0x7fe068022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79674ff7f5caca76 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:07.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe05e7fc700 1 -- 172.21.15.107:0/946514610 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06802b070 con 0x56546392d800 2023-08-10T10:52:07.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe05e7fc700 1 -- 172.21.15.107:0/946514610 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe06802c040 con 0x56546392d800 2023-08-10T10:52:07.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe05e7fc700 1 -- 172.21.15.107:0/946514610 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068004500 con 0x56546392d800 2023-08-10T10:52:07.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe09167eb80 1 -- 172.21.15.107:0/946514610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56546392d800 msgr2=0x56546393e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe09167eb80 1 --2- 172.21.15.107:0/946514610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56546392d800 0x56546393e360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe068005910 tx=0x7fe068022000 comp rx=0 tx=0).stop 2023-08-10T10:52:07.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe09167eb80 1 -- 172.21.15.107:0/946514610 shutdown_connections 2023-08-10T10:52:07.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe09167eb80 1 --2- 172.21.15.107:0/946514610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56546392d800 0x56546393e360 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe09167eb80 1 --2- 172.21.15.107:0/946514610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463933870 0x565463939470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe09167eb80 1 --2- 172.21.15.107:0/946514610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565463932f50 0x5654639322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe09167eb80 1 -- 172.21.15.107:0/946514610 >> 172.21.15.107:0/946514610 conn(0x56546388acd0 msgr2=0x565463931bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:07.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.589+0000 7fe09167eb80 1 -- 172.21.15.107:0/946514610 shutdown_connections 2023-08-10T10:52:07.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.590+0000 7fe09167eb80 1 -- 172.21.15.107:0/946514610 wait complete. 2023-08-10T10:52:07.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.590+0000 7fe09167eb80 1 -- start start 2023-08-10T10:52:07.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.590+0000 7fe09167eb80 1 Processor -- start 2023-08-10T10:52:07.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x56546393e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x56546392ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe09167eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x56546392f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe09167eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546392f9c0 con 0x565463932f50 2023-08-10T10:52:07.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe09167eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546399b080 con 0x565463933870 2023-08-10T10:52:07.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe09167eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546399b1c0 con 0x56546392d800 2023-08-10T10:52:07.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe09167eb80 10 client.0 _ll_register_callbacks cb 0x56546381b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:07.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x56546392ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x56546392ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37028/0 (socket says 172.21.15.107:37028) 2023-08-10T10:52:07.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe076ffd700 1 -- 172.21.15.107:0/586009015 learned_addr learned my addr 172.21.15.107:0/586009015 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:07.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe0777fe700 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x56546393e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe077fff700 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x56546392f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe076ffd700 1 -- 172.21.15.107:0/586009015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 msgr2=0x56546393e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:07.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe076ffd700 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x56546393e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe076ffd700 1 -- 172.21.15.107:0/586009015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 msgr2=0x56546392f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:07.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe076ffd700 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x56546392f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.591+0000 7fe076ffd700 1 -- 172.21.15.107:0/586009015 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07810de90 con 0x565463932f50 2023-08-10T10:52:07.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.592+0000 7fe076ffd700 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x56546392ebb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00e970 tx=0x7fe06c099f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951708afe21cf759 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:07.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.592+0000 7fe056ffd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:07.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.592+0000 7fe056ffd700 1 -- 172.21.15.107:0/586009015 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0a25e0 con 0x565463932f50 2023-08-10T10:52:07.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.592+0000 7fe09167eb80 1 -- 172.21.15.107:0/586009015 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe06c0ade90 con 0x565463932f50 2023-08-10T10:52:07.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.592+0000 7fe056ffd700 1 -- 172.21.15.107:0/586009015 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fe06c0a2150 con 0x565463932f50 2023-08-10T10:52:07.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.592+0000 7fe056ffd700 1 -- 172.21.15.107:0/586009015 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe06c0a2310 con 0x565463932f50 2023-08-10T10:52:07.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.592+0000 7fe09167eb80 10 client.15996 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:07.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.592+0000 7fe09167eb80 1 -- 172.21.15.107:0/586009015 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5654636d2250 con 0x565463932f50 2023-08-10T10:52:07.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.592+0000 7fe056ffd700 1 -- 172.21.15.107:0/586009015 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe06c0ade90 con 0x565463932f50 2023-08-10T10:52:07.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.593+0000 7fe056ffd700 1 -- 172.21.15.107:0/586009015 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe06c0b8020 con 0x565463932f50 2023-08-10T10:52:07.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.593+0000 7fe09167eb80 10 client.15996 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:07.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.593+0000 7fe09167eb80 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:07.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.593+0000 7fe09167eb80 20 client.15996 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:07.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.593+0000 7fe09167eb80 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56546399c6f0 0x56546399eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.593+0000 7fe09167eb80 4 client.15996 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:52:07.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.593+0000 7fe09167eb80 1 -- 172.21.15.107:0/586009015 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x565463877780 con 0x56546399c6f0 2023-08-10T10:52:07.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.593+0000 7fe0777fe700 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56546399c6f0 0x56546399eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe0777fe700 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56546399c6f0 0x56546399eb10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b345e687172e7d1a server_cookie=aebff760bf16a3d5 in_seq=0 out_seq=0 2023-08-10T10:52:07.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe056ffd700 10 client.15996 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:07.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe056ffd700 1 -- 172.21.15.107:0/586009015 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x565463877780 con 0x56546399c6f0 2023-08-10T10:52:07.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe056ffd700 10 client.15996 handle_command_reply: tid=0 2023-08-10T10:52:07.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 client.15996 shutdown 2023-08-10T10:52:07.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 -- 172.21.15.107:0/586009015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 msgr2=0x56546392ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x56546392ebb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00e970 tx=0x7fe06c099f60 comp rx=0 tx=0).stop 2023-08-10T10:52:07.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 -- 172.21.15.107:0/586009015 shutdown_connections 2023-08-10T10:52:07.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56546399c6f0 0x56546399eb10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x565463933870 0x56546392f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56546392d800 0x56546393e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 --2- 172.21.15.107:0/586009015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x565463932f50 0x56546392ebb0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 -- 172.21.15.107:0/586009015 >> 172.21.15.107:0/586009015 conn(0x56546388acd0 msgr2=0x565463932450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:07.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe056ffd700 0 client.15996 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:07.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 -- 172.21.15.107:0/586009015 shutdown_connections 2023-08-10T10:52:07.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.594+0000 7fe09167eb80 1 -- 172.21.15.107:0/586009015 wait complete. 2023-08-10T10:52:07.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe09167eb80 20 client.15996 trim_cache size 0 max 16384 2023-08-10T10:52:07.604 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:52:07.605 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "no active scrubs running", 2023-08-10T10:52:07.605 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": {} 2023-08-10T10:52:07.605 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:52:07.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 -- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fe0600a13e0 msgr2=0x7fe0600a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fe0600a13e0 0x7fe0600a38a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe068006010 tx=0x7fe06800b260 comp rx=0 tx=0).stop 2023-08-10T10:52:07.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 -- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe078101080 msgr2=0x7fe07819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe078101080 0x7fe07819ebd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00e9a0 tx=0x7fe06c00ed60 comp rx=0 tx=0).stop 2023-08-10T10:52:07.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 -- 172.21.15.107:0/1838244629 shutdown_connections 2023-08-10T10:52:07.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fe0600a13e0 0x7fe0600a38a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0781006c0 0x7fe07819e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0781066d0 0x7fe078198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 --2- 172.21.15.107:0/1838244629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe078101080 0x7fe07819ebd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 -- 172.21.15.107:0/1838244629 >> 172.21.15.107:0/1838244629 conn(0x7fe0780fc1f0 msgr2=0x7fe07810b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:07.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 -- 172.21.15.107:0/1838244629 shutdown_connections 2023-08-10T10:52:07.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.595+0000 7fe07ddff700 1 -- 172.21.15.107:0/1838244629 wait complete. 2023-08-10T10:52:07.615 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-10T10:52:07.616 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:52:07.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.834+0000 7f63df5ff700 1 -- 172.21.15.107:0/1522965858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 msgr2=0x7f63d8100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.834+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1522965858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 0x7f63d8100b60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009990 tx=0x7f63c8009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.835+0000 7f63df5ff700 1 -- 172.21.15.107:0/1522965858 shutdown_connections 2023-08-10T10:52:07.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.835+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1522965858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d81010a0 0x7f63d810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.835+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1522965858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81066f0 0x7f63d8106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.835+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1522965858 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 0x7f63d8100b60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.835+0000 7f63df5ff700 1 -- 172.21.15.107:0/1522965858 >> 172.21.15.107:0/1522965858 conn(0x7f63d80fc190 msgr2=0x7f63d80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:07.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.835+0000 7f63df5ff700 1 -- 172.21.15.107:0/1522965858 shutdown_connections 2023-08-10T10:52:07.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.835+0000 7f63df5ff700 1 -- 172.21.15.107:0/1522965858 wait complete. 2023-08-10T10:52:07.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.836+0000 7f63df5ff700 1 Processor -- start 2023-08-10T10:52:07.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.836+0000 7f63df5ff700 1 -- start start 2023-08-10T10:52:07.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.837+0000 7f63df5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 0x7f63d8072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.837+0000 7f63df5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81010a0 0x7f63d8072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.837+0000 7f63df5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d81066f0 0x7f63d81a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.837+0000 7f63df5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80737e0 con 0x7f63d81006e0 2023-08-10T10:52:07.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.837+0000 7f63df5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d81a4d80 con 0x7f63d81066f0 2023-08-10T10:52:07.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.837+0000 7f63df5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d81a4ec0 con 0x7f63d81010a0 2023-08-10T10:52:07.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.837+0000 7f63dd39b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 0x7f63d8072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.837+0000 7f63dd39b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 0x7f63d8072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37042/0 (socket says 172.21.15.107:37042) 2023-08-10T10:52:07.839 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.837+0000 7f63dd39b700 1 -- 172.21.15.107:0/1152958131 learned_addr learned my addr 172.21.15.107:0/1152958131 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:07.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63ddb9c700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d81066f0 0x7f63d81a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63dcb9a700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81010a0 0x7f63d8072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63dd39b700 1 -- 172.21.15.107:0/1152958131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81010a0 msgr2=0x7f63d8072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63dd39b700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81010a0 0x7f63d8072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63dd39b700 1 -- 172.21.15.107:0/1152958131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d81066f0 msgr2=0x7f63d81a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:07.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63dd39b700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d81066f0 0x7f63d81a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:07.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63dd39b700 1 -- 172.21.15.107:0/1152958131 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c80095f0 con 0x7f63d81006e0 2023-08-10T10:52:07.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63dcb9a700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81010a0 0x7f63d8072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:07.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63dd39b700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 0x7f63d8072a70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f63d400e9a0 tx=0x7f63d400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:07.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63ce7fc700 1 -- 172.21.15.107:0/1152958131 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4009790 con 0x7f63d81006e0 2023-08-10T10:52:07.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d81a5120 con 0x7f63d81006e0 2023-08-10T10:52:07.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63ce7fc700 1 -- 172.21.15.107:0/1152958131 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63d400cbd0 con 0x7f63d81006e0 2023-08-10T10:52:07.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63ce7fc700 1 -- 172.21.15.107:0/1152958131 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4018680 con 0x7f63d81006e0 2023-08-10T10:52:07.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.838+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d81a5600 con 0x7f63d81006e0 2023-08-10T10:52:07.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.839+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d8067560 con 0x7f63d81006e0 2023-08-10T10:52:07.843 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.841+0000 7f63ce7fc700 1 -- 172.21.15.107:0/1152958131 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f63d400cd40 con 0x7f63d81006e0 2023-08-10T10:52:07.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.843+0000 7f63ce7fc700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63c40a1430 0x7f63c40a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:07.844 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.843+0000 7f63ce7fc700 1 -- 172.21.15.107:0/1152958131 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f63d4014070 con 0x7f63d81006e0 2023-08-10T10:52:07.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.843+0000 7f63dcb9a700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63c40a1430 0x7f63c40a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:07.845 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.844+0000 7f63dcb9a700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63c40a1430 0x7f63c40a38f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f63c800b2e0 tx=0x7f63c8005fb0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:07.848 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:07.847+0000 7f63ce7fc700 1 -- 172.21.15.107:0/1152958131 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f63d4051790 con 0x7f63d81006e0 2023-08-10T10:52:08.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:07 smithi157 ceph-mon[129604]: pgmap v30: 129 pgs: 129 active+clean; 394 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:52:08.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:07 smithi107 ceph-mon[127953]: pgmap v30: 129 pgs: 129 active+clean; 394 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:52:08.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.148+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63d81a59b0 con 0x7f63d81006e0 2023-08-10T10:52:08.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.148+0000 7f63ce7fc700 1 -- 172.21.15.107:0/1152958131 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10921 (secure 0 0 0) 0x7f63d4096440 con 0x7f63d81006e0 2023-08-10T10:52:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:52:08.150 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:51:42.716963+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:52:08.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63c40a1430 msgr2=0x7f63c40a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63c40a1430 0x7f63c40a38f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f63c800b2e0 tx=0x7f63c8005fb0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 msgr2=0x7f63d8072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 0x7f63d8072a70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f63d400e9a0 tx=0x7f63d400ed60 comp rx=0 tx=0).stop 2023-08-10T10:52:08.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 shutdown_connections 2023-08-10T10:52:08.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63c40a1430 0x7f63c40a38f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d81066f0 0x7f63d81a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63d81006e0 0x7f63d8072a70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 --2- 172.21.15.107:0/1152958131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81010a0 0x7f63d8072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 >> 172.21.15.107:0/1152958131 conn(0x7f63d80fc190 msgr2=0x7f63d81041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.151+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 shutdown_connections 2023-08-10T10:52:08.154 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.152+0000 7f63df5ff700 1 -- 172.21.15.107:0/1152958131 wait complete. 2023-08-10T10:52:08.154 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 29 2023-08-10T10:52:08.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:07 smithi195 ceph-mon[129938]: pgmap v30: 129 pgs: 129 active+clean; 394 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:52:08.174 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-10T10:52:08.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.399+0000 7f1fff1ff700 1 -- 172.21.15.107:0/974085009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 msgr2=0x7f1ff810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.399+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/974085009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 0x7f1ff810f3c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000b0a0 tx=0x7f1ff000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.399+0000 7f1fff1ff700 1 -- 172.21.15.107:0/974085009 shutdown_connections 2023-08-10T10:52:08.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.399+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/974085009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff8072b40 0x7f1ff8072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.399+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/974085009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 0x7f1ff810f3c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.399+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/974085009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff8073460 0x7f1ff810ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.399+0000 7f1fff1ff700 1 -- 172.21.15.107:0/974085009 >> 172.21.15.107:0/974085009 conn(0x7f1ff80fc1e0 msgr2=0x7f1ff80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.399+0000 7f1fff1ff700 1 -- 172.21.15.107:0/974085009 shutdown_connections 2023-08-10T10:52:08.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.399+0000 7f1fff1ff700 1 -- 172.21.15.107:0/974085009 wait complete. 2023-08-10T10:52:08.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.400+0000 7f1fff1ff700 1 Processor -- start 2023-08-10T10:52:08.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1fff1ff700 1 -- start start 2023-08-10T10:52:08.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1fff1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff8072b40 0x7f1ff819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1fff1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff8073460 0x7f1ff819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1fff1ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 0x7f1ff8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1fff1ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8199130 con 0x7f1ff810cf90 2023-08-10T10:52:08.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1fff1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff81992a0 con 0x7f1ff8073460 2023-08-10T10:52:08.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1fff1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8199460 con 0x7f1ff8072b40 2023-08-10T10:52:08.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1ffd79c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 0x7f1ff8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1ffd79c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 0x7f1ff8198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37060/0 (socket says 172.21.15.107:37060) 2023-08-10T10:52:08.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1ffd79c700 1 -- 172.21.15.107:0/1153552861 learned_addr learned my addr 172.21.15.107:0/1153552861 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff8072b40 0x7f1ff819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.401+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff8073460 0x7f1ff819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1ffd79c700 1 -- 172.21.15.107:0/1153552861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff8072b40 msgr2=0x7f1ff819e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1ffd79c700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff8072b40 0x7f1ff819e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1ffd79c700 1 -- 172.21.15.107:0/1153552861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff8073460 msgr2=0x7f1ff819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1ffd79c700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff8073460 0x7f1ff819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1ffd79c700 1 -- 172.21.15.107:0/1153552861 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff0009d00 con 0x7f1ff810cf90 2023-08-10T10:52:08.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1ffd79c700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 0x7f1ff8198960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000d010 tx=0x7f1ff000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1ff5ffb700 1 -- 172.21.15.107:0/1153552861 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000e040 con 0x7f1ff810cf90 2023-08-10T10:52:08.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1fff1ff700 1 -- 172.21.15.107:0/1153552861 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff81996e0 con 0x7f1ff810cf90 2023-08-10T10:52:08.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1ff5ffb700 1 -- 172.21.15.107:0/1153552861 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ff0003e90 con 0x7f1ff810cf90 2023-08-10T10:52:08.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.402+0000 7f1ff5ffb700 1 -- 172.21.15.107:0/1153552861 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0005770 con 0x7f1ff810cf90 2023-08-10T10:52:08.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.403+0000 7f1fff1ff700 1 -- 172.21.15.107:0/1153552861 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff81007c0 con 0x7f1ff810cf90 2023-08-10T10:52:08.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.407+0000 7f1ff5ffb700 1 -- 172.21.15.107:0/1153552861 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f1ff00058d0 con 0x7f1ff810cf90 2023-08-10T10:52:08.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.408+0000 7f2012be2b80 1 Processor -- start 2023-08-10T10:52:08.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.409+0000 7f2012be2b80 1 -- start start 2023-08-10T10:52:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.409+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fdf50 0x555d2b5fe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.409+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 0x555d2b5f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.409+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b5f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.409+0000 7f2012be2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b573dc0 con 0x555d2b5f8800 2023-08-10T10:52:08.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.409+0000 7f2012be2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b550590 con 0x555d2b5fdf50 2023-08-10T10:52:08.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.409+0000 7f2012be2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b54deb0 con 0x555d2b5fe870 2023-08-10T10:52:08.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.409+0000 7f1ff5ffb700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1fe80a13e0 0x7f1fe80a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ff5ffb700 1 -- 172.21.15.107:0/1153552861 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f1ff00d6a20 con 0x7f1ff810cf90 2023-08-10T10:52:08.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ff7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fdf50 0x555d2b5fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ff7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fdf50 0x555d2b5fe330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:54388/0 (socket says 172.21.15.107:54388) 2023-08-10T10:52:08.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ffd79c700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1fe80a13e0 0x7f1fe80a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ff7fff700 1 -- 172.21.15.107:0/3327679031 learned_addr learned my addr 172.21.15.107:0/3327679031 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 0x555d2b5f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b5f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/3327679031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fdf50 msgr2=0x555d2b5fe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fdf50 0x555d2b5fe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/3327679031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 msgr2=0x555d2b5f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b5f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/3327679031 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d2b3ca630 con 0x555d2b5fe870 2023-08-10T10:52:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.410+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fdf50 0x555d2b5fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.411+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 0x555d2b5f82c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009cb0 tx=0x7f1fec011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec8f116917478823 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.411+0000 7f1ffd79c700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1fe80a13e0 0x7f1fe80a38a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00d3cf0 tx=0x7f1ff000b740 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.411+0000 7f1fe2ffd700 1 -- 172.21.15.107:0/3327679031 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec011d20 con 0x555d2b5fe870 2023-08-10T10:52:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.411+0000 7f1fe2ffd700 1 -- 172.21.15.107:0/3327679031 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fec011e80 con 0x555d2b5fe870 2023-08-10T10:52:08.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.411+0000 7f1fe2ffd700 1 -- 172.21.15.107:0/3327679031 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec005280 con 0x555d2b5fe870 2023-08-10T10:52:08.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 -- 172.21.15.107:0/3327679031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 msgr2=0x555d2b5f82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 0x555d2b5f82c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009cb0 tx=0x7f1fec011440 comp rx=0 tx=0).stop 2023-08-10T10:52:08.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 -- 172.21.15.107:0/3327679031 shutdown_connections 2023-08-10T10:52:08.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fdf50 0x555d2b5fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b5f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 --2- 172.21.15.107:0/3327679031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 0x555d2b5f82c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 -- 172.21.15.107:0/3327679031 >> 172.21.15.107:0/3327679031 conn(0x555d2b555cd0 msgr2=0x555d2b5f34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 -- 172.21.15.107:0/3327679031 shutdown_connections 2023-08-10T10:52:08.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 -- 172.21.15.107:0/3327679031 wait complete. 2023-08-10T10:52:08.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.412+0000 7f2012be2b80 1 -- start start 2023-08-10T10:52:08.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.413+0000 7f2012be2b80 1 Processor -- start 2023-08-10T10:52:08.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.413+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5f8800 0x555d2b601c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.413+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b602190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.413+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fe870 0x555d2b6026d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.413+0000 7f2012be2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b5497a0 con 0x555d2b5fdf50 2023-08-10T10:52:08.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.413+0000 7f2012be2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b4e8ac0 con 0x555d2b5fe870 2023-08-10T10:52:08.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.413+0000 7f2012be2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b4e87c0 con 0x555d2b5f8800 2023-08-10T10:52:08.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f2012be2b80 10 client.0 _ll_register_callbacks cb 0x555d2b4e6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:08.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ffcf9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b602190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ffcf9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b602190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37078/0 (socket says 172.21.15.107:37078) 2023-08-10T10:52:08.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/1722145421 learned_addr learned my addr 172.21.15.107:0/1722145421 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5f8800 0x555d2b601c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fe870 0x555d2b6026d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/1722145421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5f8800 msgr2=0x555d2b601c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5f8800 0x555d2b601c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/1722145421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fe870 msgr2=0x555d2b6026d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fe870 0x555d2b6026d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/1722145421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe401a040 con 0x555d2b5fdf50 2023-08-10T10:52:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.414+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5f8800 0x555d2b601c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.415+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b602190 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1fec011bd0 tx=0x7f1fec005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50018409e736f1e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.415+0000 7f1fd7fff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:08.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.415+0000 7f1fd7fff700 1 -- 172.21.15.107:0/1722145421 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec004260 con 0x555d2b5fdf50 2023-08-10T10:52:08.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.415+0000 7f2012be2b80 1 -- 172.21.15.107:0/1722145421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d2b5c79d0 con 0x555d2b5fdf50 2023-08-10T10:52:08.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.415+0000 7f1fd7fff700 1 -- 172.21.15.107:0/1722145421 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f1fec0043c0 con 0x555d2b5fdf50 2023-08-10T10:52:08.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.415+0000 7f1fd7fff700 1 -- 172.21.15.107:0/1722145421 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fec004580 con 0x555d2b5fdf50 2023-08-10T10:52:08.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.415+0000 7f2012be2b80 10 client.16014 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:08.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.415+0000 7f2012be2b80 1 -- 172.21.15.107:0/1722145421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f1fec0098e0 con 0x555d2b5fdf50 2023-08-10T10:52:08.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.416+0000 7f1fd7fff700 1 -- 172.21.15.107:0/1722145421 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555d2b5c79d0 con 0x555d2b5fdf50 2023-08-10T10:52:08.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.416+0000 7f1fd7fff700 1 -- 172.21.15.107:0/1722145421 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1fec005020 con 0x555d2b5fdf50 2023-08-10T10:52:08.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.416+0000 7f2012be2b80 10 client.16014 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:08.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.416+0000 7f2012be2b80 10 client.16014 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-08-10T10:52:08.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.416+0000 7f2012be2b80 20 client.16014 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:08.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.416+0000 7f2012be2b80 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x555d2b6121e0 0x555d2b614600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.416+0000 7f2012be2b80 4 client.16014 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:08.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.416+0000 7f2012be2b80 1 -- 172.21.15.107:0/1722145421 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d2b542780 con 0x555d2b6121e0 2023-08-10T10:52:08.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.417+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x555d2b6121e0 0x555d2b614600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.417+0000 7f1fd7fff700 10 client.16014 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:52:08.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.417+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x555d2b6121e0 0x555d2b614600 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=34c75def46b36f2b server_cookie=804286ac9e278278 in_seq=0 out_seq=0 2023-08-10T10:52:08.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f1fd7fff700 1 -- 172.21.15.107:0/1722145421 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x555d2b542780 con 0x555d2b6121e0 2023-08-10T10:52:08.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f1fd7fff700 10 client.16014 handle_command_reply: tid=0 2023-08-10T10:52:08.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 client.16014 shutdown 2023-08-10T10:52:08.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 -- 172.21.15.107:0/1722145421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 msgr2=0x555d2b602190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b602190 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1fec011bd0 tx=0x7f1fec005e50 comp rx=0 tx=0).stop 2023-08-10T10:52:08.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 -- 172.21.15.107:0/1722145421 shutdown_connections 2023-08-10T10:52:08.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x555d2b6121e0 0x555d2b614600 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fe870 0x555d2b6026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5f8800 0x555d2b601c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f1fd7fff700 0 client.16014 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:52:08.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 --2- 172.21.15.107:0/1722145421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b602190 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 -- 172.21.15.107:0/1722145421 >> 172.21.15.107:0/1722145421 conn(0x555d2b555cd0 msgr2=0x555d2b5f29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 -- 172.21.15.107:0/1722145421 shutdown_connections 2023-08-10T10:52:08.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 1 -- 172.21.15.107:0/1722145421 wait complete. 2023-08-10T10:52:08.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.418+0000 7f2012be2b80 20 client.16014 trim_cache size 0 max 16384 2023-08-10T10:52:08.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.437+0000 7f2012be2b80 1 Processor -- start 2023-08-10T10:52:08.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.437+0000 7f2012be2b80 1 -- start start 2023-08-10T10:52:08.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5f8800 0x555d2b5f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b5f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 0x555d2b609360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f2012be2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b3cc920 con 0x555d2b5fdf50 2023-08-10T10:52:08.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f2012be2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b602d90 con 0x555d2b5f8800 2023-08-10T10:52:08.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f2012be2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b5eff80 con 0x555d2b5fe870 2023-08-10T10:52:08.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f1ffcf9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b5f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f1ffcf9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b5f8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37082/0 (socket says 172.21.15.107:37082) 2023-08-10T10:52:08.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/4130426091 learned_addr learned my addr 172.21.15.107:0/4130426091 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/4130426091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5f8800 0x555d2b5f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.438+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/4130426091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 msgr2=0x555d2b609360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.439+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/4130426091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 0x555d2b609360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.439+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/4130426091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5f8800 msgr2=0x555d2b5f82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.439+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/4130426091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5f8800 0x555d2b5f82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.439+0000 7f1ffcf9b700 1 -- 172.21.15.107:0/4130426091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d2b376de0 con 0x555d2b5fdf50 2023-08-10T10:52:08.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.439+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/4130426091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b5f8be0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009bd0 tx=0x7f1fec01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170292acf7cd4643 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.439+0000 7f1fe37fe700 1 -- 172.21.15.107:0/4130426091 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec011840 con 0x555d2b5fdf50 2023-08-10T10:52:08.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.439+0000 7f1fe37fe700 1 -- 172.21.15.107:0/4130426091 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fec011d60 con 0x555d2b5fdf50 2023-08-10T10:52:08.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.439+0000 7f1fe37fe700 1 -- 172.21.15.107:0/4130426091 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0038e0 con 0x555d2b5fdf50 2023-08-10T10:52:08.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 -- 172.21.15.107:0/4130426091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 msgr2=0x555d2b5f8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 --2- 172.21.15.107:0/4130426091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b5f8be0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009bd0 tx=0x7f1fec01c000 comp rx=0 tx=0).stop 2023-08-10T10:52:08.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 -- 172.21.15.107:0/4130426091 shutdown_connections 2023-08-10T10:52:08.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 --2- 172.21.15.107:0/4130426091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5f8800 0x555d2b5f82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 --2- 172.21.15.107:0/4130426091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fe870 0x555d2b609360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 --2- 172.21.15.107:0/4130426091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5fdf50 0x555d2b5f8be0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 -- 172.21.15.107:0/4130426091 >> 172.21.15.107:0/4130426091 conn(0x555d2b555cd0 msgr2=0x555d2b5fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 -- 172.21.15.107:0/4130426091 shutdown_connections 2023-08-10T10:52:08.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 -- 172.21.15.107:0/4130426091 wait complete. 2023-08-10T10:52:08.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.440+0000 7f2012be2b80 1 -- start start 2023-08-10T10:52:08.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.441+0000 7f2012be2b80 1 Processor -- start 2023-08-10T10:52:08.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.441+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b607540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.441+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fdf50 0x555d2b607a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.441+0000 7f2012be2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fe870 0x555d2b664e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.441+0000 7f2012be2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b6081c0 con 0x555d2b5f8800 2023-08-10T10:52:08.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.441+0000 7f2012be2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b665390 con 0x555d2b5fe870 2023-08-10T10:52:08.445 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.441+0000 7f2012be2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b6654d0 con 0x555d2b5fdf50 2023-08-10T10:52:08.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.441+0000 7f2012be2b80 10 client.0 _ll_register_callbacks cb 0x555d2b4e6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:08.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ff7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b607540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ff7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b607540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37088/0 (socket says 172.21.15.107:37088) 2023-08-10T10:52:08.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ff7fff700 1 -- 172.21.15.107:0/55857489 learned_addr learned my addr 172.21.15.107:0/55857489 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fdf50 0x555d2b607a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ff7fff700 1 -- 172.21.15.107:0/55857489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fdf50 msgr2=0x555d2b607a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fdf50 0x555d2b607a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ff7fff700 1 -- 172.21.15.107:0/55857489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fe870 msgr2=0x555d2b664e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fe870 0x555d2b664e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ff7fff700 1 -- 172.21.15.107:0/55857489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0098e0 con 0x555d2b5f8800 2023-08-10T10:52:08.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1ff7fff700 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b607540 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4004790 tx=0x7f1fe40044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449076863e6a21a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.442+0000 7f1fd7fff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:08.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f1fd7fff700 1 -- 172.21.15.107:0/55857489 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4021e60 con 0x555d2b5f8800 2023-08-10T10:52:08.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f2012be2b80 1 -- 172.21.15.107:0/55857489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d2b5eb470 con 0x555d2b5f8800 2023-08-10T10:52:08.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f1fd7fff700 1 -- 172.21.15.107:0/55857489 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f1fe4004830 con 0x555d2b5f8800 2023-08-10T10:52:08.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f1fd7fff700 1 -- 172.21.15.107:0/55857489 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fe40049f0 con 0x555d2b5f8800 2023-08-10T10:52:08.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f2012be2b80 10 client.16020 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:08.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f2012be2b80 1 -- 172.21.15.107:0/55857489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555d2b35fc60 con 0x555d2b5f8800 2023-08-10T10:52:08.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f1fd7fff700 1 -- 172.21.15.107:0/55857489 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555d2b5eb470 con 0x555d2b5f8800 2023-08-10T10:52:08.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f1fd7fff700 1 -- 172.21.15.107:0/55857489 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1fe401d070 con 0x555d2b5f8800 2023-08-10T10:52:08.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f2012be2b80 10 client.16020 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:08.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f2012be2b80 10 client.16020 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-08-10T10:52:08.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f2012be2b80 20 client.16020 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:08.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.443+0000 7f2012be2b80 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x555d2b666ad0 0x555d2b668ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.444+0000 7f2012be2b80 4 client.16020 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:08.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.444+0000 7f2012be2b80 1 -- 172.21.15.107:0/55857489 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555d2b504050 con 0x555d2b666ad0 2023-08-10T10:52:08.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.444+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x555d2b666ad0 0x555d2b668ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.445+0000 7f1fd7fff700 10 client.16020 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:52:08.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.445+0000 7f1ffcf9b700 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x555d2b666ad0 0x555d2b668ef0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6938b49b6ed17ba0 server_cookie=a64ff4867d403a2a in_seq=0 out_seq=0 2023-08-10T10:52:08.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.445+0000 7f1fd7fff700 1 -- 172.21.15.107:0/55857489 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555d2b504050 con 0x555d2b666ad0 2023-08-10T10:52:08.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.445+0000 7f1fd7fff700 10 client.16020 handle_command_reply: tid=0 2023-08-10T10:52:08.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.445+0000 7f2012be2b80 1 client.16020 shutdown 2023-08-10T10:52:08.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.445+0000 7f2012be2b80 1 -- 172.21.15.107:0/55857489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 msgr2=0x555d2b607540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.445+0000 7f2012be2b80 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b607540 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4004790 tx=0x7f1fe40044e0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.445+0000 7f2012be2b80 1 -- 172.21.15.107:0/55857489 shutdown_connections 2023-08-10T10:52:08.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.445+0000 7f2012be2b80 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x555d2b666ad0 0x555d2b668ef0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.446+0000 7f2012be2b80 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d2b5fe870 0x555d2b664e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.446+0000 7f1fd7fff700 0 client.16020 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:52:08.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.446+0000 7f2012be2b80 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555d2b5f8800 0x555d2b607540 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.446+0000 7f2012be2b80 1 --2- 172.21.15.107:0/55857489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d2b5fdf50 0x555d2b607a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.446+0000 7f2012be2b80 1 -- 172.21.15.107:0/55857489 >> 172.21.15.107:0/55857489 conn(0x555d2b555cd0 msgr2=0x555d2b602480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.446+0000 7f2012be2b80 1 -- 172.21.15.107:0/55857489 shutdown_connections 2023-08-10T10:52:08.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.446+0000 7f2012be2b80 1 -- 172.21.15.107:0/55857489 wait complete. 2023-08-10T10:52:08.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.446+0000 7f2012be2b80 20 client.16020 trim_cache size 0 max 16384 2023-08-10T10:52:08.453 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:08.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 -- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1fe80a13e0 msgr2=0x7f1fe80a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1fe80a13e0 0x7f1fe80a38a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00d3cf0 tx=0x7f1ff000b740 comp rx=0 tx=0).stop 2023-08-10T10:52:08.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 -- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 msgr2=0x7f1ff8198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 0x7f1ff8198960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000d010 tx=0x7f1ff000bce0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 -- 172.21.15.107:0/1153552861 shutdown_connections 2023-08-10T10:52:08.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ff810cf90 0x7f1ff8198960 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff8072b40 0x7f1ff819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1fe80a13e0 0x7f1fe80a38a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 --2- 172.21.15.107:0/1153552861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff8073460 0x7f1ff819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 -- 172.21.15.107:0/1153552861 >> 172.21.15.107:0/1153552861 conn(0x7f1ff80fc1e0 msgr2=0x7f1ff810f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 -- 172.21.15.107:0/1153552861 shutdown_connections 2023-08-10T10:52:08.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.447+0000 7f1fff1ff700 1 -- 172.21.15.107:0/1153552861 wait complete. 2023-08-10T10:52:08.469 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-10T10:52:08.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.708+0000 7f15a49ff700 1 -- 172.21.15.107:0/3424317221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 msgr2=0x7f15a010a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.708+0000 7f15a49ff700 1 --2- 172.21.15.107:0/3424317221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 0x7f15a010a6e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1594009990 tx=0x7f1594009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.708+0000 7f15a49ff700 1 -- 172.21.15.107:0/3424317221 shutdown_connections 2023-08-10T10:52:08.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.708+0000 7f15a49ff700 1 --2- 172.21.15.107:0/3424317221 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a01018e0 0x7f15a0101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.708+0000 7f15a49ff700 1 --2- 172.21.15.107:0/3424317221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15a010acb0 0x7f15a010d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.708+0000 7f15a49ff700 1 --2- 172.21.15.107:0/3424317221 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 0x7f15a010a6e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.708+0000 7f15a49ff700 1 -- 172.21.15.107:0/3424317221 >> 172.21.15.107:0/3424317221 conn(0x7f15a00fb0c0 msgr2=0x7f15a00fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.708+0000 7f15a49ff700 1 -- 172.21.15.107:0/3424317221 shutdown_connections 2023-08-10T10:52:08.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.708+0000 7f15a49ff700 1 -- 172.21.15.107:0/3424317221 wait complete. 2023-08-10T10:52:08.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.709+0000 7f15a49ff700 1 Processor -- start 2023-08-10T10:52:08.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f15a49ff700 1 -- start start 2023-08-10T10:52:08.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f15a49ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15a01018e0 0x7f15a0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f15a49ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 0x7f15a0198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f15a49ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a010acb0 0x7f15a019d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f15a49ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a019d910 con 0x7f15a0102200 2023-08-10T10:52:08.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f15a49ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a019da80 con 0x7f15a010acb0 2023-08-10T10:52:08.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f15a49ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a019dc40 con 0x7f15a01018e0 2023-08-10T10:52:08.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f159dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 0x7f15a0198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f159dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 0x7f15a0198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37104/0 (socket says 172.21.15.107:37104) 2023-08-10T10:52:08.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f159dd9b700 1 -- 172.21.15.107:0/1632189064 learned_addr learned my addr 172.21.15.107:0/1632189064 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.710+0000 7f159e59c700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15a01018e0 0x7f15a0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f159ed9d700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a010acb0 0x7f15a019d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f159dd9b700 1 -- 172.21.15.107:0/1632189064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15a01018e0 msgr2=0x7f15a0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f159dd9b700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15a01018e0 0x7f15a0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f159dd9b700 1 -- 172.21.15.107:0/1632189064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a010acb0 msgr2=0x7f15a019d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f159dd9b700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a010acb0 0x7f15a019d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f159dd9b700 1 -- 172.21.15.107:0/1632189064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940095f0 con 0x7f15a0102200 2023-08-10T10:52:08.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f159ed9d700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a010acb0 0x7f15a019d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:08.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f159dd9b700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 0x7f15a0198eb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f15940036c0 tx=0x7f1594005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f158f7fe700 1 -- 172.21.15.107:0/1632189064 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159401d070 con 0x7f15a0102200 2023-08-10T10:52:08.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f158f7fe700 1 -- 172.21.15.107:0/1632189064 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1594003f40 con 0x7f15a0102200 2023-08-10T10:52:08.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f15a49ff700 1 -- 172.21.15.107:0/1632189064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a019dec0 con 0x7f15a0102200 2023-08-10T10:52:08.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f158f7fe700 1 -- 172.21.15.107:0/1632189064 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594022c40 con 0x7f15a0102200 2023-08-10T10:52:08.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.711+0000 7f15a49ff700 1 -- 172.21.15.107:0/1632189064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a019e190 con 0x7f15a0102200 2023-08-10T10:52:08.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.715+0000 7f158f7fe700 1 -- 172.21.15.107:0/1632189064 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f1594022470 con 0x7f15a0102200 2023-08-10T10:52:08.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.716+0000 7f15b82c4b80 1 Processor -- start 2023-08-10T10:52:08.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f15b82c4b80 1 -- start start 2023-08-10T10:52:08.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc23330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc1d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc1dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddb98dc0 con 0x55e4ddc22f50 2023-08-10T10:52:08.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddb75590 con 0x55e4ddc23870 2023-08-10T10:52:08.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddb72eb0 con 0x55e4ddc1d800 2023-08-10T10:52:08.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f159ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc23330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f159ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc23330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37106/0 (socket says 172.21.15.107:37106) 2023-08-10T10:52:08.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f159ed9d700 1 -- 172.21.15.107:0/2855459600 learned_addr learned my addr 172.21.15.107:0/2855459600 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.717+0000 7f159dd9b700 1 --2- 172.21.15.107:0/2855459600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc1dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.718+0000 7f158f7fe700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f15880a13e0 0x7f15880a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.718+0000 7f159e59c700 1 --2- 172.21.15.107:0/2855459600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc1d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.718+0000 7f159ed9d700 1 -- 172.21.15.107:0/2855459600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 msgr2=0x55e4ddc1dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.718+0000 7f159ed9d700 1 --2- 172.21.15.107:0/2855459600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc1dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.718+0000 7f159ed9d700 1 -- 172.21.15.107:0/2855459600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 msgr2=0x55e4ddc1d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.718+0000 7f159ed9d700 1 --2- 172.21.15.107:0/2855459600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc1d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.718+0000 7f159ed9d700 1 -- 172.21.15.107:0/2855459600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4dd9ef630 con 0x55e4ddc22f50 2023-08-10T10:52:08.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.718+0000 7f158f7fe700 1 -- 172.21.15.107:0/1632189064 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f15940ce800 con 0x7f15a0102200 2023-08-10T10:52:08.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.718+0000 7f159ed9d700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f15880a13e0 0x7f15880a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.719+0000 7f159ed9d700 1 --2- 172.21.15.107:0/2855459600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc23330 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1598009dd0 tx=0x7f15980077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44aa15bce277eb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.719+0000 7f158cff9700 1 -- 172.21.15.107:0/2855459600 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15980173d0 con 0x55e4ddc22f50 2023-08-10T10:52:08.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.719+0000 7f158cff9700 1 -- 172.21.15.107:0/2855459600 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f159800f050 con 0x55e4ddc22f50 2023-08-10T10:52:08.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.719+0000 7f158cff9700 1 -- 172.21.15.107:0/2855459600 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15980165b0 con 0x55e4ddc22f50 2023-08-10T10:52:08.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f15b82c4b80 1 -- 172.21.15.107:0/2855459600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 msgr2=0x55e4ddc23330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f159ed9d700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f15880a13e0 0x7f15880a38a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1598020000 tx=0x7f1598021000 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/2855459600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc23330 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1598009dd0 tx=0x7f15980077e0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f15b82c4b80 1 -- 172.21.15.107:0/2855459600 shutdown_connections 2023-08-10T10:52:08.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/2855459600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc1dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/2855459600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc23330 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/2855459600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc1d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f15b82c4b80 1 -- 172.21.15.107:0/2855459600 >> 172.21.15.107:0/2855459600 conn(0x55e4ddb7acd0 msgr2=0x55e4ddc184d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f15b82c4b80 1 -- 172.21.15.107:0/2855459600 shutdown_connections 2023-08-10T10:52:08.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.720+0000 7f15b82c4b80 1 -- 172.21.15.107:0/2855459600 wait complete. 2023-08-10T10:52:08.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.721+0000 7f15b82c4b80 1 -- start start 2023-08-10T10:52:08.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.721+0000 7f15b82c4b80 1 Processor -- start 2023-08-10T10:52:08.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.721+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc1d800 0x55e4ddc29890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.721+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc26b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.721+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc23870 0x55e4ddc27190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.721+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddb6e7a0 con 0x55e4ddc22f50 2023-08-10T10:52:08.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.721+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddb0dac0 con 0x55e4ddc1d800 2023-08-10T10:52:08.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.721+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddb0d7c0 con 0x55e4ddc23870 2023-08-10T10:52:08.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.721+0000 7f15b82c4b80 10 client.0 _ll_register_callbacks cb 0x55e4ddb0b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:08.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc26b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc1d800 0x55e4ddc29890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc26b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37120/0 (socket says 172.21.15.107:37120) 2023-08-10T10:52:08.727 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159dd9b700 1 -- 172.21.15.107:0/1158070874 learned_addr learned my addr 172.21.15.107:0/1158070874 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159ed9d700 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc23870 0x55e4ddc27190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159dd9b700 1 -- 172.21.15.107:0/1158070874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc23870 msgr2=0x55e4ddc27190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159dd9b700 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc23870 0x55e4ddc27190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159dd9b700 1 -- 172.21.15.107:0/1158070874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc1d800 msgr2=0x55e4ddc29890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159dd9b700 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc1d800 0x55e4ddc29890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159dd9b700 1 -- 172.21.15.107:0/1158070874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1598009a00 con 0x55e4ddc22f50 2023-08-10T10:52:08.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159e59c700 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc1d800 0x55e4ddc29890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:08.728 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f159dd9b700 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc26b10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f15940978b0 tx=0x7f1594009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1a79afb5ef0c0a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.722+0000 7f1585ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:08.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.723+0000 7f1585ffb700 1 -- 172.21.15.107:0/1158070874 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159409ad10 con 0x55e4ddc22f50 2023-08-10T10:52:08.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.723+0000 7f1585ffb700 1 -- 172.21.15.107:0/1158070874 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f15940040b0 con 0x55e4ddc22f50 2023-08-10T10:52:08.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.723+0000 7f15b82c4b80 1 -- 172.21.15.107:0/1158070874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4ddc10470 con 0x55e4ddc22f50 2023-08-10T10:52:08.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.723+0000 7f1585ffb700 1 -- 172.21.15.107:0/1158070874 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f159409b3b0 con 0x55e4ddc22f50 2023-08-10T10:52:08.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.723+0000 7f15b82c4b80 10 client.16032 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:08.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.723+0000 7f15b82c4b80 1 -- 172.21.15.107:0/1158070874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55e4dd99bde0 con 0x55e4ddc22f50 2023-08-10T10:52:08.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.723+0000 7f1585ffb700 1 -- 172.21.15.107:0/1158070874 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e4ddc10470 con 0x55e4ddc22f50 2023-08-10T10:52:08.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.724+0000 7f1585ffb700 1 -- 172.21.15.107:0/1158070874 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f159409a8a0 con 0x55e4ddc22f50 2023-08-10T10:52:08.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.724+0000 7f15b82c4b80 10 client.16032 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:08.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.724+0000 7f15b82c4b80 10 client.16032 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T10:52:08.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.724+0000 7f15b82c4b80 20 client.16032 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:08.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.724+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x55e4ddc36dd0 0x55e4ddc391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.724+0000 7f15b82c4b80 4 client.16032 mds_command: new command op to 24497 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:08.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.724+0000 7f15b82c4b80 1 -- 172.21.15.107:0/1158070874 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4ddbec9d0 con 0x55e4ddc36dd0 2023-08-10T10:52:08.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.724+0000 7f159e59c700 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x55e4ddc36dd0 0x55e4ddc391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.725+0000 7f1585ffb700 10 client.16032 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:52:08.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.725+0000 7f159e59c700 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x55e4ddc36dd0 0x55e4ddc391c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9ef2452e6b713986 server_cookie=932c9be3dead1e6a in_seq=0 out_seq=0 2023-08-10T10:52:08.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.725+0000 7f1585ffb700 1 -- 172.21.15.107:0/1158070874 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e4ddbec9d0 con 0x55e4ddc36dd0 2023-08-10T10:52:08.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.725+0000 7f1585ffb700 10 client.16032 handle_command_reply: tid=0 2023-08-10T10:52:08.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.725+0000 7f15b82c4b80 1 client.16032 shutdown 2023-08-10T10:52:08.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 -- 172.21.15.107:0/1158070874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 msgr2=0x55e4ddc26b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc26b10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f15940978b0 tx=0x7f1594009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 -- 172.21.15.107:0/1158070874 shutdown_connections 2023-08-10T10:52:08.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x55e4ddc36dd0 0x55e4ddc391c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc1d800 0x55e4ddc29890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f1585ffb700 0 client.16032 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:52:08.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc23870 0x55e4ddc27190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/1158070874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc26b10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 -- 172.21.15.107:0/1158070874 >> 172.21.15.107:0/1158070874 conn(0x55e4ddb7acd0 msgr2=0x55e4ddc179b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 -- 172.21.15.107:0/1158070874 shutdown_connections 2023-08-10T10:52:08.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 1 -- 172.21.15.107:0/1158070874 wait complete. 2023-08-10T10:52:08.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.726+0000 7f15b82c4b80 20 client.16032 trim_cache size 0 max 16384 2023-08-10T10:52:08.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.741+0000 7f15b82c4b80 1 Processor -- start 2023-08-10T10:52:08.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.741+0000 7f15b82c4b80 1 -- start start 2023-08-10T10:52:08.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.741+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc3db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.741+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc22300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.741+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc29430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.741+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4dd9f1920 con 0x55e4ddc22f50 2023-08-10T10:52:08.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.741+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddc33c80 con 0x55e4ddc23870 2023-08-10T10:52:08.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.741+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddc280f0 con 0x55e4ddc1d800 2023-08-10T10:52:08.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc22300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc3db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc22300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37126/0 (socket says 172.21.15.107:37126) 2023-08-10T10:52:08.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159dd9b700 1 -- 172.21.15.107:0/633463059 learned_addr learned my addr 172.21.15.107:0/633463059 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159ed9d700 1 --2- 172.21.15.107:0/633463059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc29430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159e59c700 1 -- 172.21.15.107:0/633463059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 msgr2=0x55e4ddc29430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159e59c700 1 --2- 172.21.15.107:0/633463059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc29430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159e59c700 1 -- 172.21.15.107:0/633463059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 msgr2=0x55e4ddc22300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159e59c700 1 --2- 172.21.15.107:0/633463059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc22300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159e59c700 1 -- 172.21.15.107:0/633463059 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4dd984c60 con 0x55e4ddc1d800 2023-08-10T10:52:08.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.742+0000 7f159dd9b700 1 --2- 172.21.15.107:0/633463059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc22300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:08.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.743+0000 7f159e59c700 1 --2- 172.21.15.107:0/633463059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc3db20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1594099700 tx=0x7f159000b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=362c2539bfd02ba2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.743+0000 7f158d7fa700 1 -- 172.21.15.107:0/633463059 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590016030 con 0x55e4ddc1d800 2023-08-10T10:52:08.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.743+0000 7f158d7fa700 1 -- 172.21.15.107:0/633463059 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1590017040 con 0x55e4ddc1d800 2023-08-10T10:52:08.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.743+0000 7f158d7fa700 1 -- 172.21.15.107:0/633463059 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590005020 con 0x55e4ddc1d800 2023-08-10T10:52:08.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.743+0000 7f15b82c4b80 1 -- 172.21.15.107:0/633463059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 msgr2=0x55e4ddc3db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.743+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/633463059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc3db20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1594099700 tx=0x7f159000b410 comp rx=0 tx=0).stop 2023-08-10T10:52:08.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.744+0000 7f15b82c4b80 1 -- 172.21.15.107:0/633463059 shutdown_connections 2023-08-10T10:52:08.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.744+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/633463059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc29430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.744+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/633463059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc3db20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.744+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/633463059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc22300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.744+0000 7f15b82c4b80 1 -- 172.21.15.107:0/633463059 >> 172.21.15.107:0/633463059 conn(0x55e4ddb7acd0 msgr2=0x55e4ddc21bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.744+0000 7f15b82c4b80 1 -- 172.21.15.107:0/633463059 shutdown_connections 2023-08-10T10:52:08.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.744+0000 7f15b82c4b80 1 -- 172.21.15.107:0/633463059 wait complete. 2023-08-10T10:52:08.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.744+0000 7f15b82c4b80 1 -- start start 2023-08-10T10:52:08.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.744+0000 7f15b82c4b80 1 Processor -- start 2023-08-10T10:52:08.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc2df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc2e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f15b82c4b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc2c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddc2cc60 con 0x55e4ddc22f50 2023-08-10T10:52:08.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddc2cdd0 con 0x55e4ddc23870 2023-08-10T10:52:08.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f15b82c4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ddc2cf90 con 0x55e4ddc1d800 2023-08-10T10:52:08.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f15b82c4b80 10 client.0 _ll_register_callbacks cb 0x55e4ddb0b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:08.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f159dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc2e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f159e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc2df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f159e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc2df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:60116/0 (socket says 172.21.15.107:60116) 2023-08-10T10:52:08.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f159e59c700 1 -- 172.21.15.107:0/463581240 learned_addr learned my addr 172.21.15.107:0/463581240 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:08.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.745+0000 7f159ed9d700 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc2c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f159dd9b700 1 -- 172.21.15.107:0/463581240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 msgr2=0x55e4ddc2df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f159dd9b700 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc2df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f159dd9b700 1 -- 172.21.15.107:0/463581240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 msgr2=0x55e4ddc2c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:08.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f159dd9b700 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc2c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f159dd9b700 1 -- 172.21.15.107:0/463581240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4dd99bde0 con 0x55e4ddc22f50 2023-08-10T10:52:08.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f159dd9b700 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc2e440 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1594097e20 tx=0x7f15940970c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f8a76f2f90f6d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:08.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f1585ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:08.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f1585ffb700 1 -- 172.21.15.107:0/463581240 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159409ad10 con 0x55e4ddc22f50 2023-08-10T10:52:08.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f15b82c4b80 1 -- 172.21.15.107:0/463581240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f159800f050 con 0x55e4ddc22f50 2023-08-10T10:52:08.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f1585ffb700 1 -- 172.21.15.107:0/463581240 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f15940040b0 con 0x55e4ddc22f50 2023-08-10T10:52:08.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f1585ffb700 1 -- 172.21.15.107:0/463581240 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15940976f0 con 0x55e4ddc22f50 2023-08-10T10:52:08.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f15b82c4b80 10 client.16038 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:08.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.746+0000 7f15b82c4b80 1 -- 172.21.15.107:0/463581240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f1590004450 con 0x55e4ddc22f50 2023-08-10T10:52:08.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.747+0000 7f1585ffb700 1 -- 172.21.15.107:0/463581240 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f159800f050 con 0x55e4ddc22f50 2023-08-10T10:52:08.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.747+0000 7f1585ffb700 1 -- 172.21.15.107:0/463581240 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f15940a32e0 con 0x55e4ddc22f50 2023-08-10T10:52:08.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.747+0000 7f15b82c4b80 10 client.16038 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:08.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.747+0000 7f15b82c4b80 10 client.16038 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T10:52:08.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.747+0000 7f15b82c4b80 20 client.16038 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:08.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.747+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x55e4ddc8b8f0 0x55e4ddc8dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:08.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.747+0000 7f15b82c4b80 4 client.16038 mds_command: new command op to 24497 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:08.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.747+0000 7f15b82c4b80 1 -- 172.21.15.107:0/463581240 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e4ddb67780 con 0x55e4ddc8b8f0 2023-08-10T10:52:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.747+0000 7f159e59c700 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x55e4ddc8b8f0 0x55e4ddc8dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f1585ffb700 10 client.16038 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:52:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f159e59c700 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x55e4ddc8b8f0 0x55e4ddc8dd10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=51a99bc065bbe182 server_cookie=2b40d6ad2e9944ac in_seq=0 out_seq=0 2023-08-10T10:52:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f1585ffb700 1 -- 172.21.15.107:0/463581240 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e4ddb67780 con 0x55e4ddc8b8f0 2023-08-10T10:52:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f1585ffb700 10 client.16038 handle_command_reply: tid=0 2023-08-10T10:52:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f15b82c4b80 1 client.16038 shutdown 2023-08-10T10:52:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f15b82c4b80 1 -- 172.21.15.107:0/463581240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 msgr2=0x55e4ddc2e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc2e440 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1594097e20 tx=0x7f15940970c0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f15b82c4b80 1 -- 172.21.15.107:0/463581240 shutdown_connections 2023-08-10T10:52:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x55e4ddc8b8f0 0x55e4ddc8dd10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4ddc23870 0x55e4ddc2c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4ddc1d800 0x55e4ddc2df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f1585ffb700 0 client.16038 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:52:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f15b82c4b80 1 --2- 172.21.15.107:0/463581240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e4ddc22f50 0x55e4ddc2e440 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.748+0000 7f15b82c4b80 1 -- 172.21.15.107:0/463581240 >> 172.21.15.107:0/463581240 conn(0x55e4ddb7acd0 msgr2=0x55e4ddc23c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.749+0000 7f15b82c4b80 1 -- 172.21.15.107:0/463581240 shutdown_connections 2023-08-10T10:52:08.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.749+0000 7f15b82c4b80 1 -- 172.21.15.107:0/463581240 wait complete. 2023-08-10T10:52:08.757 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.749+0000 7f15b82c4b80 20 client.16038 trim_cache size 0 max 16384 2023-08-10T10:52:08.757 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:08.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 -- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f15880a13e0 msgr2=0x7f15880a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f15880a13e0 0x7f15880a38a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1598020000 tx=0x7f1598021000 comp rx=0 tx=0).stop 2023-08-10T10:52:08.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 -- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 msgr2=0x7f15a0198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:08.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 0x7f15a0198eb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f15940036c0 tx=0x7f1594005740 comp rx=0 tx=0).stop 2023-08-10T10:52:08.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 -- 172.21.15.107:0/1632189064 shutdown_connections 2023-08-10T10:52:08.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f15880a13e0 0x7f15880a38a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15a010acb0 0x7f15a019d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15a01018e0 0x7f15a0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 --2- 172.21.15.107:0/1632189064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15a0102200 0x7f15a0198eb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:08.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 -- 172.21.15.107:0/1632189064 >> 172.21.15.107:0/1632189064 conn(0x7f15a00fb0c0 msgr2=0x7f15a00fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:08.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 -- 172.21.15.107:0/1632189064 shutdown_connections 2023-08-10T10:52:08.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:08.750+0000 7f15a49ff700 1 -- 172.21.15.107:0/1632189064 wait complete. 2023-08-10T10:52:08.769 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-10T10:52:09.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.008+0000 7f771dbff700 1 -- 172.21.15.107:0/1482809972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181066f0 msgr2=0x7f7718106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.008+0000 7f771dbff700 1 --2- 172.21.15.107:0/1482809972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181066f0 0x7f7718106ad0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7708009990 tx=0x7f7708009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.008+0000 7f771dbff700 1 -- 172.21.15.107:0/1482809972 shutdown_connections 2023-08-10T10:52:09.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.008+0000 7f771dbff700 1 --2- 172.21.15.107:0/1482809972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77181010a0 0x7f771810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.008+0000 7f771dbff700 1 --2- 172.21.15.107:0/1482809972 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181066f0 0x7f7718106ad0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.008+0000 7f771dbff700 1 --2- 172.21.15.107:0/1482809972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77181006e0 0x7f7718100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.008+0000 7f771dbff700 1 -- 172.21.15.107:0/1482809972 >> 172.21.15.107:0/1482809972 conn(0x7f77180fc1d0 msgr2=0x7f77180fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.008+0000 7f771dbff700 1 -- 172.21.15.107:0/1482809972 shutdown_connections 2023-08-10T10:52:09.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.008+0000 7f771dbff700 1 -- 172.21.15.107:0/1482809972 wait complete. 2023-08-10T10:52:09.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.009+0000 7f771dbff700 1 Processor -- start 2023-08-10T10:52:09.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.010+0000 7f771dbff700 1 -- start start 2023-08-10T10:52:09.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.010+0000 7f771dbff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181006e0 0x7f7718196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.010+0000 7f771dbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77181010a0 0x7f7718196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.010+0000 7f771dbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77181066f0 0x7f771819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.010+0000 7f771dbff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771819a600 con 0x7f77181006e0 2023-08-10T10:52:09.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.010+0000 7f771dbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771819a770 con 0x7f77181066f0 2023-08-10T10:52:09.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.010+0000 7f771dbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771819a930 con 0x7f77181010a0 2023-08-10T10:52:09.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f77177fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181006e0 0x7f7718196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f77177fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181006e0 0x7f7718196710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37148/0 (socket says 172.21.15.107:37148) 2023-08-10T10:52:09.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f77177fe700 1 -- 172.21.15.107:0/291751881 learned_addr learned my addr 172.21.15.107:0/291751881 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f7716ffd700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77181010a0 0x7f7718196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f77177fe700 1 -- 172.21.15.107:0/291751881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77181010a0 msgr2=0x7f7718196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f77177fe700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77181010a0 0x7f7718196c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f77177fe700 1 -- 172.21.15.107:0/291751881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77181066f0 msgr2=0x7f771819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f77177fe700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77181066f0 0x7f771819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f77177fe700 1 -- 172.21.15.107:0/291751881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080095f0 con 0x7f77181006e0 2023-08-10T10:52:09.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f7716ffd700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77181010a0 0x7f7718196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:09.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.011+0000 7f77177fe700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181006e0 0x7f7718196710 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7708005770 tx=0x7f7708005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.012+0000 7f7714ff9700 1 -- 172.21.15.107:0/291751881 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770801d070 con 0x7f77181006e0 2023-08-10T10:52:09.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.012+0000 7f771dbff700 1 -- 172.21.15.107:0/291751881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771819ac10 con 0x7f77181006e0 2023-08-10T10:52:09.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.012+0000 7f7714ff9700 1 -- 172.21.15.107:0/291751881 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f770800fb80 con 0x7f77181006e0 2023-08-10T10:52:09.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.012+0000 7f7714ff9700 1 -- 172.21.15.107:0/291751881 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080173f0 con 0x7f77181006e0 2023-08-10T10:52:09.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.012+0000 7f771dbff700 1 -- 172.21.15.107:0/291751881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77181a3570 con 0x7f77181006e0 2023-08-10T10:52:09.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.017+0000 7f7714ff9700 1 -- 172.21.15.107:0/291751881 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f770800fcf0 con 0x7f77181006e0 2023-08-10T10:52:09.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.018+0000 7f773142bb80 1 Processor -- start 2023-08-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.018+0000 7f773142bb80 1 -- start start 2023-08-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.018+0000 7f773142bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b2687c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.018+0000 7f773142bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 0x564e0b2626d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.018+0000 7f773142bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b263070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.018+0000 7f773142bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b1d9dc0 con 0x564e0b2683e0 2023-08-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.018+0000 7f773142bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b1b6590 con 0x564e0b268d00 2023-08-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.018+0000 7f773142bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b1b3eb0 con 0x564e0b262c10 2023-08-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7714ff9700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77000a13e0 0x7f77000a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7717fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b2687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7717fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b2687c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37162/0 (socket says 172.21.15.107:37162) 2023-08-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7717fff700 1 -- 172.21.15.107:0/1193233268 learned_addr learned my addr 172.21.15.107:0/1193233268 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f77177fe700 1 --2- 172.21.15.107:0/1193233268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 0x564e0b2626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7716ffd700 1 --2- 172.21.15.107:0/1193233268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b263070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7714ff9700 1 -- 172.21.15.107:0/291751881 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f77080ce630 con 0x7f77181006e0 2023-08-10T10:52:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7717fff700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77000a13e0 0x7f77000a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7716ffd700 1 -- 172.21.15.107:0/1193233268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 msgr2=0x564e0b2626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7716ffd700 1 --2- 172.21.15.107:0/1193233268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 0x564e0b2626d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7716ffd700 1 -- 172.21.15.107:0/1193233268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 msgr2=0x564e0b2687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7716ffd700 1 --2- 172.21.15.107:0/1193233268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b2687c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.019+0000 7f7716ffd700 1 -- 172.21.15.107:0/1193233268 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e0b030630 con 0x564e0b262c10 2023-08-10T10:52:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.020+0000 7f7716ffd700 1 --2- 172.21.15.107:0/1193233268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b263070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7718197e20 tx=0x7f770c009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78a745cc7913969e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.020+0000 7f76fdffb700 1 -- 172.21.15.107:0/1193233268 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011bf0 con 0x564e0b262c10 2023-08-10T10:52:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.020+0000 7f7717fff700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77000a13e0 0x7f77000a38a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7710009510 tx=0x7f7710009040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.020+0000 7f76fdffb700 1 -- 172.21.15.107:0/1193233268 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f770c011d50 con 0x564e0b262c10 2023-08-10T10:52:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.020+0000 7f76fdffb700 1 -- 172.21.15.107:0/1193233268 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00f6a0 con 0x564e0b262c10 2023-08-10T10:52:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.021+0000 7f773142bb80 1 -- 172.21.15.107:0/1193233268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 msgr2=0x564e0b263070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.021+0000 7f773142bb80 1 --2- 172.21.15.107:0/1193233268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b263070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7718197e20 tx=0x7f770c009f70 comp rx=0 tx=0).stop 2023-08-10T10:52:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.021+0000 7f773142bb80 1 -- 172.21.15.107:0/1193233268 shutdown_connections 2023-08-10T10:52:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.021+0000 7f773142bb80 1 --2- 172.21.15.107:0/1193233268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b263070 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.021+0000 7f773142bb80 1 --2- 172.21.15.107:0/1193233268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b2687c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.021+0000 7f773142bb80 1 --2- 172.21.15.107:0/1193233268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 0x564e0b2626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.021+0000 7f773142bb80 1 -- 172.21.15.107:0/1193233268 >> 172.21.15.107:0/1193233268 conn(0x564e0b1bbcd0 msgr2=0x564e0b2594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.021+0000 7f773142bb80 1 -- 172.21.15.107:0/1193233268 shutdown_connections 2023-08-10T10:52:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.021+0000 7f773142bb80 1 -- 172.21.15.107:0/1193233268 wait complete. 2023-08-10T10:52:09.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.022+0000 7f773142bb80 1 -- start start 2023-08-10T10:52:09.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.022+0000 7f773142bb80 1 Processor -- start 2023-08-10T10:52:09.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.023+0000 7f773142bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b262c10 0x564e0b26ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.023+0000 7f773142bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b2683e0 0x564e0b26bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.023+0000 7f773142bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 0x564e0b26c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.023+0000 7f773142bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b1af7a0 con 0x564e0b268d00 2023-08-10T10:52:09.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.023+0000 7f773142bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b14eac0 con 0x564e0b262c10 2023-08-10T10:52:09.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.023+0000 7f773142bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b14e7c0 con 0x564e0b2683e0 2023-08-10T10:52:09.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.023+0000 7f773142bb80 10 client.0 _ll_register_callbacks cb 0x564e0b14c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:09.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.024+0000 7f7716ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b2683e0 0x564e0b26bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.024+0000 7f7716ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b2683e0 0x564e0b26bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:60154/0 (socket says 172.21.15.107:60154) 2023-08-10T10:52:09.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.024+0000 7f7716ffd700 1 -- 172.21.15.107:0/3027440394 learned_addr learned my addr 172.21.15.107:0/3027440394 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.024+0000 7f77177fe700 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b262c10 0x564e0b26ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.024+0000 7f7716ffd700 1 -- 172.21.15.107:0/3027440394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b262c10 msgr2=0x564e0b26ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.024+0000 7f7716ffd700 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b262c10 0x564e0b26ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.024+0000 7f7716ffd700 1 -- 172.21.15.107:0/3027440394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 msgr2=0x564e0b26c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.024+0000 7f7716ffd700 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 0x564e0b26c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.024+0000 7f7716ffd700 1 -- 172.21.15.107:0/3027440394 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c0098f0 con 0x564e0b2683e0 2023-08-10T10:52:09.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.025+0000 7f7716ffd700 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b2683e0 0x564e0b26bef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f770c0058c0 tx=0x7f770c005340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d565dd074f90260d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.025+0000 7f76f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:52:09.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.026+0000 7f76f6ffd700 1 -- 172.21.15.107:0/3027440394 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0056a0 con 0x564e0b2683e0 2023-08-10T10:52:09.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.026+0000 7f773142bb80 1 -- 172.21.15.107:0/3027440394 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e0b251470 con 0x564e0b2683e0 2023-08-10T10:52:09.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.026+0000 7f76f6ffd700 1 -- 172.21.15.107:0/3027440394 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f770c004960 con 0x564e0b2683e0 2023-08-10T10:52:09.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.026+0000 7f76f6ffd700 1 -- 172.21.15.107:0/3027440394 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f770c004b20 con 0x564e0b2683e0 2023-08-10T10:52:09.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.026+0000 7f773142bb80 10 client.25759 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:09.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.026+0000 7f773142bb80 1 -- 172.21.15.107:0/3027440394 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564e0afdcde0 con 0x564e0b2683e0 2023-08-10T10:52:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.026+0000 7f76f6ffd700 1 -- 172.21.15.107:0/3027440394 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564e0b251470 con 0x564e0b2683e0 2023-08-10T10:52:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.027+0000 7f76f6ffd700 1 -- 172.21.15.107:0/3027440394 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f770c022070 con 0x564e0b2683e0 2023-08-10T10:52:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.027+0000 7f773142bb80 10 client.25759 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.027+0000 7f773142bb80 10 client.25759 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T10:52:09.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.027+0000 7f773142bb80 20 client.25759 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.027+0000 7f773142bb80 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x564e0b27c5f0 0x564e0b27ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.027+0000 7f773142bb80 4 client.25759 mds_command: new command op to 24532 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.027+0000 7f773142bb80 1 -- 172.21.15.107:0/3027440394 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e0b22d9d0 con 0x564e0b27c5f0 2023-08-10T10:52:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.027+0000 7f77177fe700 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x564e0b27c5f0 0x564e0b27ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.029+0000 7f77177fe700 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x564e0b27c5f0 0x564e0b27ea10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e8dacb07453f62a server_cookie=9c3432c65d14aca6 in_seq=0 out_seq=0 2023-08-10T10:52:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.029+0000 7f76f6ffd700 10 client.25759 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:52:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.029+0000 7f76f6ffd700 1 -- 172.21.15.107:0/3027440394 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564e0b22d9d0 con 0x564e0b27c5f0 2023-08-10T10:52:09.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.030+0000 7f76f6ffd700 10 client.25759 handle_command_reply: tid=0 2023-08-10T10:52:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.030+0000 7f773142bb80 1 client.25759 shutdown 2023-08-10T10:52:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.030+0000 7f773142bb80 1 -- 172.21.15.107:0/3027440394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b2683e0 msgr2=0x564e0b26bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.030+0000 7f773142bb80 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b2683e0 0x564e0b26bef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f770c0058c0 tx=0x7f770c005340 comp rx=0 tx=0).stop 2023-08-10T10:52:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.031+0000 7f773142bb80 1 -- 172.21.15.107:0/3027440394 shutdown_connections 2023-08-10T10:52:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.031+0000 7f773142bb80 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x564e0b27c5f0 0x564e0b27ea10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.031+0000 7f773142bb80 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b262c10 0x564e0b26ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.031+0000 7f773142bb80 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 0x564e0b26c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.031+0000 7f773142bb80 1 --2- 172.21.15.107:0/3027440394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b2683e0 0x564e0b26bef0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.031+0000 7f76f6ffd700 0 client.25759 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:52:09.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.031+0000 7f773142bb80 1 -- 172.21.15.107:0/3027440394 >> 172.21.15.107:0/3027440394 conn(0x564e0b1bbcd0 msgr2=0x564e0b2589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.031+0000 7f773142bb80 1 -- 172.21.15.107:0/3027440394 shutdown_connections 2023-08-10T10:52:09.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.031+0000 7f773142bb80 1 -- 172.21.15.107:0/3027440394 wait complete. 2023-08-10T10:52:09.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.032+0000 7f773142bb80 20 client.25759 trim_cache size 0 max 16384 2023-08-10T10:52:09.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:08 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1152958131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:52:09.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.049+0000 7f773142bb80 1 Processor -- start 2023-08-10T10:52:09.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f773142bb80 1 -- start start 2023-08-10T10:52:09.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f773142bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b25a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f773142bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b2683e0 0x564e0b273720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f773142bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 0x564e0b26e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f773142bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b032920 con 0x564e0b268d00 2023-08-10T10:52:09.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f773142bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b278650 con 0x564e0b2683e0 2023-08-10T10:52:09.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f773142bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b26cc60 con 0x564e0b262c10 2023-08-10T10:52:09.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f7717fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 0x564e0b26e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f7717fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 0x564e0b26e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37172/0 (socket says 172.21.15.107:37172) 2023-08-10T10:52:09.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.050+0000 7f7717fff700 1 -- 172.21.15.107:0/49327262 learned_addr learned my addr 172.21.15.107:0/49327262 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.051+0000 7f77177fe700 1 --2- 172.21.15.107:0/49327262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b25a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.051+0000 7f7716ffd700 1 --2- 172.21.15.107:0/49327262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b2683e0 0x564e0b273720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.051+0000 7f7717fff700 1 -- 172.21.15.107:0/49327262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 msgr2=0x564e0b25a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.051+0000 7f7717fff700 1 --2- 172.21.15.107:0/49327262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b25a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.051+0000 7f7717fff700 1 -- 172.21.15.107:0/49327262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b2683e0 msgr2=0x564e0b273720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.051+0000 7f7717fff700 1 --2- 172.21.15.107:0/49327262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b2683e0 0x564e0b273720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.051+0000 7f7717fff700 1 -- 172.21.15.107:0/49327262 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e0afc5c60 con 0x564e0b268d00 2023-08-10T10:52:09.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.051+0000 7f7717fff700 1 --2- 172.21.15.107:0/49327262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 0x564e0b26e810 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f77100098c0 tx=0x7f7710006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81acf3e77cd047fa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.051+0000 7f76fe7fc700 1 -- 172.21.15.107:0/49327262 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710007e40 con 0x564e0b268d00 2023-08-10T10:52:09.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f76fe7fc700 1 -- 172.21.15.107:0/49327262 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7710003e90 con 0x564e0b268d00 2023-08-10T10:52:09.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f76fe7fc700 1 -- 172.21.15.107:0/49327262 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77100193f0 con 0x564e0b268d00 2023-08-10T10:52:09.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f773142bb80 1 -- 172.21.15.107:0/49327262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 msgr2=0x564e0b26e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f773142bb80 1 --2- 172.21.15.107:0/49327262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 0x564e0b26e810 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f77100098c0 tx=0x7f7710006040 comp rx=0 tx=0).stop 2023-08-10T10:52:09.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f773142bb80 1 -- 172.21.15.107:0/49327262 shutdown_connections 2023-08-10T10:52:09.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f773142bb80 1 --2- 172.21.15.107:0/49327262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b268d00 0x564e0b26e810 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f773142bb80 1 --2- 172.21.15.107:0/49327262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b25a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f773142bb80 1 --2- 172.21.15.107:0/49327262 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b2683e0 0x564e0b273720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f773142bb80 1 -- 172.21.15.107:0/49327262 >> 172.21.15.107:0/49327262 conn(0x564e0b1bbcd0 msgr2=0x564e0b266000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.052+0000 7f773142bb80 1 -- 172.21.15.107:0/49327262 shutdown_connections 2023-08-10T10:52:09.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.053+0000 7f773142bb80 1 -- 172.21.15.107:0/49327262 wait complete. 2023-08-10T10:52:09.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.053+0000 7f773142bb80 1 -- start start 2023-08-10T10:52:09.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.053+0000 7f773142bb80 1 Processor -- start 2023-08-10T10:52:09.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f773142bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b26ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f773142bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b26a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f773142bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 0x564e0b26aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f773142bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b26c130 con 0x564e0b2683e0 2023-08-10T10:52:09.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f773142bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b26c2a0 con 0x564e0b268d00 2023-08-10T10:52:09.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f773142bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0b26af70 con 0x564e0b262c10 2023-08-10T10:52:09.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f773142bb80 10 client.0 _ll_register_callbacks cb 0x564e0b14c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:09.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f7716ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b26a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f77177fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b26ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f7716ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b26a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37178/0 (socket says 172.21.15.107:37178) 2023-08-10T10:52:09.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f7716ffd700 1 -- 172.21.15.107:0/1972425532 learned_addr learned my addr 172.21.15.107:0/1972425532 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f7717fff700 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 0x564e0b26aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f77177fe700 1 -- 172.21.15.107:0/1972425532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 msgr2=0x564e0b26aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f77177fe700 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 0x564e0b26aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f77177fe700 1 -- 172.21.15.107:0/1972425532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 msgr2=0x564e0b26a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.054+0000 7f77177fe700 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b26a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f77177fe700 1 -- 172.21.15.107:0/1972425532 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7710011070 con 0x564e0b262c10 2023-08-10T10:52:09.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f7716ffd700 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b26a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:09.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f77177fe700 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b26ba20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77080cb900 tx=0x7f770806d370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e283bdd6643d1c57 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f76f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:52:09.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f76f6ffd700 1 -- 172.21.15.107:0/1972425532 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770809f270 con 0x564e0b262c10 2023-08-10T10:52:09.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f773142bb80 1 -- 172.21.15.107:0/1972425532 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f770c011d50 con 0x564e0b262c10 2023-08-10T10:52:09.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f76f6ffd700 1 -- 172.21.15.107:0/1972425532 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f77080a3600 con 0x564e0b262c10 2023-08-10T10:52:09.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f76f6ffd700 1 -- 172.21.15.107:0/1972425532 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77080995e0 con 0x564e0b262c10 2023-08-10T10:52:09.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f773142bb80 10 client.25765 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:09.062 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.055+0000 7f773142bb80 1 -- 172.21.15.107:0/1972425532 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564e0b003250 con 0x564e0b262c10 2023-08-10T10:52:09.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.056+0000 7f76f6ffd700 1 -- 172.21.15.107:0/1972425532 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f770c011d50 con 0x564e0b262c10 2023-08-10T10:52:09.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.056+0000 7f76f6ffd700 1 -- 172.21.15.107:0/1972425532 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f770809b4a0 con 0x564e0b262c10 2023-08-10T10:52:09.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.056+0000 7f773142bb80 10 client.25765 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:09.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.056+0000 7f773142bb80 10 client.25765 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T10:52:09.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.056+0000 7f773142bb80 20 client.25765 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:09.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.056+0000 7f773142bb80 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x564e0b2d10f0 0x564e0b2d34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.056+0000 7f773142bb80 4 client.25765 mds_command: new command op to 24532 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:09.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.056+0000 7f773142bb80 1 -- 172.21.15.107:0/1972425532 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564e0b1a8780 con 0x564e0b2d10f0 2023-08-10T10:52:09.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.057+0000 7f7716ffd700 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x564e0b2d10f0 0x564e0b2d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.057+0000 7f7716ffd700 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x564e0b2d10f0 0x564e0b2d34e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64118474e3d99610 server_cookie=3ecc10e013a0861c in_seq=0 out_seq=0 2023-08-10T10:52:09.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.057+0000 7f76f6ffd700 10 client.25765 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:52:09.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.057+0000 7f76f6ffd700 1 -- 172.21.15.107:0/1972425532 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564e0b1a8780 con 0x564e0b2d10f0 2023-08-10T10:52:09.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.057+0000 7f76f6ffd700 10 client.25765 handle_command_reply: tid=0 2023-08-10T10:52:09.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.057+0000 7f773142bb80 1 client.25765 shutdown 2023-08-10T10:52:09.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 -- 172.21.15.107:0/1972425532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 msgr2=0x564e0b26ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b26ba20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77080cb900 tx=0x7f770806d370 comp rx=0 tx=0).stop 2023-08-10T10:52:09.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 -- 172.21.15.107:0/1972425532 shutdown_connections 2023-08-10T10:52:09.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x564e0b2d10f0 0x564e0b2d34e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0b268d00 0x564e0b26aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0b262c10 0x564e0b26ba20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 --2- 172.21.15.107:0/1972425532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564e0b2683e0 0x564e0b26a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f76f6ffd700 0 client.25765 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:52:09.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 -- 172.21.15.107:0/1972425532 >> 172.21.15.107:0/1972425532 conn(0x564e0b1bbcd0 msgr2=0x564e0b266f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 -- 172.21.15.107:0/1972425532 shutdown_connections 2023-08-10T10:52:09.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 1 -- 172.21.15.107:0/1972425532 wait complete. 2023-08-10T10:52:09.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.058+0000 7f773142bb80 20 client.25765 trim_cache size 0 max 16384 2023-08-10T10:52:09.068 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:09.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 -- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77000a13e0 msgr2=0x7f77000a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77000a13e0 0x7f77000a38a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7710009510 tx=0x7f7710009040 comp rx=0 tx=0).stop 2023-08-10T10:52:09.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 -- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181006e0 msgr2=0x7f7718196710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181006e0 0x7f7718196710 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7708005770 tx=0x7f7708005ef0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 -- 172.21.15.107:0/291751881 shutdown_connections 2023-08-10T10:52:09.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77000a13e0 0x7f77000a38a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77181066f0 0x7f771819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77181006e0 0x7f7718196710 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 --2- 172.21.15.107:0/291751881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77181010a0 0x7f7718196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 -- 172.21.15.107:0/291751881 >> 172.21.15.107:0/291751881 conn(0x7f77180fc1d0 msgr2=0x7f77180fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 -- 172.21.15.107:0/291751881 shutdown_connections 2023-08-10T10:52:09.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.059+0000 7f771dbff700 1 -- 172.21.15.107:0/291751881 wait complete. 2023-08-10T10:52:09.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:08 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1152958131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:52:09.080 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-10T10:52:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:08 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1152958131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:52:09.243 INFO:teuthology.orchestra.run.smithi107.stderr:1800000 of 50000000 tuples (3%) done (elapsed 27.42 s, remaining 734.26 s) 2023-08-10T10:52:09.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.322+0000 7fd93a19d700 1 -- 172.21.15.107:0/2607085461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9340678d0 msgr2=0x7fd934067d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.322+0000 7fd93a19d700 1 --2- 172.21.15.107:0/2607085461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9340678d0 0x7fd934067d50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9240099c0 tx=0x7fd924009cd0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.323+0000 7fd93a19d700 1 -- 172.21.15.107:0/2607085461 shutdown_connections 2023-08-10T10:52:09.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.323+0000 7fd93a19d700 1 --2- 172.21.15.107:0/2607085461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd934068290 0x7fd93410d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.323+0000 7fd93a19d700 1 --2- 172.21.15.107:0/2607085461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd934106660 0x7fd934106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.323+0000 7fd93a19d700 1 --2- 172.21.15.107:0/2607085461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9340678d0 0x7fd934067d50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.323+0000 7fd93a19d700 1 -- 172.21.15.107:0/2607085461 >> 172.21.15.107:0/2607085461 conn(0x7fd934074f30 msgr2=0x7fd934075340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.323+0000 7fd93a19d700 1 -- 172.21.15.107:0/2607085461 shutdown_connections 2023-08-10T10:52:09.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.323+0000 7fd93a19d700 1 -- 172.21.15.107:0/2607085461 wait complete. 2023-08-10T10:52:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.324+0000 7fd93a19d700 1 Processor -- start 2023-08-10T10:52:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.324+0000 7fd93a19d700 1 -- start start 2023-08-10T10:52:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.324+0000 7fd93a19d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9340678d0 0x7fd934196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.324+0000 7fd93a19d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd934068290 0x7fd9341969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.324+0000 7fd93a19d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd934106660 0x7fd93419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.324+0000 7fd93a19d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93419b440 con 0x7fd9340678d0 2023-08-10T10:52:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.324+0000 7fd93a19d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93419b5b0 con 0x7fd934068290 2023-08-10T10:52:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.324+0000 7fd93a19d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93419b770 con 0x7fd934106660 2023-08-10T10:52:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9340678d0 0x7fd934196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9340678d0 0x7fd934196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37192/0 (socket says 172.21.15.107:37192) 2023-08-10T10:52:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93919b700 1 -- 172.21.15.107:0/987100483 learned_addr learned my addr 172.21.15.107:0/987100483 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93899a700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd934068290 0x7fd9341969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93999c700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd934106660 0x7fd93419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93899a700 1 -- 172.21.15.107:0/987100483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd934106660 msgr2=0x7fd93419ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93899a700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd934106660 0x7fd93419ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93899a700 1 -- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9340678d0 msgr2=0x7fd934196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93899a700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9340678d0 0x7fd934196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93899a700 1 -- 172.21.15.107:0/987100483 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd930009520 con 0x7fd934068290 2023-08-10T10:52:09.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93919b700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9340678d0 0x7fd934196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:09.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.325+0000 7fd93899a700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd934068290 0x7fd9341969a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd924000c00 tx=0x7fd92400f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.326+0000 7fd92a7fc700 1 -- 172.21.15.107:0/987100483 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92401d070 con 0x7fd934068290 2023-08-10T10:52:09.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.326+0000 7fd93a19d700 1 -- 172.21.15.107:0/987100483 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9240095f0 con 0x7fd934068290 2023-08-10T10:52:09.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.326+0000 7fd92a7fc700 1 -- 172.21.15.107:0/987100483 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd924005050 con 0x7fd934068290 2023-08-10T10:52:09.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.326+0000 7fd92a7fc700 1 -- 172.21.15.107:0/987100483 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd924004950 con 0x7fd934068290 2023-08-10T10:52:09.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.326+0000 7fd93a19d700 1 -- 172.21.15.107:0/987100483 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93419bc80 con 0x7fd934068290 2023-08-10T10:52:09.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.330+0000 7fd92a7fc700 1 -- 172.21.15.107:0/987100483 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fd9240051c0 con 0x7fd934068290 2023-08-10T10:52:09.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.330+0000 7fd94edeeb80 1 Processor -- start 2023-08-10T10:52:09.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.331+0000 7fd94edeeb80 1 -- start start 2023-08-10T10:52:09.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.331+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cf5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.331+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cfa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.331+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cfab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.331+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1c6cdc0 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.331+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1c49590 con 0x55c4e1cf61e0 2023-08-10T10:52:09.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.331+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1c46eb0 con 0x55c4e1cf58c0 2023-08-10T10:52:09.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93899a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cfab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93999c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cf5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93919b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cfa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93919b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cfa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:54544/0 (socket says 172.21.15.107:54544) 2023-08-10T10:52:09.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93919b700 1 -- 172.21.15.107:0/1175330611 learned_addr learned my addr 172.21.15.107:0/1175330611 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93999c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cf5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:60204/0 (socket says 172.21.15.107:60204) 2023-08-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd92a7fc700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9200a1480 0x7fd9200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93919b700 1 -- 172.21.15.107:0/1175330611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 msgr2=0x55c4e1cf5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93919b700 1 --2- 172.21.15.107:0/1175330611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cf5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93919b700 1 -- 172.21.15.107:0/1175330611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 msgr2=0x55c4e1cfab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93919b700 1 --2- 172.21.15.107:0/1175330611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cfab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93919b700 1 -- 172.21.15.107:0/1175330611 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4e1ac3630 con 0x55c4e1cf61e0 2023-08-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd92a7fc700 1 -- 172.21.15.107:0/987100483 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fd9240cdf00 con 0x7fd934068290 2023-08-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.332+0000 7fd93999c700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9200a1480 0x7fd9200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.333+0000 7fd93919b700 1 --2- 172.21.15.107:0/1175330611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cfa160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd930011840 tx=0x7fd930011b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a87d9d24fbc1ba0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.333+0000 7fd91f7fe700 1 -- 172.21.15.107:0/1175330611 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930011030 con 0x55c4e1cf61e0 2023-08-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.333+0000 7fd91f7fe700 1 -- 172.21.15.107:0/1175330611 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd930011190 con 0x55c4e1cf61e0 2023-08-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.333+0000 7fd91f7fe700 1 -- 172.21.15.107:0/1175330611 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9300107d0 con 0x55c4e1cf61e0 2023-08-10T10:52:09.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 -- 172.21.15.107:0/1175330611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 msgr2=0x55c4e1cfa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd93999c700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9200a1480 0x7fd9200a3940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0075c0 tx=0x7fd92c009040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/1175330611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cfa160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd930011840 tx=0x7fd930011b50 comp rx=0 tx=0).stop 2023-08-10T10:52:09.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 -- 172.21.15.107:0/1175330611 shutdown_connections 2023-08-10T10:52:09.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/1175330611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cfab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/1175330611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cf5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/1175330611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cfa160 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 -- 172.21.15.107:0/1175330611 >> 172.21.15.107:0/1175330611 conn(0x55c4e1c4ecd0 msgr2=0x55c4e1cec750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 -- 172.21.15.107:0/1175330611 shutdown_connections 2023-08-10T10:52:09.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 -- 172.21.15.107:0/1175330611 wait complete. 2023-08-10T10:52:09.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.334+0000 7fd94edeeb80 1 -- start start 2023-08-10T10:52:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.335+0000 7fd94edeeb80 1 Processor -- start 2023-08-10T10:52:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.335+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.335+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cff6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.335+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cffc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.335+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1c427a0 con 0x55c4e1cf58c0 2023-08-10T10:52:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.335+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1be1ac0 con 0x55c4e1cf61e0 2023-08-10T10:52:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.335+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1be17c0 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.335+0000 7fd94edeeb80 10 client.0 _ll_register_callbacks cb 0x55c4e1bdf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cff1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37216/0 (socket says 172.21.15.107:37216) 2023-08-10T10:52:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93919b700 1 -- 172.21.15.107:0/150592715 learned_addr learned my addr 172.21.15.107:0/150592715 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93999c700 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cffc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93899a700 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cff6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93919b700 1 -- 172.21.15.107:0/150592715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cfa6a0 msgr2=0x55c4e1cffc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93919b700 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cffc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93919b700 1 -- 172.21.15.107:0/150592715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 msgr2=0x55c4e1cff6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93919b700 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cff6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93919b700 1 -- 172.21.15.107:0/150592715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9300114a0 con 0x55c4e1cf58c0 2023-08-10T10:52:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93899a700 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd93919b700 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cff1a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd93000fc50 tx=0x7fd93000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e1d98d5d9cafcf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.336+0000 7fd91cff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.337+0000 7fd91cff9700 1 -- 172.21.15.107:0/150592715 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930026070 con 0x55c4e1cf58c0 2023-08-10T10:52:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.337+0000 7fd94edeeb80 1 -- 172.21.15.107:0/150592715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4e1ce4470 con 0x55c4e1cf58c0 2023-08-10T10:52:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.337+0000 7fd91cff9700 1 -- 172.21.15.107:0/150592715 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fd930004240 con 0x55c4e1cf58c0 2023-08-10T10:52:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.337+0000 7fd91cff9700 1 -- 172.21.15.107:0/150592715 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd93000fe20 con 0x55c4e1cf58c0 2023-08-10T10:52:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.337+0000 7fd94edeeb80 10 client.16065 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.337+0000 7fd94edeeb80 1 -- 172.21.15.107:0/150592715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c4e1a6fde0 con 0x55c4e1cf58c0 2023-08-10T10:52:09.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.337+0000 7fd91cff9700 1 -- 172.21.15.107:0/150592715 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c4e1ce4470 con 0x55c4e1cf58c0 2023-08-10T10:52:09.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.338+0000 7fd91cff9700 1 -- 172.21.15.107:0/150592715 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd930029020 con 0x55c4e1cf58c0 2023-08-10T10:52:09.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.338+0000 7fd94edeeb80 10 client.16065 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:09.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.338+0000 7fd94edeeb80 10 client.16065 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-10T10:52:09.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.338+0000 7fd94edeeb80 20 client.16065 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:09.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.338+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55c4e1d0f720 0x55c4e1d11b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.338+0000 7fd94edeeb80 4 client.16065 mds_command: new command op to 24571 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:09.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.338+0000 7fd94edeeb80 1 -- 172.21.15.107:0/150592715 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4e1cc09d0 con 0x55c4e1d0f720 2023-08-10T10:52:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.338+0000 7fd93899a700 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55c4e1d0f720 0x55c4e1d11b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.339+0000 7fd93899a700 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55c4e1d0f720 0x55c4e1d11b40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=424daa6268a4b0ef server_cookie=cd1cdd8f8fbbdcdd in_seq=0 out_seq=0 2023-08-10T10:52:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.339+0000 7fd91cff9700 10 client.16065 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:52:09.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.339+0000 7fd91cff9700 1 -- 172.21.15.107:0/150592715 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c4e1cc09d0 con 0x55c4e1d0f720 2023-08-10T10:52:09.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.339+0000 7fd91cff9700 10 client.16065 handle_command_reply: tid=0 2023-08-10T10:52:09.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 client.16065 shutdown 2023-08-10T10:52:09.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 -- 172.21.15.107:0/150592715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf58c0 msgr2=0x55c4e1cff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cff1a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd93000fc50 tx=0x7fd93000fc80 comp rx=0 tx=0).stop 2023-08-10T10:52:09.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 -- 172.21.15.107:0/150592715 shutdown_connections 2023-08-10T10:52:09.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55c4e1d0f720 0x55c4e1d11b40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cff1a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/150592715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf61e0 0x55c4e1cff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 -- 172.21.15.107:0/150592715 >> 172.21.15.107:0/150592715 conn(0x55c4e1c4ecd0 msgr2=0x55c4e1cfbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd91cff9700 0 client.16065 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:52:09.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 -- 172.21.15.107:0/150592715 shutdown_connections 2023-08-10T10:52:09.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 1 -- 172.21.15.107:0/150592715 wait complete. 2023-08-10T10:52:09.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.340+0000 7fd94edeeb80 20 client.16065 trim_cache size 0 max 16384 2023-08-10T10:52:09.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd94edeeb80 1 Processor -- start 2023-08-10T10:52:09.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd94edeeb80 1 -- start start 2023-08-10T10:52:09.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cf7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cf9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1ac5920 con 0x55c4e1cf61e0 2023-08-10T10:52:09.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1cf6710 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1cf90a0 con 0x55c4e1cf58c0 2023-08-10T10:52:09.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd93899a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd93899a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37232/0 (socket says 172.21.15.107:37232) 2023-08-10T10:52:09.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.354+0000 7fd93899a700 1 -- 172.21.15.107:0/916093278 learned_addr learned my addr 172.21.15.107:0/916093278 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd93919b700 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cf7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd93999c700 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cf9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd93899a700 1 -- 172.21.15.107:0/916093278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 msgr2=0x55c4e1cf7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd93899a700 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cf7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd93899a700 1 -- 172.21.15.107:0/916093278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cfa6a0 msgr2=0x55c4e1cf9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd93899a700 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cf9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd93899a700 1 -- 172.21.15.107:0/916093278 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4e1a58c60 con 0x55c4e1cf61e0 2023-08-10T10:52:09.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd93999c700 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cf9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:09.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd93899a700 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd92400e040 tx=0x7fd9240d19d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0efa3592600d1f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd91ffff700 1 -- 172.21.15.107:0/916093278 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92409a8e0 con 0x55c4e1cf61e0 2023-08-10T10:52:09.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd91ffff700 1 -- 172.21.15.107:0/916093278 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd92409a650 con 0x55c4e1cf61e0 2023-08-10T10:52:09.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.355+0000 7fd91ffff700 1 -- 172.21.15.107:0/916093278 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92409ad70 con 0x55c4e1cf61e0 2023-08-10T10:52:09.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.356+0000 7fd94edeeb80 1 -- 172.21.15.107:0/916093278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf61e0 msgr2=0x55c4e1d06900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.356+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd92400e040 tx=0x7fd9240d19d0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.356+0000 7fd94edeeb80 1 -- 172.21.15.107:0/916093278 shutdown_connections 2023-08-10T10:52:09.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.356+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1cf9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.356+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf58c0 0x55c4e1cf7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.356+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/916093278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06900 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.356+0000 7fd94edeeb80 1 -- 172.21.15.107:0/916093278 >> 172.21.15.107:0/916093278 conn(0x55c4e1c4ecd0 msgr2=0x55c4e1cf9760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.356+0000 7fd94edeeb80 1 -- 172.21.15.107:0/916093278 shutdown_connections 2023-08-10T10:52:09.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.356+0000 7fd94edeeb80 1 -- 172.21.15.107:0/916093278 wait complete. 2023-08-10T10:52:09.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.357+0000 7fd94edeeb80 1 -- start start 2023-08-10T10:52:09.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.357+0000 7fd94edeeb80 1 Processor -- start 2023-08-10T10:52:09.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf58c0 0x55c4e1d062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd94edeeb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1d046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1d04da0 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1d04f10 con 0x55c4e1cf58c0 2023-08-10T10:52:09.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd94edeeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4e1d050d0 con 0x55c4e1cf61e0 2023-08-10T10:52:09.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd94edeeb80 10 client.0 _ll_register_callbacks cb 0x55c4e1bdf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:09.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93999c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1d046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93919b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf58c0 0x55c4e1d062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93999c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1d046c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37236/0 (socket says 172.21.15.107:37236) 2023-08-10T10:52:09.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93919b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf58c0 0x55c4e1d062f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:54572/0 (socket says 172.21.15.107:54572) 2023-08-10T10:52:09.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93999c700 1 -- 172.21.15.107:0/4091857506 learned_addr learned my addr 172.21.15.107:0/4091857506 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93899a700 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93999c700 1 -- 172.21.15.107:0/4091857506 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf61e0 msgr2=0x55c4e1d06830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93999c700 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93999c700 1 -- 172.21.15.107:0/4091857506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf58c0 msgr2=0x55c4e1d062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93999c700 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf58c0 0x55c4e1d062f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.358+0000 7fd93999c700 1 -- 172.21.15.107:0/4091857506 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93419bc80 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.359+0000 7fd93999c700 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1d046c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd92c003a90 tx=0x7fd92c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26699f25a6f8dc0a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.359+0000 7fd91cff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:09.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.359+0000 7fd91cff9700 1 -- 172.21.15.107:0/4091857506 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00e040 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.359+0000 7fd94edeeb80 1 -- 172.21.15.107:0/4091857506 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd930011190 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.359+0000 7fd91cff9700 1 -- 172.21.15.107:0/4091857506 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fd92c01f070 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.359+0000 7fd91cff9700 1 -- 172.21.15.107:0/4091857506 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd92c017db0 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.359+0000 7fd94edeeb80 10 client.16071 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:09.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.359+0000 7fd94edeeb80 1 -- 172.21.15.107:0/4091857506 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c4e1a96250 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.360+0000 7fd91cff9700 1 -- 172.21.15.107:0/4091857506 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd930011190 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.360+0000 7fd91cff9700 1 -- 172.21.15.107:0/4091857506 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd92c02f3b0 con 0x55c4e1cfa6a0 2023-08-10T10:52:09.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.360+0000 7fd94edeeb80 10 client.16071 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:09.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.360+0000 7fd94edeeb80 10 client.16071 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-10T10:52:09.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.360+0000 7fd94edeeb80 20 client.16071 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:09.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.360+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55c4e1d64660 0x55c4e1d66a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.360+0000 7fd94edeeb80 4 client.16071 mds_command: new command op to 24571 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:09.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.360+0000 7fd94edeeb80 1 -- 172.21.15.107:0/4091857506 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c4e1c3b780 con 0x55c4e1d64660 2023-08-10T10:52:09.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.360+0000 7fd93919b700 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55c4e1d64660 0x55c4e1d66a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.361+0000 7fd91cff9700 10 client.16071 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:52:09.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.361+0000 7fd93919b700 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55c4e1d64660 0x55c4e1d66a80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85266e2127790ca9 server_cookie=d3c12db6903f03f3 in_seq=0 out_seq=0 2023-08-10T10:52:09.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.361+0000 7fd91cff9700 1 -- 172.21.15.107:0/4091857506 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c4e1c3b780 con 0x55c4e1d64660 2023-08-10T10:52:09.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.361+0000 7fd91cff9700 10 client.16071 handle_command_reply: tid=0 2023-08-10T10:52:09.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.361+0000 7fd94edeeb80 1 client.16071 shutdown 2023-08-10T10:52:09.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.361+0000 7fd94edeeb80 1 -- 172.21.15.107:0/4091857506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 msgr2=0x55c4e1d046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.361+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1d046c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd92c003a90 tx=0x7fd92c004ad0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.361+0000 7fd94edeeb80 1 -- 172.21.15.107:0/4091857506 shutdown_connections 2023-08-10T10:52:09.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.361+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x55c4e1d64660 0x55c4e1d66a80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c4e1cf58c0 0x55c4e1d062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c4e1cfa6a0 0x55c4e1d046c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd94edeeb80 1 --2- 172.21.15.107:0/4091857506 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c4e1cf61e0 0x55c4e1d06830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd94edeeb80 1 -- 172.21.15.107:0/4091857506 >> 172.21.15.107:0/4091857506 conn(0x55c4e1c4ecd0 msgr2=0x55c4e1cff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd91cff9700 0 client.16071 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:52:09.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd94edeeb80 1 -- 172.21.15.107:0/4091857506 shutdown_connections 2023-08-10T10:52:09.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd94edeeb80 1 -- 172.21.15.107:0/4091857506 wait complete. 2023-08-10T10:52:09.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd94edeeb80 20 client.16071 trim_cache size 0 max 16384 2023-08-10T10:52:09.373 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:09.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd93a19d700 1 -- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9200a1480 msgr2=0x7fd9200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd93a19d700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9200a1480 0x7fd9200a3940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0075c0 tx=0x7fd92c009040 comp rx=0 tx=0).stop 2023-08-10T10:52:09.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd93a19d700 1 -- 172.21.15.107:0/987100483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd934068290 msgr2=0x7fd9341969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.362+0000 7fd93a19d700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd934068290 0x7fd9341969a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd924000c00 tx=0x7fd92400f690 comp rx=0 tx=0).stop 2023-08-10T10:52:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.363+0000 7fd93a19d700 1 -- 172.21.15.107:0/987100483 shutdown_connections 2023-08-10T10:52:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.363+0000 7fd93a19d700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd934106660 0x7fd93419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.363+0000 7fd93a19d700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9340678d0 0x7fd934196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.363+0000 7fd93a19d700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd9200a1480 0x7fd9200a3940 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.363+0000 7fd93a19d700 1 --2- 172.21.15.107:0/987100483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd934068290 0x7fd9341969a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.363+0000 7fd93a19d700 1 -- 172.21.15.107:0/987100483 >> 172.21.15.107:0/987100483 conn(0x7fd934074f30 msgr2=0x7fd9340fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.363+0000 7fd93a19d700 1 -- 172.21.15.107:0/987100483 shutdown_connections 2023-08-10T10:52:09.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.363+0000 7fd93a19d700 1 -- 172.21.15.107:0/987100483 wait complete. 2023-08-10T10:52:09.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-10T10:52:09.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.611+0000 7fd78d5ff700 1 -- 172.21.15.107:0/1929240390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd788101880 msgr2=0x7fd788101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.611+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/1929240390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd788101880 0x7fd788101c60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd7780098f0 tx=0x7fd778009c00 comp rx=0 tx=0).stop 2023-08-10T10:52:09.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.612+0000 7fd78d5ff700 1 -- 172.21.15.107:0/1929240390 shutdown_connections 2023-08-10T10:52:09.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.612+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/1929240390 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd78810aca0 0x7fd78810d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.612+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/1929240390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd788101880 0x7fd788101c60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.612+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/1929240390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7881021a0 0x7fd78810a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.612+0000 7fd78d5ff700 1 -- 172.21.15.107:0/1929240390 >> 172.21.15.107:0/1929240390 conn(0x7fd7880fb0c0 msgr2=0x7fd7880fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.612+0000 7fd78d5ff700 1 -- 172.21.15.107:0/1929240390 shutdown_connections 2023-08-10T10:52:09.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.612+0000 7fd78d5ff700 1 -- 172.21.15.107:0/1929240390 wait complete. 2023-08-10T10:52:09.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.613+0000 7fd78d5ff700 1 Processor -- start 2023-08-10T10:52:09.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.613+0000 7fd78d5ff700 1 -- start start 2023-08-10T10:52:09.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.613+0000 7fd78d5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd788101880 0x7fd7880ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.613+0000 7fd78d5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7881021a0 0x7fd7880ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.613+0000 7fd78d5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd78810aca0 0x7fd7881a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.613+0000 7fd78d5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788100240 con 0x7fd788101880 2023-08-10T10:52:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.613+0000 7fd78d5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7881a4e70 con 0x7fd7881021a0 2023-08-10T10:52:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.613+0000 7fd78d5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7881a4fb0 con 0x7fd78810aca0 2023-08-10T10:52:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd786ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd788101880 0x7fd7880ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd786ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd788101880 0x7fd7880ff4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37252/0 (socket says 172.21.15.107:37252) 2023-08-10T10:52:09.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd786ffd700 1 -- 172.21.15.107:0/2027202299 learned_addr learned my addr 172.21.15.107:0/2027202299 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd7867fc700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7881021a0 0x7fd7880ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd7877fe700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd78810aca0 0x7fd7881a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd786ffd700 1 -- 172.21.15.107:0/2027202299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd78810aca0 msgr2=0x7fd7881a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd786ffd700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd78810aca0 0x7fd7881a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd786ffd700 1 -- 172.21.15.107:0/2027202299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7881021a0 msgr2=0x7fd7880ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd786ffd700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7881021a0 0x7fd7880ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd786ffd700 1 -- 172.21.15.107:0/2027202299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780009d00 con 0x7fd788101880 2023-08-10T10:52:09.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd7877fe700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd78810aca0 0x7fd7881a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.614+0000 7fd786ffd700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd788101880 0x7fd7880ff4d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd778009230 tx=0x7fd77800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.615+0000 7fd76ffff700 1 -- 172.21.15.107:0/2027202299 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77801c070 con 0x7fd788101880 2023-08-10T10:52:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.615+0000 7fd78d5ff700 1 -- 172.21.15.107:0/2027202299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd778009520 con 0x7fd788101880 2023-08-10T10:52:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.615+0000 7fd76ffff700 1 -- 172.21.15.107:0/2027202299 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd778005040 con 0x7fd788101880 2023-08-10T10:52:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.615+0000 7fd76ffff700 1 -- 172.21.15.107:0/2027202299 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7780038e0 con 0x7fd788101880 2023-08-10T10:52:09.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.615+0000 7fd78d5ff700 1 -- 172.21.15.107:0/2027202299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7881a54f0 con 0x7fd788101880 2023-08-10T10:52:09.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.618+0000 7fd76ffff700 1 -- 172.21.15.107:0/2027202299 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fd778020030 con 0x7fd788101880 2023-08-10T10:52:09.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.620+0000 7fd7a0f66b80 1 Processor -- start 2023-08-10T10:52:09.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd7a0f66b80 1 -- start start 2023-08-10T10:52:09.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd76ffff700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd7700a13e0 0x7fd7700a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd76ffff700 1 -- 172.21.15.107:0/2027202299 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fd7780ce360 con 0x7fd788101880 2023-08-10T10:52:09.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaaf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd7877fe700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd7700a13e0 0x7fd7700a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 0x5605ccaa92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605cca24dc0 con 0x5605ccaa9800 2023-08-10T10:52:09.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605cca01590 con 0x5605ccaaef50 2023-08-10T10:52:09.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605cc9feeb0 con 0x5605ccaaf870 2023-08-10T10:52:09.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.621+0000 7fd7877fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd786ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaaf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd7877fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37266/0 (socket says 172.21.15.107:37266) 2023-08-10T10:52:09.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd7877fe700 1 -- 172.21.15.107:0/2442955845 learned_addr learned my addr 172.21.15.107:0/2442955845 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd7867fc700 1 --2- 172.21.15.107:0/2442955845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 0x5605ccaa92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd786ffd700 1 -- 172.21.15.107:0/2442955845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 msgr2=0x5605ccaa92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd7877fe700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd7700a13e0 0x7fd7700a38a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd780007870 tx=0x7fd780007c30 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd786ffd700 1 --2- 172.21.15.107:0/2442955845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 0x5605ccaa92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd786ffd700 1 -- 172.21.15.107:0/2442955845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 msgr2=0x5605ccaa9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd786ffd700 1 --2- 172.21.15.107:0/2442955845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd786ffd700 1 -- 172.21.15.107:0/2442955845 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605cc87b630 con 0x5605ccaaef50 2023-08-10T10:52:09.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd7877fe700 1 --2- 172.21.15.107:0/2442955845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:09.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.622+0000 7fd786ffd700 1 --2- 172.21.15.107:0/2442955845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaaf330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7780cb5d0 tx=0x7fd7780051b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ce187522189428 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.623+0000 7fd76d7fa700 1 -- 172.21.15.107:0/2442955845 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7780cbea0 con 0x5605ccaaef50 2023-08-10T10:52:09.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.623+0000 7fd76d7fa700 1 -- 172.21.15.107:0/2442955845 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7780ce170 con 0x5605ccaaef50 2023-08-10T10:52:09.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.623+0000 7fd76d7fa700 1 -- 172.21.15.107:0/2442955845 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77809b170 con 0x5605ccaaef50 2023-08-10T10:52:09.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.623+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/2442955845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 msgr2=0x5605ccaaf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.623+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/2442955845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaaf330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7780cb5d0 tx=0x7fd7780051b0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.624+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/2442955845 shutdown_connections 2023-08-10T10:52:09.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.624+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/2442955845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaaf330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.624+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/2442955845 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.624+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/2442955845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 0x5605ccaa92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.624+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/2442955845 >> 172.21.15.107:0/2442955845 conn(0x5605cca06cd0 msgr2=0x5605ccaa44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.624+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/2442955845 shutdown_connections 2023-08-10T10:52:09.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.624+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/2442955845 wait complete. 2023-08-10T10:52:09.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.624+0000 7fd7a0f66b80 1 -- start start 2023-08-10T10:52:09.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.625+0000 7fd7a0f66b80 1 Processor -- start 2023-08-10T10:52:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.625+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 0x5605ccab5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.625+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccab2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.625+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccab3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605cc9fa7a0 con 0x5605ccaaef50 2023-08-10T10:52:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605cc999ac0 con 0x5605ccaaf870 2023-08-10T10:52:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605cc9997c0 con 0x5605ccaa9800 2023-08-10T10:52:09.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7a0f66b80 10 client.0 _ll_register_callbacks cb 0x5605cc997680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:09.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7867fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccab2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7877fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccab3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7867fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccab2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37274/0 (socket says 172.21.15.107:37274) 2023-08-10T10:52:09.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7867fc700 1 -- 172.21.15.107:0/796649848 learned_addr learned my addr 172.21.15.107:0/796649848 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd786ffd700 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 0x5605ccab5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7867fc700 1 -- 172.21.15.107:0/796649848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 msgr2=0x5605ccab5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7867fc700 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 0x5605ccab5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7867fc700 1 -- 172.21.15.107:0/796649848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 msgr2=0x5605ccab3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7867fc700 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccab3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7867fc700 1 -- 172.21.15.107:0/796649848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd780007e00 con 0x5605ccaaef50 2023-08-10T10:52:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.626+0000 7fd7877fe700 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccab3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.627+0000 7fd7867fc700 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccab2a60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0126d0 tx=0x7fd77c0129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8f17f6d0a3d483 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.627+0000 7fd76aff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:09.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.627+0000 7fd76aff5700 1 -- 172.21.15.107:0/796649848 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c017070 con 0x5605ccaaef50 2023-08-10T10:52:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.627+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/796649848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605cca9c470 con 0x5605ccaaef50 2023-08-10T10:52:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.627+0000 7fd76aff5700 1 -- 172.21.15.107:0/796649848 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fd77c004030 con 0x5605ccaaef50 2023-08-10T10:52:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.627+0000 7fd76aff5700 1 -- 172.21.15.107:0/796649848 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd77c0122e0 con 0x5605ccaaef50 2023-08-10T10:52:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.627+0000 7fd7a0f66b80 10 client.16083 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.627+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/796649848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fd7881a54f0 con 0x5605ccaaef50 2023-08-10T10:52:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.628+0000 7fd76aff5700 1 -- 172.21.15.107:0/796649848 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5605cca9c470 con 0x5605ccaaef50 2023-08-10T10:52:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.628+0000 7fd76aff5700 1 -- 172.21.15.107:0/796649848 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd77c01c460 con 0x5605ccaaef50 2023-08-10T10:52:09.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.628+0000 7fd7a0f66b80 10 client.16083 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.628+0000 7fd7a0f66b80 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.628+0000 7fd7a0f66b80 20 client.16083 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.628+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5605ccac2fd0 0x5605ccac53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.628+0000 7fd7a0f66b80 4 client.16083 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.628+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/796649848 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5605cca789d0 con 0x5605ccac2fd0 2023-08-10T10:52:09.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.629+0000 7fd786ffd700 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5605ccac2fd0 0x5605ccac53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.629+0000 7fd786ffd700 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5605ccac2fd0 0x5605ccac53f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a17b7282d9507a0 server_cookie=e7d27623b54e10b0 in_seq=0 out_seq=0 2023-08-10T10:52:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.629+0000 7fd76aff5700 10 client.16083 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd76aff5700 1 -- 172.21.15.107:0/796649848 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5605cca789d0 con 0x5605ccac2fd0 2023-08-10T10:52:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd76aff5700 10 client.16083 handle_command_reply: tid=0 2023-08-10T10:52:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 client.16083 shutdown 2023-08-10T10:52:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/796649848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 msgr2=0x5605ccab2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccab2a60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0126d0 tx=0x7fd77c0129e0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/796649848 shutdown_connections 2023-08-10T10:52:09.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5605ccac2fd0 0x5605ccac53f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccab3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 0x5605ccab5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/796649848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccab2a60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd76aff5700 0 client.16083 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/796649848 >> 172.21.15.107:0/796649848 conn(0x5605cca06cd0 msgr2=0x5605ccaa39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/796649848 shutdown_connections 2023-08-10T10:52:09.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.630+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/796649848 wait complete. 2023-08-10T10:52:09.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.631+0000 7fd7a0f66b80 20 client.16083 trim_cache size 0 max 16384 2023-08-10T10:52:09.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.648+0000 7fd7a0f66b80 1 Processor -- start 2023-08-10T10:52:09.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.648+0000 7fd7a0f66b80 1 -- start start 2023-08-10T10:52:09.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.648+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.648+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.648+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 0x5605ccab04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.648+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605cc87d920 con 0x5605ccaa9800 2023-08-10T10:52:09.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.648+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605ccaa5c70 con 0x5605ccaaef50 2023-08-10T10:52:09.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.648+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605ccac0570 con 0x5605ccaaf870 2023-08-10T10:52:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.648+0000 7fd786ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd786ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37286/0 (socket says 172.21.15.107:37286) 2023-08-10T10:52:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd786ffd700 1 -- 172.21.15.107:0/1065559358 learned_addr learned my addr 172.21.15.107:0/1065559358 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd786ffd700 1 -- 172.21.15.107:0/1065559358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 msgr2=0x5605ccab04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd7877fe700 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 0x5605ccab04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd786ffd700 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 0x5605ccab04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd786ffd700 1 -- 172.21.15.107:0/1065559358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 msgr2=0x5605ccaba0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd7867fc700 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd786ffd700 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaba0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd786ffd700 1 -- 172.21.15.107:0/1065559358 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605cc827de0 con 0x5605ccaa9800 2023-08-10T10:52:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd7877fe700 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 0x5605ccab04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd7867fc700 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaba0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd786ffd700 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa92c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd778005320 tx=0x7fd778009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a636db1020b3d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd76dffb700 1 -- 172.21.15.107:0/1065559358 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7780cbea0 con 0x5605ccaa9800 2023-08-10T10:52:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd76dffb700 1 -- 172.21.15.107:0/1065559358 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7780cb510 con 0x5605ccaa9800 2023-08-10T10:52:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.649+0000 7fd76dffb700 1 -- 172.21.15.107:0/1065559358 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77809a400 con 0x5605ccaa9800 2023-08-10T10:52:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.650+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/1065559358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 msgr2=0x5605ccaa92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.650+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa92c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd778005320 tx=0x7fd778009260 comp rx=0 tx=0).stop 2023-08-10T10:52:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.650+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/1065559358 shutdown_connections 2023-08-10T10:52:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.650+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaaf870 0x5605ccab04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.650+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaa9800 0x5605ccaa92c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.650+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/1065559358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaef50 0x5605ccaba0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.650+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/1065559358 >> 172.21.15.107:0/1065559358 conn(0x5605cca06cd0 msgr2=0x5605ccaafdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.650+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/1065559358 shutdown_connections 2023-08-10T10:52:09.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.650+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/1065559358 wait complete. 2023-08-10T10:52:09.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.651+0000 7fd7a0f66b80 1 -- start start 2023-08-10T10:52:09.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.651+0000 7fd7a0f66b80 1 Processor -- start 2023-08-10T10:52:09.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 0x5605ccaaa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccaaaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7a0f66b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccaab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605ccaabbe0 con 0x5605ccaaef50 2023-08-10T10:52:09.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605ccaabd50 con 0x5605ccaaf870 2023-08-10T10:52:09.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7a0f66b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605ccaabf10 con 0x5605ccaa9800 2023-08-10T10:52:09.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7a0f66b80 10 client.0 _ll_register_callbacks cb 0x5605cc997680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:09.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7867fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccaaaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7867fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccaaaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37300/0 (socket says 172.21.15.107:37300) 2023-08-10T10:52:09.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7867fc700 1 -- 172.21.15.107:0/3094627558 learned_addr learned my addr 172.21.15.107:0/3094627558 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:09.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd786ffd700 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 0x5605ccaaa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.652+0000 7fd7877fe700 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccaab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd7867fc700 1 -- 172.21.15.107:0/3094627558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 msgr2=0x5605ccaaa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd7867fc700 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 0x5605ccaaa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd7867fc700 1 -- 172.21.15.107:0/3094627558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 msgr2=0x5605ccaab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:09.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd7867fc700 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccaab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd7867fc700 1 -- 172.21.15.107:0/3094627558 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605cc87b630 con 0x5605ccaaef50 2023-08-10T10:52:09.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd7877fe700 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccaab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:09.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd7867fc700 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccaaaeb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0094f0 tx=0x7fd77c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b33f6cbf48eaac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:09.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd76aff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:09.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd76aff5700 1 -- 172.21.15.107:0/3094627558 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c017040 con 0x5605ccaaef50 2023-08-10T10:52:09.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/3094627558 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7780ce170 con 0x5605ccaaef50 2023-08-10T10:52:09.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.653+0000 7fd76aff5700 1 -- 172.21.15.107:0/3094627558 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fd77c000e40 con 0x5605ccaaef50 2023-08-10T10:52:09.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd76aff5700 1 -- 172.21.15.107:0/3094627558 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd77c005ce0 con 0x5605ccaaef50 2023-08-10T10:52:09.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd7a0f66b80 10 client.16089 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:09.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/3094627558 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5605cc810c60 con 0x5605ccaaef50 2023-08-10T10:52:09.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd76aff5700 1 -- 172.21.15.107:0/3094627558 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7780ce170 con 0x5605ccaaef50 2023-08-10T10:52:09.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd76aff5700 1 -- 172.21.15.107:0/3094627558 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd77c0037c0 con 0x5605ccaaef50 2023-08-10T10:52:09.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd7a0f66b80 10 client.16089 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:09.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd7a0f66b80 10 client.16089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:09.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd7a0f66b80 20 client.16089 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:09.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5605ccb17a80 0x5605ccb19ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:09.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd7a0f66b80 4 client.16089 mds_command: new command op to 24575 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:09.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.654+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/3094627558 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5605cc9f3780 con 0x5605ccb17a80 2023-08-10T10:52:09.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.655+0000 7fd786ffd700 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5605ccb17a80 0x5605ccb19ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:09.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.655+0000 7fd786ffd700 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5605ccb17a80 0x5605ccb19ea0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c994da77f0d5edf3 server_cookie=af43354c8db64e94 in_seq=0 out_seq=0 2023-08-10T10:52:09.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.655+0000 7fd76aff5700 10 client.16089 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:09.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.655+0000 7fd76aff5700 1 -- 172.21.15.107:0/3094627558 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5605cc9f3780 con 0x5605ccb17a80 2023-08-10T10:52:09.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.655+0000 7fd76aff5700 10 client.16089 handle_command_reply: tid=0 2023-08-10T10:52:09.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.655+0000 7fd7a0f66b80 1 client.16089 shutdown 2023-08-10T10:52:09.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/3094627558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 msgr2=0x5605ccaaaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccaaaeb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0094f0 tx=0x7fd77c01ca00 comp rx=0 tx=0).stop 2023-08-10T10:52:09.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/3094627558 shutdown_connections 2023-08-10T10:52:09.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5605ccb17a80 0x5605ccb19ea0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5605ccaaf870 0x5605ccaab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5605ccaa9800 0x5605ccaaa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 --2- 172.21.15.107:0/3094627558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605ccaaef50 0x5605ccaaaeb0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/3094627558 >> 172.21.15.107:0/3094627558 conn(0x5605cca06cd0 msgr2=0x5605ccab1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd76aff5700 0 client.16089 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:09.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/3094627558 shutdown_connections 2023-08-10T10:52:09.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 1 -- 172.21.15.107:0/3094627558 wait complete. 2023-08-10T10:52:09.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.656+0000 7fd7a0f66b80 20 client.16089 trim_cache size 0 max 16384 2023-08-10T10:52:09.666 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:09.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 -- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd7700a13e0 msgr2=0x7fd7700a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd7700a13e0 0x7fd7700a38a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd780007870 tx=0x7fd780007c30 comp rx=0 tx=0).stop 2023-08-10T10:52:09.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 -- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd788101880 msgr2=0x7fd7880ff4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:09.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd788101880 0x7fd7880ff4d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd778009230 tx=0x7fd77800fa00 comp rx=0 tx=0).stop 2023-08-10T10:52:09.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 -- 172.21.15.107:0/2027202299 shutdown_connections 2023-08-10T10:52:09.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd78810aca0 0x7fd7881a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd788101880 0x7fd7880ff4d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd7700a13e0 0x7fd7700a38a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 --2- 172.21.15.107:0/2027202299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7881021a0 0x7fd7880ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:09.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 -- 172.21.15.107:0/2027202299 >> 172.21.15.107:0/2027202299 conn(0x7fd7880fb0c0 msgr2=0x7fd7880fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:09.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 -- 172.21.15.107:0/2027202299 shutdown_connections 2023-08-10T10:52:09.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:09.657+0000 7fd78d5ff700 1 -- 172.21.15.107:0/2027202299 wait complete. 2023-08-10T10:52:10.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:09 smithi157 ceph-mon[129604]: pgmap v31: 129 pgs: 129 active+clean; 438 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 32 MiB/s wr, 46 op/s 2023-08-10T10:52:10.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:09 smithi107 ceph-mon[127953]: pgmap v31: 129 pgs: 129 active+clean; 438 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 32 MiB/s wr, 46 op/s 2023-08-10T10:52:10.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:09 smithi195 ceph-mon[129938]: pgmap v31: 129 pgs: 129 active+clean; 438 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 32 MiB/s wr, 46 op/s 2023-08-10T10:52:10.678 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-10T10:52:10.679 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-10T10:52:10.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.903+0000 7f56371ff700 1 -- 172.21.15.107:0/30409909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 msgr2=0x7f56300ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.903+0000 7f56371ff700 1 --2- 172.21.15.107:0/30409909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 0x7f56300ffa50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f561c0099c0 tx=0x7f561c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.903+0000 7f56371ff700 1 -- 172.21.15.107:0/30409909 shutdown_connections 2023-08-10T10:52:10.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.903+0000 7f56371ff700 1 --2- 172.21.15.107:0/30409909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5630105690 0x7f5630105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.903+0000 7f56371ff700 1 --2- 172.21.15.107:0/30409909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56300fff90 0x7f563010c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.903+0000 7f56371ff700 1 --2- 172.21.15.107:0/30409909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 0x7f56300ffa50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.903+0000 7f56371ff700 1 -- 172.21.15.107:0/30409909 >> 172.21.15.107:0/30409909 conn(0x7f56300fb0c0 msgr2=0x7f56300fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:10.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.903+0000 7f56371ff700 1 -- 172.21.15.107:0/30409909 shutdown_connections 2023-08-10T10:52:10.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.903+0000 7f56371ff700 1 -- 172.21.15.107:0/30409909 wait complete. 2023-08-10T10:52:10.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.904+0000 7f56371ff700 1 Processor -- start 2023-08-10T10:52:10.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.904+0000 7f56371ff700 1 -- start start 2023-08-10T10:52:10.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f56371ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 0x7f563019e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f56371ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fff90 0x7f563019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f56371ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5630105690 0x7f56301986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f56371ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5630198d50 con 0x7f56300ff5d0 2023-08-10T10:52:10.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f56371ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5630198ec0 con 0x7f56300fff90 2023-08-10T10:52:10.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f56371ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5630199080 con 0x7f5630105690 2023-08-10T10:52:10.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f5634f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 0x7f563019e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f5634f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 0x7f563019e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37328/0 (socket says 172.21.15.107:37328) 2023-08-10T10:52:10.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f5634f9b700 1 -- 172.21.15.107:0/665376407 learned_addr learned my addr 172.21.15.107:0/665376407 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:10.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f562ffff700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fff90 0x7f563019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f563579c700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5630105690 0x7f56301986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.905+0000 7f5634f9b700 1 -- 172.21.15.107:0/665376407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5630105690 msgr2=0x7f56301986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f5634f9b700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5630105690 0x7f56301986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f5634f9b700 1 -- 172.21.15.107:0/665376407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fff90 msgr2=0x7f563019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f5634f9b700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fff90 0x7f563019ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f5634f9b700 1 -- 172.21.15.107:0/665376407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c0095f0 con 0x7f56300ff5d0 2023-08-10T10:52:10.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f562ffff700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fff90 0x7f563019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:10.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f563579c700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5630105690 0x7f56301986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:10.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f5634f9b700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 0x7f563019e670 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f562400d950 tx=0x7f562400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:10.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f562dffb700 1 -- 172.21.15.107:0/665376407 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624009b40 con 0x7f56300ff5d0 2023-08-10T10:52:10.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f56371ff700 1 -- 172.21.15.107:0/665376407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5630199360 con 0x7f56300ff5d0 2023-08-10T10:52:10.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f562dffb700 1 -- 172.21.15.107:0/665376407 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5624009ca0 con 0x7f56300ff5d0 2023-08-10T10:52:10.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f562dffb700 1 -- 172.21.15.107:0/665376407 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562400f620 con 0x7f56300ff5d0 2023-08-10T10:52:10.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.906+0000 7f56371ff700 1 -- 172.21.15.107:0/665376407 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56301a5660 con 0x7f56300ff5d0 2023-08-10T10:52:10.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.910+0000 7f562dffb700 1 -- 172.21.15.107:0/665376407 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f5624010460 con 0x7f56300ff5d0 2023-08-10T10:52:10.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f564aa90b80 1 Processor -- start 2023-08-10T10:52:10.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f564aa90b80 1 -- start start 2023-08-10T10:52:10.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f562dffb700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f56200a1460 0x7f56200a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f6270a8f0 0x562f62704340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f562dffb700 1 -- 172.21.15.107:0/665376407 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f56240cd660 con 0x7f56300ff5d0 2023-08-10T10:52:10.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62704880 0x562f62704d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f564aa90b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f6267fe40 con 0x562f62709fd0 2023-08-10T10:52:10.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f564aa90b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f6265c610 con 0x562f62704880 2023-08-10T10:52:10.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.912+0000 7f564aa90b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f62659f30 con 0x562f6270a8f0 2023-08-10T10:52:10.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f563579c700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f56200a1460 0x7f56200a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f562ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f6270a8f0 0x562f62704340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f5634f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f562ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f6270a8f0 0x562f62704340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:60314/0 (socket says 172.21.15.107:60314) 2023-08-10T10:52:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f562ffff700 1 -- 172.21.15.107:0/3857171855 learned_addr learned my addr 172.21.15.107:0/3857171855 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f563579c700 1 --2- 172.21.15.107:0/3857171855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62704880 0x562f62704d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f5634f9b700 1 -- 172.21.15.107:0/3857171855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f6270a8f0 msgr2=0x562f62704340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f5634f9b700 1 --2- 172.21.15.107:0/3857171855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f6270a8f0 0x562f62704340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f5634f9b700 1 -- 172.21.15.107:0/3857171855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62704880 msgr2=0x562f62704d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f5634f9b700 1 --2- 172.21.15.107:0/3857171855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62704880 0x562f62704d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f5634f9b700 1 -- 172.21.15.107:0/3857171855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f624d66b0 con 0x562f62709fd0 2023-08-10T10:52:10.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.913+0000 7f563579c700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f56200a1460 0x7f56200a3920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f563019f370 tx=0x7f5628007a80 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:10.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.914+0000 7f5634f9b700 1 --2- 172.21.15.107:0/3857171855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270a3b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f56240ca8d0 tx=0x7f5624099cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d8337028d39298 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:10.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.914+0000 7f561affd700 1 -- 172.21.15.107:0/3857171855 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562409a180 con 0x562f62709fd0 2023-08-10T10:52:10.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.914+0000 7f561affd700 1 -- 172.21.15.107:0/3857171855 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f562409e1b0 con 0x562f62709fd0 2023-08-10T10:52:10.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.914+0000 7f561affd700 1 -- 172.21.15.107:0/3857171855 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562409a3e0 con 0x562f62709fd0 2023-08-10T10:52:10.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 -- 172.21.15.107:0/3857171855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 msgr2=0x562f6270a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 --2- 172.21.15.107:0/3857171855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270a3b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f56240ca8d0 tx=0x7f5624099cc0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 -- 172.21.15.107:0/3857171855 shutdown_connections 2023-08-10T10:52:10.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 --2- 172.21.15.107:0/3857171855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62704880 0x562f62704d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 --2- 172.21.15.107:0/3857171855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270a3b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 --2- 172.21.15.107:0/3857171855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f6270a8f0 0x562f62704340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 -- 172.21.15.107:0/3857171855 >> 172.21.15.107:0/3857171855 conn(0x562f62661d50 msgr2=0x562f626ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:10.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 -- 172.21.15.107:0/3857171855 shutdown_connections 2023-08-10T10:52:10.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 -- 172.21.15.107:0/3857171855 wait complete. 2023-08-10T10:52:10.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.915+0000 7f564aa90b80 1 -- start start 2023-08-10T10:52:10.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.916+0000 7f564aa90b80 1 Processor -- start 2023-08-10T10:52:10.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.916+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 0x562f6270dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.916+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62709fd0 0x562f6270e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.916+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f6270a8f0 0x562f6270e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.916+0000 7f564aa90b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f62655820 con 0x562f6270a8f0 2023-08-10T10:52:10.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.916+0000 7f564aa90b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f625f4b40 con 0x562f62709fd0 2023-08-10T10:52:10.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.916+0000 7f564aa90b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f625f4840 con 0x562f62704880 2023-08-10T10:52:10.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.916+0000 7f564aa90b80 10 client.0 _ll_register_callbacks cb 0x562f625f2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:10.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.916+0000 7f563579c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f6270a8f0 0x562f6270e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f563579c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f6270a8f0 0x562f6270e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37350/0 (socket says 172.21.15.107:37350) 2023-08-10T10:52:10.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f563579c700 1 -- 172.21.15.107:0/1801907726 learned_addr learned my addr 172.21.15.107:0/1801907726 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:10.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f5634f9b700 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 0x562f6270dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f562ffff700 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62709fd0 0x562f6270e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f563579c700 1 -- 172.21.15.107:0/1801907726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 msgr2=0x562f6270dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f563579c700 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 0x562f6270dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f563579c700 1 -- 172.21.15.107:0/1801907726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62709fd0 msgr2=0x562f6270e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f563579c700 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62709fd0 0x562f6270e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f563579c700 1 -- 172.21.15.107:0/1801907726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56301a5660 con 0x562f6270a8f0 2023-08-10T10:52:10.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f562ffff700 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62709fd0 0x562f6270e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:10.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f563579c700 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f6270a8f0 0x562f6270e6e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5628004d80 tx=0x7f5628009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741d9558b3fb7614 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:10.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f560ffff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:10.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f560ffff700 1 -- 172.21.15.107:0/1801907726 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628004e70 con 0x562f6270a8f0 2023-08-10T10:52:10.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f564aa90b80 1 -- 172.21.15.107:0/1801907726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f626f74f0 con 0x562f6270a8f0 2023-08-10T10:52:10.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.917+0000 7f560ffff700 1 -- 172.21.15.107:0/1801907726 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f5628021480 con 0x562f6270a8f0 2023-08-10T10:52:10.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f560ffff700 1 -- 172.21.15.107:0/1801907726 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5628021640 con 0x562f6270a8f0 2023-08-10T10:52:10.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f564aa90b80 10 client.16101 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:10.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f564aa90b80 1 -- 172.21.15.107:0/1801907726 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562f62482e60 con 0x562f6270a8f0 2023-08-10T10:52:10.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f560ffff700 1 -- 172.21.15.107:0/1801907726 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f626f74f0 con 0x562f6270a8f0 2023-08-10T10:52:10.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f560ffff700 1 -- 172.21.15.107:0/1801907726 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5628005300 con 0x562f6270a8f0 2023-08-10T10:52:10.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f564aa90b80 10 client.16101 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:10.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f564aa90b80 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:10.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f564aa90b80 20 client.16101 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:10.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f564aa90b80 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562f6271e3c0 0x562f627207e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f564aa90b80 4 client.16101 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:10.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.918+0000 7f564aa90b80 1 -- 172.21.15.107:0/1801907726 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f626d3a50 con 0x562f6271e3c0 2023-08-10T10:52:10.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.919+0000 7f5634f9b700 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562f6271e3c0 0x562f627207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.919+0000 7f560ffff700 10 client.16101 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:10.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.919+0000 7f5634f9b700 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562f6271e3c0 0x562f627207e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af3515dacf9b11 server_cookie=c8c3adf52a98063e in_seq=0 out_seq=0 2023-08-10T10:52:10.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.920+0000 7f560ffff700 1 -- 172.21.15.107:0/1801907726 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562f626d3a50 con 0x562f6271e3c0 2023-08-10T10:52:10.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.920+0000 7f560ffff700 10 client.16101 handle_command_reply: tid=0 2023-08-10T10:52:10.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.920+0000 7f564aa90b80 1 client.16101 shutdown 2023-08-10T10:52:10.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 -- 172.21.15.107:0/1801907726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f6270a8f0 msgr2=0x562f6270e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f6270a8f0 0x562f6270e6e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5628004d80 tx=0x7f5628009620 comp rx=0 tx=0).stop 2023-08-10T10:52:10.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 -- 172.21.15.107:0/1801907726 shutdown_connections 2023-08-10T10:52:10.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562f6271e3c0 0x562f627207e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f6270a8f0 0x562f6270e6e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 0x562f6270dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 --2- 172.21.15.107:0/1801907726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f62709fd0 0x562f6270e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 -- 172.21.15.107:0/1801907726 >> 172.21.15.107:0/1801907726 conn(0x562f62661d50 msgr2=0x562f626fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:10.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f560ffff700 0 client.16101 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:10.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 -- 172.21.15.107:0/1801907726 shutdown_connections 2023-08-10T10:52:10.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 1 -- 172.21.15.107:0/1801907726 wait complete. 2023-08-10T10:52:10.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.921+0000 7f564aa90b80 20 client.16101 trim_cache size 0 max 16384 2023-08-10T10:52:10.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.946+0000 7f564aa90b80 1 Processor -- start 2023-08-10T10:52:10.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.946+0000 7f564aa90b80 1 -- start start 2023-08-10T10:52:10.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.946+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 0x562f62715330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.946+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.946+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 0x562f626ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.946+0000 7f564aa90b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f624d89a0 con 0x562f62709fd0 2023-08-10T10:52:10.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.946+0000 7f564aa90b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f626f70f0 con 0x562f6270a8f0 2023-08-10T10:52:10.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.946+0000 7f564aa90b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f626fc000 con 0x562f62704880 2023-08-10T10:52:10.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.946+0000 7f562ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f562ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37362/0 (socket says 172.21.15.107:37362) 2023-08-10T10:52:10.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f562ffff700 1 -- 172.21.15.107:0/2869720458 learned_addr learned my addr 172.21.15.107:0/2869720458 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:10.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f5634f9b700 1 --2- 172.21.15.107:0/2869720458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 0x562f62715330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f563579c700 1 --2- 172.21.15.107:0/2869720458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 0x562f626ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f562ffff700 1 -- 172.21.15.107:0/2869720458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 msgr2=0x562f62715330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f562ffff700 1 --2- 172.21.15.107:0/2869720458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 0x562f62715330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f562ffff700 1 -- 172.21.15.107:0/2869720458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 msgr2=0x562f626ff1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f562ffff700 1 --2- 172.21.15.107:0/2869720458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 0x562f626ff1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f562ffff700 1 -- 172.21.15.107:0/2869720458 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f6246bce0 con 0x562f62709fd0 2023-08-10T10:52:10.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.947+0000 7f562ffff700 1 --2- 172.21.15.107:0/2869720458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270b4d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f561c00b580 tx=0x7f561c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9b4db73dabc9ba server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:10.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.948+0000 7f561b7fe700 1 -- 172.21.15.107:0/2869720458 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c0054f0 con 0x562f62709fd0 2023-08-10T10:52:10.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.948+0000 7f561b7fe700 1 -- 172.21.15.107:0/2869720458 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f561c01e040 con 0x562f62709fd0 2023-08-10T10:52:10.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.948+0000 7f561b7fe700 1 -- 172.21.15.107:0/2869720458 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c004740 con 0x562f62709fd0 2023-08-10T10:52:10.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.948+0000 7f564aa90b80 1 -- 172.21.15.107:0/2869720458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 msgr2=0x562f6270b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.948+0000 7f564aa90b80 1 --2- 172.21.15.107:0/2869720458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270b4d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f561c00b580 tx=0x7f561c005040 comp rx=0 tx=0).stop 2023-08-10T10:52:10.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.949+0000 7f564aa90b80 1 -- 172.21.15.107:0/2869720458 shutdown_connections 2023-08-10T10:52:10.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.949+0000 7f564aa90b80 1 --2- 172.21.15.107:0/2869720458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 0x562f626ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.949+0000 7f564aa90b80 1 --2- 172.21.15.107:0/2869720458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62704880 0x562f62715330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.949+0000 7f564aa90b80 1 --2- 172.21.15.107:0/2869720458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62709fd0 0x562f6270b4d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.949+0000 7f564aa90b80 1 -- 172.21.15.107:0/2869720458 >> 172.21.15.107:0/2869720458 conn(0x562f62661d50 msgr2=0x562f6270adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:10.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.949+0000 7f564aa90b80 1 -- 172.21.15.107:0/2869720458 shutdown_connections 2023-08-10T10:52:10.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.949+0000 7f564aa90b80 1 -- 172.21.15.107:0/2869720458 wait complete. 2023-08-10T10:52:10.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.949+0000 7f564aa90b80 1 -- start start 2023-08-10T10:52:10.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.950+0000 7f564aa90b80 1 Processor -- start 2023-08-10T10:52:10.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.950+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62704880 0x562f6276ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.950+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62709fd0 0x562f6276bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.950+0000 7f564aa90b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 0x562f62766000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.950+0000 7f564aa90b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f627666e0 con 0x562f62704880 2023-08-10T10:52:10.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f564aa90b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f62766850 con 0x562f6270a8f0 2023-08-10T10:52:10.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f564aa90b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f62766990 con 0x562f62709fd0 2023-08-10T10:52:10.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f564aa90b80 10 client.0 _ll_register_callbacks cb 0x562f625f2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:10.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f5634f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62704880 0x562f6276ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f5634f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62704880 0x562f6276ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37366/0 (socket says 172.21.15.107:37366) 2023-08-10T10:52:10.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f5634f9b700 1 -- 172.21.15.107:0/449907393 learned_addr learned my addr 172.21.15.107:0/449907393 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:10.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f563579c700 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 0x562f62766000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f562ffff700 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62709fd0 0x562f6276bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f5634f9b700 1 -- 172.21.15.107:0/449907393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62709fd0 msgr2=0x562f6276bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f5634f9b700 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62709fd0 0x562f6276bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f5634f9b700 1 -- 172.21.15.107:0/449907393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 msgr2=0x562f62766000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:10.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f5634f9b700 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 0x562f62766000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f5634f9b700 1 -- 172.21.15.107:0/449907393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563010cd50 con 0x562f62704880 2023-08-10T10:52:10.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.951+0000 7f562ffff700 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62709fd0 0x562f6276bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:10.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.952+0000 7f5634f9b700 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62704880 0x562f6276ba40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5624009520 tx=0x7f5624005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b3c64904727a44 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:10.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.952+0000 7f560ffff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:10.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.952+0000 7f560ffff700 1 -- 172.21.15.107:0/449907393 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56240b2040 con 0x562f62704880 2023-08-10T10:52:10.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.952+0000 7f560ffff700 1 -- 172.21.15.107:0/449907393 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f56240b6070 con 0x562f62704880 2023-08-10T10:52:10.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.952+0000 7f564aa90b80 1 -- 172.21.15.107:0/449907393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f562409e1b0 con 0x562f62704880 2023-08-10T10:52:10.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.952+0000 7f560ffff700 1 -- 172.21.15.107:0/449907393 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56240cd2e0 con 0x562f62704880 2023-08-10T10:52:10.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.952+0000 7f564aa90b80 10 client.16107 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:10.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.952+0000 7f564aa90b80 1 -- 172.21.15.107:0/449907393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562f624a92d0 con 0x562f62704880 2023-08-10T10:52:10.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.953+0000 7f560ffff700 1 -- 172.21.15.107:0/449907393 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f562409e1b0 con 0x562f62704880 2023-08-10T10:52:10.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.954+0000 7f560ffff700 1 -- 172.21.15.107:0/449907393 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f56240a2140 con 0x562f62704880 2023-08-10T10:52:10.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.954+0000 7f564aa90b80 10 client.16107 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:10.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.954+0000 7f564aa90b80 10 client.16107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:10.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.954+0000 7f564aa90b80 20 client.16107 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:10.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.954+0000 7f564aa90b80 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562f62784490 0x562f627868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:10.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.954+0000 7f564aa90b80 4 client.16107 mds_command: new command op to 24575 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-10T10:52:10.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.954+0000 7f564aa90b80 1 -- 172.21.15.107:0/449907393 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562f6264e800 con 0x562f62784490 2023-08-10T10:52:10.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.955+0000 7f562ffff700 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562f62784490 0x562f627868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:10.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.956+0000 7f560ffff700 10 client.16107 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:10.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.956+0000 7f562ffff700 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562f62784490 0x562f627868b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bee0bb4dacd1df88 server_cookie=b48bfe185380c2f8 in_seq=0 out_seq=0 2023-08-10T10:52:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f560ffff700 1 -- 172.21.15.107:0/449907393 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562f6264e800 con 0x562f62784490 2023-08-10T10:52:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f560ffff700 10 client.16107 handle_command_reply: tid=0 2023-08-10T10:52:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 client.16107 shutdown 2023-08-10T10:52:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 -- 172.21.15.107:0/449907393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62704880 msgr2=0x562f6276ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62704880 0x562f6276ba40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5624009520 tx=0x7f5624005c80 comp rx=0 tx=0).stop 2023-08-10T10:52:10.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 -- 172.21.15.107:0/449907393 shutdown_connections 2023-08-10T10:52:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562f62784490 0x562f627868b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562f6270a8f0 0x562f62766000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562f62704880 0x562f6276ba40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f560ffff700 0 client.16107 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 --2- 172.21.15.107:0/449907393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562f62709fd0 0x562f6276bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 -- 172.21.15.107:0/449907393 >> 172.21.15.107:0/449907393 conn(0x562f62661d50 msgr2=0x562f627095a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 -- 172.21.15.107:0/449907393 shutdown_connections 2023-08-10T10:52:10.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.958+0000 7f564aa90b80 1 -- 172.21.15.107:0/449907393 wait complete. 2023-08-10T10:52:10.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f564aa90b80 20 client.16107 trim_cache size 0 max 16384 2023-08-10T10:52:10.970 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:52:10.970 INFO:teuthology.orchestra.run.smithi107.stdout: "return_code": 0, 2023-08-10T10:52:10.970 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_tag": "08e6d52e-6114-49b2-a990-644ffbdec45a", 2023-08-10T10:52:10.970 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": "asynchronous" 2023-08-10T10:52:10.971 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:52:10.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 -- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f56200a1460 msgr2=0x7f56200a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f56200a1460 0x7f56200a3920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f563019f370 tx=0x7f5628007a80 comp rx=0 tx=0).stop 2023-08-10T10:52:10.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 -- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 msgr2=0x7f563019e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:10.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 0x7f563019e670 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f562400d950 tx=0x7f562400dd10 comp rx=0 tx=0).stop 2023-08-10T10:52:10.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 -- 172.21.15.107:0/665376407 shutdown_connections 2023-08-10T10:52:10.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5630105690 0x7f56301986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56300ff5d0 0x7f563019e670 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f56200a1460 0x7f56200a3920 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 --2- 172.21.15.107:0/665376407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56300fff90 0x7f563019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:10.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.959+0000 7f56371ff700 1 -- 172.21.15.107:0/665376407 >> 172.21.15.107:0/665376407 conn(0x7f56300fb0c0 msgr2=0x7f5630067890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:10.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.960+0000 7f56371ff700 1 -- 172.21.15.107:0/665376407 shutdown_connections 2023-08-10T10:52:10.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:10.960+0000 7f56371ff700 1 -- 172.21.15.107:0/665376407 wait complete. 2023-08-10T10:52:10.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:52:11.117 INFO:teuthology.orchestra.run.smithi107.stderr:1900000 of 50000000 tuples (3%) done (elapsed 29.29 s, remaining 741.63 s) 2023-08-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.214+0000 7ff21a5ff700 1 -- 172.21.15.107:0/4002024575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2141021e0 msgr2=0x7ff21410a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.214+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/4002024575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2141021e0 0x7ff21410a6c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff208009990 tx=0x7ff208009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.214+0000 7ff21a5ff700 1 -- 172.21.15.107:0/4002024575 shutdown_connections 2023-08-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.214+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/4002024575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff21410ace0 0x7ff21410d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.214+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/4002024575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2141018c0 0x7ff214101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.214+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/4002024575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2141021e0 0x7ff21410a6c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.214+0000 7ff21a5ff700 1 -- 172.21.15.107:0/4002024575 >> 172.21.15.107:0/4002024575 conn(0x7ff2140fb0c0 msgr2=0x7ff2140fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.214+0000 7ff21a5ff700 1 -- 172.21.15.107:0/4002024575 shutdown_connections 2023-08-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.214+0000 7ff21a5ff700 1 -- 172.21.15.107:0/4002024575 wait complete. 2023-08-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.215+0000 7ff21a5ff700 1 Processor -- start 2023-08-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.215+0000 7ff21a5ff700 1 -- start start 2023-08-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff21a5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2141018c0 0x7ff214198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff21a5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2141021e0 0x7ff214198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff21a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff21410ace0 0x7ff21419d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff21a5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21419d910 con 0x7ff2141021e0 2023-08-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff21a5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21419da80 con 0x7ff2141018c0 2023-08-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff21a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21419dc40 con 0x7ff21410ace0 2023-08-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff2137fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2141021e0 0x7ff214198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff213fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2141018c0 0x7ff214198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff2137fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2141021e0 0x7ff214198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37370/0 (socket says 172.21.15.107:37370) 2023-08-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff2137fe700 1 -- 172.21.15.107:0/865209642 learned_addr learned my addr 172.21.15.107:0/865209642 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff218b9c700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff21410ace0 0x7ff21419d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff213fff700 1 -- 172.21.15.107:0/865209642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff21410ace0 msgr2=0x7ff21419d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff213fff700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff21410ace0 0x7ff21419d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff213fff700 1 -- 172.21.15.107:0/865209642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2141021e0 msgr2=0x7ff214198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff213fff700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2141021e0 0x7ff214198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.216+0000 7ff213fff700 1 -- 172.21.15.107:0/865209642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080095f0 con 0x7ff2141018c0 2023-08-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.217+0000 7ff218b9c700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff21410ace0 0x7ff21419d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.217+0000 7ff213fff700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2141018c0 0x7ff214198970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e9f0 tx=0x7ff20400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.217+0000 7ff2117fa700 1 -- 172.21.15.107:0/865209642 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400c9c0 con 0x7ff2141018c0 2023-08-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.217+0000 7ff21a5ff700 1 -- 172.21.15.107:0/865209642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21419df20 con 0x7ff2141018c0 2023-08-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.217+0000 7ff2117fa700 1 -- 172.21.15.107:0/865209642 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff204010430 con 0x7ff2141018c0 2023-08-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.217+0000 7ff2117fa700 1 -- 172.21.15.107:0/865209642 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204018680 con 0x7ff2141018c0 2023-08-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.217+0000 7ff21a5ff700 1 -- 172.21.15.107:0/865209642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2141a57d0 con 0x7ff2141018c0 2023-08-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.221+0000 7ff2117fa700 1 -- 172.21.15.107:0/865209642 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7ff2040105a0 con 0x7ff2141018c0 2023-08-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.222+0000 7ff22dee9b80 1 Processor -- start 2023-08-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.222+0000 7ff2117fa700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1fc0a13e0 0x7ff1fc0a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.222+0000 7ff22dee9b80 1 -- start start 2023-08-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.222+0000 7ff2117fa700 1 -- 172.21.15.107:0/865209642 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff204014070 con 0x7ff2141018c0 2023-08-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff218b9c700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1fc0a13e0 0x7ff1fc0a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143511330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143511870 0x56114350b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x56114350bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143486dc0 con 0x56114350b800 2023-08-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143463590 con 0x561143510f50 2023-08-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143460eb0 con 0x561143511870 2023-08-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff218b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x56114350bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff218b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x56114350bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37372/0 (socket says 172.21.15.107:37372) 2023-08-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff218b9c700 1 -- 172.21.15.107:0/2596773759 learned_addr learned my addr 172.21.15.107:0/2596773759 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.223+0000 7ff213fff700 1 --2- 172.21.15.107:0/2596773759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143511330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff2137fe700 1 --2- 172.21.15.107:0/2596773759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143511870 0x56114350b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff218b9c700 1 -- 172.21.15.107:0/2596773759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143511870 msgr2=0x56114350b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff218b9c700 1 --2- 172.21.15.107:0/2596773759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143511870 0x56114350b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff218b9c700 1 -- 172.21.15.107:0/2596773759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 msgr2=0x561143511330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff218b9c700 1 --2- 172.21.15.107:0/2596773759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143511330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff218b9c700 1 -- 172.21.15.107:0/2596773759 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611432dd630 con 0x56114350b800 2023-08-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff218b9c700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1fc0a13e0 0x7ff1fc0a38a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff20c004270 tx=0x7ff20c004630 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff218b9c700 1 --2- 172.21.15.107:0/2596773759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x56114350bc80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009fd0 tx=0x7ff20c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6389679f15bfff4e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff1fa7fc700 1 -- 172.21.15.107:0/2596773759 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c01a850 con 0x56114350b800 2023-08-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff1fa7fc700 1 -- 172.21.15.107:0/2596773759 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff20c00f040 con 0x56114350b800 2023-08-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.224+0000 7ff1fa7fc700 1 -- 172.21.15.107:0/2596773759 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c018c50 con 0x56114350b800 2023-08-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.225+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2596773759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 msgr2=0x56114350bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.225+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2596773759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x56114350bc80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009fd0 tx=0x7ff20c020000 comp rx=0 tx=0).stop 2023-08-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.225+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2596773759 shutdown_connections 2023-08-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.225+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2596773759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143511330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.225+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2596773759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x56114350bc80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.225+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2596773759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143511870 0x56114350b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.225+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2596773759 >> 172.21.15.107:0/2596773759 conn(0x561143468cd0 msgr2=0x5611435064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.225+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2596773759 shutdown_connections 2023-08-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.225+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2596773759 wait complete. 2023-08-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.226+0000 7ff22dee9b80 1 -- start start 2023-08-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.226+0000 7ff22dee9b80 1 Processor -- start 2023-08-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x5611435179c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143510f50 0x561143514bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143511870 0x561143515310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56114345c7a0 con 0x56114350b800 2023-08-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611433fbac0 con 0x561143511870 2023-08-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611433fb7c0 con 0x561143510f50 2023-08-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff22dee9b80 10 client.0 _ll_register_callbacks cb 0x5611433f9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff213fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x5611435179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff213fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x5611435179c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37376/0 (socket says 172.21.15.107:37376) 2023-08-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff213fff700 1 -- 172.21.15.107:0/3227072503 learned_addr learned my addr 172.21.15.107:0/3227072503 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff2137fe700 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143510f50 0x561143514bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff2137fe700 1 -- 172.21.15.107:0/3227072503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143511870 msgr2=0x561143515310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff2137fe700 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143511870 0x561143515310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff2137fe700 1 -- 172.21.15.107:0/3227072503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 msgr2=0x5611435179c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.227+0000 7ff2137fe700 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x5611435179c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.228+0000 7ff2137fe700 1 -- 172.21.15.107:0/3227072503 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c00e730 con 0x561143510f50 2023-08-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.228+0000 7ff213fff700 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x5611435179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.228+0000 7ff2137fe700 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143510f50 0x561143514bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff214199f80 tx=0x7ff208005730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8b0e9c0aac4c38d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.228+0000 7ff1f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.228+0000 7ff1f37fe700 1 -- 172.21.15.107:0/3227072503 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20801d070 con 0x561143510f50 2023-08-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.228+0000 7ff22dee9b80 1 -- 172.21.15.107:0/3227072503 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611434fe470 con 0x561143510f50 2023-08-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.228+0000 7ff1f37fe700 1 -- 172.21.15.107:0/3227072503 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff208004500 con 0x561143510f50 2023-08-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff1f37fe700 1 -- 172.21.15.107:0/3227072503 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2080046c0 con 0x561143510f50 2023-08-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff22dee9b80 10 client.25819 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff22dee9b80 1 -- 172.21.15.107:0/3227072503 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x561143289de0 con 0x561143510f50 2023-08-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff1f37fe700 1 -- 172.21.15.107:0/3227072503 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5611434fe470 con 0x561143510f50 2023-08-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff1f37fe700 1 -- 172.21.15.107:0/3227072503 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff2080247b0 con 0x561143510f50 2023-08-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff22dee9b80 10 client.25819 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff22dee9b80 10 client.25819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff22dee9b80 20 client.25819 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56114352db00 0x56114352ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff22dee9b80 4 client.25819 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.229+0000 7ff22dee9b80 1 -- 172.21.15.107:0/3227072503 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611434da9d0 con 0x56114352db00 2023-08-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.230+0000 7ff213fff700 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56114352db00 0x56114352ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.230+0000 7ff213fff700 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56114352db00 0x56114352ff20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56b0d9488e5047fa server_cookie=976269631e628671 in_seq=0 out_seq=0 2023-08-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.230+0000 7ff1f37fe700 10 client.25819 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff1f37fe700 1 -- 172.21.15.107:0/3227072503 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5611434da9d0 con 0x56114352db00 2023-08-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff1f37fe700 10 client.25819 handle_command_reply: tid=0 2023-08-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 client.25819 shutdown 2023-08-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 -- 172.21.15.107:0/3227072503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143510f50 msgr2=0x561143514bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143510f50 0x561143514bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff214199f80 tx=0x7ff208005730 comp rx=0 tx=0).stop 2023-08-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 -- 172.21.15.107:0/3227072503 shutdown_connections 2023-08-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56114352db00 0x56114352ff20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143511870 0x561143515310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff1f37fe700 0 client.25819 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56114350b800 0x5611435179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/3227072503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561143510f50 0x561143514bd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 -- 172.21.15.107:0/3227072503 >> 172.21.15.107:0/3227072503 conn(0x561143468cd0 msgr2=0x5611435059b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.231+0000 7ff22dee9b80 1 -- 172.21.15.107:0/3227072503 shutdown_connections 2023-08-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.232+0000 7ff22dee9b80 1 -- 172.21.15.107:0/3227072503 wait complete. 2023-08-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.232+0000 7ff22dee9b80 20 client.25819 trim_cache size 0 max 16384 2023-08-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.255+0000 7ff22dee9b80 1 Processor -- start 2023-08-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.255+0000 7ff22dee9b80 1 -- start start 2023-08-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x56114350b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143510570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 0x561143524ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611432df920 con 0x561143511870 2023-08-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143507160 con 0x561143510f50 2023-08-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143510b60 con 0x56114350b800 2023-08-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff2137fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143510570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff218b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 0x561143524ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff2137fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143510570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:54728/0 (socket says 172.21.15.107:54728) 2023-08-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.256+0000 7ff2137fe700 1 -- 172.21.15.107:0/138273876 learned_addr learned my addr 172.21.15.107:0/138273876 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.257+0000 7ff213fff700 1 --2- 172.21.15.107:0/138273876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x56114350b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.257+0000 7ff2137fe700 1 -- 172.21.15.107:0/138273876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 msgr2=0x56114350b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.257+0000 7ff2137fe700 1 --2- 172.21.15.107:0/138273876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x56114350b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.257+0000 7ff2137fe700 1 -- 172.21.15.107:0/138273876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 msgr2=0x561143524ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.257+0000 7ff2137fe700 1 --2- 172.21.15.107:0/138273876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 0x561143524ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.257+0000 7ff2137fe700 1 -- 172.21.15.107:0/138273876 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561143272c60 con 0x561143510f50 2023-08-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.257+0000 7ff2137fe700 1 --2- 172.21.15.107:0/138273876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143510570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff208009ce0 tx=0x7ff208005a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c83f8bd266ee803e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.257+0000 7ff1faffd700 1 -- 172.21.15.107:0/138273876 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20801d040 con 0x561143510f50 2023-08-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff1faffd700 1 -- 172.21.15.107:0/138273876 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff20803a070 con 0x561143510f50 2023-08-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff1faffd700 1 -- 172.21.15.107:0/138273876 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080227b0 con 0x561143510f50 2023-08-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff22dee9b80 1 -- 172.21.15.107:0/138273876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 msgr2=0x561143510570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/138273876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143510570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff208009ce0 tx=0x7ff208005a80 comp rx=0 tx=0).stop 2023-08-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff22dee9b80 1 -- 172.21.15.107:0/138273876 shutdown_connections 2023-08-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/138273876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 0x561143524ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/138273876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x56114350b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/138273876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143510570 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff22dee9b80 1 -- 172.21.15.107:0/138273876 >> 172.21.15.107:0/138273876 conn(0x561143468cd0 msgr2=0x561143511c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff22dee9b80 1 -- 172.21.15.107:0/138273876 shutdown_connections 2023-08-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.258+0000 7ff22dee9b80 1 -- 172.21.15.107:0/138273876 wait complete. 2023-08-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.259+0000 7ff22dee9b80 1 -- start start 2023-08-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.259+0000 7ff22dee9b80 1 Processor -- start 2023-08-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.259+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x561143579840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.259+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143579d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff22dee9b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 0x56114357a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143520430 con 0x561143511870 2023-08-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611435205a0 con 0x561143510f50 2023-08-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff22dee9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143520760 con 0x56114350b800 2023-08-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff22dee9b80 10 client.0 _ll_register_callbacks cb 0x5611433f9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff218b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 0x56114357a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff213fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x561143579840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff213fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x561143579840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:60388/0 (socket says 172.21.15.107:60388) 2023-08-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff218b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 0x56114357a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37402/0 (socket says 172.21.15.107:37402) 2023-08-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff213fff700 1 -- 172.21.15.107:0/2297985433 learned_addr learned my addr 172.21.15.107:0/2297985433 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff2137fe700 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143579d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff213fff700 1 -- 172.21.15.107:0/2297985433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 msgr2=0x561143579d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff213fff700 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143579d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff213fff700 1 -- 172.21.15.107:0/2297985433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 msgr2=0x56114357a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff213fff700 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 0x56114357a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.260+0000 7ff213fff700 1 -- 172.21.15.107:0/2297985433 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561143289de0 con 0x56114350b800 2023-08-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff213fff700 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x561143579840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff2040964d0 tx=0x7ff204099ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abc891b7ca8dc2f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff1f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff1f37fe700 1 -- 172.21.15.107:0/2297985433 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20409a430 con 0x56114350b800 2023-08-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2297985433 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff20c00f040 con 0x56114350b800 2023-08-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff1f37fe700 1 -- 172.21.15.107:0/2297985433 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff20409e000 con 0x56114350b800 2023-08-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff1f37fe700 1 -- 172.21.15.107:0/2297985433 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2040a2420 con 0x56114350b800 2023-08-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff22dee9b80 10 client.25825 fetch_fsmap learned FSMap version 29 2023-08-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2297985433 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5611432b0250 con 0x56114350b800 2023-08-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff1f37fe700 1 -- 172.21.15.107:0/2297985433 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2040ca020 con 0x56114350b800 2023-08-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff1f37fe700 1 -- 172.21.15.107:0/2297985433 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff2040994c0 con 0x56114350b800 2023-08-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.261+0000 7ff22dee9b80 10 client.25825 fetch_fsmap finished waiting for FSMap version 29 2023-08-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.262+0000 7ff22dee9b80 10 client.25825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.262+0000 7ff22dee9b80 20 client.25825 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.262+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561143521eb0 0x5611435242d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.262+0000 7ff22dee9b80 4 client.25825 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.262+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2297985433 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561143455780 con 0x561143521eb0 2023-08-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.262+0000 7ff2137fe700 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561143521eb0 0x5611435242d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff2137fe700 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561143521eb0 0x5611435242d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13a063323f1fd9e2 server_cookie=ebe4c008be67a00f in_seq=0 out_seq=0 2023-08-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff1f37fe700 10 client.25825 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff1f37fe700 1 -- 172.21.15.107:0/2297985433 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561143455780 con 0x561143521eb0 2023-08-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff1f37fe700 10 client.25825 handle_command_reply: tid=0 2023-08-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff22dee9b80 1 client.25825 shutdown 2023-08-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2297985433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 msgr2=0x561143579840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x561143579840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff2040964d0 tx=0x7ff204099ed0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2297985433 shutdown_connections 2023-08-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561143521eb0 0x5611435242d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561143511870 0x56114357a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56114350b800 0x561143579840 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff22dee9b80 1 --2- 172.21.15.107:0/2297985433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561143510f50 0x561143579d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff1f37fe700 0 client.25825 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.263+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2297985433 >> 172.21.15.107:0/2297985433 conn(0x561143468cd0 msgr2=0x5611435103e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.264+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2297985433 shutdown_connections 2023-08-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.264+0000 7ff22dee9b80 1 -- 172.21.15.107:0/2297985433 wait complete. 2023-08-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.264+0000 7ff22dee9b80 20 client.25825 trim_cache size 0 max 16384 2023-08-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi107.stdout: "08e6d52e-6114-49b2-a990-644ffbdec45a": { 2023-08-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "08e6d52e-6114-49b2-a990-644ffbdec45a", 2023-08-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.264+0000 7ff21a5ff700 1 -- 172.21.15.107:0/865209642 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1fc0a13e0 msgr2=0x7ff1fc0a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.264+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1fc0a13e0 0x7ff1fc0a38a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff20c004270 tx=0x7ff20c004630 comp rx=0 tx=0).stop 2023-08-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.264+0000 7ff21a5ff700 1 -- 172.21.15.107:0/865209642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2141018c0 msgr2=0x7ff214198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.264+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2141018c0 0x7ff214198970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e9f0 tx=0x7ff20400ed00 comp rx=0 tx=0).stop 2023-08-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.265+0000 7ff21a5ff700 1 -- 172.21.15.107:0/865209642 shutdown_connections 2023-08-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.265+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1fc0a13e0 0x7ff1fc0a38a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.265+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2141018c0 0x7ff214198970 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.265+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff21410ace0 0x7ff21419d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.265+0000 7ff21a5ff700 1 --2- 172.21.15.107:0/865209642 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2141021e0 0x7ff214198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.265+0000 7ff21a5ff700 1 -- 172.21.15.107:0/865209642 >> 172.21.15.107:0/865209642 conn(0x7ff2140fb0c0 msgr2=0x7ff2140fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.265+0000 7ff21a5ff700 1 -- 172.21.15.107:0/865209642 shutdown_connections 2023-08-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:11.265+0000 7ff21a5ff700 1 -- 172.21.15.107:0/865209642 wait complete. 2023-08-10T10:52:11.290 INFO:tasks.cephfs.filesystem:scrub status for tag:08e6d52e-6114-49b2-a990-644ffbdec45a - {'path': '/', 'tag': '08e6d52e-6114-49b2-a990-644ffbdec45a', 'options': 'recursive,force'} 2023-08-10T10:52:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: pgmap v32: 129 pgs: 129 active+clean; 466 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 50 op/s 2023-08-10T10:52:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:12.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:12.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:12.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:11 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: pgmap v32: 129 pgs: 129 active+clean; 466 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 50 op/s 2023-08-10T10:52:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:11 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: pgmap v32: 129 pgs: 129 active+clean; 466 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 50 op/s 2023-08-10T10:52:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:11 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:12.260 INFO:teuthology.orchestra.run.smithi107.stderr:2000000 of 50000000 tuples (4%) done (elapsed 30.44 s, remaining 730.52 s) 2023-08-10T10:52:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:12 smithi157 ceph-mon[129604]: scrub queued for path: / 2023-08-10T10:52:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:12 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:12 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:12 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:12 smithi107 ceph-mon[127953]: scrub queued for path: / 2023-08-10T10:52:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:12 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:12 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:12 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:13.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:12 smithi195 ceph-mon[129938]: scrub queued for path: / 2023-08-10T10:52:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:12 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:12 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:12 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:13.943 INFO:teuthology.orchestra.run.smithi107.stderr:2100000 of 50000000 tuples (4%) done (elapsed 32.12 s, remaining 732.67 s) 2023-08-10T10:52:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:13 smithi107 ceph-mon[127953]: pgmap v33: 129 pgs: 129 active+clean; 466 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:52:14.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:13 smithi195 ceph-mon[129938]: pgmap v33: 129 pgs: 129 active+clean; 466 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:52:14.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:13 smithi157 ceph-mon[129604]: pgmap v33: 129 pgs: 129 active+clean; 466 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:52:15.681 INFO:teuthology.orchestra.run.smithi107.stderr:2200000 of 50000000 tuples (4%) done (elapsed 33.86 s, remaining 735.65 s) 2023-08-10T10:52:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:15 smithi107 ceph-mon[127953]: pgmap v34: 129 pgs: 129 active+clean; 538 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 50 op/s 2023-08-10T10:52:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:15 smithi195 ceph-mon[129938]: pgmap v34: 129 pgs: 129 active+clean; 538 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 50 op/s 2023-08-10T10:52:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:15 smithi157 ceph-mon[129604]: pgmap v34: 129 pgs: 129 active+clean; 538 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 50 op/s 2023-08-10T10:52:16.906 INFO:teuthology.orchestra.run.smithi107.stderr:2300000 of 50000000 tuples (4%) done (elapsed 35.08 s, remaining 727.61 s) 2023-08-10T10:52:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:17 smithi107 ceph-mon[127953]: pgmap v35: 129 pgs: 129 active+clean; 538 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-08-10T10:52:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:17 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:17 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:17 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:17 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:18.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:17 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:17 smithi195 ceph-mon[129938]: pgmap v35: 129 pgs: 129 active+clean; 538 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-08-10T10:52:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:17 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:17 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:17 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:18.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:17 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:18.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:17 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:17 smithi157 ceph-mon[129604]: pgmap v35: 129 pgs: 129 active+clean; 538 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-08-10T10:52:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:17 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:17 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:17 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:17 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:17 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:18.624 INFO:teuthology.orchestra.run.smithi107.stderr:2400000 of 50000000 tuples (4%) done (elapsed 36.80 s, remaining 729.90 s) 2023-08-10T10:52:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:18 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:52:19.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:18 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:52:19.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:18 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:52:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:19 smithi107 ceph-mon[127953]: pgmap v36: 129 pgs: 129 active+clean; 586 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 MiB/s wr, 33 op/s 2023-08-10T10:52:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:19 smithi195 ceph-mon[129938]: pgmap v36: 129 pgs: 129 active+clean; 586 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 MiB/s wr, 33 op/s 2023-08-10T10:52:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:19 smithi157 ceph-mon[129604]: pgmap v36: 129 pgs: 129 active+clean; 586 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 MiB/s wr, 33 op/s 2023-08-10T10:52:20.302 INFO:teuthology.orchestra.run.smithi107.stderr:2500000 of 50000000 tuples (5%) done (elapsed 38.48 s, remaining 731.11 s) 2023-08-10T10:52:21.573 INFO:teuthology.orchestra.run.smithi107.stderr:2600000 of 50000000 tuples (5%) done (elapsed 39.75 s, remaining 724.68 s) 2023-08-10T10:52:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:21 smithi107 ceph-mon[127953]: pgmap v37: 129 pgs: 129 active+clean; 610 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-08-10T10:52:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:52:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:21 smithi195 ceph-mon[129938]: pgmap v37: 129 pgs: 129 active+clean; 610 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-08-10T10:52:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:52:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:21 smithi157 ceph-mon[129604]: pgmap v37: 129 pgs: 129 active+clean; 610 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-08-10T10:52:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:52:22.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:22.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:22 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:52:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:22 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:52:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:22 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:23.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:22 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:52:23.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:22 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:52:23.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:22 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:23.166 INFO:teuthology.orchestra.run.smithi107.stderr:2700000 of 50000000 tuples (5%) done (elapsed 41.34 s, remaining 724.28 s) 2023-08-10T10:52:23.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:22 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:52:23.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:22 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:52:23.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:22 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:52:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:23 smithi107 ceph-mon[127953]: pgmap v38: 129 pgs: 129 active+clean; 610 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-08-10T10:52:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:23 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:52:24.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:23 smithi195 ceph-mon[129938]: pgmap v38: 129 pgs: 129 active+clean; 610 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-08-10T10:52:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:23 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:52:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:23 smithi157 ceph-mon[129604]: pgmap v38: 129 pgs: 129 active+clean; 610 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-08-10T10:52:24.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:23 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:52:25.026 INFO:teuthology.orchestra.run.smithi107.stderr:2800000 of 50000000 tuples (5%) done (elapsed 43.20 s, remaining 728.29 s) 2023-08-10T10:52:25.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:24 smithi107 ceph-mon[127953]: pgmap v39: 129 pgs: 129 active+clean; 686 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 MiB/s wr, 37 op/s 2023-08-10T10:52:25.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:24 smithi195 ceph-mon[129938]: pgmap v39: 129 pgs: 129 active+clean; 686 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 MiB/s wr, 37 op/s 2023-08-10T10:52:25.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:24 smithi157 ceph-mon[129604]: pgmap v39: 129 pgs: 129 active+clean; 686 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 MiB/s wr, 37 op/s 2023-08-10T10:52:26.257 INFO:teuthology.orchestra.run.smithi107.stderr:2900000 of 50000000 tuples (5%) done (elapsed 44.43 s, remaining 721.67 s) 2023-08-10T10:52:27.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:27 smithi157 ceph-mon[129604]: pgmap v40: 129 pgs: 129 active+clean; 686 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:27.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:27 smithi107 ceph-mon[127953]: pgmap v40: 129 pgs: 129 active+clean; 686 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:27.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:27 smithi195 ceph-mon[129938]: pgmap v40: 129 pgs: 129 active+clean; 686 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:27.944 INFO:teuthology.orchestra.run.smithi107.stderr:3000000 of 50000000 tuples (6%) done (elapsed 46.12 s, remaining 722.57 s) 2023-08-10T10:52:29.192 INFO:teuthology.orchestra.run.smithi107.stderr:3100000 of 50000000 tuples (6%) done (elapsed 47.37 s, remaining 716.66 s) 2023-08-10T10:52:29.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:29 smithi195 ceph-mon[129938]: pgmap v41: 129 pgs: 129 active+clean; 738 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 34 op/s 2023-08-10T10:52:30.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:29 smithi157 ceph-mon[129604]: pgmap v41: 129 pgs: 129 active+clean; 738 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 34 op/s 2023-08-10T10:52:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:29 smithi107 ceph-mon[127953]: pgmap v41: 129 pgs: 129 active+clean; 738 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 34 op/s 2023-08-10T10:52:30.862 INFO:teuthology.orchestra.run.smithi107.stderr:3200000 of 50000000 tuples (6%) done (elapsed 49.04 s, remaining 717.20 s) 2023-08-10T10:52:31.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:31 smithi195 ceph-mon[129938]: pgmap v42: 129 pgs: 129 active+clean; 758 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-08-10T10:52:32.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:31 smithi157 ceph-mon[129604]: pgmap v42: 129 pgs: 129 active+clean; 758 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-08-10T10:52:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:31 smithi107 ceph-mon[127953]: pgmap v42: 129 pgs: 129 active+clean; 758 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-08-10T10:52:32.588 INFO:teuthology.orchestra.run.smithi107.stderr:3300000 of 50000000 tuples (6%) done (elapsed 50.77 s, remaining 718.41 s) 2023-08-10T10:52:33.735 INFO:teuthology.orchestra.run.smithi107.stderr:3400000 of 50000000 tuples (6%) done (elapsed 51.91 s, remaining 711.51 s) 2023-08-10T10:52:34.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:33 smithi157 ceph-mon[129604]: pgmap v43: 129 pgs: 129 active+clean; 758 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:33 smithi107 ceph-mon[127953]: pgmap v43: 129 pgs: 129 active+clean; 758 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:33 smithi195 ceph-mon[129938]: pgmap v43: 129 pgs: 129 active+clean; 758 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:35.426 INFO:teuthology.orchestra.run.smithi107.stderr:3500000 of 50000000 tuples (7%) done (elapsed 53.60 s, remaining 712.16 s) 2023-08-10T10:52:36.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:35 smithi157 ceph-mon[129604]: pgmap v44: 129 pgs: 129 active+clean; 835 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 MiB/s wr, 37 op/s 2023-08-10T10:52:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:35 smithi107 ceph-mon[127953]: pgmap v44: 129 pgs: 129 active+clean; 835 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 MiB/s wr, 37 op/s 2023-08-10T10:52:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:35 smithi195 ceph-mon[129938]: pgmap v44: 129 pgs: 129 active+clean; 835 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 MiB/s wr, 37 op/s 2023-08-10T10:52:37.099 INFO:teuthology.orchestra.run.smithi107.stderr:3600000 of 50000000 tuples (7%) done (elapsed 55.28 s, remaining 712.45 s) 2023-08-10T10:52:38.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:37 smithi157 ceph-mon[129604]: pgmap v45: 129 pgs: 129 active+clean; 835 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:37 smithi107 ceph-mon[127953]: pgmap v45: 129 pgs: 129 active+clean; 835 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:38.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:37 smithi195 ceph-mon[129938]: pgmap v45: 129 pgs: 129 active+clean; 835 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:38.316 INFO:teuthology.orchestra.run.smithi107.stderr:3700000 of 50000000 tuples (7%) done (elapsed 56.49 s, remaining 706.93 s) 2023-08-10T10:52:40.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:39 smithi157 ceph-mon[129604]: pgmap v46: 129 pgs: 129 active+clean; 883 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 MiB/s wr, 33 op/s 2023-08-10T10:52:40.039 INFO:teuthology.orchestra.run.smithi107.stderr:3800000 of 50000000 tuples (7%) done (elapsed 58.22 s, remaining 707.79 s) 2023-08-10T10:52:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:39 smithi107 ceph-mon[127953]: pgmap v46: 129 pgs: 129 active+clean; 883 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 MiB/s wr, 33 op/s 2023-08-10T10:52:40.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:39 smithi195 ceph-mon[129938]: pgmap v46: 129 pgs: 129 active+clean; 883 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 MiB/s wr, 33 op/s 2023-08-10T10:52:41.291 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:52:41.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.541+0000 7f72769ff700 1 -- 172.21.15.107:0/4146712004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7270102240 msgr2=0x7f727010a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.541+0000 7f72769ff700 1 --2- 172.21.15.107:0/4146712004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7270102240 0x7f727010a720 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7264009990 tx=0x7f7264009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.542+0000 7f72769ff700 1 -- 172.21.15.107:0/4146712004 shutdown_connections 2023-08-10T10:52:41.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.542+0000 7f72769ff700 1 --2- 172.21.15.107:0/4146712004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7270101920 0x7f7270101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.542+0000 7f72769ff700 1 --2- 172.21.15.107:0/4146712004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f727010acf0 0x7f727010d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.542+0000 7f72769ff700 1 --2- 172.21.15.107:0/4146712004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7270102240 0x7f727010a720 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.542+0000 7f72769ff700 1 -- 172.21.15.107:0/4146712004 >> 172.21.15.107:0/4146712004 conn(0x7f72700fb0c0 msgr2=0x7f72700fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.542+0000 7f72769ff700 1 -- 172.21.15.107:0/4146712004 shutdown_connections 2023-08-10T10:52:41.544 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.542+0000 7f72769ff700 1 -- 172.21.15.107:0/4146712004 wait complete. 2023-08-10T10:52:41.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.543+0000 7f72769ff700 1 Processor -- start 2023-08-10T10:52:41.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.543+0000 7f72769ff700 1 -- start start 2023-08-10T10:52:41.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.543+0000 7f72769ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7270101920 0x7f72700ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.543+0000 7f72769ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7270102240 0x7f72700ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.543+0000 7f72769ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f727010acf0 0x7f72701a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.543+0000 7f72769ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72701002e0 con 0x7f727010acf0 2023-08-10T10:52:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.543+0000 7f72769ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72701a4e90 con 0x7f7270101920 2023-08-10T10:52:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.543+0000 7f72769ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72701a4fd0 con 0x7f7270102240 2023-08-10T10:52:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f7274f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f727010acf0 0x7f72701a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7270101920 0x7f72700ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7270102240 0x7f72700ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7270101920 0x7f72700ff570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:33918/0 (socket says 172.21.15.107:33918) 2023-08-10T10:52:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f7274f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f727010acf0 0x7f72701a4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50934/0 (socket says 172.21.15.107:50934) 2023-08-10T10:52:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726ffff700 1 -- 172.21.15.107:0/1643185872 learned_addr learned my addr 172.21.15.107:0/1643185872 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7270102240 0x7f72700ffab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:51012/0 (socket says 172.21.15.107:51012) 2023-08-10T10:52:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726f7fe700 1 -- 172.21.15.107:0/1643185872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7270101920 msgr2=0x7f72700ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726f7fe700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7270101920 0x7f72700ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726f7fe700 1 -- 172.21.15.107:0/1643185872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f727010acf0 msgr2=0x7f72701a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726f7fe700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f727010acf0 0x7f72701a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726f7fe700 1 -- 172.21.15.107:0/1643185872 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72640095f0 con 0x7f7270102240 2023-08-10T10:52:41.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.544+0000 7f726f7fe700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7270102240 0x7f72700ffab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7264005910 tx=0x7f7264005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.545+0000 7f726d7fa700 1 -- 172.21.15.107:0/1643185872 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726401d070 con 0x7f7270102240 2023-08-10T10:52:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.545+0000 7f726d7fa700 1 -- 172.21.15.107:0/1643185872 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7264022470 con 0x7f7270102240 2023-08-10T10:52:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.545+0000 7f72769ff700 1 -- 172.21.15.107:0/1643185872 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72701a51d0 con 0x7f7270102240 2023-08-10T10:52:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.545+0000 7f726d7fa700 1 -- 172.21.15.107:0/1643185872 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264017650 con 0x7f7270102240 2023-08-10T10:52:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.545+0000 7f72769ff700 1 -- 172.21.15.107:0/1643185872 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72701a5650 con 0x7f7270102240 2023-08-10T10:52:41.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.549+0000 7f726d7fa700 1 -- 172.21.15.107:0/1643185872 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f72640225e0 con 0x7f7270102240 2023-08-10T10:52:41.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.550+0000 7f726d7fa700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f72580a13e0 0x7f72580a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.550+0000 7f728a357b80 1 Processor -- start 2023-08-10T10:52:41.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.550+0000 7f726d7fa700 1 -- 172.21.15.107:0/1643185872 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f72640ce5b0 con 0x7f7270102240 2023-08-10T10:52:41.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f728a357b80 1 -- start start 2023-08-10T10:52:41.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f726ffff700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f72580a13e0 0x7f72580a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f728a357b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 0x55d2cf369330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f728a357b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf369870 0x55d2cf3632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f728a357b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf363800 0x55d2cf363c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f728a357b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf2dedc0 con 0x55d2cf363800 2023-08-10T10:52:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f728a357b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf2bb590 con 0x55d2cf369870 2023-08-10T10:52:41.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f728a357b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf2b8eb0 con 0x55d2cf368f50 2023-08-10T10:52:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f7274f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf363800 0x55d2cf363c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f726ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 0x55d2cf369330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf369870 0x55d2cf3632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f7274f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf363800 0x55d2cf363c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50936/0 (socket says 172.21.15.107:50936) 2023-08-10T10:52:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f7274f9c700 1 -- 172.21.15.107:0/241012636 learned_addr learned my addr 172.21.15.107:0/241012636 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.551+0000 7f726ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 0x55d2cf369330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:51020/0 (socket says 172.21.15.107:51020) 2023-08-10T10:52:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.552+0000 7f726ffff700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f72580a13e0 0x7f72580a38a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7260009d30 tx=0x7f7260011720 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.552+0000 7f726f7fe700 1 -- 172.21.15.107:0/241012636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 msgr2=0x55d2cf369330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.552+0000 7f726f7fe700 1 --2- 172.21.15.107:0/241012636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 0x55d2cf369330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.552+0000 7f726f7fe700 1 -- 172.21.15.107:0/241012636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf363800 msgr2=0x55d2cf363c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.552+0000 7f726f7fe700 1 --2- 172.21.15.107:0/241012636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf363800 0x55d2cf363c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.552+0000 7f726f7fe700 1 -- 172.21.15.107:0/241012636 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2cf135630 con 0x55d2cf369870 2023-08-10T10:52:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.552+0000 7f726f7fe700 1 --2- 172.21.15.107:0/241012636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf369870 0x55d2cf3632c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f72640cb820 tx=0x7f726409b080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d01bd1fe649c34f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.553+0000 7f72567fc700 1 -- 172.21.15.107:0/241012636 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640aeea0 con 0x55d2cf369870 2023-08-10T10:52:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.553+0000 7f72567fc700 1 -- 172.21.15.107:0/241012636 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7264011110 con 0x55d2cf369870 2023-08-10T10:52:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.553+0000 7f72567fc700 1 -- 172.21.15.107:0/241012636 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640a35f0 con 0x55d2cf369870 2023-08-10T10:52:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.553+0000 7f728a357b80 1 -- 172.21.15.107:0/241012636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf369870 msgr2=0x55d2cf3632c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.553+0000 7f728a357b80 1 --2- 172.21.15.107:0/241012636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf369870 0x55d2cf3632c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f72640cb820 tx=0x7f726409b080 comp rx=0 tx=0).stop 2023-08-10T10:52:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.553+0000 7f728a357b80 1 -- 172.21.15.107:0/241012636 shutdown_connections 2023-08-10T10:52:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.554+0000 7f728a357b80 1 --2- 172.21.15.107:0/241012636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf363800 0x55d2cf363c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.554+0000 7f728a357b80 1 --2- 172.21.15.107:0/241012636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 0x55d2cf369330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.554+0000 7f728a357b80 1 --2- 172.21.15.107:0/241012636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf369870 0x55d2cf3632c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.554+0000 7f728a357b80 1 -- 172.21.15.107:0/241012636 >> 172.21.15.107:0/241012636 conn(0x55d2cf2c0cd0 msgr2=0x55d2cf35e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.554+0000 7f728a357b80 1 -- 172.21.15.107:0/241012636 shutdown_connections 2023-08-10T10:52:41.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.554+0000 7f728a357b80 1 -- 172.21.15.107:0/241012636 wait complete. 2023-08-10T10:52:41.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.554+0000 7f728a357b80 1 -- start start 2023-08-10T10:52:41.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.555+0000 7f728a357b80 1 Processor -- start 2023-08-10T10:52:41.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.555+0000 7f728a357b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf36f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.555+0000 7f728a357b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.555+0000 7f728a357b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 0x55d2cf36d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.555+0000 7f728a357b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf2b47a0 con 0x55d2cf368f50 2023-08-10T10:52:41.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.555+0000 7f728a357b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf253ac0 con 0x55d2cf363800 2023-08-10T10:52:41.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.555+0000 7f728a357b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf2537c0 con 0x55d2cf369870 2023-08-10T10:52:41.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.555+0000 7f728a357b80 10 client.0 _ll_register_callbacks cb 0x55d2cf251680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:41.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf36f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f7274f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 0x55d2cf36d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf36f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:33934/0 (socket says 172.21.15.107:33934) 2023-08-10T10:52:41.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726ffff700 1 -- 172.21.15.107:0/1979552670 learned_addr learned my addr 172.21.15.107:0/1979552670 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:41.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726ffff700 1 -- 172.21.15.107:0/1979552670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 msgr2=0x55d2cf36d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726ffff700 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 0x55d2cf36d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726ffff700 1 -- 172.21.15.107:0/1979552670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 msgr2=0x55d2cf36cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726ffff700 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726ffff700 1 -- 172.21.15.107:0/1979552670 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72701a5650 con 0x55d2cf363800 2023-08-10T10:52:41.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726f7fe700 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:41.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f7274f9c700 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 0x55d2cf36d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:41.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f726ffff700 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf36f8b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f726000faa0 tx=0x7f72600047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=760cf388405f004b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.556+0000 7f724f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:52:41.564 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.557+0000 7f724f7fe700 1 -- 172.21.15.107:0/1979552670 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726000fe70 con 0x55d2cf363800 2023-08-10T10:52:41.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.557+0000 7f728a357b80 1 -- 172.21.15.107:0/1979552670 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2cf356470 con 0x55d2cf363800 2023-08-10T10:52:41.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.557+0000 7f724f7fe700 1 -- 172.21.15.107:0/1979552670 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f726001eaf0 con 0x55d2cf363800 2023-08-10T10:52:41.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.557+0000 7f724f7fe700 1 -- 172.21.15.107:0/1979552670 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f726001ecb0 con 0x55d2cf363800 2023-08-10T10:52:41.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.557+0000 7f728a357b80 10 client.25823 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:41.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.557+0000 7f728a357b80 1 -- 172.21.15.107:0/1979552670 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d2cf0e1de0 con 0x55d2cf363800 2023-08-10T10:52:41.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.557+0000 7f724f7fe700 1 -- 172.21.15.107:0/1979552670 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d2cf356470 con 0x55d2cf363800 2023-08-10T10:52:41.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.558+0000 7f724f7fe700 1 -- 172.21.15.107:0/1979552670 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f7260005250 con 0x55d2cf363800 2023-08-10T10:52:41.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.558+0000 7f728a357b80 10 client.25823 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:41.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.558+0000 7f728a357b80 10 client.25823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:41.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.558+0000 7f728a357b80 20 client.25823 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:41.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.558+0000 7f728a357b80 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55d2cf37cfc0 0x55d2cf37f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.558+0000 7f728a357b80 4 client.25823 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:41.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.558+0000 7f728a357b80 1 -- 172.21.15.107:0/1979552670 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2cf3329d0 con 0x55d2cf37cfc0 2023-08-10T10:52:41.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.558+0000 7f726f7fe700 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55d2cf37cfc0 0x55d2cf37f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.559+0000 7f724f7fe700 10 client.25823 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:41.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.559+0000 7f726f7fe700 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55d2cf37cfc0 0x55d2cf37f3e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1185bb2a7faa289 server_cookie=e2304378947de47b in_seq=0 out_seq=0 2023-08-10T10:52:41.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.559+0000 7f724f7fe700 1 -- 172.21.15.107:0/1979552670 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d2cf3329d0 con 0x55d2cf37cfc0 2023-08-10T10:52:41.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.559+0000 7f724f7fe700 10 client.25823 handle_command_reply: tid=0 2023-08-10T10:52:41.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 client.25823 shutdown 2023-08-10T10:52:41.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 -- 172.21.15.107:0/1979552670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 msgr2=0x55d2cf36f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf36f8b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f726000faa0 tx=0x7f72600047c0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 -- 172.21.15.107:0/1979552670 shutdown_connections 2023-08-10T10:52:41.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55d2cf37cfc0 0x55d2cf37f3e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf36f8b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 0x55d2cf36d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 --2- 172.21.15.107:0/1979552670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f724f7fe700 0 client.25823 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:41.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 -- 172.21.15.107:0/1979552670 >> 172.21.15.107:0/1979552670 conn(0x55d2cf2c0cd0 msgr2=0x55d2cf35d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 -- 172.21.15.107:0/1979552670 shutdown_connections 2023-08-10T10:52:41.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 1 -- 172.21.15.107:0/1979552670 wait complete. 2023-08-10T10:52:41.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.560+0000 7f728a357b80 20 client.25823 trim_cache size 0 max 16384 2023-08-10T10:52:41.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.584+0000 7f728a357b80 1 Processor -- start 2023-08-10T10:52:41.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.585+0000 7f728a357b80 1 -- start start 2023-08-10T10:52:41.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f728a357b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf3740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f728a357b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f728a357b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 0x55d2cf35e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f728a357b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf137920 con 0x55d2cf368f50 2023-08-10T10:52:41.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f728a357b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf3693a0 con 0x55d2cf363800 2023-08-10T10:52:41.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f728a357b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf367740 con 0x55d2cf369870 2023-08-10T10:52:41.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f726ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf3740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f726f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50960/0 (socket says 172.21.15.107:50960) 2023-08-10T10:52:41.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f726f7fe700 1 -- 172.21.15.107:0/3186342513 learned_addr learned my addr 172.21.15.107:0/3186342513 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:41.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.586+0000 7f7274f9c700 1 --2- 172.21.15.107:0/3186342513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 0x55d2cf35e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.587+0000 7f726f7fe700 1 -- 172.21.15.107:0/3186342513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 msgr2=0x55d2cf35e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.587+0000 7f726f7fe700 1 --2- 172.21.15.107:0/3186342513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 0x55d2cf35e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.587+0000 7f726f7fe700 1 -- 172.21.15.107:0/3186342513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 msgr2=0x55d2cf3740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.587+0000 7f726f7fe700 1 --2- 172.21.15.107:0/3186342513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf3740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.587+0000 7f726f7fe700 1 -- 172.21.15.107:0/3186342513 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2cf0cac60 con 0x55d2cf368f50 2023-08-10T10:52:41.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.587+0000 7f726ffff700 1 --2- 172.21.15.107:0/3186342513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf3740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:41.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.587+0000 7f726f7fe700 1 --2- 172.21.15.107:0/3186342513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36f3e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7264005f50 tx=0x7f72640a1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143c950a59c7caf2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.588+0000 7f7256ffd700 1 -- 172.21.15.107:0/3186342513 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640b7070 con 0x55d2cf368f50 2023-08-10T10:52:41.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.588+0000 7f7256ffd700 1 -- 172.21.15.107:0/3186342513 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f726409b230 con 0x55d2cf368f50 2023-08-10T10:52:41.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.588+0000 7f7256ffd700 1 -- 172.21.15.107:0/3186342513 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640aeea0 con 0x55d2cf368f50 2023-08-10T10:52:41.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.589+0000 7f728a357b80 1 -- 172.21.15.107:0/3186342513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 msgr2=0x55d2cf36f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.589+0000 7f728a357b80 1 --2- 172.21.15.107:0/3186342513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36f3e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7264005f50 tx=0x7f72640a1040 comp rx=0 tx=0).stop 2023-08-10T10:52:41.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.589+0000 7f728a357b80 1 -- 172.21.15.107:0/3186342513 shutdown_connections 2023-08-10T10:52:41.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.589+0000 7f728a357b80 1 --2- 172.21.15.107:0/3186342513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf3740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.589+0000 7f728a357b80 1 --2- 172.21.15.107:0/3186342513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf369870 0x55d2cf35e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.589+0000 7f728a357b80 1 --2- 172.21.15.107:0/3186342513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf368f50 0x55d2cf36f3e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.589+0000 7f728a357b80 1 -- 172.21.15.107:0/3186342513 >> 172.21.15.107:0/3186342513 conn(0x55d2cf2c0cd0 msgr2=0x55d2cf36a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.589+0000 7f728a357b80 1 -- 172.21.15.107:0/3186342513 shutdown_connections 2023-08-10T10:52:41.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.589+0000 7f728a357b80 1 -- 172.21.15.107:0/3186342513 wait complete. 2023-08-10T10:52:41.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.590+0000 7f728a357b80 1 -- start start 2023-08-10T10:52:41.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.590+0000 7f728a357b80 1 Processor -- start 2023-08-10T10:52:41.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.590+0000 7f728a357b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf366250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.590+0000 7f728a357b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 0x55d2cf364a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.590+0000 7f728a357b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf369870 0x55d2cf364f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.590+0000 7f728a357b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf365520 con 0x55d2cf369870 2023-08-10T10:52:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.590+0000 7f728a357b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf365690 con 0x55d2cf363800 2023-08-10T10:52:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.590+0000 7f728a357b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cf365850 con 0x55d2cf368f50 2023-08-10T10:52:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.591+0000 7f728a357b80 10 client.0 _ll_register_callbacks cb 0x55d2cf251680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.591+0000 7f726ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf366250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.591+0000 7f7274f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf369870 0x55d2cf364f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.591+0000 7f726ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf366250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:33960/0 (socket says 172.21.15.107:33960) 2023-08-10T10:52:41.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.591+0000 7f726ffff700 1 -- 172.21.15.107:0/3442509990 learned_addr learned my addr 172.21.15.107:0/3442509990 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:41.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.591+0000 7f726f7fe700 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 0x55d2cf364a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.591+0000 7f726ffff700 1 -- 172.21.15.107:0/3442509990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 msgr2=0x55d2cf364a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.591+0000 7f726ffff700 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 0x55d2cf364a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.592+0000 7f726ffff700 1 -- 172.21.15.107:0/3442509990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf369870 msgr2=0x55d2cf364f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:41.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.592+0000 7f726ffff700 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf369870 0x55d2cf364f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.592+0000 7f726ffff700 1 -- 172.21.15.107:0/3442509990 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2cf0e1de0 con 0x55d2cf363800 2023-08-10T10:52:41.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.592+0000 7f726ffff700 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf366250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72600058b0 tx=0x7f7260011cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e82eeb71201aaf7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.592+0000 7f724f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:52:41.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.592+0000 7f724f7fe700 1 -- 172.21.15.107:0/3442509990 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726001e730 con 0x55d2cf363800 2023-08-10T10:52:41.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.592+0000 7f728a357b80 1 -- 172.21.15.107:0/3442509990 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7264011110 con 0x55d2cf363800 2023-08-10T10:52:41.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.592+0000 7f724f7fe700 1 -- 172.21.15.107:0/3442509990 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f7260026600 con 0x55d2cf363800 2023-08-10T10:52:41.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.592+0000 7f724f7fe700 1 -- 172.21.15.107:0/3442509990 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72600267c0 con 0x55d2cf363800 2023-08-10T10:52:41.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f728a357b80 10 client.25829 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:41.598 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f728a357b80 1 -- 172.21.15.107:0/3442509990 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d2cf135630 con 0x55d2cf363800 2023-08-10T10:52:41.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f724f7fe700 1 -- 172.21.15.107:0/3442509990 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7264011110 con 0x55d2cf363800 2023-08-10T10:52:41.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f724f7fe700 1 -- 172.21.15.107:0/3442509990 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f7260034940 con 0x55d2cf363800 2023-08-10T10:52:41.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f728a357b80 10 client.25829 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:41.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f728a357b80 10 client.25829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:41.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f728a357b80 20 client.25829 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:41.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f728a357b80 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55d2cf3e3220 0x55d2cf3e5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f728a357b80 4 client.25829 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:52:41.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.593+0000 7f728a357b80 1 -- 172.21.15.107:0/3442509990 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d2cf2ad780 con 0x55d2cf3e3220 2023-08-10T10:52:41.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.594+0000 7f726f7fe700 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55d2cf3e3220 0x55d2cf3e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.594+0000 7f726f7fe700 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55d2cf3e3220 0x55d2cf3e5640 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55a534094b6345b2 server_cookie=123ca2ddccdf0288 in_seq=0 out_seq=0 2023-08-10T10:52:41.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.594+0000 7f724f7fe700 10 client.25829 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:41.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f724f7fe700 1 -- 172.21.15.107:0/3442509990 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d2cf2ad780 con 0x55d2cf3e3220 2023-08-10T10:52:41.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f724f7fe700 10 client.25829 handle_command_reply: tid=0 2023-08-10T10:52:41.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 client.25829 shutdown 2023-08-10T10:52:41.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 -- 172.21.15.107:0/3442509990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 msgr2=0x55d2cf366250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf366250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72600058b0 tx=0x7f7260011cd0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 -- 172.21.15.107:0/3442509990 shutdown_connections 2023-08-10T10:52:41.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55d2cf3e3220 0x55d2cf3e5640 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d2cf363800 0x55d2cf366250 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2cf369870 0x55d2cf364f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 --2- 172.21.15.107:0/3442509990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2cf368f50 0x55d2cf364a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f724f7fe700 0 client.25829 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:41.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 -- 172.21.15.107:0/3442509990 >> 172.21.15.107:0/3442509990 conn(0x55d2cf2c0cd0 msgr2=0x55d2cf367b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 -- 172.21.15.107:0/3442509990 shutdown_connections 2023-08-10T10:52:41.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 1 -- 172.21.15.107:0/3442509990 wait complete. 2023-08-10T10:52:41.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.595+0000 7f728a357b80 20 client.25829 trim_cache size 0 max 16384 2023-08-10T10:52:41.603 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:52:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "no active scrubs running", 2023-08-10T10:52:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": {} 2023-08-10T10:52:41.604 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:52:41.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 -- 172.21.15.107:0/1643185872 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f72580a13e0 msgr2=0x7f72580a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f72580a13e0 0x7f72580a38a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7260009d30 tx=0x7f7260011720 comp rx=0 tx=0).stop 2023-08-10T10:52:41.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 -- 172.21.15.107:0/1643185872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7270102240 msgr2=0x7f72700ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7270102240 0x7f72700ffab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7264005910 tx=0x7f7264005740 comp rx=0 tx=0).stop 2023-08-10T10:52:41.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 -- 172.21.15.107:0/1643185872 shutdown_connections 2023-08-10T10:52:41.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f72580a13e0 0x7f72580a38a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7270101920 0x7f72700ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f727010acf0 0x7f72701a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 --2- 172.21.15.107:0/1643185872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7270102240 0x7f72700ffab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 -- 172.21.15.107:0/1643185872 >> 172.21.15.107:0/1643185872 conn(0x7f72700fb0c0 msgr2=0x7f72700fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 -- 172.21.15.107:0/1643185872 shutdown_connections 2023-08-10T10:52:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.596+0000 7f72769ff700 1 -- 172.21.15.107:0/1643185872 wait complete. 2023-08-10T10:52:41.621 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-10T10:52:41.622 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:52:41.833 INFO:teuthology.orchestra.run.smithi107.stderr:3900000 of 50000000 tuples (7%) done (elapsed 60.01 s, remaining 709.36 s) 2023-08-10T10:52:41.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.848+0000 7f63f8bff700 1 -- 172.21.15.107:0/832400434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63f41066f0 msgr2=0x7f63f4106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.848+0000 7f63f8bff700 1 --2- 172.21.15.107:0/832400434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63f41066f0 0x7f63f4106ad0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009990 tx=0x7f63e4009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.849+0000 7f63f8bff700 1 -- 172.21.15.107:0/832400434 shutdown_connections 2023-08-10T10:52:41.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.849+0000 7f63f8bff700 1 --2- 172.21.15.107:0/832400434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63f41010a0 0x7f63f410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.850 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.849+0000 7f63f8bff700 1 --2- 172.21.15.107:0/832400434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63f41066f0 0x7f63f4106ad0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.849+0000 7f63f8bff700 1 --2- 172.21.15.107:0/832400434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63f41006e0 0x7f63f4100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.849+0000 7f63f8bff700 1 -- 172.21.15.107:0/832400434 >> 172.21.15.107:0/832400434 conn(0x7f63f40fc190 msgr2=0x7f63f40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:41.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.849+0000 7f63f8bff700 1 -- 172.21.15.107:0/832400434 shutdown_connections 2023-08-10T10:52:41.851 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.849+0000 7f63f8bff700 1 -- 172.21.15.107:0/832400434 wait complete. 2023-08-10T10:52:41.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.850+0000 7f63f8bff700 1 Processor -- start 2023-08-10T10:52:41.852 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.850+0000 7f63f8bff700 1 -- start start 2023-08-10T10:52:41.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.850+0000 7f63f8bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63f41006e0 0x7f63f419e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.850+0000 7f63f8bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63f41010a0 0x7f63f419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.850+0000 7f63f8bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63f41066f0 0x7f63f4198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f8bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4198cf0 con 0x7f63f41010a0 2023-08-10T10:52:41.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f8bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4198e60 con 0x7f63f41066f0 2023-08-10T10:52:41.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f8bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4199020 con 0x7f63f41006e0 2023-08-10T10:52:41.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63f41010a0 0x7f63f419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.853 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63f41006e0 0x7f63f419e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63f41006e0 0x7f63f419e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:51048/0 (socket says 172.21.15.107:51048) 2023-08-10T10:52:41.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f259c700 1 -- 172.21.15.107:0/3900253246 learned_addr learned my addr 172.21.15.107:0/3900253246 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:41.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f2d9d700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63f41066f0 0x7f63f4198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f259c700 1 -- 172.21.15.107:0/3900253246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63f41066f0 msgr2=0x7f63f4198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f259c700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63f41066f0 0x7f63f4198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f259c700 1 -- 172.21.15.107:0/3900253246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63f41010a0 msgr2=0x7f63f419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:41.854 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f259c700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63f41010a0 0x7f63f419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:41.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.851+0000 7f63f259c700 1 -- 172.21.15.107:0/3900253246 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e40095f0 con 0x7f63f41006e0 2023-08-10T10:52:41.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.852+0000 7f63f259c700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63f41006e0 0x7f63f419e610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f63e4005770 tx=0x7f63e40057a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.855 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.852+0000 7f63e37fe700 1 -- 172.21.15.107:0/3900253246 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e401d070 con 0x7f63f41006e0 2023-08-10T10:52:41.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.852+0000 7f63e37fe700 1 -- 172.21.15.107:0/3900253246 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63e4021410 con 0x7f63f41006e0 2023-08-10T10:52:41.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.852+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f4199300 con 0x7f63f41006e0 2023-08-10T10:52:41.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.852+0000 7f63e37fe700 1 -- 172.21.15.107:0/3900253246 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4017650 con 0x7f63f41006e0 2023-08-10T10:52:41.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.852+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f41a5600 con 0x7f63f41006e0 2023-08-10T10:52:41.856 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.853+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f4067560 con 0x7f63f41006e0 2023-08-10T10:52:41.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.855+0000 7f63e37fe700 1 -- 172.21.15.107:0/3900253246 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f63e40217f0 con 0x7f63f41006e0 2023-08-10T10:52:41.857 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.857+0000 7f63e37fe700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63dc0a1430 0x7f63dc0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:41.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.857+0000 7f63e37fe700 1 -- 172.21.15.107:0/3900253246 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f63e40ce7f0 con 0x7f63f41006e0 2023-08-10T10:52:41.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.857+0000 7f63f1d9b700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63dc0a1430 0x7f63dc0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:41.858 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.858+0000 7f63f1d9b700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63dc0a1430 0x7f63dc0a38f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63f4105cb0 tx=0x7f63e8009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:41.860 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:41.859+0000 7f63e37fe700 1 -- 172.21.15.107:0/3900253246 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f63e40976e0 con 0x7f63f41006e0 2023-08-10T10:52:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:41 smithi157 ceph-mon[129604]: pgmap v47: 129 pgs: 129 active+clean; 911 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 29 op/s 2023-08-10T10:52:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:41 smithi107 ceph-mon[127953]: pgmap v47: 129 pgs: 129 active+clean; 911 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 29 op/s 2023-08-10T10:52:42.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.154+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63f4199b90 con 0x7f63f41006e0 2023-08-10T10:52:42.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.155+0000 7f63e37fe700 1 -- 172.21.15.107:0/3900253246 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+10926 (secure 0 0 0) 0x7f63e409ad00 con 0x7f63f41006e0 2023-08-10T10:52:42.156 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:52:42.156 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:52:23.320134+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:52:42.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63dc0a1430 msgr2=0x7f63dc0a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63dc0a1430 0x7f63dc0a38f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63f4105cb0 tx=0x7f63e8009260 comp rx=0 tx=0).stop 2023-08-10T10:52:42.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63f41006e0 msgr2=0x7f63f419e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63f41006e0 0x7f63f419e610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f63e4005770 tx=0x7f63e40057a0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 shutdown_connections 2023-08-10T10:52:42.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f63dc0a1430 0x7f63dc0a38f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63f41066f0 0x7f63f4198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63f41006e0 0x7f63f419e610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 --2- 172.21.15.107:0/3900253246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63f41010a0 0x7f63f419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.157+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 >> 172.21.15.107:0/3900253246 conn(0x7f63f40fc190 msgr2=0x7f63f410baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.158+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 shutdown_connections 2023-08-10T10:52:42.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.158+0000 7f63f8bff700 1 -- 172.21.15.107:0/3900253246 wait complete. 2023-08-10T10:52:42.160 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 31 2023-08-10T10:52:42.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:41 smithi195 ceph-mon[129938]: pgmap v47: 129 pgs: 129 active+clean; 911 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 29 op/s 2023-08-10T10:52:42.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-10T10:52:42.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.404+0000 7fae7f59e700 1 -- 172.21.15.107:0/2244879024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae80106660 msgr2=0x7fae80106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.404+0000 7fae7f59e700 1 --2- 172.21.15.107:0/2244879024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae80106660 0x7fae80106a40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fae700099c0 tx=0x7fae70009cd0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.404+0000 7fae7f59e700 1 -- 172.21.15.107:0/2244879024 shutdown_connections 2023-08-10T10:52:42.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.404+0000 7fae7f59e700 1 --2- 172.21.15.107:0/2244879024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae80068290 0x7fae8010d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.404+0000 7fae7f59e700 1 --2- 172.21.15.107:0/2244879024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae80106660 0x7fae80106a40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.404+0000 7fae7f59e700 1 --2- 172.21.15.107:0/2244879024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae800678d0 0x7fae80067d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.404+0000 7fae7f59e700 1 -- 172.21.15.107:0/2244879024 >> 172.21.15.107:0/2244879024 conn(0x7fae80074f30 msgr2=0x7fae80075340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.404+0000 7fae7f59e700 1 -- 172.21.15.107:0/2244879024 shutdown_connections 2023-08-10T10:52:42.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.404+0000 7fae7f59e700 1 -- 172.21.15.107:0/2244879024 wait complete. 2023-08-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.406+0000 7fae7f59e700 1 Processor -- start 2023-08-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.406+0000 7fae7f59e700 1 -- start start 2023-08-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.406+0000 7fae7f59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae800678d0 0x7fae800ff780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.406+0000 7fae7f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae80068290 0x7fae800ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.406+0000 7fae7f59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae80106660 0x7fae801a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.406+0000 7fae7f59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae801004f0 con 0x7fae800678d0 2023-08-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.406+0000 7fae7f59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae801a4b60 con 0x7fae80106660 2023-08-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.406+0000 7fae7f59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae801a4ca0 con 0x7fae80068290 2023-08-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae800678d0 0x7fae800ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae800678d0 0x7fae800ff780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51000/0 (socket says 172.21.15.107:51000) 2023-08-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7e59c700 1 -- 172.21.15.107:0/4094678340 learned_addr learned my addr 172.21.15.107:0/4094678340 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae80106660 0x7fae801a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7dd9b700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae80068290 0x7fae800ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7e59c700 1 -- 172.21.15.107:0/4094678340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae80068290 msgr2=0x7fae800ffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7e59c700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae80068290 0x7fae800ffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7e59c700 1 -- 172.21.15.107:0/4094678340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae80106660 msgr2=0x7fae801a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7e59c700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae80106660 0x7fae801a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7e59c700 1 -- 172.21.15.107:0/4094678340 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700095f0 con 0x7fae800678d0 2023-08-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae80106660 0x7fae801a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.407+0000 7fae7e59c700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae800678d0 0x7fae800ff780 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fae70000c00 tx=0x7fae70005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.408+0000 7fae6f7fe700 1 -- 172.21.15.107:0/4094678340 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7001d070 con 0x7fae800678d0 2023-08-10T10:52:42.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.408+0000 7fae6f7fe700 1 -- 172.21.15.107:0/4094678340 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae70022470 con 0x7fae800678d0 2023-08-10T10:52:42.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.408+0000 7fae7f59e700 1 -- 172.21.15.107:0/4094678340 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae801a4ea0 con 0x7fae800678d0 2023-08-10T10:52:42.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.408+0000 7fae6f7fe700 1 -- 172.21.15.107:0/4094678340 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70017650 con 0x7fae800678d0 2023-08-10T10:52:42.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.408+0000 7fae7f59e700 1 -- 172.21.15.107:0/4094678340 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae801a5260 con 0x7fae800678d0 2023-08-10T10:52:42.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.411+0000 7fae6f7fe700 1 -- 172.21.15.107:0/4094678340 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fae700225e0 con 0x7fae800678d0 2023-08-10T10:52:42.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.413+0000 7fae9871cb80 1 Processor -- start 2023-08-10T10:52:42.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.413+0000 7fae6f7fe700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fae680a1480 0x7fae680a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.413+0000 7fae9871cb80 1 -- start start 2023-08-10T10:52:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.413+0000 7fae6f7fe700 1 -- 172.21.15.107:0/4094678340 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fae700ce380 con 0x7fae800678d0 2023-08-10T10:52:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.413+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fae680a1480 0x7fae680a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8ead0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 0x562d8ead56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae9871cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8ea4bdc0 con 0x562d8ead0dd0 2023-08-10T10:52:42.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae9871cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8ea28590 con 0x562d8ead5290 2023-08-10T10:52:42.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae9871cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8ea25eb0 con 0x562d8ead04b0 2023-08-10T10:52:42.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8ead0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8ead0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:51082/0 (socket says 172.21.15.107:51082) 2023-08-10T10:52:42.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51016/0 (socket says 172.21.15.107:51016) 2023-08-10T10:52:42.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7e59c700 1 -- 172.21.15.107:0/1164629237 learned_addr learned my addr 172.21.15.107:0/1164629237 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fae680a1480 0x7fae680a3940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae80101890 tx=0x7fae78009040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/1164629237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 0x562d8ead56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7e59c700 1 -- 172.21.15.107:0/1164629237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 msgr2=0x562d8ead56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7e59c700 1 --2- 172.21.15.107:0/1164629237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 0x562d8ead56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7e59c700 1 -- 172.21.15.107:0/1164629237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 msgr2=0x562d8ead4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7e59c700 1 --2- 172.21.15.107:0/1164629237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.414+0000 7fae7e59c700 1 -- 172.21.15.107:0/1164629237 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d8e8a2630 con 0x562d8ead04b0 2023-08-10T10:52:42.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.415+0000 7fae7e59c700 1 --2- 172.21.15.107:0/1164629237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8ead0890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae7009ac90 tx=0x7fae7009aba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28d6ad23a8a7e3f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.415+0000 7fae6cff9700 1 -- 172.21.15.107:0/1164629237 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7009efc0 con 0x562d8ead04b0 2023-08-10T10:52:42.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.415+0000 7fae6cff9700 1 -- 172.21.15.107:0/1164629237 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae700a3350 con 0x562d8ead04b0 2023-08-10T10:52:42.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.415+0000 7fae6cff9700 1 -- 172.21.15.107:0/1164629237 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7009a480 con 0x562d8ead04b0 2023-08-10T10:52:42.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 -- 172.21.15.107:0/1164629237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 msgr2=0x562d8ead0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 --2- 172.21.15.107:0/1164629237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8ead0890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae7009ac90 tx=0x7fae7009aba0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 -- 172.21.15.107:0/1164629237 shutdown_connections 2023-08-10T10:52:42.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 --2- 172.21.15.107:0/1164629237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 0x562d8ead56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 --2- 172.21.15.107:0/1164629237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8ead0890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 --2- 172.21.15.107:0/1164629237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 -- 172.21.15.107:0/1164629237 >> 172.21.15.107:0/1164629237 conn(0x562d8ea2dcd0 msgr2=0x562d8eacb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 -- 172.21.15.107:0/1164629237 shutdown_connections 2023-08-10T10:52:42.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 -- 172.21.15.107:0/1164629237 wait complete. 2023-08-10T10:52:42.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.416+0000 7fae9871cb80 1 -- start start 2023-08-10T10:52:42.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.417+0000 7fae9871cb80 1 Processor -- start 2023-08-10T10:52:42.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.417+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead04b0 0x562d8eadcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.417+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.417+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead5290 0x562d8eada410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.417+0000 7fae9871cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8ea217a0 con 0x562d8ead0dd0 2023-08-10T10:52:42.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.417+0000 7fae9871cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8e9c0ac0 con 0x562d8ead04b0 2023-08-10T10:52:42.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.417+0000 7fae9871cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8e9c07c0 con 0x562d8ead5290 2023-08-10T10:52:42.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae9871cb80 10 client.0 _ll_register_callbacks cb 0x562d8e9be680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:42.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51028/0 (socket says 172.21.15.107:51028) 2023-08-10T10:52:42.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7dd9b700 1 -- 172.21.15.107:0/2802654047 learned_addr learned my addr 172.21.15.107:0/2802654047 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead5290 0x562d8eada410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7e59c700 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead04b0 0x562d8eadcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7ed9d700 1 -- 172.21.15.107:0/2802654047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead04b0 msgr2=0x562d8eadcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead04b0 0x562d8eadcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7ed9d700 1 -- 172.21.15.107:0/2802654047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 msgr2=0x562d8ead9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.418+0000 7fae7ed9d700 1 -- 172.21.15.107:0/2802654047 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae801a5260 con 0x562d8ead5290 2023-08-10T10:52:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.419+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead5290 0x562d8eada410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae78007e80 tx=0x7fae78004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54b227e7a5efb26 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.419+0000 7fae65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:52:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.419+0000 7fae65ffb700 1 -- 172.21.15.107:0/2802654047 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78003a00 con 0x562d8ead5290 2023-08-10T10:52:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.419+0000 7fae9871cb80 1 -- 172.21.15.107:0/2802654047 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d8eac3470 con 0x562d8ead5290 2023-08-10T10:52:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.419+0000 7fae65ffb700 1 -- 172.21.15.107:0/2802654047 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fae78003b60 con 0x562d8ead5290 2023-08-10T10:52:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.419+0000 7fae65ffb700 1 -- 172.21.15.107:0/2802654047 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae78003d20 con 0x562d8ead5290 2023-08-10T10:52:42.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.419+0000 7fae9871cb80 10 client.25861 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.419+0000 7fae9871cb80 1 -- 172.21.15.107:0/2802654047 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x562d8e84ede0 con 0x562d8ead5290 2023-08-10T10:52:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.419+0000 7fae65ffb700 1 -- 172.21.15.107:0/2802654047 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562d8eac3470 con 0x562d8ead5290 2023-08-10T10:52:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.420+0000 7fae65ffb700 1 -- 172.21.15.107:0/2802654047 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fae78004150 con 0x562d8ead5290 2023-08-10T10:52:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.420+0000 7fae9871cb80 10 client.25861 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.420+0000 7fae9871cb80 10 client.25861 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-08-10T10:52:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.420+0000 7fae9871cb80 20 client.25861 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:42.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.420+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x562d8eaf2940 0x562d8eaf4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.420+0000 7fae9871cb80 4 client.25861 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.420+0000 7fae9871cb80 1 -- 172.21.15.107:0/2802654047 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d8ea9f9d0 con 0x562d8eaf2940 2023-08-10T10:52:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.420+0000 7fae7e59c700 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x562d8eaf2940 0x562d8eaf4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.421+0000 7fae65ffb700 10 client.25861 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:52:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.421+0000 7fae7e59c700 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x562d8eaf2940 0x562d8eaf4d60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8cf47f3cdbcb5ac3 server_cookie=6ebf75b0fc935202 in_seq=0 out_seq=0 2023-08-10T10:52:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae65ffb700 1 -- 172.21.15.107:0/2802654047 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562d8ea9f9d0 con 0x562d8eaf2940 2023-08-10T10:52:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae65ffb700 10 client.25861 handle_command_reply: tid=0 2023-08-10T10:52:42.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 client.25861 shutdown 2023-08-10T10:52:42.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 -- 172.21.15.107:0/2802654047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead5290 msgr2=0x562d8eada410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead5290 0x562d8eada410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae78007e80 tx=0x7fae78004b40 comp rx=0 tx=0).stop 2023-08-10T10:52:42.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 -- 172.21.15.107:0/2802654047 shutdown_connections 2023-08-10T10:52:42.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x562d8eaf2940 0x562d8eaf4d60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead04b0 0x562d8eadcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead5290 0x562d8eada410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2802654047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead0dd0 0x562d8ead9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae65ffb700 0 client.25861 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:52:42.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 -- 172.21.15.107:0/2802654047 >> 172.21.15.107:0/2802654047 conn(0x562d8ea2dcd0 msgr2=0x562d8eaca980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 -- 172.21.15.107:0/2802654047 shutdown_connections 2023-08-10T10:52:42.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 1 -- 172.21.15.107:0/2802654047 wait complete. 2023-08-10T10:52:42.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.422+0000 7fae9871cb80 20 client.25861 trim_cache size 0 max 16384 2023-08-10T10:52:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.437+0000 7fae9871cb80 1 Processor -- start 2023-08-10T10:52:42.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.437+0000 7fae9871cb80 1 -- start start 2023-08-10T10:52:42.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.437+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead04b0 0x562d8eada370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.437+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead0dd0 0x562d8eaeec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.437+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 0x562d8eadc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.437+0000 7fae9871cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8e8a4920 con 0x562d8ead04b0 2023-08-10T10:52:42.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.437+0000 7fae9871cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8eaccbc0 con 0x562d8ead5290 2023-08-10T10:52:42.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.437+0000 7fae9871cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8eaccd50 con 0x562d8ead0dd0 2023-08-10T10:52:42.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead04b0 0x562d8eada370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead04b0 0x562d8eada370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51034/0 (socket says 172.21.15.107:51034) 2023-08-10T10:52:42.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7e59c700 1 -- 172.21.15.107:0/4118514654 learned_addr learned my addr 172.21.15.107:0/4118514654 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7dd9b700 1 --2- 172.21.15.107:0/4118514654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead0dd0 0x562d8eaeec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/4118514654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 0x562d8eadc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7e59c700 1 -- 172.21.15.107:0/4118514654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead0dd0 msgr2=0x562d8eaeec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7e59c700 1 --2- 172.21.15.107:0/4118514654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead0dd0 0x562d8eaeec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7e59c700 1 -- 172.21.15.107:0/4118514654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 msgr2=0x562d8eadc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7e59c700 1 --2- 172.21.15.107:0/4118514654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 0x562d8eadc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7e59c700 1 -- 172.21.15.107:0/4118514654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d8e837c60 con 0x562d8ead04b0 2023-08-10T10:52:42.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.438+0000 7fae7e59c700 1 --2- 172.21.15.107:0/4118514654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead04b0 0x562d8eada370 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fae70097490 tx=0x7fae70009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc05f973688f612 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.439+0000 7fae6d7fa700 1 -- 172.21.15.107:0/4118514654 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700ce040 con 0x562d8ead04b0 2023-08-10T10:52:42.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.439+0000 7fae6d7fa700 1 -- 172.21.15.107:0/4118514654 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae700ce1a0 con 0x562d8ead04b0 2023-08-10T10:52:42.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.439+0000 7fae6d7fa700 1 -- 172.21.15.107:0/4118514654 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7009b1f0 con 0x562d8ead04b0 2023-08-10T10:52:42.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.439+0000 7fae9871cb80 1 -- 172.21.15.107:0/4118514654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead04b0 msgr2=0x562d8eada370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.439+0000 7fae9871cb80 1 --2- 172.21.15.107:0/4118514654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead04b0 0x562d8eada370 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fae70097490 tx=0x7fae70009310 comp rx=0 tx=0).stop 2023-08-10T10:52:42.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.440+0000 7fae9871cb80 1 -- 172.21.15.107:0/4118514654 shutdown_connections 2023-08-10T10:52:42.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.440+0000 7fae9871cb80 1 --2- 172.21.15.107:0/4118514654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead5290 0x562d8eadc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.440+0000 7fae9871cb80 1 --2- 172.21.15.107:0/4118514654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead04b0 0x562d8eada370 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.440+0000 7fae9871cb80 1 --2- 172.21.15.107:0/4118514654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead0dd0 0x562d8eaeec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.440+0000 7fae9871cb80 1 -- 172.21.15.107:0/4118514654 >> 172.21.15.107:0/4118514654 conn(0x562d8ea2dcd0 msgr2=0x562d8eac73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.440+0000 7fae9871cb80 1 -- 172.21.15.107:0/4118514654 shutdown_connections 2023-08-10T10:52:42.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.440+0000 7fae9871cb80 1 -- 172.21.15.107:0/4118514654 wait complete. 2023-08-10T10:52:42.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.440+0000 7fae9871cb80 1 -- start start 2023-08-10T10:52:42.444 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.440+0000 7fae9871cb80 1 Processor -- start 2023-08-10T10:52:42.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8eae8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead0dd0 0x562d8eae93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae9871cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead5290 0x562d8eb455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae9871cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8eae9ae0 con 0x562d8ead5290 2023-08-10T10:52:42.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae9871cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8eb45b30 con 0x562d8ead0dd0 2023-08-10T10:52:42.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae9871cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8eb45ca0 con 0x562d8ead04b0 2023-08-10T10:52:42.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae9871cb80 10 client.0 _ll_register_callbacks cb 0x562d8e9be680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:42.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae7ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead5290 0x562d8eb455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae7ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead5290 0x562d8eb455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51050/0 (socket says 172.21.15.107:51050) 2023-08-10T10:52:42.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae7ed9d700 1 -- 172.21.15.107:0/2219149326 learned_addr learned my addr 172.21.15.107:0/2219149326 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae7e59c700 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8eae8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae7dd9b700 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead0dd0 0x562d8eae93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae7ed9d700 1 -- 172.21.15.107:0/2219149326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 msgr2=0x562d8eae8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.441+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8eae8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae7ed9d700 1 -- 172.21.15.107:0/2219149326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead0dd0 msgr2=0x562d8eae93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead0dd0 0x562d8eae93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae7ed9d700 1 -- 172.21.15.107:0/2219149326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d8e8a2630 con 0x562d8ead5290 2023-08-10T10:52:42.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae7dd9b700 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead0dd0 0x562d8eae93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:42.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae7ed9d700 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead5290 0x562d8eb455f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fae78017010 tx=0x7fae780138a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90995cf8471db2f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:42.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae65ffb700 1 -- 172.21.15.107:0/2219149326 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae780078c0 con 0x562d8ead5290 2023-08-10T10:52:42.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae9871cb80 1 -- 172.21.15.107:0/2219149326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae700a3350 con 0x562d8ead5290 2023-08-10T10:52:42.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae65ffb700 1 -- 172.21.15.107:0/2219149326 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fae78013d50 con 0x562d8ead5290 2023-08-10T10:52:42.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.442+0000 7fae65ffb700 1 -- 172.21.15.107:0/2219149326 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae78013f10 con 0x562d8ead5290 2023-08-10T10:52:42.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae9871cb80 10 client.16167 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:42.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae9871cb80 1 -- 172.21.15.107:0/2219149326 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x562d8e875250 con 0x562d8ead5290 2023-08-10T10:52:42.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae65ffb700 1 -- 172.21.15.107:0/2219149326 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae700a3350 con 0x562d8ead5290 2023-08-10T10:52:42.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae65ffb700 1 -- 172.21.15.107:0/2219149326 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fae780159b0 con 0x562d8ead5290 2023-08-10T10:52:42.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae9871cb80 10 client.16167 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:42.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae9871cb80 10 client.16167 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-08-10T10:52:42.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae9871cb80 20 client.16167 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:42.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x562d8eb473f0 0x562d8eb49810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae9871cb80 4 client.16167 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:42.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae9871cb80 1 -- 172.21.15.107:0/2219149326 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562d8ea1a780 con 0x562d8eb473f0 2023-08-10T10:52:42.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.443+0000 7fae7e59c700 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x562d8eb473f0 0x562d8eb49810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae65ffb700 10 client.16167 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:52:42.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae7e59c700 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x562d8eb473f0 0x562d8eb49810 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a8763f4eb496322e server_cookie=4a5e62b3cbcbb544 in_seq=0 out_seq=0 2023-08-10T10:52:42.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae65ffb700 1 -- 172.21.15.107:0/2219149326 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562d8ea1a780 con 0x562d8eb473f0 2023-08-10T10:52:42.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae65ffb700 10 client.16167 handle_command_reply: tid=0 2023-08-10T10:52:42.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae9871cb80 1 client.16167 shutdown 2023-08-10T10:52:42.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae9871cb80 1 -- 172.21.15.107:0/2219149326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead5290 msgr2=0x562d8eb455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead5290 0x562d8eb455f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fae78017010 tx=0x7fae780138a0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae9871cb80 1 -- 172.21.15.107:0/2219149326 shutdown_connections 2023-08-10T10:52:42.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x562d8eb473f0 0x562d8eb49810 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562d8ead5290 0x562d8eb455f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d8ead04b0 0x562d8eae8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae9871cb80 1 --2- 172.21.15.107:0/2219149326 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562d8ead0dd0 0x562d8eae93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae65ffb700 0 client.16167 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:52:42.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.444+0000 7fae9871cb80 1 -- 172.21.15.107:0/2219149326 >> 172.21.15.107:0/2219149326 conn(0x562d8ea2dcd0 msgr2=0x562d8ead4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae9871cb80 1 -- 172.21.15.107:0/2219149326 shutdown_connections 2023-08-10T10:52:42.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae9871cb80 1 -- 172.21.15.107:0/2219149326 wait complete. 2023-08-10T10:52:42.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae9871cb80 20 client.16167 trim_cache size 0 max 16384 2023-08-10T10:52:42.453 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:42.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 -- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fae680a1480 msgr2=0x7fae680a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fae680a1480 0x7fae680a3940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae80101890 tx=0x7fae78009040 comp rx=0 tx=0).stop 2023-08-10T10:52:42.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 -- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae800678d0 msgr2=0x7fae800ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae800678d0 0x7fae800ff780 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fae70000c00 tx=0x7fae70005f10 comp rx=0 tx=0).stop 2023-08-10T10:52:42.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 -- 172.21.15.107:0/4094678340 shutdown_connections 2023-08-10T10:52:42.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fae680a1480 0x7fae680a3940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae80106660 0x7fae801a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fae800678d0 0x7fae800ff780 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 --2- 172.21.15.107:0/4094678340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae80068290 0x7fae800ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.445+0000 7fae7f59e700 1 -- 172.21.15.107:0/4094678340 >> 172.21.15.107:0/4094678340 conn(0x7fae80074f30 msgr2=0x7fae80107390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.446+0000 7fae7f59e700 1 -- 172.21.15.107:0/4094678340 shutdown_connections 2023-08-10T10:52:42.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.446+0000 7fae7f59e700 1 -- 172.21.15.107:0/4094678340 wait complete. 2023-08-10T10:52:42.465 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-10T10:52:42.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.699+0000 7fab4dd9d700 1 -- 172.21.15.107:0/851146852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab4810d260 msgr2=0x7fab4810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.699+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/851146852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab4810d260 0x7fab4810f650 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fab4000b0a0 tx=0x7fab4000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.699+0000 7fab4dd9d700 1 -- 172.21.15.107:0/851146852 shutdown_connections 2023-08-10T10:52:42.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.699+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/851146852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab4810d260 0x7fab4810f650 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.699+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/851146852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab480678d0 0x7fab48067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.699+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/851146852 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab480681f0 0x7fab4810cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.699+0000 7fab4dd9d700 1 -- 172.21.15.107:0/851146852 >> 172.21.15.107:0/851146852 conn(0x7fab48074f30 msgr2=0x7fab48075340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.699+0000 7fab4dd9d700 1 -- 172.21.15.107:0/851146852 shutdown_connections 2023-08-10T10:52:42.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.699+0000 7fab4dd9d700 1 -- 172.21.15.107:0/851146852 wait complete. 2023-08-10T10:52:42.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.701+0000 7fab4dd9d700 1 Processor -- start 2023-08-10T10:52:42.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.701+0000 7fab4dd9d700 1 -- start start 2023-08-10T10:52:42.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4dd9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab480678d0 0x7fab4819e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4dd9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab480681f0 0x7fab4819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4dd9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4810d260 0x7fab481985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4dd9d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48198c40 con 0x7fab480678d0 2023-08-10T10:52:42.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4dd9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48198db0 con 0x7fab480681f0 2023-08-10T10:52:42.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4dd9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48198f70 con 0x7fab4810d260 2023-08-10T10:52:42.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4cd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab480678d0 0x7fab4819e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4cd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab480678d0 0x7fab4819e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51058/0 (socket says 172.21.15.107:51058) 2023-08-10T10:52:42.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4cd9b700 1 -- 172.21.15.107:0/158768395 learned_addr learned my addr 172.21.15.107:0/158768395 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab47fff700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab480681f0 0x7fab4819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4d59c700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4810d260 0x7fab481985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4cd9b700 1 -- 172.21.15.107:0/158768395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4810d260 msgr2=0x7fab481985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4810d260 0x7fab481985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4cd9b700 1 -- 172.21.15.107:0/158768395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab480681f0 msgr2=0x7fab4819eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab480681f0 0x7fab4819eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.702+0000 7fab4cd9b700 1 -- 172.21.15.107:0/158768395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009d00 con 0x7fab480678d0 2023-08-10T10:52:42.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.703+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab480678d0 0x7fab4819e560 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00e970 tx=0x7fab3c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.703+0000 7fab45ffb700 1 -- 172.21.15.107:0/158768395 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c009790 con 0x7fab480678d0 2023-08-10T10:52:42.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.703+0000 7fab45ffb700 1 -- 172.21.15.107:0/158768395 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab3c00c7e0 con 0x7fab480678d0 2023-08-10T10:52:42.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.703+0000 7fab4dd9d700 1 -- 172.21.15.107:0/158768395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab48199250 con 0x7fab480678d0 2023-08-10T10:52:42.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.703+0000 7fab45ffb700 1 -- 172.21.15.107:0/158768395 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c003bd0 con 0x7fab480678d0 2023-08-10T10:52:42.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.703+0000 7fab4dd9d700 1 -- 172.21.15.107:0/158768395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab481a5550 con 0x7fab480678d0 2023-08-10T10:52:42.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.707+0000 7fab45ffb700 1 -- 172.21.15.107:0/158768395 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fab3c00c950 con 0x7fab480678d0 2023-08-10T10:52:42.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.708+0000 7fab629a5b80 1 Processor -- start 2023-08-10T10:52:42.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.708+0000 7fab45ffb700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fab380a1480 0x7fab380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab629a5b80 1 -- start start 2023-08-10T10:52:42.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab45ffb700 1 -- 172.21.15.107:0/158768395 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fab3c014070 con 0x7fab480678d0 2023-08-10T10:52:42.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab4d59c700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fab380a1480 0x7fab380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb326890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb32b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab629a5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb2a1dc0 con 0x5581fb326dd0 2023-08-10T10:52:42.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab629a5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb27e590 con 0x5581fb32b290 2023-08-10T10:52:42.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab629a5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb27beb0 con 0x5581fb3264b0 2023-08-10T10:52:42.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab47fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.709+0000 7fab47fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51062/0 (socket says 172.21.15.107:51062) 2023-08-10T10:52:42.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab47fff700 1 -- 172.21.15.107:0/1995362616 learned_addr learned my addr 172.21.15.107:0/1995362616 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb326890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab4d59c700 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb32b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab47fff700 1 -- 172.21.15.107:0/1995362616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 msgr2=0x5581fb326890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab4d59c700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fab380a1480 0x7fab380a3940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fab4000b780 tx=0x7fab40006210 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab47fff700 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb326890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab47fff700 1 -- 172.21.15.107:0/1995362616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 msgr2=0x5581fb32b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab47fff700 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb32b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab47fff700 1 -- 172.21.15.107:0/1995362616 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581fb0f8630 con 0x5581fb326dd0 2023-08-10T10:52:42.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb326890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:42.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab47fff700 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32ad50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fab34009d20 tx=0x7fab34011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fa585f4398263d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab32ffd700 1 -- 172.21.15.107:0/1995362616 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34019630 con 0x5581fb326dd0 2023-08-10T10:52:42.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.710+0000 7fab32ffd700 1 -- 172.21.15.107:0/1995362616 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab34019c20 con 0x5581fb326dd0 2023-08-10T10:52:42.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.711+0000 7fab32ffd700 1 -- 172.21.15.107:0/1995362616 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400eb60 con 0x5581fb326dd0 2023-08-10T10:52:42.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.711+0000 7fab629a5b80 1 -- 172.21.15.107:0/1995362616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 msgr2=0x5581fb32ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.711+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32ad50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fab34009d20 tx=0x7fab34011720 comp rx=0 tx=0).stop 2023-08-10T10:52:42.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.711+0000 7fab629a5b80 1 -- 172.21.15.107:0/1995362616 shutdown_connections 2023-08-10T10:52:42.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.711+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb32b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.711+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb326890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.711+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1995362616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32ad50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.711+0000 7fab629a5b80 1 -- 172.21.15.107:0/1995362616 >> 172.21.15.107:0/1995362616 conn(0x5581fb283cd0 msgr2=0x5581fb321750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.711+0000 7fab629a5b80 1 -- 172.21.15.107:0/1995362616 shutdown_connections 2023-08-10T10:52:42.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.712+0000 7fab629a5b80 1 -- 172.21.15.107:0/1995362616 wait complete. 2023-08-10T10:52:42.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.712+0000 7fab629a5b80 1 -- start start 2023-08-10T10:52:42.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.712+0000 7fab629a5b80 1 Processor -- start 2023-08-10T10:52:42.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb332ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb330410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab629a5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb2777a0 con 0x5581fb326dd0 2023-08-10T10:52:42.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab629a5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb216ac0 con 0x5581fb32b290 2023-08-10T10:52:42.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab629a5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb2167c0 con 0x5581fb3264b0 2023-08-10T10:52:42.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab629a5b80 10 client.0 _ll_register_callbacks cb 0x5581fb214680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:42.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab47fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab47fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51076/0 (socket says 172.21.15.107:51076) 2023-08-10T10:52:42.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab47fff700 1 -- 172.21.15.107:0/100815382 learned_addr learned my addr 172.21.15.107:0/100815382 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb332ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.713+0000 7fab4d59c700 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb330410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab4cd9b700 1 -- 172.21.15.107:0/100815382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 msgr2=0x5581fb330410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb330410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab4cd9b700 1 -- 172.21.15.107:0/100815382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 msgr2=0x5581fb32fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab4cd9b700 1 -- 172.21.15.107:0/100815382 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab34009980 con 0x5581fb3264b0 2023-08-10T10:52:42.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb332ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0ca720 tx=0x7fab3c099fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2928524f87c726ff server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab27fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:52:42.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab27fff700 1 -- 172.21.15.107:0/100815382 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c094de0 con 0x5581fb3264b0 2023-08-10T10:52:42.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab629a5b80 1 -- 172.21.15.107:0/100815382 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581fb319470 con 0x5581fb3264b0 2023-08-10T10:52:42.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab27fff700 1 -- 172.21.15.107:0/100815382 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fab3c09a230 con 0x5581fb3264b0 2023-08-10T10:52:42.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab27fff700 1 -- 172.21.15.107:0/100815382 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab3c0cd2c0 con 0x5581fb3264b0 2023-08-10T10:52:42.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab629a5b80 10 client.25879 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:42.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.714+0000 7fab629a5b80 1 -- 172.21.15.107:0/100815382 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5581fb0a4de0 con 0x5581fb3264b0 2023-08-10T10:52:42.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.715+0000 7fab27fff700 1 -- 172.21.15.107:0/100815382 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab3c0ca080 con 0x5581fb3264b0 2023-08-10T10:52:42.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.715+0000 7fab27fff700 1 -- 172.21.15.107:0/100815382 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fab3c0994c0 con 0x5581fb3264b0 2023-08-10T10:52:42.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.715+0000 7fab629a5b80 10 client.25879 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:42.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.715+0000 7fab629a5b80 10 client.25879 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T10:52:42.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.715+0000 7fab629a5b80 20 client.25879 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:42.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.715+0000 7fab629a5b80 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x5581fb3403c0 0x5581fb3427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.715+0000 7fab629a5b80 4 client.25879 mds_command: new command op to 24497 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:42.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.715+0000 7fab629a5b80 1 -- 172.21.15.107:0/100815382 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581fb2f59d0 con 0x5581fb3403c0 2023-08-10T10:52:42.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.715+0000 7fab47fff700 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x5581fb3403c0 0x5581fb3427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.716+0000 7fab27fff700 10 client.25879 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:52:42.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.716+0000 7fab47fff700 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x5581fb3403c0 0x5581fb3427e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=15e150bc1f71e270 server_cookie=1143939b921190cf in_seq=0 out_seq=0 2023-08-10T10:52:42.724 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab27fff700 1 -- 172.21.15.107:0/100815382 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5581fb2f59d0 con 0x5581fb3403c0 2023-08-10T10:52:42.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab27fff700 10 client.25879 handle_command_reply: tid=0 2023-08-10T10:52:42.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 client.25879 shutdown 2023-08-10T10:52:42.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 -- 172.21.15.107:0/100815382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 msgr2=0x5581fb332ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb332ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0ca720 tx=0x7fab3c099fd0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 -- 172.21.15.107:0/100815382 shutdown_connections 2023-08-10T10:52:42.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x5581fb3403c0 0x5581fb3427e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.725 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb330410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb3264b0 0x5581fb332ac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 --2- 172.21.15.107:0/100815382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb32fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab27fff700 0 client.25879 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:52:42.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 -- 172.21.15.107:0/100815382 >> 172.21.15.107:0/100815382 conn(0x5581fb283cd0 msgr2=0x5581fb32c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.717+0000 7fab629a5b80 1 -- 172.21.15.107:0/100815382 shutdown_connections 2023-08-10T10:52:42.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.718+0000 7fab629a5b80 1 -- 172.21.15.107:0/100815382 wait complete. 2023-08-10T10:52:42.726 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.718+0000 7fab629a5b80 20 client.25879 trim_cache size 0 max 16384 2023-08-10T10:52:42.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.733+0000 7fab629a5b80 1 Processor -- start 2023-08-10T10:52:42.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.733+0000 7fab629a5b80 1 -- start start 2023-08-10T10:52:42.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb3264b0 0x5581fb32fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb326dd0 0x5581fb3374f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb3325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab629a5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb0fa920 con 0x5581fb3264b0 2023-08-10T10:52:42.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab629a5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb32dd10 con 0x5581fb32b290 2023-08-10T10:52:42.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab629a5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb330a10 con 0x5581fb326dd0 2023-08-10T10:52:42.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab4cd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb3264b0 0x5581fb32fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab4cd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb3264b0 0x5581fb32fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51080/0 (socket says 172.21.15.107:51080) 2023-08-10T10:52:42.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab4cd9b700 1 -- 172.21.15.107:0/902584681 learned_addr learned my addr 172.21.15.107:0/902584681 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab47fff700 1 --2- 172.21.15.107:0/902584681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb326dd0 0x5581fb3374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab4d59c700 1 --2- 172.21.15.107:0/902584681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb3325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab47fff700 1 -- 172.21.15.107:0/902584681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 msgr2=0x5581fb3325f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab47fff700 1 --2- 172.21.15.107:0/902584681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb3325f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab47fff700 1 -- 172.21.15.107:0/902584681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb3264b0 msgr2=0x5581fb32fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab47fff700 1 --2- 172.21.15.107:0/902584681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb3264b0 0x5581fb32fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.734+0000 7fab47fff700 1 -- 172.21.15.107:0/902584681 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581fb08dc60 con 0x5581fb326dd0 2023-08-10T10:52:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.735+0000 7fab47fff700 1 --2- 172.21.15.107:0/902584681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb326dd0 0x5581fb3374f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5581fb3430f0 tx=0x7fab34011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbddc48dc9b34f89 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.735+0000 7fab337fe700 1 -- 172.21.15.107:0/902584681 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3402e070 con 0x5581fb326dd0 2023-08-10T10:52:42.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.735+0000 7fab337fe700 1 -- 172.21.15.107:0/902584681 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab3400e3b0 con 0x5581fb326dd0 2023-08-10T10:52:42.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.735+0000 7fab337fe700 1 -- 172.21.15.107:0/902584681 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340052c0 con 0x5581fb326dd0 2023-08-10T10:52:42.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 -- 172.21.15.107:0/902584681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb326dd0 msgr2=0x5581fb3374f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 --2- 172.21.15.107:0/902584681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb326dd0 0x5581fb3374f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5581fb3430f0 tx=0x7fab34011720 comp rx=0 tx=0).stop 2023-08-10T10:52:42.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 -- 172.21.15.107:0/902584681 shutdown_connections 2023-08-10T10:52:42.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 --2- 172.21.15.107:0/902584681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb32b290 0x5581fb3325f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 --2- 172.21.15.107:0/902584681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb3264b0 0x5581fb32fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 --2- 172.21.15.107:0/902584681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb326dd0 0x5581fb3374f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 -- 172.21.15.107:0/902584681 >> 172.21.15.107:0/902584681 conn(0x5581fb283cd0 msgr2=0x5581fb32f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 -- 172.21.15.107:0/902584681 shutdown_connections 2023-08-10T10:52:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 -- 172.21.15.107:0/902584681 wait complete. 2023-08-10T10:52:42.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 -- start start 2023-08-10T10:52:42.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.736+0000 7fab629a5b80 1 Processor -- start 2023-08-10T10:52:42.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb3264b0 0x5581fb3370d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb337610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab629a5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb32b290 0x5581fb3356c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab629a5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb335d90 con 0x5581fb326dd0 2023-08-10T10:52:42.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab629a5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb335f00 con 0x5581fb3264b0 2023-08-10T10:52:42.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab629a5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581fb3360c0 con 0x5581fb32b290 2023-08-10T10:52:42.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab629a5b80 10 client.0 _ll_register_callbacks cb 0x5581fb214680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:42.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab47fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb337610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab47fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb337610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51088/0 (socket says 172.21.15.107:51088) 2023-08-10T10:52:42.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.737+0000 7fab47fff700 1 -- 172.21.15.107:0/1969843106 learned_addr learned my addr 172.21.15.107:0/1969843106 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:42.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb3264b0 0x5581fb3370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab47fff700 1 -- 172.21.15.107:0/1969843106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb32b290 msgr2=0x5581fb3356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab47fff700 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb32b290 0x5581fb3356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab47fff700 1 -- 172.21.15.107:0/1969843106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb3264b0 msgr2=0x5581fb3370d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:42.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab47fff700 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb3264b0 0x5581fb3370d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab47fff700 1 -- 172.21.15.107:0/1969843106 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581fb0f8630 con 0x5581fb326dd0 2023-08-10T10:52:42.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab47fff700 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb337610 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fab34009c70 tx=0x7fab34005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13422e206ebc4c4d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:42.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab27fff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:42.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab27fff700 1 -- 172.21.15.107:0/1969843106 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3402e040 con 0x5581fb326dd0 2023-08-10T10:52:42.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab629a5b80 1 -- 172.21.15.107:0/1969843106 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab34019c20 con 0x5581fb326dd0 2023-08-10T10:52:42.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab27fff700 1 -- 172.21.15.107:0/1969843106 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fab340056a0 con 0x5581fb326dd0 2023-08-10T10:52:42.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab27fff700 1 -- 172.21.15.107:0/1969843106 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab340197d0 con 0x5581fb326dd0 2023-08-10T10:52:42.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab629a5b80 10 client.16185 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:42.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.738+0000 7fab629a5b80 1 -- 172.21.15.107:0/1969843106 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5581fb0cb250 con 0x5581fb326dd0 2023-08-10T10:52:42.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.739+0000 7fab27fff700 1 -- 172.21.15.107:0/1969843106 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab3403c020 con 0x5581fb326dd0 2023-08-10T10:52:42.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.739+0000 7fab27fff700 1 -- 172.21.15.107:0/1969843106 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fab3400e6c0 con 0x5581fb326dd0 2023-08-10T10:52:42.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.739+0000 7fab629a5b80 10 client.16185 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:42.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.739+0000 7fab629a5b80 10 client.16185 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T10:52:42.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.739+0000 7fab629a5b80 20 client.16185 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:42.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.739+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x5581fb394fb0 0x5581fb3973a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:42.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.739+0000 7fab629a5b80 4 client.16185 mds_command: new command op to 24497 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:42.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.739+0000 7fab629a5b80 1 -- 172.21.15.107:0/1969843106 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5581fb270780 con 0x5581fb394fb0 2023-08-10T10:52:42.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.740+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x5581fb394fb0 0x5581fb3973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:42.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.740+0000 7fab4cd9b700 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x5581fb394fb0 0x5581fb3973a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49d9bd04c4ab4326 server_cookie=57c0fe709ffe7ea1 in_seq=0 out_seq=0 2023-08-10T10:52:42.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.740+0000 7fab27fff700 10 client.16185 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:52:42.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab27fff700 1 -- 172.21.15.107:0/1969843106 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5581fb270780 con 0x5581fb394fb0 2023-08-10T10:52:42.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab27fff700 10 client.16185 handle_command_reply: tid=0 2023-08-10T10:52:42.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 client.16185 shutdown 2023-08-10T10:52:42.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 -- 172.21.15.107:0/1969843106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 msgr2=0x5581fb337610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb337610 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fab34009c70 tx=0x7fab34005e10 comp rx=0 tx=0).stop 2023-08-10T10:52:42.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 -- 172.21.15.107:0/1969843106 shutdown_connections 2023-08-10T10:52:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x5581fb394fb0 0x5581fb3973a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5581fb3264b0 0x5581fb3370d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581fb32b290 0x5581fb3356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 --2- 172.21.15.107:0/1969843106 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5581fb326dd0 0x5581fb337610 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab27fff700 0 client.16185 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:52:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 -- 172.21.15.107:0/1969843106 >> 172.21.15.107:0/1969843106 conn(0x5581fb283cd0 msgr2=0x5581fb3200f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 -- 172.21.15.107:0/1969843106 shutdown_connections 2023-08-10T10:52:42.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 1 -- 172.21.15.107:0/1969843106 wait complete. 2023-08-10T10:52:42.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.741+0000 7fab629a5b80 20 client.16185 trim_cache size 0 max 16384 2023-08-10T10:52:42.754 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 -- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fab380a1480 msgr2=0x7fab380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fab380a1480 0x7fab380a3940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fab4000b780 tx=0x7fab40006210 comp rx=0 tx=0).stop 2023-08-10T10:52:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 -- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab480678d0 msgr2=0x7fab4819e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab480678d0 0x7fab4819e560 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00e970 tx=0x7fab3c00ec80 comp rx=0 tx=0).stop 2023-08-10T10:52:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 -- 172.21.15.107:0/158768395 shutdown_connections 2023-08-10T10:52:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab4810d260 0x7fab481985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fab480678d0 0x7fab4819e560 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fab380a1480 0x7fab380a3940 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 --2- 172.21.15.107:0/158768395 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab480681f0 0x7fab4819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.743+0000 7fab4dd9d700 1 -- 172.21.15.107:0/158768395 >> 172.21.15.107:0/158768395 conn(0x7fab48074f30 msgr2=0x7fab4810e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:42.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.744+0000 7fab4dd9d700 1 -- 172.21.15.107:0/158768395 shutdown_connections 2023-08-10T10:52:42.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.745+0000 7fab4dd9d700 1 -- 172.21.15.107:0/158768395 wait complete. 2023-08-10T10:52:42.769 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:42 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3900253246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:52:42.771 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-10T10:52:42.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.997+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2874532895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 msgr2=0x7f8a5c1009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:42.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.997+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2874532895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 0x7f8a5c1009e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0099c0 tx=0x7f8a4c009cd0 comp rx=0 tx=0).stop 2023-08-10T10:52:42.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.997+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2874532895 shutdown_connections 2023-08-10T10:52:43.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.997+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2874532895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a5c100f20 0x7f8a5c10d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.997+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2874532895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a5c106620 0x7f8a5c106a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.997+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2874532895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 0x7f8a5c1009e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.997+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2874532895 >> 172.21.15.107:0/2874532895 conn(0x7f8a5c0fc010 msgr2=0x7f8a5c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.997+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2874532895 shutdown_connections 2023-08-10T10:52:43.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.997+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2874532895 wait complete. 2023-08-10T10:52:43.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a62b9d700 1 Processor -- start 2023-08-10T10:52:43.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a62b9d700 1 -- start start 2023-08-10T10:52:43.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a62b9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 0x7f8a5c19e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a62b9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a5c100f20 0x7f8a5c19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a62b9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a5c106620 0x7f8a5c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a62b9d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c198b10 con 0x7f8a5c100560 2023-08-10T10:52:43.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a62b9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c198c80 con 0x7f8a5c106620 2023-08-10T10:52:43.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a62b9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c198e40 con 0x7f8a5c100f20 2023-08-10T10:52:43.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a61b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 0x7f8a5c19e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a61b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 0x7f8a5c19e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40740/0 (socket says 172.21.15.107:40740) 2023-08-10T10:52:43.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:42.999+0000 7f8a61b9b700 1 -- 172.21.15.107:0/2142027670 learned_addr learned my addr 172.21.15.107:0/2142027670 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a6239c700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a5c106620 0x7f8a5c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a6139a700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a5c100f20 0x7f8a5c19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a61b9b700 1 -- 172.21.15.107:0/2142027670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a5c100f20 msgr2=0x7f8a5c19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a5c100f20 0x7f8a5c19e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a61b9b700 1 -- 172.21.15.107:0/2142027670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a5c106620 msgr2=0x7f8a5c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a5c106620 0x7f8a5c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a61b9b700 1 -- 172.21.15.107:0/2142027670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0095f0 con 0x7f8a5c100560 2023-08-10T10:52:43.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 0x7f8a5c19e3e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e9a0 tx=0x7f8a5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a52ffd700 1 -- 172.21.15.107:0/2142027670 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58009790 con 0x7f8a5c100560 2023-08-10T10:52:43.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2142027670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5c199120 con 0x7f8a5c100560 2023-08-10T10:52:43.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.000+0000 7f8a52ffd700 1 -- 172.21.15.107:0/2142027670 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a58010430 con 0x7f8a5c100560 2023-08-10T10:52:43.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.001+0000 7f8a52ffd700 1 -- 172.21.15.107:0/2142027670 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800cea0 con 0x7f8a5c100560 2023-08-10T10:52:43.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.001+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2142027670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5c1a5480 con 0x7f8a5c100560 2023-08-10T10:52:43.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.004+0000 7f8a52ffd700 1 -- 172.21.15.107:0/2142027670 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f8a580105a0 con 0x7f8a5c100560 2023-08-10T10:52:43.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.005+0000 7f8a52ffd700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8a480a1480 0x7f8a480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.006+0000 7f8a52ffd700 1 -- 172.21.15.107:0/2142027670 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f8a58014070 con 0x7f8a5c100560 2023-08-10T10:52:43.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.006+0000 7f8a7779fb80 1 Processor -- start 2023-08-10T10:52:43.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.006+0000 7f8a6139a700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8a480a1480 0x7f8a480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.006+0000 7f8a7779fb80 1 -- start start 2023-08-10T10:52:43.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 0x5633ac663890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 0x5633ac667d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac6686f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6139a700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8a480a1480 0x7f8a480a3940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009990 tx=0x7f8a4c005c00 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac5dedc0 con 0x5633ac668290 2023-08-10T10:52:43.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac5bb590 con 0x5633ac6634b0 2023-08-10T10:52:43.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac5b8eb0 con 0x5633ac663dd0 2023-08-10T10:52:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6239c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac6686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6239c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac6686f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40744/0 (socket says 172.21.15.107:40744) 2023-08-10T10:52:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6239c700 1 -- 172.21.15.107:0/374112122 learned_addr learned my addr 172.21.15.107:0/374112122 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6139a700 1 --2- 172.21.15.107:0/374112122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 0x5633ac667d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/374112122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 0x5633ac663890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6239c700 1 -- 172.21.15.107:0/374112122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 msgr2=0x5633ac667d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6239c700 1 --2- 172.21.15.107:0/374112122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 0x5633ac667d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6239c700 1 -- 172.21.15.107:0/374112122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 msgr2=0x5633ac663890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6239c700 1 --2- 172.21.15.107:0/374112122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 0x5633ac663890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.007+0000 7f8a6239c700 1 -- 172.21.15.107:0/374112122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633ac435630 con 0x5633ac668290 2023-08-10T10:52:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.008+0000 7f8a6239c700 1 --2- 172.21.15.107:0/374112122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac6686f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8a540098f0 tx=0x7f8a54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5841991b1857da server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.008+0000 7f8a47fff700 1 -- 172.21.15.107:0/374112122 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54019070 con 0x5633ac668290 2023-08-10T10:52:43.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.008+0000 7f8a47fff700 1 -- 172.21.15.107:0/374112122 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a5400f040 con 0x5633ac668290 2023-08-10T10:52:43.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.008+0000 7f8a47fff700 1 -- 172.21.15.107:0/374112122 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54007a50 con 0x5633ac668290 2023-08-10T10:52:43.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.009+0000 7f8a7779fb80 1 -- 172.21.15.107:0/374112122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 msgr2=0x5633ac6686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.009+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/374112122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac6686f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8a540098f0 tx=0x7f8a54009c00 comp rx=0 tx=0).stop 2023-08-10T10:52:43.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.009+0000 7f8a7779fb80 1 -- 172.21.15.107:0/374112122 shutdown_connections 2023-08-10T10:52:43.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.009+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/374112122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 0x5633ac663890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.009+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/374112122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac6686f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.009+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/374112122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 0x5633ac667d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.009+0000 7f8a7779fb80 1 -- 172.21.15.107:0/374112122 >> 172.21.15.107:0/374112122 conn(0x5633ac5c0cd0 msgr2=0x5633ac65e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.009+0000 7f8a7779fb80 1 -- 172.21.15.107:0/374112122 shutdown_connections 2023-08-10T10:52:43.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.009+0000 7f8a7779fb80 1 -- 172.21.15.107:0/374112122 wait complete. 2023-08-10T10:52:43.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.010+0000 7f8a7779fb80 1 -- start start 2023-08-10T10:52:43.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.010+0000 7f8a7779fb80 1 Processor -- start 2023-08-10T10:52:43.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac6634b0 0x5633ac66faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac66d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac5b47a0 con 0x5633ac668290 2023-08-10T10:52:43.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac553ac0 con 0x5633ac663dd0 2023-08-10T10:52:43.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac5537c0 con 0x5633ac6634b0 2023-08-10T10:52:43.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a7779fb80 10 client.0 _ll_register_callbacks cb 0x5633ac551680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:43.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a61b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac6634b0 0x5633ac66faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a61b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac6634b0 0x5633ac66faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55226/0 (socket says 172.21.15.107:55226) 2023-08-10T10:52:43.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a6239c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac66d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a61b9b700 1 -- 172.21.15.107:0/2082343898 learned_addr learned my addr 172.21.15.107:0/2082343898 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a6139a700 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a61b9b700 1 -- 172.21.15.107:0/2082343898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 msgr2=0x5633ac66ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a61b9b700 1 -- 172.21.15.107:0/2082343898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 msgr2=0x5633ac66d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac66d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a61b9b700 1 -- 172.21.15.107:0/2082343898 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a54003c50 con 0x5633ac6634b0 2023-08-10T10:52:43.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.011+0000 7f8a6139a700 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:43.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.012+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac6634b0 0x5633ac66faa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a58099f80 tx=0x7f8a580cd3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=296e8016057cf628 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.012+0000 7f8a457fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:52:43.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.012+0000 7f8a457fa700 1 -- 172.21.15.107:0/2082343898 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5809e020 con 0x5633ac6634b0 2023-08-10T10:52:43.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.012+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2082343898 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633ac656470 con 0x5633ac6634b0 2023-08-10T10:52:43.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.012+0000 7f8a457fa700 1 -- 172.21.15.107:0/2082343898 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f8a580a2440 con 0x5633ac6634b0 2023-08-10T10:52:43.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.012+0000 7f8a457fa700 1 -- 172.21.15.107:0/2082343898 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a580a1fb0 con 0x5633ac6634b0 2023-08-10T10:52:43.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.012+0000 7f8a7779fb80 10 client.25894 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:43.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.012+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2082343898 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5633ac3e1de0 con 0x5633ac6634b0 2023-08-10T10:52:43.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.012+0000 7f8a457fa700 1 -- 172.21.15.107:0/2082343898 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5633ac656470 con 0x5633ac6634b0 2023-08-10T10:52:43.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.013+0000 7f8a457fa700 1 -- 172.21.15.107:0/2082343898 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f8a580b8120 con 0x5633ac6634b0 2023-08-10T10:52:43.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.013+0000 7f8a7779fb80 10 client.25894 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:43.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.013+0000 7f8a7779fb80 10 client.25894 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T10:52:43.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.013+0000 7f8a7779fb80 20 client.25894 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:43.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.013+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5633ac67d3e0 0x5633ac67f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.013+0000 7f8a7779fb80 4 client.25894 mds_command: new command op to 24532 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:43.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.013+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2082343898 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633ac6329d0 con 0x5633ac67d3e0 2023-08-10T10:52:43.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.013+0000 7f8a6139a700 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5633ac67d3e0 0x5633ac67f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.014+0000 7f8a457fa700 10 client.25894 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:52:43.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.014+0000 7f8a6139a700 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5633ac67d3e0 0x5633ac67f7d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a39f384fc5e3278 server_cookie=66f77a58672658f2 in_seq=0 out_seq=0 2023-08-10T10:52:43.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.014+0000 7f8a457fa700 1 -- 172.21.15.107:0/2082343898 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5633ac6329d0 con 0x5633ac67d3e0 2023-08-10T10:52:43.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.014+0000 7f8a457fa700 10 client.25894 handle_command_reply: tid=0 2023-08-10T10:52:43.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.014+0000 7f8a7779fb80 1 client.25894 shutdown 2023-08-10T10:52:43.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2082343898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac6634b0 msgr2=0x5633ac66faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac6634b0 0x5633ac66faa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a58099f80 tx=0x7f8a580cd3d0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2082343898 shutdown_connections 2023-08-10T10:52:43.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5633ac67d3e0 0x5633ac67f7d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac66d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac6634b0 0x5633ac66faa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2082343898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2082343898 >> 172.21.15.107:0/2082343898 conn(0x5633ac5c0cd0 msgr2=0x5633ac669740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a457fa700 0 client.25894 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:52:43.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2082343898 shutdown_connections 2023-08-10T10:52:43.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2082343898 wait complete. 2023-08-10T10:52:43.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.015+0000 7f8a7779fb80 20 client.25894 trim_cache size 0 max 16384 2023-08-10T10:52:43.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.034+0000 7f8a7779fb80 1 Processor -- start 2023-08-10T10:52:43.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.034+0000 7f8a7779fb80 1 -- start start 2023-08-10T10:52:43.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 0x5633ac6744f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 0x5633ac66f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac669f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac437920 con 0x5633ac668290 2023-08-10T10:52:43.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac6645a0 con 0x5633ac6634b0 2023-08-10T10:52:43.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac656340 con 0x5633ac663dd0 2023-08-10T10:52:43.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a6239c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac669f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a6239c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac669f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40760/0 (socket says 172.21.15.107:40760) 2023-08-10T10:52:43.037 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a6239c700 1 -- 172.21.15.107:0/2986455899 learned_addr learned my addr 172.21.15.107:0/2986455899 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a6139a700 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 0x5633ac66f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.035+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 0x5633ac6744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a6239c700 1 -- 172.21.15.107:0/2986455899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 msgr2=0x5633ac66f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a6239c700 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 0x5633ac66f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a6239c700 1 -- 172.21.15.107:0/2986455899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 msgr2=0x5633ac6744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a6239c700 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 0x5633ac6744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a6239c700 1 -- 172.21.15.107:0/2986455899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633ac3cac60 con 0x5633ac668290 2023-08-10T10:52:43.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a6139a700 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 0x5633ac66f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:42 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3900253246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:52:43.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a6239c700 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac669f50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8a54007670 tx=0x7f8a54009170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecdb381ca542a13 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a50bff700 1 -- 172.21.15.107:0/2986455899 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54019040 con 0x5633ac668290 2023-08-10T10:52:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a50bff700 1 -- 172.21.15.107:0/2986455899 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a54007d30 con 0x5633ac668290 2023-08-10T10:52:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.036+0000 7f8a50bff700 1 -- 172.21.15.107:0/2986455899 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54004aa0 con 0x5633ac668290 2023-08-10T10:52:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2986455899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 msgr2=0x5633ac669f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac669f50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8a54007670 tx=0x7f8a54009170 comp rx=0 tx=0).stop 2023-08-10T10:52:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2986455899 shutdown_connections 2023-08-10T10:52:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac6634b0 0x5633ac6744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac668290 0x5633ac669f50 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/2986455899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac663dd0 0x5633ac66f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2986455899 >> 172.21.15.107:0/2986455899 conn(0x5633ac5c0cd0 msgr2=0x5633ac666320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2986455899 shutdown_connections 2023-08-10T10:52:43.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 -- 172.21.15.107:0/2986455899 wait complete. 2023-08-10T10:52:43.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.037+0000 7f8a7779fb80 1 -- start start 2023-08-10T10:52:43.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.038+0000 7f8a7779fb80 1 Processor -- start 2023-08-10T10:52:43.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.038+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac6634b0 0x5633ac66c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.038+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.038+0000 7f8a7779fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac668290 0x5633ac66b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.038+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac66b9e0 con 0x5633ac6634b0 2023-08-10T10:52:43.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.038+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac66bb50 con 0x5633ac663dd0 2023-08-10T10:52:43.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.038+0000 7f8a7779fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633ac66bd10 con 0x5633ac668290 2023-08-10T10:52:43.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.038+0000 7f8a7779fb80 10 client.0 _ll_register_callbacks cb 0x5633ac551680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:43.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a61b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac6634b0 0x5633ac66c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a61b9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac6634b0 0x5633ac66c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40768/0 (socket says 172.21.15.107:40768) 2023-08-10T10:52:43.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a61b9b700 1 -- 172.21.15.107:0/1064970129 learned_addr learned my addr 172.21.15.107:0/1064970129 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a6139a700 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a6239c700 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac668290 0x5633ac66b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a61b9b700 1 -- 172.21.15.107:0/1064970129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac668290 msgr2=0x5633ac66b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac668290 0x5633ac66b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a61b9b700 1 -- 172.21.15.107:0/1064970129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 msgr2=0x5633ac66ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a61b9b700 1 -- 172.21.15.107:0/1064970129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5c10dce0 con 0x5633ac6634b0 2023-08-10T10:52:43.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a6139a700 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:43.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a61b9b700 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac6634b0 0x5633ac66c550 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8a580ca850 tx=0x7f8a5800c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d746cd77764d18 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.039+0000 7f8a457fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:43.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a457fa700 1 -- 172.21.15.107:0/1064970129 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580ca680 con 0x5633ac6634b0 2023-08-10T10:52:43.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a7779fb80 1 -- 172.21.15.107:0/1064970129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a5400f040 con 0x5633ac6634b0 2023-08-10T10:52:43.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a457fa700 1 -- 172.21.15.107:0/1064970129 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f8a580a2440 con 0x5633ac6634b0 2023-08-10T10:52:43.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a457fa700 1 -- 172.21.15.107:0/1064970129 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a5809e020 con 0x5633ac6634b0 2023-08-10T10:52:43.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a7779fb80 10 client.16203 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:43.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a7779fb80 1 -- 172.21.15.107:0/1064970129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5633ac435630 con 0x5633ac6634b0 2023-08-10T10:52:43.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a457fa700 1 -- 172.21.15.107:0/1064970129 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a5400f040 con 0x5633ac6634b0 2023-08-10T10:52:43.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a457fa700 1 -- 172.21.15.107:0/1064970129 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f8a580a1fb0 con 0x5633ac6634b0 2023-08-10T10:52:43.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a7779fb80 10 client.16203 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:43.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a7779fb80 10 client.16203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T10:52:43.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a7779fb80 20 client.16203 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:43.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5633ac6d1c00 0x5633ac6d3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a7779fb80 4 client.16203 mds_command: new command op to 24532 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:43.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.040+0000 7f8a7779fb80 1 -- 172.21.15.107:0/1064970129 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5633ac5ad780 con 0x5633ac6d1c00 2023-08-10T10:52:43.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.041+0000 7f8a6139a700 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5633ac6d1c00 0x5633ac6d3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.041+0000 7f8a457fa700 10 client.16203 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:52:43.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.041+0000 7f8a6139a700 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5633ac6d1c00 0x5633ac6d3ff0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=749fe53108821309 server_cookie=32d637c250755d2b in_seq=0 out_seq=0 2023-08-10T10:52:43.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.041+0000 7f8a457fa700 1 -- 172.21.15.107:0/1064970129 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5633ac5ad780 con 0x5633ac6d1c00 2023-08-10T10:52:43.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.041+0000 7f8a457fa700 10 client.16203 handle_command_reply: tid=0 2023-08-10T10:52:43.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.041+0000 7f8a7779fb80 1 client.16203 shutdown 2023-08-10T10:52:43.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 -- 172.21.15.107:0/1064970129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac6634b0 msgr2=0x5633ac66c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac6634b0 0x5633ac66c550 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8a580ca850 tx=0x7f8a5800c480 comp rx=0 tx=0).stop 2023-08-10T10:52:43.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 -- 172.21.15.107:0/1064970129 shutdown_connections 2023-08-10T10:52:43.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x5633ac6d1c00 0x5633ac6d3ff0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5633ac668290 0x5633ac66b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a457fa700 0 client.16203 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:52:43.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633ac6634b0 0x5633ac66c550 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 --2- 172.21.15.107:0/1064970129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633ac663dd0 0x5633ac66ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 -- 172.21.15.107:0/1064970129 >> 172.21.15.107:0/1064970129 conn(0x5633ac5c0cd0 msgr2=0x5633ac669f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 -- 172.21.15.107:0/1064970129 shutdown_connections 2023-08-10T10:52:43.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 1 -- 172.21.15.107:0/1064970129 wait complete. 2023-08-10T10:52:43.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.042+0000 7f8a7779fb80 20 client.16203 trim_cache size 0 max 16384 2023-08-10T10:52:43.051 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:43.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8a480a1480 msgr2=0x7f8a480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8a480a1480 0x7f8a480a3940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009990 tx=0x7f8a4c005c00 comp rx=0 tx=0).stop 2023-08-10T10:52:43.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 msgr2=0x7f8a5c19e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 0x7f8a5c19e3e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e9a0 tx=0x7f8a5800ecb0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2142027670 shutdown_connections 2023-08-10T10:52:43.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8a480a1480 0x7f8a480a3940 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a5c106620 0x7f8a5c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a5c100560 0x7f8a5c19e3e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 --2- 172.21.15.107:0/2142027670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a5c100f20 0x7f8a5c19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2142027670 >> 172.21.15.107:0/2142027670 conn(0x7f8a5c0fc010 msgr2=0x7f8a5c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2142027670 shutdown_connections 2023-08-10T10:52:43.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.043+0000 7f8a62b9d700 1 -- 172.21.15.107:0/2142027670 wait complete. 2023-08-10T10:52:43.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-10T10:52:43.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:42 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3900253246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:52:43.193 INFO:teuthology.orchestra.run.smithi107.stderr:4000000 of 50000000 tuples (8%) done (elapsed 61.37 s, remaining 705.77 s) 2023-08-10T10:52:43.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.292+0000 7f1bdbfff700 1 -- 172.21.15.107:0/1843896485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41006e0 msgr2=0x7f1bd4100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.292+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/1843896485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41006e0 0x7f1bd4100b60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009990 tx=0x7f1bc4009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.292+0000 7f1bdbfff700 1 -- 172.21.15.107:0/1843896485 shutdown_connections 2023-08-10T10:52:43.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.292+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/1843896485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bd41010a0 0x7f1bd410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.292+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/1843896485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd41066f0 0x7f1bd4106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.292+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/1843896485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41006e0 0x7f1bd4100b60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.292+0000 7f1bdbfff700 1 -- 172.21.15.107:0/1843896485 >> 172.21.15.107:0/1843896485 conn(0x7f1bd40fc1d0 msgr2=0x7f1bd40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.292+0000 7f1bdbfff700 1 -- 172.21.15.107:0/1843896485 shutdown_connections 2023-08-10T10:52:43.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.292+0000 7f1bdbfff700 1 -- 172.21.15.107:0/1843896485 wait complete. 2023-08-10T10:52:43.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.293+0000 7f1bdbfff700 1 Processor -- start 2023-08-10T10:52:43.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bdbfff700 1 -- start start 2023-08-10T10:52:43.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bdbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bd41006e0 0x7f1bd4196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bdbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd41010a0 0x7f1bd4196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bdbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41066f0 0x7f1bd419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bdbfff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd419a610 con 0x7f1bd41066f0 2023-08-10T10:52:43.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bdbfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd419a780 con 0x7f1bd41006e0 2023-08-10T10:52:43.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bdbfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd419a940 con 0x7f1bd41010a0 2023-08-10T10:52:43.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bda59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41066f0 0x7f1bd419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bda59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41066f0 0x7f1bd419a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40780/0 (socket says 172.21.15.107:40780) 2023-08-10T10:52:43.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bda59c700 1 -- 172.21.15.107:0/3068797861 learned_addr learned my addr 172.21.15.107:0/3068797861 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bd41006e0 0x7f1bd4196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.294+0000 7f1bd959a700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd41010a0 0x7f1bd4196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bda59c700 1 -- 172.21.15.107:0/3068797861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd41010a0 msgr2=0x7f1bd4196c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bda59c700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd41010a0 0x7f1bd4196c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bda59c700 1 -- 172.21.15.107:0/3068797861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bd41006e0 msgr2=0x7f1bd4196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bda59c700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bd41006e0 0x7f1bd4196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bda59c700 1 -- 172.21.15.107:0/3068797861 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40095f0 con 0x7f1bd41066f0 2023-08-10T10:52:43.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bda59c700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41066f0 0x7f1bd419a010 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00ef30 tx=0x7f1bcc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bcaffd700 1 -- 172.21.15.107:0/3068797861 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc018070 con 0x7f1bd41066f0 2023-08-10T10:52:43.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bcaffd700 1 -- 172.21.15.107:0/3068797861 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bcc00f040 con 0x7f1bd41066f0 2023-08-10T10:52:43.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bdbfff700 1 -- 172.21.15.107:0/3068797861 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd419abc0 con 0x7f1bd41066f0 2023-08-10T10:52:43.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.295+0000 7f1bcaffd700 1 -- 172.21.15.107:0/3068797861 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00cbc0 con 0x7f1bd41066f0 2023-08-10T10:52:43.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.296+0000 7f1bdbfff700 1 -- 172.21.15.107:0/3068797861 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd419ae70 con 0x7f1bd41066f0 2023-08-10T10:52:43.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.300+0000 7f1bcaffd700 1 -- 172.21.15.107:0/3068797861 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f1bcc00cd80 con 0x7f1bd41066f0 2023-08-10T10:52:43.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.300+0000 7f1bef878b80 1 Processor -- start 2023-08-10T10:52:43.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.300+0000 7f1bef878b80 1 -- start start 2023-08-10T10:52:43.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 0x5633533857c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x56335337f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x563353380070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bef878b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633532f6dc0 con 0x56335337fc10 2023-08-10T10:52:43.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bef878b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633532d3590 con 0x5633533853e0 2023-08-10T10:52:43.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bef878b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633532d0eb0 con 0x563353385d00 2023-08-10T10:52:43.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bd959a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x563353380070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bd959a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x563353380070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40792/0 (socket says 172.21.15.107:40792) 2023-08-10T10:52:43.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bd959a700 1 -- 172.21.15.107:0/1546933525 learned_addr learned my addr 172.21.15.107:0/1546933525 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/1546933525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x56335337f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.301+0000 7f1bd959a700 1 --2- 172.21.15.107:0/1546933525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 0x5633533857c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/1546933525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 msgr2=0x5633533857c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/1546933525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 0x5633533857c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/1546933525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 msgr2=0x563353380070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/1546933525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x563353380070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/1546933525 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56335314d630 con 0x563353385d00 2023-08-10T10:52:43.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/1546933525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x56335337f6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009cb0 tx=0x7f1bd00058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e76320d89c96c03 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bcaffd700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1bc00a13e0 0x7f1bc00a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bcaffd700 1 -- 172.21.15.107:0/3068797861 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f1bcc0cca50 con 0x7f1bd41066f0 2023-08-10T10:52:43.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bbffff700 1 -- 172.21.15.107:0/1546933525 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0011ce0 con 0x563353385d00 2023-08-10T10:52:43.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bbffff700 1 -- 172.21.15.107:0/1546933525 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bd0011e40 con 0x563353385d00 2023-08-10T10:52:43.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bbffff700 1 -- 172.21.15.107:0/1546933525 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0005280 con 0x563353385d00 2023-08-10T10:52:43.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.302+0000 7f1bd959a700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1bc00a13e0 0x7f1bc00a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bef878b80 1 -- 172.21.15.107:0/1546933525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 msgr2=0x56335337f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1546933525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x56335337f6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009cb0 tx=0x7f1bd00058e0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bd959a700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1bc00a13e0 0x7f1bc00a38a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000c00 tx=0x7f1bc401a040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bef878b80 1 -- 172.21.15.107:0/1546933525 shutdown_connections 2023-08-10T10:52:43.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1546933525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 0x5633533857c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1546933525 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x563353380070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1546933525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x56335337f6d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bef878b80 1 -- 172.21.15.107:0/1546933525 >> 172.21.15.107:0/1546933525 conn(0x5633532d8cd0 msgr2=0x5633533764d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bef878b80 1 -- 172.21.15.107:0/1546933525 shutdown_connections 2023-08-10T10:52:43.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.303+0000 7f1bef878b80 1 -- 172.21.15.107:0/1546933525 wait complete. 2023-08-10T10:52:43.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.304+0000 7f1bef878b80 1 -- start start 2023-08-10T10:52:43.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.304+0000 7f1bef878b80 1 Processor -- start 2023-08-10T10:52:43.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56335337fc10 0x56335338bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353388ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563353385d00 0x563353389510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bef878b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633532cc7a0 con 0x5633533853e0 2023-08-10T10:52:43.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bef878b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56335326bac0 con 0x563353385d00 2023-08-10T10:52:43.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bef878b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56335326b7c0 con 0x56335337fc10 2023-08-10T10:52:43.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bef878b80 10 client.0 _ll_register_callbacks cb 0x563353269680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:43.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bd9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56335337fc10 0x56335338bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bd9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56335337fc10 0x56335338bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55286/0 (socket says 172.21.15.107:55286) 2023-08-10T10:52:43.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/1252004991 learned_addr learned my addr 172.21.15.107:0/1252004991 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.305+0000 7f1bd959a700 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353388ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.306+0000 7f1bda59c700 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563353385d00 0x563353389510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.306+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/1252004991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563353385d00 msgr2=0x563353389510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.306+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563353385d00 0x563353389510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.306+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/1252004991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 msgr2=0x563353388ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.306+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353388ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.306+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/1252004991 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd00098e0 con 0x56335337fc10 2023-08-10T10:52:43.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.306+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56335337fc10 0x56335338bc60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0000c00 tx=0x7f1bd0005e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90cca82a956aff0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.306+0000 7f1bbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:52:43.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.306+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/1252004991 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0004260 con 0x56335337fc10 2023-08-10T10:52:43.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.307+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/1252004991 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f1bd00043c0 con 0x56335337fc10 2023-08-10T10:52:43.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.307+0000 7f1bef878b80 1 -- 172.21.15.107:0/1252004991 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56335336e470 con 0x56335337fc10 2023-08-10T10:52:43.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.307+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/1252004991 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bd0004580 con 0x56335337fc10 2023-08-10T10:52:43.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.307+0000 7f1bef878b80 10 client.25912 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:43.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.307+0000 7f1bef878b80 1 -- 172.21.15.107:0/1252004991 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5633530f9de0 con 0x56335337fc10 2023-08-10T10:52:43.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.307+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/1252004991 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56335336e470 con 0x56335337fc10 2023-08-10T10:52:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.307+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/1252004991 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f1bd00050b0 con 0x56335337fc10 2023-08-10T10:52:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.308+0000 7f1bef878b80 10 client.25912 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.308+0000 7f1bef878b80 10 client.25912 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-10T10:52:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.308+0000 7f1bef878b80 20 client.25912 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.308+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x563353399550 0x56335339b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.308+0000 7f1bef878b80 4 client.25912 mds_command: new command op to 24571 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.308+0000 7f1bef878b80 1 -- 172.21.15.107:0/1252004991 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56335334a9d0 con 0x563353399550 2023-08-10T10:52:43.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.308+0000 7f1bd959a700 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x563353399550 0x56335339b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.309+0000 7f1bd959a700 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x563353399550 0x56335339b970 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9338c5b89b9b00a server_cookie=2739032603180684 in_seq=0 out_seq=0 2023-08-10T10:52:43.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.309+0000 7f1bbd7fa700 10 client.25912 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:52:43.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/1252004991 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56335334a9d0 con 0x563353399550 2023-08-10T10:52:43.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bbd7fa700 10 client.25912 handle_command_reply: tid=0 2023-08-10T10:52:43.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 client.25912 shutdown 2023-08-10T10:52:43.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 -- 172.21.15.107:0/1252004991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56335337fc10 msgr2=0x56335338bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56335337fc10 0x56335338bc60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0000c00 tx=0x7f1bd0005e40 comp rx=0 tx=0).stop 2023-08-10T10:52:43.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 -- 172.21.15.107:0/1252004991 shutdown_connections 2023-08-10T10:52:43.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x563353399550 0x56335339b970 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563353385d00 0x563353389510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56335337fc10 0x56335338bc60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bbd7fa700 0 client.25912 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:52:43.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 --2- 172.21.15.107:0/1252004991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353388ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 -- 172.21.15.107:0/1252004991 >> 172.21.15.107:0/1252004991 conn(0x5633532d8cd0 msgr2=0x5633533759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 -- 172.21.15.107:0/1252004991 shutdown_connections 2023-08-10T10:52:43.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 1 -- 172.21.15.107:0/1252004991 wait complete. 2023-08-10T10:52:43.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.310+0000 7f1bef878b80 20 client.25912 trim_cache size 0 max 16384 2023-08-10T10:52:43.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bef878b80 1 Processor -- start 2023-08-10T10:52:43.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bef878b80 1 -- start start 2023-08-10T10:52:43.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56335337fc10 0x5633533894b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353390720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x5633533723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bef878b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56335314f920 con 0x5633533853e0 2023-08-10T10:52:43.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bef878b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563353372910 con 0x56335337fc10 2023-08-10T10:52:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bef878b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563353383ba0 con 0x563353385d00 2023-08-10T10:52:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bd959a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353390720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bd959a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353390720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40814/0 (socket says 172.21.15.107:40814) 2023-08-10T10:52:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.326+0000 7f1bd959a700 1 -- 172.21.15.107:0/601864174 learned_addr learned my addr 172.21.15.107:0/601864174 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bda59c700 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x5633533723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56335337fc10 0x5633533894b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bd959a700 1 -- 172.21.15.107:0/601864174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 msgr2=0x5633533723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bd959a700 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x5633533723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bd959a700 1 -- 172.21.15.107:0/601864174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56335337fc10 msgr2=0x5633533894b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bd959a700 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56335337fc10 0x5633533894b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bd959a700 1 -- 172.21.15.107:0/601864174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633530e2c60 con 0x5633533853e0 2023-08-10T10:52:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56335337fc10 0x5633533894b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:43.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bd959a700 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353390720 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4015000 tx=0x7f1bc4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f7c4b53b497a1d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bc8ff9700 1 -- 172.21.15.107:0/601864174 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40390b0 con 0x5633533853e0 2023-08-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bc8ff9700 1 -- 172.21.15.107:0/601864174 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bc4039210 con 0x5633533853e0 2023-08-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.327+0000 7f1bc8ff9700 1 -- 172.21.15.107:0/601864174 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4028cd0 con 0x5633533853e0 2023-08-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.328+0000 7f1bef878b80 1 -- 172.21.15.107:0/601864174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 msgr2=0x563353390720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.328+0000 7f1bef878b80 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353390720 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4015000 tx=0x7f1bc4009310 comp rx=0 tx=0).stop 2023-08-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.328+0000 7f1bef878b80 1 -- 172.21.15.107:0/601864174 shutdown_connections 2023-08-10T10:52:43.333 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.328+0000 7f1bef878b80 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56335337fc10 0x5633533894b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.328+0000 7f1bef878b80 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x5633533723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.328+0000 7f1bef878b80 1 --2- 172.21.15.107:0/601864174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633533853e0 0x563353390720 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.328+0000 7f1bef878b80 1 -- 172.21.15.107:0/601864174 >> 172.21.15.107:0/601864174 conn(0x5633532d8cd0 msgr2=0x5633533959c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.328+0000 7f1bef878b80 1 -- 172.21.15.107:0/601864174 shutdown_connections 2023-08-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.328+0000 7f1bef878b80 1 -- 172.21.15.107:0/601864174 wait complete. 2023-08-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.329+0000 7f1bef878b80 1 -- start start 2023-08-10T10:52:43.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.329+0000 7f1bef878b80 1 Processor -- start 2023-08-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x56335338c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 0x56335338ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bef878b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x5633533ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bef878b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633533ec6f0 con 0x56335337fc10 2023-08-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bef878b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633533ec830 con 0x5633533853e0 2023-08-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bef878b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633533ec9a0 con 0x563353385d00 2023-08-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bef878b80 10 client.0 _ll_register_callbacks cb 0x563353269680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:43.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bd9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x56335338c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bd9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x56335338c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40824/0 (socket says 172.21.15.107:40824) 2023-08-10T10:52:43.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/3916323600 learned_addr learned my addr 172.21.15.107:0/3916323600 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bd959a700 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 0x56335338ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/3916323600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 msgr2=0x5633533ec1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x5633533ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/3916323600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 msgr2=0x56335338ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.330+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 0x56335338ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bd9d9b700 1 -- 172.21.15.107:0/3916323600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc401d070 con 0x56335337fc10 2023-08-10T10:52:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bd959a700 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 0x56335338ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:52:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bd9d9b700 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x56335338c8f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0011dc0 tx=0x7f1bd00096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a82d5ffdd909d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/3916323600 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0004470 con 0x56335337fc10 2023-08-10T10:52:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bef878b80 1 -- 172.21.15.107:0/3916323600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1bd0011e40 con 0x56335337fc10 2023-08-10T10:52:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/3916323600 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f1bd0000e40 con 0x56335337fc10 2023-08-10T10:52:43.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/3916323600 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bd00045d0 con 0x56335337fc10 2023-08-10T10:52:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bef878b80 10 client.16221 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.331+0000 7f1bef878b80 1 -- 172.21.15.107:0/3916323600 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563353120250 con 0x56335337fc10 2023-08-10T10:52:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.332+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/3916323600 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bd0011e40 con 0x56335337fc10 2023-08-10T10:52:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.332+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/3916323600 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f1bd0003a40 con 0x56335337fc10 2023-08-10T10:52:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.332+0000 7f1bef878b80 10 client.16221 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.332+0000 7f1bef878b80 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-10T10:52:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.332+0000 7f1bef878b80 20 client.16221 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:43.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.332+0000 7f1bef878b80 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5633533ede70 0x5633533f0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.332+0000 7f1bef878b80 4 client.16221 mds_command: new command op to 24571 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:43.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.332+0000 7f1bef878b80 1 -- 172.21.15.107:0/3916323600 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5633532c5780 con 0x5633533ede70 2023-08-10T10:52:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.332+0000 7f1bd959a700 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5633533ede70 0x5633533f0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bd959a700 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5633533ede70 0x5633533f0260 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8d6bd9d711dc687 server_cookie=cbf5eadfcc49a4ce in_seq=0 out_seq=0 2023-08-10T10:52:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bbd7fa700 10 client.16221 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:52:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bbd7fa700 1 -- 172.21.15.107:0/3916323600 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5633532c5780 con 0x5633533ede70 2023-08-10T10:52:43.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bbd7fa700 10 client.16221 handle_command_reply: tid=0 2023-08-10T10:52:43.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bef878b80 1 client.16221 shutdown 2023-08-10T10:52:43.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bef878b80 1 -- 172.21.15.107:0/3916323600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 msgr2=0x56335338c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bef878b80 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x56335338c8f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0011dc0 tx=0x7f1bd00096d0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bef878b80 1 -- 172.21.15.107:0/3916323600 shutdown_connections 2023-08-10T10:52:43.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bef878b80 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5633533ede70 0x5633533f0260 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bef878b80 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563353385d00 0x5633533ec1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bef878b80 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56335337fc10 0x56335338c8f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bef878b80 1 --2- 172.21.15.107:0/3916323600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5633533853e0 0x56335338ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bbd7fa700 0 client.16221 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:52:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.333+0000 7f1bef878b80 1 -- 172.21.15.107:0/3916323600 >> 172.21.15.107:0/3916323600 conn(0x5633532d8cd0 msgr2=0x56335337a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.334+0000 7f1bef878b80 1 -- 172.21.15.107:0/3916323600 shutdown_connections 2023-08-10T10:52:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.334+0000 7f1bef878b80 1 -- 172.21.15.107:0/3916323600 wait complete. 2023-08-10T10:52:43.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.334+0000 7f1bef878b80 20 client.16221 trim_cache size 0 max 16384 2023-08-10T10:52:43.342 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:43.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.334+0000 7f1bdbfff700 1 -- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1bc00a13e0 msgr2=0x7f1bc00a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.334+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1bc00a13e0 0x7f1bc00a38a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000c00 tx=0x7f1bc401a040 comp rx=0 tx=0).stop 2023-08-10T10:52:43.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.334+0000 7f1bdbfff700 1 -- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41066f0 msgr2=0x7f1bd419a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.334+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41066f0 0x7f1bd419a010 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00ef30 tx=0x7f1bcc00c3a0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.335+0000 7f1bdbfff700 1 -- 172.21.15.107:0/3068797861 shutdown_connections 2023-08-10T10:52:43.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.335+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f1bc00a13e0 0x7f1bc00a38a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.335+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bd41006e0 0x7f1bd4196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.335+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1bd41066f0 0x7f1bd419a010 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.335+0000 7f1bdbfff700 1 --2- 172.21.15.107:0/3068797861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd41010a0 0x7f1bd4196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.335+0000 7f1bdbfff700 1 -- 172.21.15.107:0/3068797861 >> 172.21.15.107:0/3068797861 conn(0x7f1bd40fc1d0 msgr2=0x7f1bd40fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.335+0000 7f1bdbfff700 1 -- 172.21.15.107:0/3068797861 shutdown_connections 2023-08-10T10:52:43.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.335+0000 7f1bdbfff700 1 -- 172.21.15.107:0/3068797861 wait complete. 2023-08-10T10:52:43.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-10T10:52:43.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.569+0000 7ffb0ffff700 1 -- 172.21.15.107:0/3989211090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 msgr2=0x7ffb10072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.569+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/3989211090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 0x7ffb10072f00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009990 tx=0x7ffb00009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.569+0000 7ffb0ffff700 1 -- 172.21.15.107:0/3989211090 shutdown_connections 2023-08-10T10:52:43.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.569+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/3989211090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb1010ce20 0x7ffb1010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.569+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/3989211090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 0x7ffb10072f00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.569+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/3989211090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb10073440 0x7ffb1010c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.569+0000 7ffb0ffff700 1 -- 172.21.15.107:0/3989211090 >> 172.21.15.107:0/3989211090 conn(0x7ffb100fc030 msgr2=0x7ffb100fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.570+0000 7ffb0ffff700 1 -- 172.21.15.107:0/3989211090 shutdown_connections 2023-08-10T10:52:43.572 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.570+0000 7ffb0ffff700 1 -- 172.21.15.107:0/3989211090 wait complete. 2023-08-10T10:52:43.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.570+0000 7ffb0ffff700 1 Processor -- start 2023-08-10T10:52:43.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0ffff700 1 -- start start 2023-08-10T10:52:43.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 0x7ffb1019e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb10073440 0x7ffb1019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb1010ce20 0x7ffb101985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0ffff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10198d70 con 0x7ffb10072b20 2023-08-10T10:52:43.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0ffff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10198ee0 con 0x7ffb1010ce20 2023-08-10T10:52:43.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0ffff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb101990a0 con 0x7ffb10073440 2023-08-10T10:52:43.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 0x7ffb1019e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 0x7ffb1019e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40848/0 (socket says 172.21.15.107:40848) 2023-08-10T10:52:43.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0effd700 1 -- 172.21.15.107:0/1496009544 learned_addr learned my addr 172.21.15.107:0/1496009544 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.571+0000 7ffb0e7fc700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb10073440 0x7ffb1019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffb0f7fe700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb1010ce20 0x7ffb101985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffb0effd700 1 -- 172.21.15.107:0/1496009544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb10073440 msgr2=0x7ffb1019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffb0effd700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb10073440 0x7ffb1019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffb0effd700 1 -- 172.21.15.107:0/1496009544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb1010ce20 msgr2=0x7ffb101985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffb0effd700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb1010ce20 0x7ffb101985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffb0effd700 1 -- 172.21.15.107:0/1496009544 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000095f0 con 0x7ffb10072b20 2023-08-10T10:52:43.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffb0f7fe700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb1010ce20 0x7ffb101985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:52:43.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffb0effd700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 0x7ffb1019e5c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ffb00005910 tx=0x7ffb00009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffaf7fff700 1 -- 172.21.15.107:0/1496009544 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0001d070 con 0x7ffb10072b20 2023-08-10T10:52:43.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffaf7fff700 1 -- 172.21.15.107:0/1496009544 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb00003ec0 con 0x7ffb10072b20 2023-08-10T10:52:43.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffb0ffff700 1 -- 172.21.15.107:0/1496009544 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb10199320 con 0x7ffb10072b20 2023-08-10T10:52:43.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.572+0000 7ffaf7fff700 1 -- 172.21.15.107:0/1496009544 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000fb50 con 0x7ffb10072b20 2023-08-10T10:52:43.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.573+0000 7ffb0ffff700 1 -- 172.21.15.107:0/1496009544 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb101a5540 con 0x7ffb10072b20 2023-08-10T10:52:43.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.576+0000 7ffaf7fff700 1 -- 172.21.15.107:0/1496009544 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 25) v1 ==== 135949+0+0 (secure 0 0 0) 0x7ffb00004030 con 0x7ffb10072b20 2023-08-10T10:52:43.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.578+0000 7ffb28c2bb80 1 Processor -- start 2023-08-10T10:52:43.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.578+0000 7ffb28c2bb80 1 -- start start 2023-08-10T10:52:43.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.578+0000 7ffaf7fff700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffaf80a9d10 0x7ffaf80ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffaf7fff700 1 -- 172.21.15.107:0/1496009544 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ffb000ce2e0 con 0x7ffb10072b20 2023-08-10T10:52:43.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b6a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 0x561a34b6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b6f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34ae5dc0 con 0x561a34b6a4b0 2023-08-10T10:52:43.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34ac2590 con 0x561a34b6add0 2023-08-10T10:52:43.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34abfeb0 con 0x561a34b6f290 2023-08-10T10:52:43.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb0f7fe700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffaf80a9d10 0x7ffaf80ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b6a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b6a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40858/0 (socket says 172.21.15.107:40858) 2023-08-10T10:52:43.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb0effd700 1 -- 172.21.15.107:0/4271838329 learned_addr learned my addr 172.21.15.107:0/4271838329 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.579+0000 7ffb0e7fc700 1 --2- 172.21.15.107:0/4271838329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 0x561a34b6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffb0f7fe700 1 --2- 172.21.15.107:0/4271838329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b6f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffb0effd700 1 -- 172.21.15.107:0/4271838329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 msgr2=0x561a34b6f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffb0effd700 1 --2- 172.21.15.107:0/4271838329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b6f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffb0effd700 1 -- 172.21.15.107:0/4271838329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 msgr2=0x561a34b6ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffb0effd700 1 --2- 172.21.15.107:0/4271838329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 0x561a34b6ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffb0effd700 1 -- 172.21.15.107:0/4271838329 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3493c630 con 0x561a34b6a4b0 2023-08-10T10:52:43.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffb0f7fe700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffaf80a9d10 0x7ffaf80ac1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffb1019f250 tx=0x7ffb08009f90 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffb0effd700 1 --2- 172.21.15.107:0/4271838329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b6a890 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ffb00097390 tx=0x7ffb0009a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e23dbdceff7097 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffaf57fa700 1 -- 172.21.15.107:0/4271838329 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0009ae90 con 0x561a34b6a4b0 2023-08-10T10:52:43.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffaf57fa700 1 -- 172.21.15.107:0/4271838329 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb0009eec0 con 0x561a34b6a4b0 2023-08-10T10:52:43.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.580+0000 7ffaf57fa700 1 -- 172.21.15.107:0/4271838329 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000a2dc0 con 0x561a34b6a4b0 2023-08-10T10:52:43.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.581+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/4271838329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 msgr2=0x561a34b6a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.581+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/4271838329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b6a890 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ffb00097390 tx=0x7ffb0009a8f0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.581+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/4271838329 shutdown_connections 2023-08-10T10:52:43.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.581+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/4271838329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b6f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.581+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/4271838329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b6a890 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.581+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/4271838329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 0x561a34b6ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.581+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/4271838329 >> 172.21.15.107:0/4271838329 conn(0x561a34ac7cd0 msgr2=0x561a34b65750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.581+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/4271838329 shutdown_connections 2023-08-10T10:52:43.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.581+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/4271838329 wait complete. 2023-08-10T10:52:43.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.582+0000 7ffb28c2bb80 1 -- start start 2023-08-10T10:52:43.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.582+0000 7ffb28c2bb80 1 Processor -- start 2023-08-10T10:52:43.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.582+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b769b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.582+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 0x561a34b73c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b74210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34abb7a0 con 0x561a34b6a4b0 2023-08-10T10:52:43.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34a5aac0 con 0x561a34b6add0 2023-08-10T10:52:43.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34a5a7c0 con 0x561a34b6f290 2023-08-10T10:52:43.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb28c2bb80 10 client.0 _ll_register_callbacks cb 0x561a34a58680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:43.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b769b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40864/0 (socket says 172.21.15.107:40864) 2023-08-10T10:52:43.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0effd700 1 -- 172.21.15.107:0/1893808897 learned_addr learned my addr 172.21.15.107:0/1893808897 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0f7fe700 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b74210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0e7fc700 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 0x561a34b73c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0effd700 1 -- 172.21.15.107:0/1893808897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 msgr2=0x561a34b74210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0effd700 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b74210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0effd700 1 -- 172.21.15.107:0/1893808897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 msgr2=0x561a34b73c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0effd700 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 0x561a34b73c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0effd700 1 -- 172.21.15.107:0/1893808897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb101a5540 con 0x561a34b6a4b0 2023-08-10T10:52:43.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffb0effd700 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b769b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffb0009ae20 tx=0x7ffb0000ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6bc72f3216ac27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.583+0000 7ffaf2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:43.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/1893808897 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000a3250 con 0x561a34b6a4b0 2023-08-10T10:52:43.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/1893808897 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ffb0009ae90 con 0x561a34b6a4b0 2023-08-10T10:52:43.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/1893808897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a34b5d470 con 0x561a34b6a4b0 2023-08-10T10:52:43.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/1893808897 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb000a2fd0 con 0x561a34b6a4b0 2023-08-10T10:52:43.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffb28c2bb80 10 client.16233 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:43.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/1893808897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561a348e8de0 con 0x561a34b6a4b0 2023-08-10T10:52:43.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/1893808897 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb0007d080 con 0x561a34b6a4b0 2023-08-10T10:52:43.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/1893808897 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7ffb000aeb90 con 0x561a34b6a4b0 2023-08-10T10:52:43.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffb28c2bb80 10 client.16233 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:43.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffb28c2bb80 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:43.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffb28c2bb80 20 client.16233 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:43.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561a34b83bb0 0x561a34b85fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffb28c2bb80 4 client.16233 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:43.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.584+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/1893808897 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a34b399d0 con 0x561a34b83bb0 2023-08-10T10:52:43.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.585+0000 7ffb0e7fc700 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561a34b83bb0 0x561a34b85fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.586+0000 7ffb0e7fc700 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561a34b83bb0 0x561a34b85fa0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ead2b389b2d1b02 server_cookie=eb858e576c75af84 in_seq=0 out_seq=0 2023-08-10T10:52:43.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.586+0000 7ffaf2ff5700 10 client.16233 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:43.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.586+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/1893808897 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561a34b399d0 con 0x561a34b83bb0 2023-08-10T10:52:43.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.586+0000 7ffaf2ff5700 10 client.16233 handle_command_reply: tid=0 2023-08-10T10:52:43.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.586+0000 7ffb28c2bb80 1 client.16233 shutdown 2023-08-10T10:52:43.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/1893808897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 msgr2=0x561a34b769b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b769b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffb0009ae20 tx=0x7ffb0000ff60 comp rx=0 tx=0).stop 2023-08-10T10:52:43.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/1893808897 shutdown_connections 2023-08-10T10:52:43.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561a34b83bb0 0x561a34b85fa0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b74210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6a4b0 0x561a34b769b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/1893808897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6add0 0x561a34b73c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/1893808897 >> 172.21.15.107:0/1893808897 conn(0x561a34ac7cd0 msgr2=0x561a34b70740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffaf2ff5700 0 client.16233 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:43.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/1893808897 shutdown_connections 2023-08-10T10:52:43.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/1893808897 wait complete. 2023-08-10T10:52:43.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.587+0000 7ffb28c2bb80 20 client.16233 trim_cache size 0 max 16384 2023-08-10T10:52:43.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.606+0000 7ffb28c2bb80 1 Processor -- start 2023-08-10T10:52:43.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.606+0000 7ffb28c2bb80 1 -- start start 2023-08-10T10:52:43.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b8a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 0x561a34b76550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3493e920 con 0x561a34b6add0 2023-08-10T10:52:43.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34b80a40 con 0x561a34b6a4b0 2023-08-10T10:52:43.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34b800c0 con 0x561a34b6f290 2023-08-10T10:52:43.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb0e7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 0x561a34b76550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb0effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b8a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb0e7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 0x561a34b76550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40878/0 (socket says 172.21.15.107:40878) 2023-08-10T10:52:43.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb0e7fc700 1 -- 172.21.15.107:0/2180724308 learned_addr learned my addr 172.21.15.107:0/2180724308 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.607+0000 7ffb0f7fe700 1 --2- 172.21.15.107:0/2180724308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.608+0000 7ffb0effd700 1 -- 172.21.15.107:0/2180724308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 msgr2=0x561a34b640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.608+0000 7ffb0effd700 1 --2- 172.21.15.107:0/2180724308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.608+0000 7ffb0effd700 1 -- 172.21.15.107:0/2180724308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 msgr2=0x561a34b76550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.608+0000 7ffb0effd700 1 --2- 172.21.15.107:0/2180724308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 0x561a34b76550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.608+0000 7ffb0effd700 1 -- 172.21.15.107:0/2180724308 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a348d1c60 con 0x561a34b6a4b0 2023-08-10T10:52:43.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.608+0000 7ffb0effd700 1 --2- 172.21.15.107:0/2180724308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b8a900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b5c0 tx=0x7ffb00009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caae8bbee7fa829a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.608+0000 7ffaf5ffb700 1 -- 172.21.15.107:0/2180724308 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000b3300 con 0x561a34b6a4b0 2023-08-10T10:52:43.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.608+0000 7ffaf5ffb700 1 -- 172.21.15.107:0/2180724308 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561a34b5d470 con 0x561a34b6a4b0 2023-08-10T10:52:43.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.608+0000 7ffaf5ffb700 1 -- 172.21.15.107:0/2180724308 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000a3250 con 0x561a34b6a4b0 2023-08-10T10:52:43.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.609+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/2180724308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 msgr2=0x561a34b8a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.609+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/2180724308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b8a900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b5c0 tx=0x7ffb00009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.609+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/2180724308 shutdown_connections 2023-08-10T10:52:43.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.609+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/2180724308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b8a900 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.609+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/2180724308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.609+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/2180724308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 0x561a34b76550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.609+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/2180724308 >> 172.21.15.107:0/2180724308 conn(0x561a34ac7cd0 msgr2=0x561a34b65230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.609+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/2180724308 shutdown_connections 2023-08-10T10:52:43.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.610+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/2180724308 wait complete. 2023-08-10T10:52:43.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.610+0000 7ffb28c2bb80 1 -- start start 2023-08-10T10:52:43.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.610+0000 7ffb28c2bb80 1 Processor -- start 2023-08-10T10:52:43.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.611+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b7ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.611+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 0x561a34b7b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.611+0000 7ffb28c2bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b79270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.611+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34b79950 con 0x561a34b6add0 2023-08-10T10:52:43.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.611+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34b79ac0 con 0x561a34b6a4b0 2023-08-10T10:52:43.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.611+0000 7ffb28c2bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a34b79c80 con 0x561a34b6f290 2023-08-10T10:52:43.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.611+0000 7ffb28c2bb80 10 client.0 _ll_register_callbacks cb 0x561a34a58680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:43.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b79270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b79270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55382/0 (socket says 172.21.15.107:55382) 2023-08-10T10:52:43.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0f7fe700 1 -- 172.21.15.107:0/580432239 learned_addr learned my addr 172.21.15.107:0/580432239 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:43.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0effd700 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b7ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0effd700 1 -- 172.21.15.107:0/580432239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 msgr2=0x561a34b79270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0effd700 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b79270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0effd700 1 -- 172.21.15.107:0/580432239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 msgr2=0x561a34b7b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:43.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0effd700 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 0x561a34b7b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0effd700 1 -- 172.21.15.107:0/580432239 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a348e8de0 con 0x561a34b6a4b0 2023-08-10T10:52:43.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0f7fe700 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b79270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:43.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffb0effd700 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b7ad40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b5c0 tx=0x7ffb00009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de5b2248e8e6b8ac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:43.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.612+0000 7ffaf2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:52:43.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.613+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/580432239 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000a3250 con 0x561a34b6a4b0 2023-08-10T10:52:43.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.613+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/580432239 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ffb0009ae90 con 0x561a34b6a4b0 2023-08-10T10:52:43.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.613+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/580432239 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb0009eec0 con 0x561a34b6a4b0 2023-08-10T10:52:43.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.613+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/580432239 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb00099230 con 0x561a34b6a4b0 2023-08-10T10:52:43.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.613+0000 7ffb28c2bb80 10 client.25913 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:43.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.613+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/580432239 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561a3490f250 con 0x561a34b6a4b0 2023-08-10T10:52:43.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.613+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/580432239 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb0007d070 con 0x561a34b6a4b0 2023-08-10T10:52:43.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.614+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/580432239 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7ffb00096e10 con 0x561a34b6a4b0 2023-08-10T10:52:43.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.614+0000 7ffb28c2bb80 10 client.25913 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:43.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.614+0000 7ffb28c2bb80 10 client.25913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:43.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.614+0000 7ffb28c2bb80 20 client.25913 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:43.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.614+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561a34bd8610 0x561a34bdaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:43.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.614+0000 7ffb28c2bb80 4 client.25913 mds_command: new command op to 24575 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:52:43.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.614+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/580432239 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561a34ab4780 con 0x561a34bd8610 2023-08-10T10:52:43.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.614+0000 7ffb0e7fc700 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561a34bd8610 0x561a34bdaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:43.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.615+0000 7ffb0e7fc700 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561a34bd8610 0x561a34bdaa00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85aa1d4230278fba server_cookie=f64d4a90bf838fb2 in_seq=0 out_seq=0 2023-08-10T10:52:43.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.615+0000 7ffaf2ff5700 10 client.25913 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:43.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffaf2ff5700 1 -- 172.21.15.107:0/580432239 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561a34ab4780 con 0x561a34bd8610 2023-08-10T10:52:43.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffaf2ff5700 10 client.25913 handle_command_reply: tid=0 2023-08-10T10:52:43.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 client.25913 shutdown 2023-08-10T10:52:43.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/580432239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 msgr2=0x561a34b7ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b7ad40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b5c0 tx=0x7ffb00009ee0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/580432239 shutdown_connections 2023-08-10T10:52:43.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x561a34bd8610 0x561a34bdaa00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561a34b6a4b0 0x561a34b7ad40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a34b6f290 0x561a34b79270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffaf2ff5700 0 client.25913 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:43.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 --2- 172.21.15.107:0/580432239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a34b6add0 0x561a34b7b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/580432239 >> 172.21.15.107:0/580432239 conn(0x561a34ac7cd0 msgr2=0x561a34b640f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/580432239 shutdown_connections 2023-08-10T10:52:43.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 1 -- 172.21.15.107:0/580432239 wait complete. 2023-08-10T10:52:43.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.616+0000 7ffb28c2bb80 20 client.25913 trim_cache size 0 max 16384 2023-08-10T10:52:43.623 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:52:43.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 -- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffaf80a9d10 msgr2=0x7ffaf80ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffaf80a9d10 0x7ffaf80ac1d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffb1019f250 tx=0x7ffb08009f90 comp rx=0 tx=0).stop 2023-08-10T10:52:43.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 -- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 msgr2=0x7ffb1019e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:43.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 0x7ffb1019e5c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ffb00005910 tx=0x7ffb00009580 comp rx=0 tx=0).stop 2023-08-10T10:52:43.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 -- 172.21.15.107:0/1496009544 shutdown_connections 2023-08-10T10:52:43.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffaf80a9d10 0x7ffaf80ac1d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb1010ce20 0x7ffb101985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10072b20 0x7ffb1019e5c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 --2- 172.21.15.107:0/1496009544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb10073440 0x7ffb1019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:43.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 -- 172.21.15.107:0/1496009544 >> 172.21.15.107:0/1496009544 conn(0x7ffb100fc030 msgr2=0x7ffb1010eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:43.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.617+0000 7ffb0ffff700 1 -- 172.21.15.107:0/1496009544 shutdown_connections 2023-08-10T10:52:43.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:43.618+0000 7ffb0ffff700 1 -- 172.21.15.107:0/1496009544 wait complete. 2023-08-10T10:52:44.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:43 smithi157 ceph-mon[129604]: pgmap v48: 129 pgs: 129 active+clean; 911 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:43 smithi107 ceph-mon[127953]: pgmap v48: 129 pgs: 129 active+clean; 911 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:44.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:43 smithi195 ceph-mon[129938]: pgmap v48: 129 pgs: 129 active+clean; 911 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:52:44.644 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-10T10:52:44.644 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-10T10:52:44.879 INFO:teuthology.orchestra.run.smithi107.stderr:4100000 of 50000000 tuples (8%) done (elapsed 63.06 s, remaining 705.93 s) 2023-08-10T10:52:44.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.884+0000 7fdf5b59e700 1 -- 172.21.15.107:0/852907162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 msgr2=0x7fdf5c108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.884+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/852907162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 0x7fdf5c108b80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009990 tx=0x7fdf4c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.884+0000 7fdf5b59e700 1 -- 172.21.15.107:0/852907162 shutdown_connections 2023-08-10T10:52:44.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.884+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/852907162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf5c103150 0x7fdf5c10f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.884+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/852907162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 0x7fdf5c108b80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.884+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/852907162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf5c102790 0x7fdf5c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.884+0000 7fdf5b59e700 1 -- 172.21.15.107:0/852907162 >> 172.21.15.107:0/852907162 conn(0x7fdf5c0fe200 msgr2=0x7fdf5c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.884+0000 7fdf5b59e700 1 -- 172.21.15.107:0/852907162 shutdown_connections 2023-08-10T10:52:44.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.884+0000 7fdf5b59e700 1 -- 172.21.15.107:0/852907162 wait complete. 2023-08-10T10:52:44.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.885+0000 7fdf5b59e700 1 Processor -- start 2023-08-10T10:52:44.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.885+0000 7fdf5b59e700 1 -- start start 2023-08-10T10:52:44.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.885+0000 7fdf5b59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf5c102790 0x7fdf5c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5b59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf5c103150 0x7fdf5c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 0x7fdf5c19cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5b59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c19d630 con 0x7fdf5c1087a0 2023-08-10T10:52:44.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5b59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c19d7a0 con 0x7fdf5c102790 2023-08-10T10:52:44.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5b59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c19d960 con 0x7fdf5c103150 2023-08-10T10:52:44.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 0x7fdf5c19cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 0x7fdf5c19cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40898/0 (socket says 172.21.15.107:40898) 2023-08-10T10:52:44.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5ad9d700 1 -- 172.21.15.107:0/2983731350 learned_addr learned my addr 172.21.15.107:0/2983731350 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:44.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf5c102790 0x7fdf5c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf5c103150 0x7fdf5c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5ad9d700 1 -- 172.21.15.107:0/2983731350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf5c103150 msgr2=0x7fdf5c198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5ad9d700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf5c103150 0x7fdf5c198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5ad9d700 1 -- 172.21.15.107:0/2983731350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf5c102790 msgr2=0x7fdf5c198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5ad9d700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf5c102790 0x7fdf5c198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.886+0000 7fdf5ad9d700 1 -- 172.21.15.107:0/2983731350 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c0095f0 con 0x7fdf5c1087a0 2023-08-10T10:52:44.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.887+0000 7fdf5ad9d700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 0x7fdf5c19cff0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400ef30 tx=0x7fdf5400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.887+0000 7fdf4b7fe700 1 -- 172.21.15.107:0/2983731350 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54018070 con 0x7fdf5c1087a0 2023-08-10T10:52:44.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.887+0000 7fdf4b7fe700 1 -- 172.21.15.107:0/2983731350 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf5400f040 con 0x7fdf5c1087a0 2023-08-10T10:52:44.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.887+0000 7fdf5b59e700 1 -- 172.21.15.107:0/2983731350 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c19dbe0 con 0x7fdf5c1087a0 2023-08-10T10:52:44.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.887+0000 7fdf4b7fe700 1 -- 172.21.15.107:0/2983731350 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5400cbc0 con 0x7fdf5c1087a0 2023-08-10T10:52:44.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.887+0000 7fdf5b59e700 1 -- 172.21.15.107:0/2983731350 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c1a5480 con 0x7fdf5c1087a0 2023-08-10T10:52:44.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.890+0000 7fdf4b7fe700 1 -- 172.21.15.107:0/2983731350 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdf5400cd80 con 0x7fdf5c1087a0 2023-08-10T10:52:44.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf747a1b80 1 Processor -- start 2023-08-10T10:52:44.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf747a1b80 1 -- start start 2023-08-10T10:52:44.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc864910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc868dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 0x5598cc869770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc7dfe40 con 0x5598cc864530 2023-08-10T10:52:44.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc7bc610 con 0x5598cc869310 2023-08-10T10:52:44.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc7b9f30 con 0x5598cc864e50 2023-08-10T10:52:44.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf4b7fe700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdf440a1360 0x7fdf440a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.892+0000 7fdf59d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc864910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf59d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc864910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40914/0 (socket says 172.21.15.107:40914) 2023-08-10T10:52:44.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf59d9b700 1 -- 172.21.15.107:0/3591043589 learned_addr learned my addr 172.21.15.107:0/3591043589 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:44.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/3591043589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc868dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf4b7fe700 1 -- 172.21.15.107:0/2983731350 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fdf540cc8b0 con 0x7fdf5c1087a0 2023-08-10T10:52:44.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf5ad9d700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdf440a1360 0x7fdf440a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/3591043589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 0x5598cc869770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf5a59c700 1 -- 172.21.15.107:0/3591043589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 msgr2=0x5598cc869770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/3591043589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 0x5598cc869770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf5a59c700 1 -- 172.21.15.107:0/3591043589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 msgr2=0x5598cc864910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/3591043589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc864910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.893+0000 7fdf5a59c700 1 -- 172.21.15.107:0/3591043589 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598cc6366b0 con 0x5598cc864e50 2023-08-10T10:52:44.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.894+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/3591043589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc868dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c005910 tx=0x7fdf4c005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cbf2621bfc5e1f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.894+0000 7fdf5ad9d700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdf440a1360 0x7fdf440a3820 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009f40 tx=0x7fdf54009ed0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.894+0000 7fdf48ff9700 1 -- 172.21.15.107:0/3591043589 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c01d070 con 0x5598cc864e50 2023-08-10T10:52:44.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.894+0000 7fdf48ff9700 1 -- 172.21.15.107:0/3591043589 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf4c01e040 con 0x5598cc864e50 2023-08-10T10:52:44.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.894+0000 7fdf48ff9700 1 -- 172.21.15.107:0/3591043589 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c004760 con 0x5598cc864e50 2023-08-10T10:52:44.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.895+0000 7fdf747a1b80 1 -- 172.21.15.107:0/3591043589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 msgr2=0x5598cc868dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.895+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/3591043589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc868dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c005910 tx=0x7fdf4c005f00 comp rx=0 tx=0).stop 2023-08-10T10:52:44.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.895+0000 7fdf747a1b80 1 -- 172.21.15.107:0/3591043589 shutdown_connections 2023-08-10T10:52:44.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.895+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/3591043589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 0x5598cc869770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.895+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/3591043589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc864910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.895+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/3591043589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc868dd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.895+0000 7fdf747a1b80 1 -- 172.21.15.107:0/3591043589 >> 172.21.15.107:0/3591043589 conn(0x5598cc7c1d50 msgr2=0x5598cc85f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.895+0000 7fdf747a1b80 1 -- 172.21.15.107:0/3591043589 shutdown_connections 2023-08-10T10:52:44.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.895+0000 7fdf747a1b80 1 -- 172.21.15.107:0/3591043589 wait complete. 2023-08-10T10:52:44.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.896+0000 7fdf747a1b80 1 -- start start 2023-08-10T10:52:44.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.896+0000 7fdf747a1b80 1 Processor -- start 2023-08-10T10:52:44.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.896+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864530 0x5598cc870ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.896+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864e50 0x5598cc86dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.896+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc869310 0x5598cc86e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.896+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc7b5820 con 0x5598cc864e50 2023-08-10T10:52:44.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.896+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc754b40 con 0x5598cc864530 2023-08-10T10:52:44.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.896+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc754840 con 0x5598cc869310 2023-08-10T10:52:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.896+0000 7fdf747a1b80 10 client.0 _ll_register_callbacks cb 0x5598cc752700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.897+0000 7fdf59d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864530 0x5598cc870ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.897+0000 7fdf59d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864530 0x5598cc870ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:50130/0 (socket says 172.21.15.107:50130) 2023-08-10T10:52:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.897+0000 7fdf59d9b700 1 -- 172.21.15.107:0/267755864 learned_addr learned my addr 172.21.15.107:0/267755864 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.897+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864e50 0x5598cc86dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.897+0000 7fdf59d9b700 1 -- 172.21.15.107:0/267755864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc869310 msgr2=0x5598cc86e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.897+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc869310 0x5598cc86e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.897+0000 7fdf59d9b700 1 -- 172.21.15.107:0/267755864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864e50 msgr2=0x5598cc86dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.897+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864e50 0x5598cc86dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.897+0000 7fdf59d9b700 1 -- 172.21.15.107:0/267755864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c10ff60 con 0x5598cc864530 2023-08-10T10:52:44.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.898+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864530 0x5598cc870ae0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009e30 tx=0x7fdf50010f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba27ab9f1c4d06bf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.898+0000 7fdf41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:52:44.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.898+0000 7fdf41ffb700 1 -- 172.21.15.107:0/267755864 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50004460 con 0x5598cc864530 2023-08-10T10:52:44.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.898+0000 7fdf747a1b80 1 -- 172.21.15.107:0/267755864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598cc8574f0 con 0x5598cc864530 2023-08-10T10:52:44.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.898+0000 7fdf41ffb700 1 -- 172.21.15.107:0/267755864 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fdf5000f7d0 con 0x5598cc864530 2023-08-10T10:52:44.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.898+0000 7fdf41ffb700 1 -- 172.21.15.107:0/267755864 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf5000f990 con 0x5598cc864530 2023-08-10T10:52:44.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.898+0000 7fdf747a1b80 10 client.25925 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:44.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.898+0000 7fdf747a1b80 1 -- 172.21.15.107:0/267755864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5598cc5e2e60 con 0x5598cc864530 2023-08-10T10:52:44.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.899+0000 7fdf41ffb700 1 -- 172.21.15.107:0/267755864 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598cc8574f0 con 0x5598cc864530 2023-08-10T10:52:44.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.899+0000 7fdf41ffb700 1 -- 172.21.15.107:0/267755864 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fdf5001f440 con 0x5598cc864530 2023-08-10T10:52:44.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.899+0000 7fdf747a1b80 10 client.25925 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:44.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.899+0000 7fdf747a1b80 10 client.25925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:44.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.899+0000 7fdf747a1b80 20 client.25925 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:44.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.899+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5598cc87e440 0x5598cc880860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.899+0000 7fdf747a1b80 4 client.25925 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:44.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.899+0000 7fdf747a1b80 1 -- 172.21.15.107:0/267755864 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598cc833a50 con 0x5598cc87e440 2023-08-10T10:52:44.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.899+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5598cc87e440 0x5598cc880860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.900+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5598cc87e440 0x5598cc880860 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e061fcb500cc0f6 server_cookie=31523e9d57d167eb in_seq=0 out_seq=0 2023-08-10T10:52:44.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.900+0000 7fdf41ffb700 10 client.25925 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:44.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.900+0000 7fdf41ffb700 1 -- 172.21.15.107:0/267755864 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5598cc833a50 con 0x5598cc87e440 2023-08-10T10:52:44.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.900+0000 7fdf41ffb700 10 client.25925 handle_command_reply: tid=0 2023-08-10T10:52:44.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 client.25925 shutdown 2023-08-10T10:52:44.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 -- 172.21.15.107:0/267755864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864530 msgr2=0x5598cc870ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864530 0x5598cc870ae0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009e30 tx=0x7fdf50010f20 comp rx=0 tx=0).stop 2023-08-10T10:52:44.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 -- 172.21.15.107:0/267755864 shutdown_connections 2023-08-10T10:52:44.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5598cc87e440 0x5598cc880860 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864530 0x5598cc870ae0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf41ffb700 0 client.25925 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:44.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc869310 0x5598cc86e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/267755864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864e50 0x5598cc86dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 -- 172.21.15.107:0/267755864 >> 172.21.15.107:0/267755864 conn(0x5598cc7c1d50 msgr2=0x5598cc86a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 -- 172.21.15.107:0/267755864 shutdown_connections 2023-08-10T10:52:44.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 1 -- 172.21.15.107:0/267755864 wait complete. 2023-08-10T10:52:44.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.901+0000 7fdf747a1b80 20 client.25925 trim_cache size 0 max 16384 2023-08-10T10:52:44.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.927+0000 7fdf747a1b80 1 Processor -- start 2023-08-10T10:52:44.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.928+0000 7fdf747a1b80 1 -- start start 2023-08-10T10:52:44.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.928+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc875510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.928+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc86b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.928+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 0x5598cc870680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.928+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc6389a0 con 0x5598cc864530 2023-08-10T10:52:44.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.928+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc86eda0 con 0x5598cc869310 2023-08-10T10:52:44.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.928+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc86c2c0 con 0x5598cc864e50 2023-08-10T10:52:44.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf59d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc875510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf5a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc86b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf5a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc86b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55436/0 (socket says 172.21.15.107:55436) 2023-08-10T10:52:44.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf5a59c700 1 -- 172.21.15.107:0/234726168 learned_addr learned my addr 172.21.15.107:0/234726168 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:44.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/234726168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 0x5598cc870680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf5a59c700 1 -- 172.21.15.107:0/234726168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 msgr2=0x5598cc870680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/234726168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 0x5598cc870680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf5a59c700 1 -- 172.21.15.107:0/234726168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 msgr2=0x5598cc875510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/234726168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc875510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf5a59c700 1 -- 172.21.15.107:0/234726168 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598cc5cbce0 con 0x5598cc864e50 2023-08-10T10:52:44.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/234726168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc875510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:44.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.929+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/234726168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc86b6e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009520 tx=0x7fdf4c01a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3152ed0f3147e93a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.930+0000 7fdf497fa700 1 -- 172.21.15.107:0/234726168 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c01d040 con 0x5598cc864e50 2023-08-10T10:52:44.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.930+0000 7fdf497fa700 1 -- 172.21.15.107:0/234726168 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf4c005600 con 0x5598cc864e50 2023-08-10T10:52:44.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.930+0000 7fdf497fa700 1 -- 172.21.15.107:0/234726168 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c034b70 con 0x5598cc864e50 2023-08-10T10:52:44.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 -- 172.21.15.107:0/234726168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 msgr2=0x5598cc86b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/234726168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc86b6e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009520 tx=0x7fdf4c01a040 comp rx=0 tx=0).stop 2023-08-10T10:52:44.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 -- 172.21.15.107:0/234726168 shutdown_connections 2023-08-10T10:52:44.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/234726168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc869310 0x5598cc870680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/234726168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc875510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/234726168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc864e50 0x5598cc86b6e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 -- 172.21.15.107:0/234726168 >> 172.21.15.107:0/234726168 conn(0x5598cc7c1d50 msgr2=0x5598cc86afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 -- 172.21.15.107:0/234726168 shutdown_connections 2023-08-10T10:52:44.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 -- 172.21.15.107:0/234726168 wait complete. 2023-08-10T10:52:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.931+0000 7fdf747a1b80 1 -- start start 2023-08-10T10:52:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf747a1b80 1 Processor -- start 2023-08-10T10:52:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc874df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864e50 0x5598cc875330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf747a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc869310 0x5598cc86d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc86d720 con 0x5598cc864530 2023-08-10T10:52:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc86d860 con 0x5598cc864e50 2023-08-10T10:52:44.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf747a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc86da20 con 0x5598cc869310 2023-08-10T10:52:44.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf747a1b80 10 client.0 _ll_register_callbacks cb 0x5598cc752700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:44.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf59d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc874df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf59d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc874df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40956/0 (socket says 172.21.15.107:40956) 2023-08-10T10:52:44.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf59d9b700 1 -- 172.21.15.107:0/2193050866 learned_addr learned my addr 172.21.15.107:0/2193050866 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:44.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.932+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864e50 0x5598cc875330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc869310 0x5598cc86d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf59d9b700 1 -- 172.21.15.107:0/2193050866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc869310 msgr2=0x5598cc86d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc869310 0x5598cc86d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf59d9b700 1 -- 172.21.15.107:0/2193050866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864e50 msgr2=0x5598cc875330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:44.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864e50 0x5598cc875330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf59d9b700 1 -- 172.21.15.107:0/2193050866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598cc5e2e60 con 0x5598cc864530 2023-08-10T10:52:44.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf59d9b700 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc874df0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdf50010850 tx=0x7fdf50009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588bc3a69d86230d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:44.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:44.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf41ffb700 1 -- 172.21.15.107:0/2193050866 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5000f6a0 con 0x5598cc864530 2023-08-10T10:52:44.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf747a1b80 1 -- 172.21.15.107:0/2193050866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf4c01e040 con 0x5598cc864530 2023-08-10T10:52:44.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf41ffb700 1 -- 172.21.15.107:0/2193050866 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fdf50000e40 con 0x5598cc864530 2023-08-10T10:52:44.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.933+0000 7fdf41ffb700 1 -- 172.21.15.107:0/2193050866 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf5000f800 con 0x5598cc864530 2023-08-10T10:52:44.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf747a1b80 10 client.16254 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:44.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf747a1b80 1 -- 172.21.15.107:0/2193050866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5598cc6366b0 con 0x5598cc864530 2023-08-10T10:52:44.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf41ffb700 1 -- 172.21.15.107:0/2193050866 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf4c01e040 con 0x5598cc864530 2023-08-10T10:52:44.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf41ffb700 1 -- 172.21.15.107:0/2193050866 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fdf500039d0 con 0x5598cc864530 2023-08-10T10:52:44.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf747a1b80 10 client.16254 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:44.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf747a1b80 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:44.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf747a1b80 20 client.16254 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:44.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5598cc8d4270 0x5598cc8e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:44.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf747a1b80 4 client.16254 mds_command: new command op to 24575 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-10T10:52:44.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf747a1b80 1 -- 172.21.15.107:0/2193050866 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5598cc7ae800 con 0x5598cc8d4270 2023-08-10T10:52:44.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.934+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5598cc8d4270 0x5598cc8e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:44.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.935+0000 7fdf5a59c700 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5598cc8d4270 0x5598cc8e78e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fd59c8942db679e server_cookie=695b877e4acc58bc in_seq=0 out_seq=0 2023-08-10T10:52:44.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.935+0000 7fdf41ffb700 10 client.16254 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:44.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf41ffb700 1 -- 172.21.15.107:0/2193050866 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5598cc7ae800 con 0x5598cc8d4270 2023-08-10T10:52:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf41ffb700 10 client.16254 handle_command_reply: tid=0 2023-08-10T10:52:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf747a1b80 1 client.16254 shutdown 2023-08-10T10:52:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf747a1b80 1 -- 172.21.15.107:0/2193050866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 msgr2=0x5598cc874df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc874df0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdf50010850 tx=0x7fdf50009fd0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf747a1b80 1 -- 172.21.15.107:0/2193050866 shutdown_connections 2023-08-10T10:52:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5598cc8d4270 0x5598cc8e78e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598cc869310 0x5598cc86d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598cc864530 0x5598cc874df0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf747a1b80 1 --2- 172.21.15.107:0/2193050866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5598cc864e50 0x5598cc875330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.936+0000 7fdf41ffb700 0 client.16254 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.937+0000 7fdf747a1b80 1 -- 172.21.15.107:0/2193050866 >> 172.21.15.107:0/2193050866 conn(0x5598cc7c1d50 msgr2=0x5598cc869df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.937+0000 7fdf747a1b80 1 -- 172.21.15.107:0/2193050866 shutdown_connections 2023-08-10T10:52:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.937+0000 7fdf747a1b80 1 -- 172.21.15.107:0/2193050866 wait complete. 2023-08-10T10:52:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.937+0000 7fdf747a1b80 20 client.16254 trim_cache size 0 max 16384 2023-08-10T10:52:44.945 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:52:44.945 INFO:teuthology.orchestra.run.smithi107.stdout: "return_code": 0, 2023-08-10T10:52:44.945 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_tag": "e839591c-0eb9-42de-a357-538c29c99df0", 2023-08-10T10:52:44.945 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": "asynchronous" 2023-08-10T10:52:44.945 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:52:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.937+0000 7fdf5b59e700 1 -- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdf440a1360 msgr2=0x7fdf440a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.937+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdf440a1360 0x7fdf440a3820 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009f40 tx=0x7fdf54009ed0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.937+0000 7fdf5b59e700 1 -- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 msgr2=0x7fdf5c19cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.937+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 0x7fdf5c19cff0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400ef30 tx=0x7fdf5400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.938+0000 7fdf5b59e700 1 -- 172.21.15.107:0/2983731350 shutdown_connections 2023-08-10T10:52:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.938+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdf440a1360 0x7fdf440a3820 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.938+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf5c102790 0x7fdf5c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.938+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf5c1087a0 0x7fdf5c19cff0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.938+0000 7fdf5b59e700 1 --2- 172.21.15.107:0/2983731350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf5c103150 0x7fdf5c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:44.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.938+0000 7fdf5b59e700 1 -- 172.21.15.107:0/2983731350 >> 172.21.15.107:0/2983731350 conn(0x7fdf5c0fe200 msgr2=0x7fdf5c1062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:44.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.938+0000 7fdf5b59e700 1 -- 172.21.15.107:0/2983731350 shutdown_connections 2023-08-10T10:52:44.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:44.938+0000 7fdf5b59e700 1 -- 172.21.15.107:0/2983731350 wait complete. 2023-08-10T10:52:44.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:52:45.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.200+0000 7f8c6d39d700 1 -- 172.21.15.107:0/2717797760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68106620 msgr2=0x7f8c68106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.200+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/2717797760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68106620 0x7f8c68106a00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8c580099c0 tx=0x7f8c58009cd0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.201+0000 7f8c6d39d700 1 -- 172.21.15.107:0/2717797760 shutdown_connections 2023-08-10T10:52:45.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.201+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/2717797760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c68100f20 0x7f8c6810d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.201+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/2717797760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68106620 0x7f8c68106a00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.201+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/2717797760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c68100560 0x7f8c681009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.201+0000 7f8c6d39d700 1 -- 172.21.15.107:0/2717797760 >> 172.21.15.107:0/2717797760 conn(0x7f8c680fc010 msgr2=0x7f8c680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:45.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.201+0000 7f8c6d39d700 1 -- 172.21.15.107:0/2717797760 shutdown_connections 2023-08-10T10:52:45.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.201+0000 7f8c6d39d700 1 -- 172.21.15.107:0/2717797760 wait complete. 2023-08-10T10:52:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.202+0000 7f8c6d39d700 1 Processor -- start 2023-08-10T10:52:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.202+0000 7f8c6d39d700 1 -- start start 2023-08-10T10:52:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.202+0000 7f8c6d39d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c68100560 0x7f8c68198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.202+0000 7f8c6d39d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c68100f20 0x7f8c68198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.202+0000 7f8c6d39d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68106620 0x7f8c6819d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.202+0000 7f8c6d39d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6819d640 con 0x7f8c68106620 2023-08-10T10:52:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.202+0000 7f8c6d39d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6819d7b0 con 0x7f8c68100560 2023-08-10T10:52:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.202+0000 7f8c6d39d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6819d970 con 0x7f8c68100f20 2023-08-10T10:52:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c67fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c68100560 0x7f8c68198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c6cb9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68106620 0x7f8c6819d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c67fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c68100560 0x7f8c68198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:50164/0 (socket says 172.21.15.107:50164) 2023-08-10T10:52:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c67fff700 1 -- 172.21.15.107:0/3376075483 learned_addr learned my addr 172.21.15.107:0/3376075483 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c677fe700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c68100f20 0x7f8c68198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c67fff700 1 -- 172.21.15.107:0/3376075483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c68100f20 msgr2=0x7f8c68198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c67fff700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c68100f20 0x7f8c68198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c67fff700 1 -- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68106620 msgr2=0x7f8c6819d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c67fff700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68106620 0x7f8c6819d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c67fff700 1 -- 172.21.15.107:0/3376075483 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009520 con 0x7f8c68100560 2023-08-10T10:52:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68106620 0x7f8c6819d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.203+0000 7f8c67fff700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c68100560 0x7f8c68198660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c58005910 tx=0x7f8c5800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.204+0000 7f8c657fa700 1 -- 172.21.15.107:0/3376075483 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5801d070 con 0x7f8c68100560 2023-08-10T10:52:45.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.204+0000 7f8c6d39d700 1 -- 172.21.15.107:0/3376075483 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c580095f0 con 0x7f8c68100560 2023-08-10T10:52:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.204+0000 7f8c657fa700 1 -- 172.21.15.107:0/3376075483 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c58005050 con 0x7f8c68100560 2023-08-10T10:52:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.204+0000 7f8c657fa700 1 -- 172.21.15.107:0/3376075483 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58004950 con 0x7f8c68100560 2023-08-10T10:52:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.204+0000 7f8c6d39d700 1 -- 172.21.15.107:0/3376075483 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c681a52b0 con 0x7f8c68100560 2023-08-10T10:52:45.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.208+0000 7f8c657fa700 1 -- 172.21.15.107:0/3376075483 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f8c580051c0 con 0x7f8c68100560 2023-08-10T10:52:45.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.209+0000 7f8c81effb80 1 Processor -- start 2023-08-10T10:52:45.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c81effb80 1 -- start start 2023-08-10T10:52:45.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f466644b0 0x563f46664890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c657fa700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8c500a1360 0x7f8c500a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f46664dd0 0x563f46668d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f466696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c81effb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f465dfdc0 con 0x563f466644b0 2023-08-10T10:52:45.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c81effb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f465bc590 con 0x563f46669290 2023-08-10T10:52:45.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c81effb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f465b9eb0 con 0x563f46664dd0 2023-08-10T10:52:45.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c657fa700 1 -- 172.21.15.107:0/3376075483 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f8c580cdd80 con 0x7f8c68100560 2023-08-10T10:52:45.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c6cb9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f466644b0 0x563f46664890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.210+0000 7f8c6cb9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f466644b0 0x563f46664890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40990/0 (socket says 172.21.15.107:40990) 2023-08-10T10:52:45.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c6cb9c700 1 -- 172.21.15.107:0/3605110125 learned_addr learned my addr 172.21.15.107:0/3605110125 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:45.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c677fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f46664dd0 0x563f46668d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/3605110125 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f466696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c67fff700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8c500a1360 0x7f8c500a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c677fe700 1 -- 172.21.15.107:0/3605110125 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 msgr2=0x563f466696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:45.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c677fe700 1 --2- 172.21.15.107:0/3605110125 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f466696f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c677fe700 1 -- 172.21.15.107:0/3605110125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f466644b0 msgr2=0x563f46664890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:45.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c677fe700 1 --2- 172.21.15.107:0/3605110125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f466644b0 0x563f46664890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c677fe700 1 -- 172.21.15.107:0/3605110125 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f46436630 con 0x563f46664dd0 2023-08-10T10:52:45.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/3605110125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f466644b0 0x563f46664890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:52:45.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c677fe700 1 --2- 172.21.15.107:0/3605110125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f46664dd0 0x563f46668d50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009e10 tx=0x7f8c5c011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9364237fd91f25bb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:45.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.211+0000 7f8c67fff700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8c500a1360 0x7f8c500a3820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c5809a880 tx=0x7f8c5809ec60 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:45.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c4e7fc700 1 -- 172.21.15.107:0/3605110125 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c019630 con 0x563f46664dd0 2023-08-10T10:52:45.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c4e7fc700 1 -- 172.21.15.107:0/3605110125 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c5c019c20 con 0x563f46664dd0 2023-08-10T10:52:45.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c4e7fc700 1 -- 172.21.15.107:0/3605110125 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00ebd0 con 0x563f46664dd0 2023-08-10T10:52:45.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c81effb80 1 -- 172.21.15.107:0/3605110125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f46664dd0 msgr2=0x563f46668d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c81effb80 1 --2- 172.21.15.107:0/3605110125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f46664dd0 0x563f46668d50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009e10 tx=0x7f8c5c011720 comp rx=0 tx=0).stop 2023-08-10T10:52:45.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c81effb80 1 -- 172.21.15.107:0/3605110125 shutdown_connections 2023-08-10T10:52:45.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c81effb80 1 --2- 172.21.15.107:0/3605110125 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f466696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c81effb80 1 --2- 172.21.15.107:0/3605110125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f466644b0 0x563f46664890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c81effb80 1 --2- 172.21.15.107:0/3605110125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f46664dd0 0x563f46668d50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.212+0000 7f8c81effb80 1 -- 172.21.15.107:0/3605110125 >> 172.21.15.107:0/3605110125 conn(0x563f465c1cd0 msgr2=0x563f4665f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:45.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.213+0000 7f8c81effb80 1 -- 172.21.15.107:0/3605110125 shutdown_connections 2023-08-10T10:52:45.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.213+0000 7f8c81effb80 1 -- 172.21.15.107:0/3605110125 wait complete. 2023-08-10T10:52:45.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.213+0000 7f8c81effb80 1 -- start start 2023-08-10T10:52:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c81effb80 1 Processor -- start 2023-08-10T10:52:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46670aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f4666dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f4666e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c81effb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f465b57a0 con 0x563f46664dd0 2023-08-10T10:52:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c81effb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f46554ac0 con 0x563f46669290 2023-08-10T10:52:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c81effb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f465547c0 con 0x563f466644b0 2023-08-10T10:52:45.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c81effb80 10 client.0 _ll_register_callbacks cb 0x563f46552680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:45.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c677fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f4666dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c677fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f4666dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40998/0 (socket says 172.21.15.107:40998) 2023-08-10T10:52:45.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.214+0000 7f8c677fe700 1 -- 172.21.15.107:0/2084620368 learned_addr learned my addr 172.21.15.107:0/2084620368 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:45.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46670aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f4666e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c677fe700 1 -- 172.21.15.107:0/2084620368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 msgr2=0x563f46670aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:45.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c677fe700 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46670aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c677fe700 1 -- 172.21.15.107:0/2084620368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 msgr2=0x563f4666e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:45.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c677fe700 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f4666e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c677fe700 1 -- 172.21.15.107:0/2084620368 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c600089b0 con 0x563f46664dd0 2023-08-10T10:52:45.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c677fe700 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f4666dd20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000c00 tx=0x7f8c5c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd34d6eb3b7531b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:45.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c477fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:45.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.215+0000 7f8c477fe700 1 -- 172.21.15.107:0/2084620368 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c004230 con 0x563f46664dd0 2023-08-10T10:52:45.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c81effb80 1 -- 172.21.15.107:0/2084620368 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f46657470 con 0x563f46664dd0 2023-08-10T10:52:45.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c477fe700 1 -- 172.21.15.107:0/2084620368 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f8c5c004390 con 0x563f46664dd0 2023-08-10T10:52:45.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c477fe700 1 -- 172.21.15.107:0/2084620368 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c5c004550 con 0x563f46664dd0 2023-08-10T10:52:45.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c81effb80 10 client.16266 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:45.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c81effb80 1 -- 172.21.15.107:0/2084620368 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f8c5c009a70 con 0x563f46664dd0 2023-08-10T10:52:45.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c477fe700 1 -- 172.21.15.107:0/2084620368 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563f46657470 con 0x563f46664dd0 2023-08-10T10:52:45.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c477fe700 1 -- 172.21.15.107:0/2084620368 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f8c5c005480 con 0x563f46664dd0 2023-08-10T10:52:45.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c81effb80 10 client.16266 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:45.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c81effb80 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:45.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.216+0000 7f8c81effb80 20 client.16266 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:45.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.217+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563f4667e430 0x563f46680850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.217+0000 7f8c81effb80 4 client.16266 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:52:45.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.217+0000 7f8c81effb80 1 -- 172.21.15.107:0/2084620368 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f466339d0 con 0x563f4667e430 2023-08-10T10:52:45.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.217+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563f4667e430 0x563f46680850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.218+0000 7f8c477fe700 10 client.16266 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:45.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.218+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563f4667e430 0x563f46680850 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f5d33ca62735283 server_cookie=2a1786adb4b86520 in_seq=0 out_seq=0 2023-08-10T10:52:45.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.218+0000 7f8c477fe700 1 -- 172.21.15.107:0/2084620368 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x7f8c60026670 con 0x563f4667e430 2023-08-10T10:52:45.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.218+0000 7f8c477fe700 10 client.16266 handle_command_reply: tid=0 2023-08-10T10:52:45.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.218+0000 7f8c81effb80 1 client.16266 shutdown 2023-08-10T10:52:45.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 -- 172.21.15.107:0/2084620368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 msgr2=0x563f4666dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f4666dd20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000c00 tx=0x7f8c5c00ef20 comp rx=0 tx=0).stop 2023-08-10T10:52:45.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 -- 172.21.15.107:0/2084620368 shutdown_connections 2023-08-10T10:52:45.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563f4667e430 0x563f46680850 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f4666e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.225 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46670aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2084620368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f4666dd20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 -- 172.21.15.107:0/2084620368 >> 172.21.15.107:0/2084620368 conn(0x563f465c1cd0 msgr2=0x563f4666a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:45.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c477fe700 0 client.16266 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:45.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 -- 172.21.15.107:0/2084620368 shutdown_connections 2023-08-10T10:52:45.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 1 -- 172.21.15.107:0/2084620368 wait complete. 2023-08-10T10:52:45.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.219+0000 7f8c81effb80 20 client.16266 trim_cache size 0 max 16384 2023-08-10T10:52:45.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.242+0000 7f8c81effb80 1 Processor -- start 2023-08-10T10:52:45.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.242+0000 7f8c81effb80 1 -- start start 2023-08-10T10:52:45.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.242+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46675500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.242+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46664dd0 0x563f4665f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.242+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46669290 0x563f4665f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.242+0000 7f8c81effb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f46438920 con 0x563f46669290 2023-08-10T10:52:45.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.242+0000 7f8c81effb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4666ee30 con 0x563f46664dd0 2023-08-10T10:52:45.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.242+0000 7f8c81effb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4665fc60 con 0x563f466644b0 2023-08-10T10:52:45.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46669290 0x563f4665f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46669290 0x563f4665f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41006/0 (socket says 172.21.15.107:41006) 2023-08-10T10:52:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 -- 172.21.15.107:0/1133294735 learned_addr learned my addr 172.21.15.107:0/1133294735 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/1133294735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46675500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c677fe700 1 --2- 172.21.15.107:0/1133294735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46664dd0 0x563f4665f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 -- 172.21.15.107:0/1133294735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 msgr2=0x563f46675500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/1133294735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46675500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 -- 172.21.15.107:0/1133294735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46664dd0 msgr2=0x563f4665f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:45.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/1133294735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46664dd0 0x563f4665f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 -- 172.21.15.107:0/1133294735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f463e2de0 con 0x563f46669290 2023-08-10T10:52:45.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.243+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/1133294735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46669290 0x563f4665f720 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000f80 tx=0x7f8c60009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172464834ff4b1e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:45.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c4effd700 1 -- 172.21.15.107:0/1133294735 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000ee30 con 0x563f46669290 2023-08-10T10:52:45.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c4effd700 1 -- 172.21.15.107:0/1133294735 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c60022040 con 0x563f46669290 2023-08-10T10:52:45.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c4effd700 1 -- 172.21.15.107:0/1133294735 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6002c680 con 0x563f46669290 2023-08-10T10:52:45.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c81effb80 1 -- 172.21.15.107:0/1133294735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46669290 msgr2=0x563f4665f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c81effb80 1 --2- 172.21.15.107:0/1133294735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46669290 0x563f4665f720 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000f80 tx=0x7f8c60009510 comp rx=0 tx=0).stop 2023-08-10T10:52:45.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c81effb80 1 -- 172.21.15.107:0/1133294735 shutdown_connections 2023-08-10T10:52:45.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c81effb80 1 --2- 172.21.15.107:0/1133294735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46669290 0x563f4665f720 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c81effb80 1 --2- 172.21.15.107:0/1133294735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46675500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c81effb80 1 --2- 172.21.15.107:0/1133294735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46664dd0 0x563f4665f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.244+0000 7f8c81effb80 1 -- 172.21.15.107:0/1133294735 >> 172.21.15.107:0/1133294735 conn(0x563f465c1cd0 msgr2=0x563f46667360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:45.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.245+0000 7f8c81effb80 1 -- 172.21.15.107:0/1133294735 shutdown_connections 2023-08-10T10:52:45.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.245+0000 7f8c81effb80 1 -- 172.21.15.107:0/1133294735 wait complete. 2023-08-10T10:52:45.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.245+0000 7f8c81effb80 1 -- start start 2023-08-10T10:52:45.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.245+0000 7f8c81effb80 1 Processor -- start 2023-08-10T10:52:45.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46673b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f46674090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c81effb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f466745d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c81effb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f466d21a0 con 0x563f46664dd0 2023-08-10T10:52:45.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c81effb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f466d2310 con 0x563f46669290 2023-08-10T10:52:45.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c81effb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f466d24d0 con 0x563f466644b0 2023-08-10T10:52:45.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c81effb80 10 client.0 _ll_register_callbacks cb 0x563f46552680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:52:45.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c677fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f46674090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c6cb9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46673b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c6cb9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46673b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55492/0 (socket says 172.21.15.107:55492) 2023-08-10T10:52:45.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c6cb9c700 1 -- 172.21.15.107:0/2249553484 learned_addr learned my addr 172.21.15.107:0/2249553484 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:52:45.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.246+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f466745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c677fe700 1 -- 172.21.15.107:0/2249553484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 msgr2=0x563f46673b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:45.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c677fe700 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46673b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c677fe700 1 -- 172.21.15.107:0/2249553484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 msgr2=0x563f466745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:52:45.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c677fe700 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f466745d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c677fe700 1 -- 172.21.15.107:0/2249553484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6000e770 con 0x563f46664dd0 2023-08-10T10:52:45.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c677fe700 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f46674090 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c001eb0 tx=0x7f8c5c004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54c9a607b28c56 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:52:45.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c477fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:52:45.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c477fe700 1 -- 172.21.15.107:0/2249553484 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c019840 con 0x563f46664dd0 2023-08-10T10:52:45.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c81effb80 1 -- 172.21.15.107:0/2249553484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c5c019c20 con 0x563f46664dd0 2023-08-10T10:52:45.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c477fe700 1 -- 172.21.15.107:0/2249553484 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f8c5c004990 con 0x563f46664dd0 2023-08-10T10:52:45.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c477fe700 1 -- 172.21.15.107:0/2249553484 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c5c021e80 con 0x563f46664dd0 2023-08-10T10:52:45.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c81effb80 10 client.16272 fetch_fsmap learned FSMap version 31 2023-08-10T10:52:45.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.247+0000 7f8c81effb80 1 -- 172.21.15.107:0/2249553484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563f463cbc60 con 0x563f46664dd0 2023-08-10T10:52:45.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.248+0000 7f8c477fe700 1 -- 172.21.15.107:0/2249553484 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c5c019c20 con 0x563f46664dd0 2023-08-10T10:52:45.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.248+0000 7f8c477fe700 1 -- 172.21.15.107:0/2249553484 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f8c5c0219f0 con 0x563f46664dd0 2023-08-10T10:52:45.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.248+0000 7f8c81effb80 10 client.16272 fetch_fsmap finished waiting for FSMap version 31 2023-08-10T10:52:45.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.248+0000 7f8c81effb80 10 client.16272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:52:45.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.248+0000 7f8c81effb80 20 client.16272 populate_metadata read hostname 'smithi107' 2023-08-10T10:52:45.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.248+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563f466d3920 0x563f466d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:52:45.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.248+0000 7f8c81effb80 4 client.16272 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:52:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.248+0000 7f8c81effb80 1 -- 172.21.15.107:0/2249553484 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563f465ae780 con 0x563f466d3920 2023-08-10T10:52:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.248+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563f466d3920 0x563f466d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:52:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c477fe700 10 client.16272 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c6cb9c700 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563f466d3920 0x563f466d5d40 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dfef5b4836fba47 server_cookie=690c7b00c08e83a4 in_seq=0 out_seq=0 2023-08-10T10:52:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c477fe700 1 -- 172.21.15.107:0/2249553484 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563f465ae780 con 0x563f466d3920 2023-08-10T10:52:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c477fe700 10 client.16272 handle_command_reply: tid=0 2023-08-10T10:52:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c81effb80 1 client.16272 shutdown 2023-08-10T10:52:45.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c81effb80 1 -- 172.21.15.107:0/2249553484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 msgr2=0x563f46674090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f46674090 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c001eb0 tx=0x7f8c5c004690 comp rx=0 tx=0).stop 2023-08-10T10:52:45.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c81effb80 1 -- 172.21.15.107:0/2249553484 shutdown_connections 2023-08-10T10:52:45.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563f466d3920 0x563f466d5d40 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563f46669290 0x563f466745d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563f466644b0 0x563f46673b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c477fe700 0 client.16272 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:52:45.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c81effb80 1 --2- 172.21.15.107:0/2249553484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563f46664dd0 0x563f46674090 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.249+0000 7f8c81effb80 1 -- 172.21.15.107:0/2249553484 >> 172.21.15.107:0/2249553484 conn(0x563f465c1cd0 msgr2=0x563f4665f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:45.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c81effb80 1 -- 172.21.15.107:0/2249553484 shutdown_connections 2023-08-10T10:52:45.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c81effb80 1 -- 172.21.15.107:0/2249553484 wait complete. 2023-08-10T10:52:45.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c81effb80 20 client.16272 trim_cache size 0 max 16384 2023-08-10T10:52:45.258 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:52:45.258 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:52:45.259 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:52:45.259 INFO:teuthology.orchestra.run.smithi107.stdout: "e839591c-0eb9-42de-a357-538c29c99df0": { 2023-08-10T10:52:45.259 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:52:45.259 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "e839591c-0eb9-42de-a357-538c29c99df0", 2023-08-10T10:52:45.259 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:52:45.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:52:45.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:52:45.259 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:52:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 -- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8c500a1360 msgr2=0x7f8c500a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8c500a1360 0x7f8c500a3820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c5809a880 tx=0x7f8c5809ec60 comp rx=0 tx=0).stop 2023-08-10T10:52:45.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 -- 172.21.15.107:0/3376075483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c68100560 msgr2=0x7f8c68198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:52:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c68100560 0x7f8c68198660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c58005910 tx=0x7f8c5800f690 comp rx=0 tx=0).stop 2023-08-10T10:52:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 -- 172.21.15.107:0/3376075483 shutdown_connections 2023-08-10T10:52:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f8c500a1360 0x7f8c500a3820 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c68100560 0x7f8c68198660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c68106620 0x7f8c6819d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 --2- 172.21.15.107:0/3376075483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c68100f20 0x7f8c68198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:52:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.250+0000 7f8c6d39d700 1 -- 172.21.15.107:0/3376075483 >> 172.21.15.107:0/3376075483 conn(0x7f8c680fc010 msgr2=0x7f8c680729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:52:45.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.251+0000 7f8c6d39d700 1 -- 172.21.15.107:0/3376075483 shutdown_connections 2023-08-10T10:52:45.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:52:45.251+0000 7f8c6d39d700 1 -- 172.21.15.107:0/3376075483 wait complete. 2023-08-10T10:52:45.272 INFO:tasks.cephfs.filesystem:scrub status for tag:e839591c-0eb9-42de-a357-538c29c99df0 - {'path': '/', 'tag': 'e839591c-0eb9-42de-a357-538c29c99df0', 'options': 'recursive,force'} 2023-08-10T10:52:46.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: pgmap v49: 129 pgs: 129 active+clean; 983 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 MiB/s wr, 44 op/s 2023-08-10T10:52:46.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: mgrmap e26: x(active, since 92s), standbys: y, z 2023-08-10T10:52:46.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub queued for path: / 2023-08-10T10:52:46.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:46.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:46.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:46.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:46.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:46.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:45 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: pgmap v49: 129 pgs: 129 active+clean; 983 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 MiB/s wr, 44 op/s 2023-08-10T10:52:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: mgrmap e26: x(active, since 92s), standbys: y, z 2023-08-10T10:52:46.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub queued for path: / 2023-08-10T10:52:46.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:46.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:46.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:46.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:46.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:46.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:45 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: pgmap v49: 129 pgs: 129 active+clean; 983 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 MiB/s wr, 44 op/s 2023-08-10T10:52:46.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: mgrmap e26: x(active, since 92s), standbys: y, z 2023-08-10T10:52:46.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub queued for path: / 2023-08-10T10:52:46.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:46.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:46.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:46.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:46.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:46.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:45 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:46.214 INFO:teuthology.orchestra.run.smithi107.stderr:4200000 of 50000000 tuples (8%) done (elapsed 64.39 s, remaining 702.17 s) 2023-08-10T10:52:47.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:46 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:52:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:46 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:46 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:46 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:52:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:46 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:46 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:47.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:46 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:52:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:46 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:46 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:52:47.830 INFO:teuthology.orchestra.run.smithi107.stderr:4300000 of 50000000 tuples (8%) done (elapsed 66.01 s, remaining 701.52 s) 2023-08-10T10:52:48.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:47 smithi157 ceph-mon[129604]: pgmap v50: 129 pgs: 129 active+clean; 983 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-08-10T10:52:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:47 smithi107 ceph-mon[127953]: pgmap v50: 129 pgs: 129 active+clean; 983 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-08-10T10:52:48.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:47 smithi195 ceph-mon[129938]: pgmap v50: 129 pgs: 129 active+clean; 983 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-08-10T10:52:49.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:48 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:52:49.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:48 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:52:49.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:48 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:52:49.520 INFO:teuthology.orchestra.run.smithi107.stderr:4400000 of 50000000 tuples (8%) done (elapsed 67.70 s, remaining 701.59 s) 2023-08-10T10:52:50.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:49 smithi157 ceph-mon[129604]: pgmap v51: 129 pgs: 129 active+clean; 1.0 GiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 43 op/s 2023-08-10T10:52:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:49 smithi107 ceph-mon[127953]: pgmap v51: 129 pgs: 129 active+clean; 1.0 GiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 43 op/s 2023-08-10T10:52:50.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:49 smithi195 ceph-mon[129938]: pgmap v51: 129 pgs: 129 active+clean; 1.0 GiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 43 op/s 2023-08-10T10:52:50.748 INFO:teuthology.orchestra.run.smithi107.stderr:4500000 of 50000000 tuples (9%) done (elapsed 68.93 s, remaining 696.91 s) 2023-08-10T10:52:52.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:51 smithi157 ceph-mon[129604]: pgmap v52: 129 pgs: 129 active+clean; 1.0 GiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 40 op/s 2023-08-10T10:52:52.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:51 smithi107 ceph-mon[127953]: pgmap v52: 129 pgs: 129 active+clean; 1.0 GiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 40 op/s 2023-08-10T10:52:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:51 smithi195 ceph-mon[129938]: pgmap v52: 129 pgs: 129 active+clean; 1.0 GiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 40 op/s 2023-08-10T10:52:52.421 INFO:teuthology.orchestra.run.smithi107.stderr:4600000 of 50000000 tuples (9%) done (elapsed 70.60 s, remaining 696.78 s) 2023-08-10T10:52:54.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:53 smithi157 ceph-mon[129604]: pgmap v53: 129 pgs: 129 active+clean; 1.0 GiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-08-10T10:52:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:53 smithi107 ceph-mon[127953]: pgmap v53: 129 pgs: 129 active+clean; 1.0 GiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-08-10T10:52:54.147 INFO:teuthology.orchestra.run.smithi107.stderr:4700000 of 50000000 tuples (9%) done (elapsed 72.32 s, remaining 697.08 s) 2023-08-10T10:52:54.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:53 smithi195 ceph-mon[129938]: pgmap v53: 129 pgs: 129 active+clean; 1.0 GiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-08-10T10:52:55.280 INFO:teuthology.orchestra.run.smithi107.stderr:4800000 of 50000000 tuples (9%) done (elapsed 73.46 s, remaining 691.73 s) 2023-08-10T10:52:56.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:55 smithi157 ceph-mon[129604]: pgmap v54: 129 pgs: 129 active+clean; 1.1 GiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 MiB/s wr, 49 op/s 2023-08-10T10:52:56.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:55 smithi107 ceph-mon[127953]: pgmap v54: 129 pgs: 129 active+clean; 1.1 GiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 MiB/s wr, 49 op/s 2023-08-10T10:52:56.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:55 smithi195 ceph-mon[129938]: pgmap v54: 129 pgs: 129 active+clean; 1.1 GiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 MiB/s wr, 49 op/s 2023-08-10T10:52:56.956 INFO:teuthology.orchestra.run.smithi107.stderr:4900000 of 50000000 tuples (9%) done (elapsed 75.13 s, remaining 691.54 s) 2023-08-10T10:52:58.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:57 smithi157 ceph-mon[129604]: pgmap v55: 129 pgs: 129 active+clean; 1.1 GiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:52:58.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:57 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:58.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:57 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:58.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:57 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:58.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:57 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:58.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:57 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T10:52:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:57 smithi107 ceph-mon[127953]: pgmap v55: 129 pgs: 129 active+clean; 1.1 GiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:52:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:57 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:57 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:57 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:57 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:57 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T10:52:58.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:57 smithi195 ceph-mon[129938]: pgmap v55: 129 pgs: 129 active+clean; 1.1 GiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:52:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:57 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:57 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:57 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:57 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:57 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T10:52:58.644 INFO:teuthology.orchestra.run.smithi107.stderr:5000000 of 50000000 tuples (10%) done (elapsed 76.82 s, remaining 691.40 s) 2023-08-10T10:52:59.875 INFO:teuthology.orchestra.run.smithi107.stderr:5100000 of 50000000 tuples (10%) done (elapsed 78.05 s, remaining 687.17 s) 2023-08-10T10:53:00.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:52:59 smithi157 ceph-mon[129604]: pgmap v56: 129 pgs: 129 active+clean; 1.2 GiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 36 MiB/s wr, 39 op/s 2023-08-10T10:53:00.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:52:59 smithi107 ceph-mon[127953]: pgmap v56: 129 pgs: 129 active+clean; 1.2 GiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 36 MiB/s wr, 39 op/s 2023-08-10T10:53:00.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:52:59 smithi195 ceph-mon[129938]: pgmap v56: 129 pgs: 129 active+clean; 1.2 GiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 36 MiB/s wr, 39 op/s 2023-08-10T10:53:01.572 INFO:teuthology.orchestra.run.smithi107.stderr:5200000 of 50000000 tuples (10%) done (elapsed 79.75 s, remaining 687.07 s) 2023-08-10T10:53:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:01 smithi157 ceph-mon[129604]: pgmap v57: 129 pgs: 129 active+clean; 1.2 GiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 33 op/s 2023-08-10T10:53:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:01 smithi107 ceph-mon[127953]: pgmap v57: 129 pgs: 129 active+clean; 1.2 GiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 33 op/s 2023-08-10T10:53:02.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:01 smithi195 ceph-mon[129938]: pgmap v57: 129 pgs: 129 active+clean; 1.2 GiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 33 op/s 2023-08-10T10:53:03.297 INFO:teuthology.orchestra.run.smithi107.stderr:5300000 of 50000000 tuples (10%) done (elapsed 81.47 s, remaining 687.15 s) 2023-08-10T10:53:04.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:03 smithi157 ceph-mon[129604]: pgmap v58: 129 pgs: 129 active+clean; 1.2 GiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-08-10T10:53:04.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:03 smithi107 ceph-mon[127953]: pgmap v58: 129 pgs: 129 active+clean; 1.2 GiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-08-10T10:53:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:03 smithi195 ceph-mon[129938]: pgmap v58: 129 pgs: 129 active+clean; 1.2 GiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-08-10T10:53:04.520 INFO:teuthology.orchestra.run.smithi107.stderr:5400000 of 50000000 tuples (10%) done (elapsed 82.70 s, remaining 683.02 s) 2023-08-10T10:53:06.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:05 smithi157 ceph-mon[129604]: pgmap v59: 129 pgs: 129 active+clean; 1.3 GiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 38 MiB/s wr, 54 op/s 2023-08-10T10:53:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:05 smithi107 ceph-mon[127953]: pgmap v59: 129 pgs: 129 active+clean; 1.3 GiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 38 MiB/s wr, 54 op/s 2023-08-10T10:53:06.122 INFO:teuthology.orchestra.run.smithi107.stderr:5500000 of 50000000 tuples (11%) done (elapsed 84.30 s, remaining 682.06 s) 2023-08-10T10:53:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:05 smithi195 ceph-mon[129938]: pgmap v59: 129 pgs: 129 active+clean; 1.3 GiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 38 MiB/s wr, 54 op/s 2023-08-10T10:53:07.345 INFO:teuthology.orchestra.run.smithi107.stderr:5600000 of 50000000 tuples (11%) done (elapsed 85.52 s, remaining 678.07 s) 2023-08-10T10:53:08.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:07 smithi157 ceph-mon[129604]: pgmap v60: 129 pgs: 129 active+clean; 1.3 GiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 26 MiB/s wr, 40 op/s 2023-08-10T10:53:08.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:07 smithi107 ceph-mon[127953]: pgmap v60: 129 pgs: 129 active+clean; 1.3 GiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 26 MiB/s wr, 40 op/s 2023-08-10T10:53:08.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:07 smithi195 ceph-mon[129938]: pgmap v60: 129 pgs: 129 active+clean; 1.3 GiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 26 MiB/s wr, 40 op/s 2023-08-10T10:53:09.048 INFO:teuthology.orchestra.run.smithi107.stderr:5700000 of 50000000 tuples (11%) done (elapsed 87.23 s, remaining 677.91 s) 2023-08-10T10:53:10.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:09 smithi157 ceph-mon[129604]: pgmap v61: 129 pgs: 129 active+clean; 1.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 MiB/s wr, 54 op/s 2023-08-10T10:53:10.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:09 smithi107 ceph-mon[127953]: pgmap v61: 129 pgs: 129 active+clean; 1.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 MiB/s wr, 54 op/s 2023-08-10T10:53:10.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:09 smithi195 ceph-mon[129938]: pgmap v61: 129 pgs: 129 active+clean; 1.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 MiB/s wr, 54 op/s 2023-08-10T10:53:10.775 INFO:teuthology.orchestra.run.smithi107.stderr:5800000 of 50000000 tuples (11%) done (elapsed 88.95 s, remaining 677.88 s) 2023-08-10T10:53:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:11 smithi157 ceph-mon[129604]: pgmap v62: 129 pgs: 129 active+clean; 1.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 43 op/s 2023-08-10T10:53:12.045 INFO:teuthology.orchestra.run.smithi107.stderr:5900000 of 50000000 tuples (11%) done (elapsed 90.22 s, remaining 674.37 s) 2023-08-10T10:53:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:11 smithi107 ceph-mon[127953]: pgmap v62: 129 pgs: 129 active+clean; 1.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 43 op/s 2023-08-10T10:53:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:11 smithi195 ceph-mon[129938]: pgmap v62: 129 pgs: 129 active+clean; 1.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 43 op/s 2023-08-10T10:53:13.774 INFO:teuthology.orchestra.run.smithi107.stderr:6000000 of 50000000 tuples (12%) done (elapsed 91.95 s, remaining 674.31 s) 2023-08-10T10:53:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:13 smithi157 ceph-mon[129604]: pgmap v63: 129 pgs: 129 active+clean; 1.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 40 op/s 2023-08-10T10:53:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:13 smithi107 ceph-mon[127953]: pgmap v63: 129 pgs: 129 active+clean; 1.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 40 op/s 2023-08-10T10:53:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:13 smithi195 ceph-mon[129938]: pgmap v63: 129 pgs: 129 active+clean; 1.4 GiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 40 op/s 2023-08-10T10:53:15.272 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:53:15.494 INFO:teuthology.orchestra.run.smithi107.stderr:6100000 of 50000000 tuples (12%) done (elapsed 93.67 s, remaining 674.13 s) 2023-08-10T10:53:15.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.498+0000 7fefdd59d700 1 -- 172.21.15.107:0/1473764384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8106660 msgr2=0x7fefd8106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.498+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1473764384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8106660 0x7fefd8106a40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fefc80099c0 tx=0x7fefc8009cd0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.498+0000 7fefdd59d700 1 -- 172.21.15.107:0/1473764384 shutdown_connections 2023-08-10T10:53:15.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.498+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1473764384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefd8068290 0x7fefd810d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.498+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1473764384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8106660 0x7fefd8106a40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.498+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1473764384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd80678d0 0x7fefd8067d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.498+0000 7fefdd59d700 1 -- 172.21.15.107:0/1473764384 >> 172.21.15.107:0/1473764384 conn(0x7fefd8074f30 msgr2=0x7fefd8075340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:15.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.498+0000 7fefdd59d700 1 -- 172.21.15.107:0/1473764384 shutdown_connections 2023-08-10T10:53:15.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.498+0000 7fefdd59d700 1 -- 172.21.15.107:0/1473764384 wait complete. 2023-08-10T10:53:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.499+0000 7fefdd59d700 1 Processor -- start 2023-08-10T10:53:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefdd59d700 1 -- start start 2023-08-10T10:53:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefdd59d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefd80678d0 0x7fefd8198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefdd59d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8068290 0x7fefd8198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefdd59d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd8106660 0x7fefd819cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefdd59d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd819d600 con 0x7fefd8068290 2023-08-10T10:53:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefdd59d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd819d770 con 0x7fefd8106660 2023-08-10T10:53:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefdd59d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd819d930 con 0x7fefd80678d0 2023-08-10T10:53:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8068290 0x7fefd8198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8068290 0x7fefd8198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49326/0 (socket says 172.21.15.107:49326) 2023-08-10T10:53:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefd77fe700 1 -- 172.21.15.107:0/1933220899 learned_addr learned my addr 172.21.15.107:0/1933220899 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd8106660 0x7fefd819cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.500+0000 7fefd7fff700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefd80678d0 0x7fefd8198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefd77fe700 1 -- 172.21.15.107:0/1933220899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefd80678d0 msgr2=0x7fefd8198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefd77fe700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefd80678d0 0x7fefd8198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefd77fe700 1 -- 172.21.15.107:0/1933220899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd8106660 msgr2=0x7fefd819cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefd77fe700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd8106660 0x7fefd819cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefd77fe700 1 -- 172.21.15.107:0/1933220899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc80095f0 con 0x7fefd8068290 2023-08-10T10:53:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd8106660 0x7fefd819cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:15.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefd77fe700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8068290 0x7fefd8198b60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00e9a0 tx=0x7fefcc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:15.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefd57fa700 1 -- 172.21.15.107:0/1933220899 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc009790 con 0x7fefd8068290 2023-08-10T10:53:15.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefdd59d700 1 -- 172.21.15.107:0/1933220899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd819dc10 con 0x7fefd8068290 2023-08-10T10:53:15.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefd57fa700 1 -- 172.21.15.107:0/1933220899 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefcc00cbd0 con 0x7fefd8068290 2023-08-10T10:53:15.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefd57fa700 1 -- 172.21.15.107:0/1933220899 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc018680 con 0x7fefd8068290 2023-08-10T10:53:15.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.501+0000 7fefdd59d700 1 -- 172.21.15.107:0/1933220899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd81a5450 con 0x7fefd8068290 2023-08-10T10:53:15.506 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.505+0000 7fefd57fa700 1 -- 172.21.15.107:0/1933220899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fefcc00cd40 con 0x7fefd8068290 2023-08-10T10:53:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.506+0000 7feff20f2b80 1 Processor -- start 2023-08-10T10:53:15.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.506+0000 7feff20f2b80 1 -- start start 2023-08-10T10:53:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.506+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a0264b0 0x55706a026890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.506+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a026dd0 0x55706a02ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a02b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7feff20f2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557069fa1dc0 con 0x55706a0264b0 2023-08-10T10:53:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7feff20f2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557069f7e590 con 0x55706a026dd0 2023-08-10T10:53:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7feff20f2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557069f7beb0 con 0x55706a02b290 2023-08-10T10:53:15.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7fefd57fa700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefc00a1360 0x7fefc00a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7fefdcd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a0264b0 0x55706a026890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7fefdcd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a0264b0 0x55706a026890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49334/0 (socket says 172.21.15.107:49334) 2023-08-10T10:53:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7fefdcd9c700 1 -- 172.21.15.107:0/1789905338 learned_addr learned my addr 172.21.15.107:0/1789905338 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7fefd57fa700 1 -- 172.21.15.107:0/1933220899 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fefcc014070 con 0x7fefd8068290 2023-08-10T10:53:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7fefd77fe700 1 --2- 172.21.15.107:0/1789905338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a02b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefc00a1360 0x7fefc00a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7fefd7fff700 1 --2- 172.21.15.107:0/1789905338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a026dd0 0x55706a02ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.507+0000 7fefdcd9c700 1 -- 172.21.15.107:0/1789905338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 msgr2=0x55706a02b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.508+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/1789905338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a02b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.508+0000 7fefdcd9c700 1 -- 172.21.15.107:0/1789905338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a026dd0 msgr2=0x55706a02ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.508+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/1789905338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a026dd0 0x55706a02ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.508+0000 7fefdcd9c700 1 -- 172.21.15.107:0/1789905338 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557069df8630 con 0x55706a0264b0 2023-08-10T10:53:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.508+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/1789905338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a0264b0 0x55706a026890 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fefd00076b0 tx=0x7fefd00079c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6ebd4f2ce3cdeb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.508+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefc00a1360 0x7fefc00a3820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fefd0007d10 tx=0x7fefd000b000 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:15.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.508+0000 7fefbe7fc700 1 -- 172.21.15.107:0/1789905338 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0004bb0 con 0x55706a0264b0 2023-08-10T10:53:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.508+0000 7fefbe7fc700 1 -- 172.21.15.107:0/1789905338 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefd0017c30 con 0x55706a0264b0 2023-08-10T10:53:15.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.508+0000 7fefbe7fc700 1 -- 172.21.15.107:0/1789905338 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0015de0 con 0x55706a0264b0 2023-08-10T10:53:15.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.509+0000 7feff20f2b80 1 -- 172.21.15.107:0/1789905338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a0264b0 msgr2=0x55706a026890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.509+0000 7feff20f2b80 1 --2- 172.21.15.107:0/1789905338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a0264b0 0x55706a026890 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fefd00076b0 tx=0x7fefd00079c0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.509+0000 7feff20f2b80 1 -- 172.21.15.107:0/1789905338 shutdown_connections 2023-08-10T10:53:15.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.509+0000 7feff20f2b80 1 --2- 172.21.15.107:0/1789905338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a02b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.509+0000 7feff20f2b80 1 --2- 172.21.15.107:0/1789905338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a0264b0 0x55706a026890 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.509+0000 7feff20f2b80 1 --2- 172.21.15.107:0/1789905338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a026dd0 0x55706a02ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.509+0000 7feff20f2b80 1 -- 172.21.15.107:0/1789905338 >> 172.21.15.107:0/1789905338 conn(0x557069f83cd0 msgr2=0x55706a021750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:15.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.509+0000 7feff20f2b80 1 -- 172.21.15.107:0/1789905338 shutdown_connections 2023-08-10T10:53:15.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.509+0000 7feff20f2b80 1 -- 172.21.15.107:0/1789905338 wait complete. 2023-08-10T10:53:15.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.510+0000 7feff20f2b80 1 -- start start 2023-08-10T10:53:15.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.510+0000 7feff20f2b80 1 Processor -- start 2023-08-10T10:53:15.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a032b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a02fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a030490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7feff20f2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557069f777a0 con 0x55706a026dd0 2023-08-10T10:53:15.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7feff20f2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557069f16ac0 con 0x55706a0264b0 2023-08-10T10:53:15.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7feff20f2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557069f167c0 con 0x55706a02b290 2023-08-10T10:53:15.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7feff20f2b80 10 client.0 _ll_register_callbacks cb 0x557069f14680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:15.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefd7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a032b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a02fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefdcd9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a030490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefd7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a032b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:45684/0 (socket says 172.21.15.107:45684) 2023-08-10T10:53:15.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefd7fff700 1 -- 172.21.15.107:0/658077696 learned_addr learned my addr 172.21.15.107:0/658077696 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:15.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a02fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49344/0 (socket says 172.21.15.107:49344) 2023-08-10T10:53:15.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefdcd9c700 1 -- 172.21.15.107:0/658077696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 msgr2=0x55706a032b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:15.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a032b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefdcd9c700 1 -- 172.21.15.107:0/658077696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 msgr2=0x55706a02fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:15.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.511+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a02fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.512+0000 7fefdcd9c700 1 -- 172.21.15.107:0/658077696 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd001f040 con 0x55706a02b290 2023-08-10T10:53:15.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.512+0000 7fefd7fff700 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a032b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:15.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.512+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a030490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009410 tx=0x7fefd0022c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa1988f1dc793ea1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:15.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.512+0000 7fefb77fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:53:15.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.512+0000 7fefb77fe700 1 -- 172.21.15.107:0/658077696 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0022e20 con 0x55706a02b290 2023-08-10T10:53:15.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.513+0000 7feff20f2b80 1 -- 172.21.15.107:0/658077696 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55706a019470 con 0x55706a02b290 2023-08-10T10:53:15.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.513+0000 7fefb77fe700 1 -- 172.21.15.107:0/658077696 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fefd0015bf0 con 0x55706a02b290 2023-08-10T10:53:15.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.513+0000 7fefb77fe700 1 -- 172.21.15.107:0/658077696 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefd0015db0 con 0x55706a02b290 2023-08-10T10:53:15.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.513+0000 7feff20f2b80 10 client.25978 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:15.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.513+0000 7feff20f2b80 1 -- 172.21.15.107:0/658077696 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x557069da4de0 con 0x55706a02b290 2023-08-10T10:53:15.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.513+0000 7fefb77fe700 1 -- 172.21.15.107:0/658077696 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55706a019470 con 0x55706a02b290 2023-08-10T10:53:15.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.513+0000 7fefb77fe700 1 -- 172.21.15.107:0/658077696 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fefd00245c0 con 0x55706a02b290 2023-08-10T10:53:15.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.514+0000 7feff20f2b80 10 client.25978 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:15.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.514+0000 7feff20f2b80 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:15.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.514+0000 7feff20f2b80 20 client.25978 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:15.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.514+0000 7feff20f2b80 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55706a040480 0x55706a0428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.514+0000 7feff20f2b80 4 client.25978 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:53:15.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.514+0000 7feff20f2b80 1 -- 172.21.15.107:0/658077696 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557069ff59d0 con 0x55706a040480 2023-08-10T10:53:15.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.514+0000 7fefd7fff700 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55706a040480 0x55706a0428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.515+0000 7fefd7fff700 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55706a040480 0x55706a0428a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea45015887a66f85 server_cookie=cbf63801f3d91ba in_seq=0 out_seq=0 2023-08-10T10:53:15.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.515+0000 7fefb77fe700 10 client.25978 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:15.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7fefb77fe700 1 -- 172.21.15.107:0/658077696 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557069ff59d0 con 0x55706a040480 2023-08-10T10:53:15.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7fefb77fe700 10 client.25978 handle_command_reply: tid=0 2023-08-10T10:53:15.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 client.25978 shutdown 2023-08-10T10:53:15.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 -- 172.21.15.107:0/658077696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 msgr2=0x55706a030490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a030490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009410 tx=0x7fefd0022c30 comp rx=0 tx=0).stop 2023-08-10T10:53:15.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 -- 172.21.15.107:0/658077696 shutdown_connections 2023-08-10T10:53:15.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55706a040480 0x55706a0428a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a032b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a030490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7fefb77fe700 0 client.25978 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:15.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 --2- 172.21.15.107:0/658077696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a02fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 -- 172.21.15.107:0/658077696 >> 172.21.15.107:0/658077696 conn(0x557069f83cd0 msgr2=0x55706a02c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:15.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 -- 172.21.15.107:0/658077696 shutdown_connections 2023-08-10T10:53:15.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 1 -- 172.21.15.107:0/658077696 wait complete. 2023-08-10T10:53:15.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.516+0000 7feff20f2b80 20 client.25978 trim_cache size 0 max 16384 2023-08-10T10:53:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7feff20f2b80 1 Processor -- start 2023-08-10T10:53:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7feff20f2b80 1 -- start start 2023-08-10T10:53:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a028b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a026dd0 0x55706a0374a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a02b290 0x55706a032670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7feff20f2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557069dfa920 con 0x55706a02b290 2023-08-10T10:53:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7feff20f2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55706a01df80 con 0x55706a0264b0 2023-08-10T10:53:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7feff20f2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55706a031330 con 0x55706a026dd0 2023-08-10T10:53:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7fefdcd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a02b290 0x55706a032670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7fefdcd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a02b290 0x55706a032670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49352/0 (socket says 172.21.15.107:49352) 2023-08-10T10:53:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.537+0000 7fefdcd9c700 1 -- 172.21.15.107:0/2222540032 learned_addr learned my addr 172.21.15.107:0/2222540032 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefd77fe700 1 --2- 172.21.15.107:0/2222540032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a026dd0 0x55706a0374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefd7fff700 1 --2- 172.21.15.107:0/2222540032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a028b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefdcd9c700 1 -- 172.21.15.107:0/2222540032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a026dd0 msgr2=0x55706a0374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/2222540032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a026dd0 0x55706a0374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefdcd9c700 1 -- 172.21.15.107:0/2222540032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 msgr2=0x55706a028b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/2222540032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a028b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefdcd9c700 1 -- 172.21.15.107:0/2222540032 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557069d8dc60 con 0x55706a02b290 2023-08-10T10:53:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/2222540032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a02b290 0x55706a032670 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009550 tx=0x7fefd0007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5e65657f300782 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefbeffd700 1 -- 172.21.15.107:0/2222540032 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0009190 con 0x55706a02b290 2023-08-10T10:53:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefbeffd700 1 -- 172.21.15.107:0/2222540032 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefd0024ba0 con 0x55706a02b290 2023-08-10T10:53:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.538+0000 7fefbeffd700 1 -- 172.21.15.107:0/2222540032 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0017620 con 0x55706a02b290 2023-08-10T10:53:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.539+0000 7feff20f2b80 1 -- 172.21.15.107:0/2222540032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a02b290 msgr2=0x55706a032670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.539+0000 7feff20f2b80 1 --2- 172.21.15.107:0/2222540032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a02b290 0x55706a032670 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009550 tx=0x7fefd0007dc0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.539+0000 7feff20f2b80 1 -- 172.21.15.107:0/2222540032 shutdown_connections 2023-08-10T10:53:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.539+0000 7feff20f2b80 1 --2- 172.21.15.107:0/2222540032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a028b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.539+0000 7feff20f2b80 1 --2- 172.21.15.107:0/2222540032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a02b290 0x55706a032670 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.539+0000 7feff20f2b80 1 --2- 172.21.15.107:0/2222540032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a026dd0 0x55706a0374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.539+0000 7feff20f2b80 1 -- 172.21.15.107:0/2222540032 >> 172.21.15.107:0/2222540032 conn(0x557069f83cd0 msgr2=0x55706a03c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.539+0000 7feff20f2b80 1 -- 172.21.15.107:0/2222540032 shutdown_connections 2023-08-10T10:53:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.539+0000 7feff20f2b80 1 -- 172.21.15.107:0/2222540032 wait complete. 2023-08-10T10:53:15.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.540+0000 7feff20f2b80 1 -- start start 2023-08-10T10:53:15.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.540+0000 7feff20f2b80 1 Processor -- start 2023-08-10T10:53:15.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.540+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a035a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.540+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a035fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.540+0000 7feff20f2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a0364f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.540+0000 7feff20f2b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55706a094140 con 0x55706a026dd0 2023-08-10T10:53:15.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.540+0000 7feff20f2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55706a094280 con 0x55706a0264b0 2023-08-10T10:53:15.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.540+0000 7feff20f2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55706a0943c0 con 0x55706a02b290 2023-08-10T10:53:15.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.540+0000 7feff20f2b80 10 client.0 _ll_register_callbacks cb 0x557069f14680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:15.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a035fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a035a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a035fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49368/0 (socket says 172.21.15.107:49368) 2023-08-10T10:53:15.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd77fe700 1 -- 172.21.15.107:0/3037972621 learned_addr learned my addr 172.21.15.107:0/3037972621 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:15.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefdcd9c700 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a0364f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd77fe700 1 -- 172.21.15.107:0/3037972621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 msgr2=0x55706a0364f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:15.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd77fe700 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a0364f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd77fe700 1 -- 172.21.15.107:0/3037972621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 msgr2=0x55706a035a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:15.548 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd77fe700 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a035a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd77fe700 1 -- 172.21.15.107:0/3037972621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557069da4de0 con 0x55706a026dd0 2023-08-10T10:53:15.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd7fff700 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a035a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:15.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefd77fe700 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a035fb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fefcc099e00 tx=0x7fefcc0bed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb44eb4a6677885 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:15.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.541+0000 7fefb77fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:15.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7fefb77fe700 1 -- 172.21.15.107:0/3037972621 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc09e130 con 0x55706a026dd0 2023-08-10T10:53:15.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7fefb77fe700 1 -- 172.21.15.107:0/3037972621 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fefcc0a2550 con 0x55706a026dd0 2023-08-10T10:53:15.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7feff20f2b80 1 -- 172.21.15.107:0/3037972621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefd0017c30 con 0x55706a026dd0 2023-08-10T10:53:15.549 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7fefb77fe700 1 -- 172.21.15.107:0/3037972621 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefcc09a360 con 0x55706a026dd0 2023-08-10T10:53:15.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7feff20f2b80 10 client.16290 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:15.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7feff20f2b80 1 -- 172.21.15.107:0/3037972621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x557069dcb250 con 0x55706a026dd0 2023-08-10T10:53:15.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7fefb77fe700 1 -- 172.21.15.107:0/3037972621 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefd0017c30 con 0x55706a026dd0 2023-08-10T10:53:15.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7fefb77fe700 1 -- 172.21.15.107:0/3037972621 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fefcc0a20c0 con 0x55706a026dd0 2023-08-10T10:53:15.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7feff20f2b80 10 client.16290 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:15.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7feff20f2b80 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:15.550 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7feff20f2b80 20 client.16290 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:15.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7feff20f2b80 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55706a095bd0 0x55706a097ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7feff20f2b80 4 client.16290 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:53:15.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.542+0000 7feff20f2b80 1 -- 172.21.15.107:0/3037972621 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557069f70780 con 0x55706a095bd0 2023-08-10T10:53:15.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.543+0000 7fefd7fff700 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55706a095bd0 0x55706a097ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.543+0000 7fefb77fe700 10 client.16290 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:15.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.543+0000 7fefd7fff700 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55706a095bd0 0x55706a097ff0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c92c1643b626174 server_cookie=7f9303601b3b2680 in_seq=0 out_seq=0 2023-08-10T10:53:15.551 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7fefb77fe700 1 -- 172.21.15.107:0/3037972621 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557069f70780 con 0x55706a095bd0 2023-08-10T10:53:15.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7fefb77fe700 10 client.16290 handle_command_reply: tid=0 2023-08-10T10:53:15.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 client.16290 shutdown 2023-08-10T10:53:15.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 -- 172.21.15.107:0/3037972621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 msgr2=0x55706a035fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a035fb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fefcc099e00 tx=0x7fefcc0bed90 comp rx=0 tx=0).stop 2023-08-10T10:53:15.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 -- 172.21.15.107:0/3037972621 shutdown_connections 2023-08-10T10:53:15.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55706a095bd0 0x55706a097ff0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.552 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55706a0264b0 0x55706a035a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55706a02b290 0x55706a0364f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7fefb77fe700 0 client.16290 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:15.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 --2- 172.21.15.107:0/3037972621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55706a026dd0 0x55706a035fb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 -- 172.21.15.107:0/3037972621 >> 172.21.15.107:0/3037972621 conn(0x557069f83cd0 msgr2=0x55706a021280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:15.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 -- 172.21.15.107:0/3037972621 shutdown_connections 2023-08-10T10:53:15.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 1 -- 172.21.15.107:0/3037972621 wait complete. 2023-08-10T10:53:15.553 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.544+0000 7feff20f2b80 20 client.16290 trim_cache size 0 max 16384 2023-08-10T10:53:15.554 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:53:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "no active scrubs running", 2023-08-10T10:53:15.554 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": {} 2023-08-10T10:53:15.554 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:53:15.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 -- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefc00a1360 msgr2=0x7fefc00a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefc00a1360 0x7fefc00a3820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fefd0007d10 tx=0x7fefd000b000 comp rx=0 tx=0).stop 2023-08-10T10:53:15.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 -- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8068290 msgr2=0x7fefd8198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8068290 0x7fefd8198b60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00e9a0 tx=0x7fefcc00ed60 comp rx=0 tx=0).stop 2023-08-10T10:53:15.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 -- 172.21.15.107:0/1933220899 shutdown_connections 2023-08-10T10:53:15.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefc00a1360 0x7fefc00a3820 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefd8106660 0x7fefd819cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefd80678d0 0x7fefd8198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 --2- 172.21.15.107:0/1933220899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefd8068290 0x7fefd8198b60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 -- 172.21.15.107:0/1933220899 >> 172.21.15.107:0/1933220899 conn(0x7fefd8074f30 msgr2=0x7fefd810b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:15.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 -- 172.21.15.107:0/1933220899 shutdown_connections 2023-08-10T10:53:15.556 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.545+0000 7fefdd59d700 1 -- 172.21.15.107:0/1933220899 wait complete. 2023-08-10T10:53:15.566 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-10T10:53:15.566 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:53:15.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.789+0000 7f5f8a19d700 1 -- 172.21.15.107:0/74171797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84103130 msgr2=0x7f5f8410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.789+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/74171797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84103130 0x7f5f8410f640 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00b0a0 tx=0x7f5f7c00b3b0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.789+0000 7f5f8a19d700 1 -- 172.21.15.107:0/74171797 shutdown_connections 2023-08-10T10:53:15.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.789+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/74171797 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84103130 0x7f5f8410f640 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.789+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/74171797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f84108780 0x7f5f84108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.789+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/74171797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84102770 0x7f5f84102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.789+0000 7f5f8a19d700 1 -- 172.21.15.107:0/74171797 >> 172.21.15.107:0/74171797 conn(0x7f5f840fe200 msgr2=0x7f5f84100620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:15.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.789+0000 7f5f8a19d700 1 -- 172.21.15.107:0/74171797 shutdown_connections 2023-08-10T10:53:15.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.789+0000 7f5f8a19d700 1 -- 172.21.15.107:0/74171797 wait complete. 2023-08-10T10:53:15.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.790+0000 7f5f8a19d700 1 Processor -- start 2023-08-10T10:53:15.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.790+0000 7f5f8a19d700 1 -- start start 2023-08-10T10:53:15.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8a19d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84102770 0x7f5f84198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8a19d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f84103130 0x7f5f84198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8a19d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84108780 0x7f5f8419cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8a19d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8419d630 con 0x7f5f84102770 2023-08-10T10:53:15.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8a19d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8419d7a0 con 0x7f5f84108780 2023-08-10T10:53:15.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8a19d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8419d960 con 0x7f5f84103130 2023-08-10T10:53:15.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84102770 0x7f5f84198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84102770 0x7f5f84198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49392/0 (socket says 172.21.15.107:49392) 2023-08-10T10:53:15.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8919b700 1 -- 172.21.15.107:0/3896317629 learned_addr learned my addr 172.21.15.107:0/3896317629 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:15.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8899a700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f84103130 0x7f5f84198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8999c700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84108780 0x7f5f8419cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8919b700 1 -- 172.21.15.107:0/3896317629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f84103130 msgr2=0x7f5f84198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8919b700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f84103130 0x7f5f84198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.791+0000 7f5f8919b700 1 -- 172.21.15.107:0/3896317629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84108780 msgr2=0x7f5f8419cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:15.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.792+0000 7f5f8919b700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84108780 0x7f5f8419cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:15.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.792+0000 7f5f8919b700 1 -- 172.21.15.107:0/3896317629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009520 con 0x7f5f84102770 2023-08-10T10:53:15.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.792+0000 7f5f8999c700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84108780 0x7f5f8419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:53:15.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.792+0000 7f5f8919b700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84102770 0x7f5f84198650 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000e9a0 tx=0x7f5f8000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:15.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.792+0000 7f5f7a7fc700 1 -- 172.21.15.107:0/3896317629 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80009790 con 0x7f5f84102770 2023-08-10T10:53:15.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.792+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c009d00 con 0x7f5f84102770 2023-08-10T10:53:15.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.792+0000 7f5f7a7fc700 1 -- 172.21.15.107:0/3896317629 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f8000cbd0 con 0x7f5f84102770 2023-08-10T10:53:15.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.792+0000 7f5f7a7fc700 1 -- 172.21.15.107:0/3896317629 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80018680 con 0x7f5f84102770 2023-08-10T10:53:15.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.792+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8419de30 con 0x7f5f84102770 2023-08-10T10:53:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.793+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f84067480 con 0x7f5f84102770 2023-08-10T10:53:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.796+0000 7f5f7a7fc700 1 -- 172.21.15.107:0/3896317629 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5f8000cd40 con 0x7f5f84102770 2023-08-10T10:53:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.797+0000 7f5f7a7fc700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5f700a13b0 0x7f5f700a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.798+0000 7f5f7a7fc700 1 -- 172.21.15.107:0/3896317629 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f5f80014070 con 0x7f5f84102770 2023-08-10T10:53:15.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.798+0000 7f5f8899a700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5f700a13b0 0x7f5f700a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:15.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.799+0000 7f5f8899a700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5f700a13b0 0x7f5f700a3870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f84199c60 tx=0x7f5f74009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:15.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:15.802+0000 7f5f7a7fc700 1 -- 172.21.15.107:0/3896317629 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5f80051790 con 0x7f5f84102770 2023-08-10T10:53:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:15 smithi157 ceph-mon[129604]: pgmap v64: 129 pgs: 129 active+clean; 1.4 GiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 37 MiB/s wr, 56 op/s 2023-08-10T10:53:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:15 smithi107 ceph-mon[127953]: pgmap v64: 129 pgs: 129 active+clean; 1.4 GiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 37 MiB/s wr, 56 op/s 2023-08-10T10:53:16.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.094+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f841999a0 con 0x7f5f84102770 2023-08-10T10:53:16.095 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.095+0000 7f5f7a7fc700 1 -- 172.21.15.107:0/3896317629 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+10928 (secure 0 0 0) 0x7f5f80099e60 con 0x7f5f84102770 2023-08-10T10:53:16.096 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T10:53:16.096 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/699889592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":699889592},{"type":"v1","addr":"172.21.15.157:6833","nonce":699889592}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1837769086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1837769086},{"type":"v1","addr":"172.21.15.107:6835","nonce":1837769086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-10T10:48:42.135183+0000","modified":"2023-08-10T10:52:47.699526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24575,"mds_1":24571,"mds_2":24532,"mds_3":24497,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6837/1989272471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1989272471},{"type":"v1","addr":"172.21.15.107:6837","nonce":1989272471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14670":{"gid":14670,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1945342668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1945342668},{"type":"v1","addr":"172.21.15.107:6839","nonce":1945342668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14682":{"gid":14682,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/718281985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":718281985},{"type":"v1","addr":"172.21.15.107:6841","nonce":718281985}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":20,"addr":"172.21.15.195:6833/3699521074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3699521074},{"type":"v1","addr":"172.21.15.195:6833","nonce":3699521074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":16,"addr":"172.21.15.157:6835/1674728866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":1674728866},{"type":"v1","addr":"172.21.15.157:6835","nonce":1674728866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24532":{"gid":24532,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/3324910460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3324910460},{"type":"v1","addr":"172.21.15.195:6835","nonce":3324910460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24536":{"gid":24536,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6837/2089201911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2089201911},{"type":"v1","addr":"172.21.15.157:6837","nonce":2089201911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6837/2175306413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":2175306413},{"type":"v1","addr":"172.21.15.195:6837","nonce":2175306413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24571":{"gid":24571,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6839/1633036352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":1633036352},{"type":"v1","addr":"172.21.15.195:6839","nonce":1633036352}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24575":{"gid":24575,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/2476404740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":2476404740},{"type":"v1","addr":"172.21.15.157:6839","nonce":2476404740}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:53:16.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5f700a13b0 msgr2=0x7f5f700a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5f700a13b0 0x7f5f700a3870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f84199c60 tx=0x7f5f74009260 comp rx=0 tx=0).stop 2023-08-10T10:53:16.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84102770 msgr2=0x7f5f84198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84102770 0x7f5f84198650 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000e9a0 tx=0x7f5f8000ed60 comp rx=0 tx=0).stop 2023-08-10T10:53:16.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 shutdown_connections 2023-08-10T10:53:16.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5f700a13b0 0x7f5f700a3870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f84108780 0x7f5f8419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5f84102770 0x7f5f84198650 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 --2- 172.21.15.107:0/3896317629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f84103130 0x7f5f84198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 >> 172.21.15.107:0/3896317629 conn(0x7f5f840fe200 msgr2=0x7f5f84109660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 shutdown_connections 2023-08-10T10:53:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.097+0000 7f5f8a19d700 1 -- 172.21.15.107:0/3896317629 wait complete. 2023-08-10T10:53:16.100 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 32 2023-08-10T10:53:16.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-08-10T10:53:16.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:15 smithi195 ceph-mon[129938]: pgmap v64: 129 pgs: 129 active+clean; 1.4 GiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 37 MiB/s wr, 56 op/s 2023-08-10T10:53:16.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.350+0000 7f654c3ff700 1 -- 172.21.15.107:0/2710953582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 msgr2=0x7f6544100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.350+0000 7f654c3ff700 1 --2- 172.21.15.107:0/2710953582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 0x7f6544100b40 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6534009990 tx=0x7f6534009ca0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.350+0000 7f654c3ff700 1 -- 172.21.15.107:0/2710953582 shutdown_connections 2023-08-10T10:53:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.350+0000 7f654c3ff700 1 --2- 172.21.15.107:0/2710953582 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65441066d0 0x7f6544106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.350+0000 7f654c3ff700 1 --2- 172.21.15.107:0/2710953582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6544101080 0x7f654410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.350+0000 7f654c3ff700 1 --2- 172.21.15.107:0/2710953582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 0x7f6544100b40 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.350+0000 7f654c3ff700 1 -- 172.21.15.107:0/2710953582 >> 172.21.15.107:0/2710953582 conn(0x7f65440fc1f0 msgr2=0x7f65440fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.350+0000 7f654c3ff700 1 -- 172.21.15.107:0/2710953582 shutdown_connections 2023-08-10T10:53:16.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.350+0000 7f654c3ff700 1 -- 172.21.15.107:0/2710953582 wait complete. 2023-08-10T10:53:16.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.351+0000 7f654c3ff700 1 Processor -- start 2023-08-10T10:53:16.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.351+0000 7f654c3ff700 1 -- start start 2023-08-10T10:53:16.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654c3ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 0x7f6544072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654c3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6544101080 0x7f6544072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654c3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65441066d0 0x7f65441a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654c3ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65440737e0 con 0x7f65441006c0 2023-08-10T10:53:16.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654c3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65441a4e40 con 0x7f65441066d0 2023-08-10T10:53:16.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654c3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65441a4f80 con 0x7f6544101080 2023-08-10T10:53:16.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654a19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 0x7f6544072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654a19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 0x7f6544072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49414/0 (socket says 172.21.15.107:49414) 2023-08-10T10:53:16.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654a19b700 1 -- 172.21.15.107:0/1011960631 learned_addr learned my addr 172.21.15.107:0/1011960631 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654a99c700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65441066d0 0x7f65441a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.352+0000 7f654999a700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6544101080 0x7f6544072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654a19b700 1 -- 172.21.15.107:0/1011960631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6544101080 msgr2=0x7f6544072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654a19b700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6544101080 0x7f6544072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654a19b700 1 -- 172.21.15.107:0/1011960631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65441066d0 msgr2=0x7f65441a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654a19b700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65441066d0 0x7f65441a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654a19b700 1 -- 172.21.15.107:0/1011960631 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65340095f0 con 0x7f65441006c0 2023-08-10T10:53:16.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654999a700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6544101080 0x7f6544072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:16.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654a99c700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65441066d0 0x7f65441a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:16.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654a19b700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 0x7f6544072a70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f654000d950 tx=0x7f654000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f653b7fe700 1 -- 172.21.15.107:0/1011960631 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540009b40 con 0x7f65441006c0 2023-08-10T10:53:16.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654c3ff700 1 -- 172.21.15.107:0/1011960631 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65441a51e0 con 0x7f65441006c0 2023-08-10T10:53:16.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f653b7fe700 1 -- 172.21.15.107:0/1011960631 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6540009ca0 con 0x7f65441006c0 2023-08-10T10:53:16.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f653b7fe700 1 -- 172.21.15.107:0/1011960631 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654000f620 con 0x7f65441006c0 2023-08-10T10:53:16.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.353+0000 7f654c3ff700 1 -- 172.21.15.107:0/1011960631 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65441a56c0 con 0x7f65441006c0 2023-08-10T10:53:16.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.357+0000 7f653b7fe700 1 -- 172.21.15.107:0/1011960631 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6540010460 con 0x7f65441006c0 2023-08-10T10:53:16.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.358+0000 7f655fe05b80 1 Processor -- start 2023-08-10T10:53:16.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.358+0000 7f655fe05b80 1 -- start start 2023-08-10T10:53:16.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 0x556c90a07330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a07870 0x556c90a012c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a01800 0x556c90a01c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f655fe05b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c9097cdc0 con 0x556c90a01800 2023-08-10T10:53:16.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f655fe05b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c90959590 con 0x556c90a06f50 2023-08-10T10:53:16.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f655fe05b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c90956eb0 con 0x556c90a07870 2023-08-10T10:53:16.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f653b7fe700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f65300a12c0 0x7f65300a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f654a19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a07870 0x556c90a012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f654999a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a01800 0x556c90a01c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f654a19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a07870 0x556c90a012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:35226/0 (socket says 172.21.15.107:35226) 2023-08-10T10:53:16.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f654a19b700 1 -- 172.21.15.107:0/3387743798 learned_addr learned my addr 172.21.15.107:0/3387743798 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f654a99c700 1 --2- 172.21.15.107:0/3387743798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 0x556c90a07330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f653b7fe700 1 -- 172.21.15.107:0/1011960631 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f65400cd320 con 0x7f65441006c0 2023-08-10T10:53:16.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.359+0000 7f654a99c700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f65300a12c0 0x7f65300a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f654999a700 1 -- 172.21.15.107:0/3387743798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a07870 msgr2=0x556c90a012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f654999a700 1 --2- 172.21.15.107:0/3387743798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a07870 0x556c90a012c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f654999a700 1 -- 172.21.15.107:0/3387743798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 msgr2=0x556c90a07330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f654999a700 1 --2- 172.21.15.107:0/3387743798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 0x556c90a07330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f654999a700 1 -- 172.21.15.107:0/3387743798 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c907d3630 con 0x556c90a01800 2023-08-10T10:53:16.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f654a19b700 1 --2- 172.21.15.107:0/3387743798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a07870 0x556c90a012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:16.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f654999a700 1 --2- 172.21.15.107:0/3387743798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a01800 0x556c90a01c80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f65340098e0 tx=0x7f6534005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d07f3ef9621c9d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f654a99c700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f65300a12c0 0x7f65300a3780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x556c90a02520 tx=0x7f653c00b040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f6538bfe700 1 -- 172.21.15.107:0/3387743798 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400ba90 con 0x556c90a01800 2023-08-10T10:53:16.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f6538bfe700 1 -- 172.21.15.107:0/3387743798 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f653401e040 con 0x556c90a01800 2023-08-10T10:53:16.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.360+0000 7f6538bfe700 1 -- 172.21.15.107:0/3387743798 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534005290 con 0x556c90a01800 2023-08-10T10:53:16.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.361+0000 7f655fe05b80 1 -- 172.21.15.107:0/3387743798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a01800 msgr2=0x556c90a01c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.361+0000 7f655fe05b80 1 --2- 172.21.15.107:0/3387743798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a01800 0x556c90a01c80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f65340098e0 tx=0x7f6534005c80 comp rx=0 tx=0).stop 2023-08-10T10:53:16.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.361+0000 7f655fe05b80 1 -- 172.21.15.107:0/3387743798 shutdown_connections 2023-08-10T10:53:16.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.361+0000 7f655fe05b80 1 --2- 172.21.15.107:0/3387743798 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 0x556c90a07330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.361+0000 7f655fe05b80 1 --2- 172.21.15.107:0/3387743798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a01800 0x556c90a01c80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.361+0000 7f655fe05b80 1 --2- 172.21.15.107:0/3387743798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a07870 0x556c90a012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.361+0000 7f655fe05b80 1 -- 172.21.15.107:0/3387743798 >> 172.21.15.107:0/3387743798 conn(0x556c9095ecd0 msgr2=0x556c909fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.361+0000 7f655fe05b80 1 -- 172.21.15.107:0/3387743798 shutdown_connections 2023-08-10T10:53:16.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.361+0000 7f655fe05b80 1 -- 172.21.15.107:0/3387743798 wait complete. 2023-08-10T10:53:16.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.362+0000 7f655fe05b80 1 -- start start 2023-08-10T10:53:16.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.362+0000 7f655fe05b80 1 Processor -- start 2023-08-10T10:53:16.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a0d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a06f50 0x556c90a0ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a07870 0x556c90a0b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f655fe05b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c909527a0 con 0x556c90a06f50 2023-08-10T10:53:16.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f655fe05b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c908f1ac0 con 0x556c90a07870 2023-08-10T10:53:16.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f655fe05b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c908f17c0 con 0x556c90a01800 2023-08-10T10:53:16.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f655fe05b80 10 client.0 _ll_register_callbacks cb 0x556c908ef680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:16.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f654999a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a06f50 0x556c90a0ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f654a19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a0d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f654a19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a0d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:35232/0 (socket says 172.21.15.107:35232) 2023-08-10T10:53:16.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f654a19b700 1 -- 172.21.15.107:0/1850977418 learned_addr learned my addr 172.21.15.107:0/1850977418 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.363+0000 7f654a99c700 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a07870 0x556c90a0b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.364+0000 7f654a19b700 1 -- 172.21.15.107:0/1850977418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a07870 msgr2=0x556c90a0b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.364+0000 7f654a19b700 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a07870 0x556c90a0b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.364+0000 7f654a19b700 1 -- 172.21.15.107:0/1850977418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a06f50 msgr2=0x556c90a0ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.364+0000 7f654a19b700 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a06f50 0x556c90a0ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.364+0000 7f654a19b700 1 -- 172.21.15.107:0/1850977418 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654410de90 con 0x556c90a01800 2023-08-10T10:53:16.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.364+0000 7f654999a700 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a06f50 0x556c90a0ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:16.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.364+0000 7f654a19b700 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a0d8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6540000c00 tx=0x7f65400659e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b42a7f4ed370ffd5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.364+0000 7f652dffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:53:16.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.364+0000 7f652dffb700 1 -- 172.21.15.107:0/1850977418 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654009a0f0 con 0x556c90a01800 2023-08-10T10:53:16.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.365+0000 7f655fe05b80 1 -- 172.21.15.107:0/1850977418 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c909f4470 con 0x556c90a01800 2023-08-10T10:53:16.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.365+0000 7f652dffb700 1 -- 172.21.15.107:0/1850977418 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f654009e120 con 0x556c90a01800 2023-08-10T10:53:16.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.365+0000 7f652dffb700 1 -- 172.21.15.107:0/1850977418 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6540067020 con 0x556c90a01800 2023-08-10T10:53:16.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.365+0000 7f655fe05b80 10 client.26002 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:16.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.365+0000 7f655fe05b80 1 -- 172.21.15.107:0/1850977418 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x556c9077fde0 con 0x556c90a01800 2023-08-10T10:53:16.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.365+0000 7f652dffb700 1 -- 172.21.15.107:0/1850977418 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556c909f4470 con 0x556c90a01800 2023-08-10T10:53:16.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.365+0000 7f652dffb700 1 -- 172.21.15.107:0/1850977418 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f6540096800 con 0x556c90a01800 2023-08-10T10:53:16.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.366+0000 7f655fe05b80 10 client.26002 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:16.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.366+0000 7f655fe05b80 10 client.26002 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-08-10T10:53:16.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.366+0000 7f655fe05b80 20 client.26002 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:16.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.366+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x556c90a238c0 0x556c90a25cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.366+0000 7f655fe05b80 4 client.26002 mds_command: new command op to 24469 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:53:16.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.366+0000 7f655fe05b80 1 -- 172.21.15.107:0/1850977418 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c909d09d0 con 0x556c90a238c0 2023-08-10T10:53:16.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.366+0000 7f654999a700 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x556c90a238c0 0x556c90a25cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.367+0000 7f652dffb700 10 client.26002 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:53:16.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.367+0000 7f654999a700 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x556c90a238c0 0x556c90a25cb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3804cbb0a59f30ed server_cookie=831d499f6325f6fe in_seq=0 out_seq=0 2023-08-10T10:53:16.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f652dffb700 1 -- 172.21.15.107:0/1850977418 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556c909d09d0 con 0x556c90a238c0 2023-08-10T10:53:16.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f652dffb700 10 client.26002 handle_command_reply: tid=0 2023-08-10T10:53:16.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 client.26002 shutdown 2023-08-10T10:53:16.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 -- 172.21.15.107:0/1850977418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 msgr2=0x556c90a0d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a0d8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6540000c00 tx=0x7f65400659e0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 -- 172.21.15.107:0/1850977418 shutdown_connections 2023-08-10T10:53:16.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x556c90a238c0 0x556c90a25cb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a07870 0x556c90a0b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a0d8c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1850977418 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a06f50 0x556c90a0ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 -- 172.21.15.107:0/1850977418 >> 172.21.15.107:0/1850977418 conn(0x556c9095ecd0 msgr2=0x556c909fb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f652dffb700 0 client.26002 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:53:16.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 -- 172.21.15.107:0/1850977418 shutdown_connections 2023-08-10T10:53:16.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.368+0000 7f655fe05b80 1 -- 172.21.15.107:0/1850977418 wait complete. 2023-08-10T10:53:16.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.369+0000 7f655fe05b80 20 client.26002 trim_cache size 0 max 16384 2023-08-10T10:53:16.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.383+0000 7f655fe05b80 1 Processor -- start 2023-08-10T10:53:16.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.383+0000 7f655fe05b80 1 -- start start 2023-08-10T10:53:16.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.383+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a12360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.383+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 0x556c90a06280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.383+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c909fc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.383+0000 7f655fe05b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c907d5920 con 0x556c90a07870 2023-08-10T10:53:16.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.383+0000 7f655fe05b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c90a0baa0 con 0x556c90a06f50 2023-08-10T10:53:16.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.383+0000 7f655fe05b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c90a05760 con 0x556c90a01800 2023-08-10T10:53:16.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.383+0000 7f654a99c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c909fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a99c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c909fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49448/0 (socket says 172.21.15.107:49448) 2023-08-10T10:53:16.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a99c700 1 -- 172.21.15.107:0/1605388926 learned_addr learned my addr 172.21.15.107:0/1605388926 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654999a700 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 0x556c90a06280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a19b700 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a12360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a19b700 1 -- 172.21.15.107:0/1605388926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 msgr2=0x556c90a06280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a19b700 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 0x556c90a06280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a19b700 1 -- 172.21.15.107:0/1605388926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 msgr2=0x556c909fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a19b700 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c909fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.398 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a19b700 1 -- 172.21.15.107:0/1605388926 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c909f86a0 con 0x556c90a01800 2023-08-10T10:53:16.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a99c700 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c909fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:16.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.384+0000 7f654a19b700 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a12360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6540098440 tx=0x7f65400986a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e957f6d0f6be0ce7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f65393ff700 1 -- 172.21.15.107:0/1605388926 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540067070 con 0x556c90a01800 2023-08-10T10:53:16.399 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f65393ff700 1 -- 172.21.15.107:0/1605388926 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6540099c30 con 0x556c90a01800 2023-08-10T10:53:16.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f65393ff700 1 -- 172.21.15.107:0/1605388926 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540014020 con 0x556c90a01800 2023-08-10T10:53:16.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f655fe05b80 1 -- 172.21.15.107:0/1605388926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 msgr2=0x556c90a12360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a12360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6540098440 tx=0x7f65400986a0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f655fe05b80 1 -- 172.21.15.107:0/1605388926 shutdown_connections 2023-08-10T10:53:16.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c909fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a01800 0x556c90a12360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f655fe05b80 1 --2- 172.21.15.107:0/1605388926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a06f50 0x556c90a06280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f655fe05b80 1 -- 172.21.15.107:0/1605388926 >> 172.21.15.107:0/1605388926 conn(0x556c9095ecd0 msgr2=0x556c90a05b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f655fe05b80 1 -- 172.21.15.107:0/1605388926 shutdown_connections 2023-08-10T10:53:16.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.385+0000 7f655fe05b80 1 -- 172.21.15.107:0/1605388926 wait complete. 2023-08-10T10:53:16.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.386+0000 7f655fe05b80 1 -- start start 2023-08-10T10:53:16.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.386+0000 7f655fe05b80 1 Processor -- start 2023-08-10T10:53:16.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a01800 0x556c90a03a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a06f50 0x556c90a03fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f655fe05b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c90a02970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f655fe05b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c90a046b0 con 0x556c90a07870 2023-08-10T10:53:16.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f655fe05b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c90a02eb0 con 0x556c90a01800 2023-08-10T10:53:16.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f655fe05b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c90a03070 con 0x556c90a06f50 2023-08-10T10:53:16.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f655fe05b80 10 client.0 _ll_register_callbacks cb 0x556c908ef680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:16.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f654a99c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c90a02970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f654a19b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a01800 0x556c90a03a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f654a99c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c90a02970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49458/0 (socket says 172.21.15.107:49458) 2023-08-10T10:53:16.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f654a99c700 1 -- 172.21.15.107:0/2506881609 learned_addr learned my addr 172.21.15.107:0/2506881609 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.387+0000 7f654999a700 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a06f50 0x556c90a03fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f654a19b700 1 -- 172.21.15.107:0/2506881609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a06f50 msgr2=0x556c90a03fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f654a19b700 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a06f50 0x556c90a03fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f654a19b700 1 -- 172.21.15.107:0/2506881609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 msgr2=0x556c90a02970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f654a19b700 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c90a02970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f654a19b700 1 -- 172.21.15.107:0/2506881609 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c0091c0 con 0x556c90a01800 2023-08-10T10:53:16.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f654a99c700 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c90a02970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:16.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f654999a700 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a06f50 0x556c90a03fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:16.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f654a19b700 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a01800 0x556c90a03a60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6540009520 tx=0x7f65400cd260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=583d96c085f37641 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f652dffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:53:16.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f652dffb700 1 -- 172.21.15.107:0/2506881609 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540067070 con 0x556c90a01800 2023-08-10T10:53:16.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f652dffb700 1 -- 172.21.15.107:0/2506881609 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f654009a0f0 con 0x556c90a01800 2023-08-10T10:53:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f655fe05b80 1 -- 172.21.15.107:0/2506881609 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f653401e040 con 0x556c90a01800 2023-08-10T10:53:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f652dffb700 1 -- 172.21.15.107:0/2506881609 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6540014070 con 0x556c90a01800 2023-08-10T10:53:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f655fe05b80 10 client.25988 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.388+0000 7f655fe05b80 1 -- 172.21.15.107:0/2506881609 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x556c9077fde0 con 0x556c90a01800 2023-08-10T10:53:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.389+0000 7f652dffb700 1 -- 172.21.15.107:0/2506881609 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f653401e040 con 0x556c90a01800 2023-08-10T10:53:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.389+0000 7f652dffb700 1 -- 172.21.15.107:0/2506881609 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f65400a20b0 con 0x556c90a01800 2023-08-10T10:53:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.389+0000 7f655fe05b80 10 client.25988 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:16.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.389+0000 7f655fe05b80 10 client.25988 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2023-08-10T10:53:16.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.389+0000 7f655fe05b80 20 client.25988 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:16.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.389+0000 7f655fe05b80 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x556c90a77e20 0x556c90a7a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.389+0000 7f655fe05b80 4 client.25988 mds_command: new command op to 24469 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:53:16.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.389+0000 7f655fe05b80 1 -- 172.21.15.107:0/2506881609 --> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556c9094b780 con 0x556c90a77e20 2023-08-10T10:53:16.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.389+0000 7f654999a700 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x556c90a77e20 0x556c90a7a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.390+0000 7f654999a700 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x556c90a77e20 0x556c90a7a210 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d6aaa434df5e0301 server_cookie=478834e3e071043b in_seq=0 out_seq=0 2023-08-10T10:53:16.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.390+0000 7f652dffb700 10 client.25988 ms_handle_connect on v2:172.21.15.195:6832/3699521074 2023-08-10T10:53:16.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f652dffb700 1 -- 172.21.15.107:0/2506881609 <== mds.4 v2:172.21.15.195:6832/3699521074 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556c9094b780 con 0x556c90a77e20 2023-08-10T10:53:16.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f652dffb700 10 client.25988 handle_command_reply: tid=0 2023-08-10T10:53:16.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 client.25988 shutdown 2023-08-10T10:53:16.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 -- 172.21.15.107:0/2506881609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a01800 msgr2=0x556c90a03a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a01800 0x556c90a03a60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6540009520 tx=0x7f65400cd260 comp rx=0 tx=0).stop 2023-08-10T10:53:16.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 -- 172.21.15.107:0/2506881609 shutdown_connections 2023-08-10T10:53:16.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.195:6832/3699521074,v1:172.21.15.195:6833/3699521074] conn(0x556c90a77e20 0x556c90a7a210 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556c90a01800 0x556c90a03a60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556c90a07870 0x556c90a02970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 --2- 172.21.15.107:0/2506881609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556c90a06f50 0x556c90a03fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 -- 172.21.15.107:0/2506881609 >> 172.21.15.107:0/2506881609 conn(0x556c9095ecd0 msgr2=0x556c90a06400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f652dffb700 0 client.25988 ms_handle_reset on v2:172.21.15.195:6832/3699521074 2023-08-10T10:53:16.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 -- 172.21.15.107:0/2506881609 shutdown_connections 2023-08-10T10:53:16.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 1 -- 172.21.15.107:0/2506881609 wait complete. 2023-08-10T10:53:16.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.391+0000 7f655fe05b80 20 client.25988 trim_cache size 0 max 16384 2023-08-10T10:53:16.410 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:53:16.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 -- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f65300a12c0 msgr2=0x7f65300a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f65300a12c0 0x7f65300a3780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x556c90a02520 tx=0x7f653c00b040 comp rx=0 tx=0).stop 2023-08-10T10:53:16.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 -- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 msgr2=0x7f6544072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 0x7f6544072a70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f654000d950 tx=0x7f654000dd10 comp rx=0 tx=0).stop 2023-08-10T10:53:16.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 -- 172.21.15.107:0/1011960631 shutdown_connections 2023-08-10T10:53:16.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f65300a12c0 0x7f65300a3780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65441066d0 0x7f65441a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f65441006c0 0x7f6544072a70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 --2- 172.21.15.107:0/1011960631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6544101080 0x7f6544072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 -- 172.21.15.107:0/1011960631 >> 172.21.15.107:0/1011960631 conn(0x7f65440fc1f0 msgr2=0x7f65440fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 -- 172.21.15.107:0/1011960631 shutdown_connections 2023-08-10T10:53:16.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.392+0000 7f654c3ff700 1 -- 172.21.15.107:0/1011960631 wait complete. 2023-08-10T10:53:16.413 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-08-10T10:53:16.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.639+0000 7ff08bfff700 1 -- 172.21.15.107:0/61367775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff084101080 msgr2=0x7ff08410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.639+0000 7ff08bfff700 1 --2- 172.21.15.107:0/61367775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff084101080 0x7ff08410d590 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00b0a0 tx=0x7ff07c00b3b0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.639+0000 7ff08bfff700 1 -- 172.21.15.107:0/61367775 shutdown_connections 2023-08-10T10:53:16.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.639+0000 7ff08bfff700 1 --2- 172.21.15.107:0/61367775 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff084101080 0x7ff08410d590 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.639+0000 7ff08bfff700 1 --2- 172.21.15.107:0/61367775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0841066d0 0x7ff084106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.639+0000 7ff08bfff700 1 --2- 172.21.15.107:0/61367775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0841006c0 0x7ff084100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.639+0000 7ff08bfff700 1 -- 172.21.15.107:0/61367775 >> 172.21.15.107:0/61367775 conn(0x7ff0840fc1f0 msgr2=0x7ff0840fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.639+0000 7ff08bfff700 1 -- 172.21.15.107:0/61367775 shutdown_connections 2023-08-10T10:53:16.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.639+0000 7ff08bfff700 1 -- 172.21.15.107:0/61367775 wait complete. 2023-08-10T10:53:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.640+0000 7ff08bfff700 1 Processor -- start 2023-08-10T10:53:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.640+0000 7ff08bfff700 1 -- start start 2023-08-10T10:53:16.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0841006c0 0x7ff08419e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff084101080 0x7ff08419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0841066d0 0x7ff0841986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08bfff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff084198d20 con 0x7ff0841066d0 2023-08-10T10:53:16.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08bfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff084198e90 con 0x7ff0841006c0 2023-08-10T10:53:16.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08bfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff084199050 con 0x7ff084101080 2023-08-10T10:53:16.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0841066d0 0x7ff0841986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0841066d0 0x7ff0841986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49486/0 (socket says 172.21.15.107:49486) 2023-08-10T10:53:16.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08a59c700 1 -- 172.21.15.107:0/2146217472 learned_addr learned my addr 172.21.15.107:0/2146217472 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff089d9b700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0841006c0 0x7ff08419e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08959a700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff084101080 0x7ff08419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08a59c700 1 -- 172.21.15.107:0/2146217472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff084101080 msgr2=0x7ff08419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08a59c700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff084101080 0x7ff08419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08a59c700 1 -- 172.21.15.107:0/2146217472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0841006c0 msgr2=0x7ff08419e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08a59c700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0841006c0 0x7ff08419e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.641+0000 7ff08a59c700 1 -- 172.21.15.107:0/2146217472 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c009d00 con 0x7ff0841066d0 2023-08-10T10:53:16.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.642+0000 7ff08a59c700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0841066d0 0x7ff0841986b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009fd0 tx=0x7ff07c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.642+0000 7ff07affd700 1 -- 172.21.15.107:0/2146217472 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c00e040 con 0x7ff0841066d0 2023-08-10T10:53:16.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.642+0000 7ff07affd700 1 -- 172.21.15.107:0/2146217472 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff07c0094c0 con 0x7ff0841066d0 2023-08-10T10:53:16.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.642+0000 7ff08bfff700 1 -- 172.21.15.107:0/2146217472 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0841992d0 con 0x7ff0841066d0 2023-08-10T10:53:16.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.642+0000 7ff07affd700 1 -- 172.21.15.107:0/2146217472 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c01dea0 con 0x7ff0841066d0 2023-08-10T10:53:16.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.642+0000 7ff08bfff700 1 -- 172.21.15.107:0/2146217472 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0841a5630 con 0x7ff0841066d0 2023-08-10T10:53:16.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.646+0000 7ff07affd700 1 -- 172.21.15.107:0/2146217472 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff07c01d470 con 0x7ff0841066d0 2023-08-10T10:53:16.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff09f8b0b80 1 Processor -- start 2023-08-10T10:53:16.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff07affd700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0700a1340 0x7ff0700a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff09f8b0b80 1 -- start start 2023-08-10T10:53:16.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff07affd700 1 -- 172.21.15.107:0/2146217472 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff07c0ce230 con 0x7ff0841066d0 2023-08-10T10:53:16.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cfa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cf42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112c6fdc0 con 0x563112cf9f50 2023-08-10T10:53:16.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112c4c590 con 0x563112cf4800 2023-08-10T10:53:16.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112c49eb0 con 0x563112cfa870 2023-08-10T10:53:16.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff08959a700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0700a1340 0x7ff0700a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.648+0000 7ff089d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cfa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff089d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cfa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49496/0 (socket says 172.21.15.107:49496) 2023-08-10T10:53:16.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff089d9b700 1 -- 172.21.15.107:0/3962253663 learned_addr learned my addr 172.21.15.107:0/3962253663 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff08a59c700 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff089d9b700 1 -- 172.21.15.107:0/3962253663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 msgr2=0x563112cf42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff08959a700 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cf42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff089d9b700 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cf42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff089d9b700 1 -- 172.21.15.107:0/3962253663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 msgr2=0x563112cf4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff089d9b700 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff089d9b700 1 -- 172.21.15.107:0/3962253663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563112ac6630 con 0x563112cf9f50 2023-08-10T10:53:16.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff08959a700 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cf42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:53:16.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff08a59c700 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:16.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff08959a700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0700a1340 0x7ff0700a3800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff084105c30 tx=0x7ff074011440 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.649+0000 7ff089d9b700 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cfa330 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff080009d00 tx=0x7ff080011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c732b9c48b99d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.650+0000 7ff06ffff700 1 -- 172.21.15.107:0/3962253663 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080004230 con 0x563112cf9f50 2023-08-10T10:53:16.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.650+0000 7ff06ffff700 1 -- 172.21.15.107:0/3962253663 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff080004390 con 0x563112cf9f50 2023-08-10T10:53:16.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.650+0000 7ff06ffff700 1 -- 172.21.15.107:0/3962253663 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080019660 con 0x563112cf9f50 2023-08-10T10:53:16.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.650+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/3962253663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 msgr2=0x563112cfa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.650+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cfa330 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff080009d00 tx=0x7ff080011720 comp rx=0 tx=0).stop 2023-08-10T10:53:16.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.650+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/3962253663 shutdown_connections 2023-08-10T10:53:16.658 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.650+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.650+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cfa330 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.650+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/3962253663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cf42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.651+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/3962253663 >> 172.21.15.107:0/3962253663 conn(0x563112c51cd0 msgr2=0x563112cef4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.651+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/3962253663 shutdown_connections 2023-08-10T10:53:16.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.651+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/3962253663 wait complete. 2023-08-10T10:53:16.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.651+0000 7ff09f8b0b80 1 -- start start 2023-08-10T10:53:16.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.651+0000 7ff09f8b0b80 1 Processor -- start 2023-08-10T10:53:16.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112d008b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 0x563112cfdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cfe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112c457a0 con 0x563112cf4800 2023-08-10T10:53:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112be4ac0 con 0x563112cf9f50 2023-08-10T10:53:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112be47c0 con 0x563112cfa870 2023-08-10T10:53:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff09f8b0b80 10 client.0 _ll_register_callbacks cb 0x563112be2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff089d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112d008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff08959a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 0x563112cfdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff089d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112d008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49498/0 (socket says 172.21.15.107:49498) 2023-08-10T10:53:16.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff089d9b700 1 -- 172.21.15.107:0/2921282897 learned_addr learned my addr 172.21.15.107:0/2921282897 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.652+0000 7ff08959a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 0x563112cfdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:45840/0 (socket says 172.21.15.107:45840) 2023-08-10T10:53:16.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.653+0000 7ff08a59c700 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cfe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.653+0000 7ff089d9b700 1 -- 172.21.15.107:0/2921282897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 msgr2=0x563112cfe0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.653+0000 7ff089d9b700 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cfe0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.653+0000 7ff089d9b700 1 -- 172.21.15.107:0/2921282897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 msgr2=0x563112cfdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.653+0000 7ff089d9b700 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 0x563112cfdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.653+0000 7ff089d9b700 1 -- 172.21.15.107:0/2921282897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff080009960 con 0x563112cf4800 2023-08-10T10:53:16.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.653+0000 7ff089d9b700 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112d008b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff080006010 tx=0x7ff080003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0add73fe76868dc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.653+0000 7ff06d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:16.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.654+0000 7ff06d7fa700 1 -- 172.21.15.107:0/2921282897 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080005450 con 0x563112cf4800 2023-08-10T10:53:16.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.654+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/2921282897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563112ce7470 con 0x563112cf4800 2023-08-10T10:53:16.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.654+0000 7ff06d7fa700 1 -- 172.21.15.107:0/2921282897 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff080005ce0 con 0x563112cf4800 2023-08-10T10:53:16.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.654+0000 7ff06d7fa700 1 -- 172.21.15.107:0/2921282897 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff080004500 con 0x563112cf4800 2023-08-10T10:53:16.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.654+0000 7ff09f8b0b80 10 client.16326 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:16.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.654+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/2921282897 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x563112a72de0 con 0x563112cf4800 2023-08-10T10:53:16.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.654+0000 7ff06d7fa700 1 -- 172.21.15.107:0/2921282897 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563112ce7470 con 0x563112cf4800 2023-08-10T10:53:16.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.655+0000 7ff06d7fa700 1 -- 172.21.15.107:0/2921282897 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7ff080028020 con 0x563112cf4800 2023-08-10T10:53:16.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.655+0000 7ff09f8b0b80 10 client.16326 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:16.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.655+0000 7ff09f8b0b80 10 client.16326 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T10:53:16.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.655+0000 7ff09f8b0b80 20 client.16326 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:16.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.655+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x563112d0e160 0x563112d10580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.655+0000 7ff09f8b0b80 4 client.16326 mds_command: new command op to 24497 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:53:16.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.655+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/2921282897 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563112cc39d0 con 0x563112d0e160 2023-08-10T10:53:16.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.655+0000 7ff08959a700 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x563112d0e160 0x563112d10580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.656+0000 7ff08959a700 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x563112d0e160 0x563112d10580 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=51ff194e3db1d6e6 server_cookie=d2902c7c2473b851 in_seq=0 out_seq=0 2023-08-10T10:53:16.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.656+0000 7ff06d7fa700 10 client.16326 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:53:16.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.657+0000 7ff06d7fa700 1 -- 172.21.15.107:0/2921282897 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563112cc39d0 con 0x563112d0e160 2023-08-10T10:53:16.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.657+0000 7ff06d7fa700 10 client.16326 handle_command_reply: tid=0 2023-08-10T10:53:16.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.657+0000 7ff09f8b0b80 1 client.16326 shutdown 2023-08-10T10:53:16.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.657+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/2921282897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 msgr2=0x563112d008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.657+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112d008b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff080006010 tx=0x7ff080003930 comp rx=0 tx=0).stop 2023-08-10T10:53:16.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/2921282897 shutdown_connections 2023-08-10T10:53:16.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x563112d0e160 0x563112d10580 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cfe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112d008b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/2921282897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 0x563112cfdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff06d7fa700 0 client.16326 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:53:16.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/2921282897 >> 172.21.15.107:0/2921282897 conn(0x563112c51cd0 msgr2=0x563112cee9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/2921282897 shutdown_connections 2023-08-10T10:53:16.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/2921282897 wait complete. 2023-08-10T10:53:16.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.658+0000 7ff09f8b0b80 20 client.16326 trim_cache size 0 max 16384 2023-08-10T10:53:16.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.676+0000 7ff09f8b0b80 1 Processor -- start 2023-08-10T10:53:16.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.676+0000 7ff09f8b0b80 1 -- start start 2023-08-10T10:53:16.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.676+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112cfda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 0x563112d14ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112d05360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112ac8920 con 0x563112cf4800 2023-08-10T10:53:16.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112d058a0 con 0x563112cf9f50 2023-08-10T10:53:16.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112ce6fe0 con 0x563112cfa870 2023-08-10T10:53:16.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff089d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112cfda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff089d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112cfda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49514/0 (socket says 172.21.15.107:49514) 2023-08-10T10:53:16.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff089d9b700 1 -- 172.21.15.107:0/1166644542 learned_addr learned my addr 172.21.15.107:0/1166644542 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff08959a700 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 0x563112d14ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff089d9b700 1 -- 172.21.15.107:0/1166644542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 msgr2=0x563112d05360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff08a59c700 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112d05360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff089d9b700 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112d05360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff089d9b700 1 -- 172.21.15.107:0/1166644542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 msgr2=0x563112d14ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff089d9b700 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 0x563112d14ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff089d9b700 1 -- 172.21.15.107:0/1166644542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563112a5bc60 con 0x563112cf4800 2023-08-10T10:53:16.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.677+0000 7ff08a59c700 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112d05360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:53:16.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.678+0000 7ff089d9b700 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112cfda70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff080000c00 tx=0x7ff080003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e349991a5e3de1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.678+0000 7ff078ff9700 1 -- 172.21.15.107:0/1166644542 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800227b0 con 0x563112cf4800 2023-08-10T10:53:16.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.678+0000 7ff078ff9700 1 -- 172.21.15.107:0/1166644542 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff080005c20 con 0x563112cf4800 2023-08-10T10:53:16.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.678+0000 7ff078ff9700 1 -- 172.21.15.107:0/1166644542 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800054b0 con 0x563112cf4800 2023-08-10T10:53:16.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1166644542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 msgr2=0x563112cfda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112cfda70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff080000c00 tx=0x7ff080003d50 comp rx=0 tx=0).stop 2023-08-10T10:53:16.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1166644542 shutdown_connections 2023-08-10T10:53:16.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112d05360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf4800 0x563112cfda70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1166644542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf9f50 0x563112d14ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1166644542 >> 172.21.15.107:0/1166644542 conn(0x563112c51cd0 msgr2=0x563112cfd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1166644542 shutdown_connections 2023-08-10T10:53:16.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1166644542 wait complete. 2023-08-10T10:53:16.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.679+0000 7ff09f8b0b80 1 -- start start 2023-08-10T10:53:16.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff09f8b0b80 1 Processor -- start 2023-08-10T10:53:16.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cf5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff09f8b0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cf64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112cf6b80 con 0x563112cf9f50 2023-08-10T10:53:16.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112cf6cf0 con 0x563112cf4800 2023-08-10T10:53:16.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff09f8b0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563112cf6eb0 con 0x563112cfa870 2023-08-10T10:53:16.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff09f8b0b80 10 client.0 _ll_register_callbacks cb 0x563112be2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:16.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff08959a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cf5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff089d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff08959a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cf5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49526/0 (socket says 172.21.15.107:49526) 2023-08-10T10:53:16.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.680+0000 7ff08959a700 1 -- 172.21.15.107:0/1146275941 learned_addr learned my addr 172.21.15.107:0/1146275941 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.681+0000 7ff08a59c700 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cf64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.681+0000 7ff089d9b700 1 -- 172.21.15.107:0/1146275941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 msgr2=0x563112cf64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.681+0000 7ff089d9b700 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cf64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.681+0000 7ff089d9b700 1 -- 172.21.15.107:0/1146275941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 msgr2=0x563112cf5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.681+0000 7ff089d9b700 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cf5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.681+0000 7ff089d9b700 1 -- 172.21.15.107:0/1146275941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563112a72de0 con 0x563112cf4800 2023-08-10T10:53:16.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.681+0000 7ff08959a700 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cf5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:16.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.681+0000 7ff089d9b700 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf5970 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff080009c50 tx=0x7ff0800229e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1753e28cab2dfd57 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.681+0000 7ff06d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:53:16.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.682+0000 7ff06d7fa700 1 -- 172.21.15.107:0/1146275941 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080003aa0 con 0x563112cf4800 2023-08-10T10:53:16.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.682+0000 7ff06d7fa700 1 -- 172.21.15.107:0/1146275941 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff080000e40 con 0x563112cf4800 2023-08-10T10:53:16.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.682+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1146275941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff080004390 con 0x563112cf4800 2023-08-10T10:53:16.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.682+0000 7ff06d7fa700 1 -- 172.21.15.107:0/1146275941 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff08000faf0 con 0x563112cf4800 2023-08-10T10:53:16.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.682+0000 7ff09f8b0b80 10 client.26006 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:16.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.682+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1146275941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x563112a99250 con 0x563112cf4800 2023-08-10T10:53:16.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.682+0000 7ff06d7fa700 1 -- 172.21.15.107:0/1146275941 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff080049080 con 0x563112cf4800 2023-08-10T10:53:16.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.682+0000 7ff06d7fa700 1 -- 172.21.15.107:0/1146275941 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7ff080011840 con 0x563112cf4800 2023-08-10T10:53:16.689 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.683+0000 7ff09f8b0b80 10 client.26006 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:16.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.683+0000 7ff09f8b0b80 10 client.26006 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-08-10T10:53:16.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.683+0000 7ff09f8b0b80 20 client.26006 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:16.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.683+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x563112d62680 0x563112d64aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.683+0000 7ff09f8b0b80 4 client.26006 mds_command: new command op to 24497 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:53:16.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.683+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1146275941 --> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563112c3e780 con 0x563112d62680 2023-08-10T10:53:16.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.683+0000 7ff08959a700 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x563112d62680 0x563112d64aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.684+0000 7ff06d7fa700 10 client.26006 ms_handle_connect on v2:172.21.15.157:6834/1674728866 2023-08-10T10:53:16.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.684+0000 7ff08959a700 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x563112d62680 0x563112d64aa0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7aab9027c05de9a3 server_cookie=296dad3019544dab in_seq=0 out_seq=0 2023-08-10T10:53:16.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.684+0000 7ff06d7fa700 1 -- 172.21.15.107:0/1146275941 <== mds.3 v2:172.21.15.157:6834/1674728866 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563112c3e780 con 0x563112d62680 2023-08-10T10:53:16.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.684+0000 7ff06d7fa700 10 client.26006 handle_command_reply: tid=0 2023-08-10T10:53:16.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.684+0000 7ff09f8b0b80 1 client.26006 shutdown 2023-08-10T10:53:16.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.684+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1146275941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 msgr2=0x563112cf5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.684+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf5970 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff080009c50 tx=0x7ff0800229e0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1146275941 shutdown_connections 2023-08-10T10:53:16.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.157:6834/1674728866,v1:172.21.15.157:6835/1674728866] conn(0x563112d62680 0x563112d64aa0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563112cf4800 0x563112cf5970 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff06d7fa700 0 client.26006 ms_handle_reset on v2:172.21.15.157:6834/1674728866 2023-08-10T10:53:16.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563112cfa870 0x563112cf64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff09f8b0b80 1 --2- 172.21.15.107:0/1146275941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563112cf9f50 0x563112cf5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1146275941 >> 172.21.15.107:0/1146275941 conn(0x563112c51cd0 msgr2=0x563112cf8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1146275941 shutdown_connections 2023-08-10T10:53:16.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff09f8b0b80 1 -- 172.21.15.107:0/1146275941 wait complete. 2023-08-10T10:53:16.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.685+0000 7ff09f8b0b80 20 client.26006 trim_cache size 0 max 16384 2023-08-10T10:53:16.694 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:53:16.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 -- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0700a1340 msgr2=0x7ff0700a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0700a1340 0x7ff0700a3800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff084105c30 tx=0x7ff074011440 comp rx=0 tx=0).stop 2023-08-10T10:53:16.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 -- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0841066d0 msgr2=0x7ff0841986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0841066d0 0x7ff0841986b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009fd0 tx=0x7ff07c00bce0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 -- 172.21.15.107:0/2146217472 shutdown_connections 2023-08-10T10:53:16.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0700a1340 0x7ff0700a3800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0841006c0 0x7ff08419e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff0841066d0 0x7ff0841986b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 --2- 172.21.15.107:0/2146217472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff084101080 0x7ff08419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 -- 172.21.15.107:0/2146217472 >> 172.21.15.107:0/2146217472 conn(0x7ff0840fc1f0 msgr2=0x7ff08410baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.686+0000 7ff08bfff700 1 -- 172.21.15.107:0/2146217472 shutdown_connections 2023-08-10T10:53:16.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.687+0000 7ff08bfff700 1 -- 172.21.15.107:0/2146217472 wait complete. 2023-08-10T10:53:16.711 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-08-10T10:53:16.724 INFO:teuthology.orchestra.run.smithi107.stderr:6200000 of 50000000 tuples (12%) done (elapsed 94.90 s, remaining 670.44 s) 2023-08-10T10:53:16.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.933+0000 7f778b3ff700 1 -- 172.21.15.107:0/3057256649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 msgr2=0x7f7784100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.933+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3057256649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 0x7f7784100b60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7774009990 tx=0x7f7774009ca0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.933+0000 7f778b3ff700 1 -- 172.21.15.107:0/3057256649 shutdown_connections 2023-08-10T10:53:16.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.933+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3057256649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77841066f0 0x7f7784106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.933+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3057256649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77841010a0 0x7f778410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.933+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3057256649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 0x7f7784100b60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.933+0000 7f778b3ff700 1 -- 172.21.15.107:0/3057256649 >> 172.21.15.107:0/3057256649 conn(0x7f77840fc1d0 msgr2=0x7f77840fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.933+0000 7f778b3ff700 1 -- 172.21.15.107:0/3057256649 shutdown_connections 2023-08-10T10:53:16.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.933+0000 7f778b3ff700 1 -- 172.21.15.107:0/3057256649 wait complete. 2023-08-10T10:53:16.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.934+0000 7f778b3ff700 1 Processor -- start 2023-08-10T10:53:16.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778b3ff700 1 -- start start 2023-08-10T10:53:16.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778b3ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 0x7f7784072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778b3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77841010a0 0x7f7784072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778b3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77841066f0 0x7f77841a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778b3ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7784073850 con 0x7f77841006e0 2023-08-10T10:53:16.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778b3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77841a4e90 con 0x7f77841066f0 2023-08-10T10:53:16.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778b3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77841a4fd0 con 0x7f77841010a0 2023-08-10T10:53:16.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 0x7f7784072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 0x7f7784072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49552/0 (socket says 172.21.15.107:49552) 2023-08-10T10:53:16.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778919b700 1 -- 172.21.15.107:0/3842582619 learned_addr learned my addr 172.21.15.107:0/3842582619 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.935+0000 7f778899a700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77841010a0 0x7f7784072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f778999c700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77841066f0 0x7f77841a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f778919b700 1 -- 172.21.15.107:0/3842582619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77841010a0 msgr2=0x7f7784072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f778919b700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77841010a0 0x7f7784072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f778919b700 1 -- 172.21.15.107:0/3842582619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77841066f0 msgr2=0x7f77841a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f778919b700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77841066f0 0x7f77841a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f778919b700 1 -- 172.21.15.107:0/3842582619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740095f0 con 0x7f77841006e0 2023-08-10T10:53:16.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f778919b700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 0x7f7784072a70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f778000e9d0 tx=0x7f778000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f777a7fc700 1 -- 172.21.15.107:0/3842582619 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780009790 con 0x7f77841006e0 2023-08-10T10:53:16.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f777a7fc700 1 -- 172.21.15.107:0/3842582619 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f778000cbd0 con 0x7f77841006e0 2023-08-10T10:53:16.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f778b3ff700 1 -- 172.21.15.107:0/3842582619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77841a5280 con 0x7f77841006e0 2023-08-10T10:53:16.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f777a7fc700 1 -- 172.21.15.107:0/3842582619 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780018680 con 0x7f77841006e0 2023-08-10T10:53:16.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.936+0000 7f778b3ff700 1 -- 172.21.15.107:0/3842582619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77841a57b0 con 0x7f77841006e0 2023-08-10T10:53:16.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.940+0000 7f777a7fc700 1 -- 172.21.15.107:0/3842582619 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f778000cd40 con 0x7f77841006e0 2023-08-10T10:53:16.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.942+0000 7f779edcfb80 1 Processor -- start 2023-08-10T10:53:16.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.942+0000 7f777a7fc700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77700a1340 0x7f77700a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.942+0000 7f777a7fc700 1 -- 172.21.15.107:0/3842582619 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f7780014070 con 0x7f77841006e0 2023-08-10T10:53:16.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.942+0000 7f779edcfb80 1 -- start start 2023-08-10T10:53:16.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.942+0000 7f778999c700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77700a1340 0x7f77700a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.942+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12df50 0x55a43e12e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.942+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12e870 0x55a43e1282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.942+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e128c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.942+0000 7f779edcfb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e0a3dc0 con 0x55a43e128800 2023-08-10T10:53:16.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f779edcfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e080590 con 0x55a43e12e870 2023-08-10T10:53:16.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f779edcfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e07deb0 con 0x55a43e12df50 2023-08-10T10:53:16.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778919b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12df50 0x55a43e12e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778919b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12df50 0x55a43e12e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:35346/0 (socket says 172.21.15.107:35346) 2023-08-10T10:53:16.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778919b700 1 -- 172.21.15.107:0/2569700884 learned_addr learned my addr 172.21.15.107:0/2569700884 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778999c700 1 --2- 172.21.15.107:0/2569700884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e128c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778899a700 1 --2- 172.21.15.107:0/2569700884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12e870 0x55a43e1282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778999c700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77700a1340 0x7f77700a3800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f777c009cc0 tx=0x7f777c0077e0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778919b700 1 -- 172.21.15.107:0/2569700884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12e870 msgr2=0x55a43e1282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778919b700 1 --2- 172.21.15.107:0/2569700884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12e870 0x55a43e1282c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778919b700 1 -- 172.21.15.107:0/2569700884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 msgr2=0x55a43e128c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778919b700 1 --2- 172.21.15.107:0/2569700884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e128c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.943+0000 7f778919b700 1 -- 172.21.15.107:0/2569700884 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a43defa630 con 0x55a43e12df50 2023-08-10T10:53:16.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.944+0000 7f778919b700 1 --2- 172.21.15.107:0/2569700884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12df50 0x55a43e12e330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f77800969f0 tx=0x7f7780011e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ff2e5e747ddb6e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.944+0000 7f776f7fe700 1 -- 172.21.15.107:0/2569700884 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800a23d0 con 0x55a43e12df50 2023-08-10T10:53:16.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.944+0000 7f776f7fe700 1 -- 172.21.15.107:0/2569700884 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f778009a1e0 con 0x55a43e12df50 2023-08-10T10:53:16.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.944+0000 7f776f7fe700 1 -- 172.21.15.107:0/2569700884 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800a2160 con 0x55a43e12df50 2023-08-10T10:53:16.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.944+0000 7f779edcfb80 1 -- 172.21.15.107:0/2569700884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12df50 msgr2=0x55a43e12e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.944+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2569700884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12df50 0x55a43e12e330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f77800969f0 tx=0x7f7780011e30 comp rx=0 tx=0).stop 2023-08-10T10:53:16.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.945+0000 7f779edcfb80 1 -- 172.21.15.107:0/2569700884 shutdown_connections 2023-08-10T10:53:16.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.945+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2569700884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e128c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.945+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2569700884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12df50 0x55a43e12e330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.945+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2569700884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12e870 0x55a43e1282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.945+0000 7f779edcfb80 1 -- 172.21.15.107:0/2569700884 >> 172.21.15.107:0/2569700884 conn(0x55a43e085cd0 msgr2=0x55a43e1234d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.945+0000 7f779edcfb80 1 -- 172.21.15.107:0/2569700884 shutdown_connections 2023-08-10T10:53:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.945+0000 7f779edcfb80 1 -- 172.21.15.107:0/2569700884 wait complete. 2023-08-10T10:53:16.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.945+0000 7f779edcfb80 1 -- start start 2023-08-10T10:53:16.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.946+0000 7f779edcfb80 1 Processor -- start 2023-08-10T10:53:16.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.946+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e128800 0x55a43e131cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.946+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e12df50 0x55a43e1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.946+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e132730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.946+0000 7f779edcfb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e0797a0 con 0x55a43e12df50 2023-08-10T10:53:16.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.946+0000 7f779edcfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e018ac0 con 0x55a43e128800 2023-08-10T10:53:16.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.946+0000 7f779edcfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e0187c0 con 0x55a43e12e870 2023-08-10T10:53:16.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.946+0000 7f779edcfb80 10 client.0 _ll_register_callbacks cb 0x55a43e016680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:16.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778919b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e128800 0x55a43e131cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778919b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e128800 0x55a43e131cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:45904/0 (socket says 172.21.15.107:45904) 2023-08-10T10:53:16.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778919b700 1 -- 172.21.15.107:0/3013691741 learned_addr learned my addr 172.21.15.107:0/3013691741 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778899a700 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e12df50 0x55a43e1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778999c700 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778899a700 1 -- 172.21.15.107:0/3013691741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 msgr2=0x55a43e132730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778899a700 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e132730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778899a700 1 -- 172.21.15.107:0/3013691741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e128800 msgr2=0x55a43e131cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778899a700 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e128800 0x55a43e131cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778899a700 1 -- 172.21.15.107:0/3013691741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77841a57b0 con 0x55a43e12df50 2023-08-10T10:53:16.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.947+0000 7f778919b700 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e128800 0x55a43e131cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:16.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.948+0000 7f778899a700 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e12df50 0x55a43e1321f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7774005910 tx=0x7f7774005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7baf47a47292b28 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.948+0000 7f776cff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:16.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.948+0000 7f776cff9700 1 -- 172.21.15.107:0/3013691741 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777401d070 con 0x55a43e12df50 2023-08-10T10:53:16.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.948+0000 7f776cff9700 1 -- 172.21.15.107:0/3013691741 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f7774004500 con 0x55a43e12df50 2023-08-10T10:53:16.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.948+0000 7f779edcfb80 1 -- 172.21.15.107:0/3013691741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a43e11b470 con 0x55a43e12df50 2023-08-10T10:53:16.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.948+0000 7f776cff9700 1 -- 172.21.15.107:0/3013691741 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77740046c0 con 0x55a43e12df50 2023-08-10T10:53:16.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.949+0000 7f779edcfb80 10 client.16344 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:16.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.949+0000 7f779edcfb80 1 -- 172.21.15.107:0/3013691741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55a43dea6de0 con 0x55a43e12df50 2023-08-10T10:53:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.949+0000 7f776cff9700 1 -- 172.21.15.107:0/3013691741 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a43e11b470 con 0x55a43e12df50 2023-08-10T10:53:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.949+0000 7f776cff9700 1 -- 172.21.15.107:0/3013691741 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f777400f810 con 0x55a43e12df50 2023-08-10T10:53:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.950+0000 7f779edcfb80 10 client.16344 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.950+0000 7f779edcfb80 10 client.16344 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T10:53:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.950+0000 7f779edcfb80 20 client.16344 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.950+0000 7f779edcfb80 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55a43e1532c0 0x55a43e1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.950+0000 7f779edcfb80 4 client.16344 mds_command: new command op to 24532 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:53:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.950+0000 7f779edcfb80 1 -- 172.21.15.107:0/3013691741 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a43e0f79d0 con 0x55a43e1532c0 2023-08-10T10:53:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.950+0000 7f778919b700 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55a43e1532c0 0x55a43e1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.950+0000 7f778919b700 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55a43e1532c0 0x55a43e1556e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=250cdf2ecbedf83e server_cookie=1836bb7381bea460 in_seq=0 out_seq=0 2023-08-10T10:53:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.950+0000 7f776cff9700 10 client.16344 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:53:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.951+0000 7f776cff9700 1 -- 172.21.15.107:0/3013691741 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a43e0f79d0 con 0x55a43e1532c0 2023-08-10T10:53:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.951+0000 7f776cff9700 10 client.16344 handle_command_reply: tid=0 2023-08-10T10:53:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.951+0000 7f779edcfb80 1 client.16344 shutdown 2023-08-10T10:53:16.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.951+0000 7f779edcfb80 1 -- 172.21.15.107:0/3013691741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e12df50 msgr2=0x55a43e1321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.951+0000 7f779edcfb80 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e12df50 0x55a43e1321f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7774005910 tx=0x7f7774005a90 comp rx=0 tx=0).stop 2023-08-10T10:53:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f779edcfb80 1 -- 172.21.15.107:0/3013691741 shutdown_connections 2023-08-10T10:53:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f779edcfb80 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55a43e1532c0 0x55a43e1556e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f779edcfb80 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e128800 0x55a43e131cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f779edcfb80 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e132730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f779edcfb80 1 --2- 172.21.15.107:0/3013691741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e12df50 0x55a43e1321f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f779edcfb80 1 -- 172.21.15.107:0/3013691741 >> 172.21.15.107:0/3013691741 conn(0x55a43e085cd0 msgr2=0x55a43e1229b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f776cff9700 0 client.16344 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:53:16.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f779edcfb80 1 -- 172.21.15.107:0/3013691741 shutdown_connections 2023-08-10T10:53:16.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f779edcfb80 1 -- 172.21.15.107:0/3013691741 wait complete. 2023-08-10T10:53:16.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.952+0000 7f779edcfb80 20 client.16344 trim_cache size 0 max 16384 2023-08-10T10:53:16.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.966+0000 7f779edcfb80 1 Processor -- start 2023-08-10T10:53:16.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.966+0000 7f779edcfb80 1 -- start start 2023-08-10T10:53:16.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e14a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e12d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f779edcfb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43defc920 con 0x55a43e128800 2023-08-10T10:53:16.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f779edcfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e145f50 con 0x55a43e12df50 2023-08-10T10:53:16.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f779edcfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e12fc60 con 0x55a43e12e870 2023-08-10T10:53:16.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f778919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f778919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1282c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49564/0 (socket says 172.21.15.107:49564) 2023-08-10T10:53:16.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f778919b700 1 -- 172.21.15.107:0/1333019975 learned_addr learned my addr 172.21.15.107:0/1333019975 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f778899a700 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e14a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.967+0000 7f778999c700 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e12d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f778919b700 1 -- 172.21.15.107:0/1333019975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 msgr2=0x55a43e12d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f778919b700 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e12d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f778919b700 1 -- 172.21.15.107:0/1333019975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 msgr2=0x55a43e14a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f778919b700 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e14a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f778919b700 1 -- 172.21.15.107:0/1333019975 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a43de8fc60 con 0x55a43e128800 2023-08-10T10:53:16.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f778899a700 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e14a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:16.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f778919b700 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1282c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f77800969f0 tx=0x7f7780099e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd569cd5cd4e4b63 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f776ffff700 1 -- 172.21.15.107:0/1333019975 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800b82b0 con 0x55a43e128800 2023-08-10T10:53:16.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f776ffff700 1 -- 172.21.15.107:0/1333019975 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f778009a350 con 0x55a43e128800 2023-08-10T10:53:16.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.968+0000 7f776ffff700 1 -- 172.21.15.107:0/1333019975 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780094b90 con 0x55a43e128800 2023-08-10T10:53:16.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.969+0000 7f779edcfb80 1 -- 172.21.15.107:0/1333019975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 msgr2=0x55a43e1282c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.969+0000 7f779edcfb80 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1282c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f77800969f0 tx=0x7f7780099e60 comp rx=0 tx=0).stop 2023-08-10T10:53:16.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.969+0000 7f779edcfb80 1 -- 172.21.15.107:0/1333019975 shutdown_connections 2023-08-10T10:53:16.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.969+0000 7f779edcfb80 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e12d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.969+0000 7f779edcfb80 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1282c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.969+0000 7f779edcfb80 1 --2- 172.21.15.107:0/1333019975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e14a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.969+0000 7f779edcfb80 1 -- 172.21.15.107:0/1333019975 >> 172.21.15.107:0/1333019975 conn(0x55a43e085cd0 msgr2=0x55a43e12cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.969+0000 7f779edcfb80 1 -- 172.21.15.107:0/1333019975 shutdown_connections 2023-08-10T10:53:16.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.969+0000 7f779edcfb80 1 -- 172.21.15.107:0/1333019975 wait complete. 2023-08-10T10:53:16.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.970+0000 7f779edcfb80 1 -- start start 2023-08-10T10:53:16.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.970+0000 7f779edcfb80 1 Processor -- start 2023-08-10T10:53:16.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1236a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f779edcfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f779edcfb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e1490f0 con 0x55a43e128800 2023-08-10T10:53:16.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f779edcfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e1a5f70 con 0x55a43e12df50 2023-08-10T10:53:16.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f779edcfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43e1a60b0 con 0x55a43e12e870 2023-08-10T10:53:16.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f779edcfb80 10 client.0 _ll_register_callbacks cb 0x55a43e016680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:16.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1236a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778919b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1236a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49578/0 (socket says 172.21.15.107:49578) 2023-08-10T10:53:16.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778919b700 1 -- 172.21.15.107:0/2509674386 learned_addr learned my addr 172.21.15.107:0/2509674386 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:16.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778999c700 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778899a700 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778919b700 1 -- 172.21.15.107:0/2509674386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 msgr2=0x55a43e1489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778919b700 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e1489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778919b700 1 -- 172.21.15.107:0/2509674386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 msgr2=0x55a43e1482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:16.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778919b700 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e1482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778919b700 1 -- 172.21.15.107:0/2509674386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a43dea6de0 con 0x55a43e128800 2023-08-10T10:53:16.981 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.971+0000 7f778899a700 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e1482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:53:16.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.972+0000 7f778919b700 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1236a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7780099c30 tx=0x7f778009a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9c93e942f3a013 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:16.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.972+0000 7f776cff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:16.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.972+0000 7f776cff9700 1 -- 172.21.15.107:0/2509674386 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800ca270 con 0x55a43e128800 2023-08-10T10:53:16.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.972+0000 7f779edcfb80 1 -- 172.21.15.107:0/2509674386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f778009a1e0 con 0x55a43e128800 2023-08-10T10:53:16.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.972+0000 7f776cff9700 1 -- 172.21.15.107:0/2509674386 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f77800a1f40 con 0x55a43e128800 2023-08-10T10:53:16.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.972+0000 7f776cff9700 1 -- 172.21.15.107:0/2509674386 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77800ca3d0 con 0x55a43e128800 2023-08-10T10:53:16.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.972+0000 7f779edcfb80 10 client.16350 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:16.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.972+0000 7f779edcfb80 1 -- 172.21.15.107:0/2509674386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55a43defa630 con 0x55a43e128800 2023-08-10T10:53:16.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.972+0000 7f776cff9700 1 -- 172.21.15.107:0/2509674386 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f778007f080 con 0x55a43e128800 2023-08-10T10:53:16.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.973+0000 7f776cff9700 1 -- 172.21.15.107:0/2509674386 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f7780098f70 con 0x55a43e128800 2023-08-10T10:53:16.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.973+0000 7f779edcfb80 10 client.16350 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:16.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.973+0000 7f779edcfb80 10 client.16350 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2023-08-10T10:53:16.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.973+0000 7f779edcfb80 20 client.16350 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:16.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.973+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55a43e1a7380 0x55a43e1a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:16.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.973+0000 7f779edcfb80 4 client.16350 mds_command: new command op to 24532 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:53:16.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.973+0000 7f779edcfb80 1 -- 172.21.15.107:0/2509674386 --> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a43e072780 con 0x55a43e1a7380 2023-08-10T10:53:16.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.973+0000 7f778899a700 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55a43e1a7380 0x55a43e1a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:16.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f778899a700 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55a43e1a7380 0x55a43e1a97a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f822dabd900ebc0 server_cookie=de8ea0d6d18bf7ed in_seq=0 out_seq=0 2023-08-10T10:53:16.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f776cff9700 10 client.16350 ms_handle_connect on v2:172.21.15.195:6834/3324910460 2023-08-10T10:53:16.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f776cff9700 1 -- 172.21.15.107:0/2509674386 <== mds.2 v2:172.21.15.195:6834/3324910460 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a43e072780 con 0x55a43e1a7380 2023-08-10T10:53:16.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f776cff9700 10 client.16350 handle_command_reply: tid=0 2023-08-10T10:53:16.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 client.16350 shutdown 2023-08-10T10:53:16.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 -- 172.21.15.107:0/2509674386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 msgr2=0x55a43e1236a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1236a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7780099c30 tx=0x7f778009a4c0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 -- 172.21.15.107:0/2509674386 shutdown_connections 2023-08-10T10:53:16.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.195:6834/3324910460,v1:172.21.15.195:6835/3324910460] conn(0x55a43e1a7380 0x55a43e1a97a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a43e12e870 0x55a43e1489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a43e128800 0x55a43e1236a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f776cff9700 0 client.16350 ms_handle_reset on v2:172.21.15.195:6834/3324910460 2023-08-10T10:53:16.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 --2- 172.21.15.107:0/2509674386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a43e12df50 0x55a43e1482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 -- 172.21.15.107:0/2509674386 >> 172.21.15.107:0/2509674386 conn(0x55a43e085cd0 msgr2=0x55a43e12ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 -- 172.21.15.107:0/2509674386 shutdown_connections 2023-08-10T10:53:16.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.974+0000 7f779edcfb80 1 -- 172.21.15.107:0/2509674386 wait complete. 2023-08-10T10:53:16.986 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f779edcfb80 20 client.16350 trim_cache size 0 max 16384 2023-08-10T10:53:16.987 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:53:16.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 -- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77700a1340 msgr2=0x7f77700a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77700a1340 0x7f77700a3800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f777c009cc0 tx=0x7f777c0077e0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 -- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 msgr2=0x7f7784072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:16.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 0x7f7784072a70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f778000e9d0 tx=0x7f778000ece0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 -- 172.21.15.107:0/3842582619 shutdown_connections 2023-08-10T10:53:16.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f77700a1340 0x7f77700a3800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77841066f0 0x7f77841a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77841006e0 0x7f7784072a70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 --2- 172.21.15.107:0/3842582619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77841010a0 0x7f7784072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:16.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 -- 172.21.15.107:0/3842582619 >> 172.21.15.107:0/3842582619 conn(0x7f77840fc1d0 msgr2=0x7f77840fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:16.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 -- 172.21.15.107:0/3842582619 shutdown_connections 2023-08-10T10:53:16.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:16.975+0000 7f778b3ff700 1 -- 172.21.15.107:0/3842582619 wait complete. 2023-08-10T10:53:16.993 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:16 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3896317629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:53:16.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-08-10T10:53:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:16 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3896317629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:53:17.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:16 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3896317629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-08-10T10:53:17.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.283+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/2622519489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 msgr2=0x7fb5e4106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.283+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/2622519489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 0x7fb5e4106ab0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009990 tx=0x7fb5e0009ca0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.283+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/2622519489 shutdown_connections 2023-08-10T10:53:17.285 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.283+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/2622519489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5e4101080 0x7fb5e410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.283+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/2622519489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 0x7fb5e4106ab0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.283+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/2622519489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e41006c0 0x7fb5e4100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.283+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/2622519489 >> 172.21.15.107:0/2622519489 conn(0x7fb5e40fc1f0 msgr2=0x7fb5e40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.283+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/2622519489 shutdown_connections 2023-08-10T10:53:17.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.283+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/2622519489 wait complete. 2023-08-10T10:53:17.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.284+0000 7fb5eb1ff700 1 Processor -- start 2023-08-10T10:53:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.285+0000 7fb5eb1ff700 1 -- start start 2023-08-10T10:53:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.285+0000 7fb5eb1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5e41006c0 0x7fb5e4072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.285+0000 7fb5eb1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e4101080 0x7fb5e4072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.285+0000 7fb5eb1ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 0x7fb5e40734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.285+0000 7fb5eb1ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e41a4b60 con 0x7fb5e41066d0 2023-08-10T10:53:17.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.285+0000 7fb5eb1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e41a4cd0 con 0x7fb5e4101080 2023-08-10T10:53:17.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.285+0000 7fb5eb1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e41a4e90 con 0x7fb5e41006c0 2023-08-10T10:53:17.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e979c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 0x7fb5e40734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e8f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5e41006c0 0x7fb5e4072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e4101080 0x7fb5e4072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e8f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5e41006c0 0x7fb5e4072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:35396/0 (socket says 172.21.15.107:35396) 2023-08-10T10:53:17.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e8f9b700 1 -- 172.21.15.107:0/342226529 learned_addr learned my addr 172.21.15.107:0/342226529 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e979c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 0x7fb5e40734f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49602/0 (socket says 172.21.15.107:49602) 2023-08-10T10:53:17.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e979c700 1 -- 172.21.15.107:0/342226529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5e41006c0 msgr2=0x7fb5e4072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e979c700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5e41006c0 0x7fb5e4072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e979c700 1 -- 172.21.15.107:0/342226529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e4101080 msgr2=0x7fb5e4072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e979c700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e4101080 0x7fb5e4072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e979c700 1 -- 172.21.15.107:0/342226529 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e00095f0 con 0x7fb5e41066d0 2023-08-10T10:53:17.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5e41006c0 0x7fb5e4072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:17.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.286+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e4101080 0x7fb5e4072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:17.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.287+0000 7fb5e979c700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 0x7fb5e40734f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc007f10 tx=0x7fb5dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.287+0000 7fb5d9ffb700 1 -- 172.21.15.107:0/342226529 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc004db0 con 0x7fb5e41066d0 2023-08-10T10:53:17.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.287+0000 7fb5d9ffb700 1 -- 172.21.15.107:0/342226529 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5dc00f040 con 0x7fb5e41066d0 2023-08-10T10:53:17.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.287+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/342226529 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e41a5170 con 0x7fb5e41066d0 2023-08-10T10:53:17.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.287+0000 7fb5d9ffb700 1 -- 172.21.15.107:0/342226529 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc005960 con 0x7fb5e41066d0 2023-08-10T10:53:17.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.287+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/342226529 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e41a5630 con 0x7fb5e41066d0 2023-08-10T10:53:17.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.292+0000 7fb5d9ffb700 1 -- 172.21.15.107:0/342226529 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fb5dc00db20 con 0x7fb5e41066d0 2023-08-10T10:53:17.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.292+0000 7fb5fea9eb80 1 Processor -- start 2023-08-10T10:53:17.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.293+0000 7fb5fea9eb80 1 -- start start 2023-08-10T10:53:17.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.293+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x55899179c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.293+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x5589917962c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.293+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x558991796c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.293+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558991711dc0 con 0x55899179bf50 2023-08-10T10:53:17.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.293+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589916ee590 con 0x558991796800 2023-08-10T10:53:17.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.293+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589916ebeb0 con 0x55899179c870 2023-08-10T10:53:17.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.293+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x55899179c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5e8f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x5589917962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x55899179c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49616/0 (socket says 172.21.15.107:49616) 2023-08-10T10:53:17.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5dbfff700 1 -- 172.21.15.107:0/6223148 learned_addr learned my addr 172.21.15.107:0/6223148 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/6223148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x558991796c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5e8f9b700 1 -- 172.21.15.107:0/6223148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 msgr2=0x558991796c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/6223148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x558991796c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5e8f9b700 1 -- 172.21.15.107:0/6223148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 msgr2=0x55899179c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/6223148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x55899179c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5e8f9b700 1 -- 172.21.15.107:0/6223148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558991568630 con 0x55899179c870 2023-08-10T10:53:17.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/6223148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x55899179c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:17.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5d9ffb700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb5cc0a12c0 0x7fb5cc0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5d9ffb700 1 -- 172.21.15.107:0/342226529 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fb5dc0cc880 con 0x7fb5e41066d0 2023-08-10T10:53:17.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.294+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/6223148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x5589917962c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00036c0 tx=0x7fb5e0005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6769716d598742d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.295+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb5cc0a12c0 0x7fb5cc0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.295+0000 7fb5caffd700 1 -- 172.21.15.107:0/6223148 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e001d050 con 0x55899179c870 2023-08-10T10:53:17.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.295+0000 7fb5caffd700 1 -- 172.21.15.107:0/6223148 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5e001e040 con 0x55899179c870 2023-08-10T10:53:17.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.295+0000 7fb5caffd700 1 -- 172.21.15.107:0/6223148 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00048c0 con 0x55899179c870 2023-08-10T10:53:17.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/6223148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 msgr2=0x5589917962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/6223148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x5589917962c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00036c0 tx=0x7fb5e0005c00 comp rx=0 tx=0).stop 2023-08-10T10:53:17.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb5cc0a12c0 0x7fb5cc0a3780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x558991797520 tx=0x7fb5d400bc90 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/6223148 shutdown_connections 2023-08-10T10:53:17.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/6223148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x558991796c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/6223148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x55899179c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/6223148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x5589917962c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/6223148 >> 172.21.15.107:0/6223148 conn(0x5589916f3cd0 msgr2=0x5589917914d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/6223148 shutdown_connections 2023-08-10T10:53:17.315 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.296+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/6223148 wait complete. 2023-08-10T10:53:17.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.297+0000 7fb5fea9eb80 1 -- start start 2023-08-10T10:53:17.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.297+0000 7fb5fea9eb80 1 Processor -- start 2023-08-10T10:53:17.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.297+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 0x5589917a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.297+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x55899179fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.297+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x5589917a0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.297+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589916e77a0 con 0x558991796800 2023-08-10T10:53:17.317 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.297+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x558991686ac0 con 0x55899179c870 2023-08-10T10:53:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.297+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589916867c0 con 0x55899179bf50 2023-08-10T10:53:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5fea9eb80 10 client.0 _ll_register_callbacks cb 0x558991684680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e8f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 0x5589917a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e8f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 0x5589917a28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49632/0 (socket says 172.21.15.107:49632) 2023-08-10T10:53:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e8f9b700 1 -- 172.21.15.107:0/463803735 learned_addr learned my addr 172.21.15.107:0/463803735 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x55899179fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e979c700 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x5589917a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e8f9b700 1 -- 172.21.15.107:0/463803735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 msgr2=0x55899179fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x55899179fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e8f9b700 1 -- 172.21.15.107:0/463803735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 msgr2=0x5589917a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x5589917a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.320 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e8f9b700 1 -- 172.21.15.107:0/463803735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d40125f0 con 0x558991796800 2023-08-10T10:53:17.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.298+0000 7fb5e979c700 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x5589917a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:17.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.299+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 0x5589917a28a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0005f50 tx=0x7fb5e00052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63b2c9894f04968 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.299+0000 7fb5c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:17.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.299+0000 7fb5c3fff700 1 -- 172.21.15.107:0/463803735 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0004910 con 0x558991796800 2023-08-10T10:53:17.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.299+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/463803735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558991789470 con 0x558991796800 2023-08-10T10:53:17.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.299+0000 7fb5c3fff700 1 -- 172.21.15.107:0/463803735 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fb5e0004a70 con 0x558991796800 2023-08-10T10:53:17.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.299+0000 7fb5c3fff700 1 -- 172.21.15.107:0/463803735 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5e0005940 con 0x558991796800 2023-08-10T10:53:17.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.299+0000 7fb5fea9eb80 10 client.16362 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:17.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.299+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/463803735 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fb5e410de90 con 0x558991796800 2023-08-10T10:53:17.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.300+0000 7fb5c3fff700 1 -- 172.21.15.107:0/463803735 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558991789470 con 0x558991796800 2023-08-10T10:53:17.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.300+0000 7fb5c3fff700 1 -- 172.21.15.107:0/463803735 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fb5e0003ff0 con 0x558991796800 2023-08-10T10:53:17.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.300+0000 7fb5fea9eb80 10 client.16362 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:17.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.300+0000 7fb5fea9eb80 10 client.16362 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-10T10:53:17.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.300+0000 7fb5fea9eb80 20 client.16362 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:17.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.300+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5589917aff50 0x5589917b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.300+0000 7fb5fea9eb80 4 client.16362 mds_command: new command op to 24571 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:53:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.300+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/463803735 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589917659d0 con 0x5589917aff50 2023-08-10T10:53:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.301+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5589917aff50 0x5589917b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.301+0000 7fb5c3fff700 10 client.16362 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:53:17.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.301+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5589917aff50 0x5589917b2370 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4858373e8dc6445f server_cookie=fad7d1ff72dc45cb in_seq=0 out_seq=0 2023-08-10T10:53:17.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.302+0000 7fb5c3fff700 1 -- 172.21.15.107:0/463803735 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5589917659d0 con 0x5589917aff50 2023-08-10T10:53:17.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.302+0000 7fb5c3fff700 10 client.16362 handle_command_reply: tid=0 2023-08-10T10:53:17.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.302+0000 7fb5fea9eb80 1 client.16362 shutdown 2023-08-10T10:53:17.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/463803735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 msgr2=0x5589917a28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 0x5589917a28a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0005f50 tx=0x7fb5e00052f0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/463803735 shutdown_connections 2023-08-10T10:53:17.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x5589917aff50 0x5589917b2370 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x5589917a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 0x5589917a28a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5c3fff700 0 client.16362 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:53:17.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/463803735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x55899179fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/463803735 >> 172.21.15.107:0/463803735 conn(0x5589916f3cd0 msgr2=0x5589917909b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/463803735 shutdown_connections 2023-08-10T10:53:17.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/463803735 wait complete. 2023-08-10T10:53:17.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.303+0000 7fb5fea9eb80 20 client.16362 trim_cache size 0 max 16384 2023-08-10T10:53:17.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.320+0000 7fb5fea9eb80 1 Processor -- start 2023-08-10T10:53:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.320+0000 7fb5fea9eb80 1 -- start start 2023-08-10T10:53:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.320+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x5589917a7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.320+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x5589917a2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.320+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x558991791130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.320+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899156a920 con 0x55899179bf50 2023-08-10T10:53:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.320+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589917a0ee0 con 0x558991796800 2023-08-10T10:53:17.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.320+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899178ba80 con 0x55899179c870 2023-08-10T10:53:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x5589917a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5e8f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x5589917a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5e8f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x5589917a7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:45974/0 (socket says 172.21.15.107:45974) 2023-08-10T10:53:17.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x5589917a2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49640/0 (socket says 172.21.15.107:49640) 2023-08-10T10:53:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5e8f9b700 1 -- 172.21.15.107:0/233483372 learned_addr learned my addr 172.21.15.107:0/233483372 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5dbfff700 1 -- 172.21.15.107:0/233483372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 msgr2=0x558991791130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5e979c700 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x558991791130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x558991791130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5dbfff700 1 -- 172.21.15.107:0/233483372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 msgr2=0x5589917a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x5589917a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5dbfff700 1 -- 172.21.15.107:0/233483372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558991514de0 con 0x55899179bf50 2023-08-10T10:53:17.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x5589917a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.321+0000 7fb5e979c700 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x558991791130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:53:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.322+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x5589917a2440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400be50 tx=0x7fb5d4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd52433d72334b60 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.322+0000 7fb5cb7fe700 1 -- 172.21.15.107:0/233483372 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4026040 con 0x55899179bf50 2023-08-10T10:53:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.322+0000 7fb5cb7fe700 1 -- 172.21.15.107:0/233483372 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5d400ec60 con 0x55899179bf50 2023-08-10T10:53:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.322+0000 7fb5cb7fe700 1 -- 172.21.15.107:0/233483372 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4010ab0 con 0x55899179bf50 2023-08-10T10:53:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/233483372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 msgr2=0x5589917a2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x5589917a2440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400be50 tx=0x7fb5d4011000 comp rx=0 tx=0).stop 2023-08-10T10:53:17.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/233483372 shutdown_connections 2023-08-10T10:53:17.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558991796800 0x5589917a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179c870 0x558991791130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/233483372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55899179bf50 0x5589917a2440 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/233483372 >> 172.21.15.107:0/233483372 conn(0x5589916f3cd0 msgr2=0x558991799c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/233483372 shutdown_connections 2023-08-10T10:53:17.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/233483372 wait complete. 2023-08-10T10:53:17.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.323+0000 7fb5fea9eb80 1 -- start start 2023-08-10T10:53:17.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.324+0000 7fb5fea9eb80 1 Processor -- start 2023-08-10T10:53:17.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.324+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 0x5589917f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.324+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x5589917f8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.324+0000 7fb5fea9eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x558991802bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.324+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558991803110 con 0x558991796800 2023-08-10T10:53:17.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.324+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x558991803250 con 0x55899179c870 2023-08-10T10:53:17.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.324+0000 7fb5fea9eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558991803390 con 0x55899179bf50 2023-08-10T10:53:17.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.324+0000 7fb5fea9eb80 10 client.0 _ll_register_callbacks cb 0x558991684680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:17.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x5589917f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x5589917f8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:35442/0 (socket says 172.21.15.107:35442) 2023-08-10T10:53:17.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5dbfff700 1 -- 172.21.15.107:0/2133763090 learned_addr learned my addr 172.21.15.107:0/2133763090 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5e979c700 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x558991802bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5dbfff700 1 -- 172.21.15.107:0/2133763090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 msgr2=0x558991802bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x558991802bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5dbfff700 1 -- 172.21.15.107:0/2133763090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 msgr2=0x5589917f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 0x5589917f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5dbfff700 1 -- 172.21.15.107:0/2133763090 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e410de90 con 0x55899179bf50 2023-08-10T10:53:17.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.325+0000 7fb5e979c700 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x558991802bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:17.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.326+0000 7fb5dbfff700 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x5589917f8280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400b6e0 tx=0x7fb5d402c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c0f2a751f1d275f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.326+0000 7fb5c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:53:17.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.326+0000 7fb5c3fff700 1 -- 172.21.15.107:0/2133763090 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4026070 con 0x55899179bf50 2023-08-10T10:53:17.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.326+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/2133763090 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb5e001e040 con 0x55899179bf50 2023-08-10T10:53:17.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.326+0000 7fb5c3fff700 1 -- 172.21.15.107:0/2133763090 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fb5d400e9d0 con 0x55899179bf50 2023-08-10T10:53:17.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.326+0000 7fb5c3fff700 1 -- 172.21.15.107:0/2133763090 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5d403f440 con 0x55899179bf50 2023-08-10T10:53:17.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.326+0000 7fb5fea9eb80 10 client.26053 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:17.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.326+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/2133763090 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fb5d401b070 con 0x55899179bf50 2023-08-10T10:53:17.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.327+0000 7fb5c3fff700 1 -- 172.21.15.107:0/2133763090 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5e001e040 con 0x55899179bf50 2023-08-10T10:53:17.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.327+0000 7fb5c3fff700 1 -- 172.21.15.107:0/2133763090 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fb5d4035420 con 0x55899179bf50 2023-08-10T10:53:17.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.327+0000 7fb5fea9eb80 10 client.26053 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:17.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.327+0000 7fb5fea9eb80 10 client.26053 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-08-10T10:53:17.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.327+0000 7fb5fea9eb80 20 client.26053 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:17.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.327+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x558991804ae0 0x558991806f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.327+0000 7fb5fea9eb80 4 client.26053 mds_command: new command op to 24571 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:53:17.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.327+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/2133763090 --> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5589916e0780 con 0x558991804ae0 2023-08-10T10:53:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.328+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x558991804ae0 0x558991806f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.328+0000 7fb5e8f9b700 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x558991804ae0 0x558991806f00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=335189660ee1a16c server_cookie=2129330aab07c5d9 in_seq=0 out_seq=0 2023-08-10T10:53:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.328+0000 7fb5c3fff700 10 client.26053 ms_handle_connect on v2:172.21.15.195:6838/1633036352 2023-08-10T10:53:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.328+0000 7fb5c3fff700 1 -- 172.21.15.107:0/2133763090 <== mds.1 v2:172.21.15.195:6838/1633036352 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5589916e0780 con 0x558991804ae0 2023-08-10T10:53:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.328+0000 7fb5c3fff700 10 client.26053 handle_command_reply: tid=0 2023-08-10T10:53:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.328+0000 7fb5fea9eb80 1 client.26053 shutdown 2023-08-10T10:53:17.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.328+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/2133763090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 msgr2=0x5589917f8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.328+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x5589917f8280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400b6e0 tx=0x7fb5d402c410 comp rx=0 tx=0).stop 2023-08-10T10:53:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/2133763090 shutdown_connections 2023-08-10T10:53:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.195:6838/1633036352,v1:172.21.15.195:6839/1633036352] conn(0x558991804ae0 0x558991806f00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55899179c870 0x558991802bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558991796800 0x5589917f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5fea9eb80 1 --2- 172.21.15.107:0/2133763090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55899179bf50 0x5589917f8280 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5c3fff700 0 client.26053 ms_handle_reset on v2:172.21.15.195:6838/1633036352 2023-08-10T10:53:17.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/2133763090 >> 172.21.15.107:0/2133763090 conn(0x5589916f3cd0 msgr2=0x55899179aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/2133763090 shutdown_connections 2023-08-10T10:53:17.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5fea9eb80 1 -- 172.21.15.107:0/2133763090 wait complete. 2023-08-10T10:53:17.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5fea9eb80 20 client.26053 trim_cache size 0 max 16384 2023-08-10T10:53:17.354 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:53:17.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.329+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb5cc0a12c0 msgr2=0x7fb5cc0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb5cc0a12c0 0x7fb5cc0a3780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x558991797520 tx=0x7fb5d400bc90 comp rx=0 tx=0).stop 2023-08-10T10:53:17.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 msgr2=0x7fb5e40734f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 0x7fb5e40734f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc007f10 tx=0x7fb5dc00d3b0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/342226529 shutdown_connections 2023-08-10T10:53:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb5e41066d0 0x7fb5e40734f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5e41006c0 0x7fb5e4072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb5cc0a12c0 0x7fb5cc0a3780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 --2- 172.21.15.107:0/342226529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5e4101080 0x7fb5e4072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/342226529 >> 172.21.15.107:0/342226529 conn(0x7fb5e40fc1f0 msgr2=0x7fb5e40fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/342226529 shutdown_connections 2023-08-10T10:53:17.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.330+0000 7fb5eb1ff700 1 -- 172.21.15.107:0/342226529 wait complete. 2023-08-10T10:53:17.358 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-08-10T10:53:17.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.580+0000 7f46e25ff700 1 -- 172.21.15.107:0/3392243729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46dc073430 msgr2=0x7f46dc1111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.580+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3392243729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46dc073430 0x7f46dc1111b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009990 tx=0x7f46d0009ca0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.580+0000 7f46e25ff700 1 -- 172.21.15.107:0/3392243729 shutdown_connections 2023-08-10T10:53:17.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.580+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3392243729 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc072b10 0x7f46dc072ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.580+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3392243729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46dc1116f0 0x7f46dc113ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.580+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3392243729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46dc073430 0x7f46dc1111b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.580+0000 7f46e25ff700 1 -- 172.21.15.107:0/3392243729 >> 172.21.15.107:0/3392243729 conn(0x7f46dc0fc1d0 msgr2=0x7f46dc0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.580+0000 7f46e25ff700 1 -- 172.21.15.107:0/3392243729 shutdown_connections 2023-08-10T10:53:17.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.580+0000 7f46e25ff700 1 -- 172.21.15.107:0/3392243729 wait complete. 2023-08-10T10:53:17.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.581+0000 7f46e25ff700 1 Processor -- start 2023-08-10T10:53:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.581+0000 7f46e25ff700 1 -- start start 2023-08-10T10:53:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.581+0000 7f46e25ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46dc072b10 0x7f46dc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.581+0000 7f46e25ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46dc073430 0x7f46dc19d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.581+0000 7f46e25ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1116f0 0x7f46dc1a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.581+0000 7f46e25ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc1a1de0 con 0x7f46dc073430 2023-08-10T10:53:17.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.581+0000 7f46e25ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc1a1f50 con 0x7f46dc1116f0 2023-08-10T10:53:17.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.581+0000 7f46e25ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc1a2110 con 0x7f46dc072b10 2023-08-10T10:53:17.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46dbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46dc072b10 0x7f46dc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46dbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46dc072b10 0x7f46dc19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:35460/0 (socket says 172.21.15.107:35460) 2023-08-10T10:53:17.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46dbfff700 1 -- 172.21.15.107:0/3849804024 learned_addr learned my addr 172.21.15.107:0/3849804024 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46dc073430 0x7f46dc19d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46e0b9c700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1116f0 0x7f46dc1a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.585 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46dbfff700 1 -- 172.21.15.107:0/3849804024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1116f0 msgr2=0x7f46dc1a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46dbfff700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1116f0 0x7f46dc1a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46dbfff700 1 -- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46dc073430 msgr2=0x7f46dc19d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46dbfff700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46dc073430 0x7f46dc19d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.586 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46dbfff700 1 -- 172.21.15.107:0/3849804024 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00095f0 con 0x7f46dc072b10 2023-08-10T10:53:17.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.582+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46dc073430 0x7f46dc19d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:17.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.583+0000 7f46dbfff700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46dc072b10 0x7f46dc19ce00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00d950 tx=0x7f46cc00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.583+0000 7f46d97fa700 1 -- 172.21.15.107:0/3849804024 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc009940 con 0x7f46dc072b10 2023-08-10T10:53:17.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.583+0000 7f46e25ff700 1 -- 172.21.15.107:0/3849804024 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46dc1a23f0 con 0x7f46dc072b10 2023-08-10T10:53:17.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.583+0000 7f46e25ff700 1 -- 172.21.15.107:0/3849804024 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc1a9c30 con 0x7f46dc072b10 2023-08-10T10:53:17.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.583+0000 7f46d97fa700 1 -- 172.21.15.107:0/3849804024 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46cc010460 con 0x7f46dc072b10 2023-08-10T10:53:17.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.583+0000 7f46d97fa700 1 -- 172.21.15.107:0/3849804024 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc01b650 con 0x7f46dc072b10 2023-08-10T10:53:17.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.587+0000 7f46d97fa700 1 -- 172.21.15.107:0/3849804024 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f46cc009aa0 con 0x7f46dc072b10 2023-08-10T10:53:17.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.588+0000 7f46d97fa700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f46c40a12c0 0x7f46c40a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.588+0000 7f46d97fa700 1 -- 172.21.15.107:0/3849804024 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f46cc0cce20 con 0x7f46dc072b10 2023-08-10T10:53:17.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.588+0000 7f46f5e99b80 1 Processor -- start 2023-08-10T10:53:17.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.589+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f46c40a12c0 0x7f46c40a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.589+0000 7f46f5e99b80 1 -- start start 2023-08-10T10:53:17.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.589+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6ea1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.589+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.589+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 0x55efb6e9bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.589+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6e16dc0 con 0x55efb6ea0f50 2023-08-10T10:53:17.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.589+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6df3590 con 0x55efb6e9b800 2023-08-10T10:53:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.589+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6df0eb0 con 0x55efb6ea1870 2023-08-10T10:53:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.589+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f46c40a12c0 0x7f46c40a3780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46d000b5c0 tx=0x7f46d0009ee0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46db7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6ea1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46db7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:35476/0 (socket says 172.21.15.107:35476) 2023-08-10T10:53:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46db7fe700 1 -- 172.21.15.107:0/3449956285 learned_addr learned my addr 172.21.15.107:0/3449956285 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46e0b9c700 1 --2- 172.21.15.107:0/3449956285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 0x55efb6e9bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46db7fe700 1 -- 172.21.15.107:0/3449956285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 msgr2=0x55efb6e9bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3449956285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 0x55efb6e9bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46db7fe700 1 -- 172.21.15.107:0/3449956285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 msgr2=0x55efb6ea1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3449956285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6ea1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46db7fe700 1 -- 172.21.15.107:0/3449956285 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efb6c6d630 con 0x55efb6ea1870 2023-08-10T10:53:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.590+0000 7f46dbfff700 1 --2- 172.21.15.107:0/3449956285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6ea1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:17.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.591+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3449956285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9b2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009990 tx=0x7f46d0020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ed0f0393353f2eb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.591+0000 7f46c27fc700 1 -- 172.21.15.107:0/3449956285 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0003e80 con 0x55efb6ea1870 2023-08-10T10:53:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.591+0000 7f46c27fc700 1 -- 172.21.15.107:0/3449956285 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46d001e040 con 0x55efb6ea1870 2023-08-10T10:53:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.591+0000 7f46c27fc700 1 -- 172.21.15.107:0/3449956285 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0024410 con 0x55efb6ea1870 2023-08-10T10:53:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.592+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3449956285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 msgr2=0x55efb6e9b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.592+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3449956285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9b2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009990 tx=0x7f46d0020000 comp rx=0 tx=0).stop 2023-08-10T10:53:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.592+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3449956285 shutdown_connections 2023-08-10T10:53:17.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.592+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3449956285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 0x55efb6e9bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.592+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3449956285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6ea1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.592+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3449956285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9b2c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.592+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3449956285 >> 172.21.15.107:0/3449956285 conn(0x55efb6df8cd0 msgr2=0x55efb6e964d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.592+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3449956285 shutdown_connections 2023-08-10T10:53:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.592+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3449956285 wait complete. 2023-08-10T10:53:17.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.593+0000 7f46f5e99b80 1 -- start start 2023-08-10T10:53:17.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.593+0000 7f46f5e99b80 1 Processor -- start 2023-08-10T10:53:17.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6e9b800 0x55efb6ea78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 0x55efb6ea4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea1870 0x55efb6ea5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6dec7a0 con 0x55efb6ea1870 2023-08-10T10:53:17.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6d8bac0 con 0x55efb6ea0f50 2023-08-10T10:53:17.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6d8b7c0 con 0x55efb6e9b800 2023-08-10T10:53:17.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46f5e99b80 10 client.0 _ll_register_callbacks cb 0x55efb6d89680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:17.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46e0b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea1870 0x55efb6ea5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46e0b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea1870 0x55efb6ea5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49694/0 (socket says 172.21.15.107:49694) 2023-08-10T10:53:17.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46e0b9c700 1 -- 172.21.15.107:0/2665805247 learned_addr learned my addr 172.21.15.107:0/2665805247 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46dbfff700 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6e9b800 0x55efb6ea78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.594+0000 7f46db7fe700 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 0x55efb6ea4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46e0b9c700 1 -- 172.21.15.107:0/2665805247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6e9b800 msgr2=0x55efb6ea78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46e0b9c700 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6e9b800 0x55efb6ea78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46e0b9c700 1 -- 172.21.15.107:0/2665805247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 msgr2=0x55efb6ea4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46e0b9c700 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 0x55efb6ea4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46e0b9c700 1 -- 172.21.15.107:0/2665805247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc1a9c30 con 0x55efb6ea1870 2023-08-10T10:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46e0b9c700 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea1870 0x55efb6ea5110 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f46d400be50 tx=0x7f46d400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f54a73be03fb6e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46bb7fe700 1 -- 172.21.15.107:0/2665805247 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d40078c0 con 0x55efb6ea1870 2023-08-10T10:53:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46bb7fe700 1 -- 172.21.15.107:0/2665805247 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f46d4006e40 con 0x55efb6ea1870 2023-08-10T10:53:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.595+0000 7f46f5e99b80 1 -- 172.21.15.107:0/2665805247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efb6e8e470 con 0x55efb6ea1870 2023-08-10T10:53:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46bb7fe700 1 -- 172.21.15.107:0/2665805247 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46d4007a20 con 0x55efb6ea1870 2023-08-10T10:53:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46f5e99b80 10 client.16377 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46f5e99b80 1 -- 172.21.15.107:0/2665805247 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f46dc114490 con 0x55efb6ea1870 2023-08-10T10:53:17.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46bb7fe700 1 -- 172.21.15.107:0/2665805247 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55efb6e8e470 con 0x55efb6ea1870 2023-08-10T10:53:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46bb7fe700 1 -- 172.21.15.107:0/2665805247 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f46d4015070 con 0x55efb6ea1870 2023-08-10T10:53:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46f5e99b80 10 client.16377 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46f5e99b80 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46f5e99b80 20 client.16377 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55efb6eb5290 0x55efb6eb76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46f5e99b80 4 client.16377 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:53:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.596+0000 7f46f5e99b80 1 -- 172.21.15.107:0/2665805247 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efb6e6a9d0 con 0x55efb6eb5290 2023-08-10T10:53:17.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.597+0000 7f46dbfff700 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55efb6eb5290 0x55efb6eb76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.598+0000 7f46dbfff700 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55efb6eb5290 0x55efb6eb76b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c400e9171f90930 server_cookie=95fe243b68035119 in_seq=0 out_seq=0 2023-08-10T10:53:17.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.598+0000 7f46bb7fe700 10 client.16377 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.598+0000 7f46bb7fe700 1 -- 172.21.15.107:0/2665805247 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55efb6e6a9d0 con 0x55efb6eb5290 2023-08-10T10:53:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.598+0000 7f46bb7fe700 10 client.16377 handle_command_reply: tid=0 2023-08-10T10:53:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 client.16377 shutdown 2023-08-10T10:53:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 -- 172.21.15.107:0/2665805247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea1870 msgr2=0x55efb6ea5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea1870 0x55efb6ea5110 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f46d400be50 tx=0x7f46d400be80 comp rx=0 tx=0).stop 2023-08-10T10:53:17.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 -- 172.21.15.107:0/2665805247 shutdown_connections 2023-08-10T10:53:17.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55efb6eb5290 0x55efb6eb76b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea1870 0x55efb6ea5110 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6e9b800 0x55efb6ea78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46bb7fe700 0 client.16377 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:17.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/2665805247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 0x55efb6ea4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 -- 172.21.15.107:0/2665805247 >> 172.21.15.107:0/2665805247 conn(0x55efb6df8cd0 msgr2=0x55efb6e959b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 -- 172.21.15.107:0/2665805247 shutdown_connections 2023-08-10T10:53:17.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 1 -- 172.21.15.107:0/2665805247 wait complete. 2023-08-10T10:53:17.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.599+0000 7f46f5e99b80 20 client.16377 trim_cache size 0 max 16384 2023-08-10T10:53:17.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.618+0000 7f46f5e99b80 1 Processor -- start 2023-08-10T10:53:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.618+0000 7f46f5e99b80 1 -- start start 2023-08-10T10:53:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.618+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6e9b800 0x55efb6eac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.618+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 0x55efb6ea24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.618+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6ea7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.618+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6c6f920 con 0x55efb6e9b800 2023-08-10T10:53:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.618+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6ea56f0 con 0x55efb6ea0f50 2023-08-10T10:53:17.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.618+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6eb2880 con 0x55efb6ea1870 2023-08-10T10:53:17.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6e9b800 0x55efb6eac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6e9b800 0x55efb6eac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49706/0 (socket says 172.21.15.107:49706) 2023-08-10T10:53:17.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46dbfff700 1 -- 172.21.15.107:0/898434314 learned_addr learned my addr 172.21.15.107:0/898434314 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46db7fe700 1 --2- 172.21.15.107:0/898434314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 0x55efb6ea24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46e0b9c700 1 --2- 172.21.15.107:0/898434314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6ea7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46dbfff700 1 -- 172.21.15.107:0/898434314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 msgr2=0x55efb6ea7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46dbfff700 1 --2- 172.21.15.107:0/898434314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6ea7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46dbfff700 1 -- 172.21.15.107:0/898434314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 msgr2=0x55efb6ea24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46dbfff700 1 --2- 172.21.15.107:0/898434314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 0x55efb6ea24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.619+0000 7f46dbfff700 1 -- 172.21.15.107:0/898434314 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efb6c19de0 con 0x55efb6e9b800 2023-08-10T10:53:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.620+0000 7f46dbfff700 1 --2- 172.21.15.107:0/898434314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6e9b800 0x55efb6eac300 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f46cc096600 tx=0x7f46cc099a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340f3c88586211a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.620+0000 7f46c2ffd700 1 -- 172.21.15.107:0/898434314 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0a1fe0 con 0x55efb6e9b800 2023-08-10T10:53:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.620+0000 7f46c2ffd700 1 -- 172.21.15.107:0/898434314 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46cc097f30 con 0x55efb6e9b800 2023-08-10T10:53:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.620+0000 7f46c2ffd700 1 -- 172.21.15.107:0/898434314 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc099df0 con 0x55efb6e9b800 2023-08-10T10:53:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.620+0000 7f46f5e99b80 1 -- 172.21.15.107:0/898434314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6e9b800 msgr2=0x55efb6eac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.620+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/898434314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6e9b800 0x55efb6eac300 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f46cc096600 tx=0x7f46cc099a10 comp rx=0 tx=0).stop 2023-08-10T10:53:17.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.621+0000 7f46f5e99b80 1 -- 172.21.15.107:0/898434314 shutdown_connections 2023-08-10T10:53:17.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.621+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/898434314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6ea7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.621+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/898434314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6e9b800 0x55efb6eac300 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.621+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/898434314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6ea0f50 0x55efb6ea24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.621+0000 7f46f5e99b80 1 -- 172.21.15.107:0/898434314 >> 172.21.15.107:0/898434314 conn(0x55efb6df8cd0 msgr2=0x55efb6ea1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.621+0000 7f46f5e99b80 1 -- 172.21.15.107:0/898434314 shutdown_connections 2023-08-10T10:53:17.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.621+0000 7f46f5e99b80 1 -- 172.21.15.107:0/898434314 wait complete. 2023-08-10T10:53:17.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.621+0000 7f46f5e99b80 1 -- start start 2023-08-10T10:53:17.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.621+0000 7f46f5e99b80 1 Processor -- start 2023-08-10T10:53:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 0x55efb6e9c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6e9ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46f5e99b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6e9db00 con 0x55efb6ea0f50 2023-08-10T10:53:17.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6e9dc70 con 0x55efb6e9b800 2023-08-10T10:53:17.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46f5e99b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efb6e9de30 con 0x55efb6ea1870 2023-08-10T10:53:17.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46f5e99b80 10 client.0 _ll_register_callbacks cb 0x55efb6d89680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:17.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46db7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6e9ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46db7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6e9ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49722/0 (socket says 172.21.15.107:49722) 2023-08-10T10:53:17.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46db7fe700 1 -- 172.21.15.107:0/3843637129 learned_addr learned my addr 172.21.15.107:0/3843637129 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:17.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46dbfff700 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 0x55efb6e9c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.622+0000 7f46e0b9c700 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.623+0000 7f46db7fe700 1 -- 172.21.15.107:0/3843637129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 msgr2=0x55efb6e9d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.623+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.623+0000 7f46db7fe700 1 -- 172.21.15.107:0/3843637129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 msgr2=0x55efb6e9c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:17.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.623+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 0x55efb6e9c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.623+0000 7f46db7fe700 1 -- 172.21.15.107:0/3843637129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc1a23f0 con 0x55efb6ea0f50 2023-08-10T10:53:17.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.623+0000 7f46dbfff700 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 0x55efb6e9c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:17.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.623+0000 7f46db7fe700 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6e9ceb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f46d000bc90 tx=0x7f46d00052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19941c462f489bc5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:17.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.623+0000 7f46bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:17.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46bb7fe700 1 -- 172.21.15.107:0/3843637129 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d00049b0 con 0x55efb6ea0f50 2023-08-10T10:53:17.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46bb7fe700 1 -- 172.21.15.107:0/3843637129 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f46d0004b10 con 0x55efb6ea0f50 2023-08-10T10:53:17.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3843637129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46d001e040 con 0x55efb6ea0f50 2023-08-10T10:53:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46bb7fe700 1 -- 172.21.15.107:0/3843637129 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46d00056f0 con 0x55efb6ea0f50 2023-08-10T10:53:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46f5e99b80 10 client.16383 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3843637129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55efb6c02c60 con 0x55efb6ea0f50 2023-08-10T10:53:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46bb7fe700 1 -- 172.21.15.107:0/3843637129 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46d0048020 con 0x55efb6ea0f50 2023-08-10T10:53:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46bb7fe700 1 -- 172.21.15.107:0/3843637129 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f46d000bcc0 con 0x55efb6ea0f50 2023-08-10T10:53:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46f5e99b80 10 client.16383 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:17.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46f5e99b80 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46f5e99b80 20 client.16383 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55efb6f09840 0x55efb6f0bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46f5e99b80 4 client.16383 mds_command: new command op to 24575 tid=0[{"prefix": "damage ls"}] 2023-08-10T10:53:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.624+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3843637129 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55efb6de5780 con 0x55efb6f09840 2023-08-10T10:53:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.625+0000 7f46dbfff700 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55efb6f09840 0x55efb6f0bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46dbfff700 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55efb6f09840 0x55efb6f0bc60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2613815afcd59fa9 server_cookie=5f25e477e4dedae2 in_seq=0 out_seq=0 2023-08-10T10:53:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46bb7fe700 10 client.16383 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:17.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46bb7fe700 1 -- 172.21.15.107:0/3843637129 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55efb6de5780 con 0x55efb6f09840 2023-08-10T10:53:17.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46bb7fe700 10 client.16383 handle_command_reply: tid=0 2023-08-10T10:53:17.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 client.16383 shutdown 2023-08-10T10:53:17.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3843637129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 msgr2=0x55efb6e9ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6e9ceb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f46d000bc90 tx=0x7f46d00052f0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3843637129 shutdown_connections 2023-08-10T10:53:17.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55efb6f09840 0x55efb6f0bc60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55efb6e9b800 0x55efb6e9c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55efb6ea1870 0x55efb6e9d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46bb7fe700 0 client.16383 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:17.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 --2- 172.21.15.107:0/3843637129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efb6ea0f50 0x55efb6e9ceb0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3843637129 >> 172.21.15.107:0/3843637129 conn(0x55efb6df8cd0 msgr2=0x55efb6ea2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3843637129 shutdown_connections 2023-08-10T10:53:17.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.626+0000 7f46f5e99b80 1 -- 172.21.15.107:0/3843637129 wait complete. 2023-08-10T10:53:17.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46f5e99b80 20 client.16383 trim_cache size 0 max 16384 2023-08-10T10:53:17.638 INFO:teuthology.orchestra.run.smithi107.stdout:[] 2023-08-10T10:53:17.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 -- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f46c40a12c0 msgr2=0x7f46c40a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f46c40a12c0 0x7f46c40a3780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46d000b5c0 tx=0x7f46d0009ee0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 -- 172.21.15.107:0/3849804024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46dc072b10 msgr2=0x7f46dc19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:17.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46dc072b10 0x7f46dc19ce00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00d950 tx=0x7f46cc00dc60 comp rx=0 tx=0).stop 2023-08-10T10:53:17.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 -- 172.21.15.107:0/3849804024 shutdown_connections 2023-08-10T10:53:17.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f46c40a12c0 0x7f46c40a3780 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46dc1116f0 0x7f46dc1a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46dc072b10 0x7f46dc19ce00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 --2- 172.21.15.107:0/3849804024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46dc073430 0x7f46dc19d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:17.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 -- 172.21.15.107:0/3849804024 >> 172.21.15.107:0/3849804024 conn(0x7f46dc0fc1d0 msgr2=0x7f46dc0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:17.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 -- 172.21.15.107:0/3849804024 shutdown_connections 2023-08-10T10:53:17.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:17.627+0000 7f46e25ff700 1 -- 172.21.15.107:0/3849804024 wait complete. 2023-08-10T10:53:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:17 smithi157 ceph-mon[129604]: pgmap v65: 129 pgs: 129 active+clean; 1.4 GiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:53:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:17 smithi107 ceph-mon[127953]: pgmap v65: 129 pgs: 129 active+clean; 1.4 GiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:53:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:17 smithi195 ceph-mon[129938]: pgmap v65: 129 pgs: 129 active+clean; 1.4 GiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:53:18.542 INFO:teuthology.orchestra.run.smithi107.stderr:6300000 of 50000000 tuples (12%) done (elapsed 96.72 s, remaining 670.90 s) 2023-08-10T10:53:18.649 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-08-10T10:53:18.649 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-08-10T10:53:18.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.881+0000 7f4db4f9d700 1 -- 172.21.15.107:0/35562746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0111550 msgr2=0x7f4db0113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:18.882 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.881+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/35562746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0111550 0x7f4db0113940 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4da800b0a0 tx=0x7f4da800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.881+0000 7f4db4f9d700 1 -- 172.21.15.107:0/35562746 shutdown_connections 2023-08-10T10:53:18.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.881+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/35562746 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0111550 0x7f4db0113940 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.881+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/35562746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4db0072b10 0x7f4db0072ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.881+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/35562746 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4db0073430 0x7f4db0111010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.881+0000 7f4db4f9d700 1 -- 172.21.15.107:0/35562746 >> 172.21.15.107:0/35562746 conn(0x7f4db00fc010 msgr2=0x7f4db00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:18.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.881+0000 7f4db4f9d700 1 -- 172.21.15.107:0/35562746 shutdown_connections 2023-08-10T10:53:18.883 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.881+0000 7f4db4f9d700 1 -- 172.21.15.107:0/35562746 wait complete. 2023-08-10T10:53:18.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.882+0000 7f4db4f9d700 1 Processor -- start 2023-08-10T10:53:18.885 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4db4f9d700 1 -- start start 2023-08-10T10:53:18.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4db4f9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4db0072b10 0x7f4db01a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4db4f9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0073430 0x7f4db01a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4db4f9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4db0111550 0x7f4db019ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4db4f9d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db019d0d0 con 0x7f4db0073430 2023-08-10T10:53:18.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4db4f9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db019d240 con 0x7f4db0111550 2023-08-10T10:53:18.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4db4f9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db019d400 con 0x7f4db0072b10 2023-08-10T10:53:18.886 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4daeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0073430 0x7f4db01a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4daeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0073430 0x7f4db01a2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49742/0 (socket says 172.21.15.107:49742) 2023-08-10T10:53:18.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4daeffd700 1 -- 172.21.15.107:0/1274353117 learned_addr learned my addr 172.21.15.107:0/1274353117 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:18.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4db0072b10 0x7f4db01a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.883+0000 7f4daffff700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4db0111550 0x7f4db019ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4daeffd700 1 -- 172.21.15.107:0/1274353117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4db0072b10 msgr2=0x7f4db01a29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:18.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4daeffd700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4db0072b10 0x7f4db01a29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4daeffd700 1 -- 172.21.15.107:0/1274353117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4db0111550 msgr2=0x7f4db019ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:18.887 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4daeffd700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4db0111550 0x7f4db019ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4daeffd700 1 -- 172.21.15.107:0/1274353117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8009d00 con 0x7f4db0073430 2023-08-10T10:53:18.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4daeffd700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0073430 0x7f4db01a2f30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4da400e9a0 tx=0x7f4da400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:18.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4dacff9700 1 -- 172.21.15.107:0/1274353117 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4009790 con 0x7f4db0073430 2023-08-10T10:53:18.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4dacff9700 1 -- 172.21.15.107:0/1274353117 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da4010430 con 0x7f4db0073430 2023-08-10T10:53:18.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4dacff9700 1 -- 172.21.15.107:0/1274353117 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da400cea0 con 0x7f4db0073430 2023-08-10T10:53:18.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4db4f9d700 1 -- 172.21.15.107:0/1274353117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db019d6e0 con 0x7f4db0073430 2023-08-10T10:53:18.888 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.884+0000 7f4db4f9d700 1 -- 172.21.15.107:0/1274353117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db01a99e0 con 0x7f4db0073430 2023-08-10T10:53:18.889 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.888+0000 7f4dacff9700 1 -- 172.21.15.107:0/1274353117 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4da40105a0 con 0x7f4db0073430 2023-08-10T10:53:18.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.889+0000 7f4dc9bceb80 1 Processor -- start 2023-08-10T10:53:18.890 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.889+0000 7f4dacff9700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f4d980a13e0 0x7f4d980a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.889+0000 7f4dc9bceb80 1 -- start start 2023-08-10T10:53:18.891 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.889+0000 7f4dacff9700 1 -- 172.21.15.107:0/1274353117 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f4da4014070 con 0x7f4db0073430 2023-08-10T10:53:18.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4daffff700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f4d980a13e0 0x7f4d980a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6530 0x564bb61b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6e50 0x564bb61badd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61bb310 0x564bb61bb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb6131e40 con 0x564bb61b6e50 2023-08-10T10:53:18.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb610e610 con 0x564bb61bb310 2023-08-10T10:53:18.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb610bf30 con 0x564bb61b6530 2023-08-10T10:53:18.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4daeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6e50 0x564bb61badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4daeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6e50 0x564bb61badd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49754/0 (socket says 172.21.15.107:49754) 2023-08-10T10:53:18.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4daeffd700 1 -- 172.21.15.107:0/2065019873 learned_addr learned my addr 172.21.15.107:0/2065019873 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:18.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.890+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/2065019873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6530 0x564bb61b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4daffff700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f4d980a13e0 0x7f4d980a38a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009fd0 tx=0x7f4da800b720 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:18.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4daeffd700 1 -- 172.21.15.107:0/2065019873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6530 msgr2=0x564bb61b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:18.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4daeffd700 1 --2- 172.21.15.107:0/2065019873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6530 0x564bb61b6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4daeffd700 1 -- 172.21.15.107:0/2065019873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61bb310 msgr2=0x564bb61bb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:18.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4daeffd700 1 --2- 172.21.15.107:0/2065019873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61bb310 0x564bb61bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4daeffd700 1 -- 172.21.15.107:0/2065019873 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bb5f886b0 con 0x564bb61b6e50 2023-08-10T10:53:18.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/2065019873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6530 0x564bb61b6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:18.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4daeffd700 1 --2- 172.21.15.107:0/2065019873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6e50 0x564bb61badd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4da4096810 tx=0x7f4da40999f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae62903ed87412d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:18.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4d95ffb700 1 -- 172.21.15.107:0/2065019873 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40b1070 con 0x564bb61b6e50 2023-08-10T10:53:18.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4d95ffb700 1 -- 172.21.15.107:0/2065019873 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da40a21f0 con 0x564bb61b6e50 2023-08-10T10:53:18.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.891+0000 7f4d95ffb700 1 -- 172.21.15.107:0/2065019873 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40994f0 con 0x564bb61b6e50 2023-08-10T10:53:18.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.892+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2065019873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6e50 msgr2=0x564bb61badd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:18.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.892+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2065019873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6e50 0x564bb61badd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4da4096810 tx=0x7f4da40999f0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.892+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2065019873 shutdown_connections 2023-08-10T10:53:18.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.892+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2065019873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61bb310 0x564bb61bb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.892+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2065019873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6530 0x564bb61b6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.892+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2065019873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6e50 0x564bb61badd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.892+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2065019873 >> 172.21.15.107:0/2065019873 conn(0x564bb6113d50 msgr2=0x564bb61b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:18.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.892+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2065019873 shutdown_connections 2023-08-10T10:53:18.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.892+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2065019873 wait complete. 2023-08-10T10:53:18.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.893+0000 7f4dc9bceb80 1 -- start start 2023-08-10T10:53:18.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.893+0000 7f4dc9bceb80 1 Processor -- start 2023-08-10T10:53:18.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.893+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.893+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 0x564bb61c0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.893+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61bb310 0x564bb61c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.893+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb6107820 con 0x564bb61b6530 2023-08-10T10:53:18.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb60a6b40 con 0x564bb61bb310 2023-08-10T10:53:18.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb60a6840 con 0x564bb61b6e50 2023-08-10T10:53:18.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4dc9bceb80 10 client.0 _ll_register_callbacks cb 0x564bb60a4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:18.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61bfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49768/0 (socket says 172.21.15.107:49768) 2023-08-10T10:53:18.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daf7fe700 1 -- 172.21.15.107:0/452035924 learned_addr learned my addr 172.21.15.107:0/452035924 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:18.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daeffd700 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 0x564bb61c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daffff700 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61bb310 0x564bb61c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daf7fe700 1 -- 172.21.15.107:0/452035924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 msgr2=0x564bb61c0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:18.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 0x564bb61c0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daf7fe700 1 -- 172.21.15.107:0/452035924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61bb310 msgr2=0x564bb61c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:18.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61bb310 0x564bb61c0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.894+0000 7f4daf7fe700 1 -- 172.21.15.107:0/452035924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db01a99e0 con 0x564bb61b6530 2023-08-10T10:53:18.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.895+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61bfec0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4da0012870 tx=0x7f4da0012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d9120524f98592 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:18.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.895+0000 7f4d8effd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:18.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.895+0000 7f4d8effd700 1 -- 172.21.15.107:0/452035924 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0017070 con 0x564bb61b6530 2023-08-10T10:53:18.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.895+0000 7f4d8effd700 1 -- 172.21.15.107:0/452035924 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f4da0004020 con 0x564bb61b6530 2023-08-10T10:53:18.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.895+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/452035924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564bb61a94f0 con 0x564bb61b6530 2023-08-10T10:53:18.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.895+0000 7f4d8effd700 1 -- 172.21.15.107:0/452035924 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4da00122e0 con 0x564bb61b6530 2023-08-10T10:53:18.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.895+0000 7f4dc9bceb80 10 client.16395 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:18.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.895+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/452035924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x564bb5f34e60 con 0x564bb61b6530 2023-08-10T10:53:18.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.895+0000 7f4d8effd700 1 -- 172.21.15.107:0/452035924 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564bb61a94f0 con 0x564bb61b6530 2023-08-10T10:53:18.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.896+0000 7f4d8effd700 1 -- 172.21.15.107:0/452035924 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f4da000f640 con 0x564bb61b6530 2023-08-10T10:53:18.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.896+0000 7f4dc9bceb80 10 client.16395 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:18.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.896+0000 7f4dc9bceb80 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:18.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.896+0000 7f4dc9bceb80 20 client.16395 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:18.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.896+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564bb61d0650 0x564bb61d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.896+0000 7f4dc9bceb80 4 client.16395 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:53:18.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.896+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/452035924 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564bb6185a50 con 0x564bb61d0650 2023-08-10T10:53:18.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.896+0000 7f4daeffd700 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564bb61d0650 0x564bb61d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.897+0000 7f4d8effd700 10 client.16395 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:18.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.897+0000 7f4daeffd700 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564bb61d0650 0x564bb61d2a70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=becea71a6741ae12 server_cookie=77bb976b9ab78aa2 in_seq=0 out_seq=0 2023-08-10T10:53:18.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4d8effd700 1 -- 172.21.15.107:0/452035924 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564bb6185a50 con 0x564bb61d0650 2023-08-10T10:53:18.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4d8effd700 10 client.16395 handle_command_reply: tid=0 2023-08-10T10:53:18.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 client.16395 shutdown 2023-08-10T10:53:18.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/452035924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 msgr2=0x564bb61bfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:18.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61bfec0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4da0012870 tx=0x7f4da0012b80 comp rx=0 tx=0).stop 2023-08-10T10:53:18.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/452035924 shutdown_connections 2023-08-10T10:53:18.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564bb61d0650 0x564bb61d2a70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61bb310 0x564bb61c0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4d8effd700 0 client.16395 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61bfec0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/452035924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 0x564bb61c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/452035924 >> 172.21.15.107:0/452035924 conn(0x564bb6113d50 msgr2=0x564bb61bc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:18.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/452035924 shutdown_connections 2023-08-10T10:53:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/452035924 wait complete. 2023-08-10T10:53:18.910 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.898+0000 7f4dc9bceb80 20 client.16395 trim_cache size 0 max 16384 2023-08-10T10:53:18.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.922+0000 7f4dc9bceb80 1 Processor -- start 2023-08-10T10:53:18.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.922+0000 7f4dc9bceb80 1 -- start start 2023-08-10T10:53:18.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.922+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6530 0x564bb61b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.922+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 0x564bb61baaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.922+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61bb310 0x564bb61c0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.922+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb5f8a9a0 con 0x564bb61bb310 2023-08-10T10:53:18.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.922+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb61b6d10 con 0x564bb61b6530 2023-08-10T10:53:18.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.922+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb61be4c0 con 0x564bb61b6e50 2023-08-10T10:53:18.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61bb310 0x564bb61c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6530 0x564bb61b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6530 0x564bb61b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:46088/0 (socket says 172.21.15.107:46088) 2023-08-10T10:53:18.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61bb310 0x564bb61c0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49776/0 (socket says 172.21.15.107:49776) 2023-08-10T10:53:18.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daf7fe700 1 -- 172.21.15.107:0/805312411 learned_addr learned my addr 172.21.15.107:0/805312411 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:18.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daeffd700 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 0x564bb61baaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daf7fe700 1 -- 172.21.15.107:0/805312411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 msgr2=0x564bb61baaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:18.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 0x564bb61baaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daf7fe700 1 -- 172.21.15.107:0/805312411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61bb310 msgr2=0x564bb61c0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:18.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61bb310 0x564bb61c0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daf7fe700 1 -- 172.21.15.107:0/805312411 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bb5f1dce0 con 0x564bb61b6530 2023-08-10T10:53:18.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daeffd700 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 0x564bb61baaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:18.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.923+0000 7f4daffff700 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61bb310 0x564bb61c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:18.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.924+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6530 0x564bb61b8c00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009fc0 tx=0x7f4da000fb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84b85e97b5b531f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:18.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.924+0000 7f4d967fc700 1 -- 172.21.15.107:0/805312411 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0017040 con 0x564bb61b6530 2023-08-10T10:53:18.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.924+0000 7f4d967fc700 1 -- 172.21.15.107:0/805312411 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da00122e0 con 0x564bb61b6530 2023-08-10T10:53:18.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.924+0000 7f4d967fc700 1 -- 172.21.15.107:0/805312411 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0003970 con 0x564bb61b6530 2023-08-10T10:53:18.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/805312411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6530 msgr2=0x564bb61b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:18.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6530 0x564bb61b8c00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009fc0 tx=0x7f4da000fb70 comp rx=0 tx=0).stop 2023-08-10T10:53:18.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/805312411 shutdown_connections 2023-08-10T10:53:18.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6530 0x564bb61b8c00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61bb310 0x564bb61c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/805312411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61b6e50 0x564bb61baaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/805312411 >> 172.21.15.107:0/805312411 conn(0x564bb6113d50 msgr2=0x564bb61b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:18.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/805312411 shutdown_connections 2023-08-10T10:53:18.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/805312411 wait complete. 2023-08-10T10:53:18.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.925+0000 7f4dc9bceb80 1 -- start start 2023-08-10T10:53:18.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.926+0000 7f4dc9bceb80 1 Processor -- start 2023-08-10T10:53:18.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.926+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.926+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6e50 0x564bb61c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.926+0000 7f4dc9bceb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61bb310 0x564bb621d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.926+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb621da00 con 0x564bb61b6530 2023-08-10T10:53:18.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.926+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb621db70 con 0x564bb61b6e50 2023-08-10T10:53:18.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.926+0000 7f4dc9bceb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb621dd30 con 0x564bb61bb310 2023-08-10T10:53:18.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.926+0000 7f4dc9bceb80 10 client.0 _ll_register_callbacks cb 0x564bb60a4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:18.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49782/0 (socket says 172.21.15.107:49782) 2023-08-10T10:53:18.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61bb310 0x564bb621d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daf7fe700 1 -- 172.21.15.107:0/2583078188 learned_addr learned my addr 172.21.15.107:0/2583078188 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:18.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daeffd700 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6e50 0x564bb61c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daf7fe700 1 -- 172.21.15.107:0/2583078188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61bb310 msgr2=0x564bb621d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:18.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61bb310 0x564bb621d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daf7fe700 1 -- 172.21.15.107:0/2583078188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6e50 msgr2=0x564bb61c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:18.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6e50 0x564bb61c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daf7fe700 1 -- 172.21.15.107:0/2583078188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db01142f0 con 0x564bb61b6530 2023-08-10T10:53:18.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4daf7fe700 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61c67b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4da0012870 tx=0x7f4da000fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3701ac8ec1c9ca0f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:18.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.927+0000 7f4d8effd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:18.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4d8effd700 1 -- 172.21.15.107:0/2583078188 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da00056a0 con 0x564bb61b6530 2023-08-10T10:53:18.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4d8effd700 1 -- 172.21.15.107:0/2583078188 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f4da0000e40 con 0x564bb61b6530 2023-08-10T10:53:18.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2583078188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4da40a21f0 con 0x564bb61b6530 2023-08-10T10:53:18.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4d8effd700 1 -- 172.21.15.107:0/2583078188 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4da0003680 con 0x564bb61b6530 2023-08-10T10:53:18.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4dc9bceb80 10 client.16401 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:18.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2583078188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f4da0021040 con 0x564bb61b6530 2023-08-10T10:53:18.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4d8effd700 1 -- 172.21.15.107:0/2583078188 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da40a21f0 con 0x564bb61b6530 2023-08-10T10:53:18.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4d8effd700 1 -- 172.21.15.107:0/2583078188 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f4da0030020 con 0x564bb61b6530 2023-08-10T10:53:18.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4dc9bceb80 10 client.16401 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:18.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4dc9bceb80 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:18.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4dc9bceb80 20 client.16401 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:18.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564bb62265b0 0x564bb62289d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:18.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4dc9bceb80 4 client.16401 mds_command: new command op to 24575 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-08-10T10:53:18.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.928+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2583078188 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564bb6100800 con 0x564bb62265b0 2023-08-10T10:53:18.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.929+0000 7f4daeffd700 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564bb62265b0 0x564bb62289d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:18.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.930+0000 7f4daeffd700 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564bb62265b0 0x564bb62289d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b640f52f6c40f65e server_cookie=9a5ab1c2073011f3 in_seq=0 out_seq=0 2023-08-10T10:53:18.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.930+0000 7f4d8effd700 10 client.16401 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:18.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4d8effd700 1 -- 172.21.15.107:0/2583078188 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564bb6100800 con 0x564bb62265b0 2023-08-10T10:53:18.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4d8effd700 10 client.16401 handle_command_reply: tid=0 2023-08-10T10:53:18.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 client.16401 shutdown 2023-08-10T10:53:18.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2583078188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 msgr2=0x564bb61c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:18.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61c67b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4da0012870 tx=0x7f4da000fe40 comp rx=0 tx=0).stop 2023-08-10T10:53:18.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2583078188 shutdown_connections 2023-08-10T10:53:18.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564bb62265b0 0x564bb62289d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564bb61bb310 0x564bb621d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564bb61b6530 0x564bb61c67b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4d8effd700 0 client.16401 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:18.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 --2- 172.21.15.107:0/2583078188 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564bb61b6e50 0x564bb61c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2583078188 >> 172.21.15.107:0/2583078188 conn(0x564bb6113d50 msgr2=0x564bb61b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:18.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2583078188 shutdown_connections 2023-08-10T10:53:18.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.931+0000 7f4dc9bceb80 1 -- 172.21.15.107:0/2583078188 wait complete. 2023-08-10T10:53:18.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4dc9bceb80 20 client.16401 trim_cache size 0 max 16384 2023-08-10T10:53:18.946 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:53:18.946 INFO:teuthology.orchestra.run.smithi107.stdout: "return_code": 0, 2023-08-10T10:53:18.946 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:53:18.947 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": "asynchronous" 2023-08-10T10:53:18.947 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:53:18.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 -- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f4d980a13e0 msgr2=0x7f4d980a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:18.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f4d980a13e0 0x7f4d980a38a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009fd0 tx=0x7f4da800b720 comp rx=0 tx=0).stop 2023-08-10T10:53:18.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 -- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0073430 msgr2=0x7f4db01a2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:18.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0073430 0x7f4db01a2f30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4da400e9a0 tx=0x7f4da400ecb0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 -- 172.21.15.107:0/1274353117 shutdown_connections 2023-08-10T10:53:18.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f4d980a13e0 0x7f4d980a38a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4db0111550 0x7f4db019ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4db0072b10 0x7f4db01a29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 --2- 172.21.15.107:0/1274353117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4db0073430 0x7f4db01a2f30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:18.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 -- 172.21.15.107:0/1274353117 >> 172.21.15.107:0/1274353117 conn(0x7f4db00fc010 msgr2=0x7f4db00fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:18.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 -- 172.21.15.107:0/1274353117 shutdown_connections 2023-08-10T10:53:18.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:18.932+0000 7f4db4f9d700 1 -- 172.21.15.107:0/1274353117 wait complete. 2023-08-10T10:53:18.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:53:19.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.193+0000 7ff924bff700 1 -- 172.21.15.107:0/1493132483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff920101080 msgr2=0x7ff92010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:19.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.193+0000 7ff924bff700 1 --2- 172.21.15.107:0/1493132483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff920101080 0x7ff92010d590 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff91800b0a0 tx=0x7ff91800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.193+0000 7ff924bff700 1 -- 172.21.15.107:0/1493132483 shutdown_connections 2023-08-10T10:53:19.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.193+0000 7ff924bff700 1 --2- 172.21.15.107:0/1493132483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9201066d0 0x7ff920106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.195 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.193+0000 7ff924bff700 1 --2- 172.21.15.107:0/1493132483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff920101080 0x7ff92010d590 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.193+0000 7ff924bff700 1 --2- 172.21.15.107:0/1493132483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9201006c0 0x7ff920100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.193+0000 7ff924bff700 1 -- 172.21.15.107:0/1493132483 >> 172.21.15.107:0/1493132483 conn(0x7ff9200fc1f0 msgr2=0x7ff9200fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:19.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.194+0000 7ff924bff700 1 -- 172.21.15.107:0/1493132483 shutdown_connections 2023-08-10T10:53:19.196 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.194+0000 7ff924bff700 1 -- 172.21.15.107:0/1493132483 wait complete. 2023-08-10T10:53:19.197 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.195+0000 7ff924bff700 1 Processor -- start 2023-08-10T10:53:19.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.195+0000 7ff924bff700 1 -- start start 2023-08-10T10:53:19.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.195+0000 7ff924bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9201006c0 0x7ff92019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.195+0000 7ff924bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff920101080 0x7ff92019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.195+0000 7ff924bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9201066d0 0x7ff9201986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.195+0000 7ff924bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff920198d90 con 0x7ff9201006c0 2023-08-10T10:53:19.198 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.195+0000 7ff924bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff920198f00 con 0x7ff920101080 2023-08-10T10:53:19.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.195+0000 7ff924bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9201990c0 con 0x7ff9201066d0 2023-08-10T10:53:19.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.195+0000 7ff91e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9201006c0 0x7ff92019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9201006c0 0x7ff92019e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49794/0 (socket says 172.21.15.107:49794) 2023-08-10T10:53:19.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91e59c700 1 -- 172.21.15.107:0/2831694414 learned_addr learned my addr 172.21.15.107:0/2831694414 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:19.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff920101080 0x7ff92019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91ed9d700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9201066d0 0x7ff9201986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.199 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91e59c700 1 -- 172.21.15.107:0/2831694414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9201066d0 msgr2=0x7ff9201986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:19.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91e59c700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9201066d0 0x7ff9201986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91e59c700 1 -- 172.21.15.107:0/2831694414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff920101080 msgr2=0x7ff92019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:19.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91e59c700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff920101080 0x7ff92019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91e59c700 1 -- 172.21.15.107:0/2831694414 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918009d00 con 0x7ff9201006c0 2023-08-10T10:53:19.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff91e59c700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9201006c0 0x7ff92019e650 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff91000e9a0 tx=0x7ff91000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:19.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.196+0000 7ff90f7fe700 1 -- 172.21.15.107:0/2831694414 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910009790 con 0x7ff9201006c0 2023-08-10T10:53:19.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.197+0000 7ff90f7fe700 1 -- 172.21.15.107:0/2831694414 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff910010430 con 0x7ff9201006c0 2023-08-10T10:53:19.200 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.197+0000 7ff90f7fe700 1 -- 172.21.15.107:0/2831694414 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000cea0 con 0x7ff9201006c0 2023-08-10T10:53:19.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.197+0000 7ff924bff700 1 -- 172.21.15.107:0/2831694414 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9201993a0 con 0x7ff9201006c0 2023-08-10T10:53:19.201 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.197+0000 7ff924bff700 1 -- 172.21.15.107:0/2831694414 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9201a5680 con 0x7ff9201006c0 2023-08-10T10:53:19.202 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.201+0000 7ff90f7fe700 1 -- 172.21.15.107:0/2831694414 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff9100105a0 con 0x7ff9201006c0 2023-08-10T10:53:19.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.202+0000 7ff938432b80 1 Processor -- start 2023-08-10T10:53:19.203 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.202+0000 7ff938432b80 1 -- start start 2023-08-10T10:53:19.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff938432b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9a7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff938432b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff938432b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff938432b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e91cdc0 con 0x55ef2e9a1800 2023-08-10T10:53:19.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff938432b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e8f9590 con 0x55ef2e9a6f50 2023-08-10T10:53:19.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff938432b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e8f6eb0 con 0x55ef2e9a7870 2023-08-10T10:53:19.205 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff91ed9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff91ed9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9a7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:46118/0 (socket says 172.21.15.107:46118) 2023-08-10T10:53:19.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff90f7fe700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff9080a12c0 0x7ff9080a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff91ed9d700 1 -- 172.21.15.107:0/788344581 learned_addr learned my addr 172.21.15.107:0/788344581 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:19.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff91e59c700 1 --2- 172.21.15.107:0/788344581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/788344581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.203+0000 7ff90f7fe700 1 -- 172.21.15.107:0/2831694414 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff910014070 con 0x7ff9201006c0 2023-08-10T10:53:19.206 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff91ed9d700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff9080a12c0 0x7ff9080a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff91e59c700 1 -- 172.21.15.107:0/788344581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 msgr2=0x55ef2e9a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:19.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff91e59c700 1 --2- 172.21.15.107:0/788344581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9a7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff91e59c700 1 -- 172.21.15.107:0/788344581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 msgr2=0x55ef2e9a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:19.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff91e59c700 1 --2- 172.21.15.107:0/788344581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff91e59c700 1 -- 172.21.15.107:0/788344581 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef2e773630 con 0x55ef2e9a7870 2023-08-10T10:53:19.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff91e59c700 1 --2- 172.21.15.107:0/788344581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9a12c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff9100ca610 tx=0x7ff910099e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b00360c09b872e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:19.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff90cff9700 1 -- 172.21.15.107:0/788344581 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910010880 con 0x55ef2e9a7870 2023-08-10T10:53:19.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff90cff9700 1 -- 172.21.15.107:0/788344581 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff91009dfc0 con 0x55ef2e9a7870 2023-08-10T10:53:19.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff90cff9700 1 -- 172.21.15.107:0/788344581 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91009e480 con 0x55ef2e9a7870 2023-08-10T10:53:19.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.204+0000 7ff91ed9d700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff9080a12c0 0x7ff9080a3780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff91800bfd0 tx=0x7ff91800b3b0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:19.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.205+0000 7ff938432b80 1 -- 172.21.15.107:0/788344581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 msgr2=0x55ef2e9a12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:19.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.205+0000 7ff938432b80 1 --2- 172.21.15.107:0/788344581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9a12c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff9100ca610 tx=0x7ff910099e60 comp rx=0 tx=0).stop 2023-08-10T10:53:19.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.205+0000 7ff938432b80 1 -- 172.21.15.107:0/788344581 shutdown_connections 2023-08-10T10:53:19.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.205+0000 7ff938432b80 1 --2- 172.21.15.107:0/788344581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.205+0000 7ff938432b80 1 --2- 172.21.15.107:0/788344581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.205+0000 7ff938432b80 1 --2- 172.21.15.107:0/788344581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9a12c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.205+0000 7ff938432b80 1 -- 172.21.15.107:0/788344581 >> 172.21.15.107:0/788344581 conn(0x55ef2e8fecd0 msgr2=0x55ef2e99c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:19.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.205+0000 7ff938432b80 1 -- 172.21.15.107:0/788344581 shutdown_connections 2023-08-10T10:53:19.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.205+0000 7ff938432b80 1 -- 172.21.15.107:0/788344581 wait complete. 2023-08-10T10:53:19.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.206+0000 7ff938432b80 1 -- start start 2023-08-10T10:53:19.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.206+0000 7ff938432b80 1 Processor -- start 2023-08-10T10:53:19.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff938432b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff938432b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff938432b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff938432b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e8f27a0 con 0x55ef2e9a1800 2023-08-10T10:53:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff938432b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e891ac0 con 0x55ef2e9a6f50 2023-08-10T10:53:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff938432b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e8917c0 con 0x55ef2e9a7870 2023-08-10T10:53:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff938432b80 10 client.0 _ll_register_callbacks cb 0x55ef2e88f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49810/0 (socket says 172.21.15.107:49810) 2023-08-10T10:53:19.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91e59c700 1 -- 172.21.15.107:0/1336271663 learned_addr learned my addr 172.21.15.107:0/1336271663 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:19.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91ed9d700 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91e59c700 1 -- 172.21.15.107:0/1336271663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 msgr2=0x55ef2e9ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:19.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91e59c700 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91e59c700 1 -- 172.21.15.107:0/1336271663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 msgr2=0x55ef2e9ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91e59c700 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91e59c700 1 -- 172.21.15.107:0/1336271663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9201a5680 con 0x55ef2e9a1800 2023-08-10T10:53:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.207+0000 7ff91ed9d700 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.208+0000 7ff91e59c700 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9aac20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff9100cac10 tx=0x7ff91000c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe9a5770938cd17 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.208+0000 7ff905ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:53:19.216 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.208+0000 7ff905ffb700 1 -- 172.21.15.107:0/1336271663 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91009a3f0 con 0x55ef2e9a1800 2023-08-10T10:53:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.208+0000 7ff905ffb700 1 -- 172.21.15.107:0/1336271663 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff9100a23e0 con 0x55ef2e9a1800 2023-08-10T10:53:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.208+0000 7ff938432b80 1 -- 172.21.15.107:0/1336271663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef2e994470 con 0x55ef2e9a1800 2023-08-10T10:53:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.208+0000 7ff905ffb700 1 -- 172.21.15.107:0/1336271663 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff910099480 con 0x55ef2e9a1800 2023-08-10T10:53:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.208+0000 7ff938432b80 10 client.16413 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.208+0000 7ff938432b80 1 -- 172.21.15.107:0/1336271663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ef2e71fde0 con 0x55ef2e9a1800 2023-08-10T10:53:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.209+0000 7ff905ffb700 1 -- 172.21.15.107:0/1336271663 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ef2e994470 con 0x55ef2e9a1800 2023-08-10T10:53:19.217 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.209+0000 7ff905ffb700 1 -- 172.21.15.107:0/1336271663 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7ff910094ba0 con 0x55ef2e9a1800 2023-08-10T10:53:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.209+0000 7ff938432b80 10 client.16413 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.209+0000 7ff938432b80 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.209+0000 7ff938432b80 20 client.16413 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.209+0000 7ff938432b80 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ef2e9bb030 0x55ef2e9bd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.209+0000 7ff938432b80 4 client.16413 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:53:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.209+0000 7ff938432b80 1 -- 172.21.15.107:0/1336271663 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef2e9709d0 con 0x55ef2e9bb030 2023-08-10T10:53:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.209+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ef2e9bb030 0x55ef2e9bd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.218 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.210+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ef2e9bb030 0x55ef2e9bd450 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=776ae3e9b7886261 server_cookie=9f2165d316c51869 in_seq=0 out_seq=0 2023-08-10T10:53:19.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.210+0000 7ff905ffb700 10 client.16413 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff905ffb700 1 -- 172.21.15.107:0/1336271663 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ef2e9709d0 con 0x55ef2e9bb030 2023-08-10T10:53:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff905ffb700 10 client.16413 handle_command_reply: tid=0 2023-08-10T10:53:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 client.16413 shutdown 2023-08-10T10:53:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 -- 172.21.15.107:0/1336271663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 msgr2=0x55ef2e9aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:19.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9aac20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff9100cac10 tx=0x7ff91000c480 comp rx=0 tx=0).stop 2023-08-10T10:53:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 -- 172.21.15.107:0/1336271663 shutdown_connections 2023-08-10T10:53:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ef2e9bb030 0x55ef2e9bd450 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9aac20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 --2- 172.21.15.107:0/1336271663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 -- 172.21.15.107:0/1336271663 >> 172.21.15.107:0/1336271663 conn(0x55ef2e8fecd0 msgr2=0x55ef2e99b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:19.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff905ffb700 0 client.16413 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:19.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 -- 172.21.15.107:0/1336271663 shutdown_connections 2023-08-10T10:53:19.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.211+0000 7ff938432b80 1 -- 172.21.15.107:0/1336271663 wait complete. 2023-08-10T10:53:19.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.212+0000 7ff938432b80 20 client.16413 trim_cache size 0 max 16384 2023-08-10T10:53:19.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.235+0000 7ff938432b80 1 Processor -- start 2023-08-10T10:53:19.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.235+0000 7ff938432b80 1 -- start start 2023-08-10T10:53:19.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff938432b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff938432b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff938432b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e99c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff938432b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e775920 con 0x55ef2e9a1800 2023-08-10T10:53:19.237 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff938432b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e993fe0 con 0x55ef2e9a6f50 2023-08-10T10:53:19.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff938432b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e99ca70 con 0x55ef2e9a7870 2023-08-10T10:53:19.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff91e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff91dd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff91e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49814/0 (socket says 172.21.15.107:49814) 2023-08-10T10:53:19.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff91e59c700 1 -- 172.21.15.107:0/2040103493 learned_addr learned my addr 172.21.15.107:0/2040103493 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:19.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff91dd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:46124/0 (socket says 172.21.15.107:46124) 2023-08-10T10:53:19.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.236+0000 7ff91ed9d700 1 --2- 172.21.15.107:0/2040103493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e99c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.237+0000 7ff91dd9b700 1 -- 172.21.15.107:0/2040103493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 msgr2=0x55ef2e99c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:19.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.237+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/2040103493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e99c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.237+0000 7ff91dd9b700 1 -- 172.21.15.107:0/2040103493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 msgr2=0x55ef2e9b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:19.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.237+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/2040103493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.237+0000 7ff91dd9b700 1 -- 172.21.15.107:0/2040103493 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef2e708c60 con 0x55ef2e9a6f50 2023-08-10T10:53:19.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.237+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/2040103493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab4d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55ef2e9bdd00 tx=0x7ff914009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64b174d5ea16b5be server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:19.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.237+0000 7ff90d7fa700 1 -- 172.21.15.107:0/2040103493 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914017070 con 0x55ef2e9a6f50 2023-08-10T10:53:19.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.237+0000 7ff90d7fa700 1 -- 172.21.15.107:0/2040103493 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff914018040 con 0x55ef2e9a6f50 2023-08-10T10:53:19.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.237+0000 7ff90d7fa700 1 -- 172.21.15.107:0/2040103493 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914010810 con 0x55ef2e9a6f50 2023-08-10T10:53:19.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.238+0000 7ff938432b80 1 -- 172.21.15.107:0/2040103493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 msgr2=0x55ef2e9ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:19.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.238+0000 7ff938432b80 1 --2- 172.21.15.107:0/2040103493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab4d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55ef2e9bdd00 tx=0x7ff914009260 comp rx=0 tx=0).stop 2023-08-10T10:53:19.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.238+0000 7ff938432b80 1 -- 172.21.15.107:0/2040103493 shutdown_connections 2023-08-10T10:53:19.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.238+0000 7ff938432b80 1 --2- 172.21.15.107:0/2040103493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e99c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.238+0000 7ff938432b80 1 --2- 172.21.15.107:0/2040103493 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.238+0000 7ff938432b80 1 --2- 172.21.15.107:0/2040103493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9ab4d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.238+0000 7ff938432b80 1 -- 172.21.15.107:0/2040103493 >> 172.21.15.107:0/2040103493 conn(0x55ef2e8fecd0 msgr2=0x55ef2e9a93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:19.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.238+0000 7ff938432b80 1 -- 172.21.15.107:0/2040103493 shutdown_connections 2023-08-10T10:53:19.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.238+0000 7ff938432b80 1 -- 172.21.15.107:0/2040103493 wait complete. 2023-08-10T10:53:19.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.239+0000 7ff938432b80 1 -- start start 2023-08-10T10:53:19.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.239+0000 7ff938432b80 1 Processor -- start 2023-08-10T10:53:19.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.239+0000 7ff938432b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.239+0000 7ff938432b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff938432b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff938432b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e9b0ec0 con 0x55ef2e9a6f50 2023-08-10T10:53:19.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff938432b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e9b1030 con 0x55ef2e9a1800 2023-08-10T10:53:19.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff938432b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2e9b11f0 con 0x55ef2e9a7870 2023-08-10T10:53:19.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff938432b80 10 client.0 _ll_register_callbacks cb 0x55ef2e88f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:19.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:46136/0 (socket says 172.21.15.107:46136) 2023-08-10T10:53:19.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91e59c700 1 -- 172.21.15.107:0/3448527570 learned_addr learned my addr 172.21.15.107:0/3448527570 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:19.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91ed9d700 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91e59c700 1 -- 172.21.15.107:0/3448527570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 msgr2=0x55ef2e9b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:19.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91e59c700 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91e59c700 1 -- 172.21.15.107:0/3448527570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a6f50 msgr2=0x55ef2e9b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:19.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91e59c700 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91e59c700 1 -- 172.21.15.107:0/3448527570 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff914005ce0 con 0x55ef2e9a1800 2023-08-10T10:53:19.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91ed9d700 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:19.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff91e59c700 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2080 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff91000c2d0 tx=0x7ff9100ca5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3201367b1375df0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:19.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.240+0000 7ff905ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:53:19.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff905ffb700 1 -- 172.21.15.107:0/3448527570 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100a2150 con 0x55ef2e9a1800 2023-08-10T10:53:19.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff905ffb700 1 -- 172.21.15.107:0/3448527570 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff9100a23e0 con 0x55ef2e9a1800 2023-08-10T10:53:19.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff938432b80 1 -- 172.21.15.107:0/3448527570 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff91009dfc0 con 0x55ef2e9a1800 2023-08-10T10:53:19.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff905ffb700 1 -- 172.21.15.107:0/3448527570 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9100b83d0 con 0x55ef2e9a1800 2023-08-10T10:53:19.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff938432b80 10 client.26090 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:19.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff938432b80 1 -- 172.21.15.107:0/3448527570 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ef2e746250 con 0x55ef2e9a1800 2023-08-10T10:53:19.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff905ffb700 1 -- 172.21.15.107:0/3448527570 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff91009dfc0 con 0x55ef2e9a1800 2023-08-10T10:53:19.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff905ffb700 1 -- 172.21.15.107:0/3448527570 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7ff910098ef0 con 0x55ef2e9a1800 2023-08-10T10:53:19.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff938432b80 10 client.26090 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:19.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff938432b80 10 client.26090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:19.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff938432b80 20 client.26090 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:19.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.241+0000 7ff938432b80 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ef2ea0fed0 0x55ef2ea122f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:19.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.242+0000 7ff938432b80 4 client.26090 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:53:19.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.242+0000 7ff938432b80 1 -- 172.21.15.107:0/3448527570 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ef2e8eb780 con 0x55ef2ea0fed0 2023-08-10T10:53:19.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.242+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ef2ea0fed0 0x55ef2ea122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:19.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.242+0000 7ff91dd9b700 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ef2ea0fed0 0x55ef2ea122f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ec0ee275da3d196 server_cookie=38aa2c41f5d74e80 in_seq=0 out_seq=0 2023-08-10T10:53:19.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.242+0000 7ff905ffb700 10 client.26090 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:19.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff905ffb700 1 -- 172.21.15.107:0/3448527570 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ef2e8eb780 con 0x55ef2ea0fed0 2023-08-10T10:53:19.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff905ffb700 10 client.26090 handle_command_reply: tid=0 2023-08-10T10:53:19.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 client.26090 shutdown 2023-08-10T10:53:19.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 -- 172.21.15.107:0/3448527570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a1800 msgr2=0x55ef2e9b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:19.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2080 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff91000c2d0 tx=0x7ff9100ca5e0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 -- 172.21.15.107:0/3448527570 shutdown_connections 2023-08-10T10:53:19.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ef2ea0fed0 0x55ef2ea122f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ef2e9a1800 0x55ef2e9b2080 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef2e9a7870 0x55ef2e9b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff905ffb700 0 client.26090 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:19.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 --2- 172.21.15.107:0/3448527570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ef2e9a6f50 0x55ef2e9b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 -- 172.21.15.107:0/3448527570 >> 172.21.15.107:0/3448527570 conn(0x55ef2e8fecd0 msgr2=0x55ef2e9a9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:19.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 -- 172.21.15.107:0/3448527570 shutdown_connections 2023-08-10T10:53:19.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 1 -- 172.21.15.107:0/3448527570 wait complete. 2023-08-10T10:53:19.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.243+0000 7ff938432b80 20 client.26090 trim_cache size 0 max 16384 2023-08-10T10:53:19.259 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:53:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-10T10:53:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:53:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:53:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:53:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:53:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:53:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:53:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:53:19.261 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:53:19.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 -- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff9080a12c0 msgr2=0x7ff9080a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:19.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff9080a12c0 0x7ff9080a3780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff91800bfd0 tx=0x7ff91800b3b0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 -- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9201006c0 msgr2=0x7ff92019e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:19.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9201006c0 0x7ff92019e650 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff91000e9a0 tx=0x7ff91000ecb0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 -- 172.21.15.107:0/2831694414 shutdown_connections 2023-08-10T10:53:19.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9201066d0 0x7ff9201986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff9201006c0 0x7ff92019e650 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff9080a12c0 0x7ff9080a3780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 --2- 172.21.15.107:0/2831694414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff920101080 0x7ff92019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:19.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 -- 172.21.15.107:0/2831694414 >> 172.21.15.107:0/2831694414 conn(0x7ff9200fc1f0 msgr2=0x7ff92010bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:19.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 -- 172.21.15.107:0/2831694414 shutdown_connections 2023-08-10T10:53:19.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:19.244+0000 7ff924bff700 1 -- 172.21.15.107:0/2831694414 wait complete. 2023-08-10T10:53:19.263 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:53:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: pgmap v66: 129 pgs: 129 active+clean; 1.5 GiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 37 MiB/s wr, 42 op/s 2023-08-10T10:53:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub queued for path: / 2023-08-10T10:53:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:53:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:53:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:53:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:53:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:53:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:53:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:53:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:19 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: pgmap v66: 129 pgs: 129 active+clean; 1.5 GiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 37 MiB/s wr, 42 op/s 2023-08-10T10:53:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub queued for path: / 2023-08-10T10:53:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:53:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:53:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:53:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:53:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:53:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:53:20.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:53:20.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:19 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: pgmap v66: 129 pgs: 129 active+clean; 1.5 GiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 37 MiB/s wr, 42 op/s 2023-08-10T10:53:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub queued for path: / 2023-08-10T10:53:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:53:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:53:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:53:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:53:20.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:53:20.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:53:20.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:53:20.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:19 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:53:20.265 INFO:teuthology.orchestra.run.smithi107.stderr:6400000 of 50000000 tuples (12%) done (elapsed 98.44 s, remaining 670.64 s) 2023-08-10T10:53:21.493 INFO:teuthology.orchestra.run.smithi107.stderr:6500000 of 50000000 tuples (13%) done (elapsed 99.67 s, remaining 667.03 s) 2023-08-10T10:53:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:21 smithi157 ceph-mon[129604]: pgmap v67: 129 pgs: 129 active+clean; 1.5 GiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:53:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:21 smithi107 ceph-mon[127953]: pgmap v67: 129 pgs: 129 active+clean; 1.5 GiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:53:22.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:21 smithi195 ceph-mon[129938]: pgmap v67: 129 pgs: 129 active+clean; 1.5 GiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:53:23.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:22 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:53:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:22 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:53:23.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:22 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:53:23.256 INFO:teuthology.orchestra.run.smithi107.stderr:6600000 of 50000000 tuples (13%) done (elapsed 101.43 s, remaining 667.00 s) 2023-08-10T10:53:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:23 smithi157 ceph-mon[129604]: pgmap v68: 129 pgs: 129 active+clean; 1.5 GiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:53:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:23 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:53:24.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:23 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:53:24.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:23 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:53:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:23 smithi107 ceph-mon[127953]: pgmap v68: 129 pgs: 129 active+clean; 1.5 GiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:53:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:23 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:53:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:23 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:53:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:23 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:53:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:23 smithi195 ceph-mon[129938]: pgmap v68: 129 pgs: 129 active+clean; 1.5 GiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 25 MiB/s wr, 29 op/s 2023-08-10T10:53:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:23 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:53:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:23 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:53:24.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:23 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:53:24.918 INFO:teuthology.orchestra.run.smithi107.stderr:6700000 of 50000000 tuples (13%) done (elapsed 103.10 s, remaining 666.28 s) 2023-08-10T10:53:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:25 smithi157 ceph-mon[129604]: pgmap v69: 129 pgs: 129 active+clean; 1.6 GiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 37 MiB/s wr, 42 op/s 2023-08-10T10:53:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:25 smithi107 ceph-mon[127953]: pgmap v69: 129 pgs: 129 active+clean; 1.6 GiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 37 MiB/s wr, 42 op/s 2023-08-10T10:53:26.156 INFO:teuthology.orchestra.run.smithi107.stderr:6800000 of 50000000 tuples (13%) done (elapsed 104.33 s, remaining 662.83 s) 2023-08-10T10:53:26.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:25 smithi195 ceph-mon[129938]: pgmap v69: 129 pgs: 129 active+clean; 1.6 GiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 37 MiB/s wr, 42 op/s 2023-08-10T10:53:27.733 INFO:teuthology.orchestra.run.smithi107.stderr:6900000 of 50000000 tuples (13%) done (elapsed 105.91 s, remaining 661.56 s) 2023-08-10T10:53:28.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:27 smithi157 ceph-mon[129604]: pgmap v70: 129 pgs: 129 active+clean; 1.6 GiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-08-10T10:53:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:27 smithi107 ceph-mon[127953]: pgmap v70: 129 pgs: 129 active+clean; 1.6 GiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-08-10T10:53:28.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:27 smithi195 ceph-mon[129938]: pgmap v70: 129 pgs: 129 active+clean; 1.6 GiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-08-10T10:53:28.949 INFO:teuthology.orchestra.run.smithi107.stderr:7000000 of 50000000 tuples (14%) done (elapsed 107.13 s, remaining 658.06 s) 2023-08-10T10:53:30.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:29 smithi157 ceph-mon[129604]: pgmap v71: 129 pgs: 129 active+clean; 1.6 GiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 38 op/s 2023-08-10T10:53:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:29 smithi107 ceph-mon[127953]: pgmap v71: 129 pgs: 129 active+clean; 1.6 GiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 38 op/s 2023-08-10T10:53:30.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:29 smithi195 ceph-mon[129938]: pgmap v71: 129 pgs: 129 active+clean; 1.6 GiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 38 op/s 2023-08-10T10:53:30.668 INFO:teuthology.orchestra.run.smithi107.stderr:7100000 of 50000000 tuples (14%) done (elapsed 108.85 s, remaining 657.67 s) 2023-08-10T10:53:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:31 smithi107 ceph-mon[127953]: pgmap v72: 129 pgs: 129 active+clean; 1.6 GiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-08-10T10:53:32.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:31 smithi195 ceph-mon[129938]: pgmap v72: 129 pgs: 129 active+clean; 1.6 GiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-08-10T10:53:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:31 smithi157 ceph-mon[129604]: pgmap v72: 129 pgs: 129 active+clean; 1.6 GiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-08-10T10:53:32.360 INFO:teuthology.orchestra.run.smithi107.stderr:7200000 of 50000000 tuples (14%) done (elapsed 110.54 s, remaining 657.09 s) 2023-08-10T10:53:33.575 INFO:teuthology.orchestra.run.smithi107.stderr:7300000 of 50000000 tuples (14%) done (elapsed 111.75 s, remaining 653.68 s) 2023-08-10T10:53:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:33 smithi107 ceph-mon[127953]: pgmap v73: 129 pgs: 129 active+clean; 1.6 GiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:53:34.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:33 smithi195 ceph-mon[129938]: pgmap v73: 129 pgs: 129 active+clean; 1.6 GiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:53:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:33 smithi157 ceph-mon[129604]: pgmap v73: 129 pgs: 129 active+clean; 1.6 GiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T10:53:35.309 INFO:teuthology.orchestra.run.smithi107.stderr:7400000 of 50000000 tuples (14%) done (elapsed 113.49 s, remaining 653.32 s) 2023-08-10T10:53:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:35 smithi107 ceph-mon[127953]: pgmap v74: 129 pgs: 129 active+clean; 1.7 GiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-08-10T10:53:36.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:35 smithi195 ceph-mon[129938]: pgmap v74: 129 pgs: 129 active+clean; 1.7 GiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-08-10T10:53:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:35 smithi157 ceph-mon[129604]: pgmap v74: 129 pgs: 129 active+clean; 1.7 GiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-08-10T10:53:37.001 INFO:teuthology.orchestra.run.smithi107.stderr:7500000 of 50000000 tuples (15%) done (elapsed 115.18 s, remaining 652.68 s) 2023-08-10T10:53:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:37 smithi107 ceph-mon[127953]: pgmap v75: 129 pgs: 129 active+clean; 1.7 GiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-08-10T10:53:38.136 INFO:teuthology.orchestra.run.smithi107.stderr:7600000 of 50000000 tuples (15%) done (elapsed 116.31 s, remaining 648.91 s) 2023-08-10T10:53:38.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:37 smithi195 ceph-mon[129938]: pgmap v75: 129 pgs: 129 active+clean; 1.7 GiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-08-10T10:53:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:37 smithi157 ceph-mon[129604]: pgmap v75: 129 pgs: 129 active+clean; 1.7 GiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-08-10T10:53:39.834 INFO:teuthology.orchestra.run.smithi107.stderr:7700000 of 50000000 tuples (15%) done (elapsed 118.01 s, remaining 648.30 s) 2023-08-10T10:53:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:39 smithi107 ceph-mon[127953]: pgmap v76: 129 pgs: 129 active+clean; 1.8 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 MiB/s wr, 37 op/s 2023-08-10T10:53:40.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:39 smithi195 ceph-mon[129938]: pgmap v76: 129 pgs: 129 active+clean; 1.8 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 MiB/s wr, 37 op/s 2023-08-10T10:53:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:39 smithi157 ceph-mon[129604]: pgmap v76: 129 pgs: 129 active+clean; 1.8 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 MiB/s wr, 37 op/s 2023-08-10T10:53:41.543 INFO:teuthology.orchestra.run.smithi107.stderr:7800000 of 50000000 tuples (15%) done (elapsed 119.72 s, remaining 647.72 s) 2023-08-10T10:53:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:41 smithi107 ceph-mon[127953]: pgmap v77: 129 pgs: 129 active+clean; 1.8 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-08-10T10:53:42.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:41 smithi195 ceph-mon[129938]: pgmap v77: 129 pgs: 129 active+clean; 1.8 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-08-10T10:53:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:41 smithi157 ceph-mon[129604]: pgmap v77: 129 pgs: 129 active+clean; 1.8 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-08-10T10:53:42.764 INFO:teuthology.orchestra.run.smithi107.stderr:7900000 of 50000000 tuples (15%) done (elapsed 120.94 s, remaining 644.51 s) 2023-08-10T10:53:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:43 smithi107 ceph-mon[127953]: pgmap v78: 129 pgs: 129 active+clean; 1.8 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-08-10T10:53:44.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:43 smithi195 ceph-mon[129938]: pgmap v78: 129 pgs: 129 active+clean; 1.8 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-08-10T10:53:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:43 smithi157 ceph-mon[129604]: pgmap v78: 129 pgs: 129 active+clean; 1.8 GiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-08-10T10:53:44.457 INFO:teuthology.orchestra.run.smithi107.stderr:8000000 of 50000000 tuples (16%) done (elapsed 122.63 s, remaining 643.83 s) 2023-08-10T10:53:45.729 INFO:teuthology.orchestra.run.smithi107.stderr:8100000 of 50000000 tuples (16%) done (elapsed 123.91 s, remaining 640.95 s) 2023-08-10T10:53:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:45 smithi107 ceph-mon[127953]: pgmap v79: 129 pgs: 129 active+clean; 1.9 GiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 40 op/s 2023-08-10T10:53:46.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:45 smithi195 ceph-mon[129938]: pgmap v79: 129 pgs: 129 active+clean; 1.9 GiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 40 op/s 2023-08-10T10:53:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:45 smithi157 ceph-mon[129604]: pgmap v79: 129 pgs: 129 active+clean; 1.9 GiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 40 op/s 2023-08-10T10:53:47.381 INFO:teuthology.orchestra.run.smithi107.stderr:8200000 of 50000000 tuples (16%) done (elapsed 125.56 s, remaining 640.04 s) 2023-08-10T10:53:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:47 smithi107 ceph-mon[127953]: pgmap v80: 129 pgs: 129 active+clean; 1.9 GiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-08-10T10:53:48.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:47 smithi195 ceph-mon[129938]: pgmap v80: 129 pgs: 129 active+clean; 1.9 GiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-08-10T10:53:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:47 smithi157 ceph-mon[129604]: pgmap v80: 129 pgs: 129 active+clean; 1.9 GiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 27 op/s 2023-08-10T10:53:49.000 INFO:teuthology.orchestra.run.smithi107.stderr:8300000 of 50000000 tuples (16%) done (elapsed 127.18 s, remaining 638.95 s) 2023-08-10T10:53:49.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:53:49.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.489+0000 7ff60cb9d700 1 -- 172.21.15.107:0/2931379674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff608072b10 msgr2=0x7ff608072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:49.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.490+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/2931379674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff608072b10 0x7ff608072ef0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80098f0 tx=0x7ff5f8009c00 comp rx=0 tx=0).stop 2023-08-10T10:53:49.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.490+0000 7ff60cb9d700 1 -- 172.21.15.107:0/2931379674 shutdown_connections 2023-08-10T10:53:49.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.490+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/2931379674 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff608111550 0x7ff608113940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.490+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/2931379674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff608072b10 0x7ff608072ef0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.490+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/2931379674 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff608073430 0x7ff608111010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.490+0000 7ff60cb9d700 1 -- 172.21.15.107:0/2931379674 >> 172.21.15.107:0/2931379674 conn(0x7ff6080fc010 msgr2=0x7ff6080fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:49.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.490+0000 7ff60cb9d700 1 -- 172.21.15.107:0/2931379674 shutdown_connections 2023-08-10T10:53:49.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.490+0000 7ff60cb9d700 1 -- 172.21.15.107:0/2931379674 wait complete. 2023-08-10T10:53:49.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.491+0000 7ff60cb9d700 1 Processor -- start 2023-08-10T10:53:49.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff60cb9d700 1 -- start start 2023-08-10T10:53:49.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff60cb9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff608072b10 0x7ff6081a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff60cb9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff608073430 0x7ff6081a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff60cb9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff608111550 0x7ff60819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff60cb9d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60819d080 con 0x7ff608073430 2023-08-10T10:53:49.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff60cb9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60819d1f0 con 0x7ff608111550 2023-08-10T10:53:49.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff60cb9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60819d3b0 con 0x7ff608072b10 2023-08-10T10:53:49.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff606ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff608073430 0x7ff6081a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff606ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff608073430 0x7ff6081a2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35324/0 (socket says 172.21.15.107:35324) 2023-08-10T10:53:49.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.492+0000 7ff606ffd700 1 -- 172.21.15.107:0/1852689136 learned_addr learned my addr 172.21.15.107:0/1852689136 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:49.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff6077fe700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff608072b10 0x7ff6081a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff607fff700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff608111550 0x7ff60819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff606ffd700 1 -- 172.21.15.107:0/1852689136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff608072b10 msgr2=0x7ff6081a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:49.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff606ffd700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff608072b10 0x7ff6081a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff606ffd700 1 -- 172.21.15.107:0/1852689136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff608111550 msgr2=0x7ff60819ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:49.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff606ffd700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff608111550 0x7ff60819ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff606ffd700 1 -- 172.21.15.107:0/1852689136 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009520 con 0x7ff608073430 2023-08-10T10:53:49.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff607fff700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff608111550 0x7ff60819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:49.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff606ffd700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff608073430 0x7ff6081a2ee0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00e9c0 tx=0x7ff5fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:49.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff604ff9700 1 -- 172.21.15.107:0/1852689136 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00cbd0 con 0x7ff608073430 2023-08-10T10:53:49.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff60cb9d700 1 -- 172.21.15.107:0/1852689136 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60819d690 con 0x7ff608073430 2023-08-10T10:53:49.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.493+0000 7ff604ff9700 1 -- 172.21.15.107:0/1852689136 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5fc00eeb0 con 0x7ff608073430 2023-08-10T10:53:49.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.494+0000 7ff604ff9700 1 -- 172.21.15.107:0/1852689136 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc005410 con 0x7ff608073430 2023-08-10T10:53:49.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.494+0000 7ff60cb9d700 1 -- 172.21.15.107:0/1852689136 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6081a9990 con 0x7ff608073430 2023-08-10T10:53:49.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.498+0000 7ff604ff9700 1 -- 172.21.15.107:0/1852689136 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff5fc0055b0 con 0x7ff608073430 2023-08-10T10:53:49.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.499+0000 7ff621629b80 1 Processor -- start 2023-08-10T10:53:49.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.499+0000 7ff621629b80 1 -- start start 2023-08-10T10:53:49.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff621629b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04af8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff621629b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04afcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff621629b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04afd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff621629b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c04a73dc0 con 0x564c04afd290 2023-08-10T10:53:49.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff621629b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c04a50590 con 0x564c04af84b0 2023-08-10T10:53:49.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff621629b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c04a4deb0 con 0x564c04af8dd0 2023-08-10T10:53:49.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff607fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04af8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff607fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04af8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:51802/0 (socket says 172.21.15.107:51802) 2023-08-10T10:53:49.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff607fff700 1 -- 172.21.15.107:0/2688855368 learned_addr learned my addr 172.21.15.107:0/2688855368 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:49.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff6077fe700 1 --2- 172.21.15.107:0/2688855368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04afcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff604ff9700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff5f00a13e0 0x7ff5f00a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff604ff9700 1 -- 172.21.15.107:0/1852689136 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff5fc014070 con 0x7ff608073430 2023-08-10T10:53:49.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.500+0000 7ff607fff700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff5f00a13e0 0x7ff5f00a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.503 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff6077fe700 1 -- 172.21.15.107:0/2688855368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 msgr2=0x564c04af8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:49.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff6077fe700 1 --2- 172.21.15.107:0/2688855368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04af8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff6077fe700 1 -- 172.21.15.107:0/2688855368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 msgr2=0x564c04afd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:49.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff6077fe700 1 --2- 172.21.15.107:0/2688855368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04afd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff6077fe700 1 -- 172.21.15.107:0/2688855368 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c048ca630 con 0x564c04af8dd0 2023-08-10T10:53:49.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff6077fe700 1 --2- 172.21.15.107:0/2688855368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04afcd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009810 tx=0x7ff5f8005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d93ccb58e81077 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:49.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff607fff700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff5f00a13e0 0x7ff5f00a38a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff600009fd0 tx=0x7ff600004ad0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:49.504 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff5edffb700 1 -- 172.21.15.107:0/2688855368 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800f460 con 0x564c04af8dd0 2023-08-10T10:53:49.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff5edffb700 1 -- 172.21.15.107:0/2688855368 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5f801d040 con 0x564c04af8dd0 2023-08-10T10:53:49.505 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.501+0000 7ff5edffb700 1 -- 172.21.15.107:0/2688855368 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8005260 con 0x564c04af8dd0 2023-08-10T10:53:49.507 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.502+0000 7ff621629b80 1 -- 172.21.15.107:0/2688855368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 msgr2=0x564c04afcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:49.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.502+0000 7ff621629b80 1 --2- 172.21.15.107:0/2688855368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04afcd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009810 tx=0x7ff5f8005dc0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.502+0000 7ff621629b80 1 -- 172.21.15.107:0/2688855368 shutdown_connections 2023-08-10T10:53:49.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.502+0000 7ff621629b80 1 --2- 172.21.15.107:0/2688855368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04af8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.502+0000 7ff621629b80 1 --2- 172.21.15.107:0/2688855368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04afd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.502+0000 7ff621629b80 1 --2- 172.21.15.107:0/2688855368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04afcd50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.502+0000 7ff621629b80 1 -- 172.21.15.107:0/2688855368 >> 172.21.15.107:0/2688855368 conn(0x564c04a55cd0 msgr2=0x564c04af3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:49.508 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.502+0000 7ff621629b80 1 -- 172.21.15.107:0/2688855368 shutdown_connections 2023-08-10T10:53:49.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.502+0000 7ff621629b80 1 -- 172.21.15.107:0/2688855368 wait complete. 2023-08-10T10:53:49.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.503+0000 7ff621629b80 1 -- start start 2023-08-10T10:53:49.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.503+0000 7ff621629b80 1 Processor -- start 2023-08-10T10:53:49.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff621629b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04b01e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff621629b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff621629b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04b028e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff621629b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c04a497a0 con 0x564c04afd290 2023-08-10T10:53:49.509 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff621629b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c049e8ac0 con 0x564c04af84b0 2023-08-10T10:53:49.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff621629b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c049e87c0 con 0x564c04af8dd0 2023-08-10T10:53:49.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff621629b80 10 client.0 _ll_register_callbacks cb 0x564c049e6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:49.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff606ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff6077fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04b01e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff6077fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04b01e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:51818/0 (socket says 172.21.15.107:51818) 2023-08-10T10:53:49.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff6077fe700 1 -- 172.21.15.107:0/825164975 learned_addr learned my addr 172.21.15.107:0/825164975 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:49.510 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.504+0000 7ff607fff700 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04b028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff606ffd700 1 -- 172.21.15.107:0/825164975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 msgr2=0x564c04b01e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:49.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff606ffd700 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04b01e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff606ffd700 1 -- 172.21.15.107:0/825164975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 msgr2=0x564c04b028e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:49.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff606ffd700 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04b028e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff606ffd700 1 -- 172.21.15.107:0/825164975 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6081142f0 con 0x564c04af8dd0 2023-08-10T10:53:49.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff607fff700 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04b028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:53:49.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff606ffd700 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b023a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0ca6f0 tx=0x7ff5fc099a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=786522bd8e04c704 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:49.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff5e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:53:49.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/825164975 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc09e0a0 con 0x564c04af8dd0 2023-08-10T10:53:49.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/825164975 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff5fc0cae40 con 0x564c04af8dd0 2023-08-10T10:53:49.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff621629b80 1 -- 172.21.15.107:0/825164975 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c04aeb470 con 0x564c04af8dd0 2023-08-10T10:53:49.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/825164975 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5fc0a24c0 con 0x564c04af8dd0 2023-08-10T10:53:49.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff621629b80 10 client.26116 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:49.512 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.505+0000 7ff621629b80 1 -- 172.21.15.107:0/825164975 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x564c04876de0 con 0x564c04af8dd0 2023-08-10T10:53:49.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.506+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/825164975 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5fc0c8080 con 0x564c04af8dd0 2023-08-10T10:53:49.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.506+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/825164975 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7ff5fc095e60 con 0x564c04af8dd0 2023-08-10T10:53:49.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.506+0000 7ff621629b80 10 client.26116 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:49.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.506+0000 7ff621629b80 10 client.26116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:49.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.506+0000 7ff621629b80 20 client.26116 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:49.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.506+0000 7ff621629b80 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564c04b124b0 0x564c04b148d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.506+0000 7ff621629b80 4 client.26116 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:53:49.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.506+0000 7ff621629b80 1 -- 172.21.15.107:0/825164975 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c04ac79d0 con 0x564c04b124b0 2023-08-10T10:53:49.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.506+0000 7ff6077fe700 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564c04b124b0 0x564c04b148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.507+0000 7ff5e6ffd700 10 client.26116 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:49.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.507+0000 7ff6077fe700 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564c04b124b0 0x564c04b148d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29b61153397f2913 server_cookie=8cb279c8ffeb6af7 in_seq=0 out_seq=0 2023-08-10T10:53:49.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.507+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/825164975 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564c04ac79d0 con 0x564c04b124b0 2023-08-10T10:53:49.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.507+0000 7ff5e6ffd700 10 client.26116 handle_command_reply: tid=0 2023-08-10T10:53:49.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 client.26116 shutdown 2023-08-10T10:53:49.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 -- 172.21.15.107:0/825164975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 msgr2=0x564c04b023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:49.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b023a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0ca6f0 tx=0x7ff5fc099a40 comp rx=0 tx=0).stop 2023-08-10T10:53:49.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 -- 172.21.15.107:0/825164975 shutdown_connections 2023-08-10T10:53:49.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564c04b124b0 0x564c04b148d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04b01e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04b028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 --2- 172.21.15.107:0/825164975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b023a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 -- 172.21.15.107:0/825164975 >> 172.21.15.107:0/825164975 conn(0x564c04a55cd0 msgr2=0x564c04afe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:49.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff5e6ffd700 0 client.26116 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:49.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 -- 172.21.15.107:0/825164975 shutdown_connections 2023-08-10T10:53:49.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 1 -- 172.21.15.107:0/825164975 wait complete. 2023-08-10T10:53:49.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.508+0000 7ff621629b80 20 client.26116 trim_cache size 0 max 16384 2023-08-10T10:53:49.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.526+0000 7ff621629b80 1 Processor -- start 2023-08-10T10:53:49.528 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.526+0000 7ff621629b80 1 -- start start 2023-08-10T10:53:49.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff621629b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04afab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff621629b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b09490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff621629b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04af3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff621629b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c048cc920 con 0x564c04afd290 2023-08-10T10:53:49.529 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff621629b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c04b0eef0 con 0x564c04af84b0 2023-08-10T10:53:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff621629b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c04af91b0 con 0x564c04af8dd0 2023-08-10T10:53:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff6077fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04afab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff606ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b09490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff607fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04af3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff6077fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04afab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:51828/0 (socket says 172.21.15.107:51828) 2023-08-10T10:53:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff6077fe700 1 -- 172.21.15.107:0/741153612 learned_addr learned my addr 172.21.15.107:0/741153612 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff606ffd700 1 -- 172.21.15.107:0/741153612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 msgr2=0x564c04afab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff606ffd700 1 --2- 172.21.15.107:0/741153612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04afab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff606ffd700 1 -- 172.21.15.107:0/741153612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 msgr2=0x564c04af3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff606ffd700 1 --2- 172.21.15.107:0/741153612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04af3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.527+0000 7ff606ffd700 1 -- 172.21.15.107:0/741153612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c0485fc60 con 0x564c04af8dd0 2023-08-10T10:53:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.528+0000 7ff606ffd700 1 --2- 172.21.15.107:0/741153612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b09490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0983c0 tx=0x7ff5fc09a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5977381d5e2eb365 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.528+0000 7ff5ee7fc700 1 -- 172.21.15.107:0/741153612 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0963b0 con 0x564c04af8dd0 2023-08-10T10:53:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.528+0000 7ff5ee7fc700 1 -- 172.21.15.107:0/741153612 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564c04aeb470 con 0x564c04af8dd0 2023-08-10T10:53:49.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.528+0000 7ff5ee7fc700 1 -- 172.21.15.107:0/741153612 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc099560 con 0x564c04af8dd0 2023-08-10T10:53:49.533 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 -- 172.21.15.107:0/741153612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 msgr2=0x564c04b09490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:49.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 --2- 172.21.15.107:0/741153612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b09490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0983c0 tx=0x7ff5fc09a1f0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 -- 172.21.15.107:0/741153612 shutdown_connections 2023-08-10T10:53:49.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 --2- 172.21.15.107:0/741153612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af84b0 0x564c04afab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 --2- 172.21.15.107:0/741153612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04afd290 0x564c04af3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 --2- 172.21.15.107:0/741153612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04af8dd0 0x564c04b09490 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.534 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 -- 172.21.15.107:0/741153612 >> 172.21.15.107:0/741153612 conn(0x564c04a55cd0 msgr2=0x564c04afb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 -- 172.21.15.107:0/741153612 shutdown_connections 2023-08-10T10:53:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 -- 172.21.15.107:0/741153612 wait complete. 2023-08-10T10:53:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 -- start start 2023-08-10T10:53:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.529+0000 7ff621629b80 1 Processor -- start 2023-08-10T10:53:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff621629b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04af84b0 0x564c04b08c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff621629b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af8dd0 0x564c04b091c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff621629b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04afd290 0x564c04b07480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff621629b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c04b07a50 con 0x564c04af84b0 2023-08-10T10:53:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff621629b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c04b07bc0 con 0x564c04af8dd0 2023-08-10T10:53:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff621629b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c04b07d80 con 0x564c04afd290 2023-08-10T10:53:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff621629b80 10 client.0 _ll_register_callbacks cb 0x564c049e6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:53:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff6077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04af84b0 0x564c04b08c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff606ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af8dd0 0x564c04b091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff6077fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04af84b0 0x564c04b08c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35372/0 (socket says 172.21.15.107:35372) 2023-08-10T10:53:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff6077fe700 1 -- 172.21.15.107:0/28445655 learned_addr learned my addr 172.21.15.107:0/28445655 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:53:49.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.530+0000 7ff607fff700 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04afd290 0x564c04b07480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff606ffd700 1 -- 172.21.15.107:0/28445655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04afd290 msgr2=0x564c04b07480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:49.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff606ffd700 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04afd290 0x564c04b07480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff606ffd700 1 -- 172.21.15.107:0/28445655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04af84b0 msgr2=0x564c04b08c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:53:49.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff606ffd700 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04af84b0 0x564c04b08c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff606ffd700 1 -- 172.21.15.107:0/28445655 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c04876de0 con 0x564c04af8dd0 2023-08-10T10:53:49.537 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff6077fe700 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04af84b0 0x564c04b08c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:53:49.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff606ffd700 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af8dd0 0x564c04b091c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc096ae0 tx=0x7ff5fc009f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b209d96381198513 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:53:49.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff5e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:53:49.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/28445655 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc099760 con 0x564c04af8dd0 2023-08-10T10:53:49.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff621629b80 1 -- 172.21.15.107:0/28445655 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5f801d040 con 0x564c04af8dd0 2023-08-10T10:53:49.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.531+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/28445655 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ff5fc0cae40 con 0x564c04af8dd0 2023-08-10T10:53:49.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/28445655 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5fc00cd30 con 0x564c04af8dd0 2023-08-10T10:53:49.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff621629b80 10 client.26105 fetch_fsmap learned FSMap version 32 2023-08-10T10:53:49.538 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff621629b80 1 -- 172.21.15.107:0/28445655 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x564c0489d250 con 0x564c04af8dd0 2023-08-10T10:53:49.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/28445655 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5f801d040 con 0x564c04af8dd0 2023-08-10T10:53:49.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/28445655 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7ff5fc098fd0 con 0x564c04af8dd0 2023-08-10T10:53:49.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff621629b80 10 client.26105 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:53:49.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff621629b80 10 client.26105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:53:49.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff621629b80 20 client.26105 populate_metadata read hostname 'smithi107' 2023-08-10T10:53:49.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff621629b80 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564c04b66d80 0x564c04b69170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:53:49.539 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff621629b80 4 client.26105 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:53:49.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.532+0000 7ff621629b80 1 -- 172.21.15.107:0/28445655 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564c04a42780 con 0x564c04b66d80 2023-08-10T10:53:49.540 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff6077fe700 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564c04b66d80 0x564c04b69170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:53:49.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff6077fe700 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564c04b66d80 0x564c04b69170 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee687a766105b74 server_cookie=589de4d869c05194 in_seq=0 out_seq=0 2023-08-10T10:53:49.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff5e6ffd700 10 client.26105 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:49.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff5e6ffd700 1 -- 172.21.15.107:0/28445655 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564c04a42780 con 0x564c04b66d80 2023-08-10T10:53:49.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff5e6ffd700 10 client.26105 handle_command_reply: tid=0 2023-08-10T10:53:49.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff621629b80 1 client.26105 shutdown 2023-08-10T10:53:49.541 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff621629b80 1 -- 172.21.15.107:0/28445655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af8dd0 msgr2=0x564c04b091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:49.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff621629b80 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af8dd0 0x564c04b091c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc096ae0 tx=0x7ff5fc009f00 comp rx=0 tx=0).stop 2023-08-10T10:53:49.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff621629b80 1 -- 172.21.15.107:0/28445655 shutdown_connections 2023-08-10T10:53:49.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff621629b80 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x564c04b66d80 0x564c04b69170 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff621629b80 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564c04afd290 0x564c04b07480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff621629b80 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564c04af84b0 0x564c04b08c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff621629b80 1 --2- 172.21.15.107:0/28445655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564c04af8dd0 0x564c04b091c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff5e6ffd700 0 client.26105 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:53:49.542 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.533+0000 7ff621629b80 1 -- 172.21.15.107:0/28445655 >> 172.21.15.107:0/28445655 conn(0x564c04a55cd0 msgr2=0x564c04af3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:49.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff621629b80 1 -- 172.21.15.107:0/28445655 shutdown_connections 2023-08-10T10:53:49.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff621629b80 1 -- 172.21.15.107:0/28445655 wait complete. 2023-08-10T10:53:49.543 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff621629b80 20 client.26105 trim_cache size 0 max 16384 2023-08-10T10:53:49.543 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:53:49.543 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "scrub active (1 inodes in the stack)", 2023-08-10T10:53:49.543 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:53:49.544 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:53:49.544 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:53:49.544 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:53:49.544 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:53:49.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:53:49.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:53:49.544 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:53:49.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 -- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff5f00a13e0 msgr2=0x7ff5f00a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:49.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff5f00a13e0 0x7ff5f00a38a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff600009fd0 tx=0x7ff600004ad0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 -- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff608073430 msgr2=0x7ff6081a2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:53:49.545 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff608073430 0x7ff6081a2ee0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00e9c0 tx=0x7ff5fc00ecd0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 -- 172.21.15.107:0/1852689136 shutdown_connections 2023-08-10T10:53:49.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff5f00a13e0 0x7ff5f00a38a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff608111550 0x7ff60819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff608072b10 0x7ff6081a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 --2- 172.21.15.107:0/1852689136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff608073430 0x7ff6081a2ee0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:53:49.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.534+0000 7ff60cb9d700 1 -- 172.21.15.107:0/1852689136 >> 172.21.15.107:0/1852689136 conn(0x7ff6080fc010 msgr2=0x7ff6080fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:53:49.546 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.535+0000 7ff60cb9d700 1 -- 172.21.15.107:0/1852689136 shutdown_connections 2023-08-10T10:53:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:53:49.535+0000 7ff60cb9d700 1 -- 172.21.15.107:0/1852689136 wait complete. 2023-08-10T10:53:49.556 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:53:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:49 smithi107 ceph-mon[127953]: pgmap v81: 129 pgs: 129 active+clean; 1.9 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 42 op/s 2023-08-10T10:53:50.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:49 smithi195 ceph-mon[129938]: pgmap v81: 129 pgs: 129 active+clean; 1.9 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 42 op/s 2023-08-10T10:53:50.244 INFO:teuthology.orchestra.run.smithi107.stderr:8400000 of 50000000 tuples (16%) done (elapsed 128.42 s, remaining 635.99 s) 2023-08-10T10:53:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:49 smithi157 ceph-mon[129604]: pgmap v81: 129 pgs: 129 active+clean; 1.9 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 42 op/s 2023-08-10T10:53:51.940 INFO:teuthology.orchestra.run.smithi107.stderr:8500000 of 50000000 tuples (17%) done (elapsed 130.12 s, remaining 635.28 s) 2023-08-10T10:53:52.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:51 smithi107 ceph-mon[127953]: pgmap v82: 129 pgs: 129 active+clean; 1.9 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 30 op/s 2023-08-10T10:53:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:51 smithi195 ceph-mon[129938]: pgmap v82: 129 pgs: 129 active+clean; 1.9 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 30 op/s 2023-08-10T10:53:52.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:51 smithi157 ceph-mon[129604]: pgmap v82: 129 pgs: 129 active+clean; 1.9 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 30 op/s 2023-08-10T10:53:53.700 INFO:teuthology.orchestra.run.smithi107.stderr:8600000 of 50000000 tuples (17%) done (elapsed 131.88 s, remaining 634.85 s) 2023-08-10T10:53:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:53 smithi107 ceph-mon[127953]: pgmap v83: 129 pgs: 129 active+clean; 1.9 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 30 op/s 2023-08-10T10:53:54.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:53 smithi195 ceph-mon[129938]: pgmap v83: 129 pgs: 129 active+clean; 1.9 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 30 op/s 2023-08-10T10:53:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:53 smithi157 ceph-mon[129604]: pgmap v83: 129 pgs: 129 active+clean; 1.9 GiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 30 op/s 2023-08-10T10:53:54.939 INFO:teuthology.orchestra.run.smithi107.stderr:8700000 of 50000000 tuples (17%) done (elapsed 133.12 s, remaining 631.92 s) 2023-08-10T10:53:56.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:55 smithi107 ceph-mon[127953]: pgmap v84: 129 pgs: 129 active+clean; 2.0 GiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 45 op/s 2023-08-10T10:53:56.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:55 smithi195 ceph-mon[129938]: pgmap v84: 129 pgs: 129 active+clean; 2.0 GiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 45 op/s 2023-08-10T10:53:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:55 smithi157 ceph-mon[129604]: pgmap v84: 129 pgs: 129 active+clean; 2.0 GiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 45 op/s 2023-08-10T10:53:56.622 INFO:teuthology.orchestra.run.smithi107.stderr:8800000 of 50000000 tuples (17%) done (elapsed 134.80 s, remaining 631.11 s) 2023-08-10T10:53:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:57 smithi107 ceph-mon[127953]: pgmap v85: 129 pgs: 129 active+clean; 2.0 GiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 29 op/s 2023-08-10T10:53:58.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:57 smithi195 ceph-mon[129938]: pgmap v85: 129 pgs: 129 active+clean; 2.0 GiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 29 op/s 2023-08-10T10:53:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:57 smithi157 ceph-mon[129604]: pgmap v85: 129 pgs: 129 active+clean; 2.0 GiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 29 op/s 2023-08-10T10:53:58.332 INFO:teuthology.orchestra.run.smithi107.stderr:8900000 of 50000000 tuples (17%) done (elapsed 136.51 s, remaining 630.40 s) 2023-08-10T10:53:59.422 INFO:teuthology.orchestra.run.smithi107.stderr:9000000 of 50000000 tuples (18%) done (elapsed 137.60 s, remaining 626.84 s) 2023-08-10T10:54:00.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:53:59 smithi157 ceph-mon[129604]: pgmap v86: 129 pgs: 129 active+clean; 2.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 43 op/s 2023-08-10T10:54:00.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:53:59 smithi107 ceph-mon[127953]: pgmap v86: 129 pgs: 129 active+clean; 2.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 43 op/s 2023-08-10T10:54:00.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:53:59 smithi195 ceph-mon[129938]: pgmap v86: 129 pgs: 129 active+clean; 2.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 43 op/s 2023-08-10T10:54:01.212 INFO:teuthology.orchestra.run.smithi107.stderr:9100000 of 50000000 tuples (18%) done (elapsed 139.39 s, remaining 626.49 s) 2023-08-10T10:54:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:01 smithi157 ceph-mon[129604]: pgmap v87: 129 pgs: 129 active+clean; 2.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-08-10T10:54:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:01 smithi107 ceph-mon[127953]: pgmap v87: 129 pgs: 129 active+clean; 2.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-08-10T10:54:02.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:01 smithi195 ceph-mon[129938]: pgmap v87: 129 pgs: 129 active+clean; 2.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-08-10T10:54:02.478 INFO:teuthology.orchestra.run.smithi107.stderr:9200000 of 50000000 tuples (18%) done (elapsed 140.66 s, remaining 623.78 s) 2023-08-10T10:54:04.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:03 smithi157 ceph-mon[129604]: pgmap v88: 129 pgs: 129 active+clean; 2.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-08-10T10:54:04.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:03 smithi107 ceph-mon[127953]: pgmap v88: 129 pgs: 129 active+clean; 2.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-08-10T10:54:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:03 smithi195 ceph-mon[129938]: pgmap v88: 129 pgs: 129 active+clean; 2.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-08-10T10:54:04.348 INFO:teuthology.orchestra.run.smithi107.stderr:9300000 of 50000000 tuples (18%) done (elapsed 142.53 s, remaining 623.74 s) 2023-08-10T10:54:06.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:05 smithi157 ceph-mon[129604]: pgmap v89: 129 pgs: 129 active+clean; 2.2 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 37 MiB/s wr, 52 op/s 2023-08-10T10:54:06.060 INFO:teuthology.orchestra.run.smithi107.stderr:9400000 of 50000000 tuples (18%) done (elapsed 144.24 s, remaining 622.98 s) 2023-08-10T10:54:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:05 smithi107 ceph-mon[127953]: pgmap v89: 129 pgs: 129 active+clean; 2.2 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 37 MiB/s wr, 52 op/s 2023-08-10T10:54:06.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:05 smithi195 ceph-mon[129938]: pgmap v89: 129 pgs: 129 active+clean; 2.2 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 37 MiB/s wr, 52 op/s 2023-08-10T10:54:07.310 INFO:teuthology.orchestra.run.smithi107.stderr:9500000 of 50000000 tuples (19%) done (elapsed 145.49 s, remaining 620.24 s) 2023-08-10T10:54:08.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:07 smithi157 ceph-mon[129604]: pgmap v90: 129 pgs: 129 active+clean; 2.2 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-08-10T10:54:08.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:07 smithi107 ceph-mon[127953]: pgmap v90: 129 pgs: 129 active+clean; 2.2 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-08-10T10:54:08.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:07 smithi195 ceph-mon[129938]: pgmap v90: 129 pgs: 129 active+clean; 2.2 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-08-10T10:54:08.998 INFO:teuthology.orchestra.run.smithi107.stderr:9600000 of 50000000 tuples (19%) done (elapsed 147.18 s, remaining 619.37 s) 2023-08-10T10:54:10.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:09 smithi157 ceph-mon[129604]: pgmap v91: 129 pgs: 129 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 MiB/s wr, 51 op/s 2023-08-10T10:54:10.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:09 smithi107 ceph-mon[127953]: pgmap v91: 129 pgs: 129 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 MiB/s wr, 51 op/s 2023-08-10T10:54:10.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:09 smithi195 ceph-mon[129938]: pgmap v91: 129 pgs: 129 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 MiB/s wr, 51 op/s 2023-08-10T10:54:10.702 INFO:teuthology.orchestra.run.smithi107.stderr:9700000 of 50000000 tuples (19%) done (elapsed 148.88 s, remaining 618.54 s) 2023-08-10T10:54:11.973 INFO:teuthology.orchestra.run.smithi107.stderr:9800000 of 50000000 tuples (19%) done (elapsed 150.15 s, remaining 615.93 s) 2023-08-10T10:54:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:11 smithi157 ceph-mon[129604]: pgmap v92: 129 pgs: 129 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:54:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:11 smithi107 ceph-mon[127953]: pgmap v92: 129 pgs: 129 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:54:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:11 smithi195 ceph-mon[129938]: pgmap v92: 129 pgs: 129 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:54:13.298 INFO:teuthology.orchestra.run.smithi107.stderr:9900000 of 50000000 tuples (19%) done (elapsed 151.48 s, remaining 613.55 s) 2023-08-10T10:54:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:13 smithi157 ceph-mon[129604]: pgmap v93: 129 pgs: 129 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:54:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:13 smithi107 ceph-mon[127953]: pgmap v93: 129 pgs: 129 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:54:14.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:13 smithi195 ceph-mon[129938]: pgmap v93: 129 pgs: 129 active+clean; 2.3 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-08-10T10:54:14.561 INFO:teuthology.orchestra.run.smithi107.stderr:10000000 of 50000000 tuples (20%) done (elapsed 152.74 s, remaining 610.96 s) 2023-08-10T10:54:15.761 INFO:teuthology.orchestra.run.smithi107.stderr:10100000 of 50000000 tuples (20%) done (elapsed 153.94 s, remaining 608.13 s) 2023-08-10T10:54:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:15 smithi157 ceph-mon[129604]: pgmap v94: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 37 MiB/s wr, 68 op/s 2023-08-10T10:54:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:15 smithi107 ceph-mon[127953]: pgmap v94: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 37 MiB/s wr, 68 op/s 2023-08-10T10:54:16.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:15 smithi195 ceph-mon[129938]: pgmap v94: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 37 MiB/s wr, 68 op/s 2023-08-10T10:54:16.947 INFO:teuthology.orchestra.run.smithi107.stderr:10200000 of 50000000 tuples (20%) done (elapsed 155.12 s, remaining 605.29 s) 2023-08-10T10:54:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:17 smithi157 ceph-mon[129604]: pgmap v95: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 25 MiB/s wr, 44 op/s 2023-08-10T10:54:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:17 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T10:54:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:17 smithi107 ceph-mon[127953]: pgmap v95: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 25 MiB/s wr, 44 op/s 2023-08-10T10:54:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:17 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T10:54:18.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:17 smithi195 ceph-mon[129938]: pgmap v95: 129 pgs: 129 active+clean; 2.3 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 25 MiB/s wr, 44 op/s 2023-08-10T10:54:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:17 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T10:54:18.241 INFO:teuthology.orchestra.run.smithi107.stderr:10300000 of 50000000 tuples (20%) done (elapsed 156.42 s, remaining 602.90 s) 2023-08-10T10:54:19.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:18 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T10:54:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:18 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T10:54:19.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:18 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T10:54:19.444 INFO:teuthology.orchestra.run.smithi107.stderr:10400000 of 50000000 tuples (20%) done (elapsed 157.62 s, remaining 600.17 s) 2023-08-10T10:54:19.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:54:19.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.781+0000 7f0a611ff700 1 -- 172.21.15.107:0/3388132770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c1032d0 msgr2=0x7f0a5c10f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:19.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.781+0000 7f0a611ff700 1 --2- 172.21.15.107:0/3388132770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c1032d0 0x7f0a5c10f7e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400b0a0 tx=0x7f0a5400b3b0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.781+0000 7f0a611ff700 1 -- 172.21.15.107:0/3388132770 shutdown_connections 2023-08-10T10:54:19.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.781+0000 7f0a611ff700 1 --2- 172.21.15.107:0/3388132770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a5c108920 0x7f0a5c108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.781+0000 7f0a611ff700 1 --2- 172.21.15.107:0/3388132770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c1032d0 0x7f0a5c10f7e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.781+0000 7f0a611ff700 1 --2- 172.21.15.107:0/3388132770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a5c102910 0x7f0a5c102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.781+0000 7f0a611ff700 1 -- 172.21.15.107:0/3388132770 >> 172.21.15.107:0/3388132770 conn(0x7f0a5c0fe400 msgr2=0x7f0a5c100820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:19.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.781+0000 7f0a611ff700 1 -- 172.21.15.107:0/3388132770 shutdown_connections 2023-08-10T10:54:19.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.781+0000 7f0a611ff700 1 -- 172.21.15.107:0/3388132770 wait complete. 2023-08-10T10:54:19.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.782+0000 7f0a611ff700 1 Processor -- start 2023-08-10T10:54:19.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.782+0000 7f0a611ff700 1 -- start start 2023-08-10T10:54:19.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a611ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c102910 0x7f0a5c19e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a611ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a5c1032d0 0x7f0a5c19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a611ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a5c108920 0x7f0a5c198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a611ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c198df0 con 0x7f0a5c102910 2023-08-10T10:54:19.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a611ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c198f60 con 0x7f0a5c1032d0 2023-08-10T10:54:19.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a611ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c199120 con 0x7f0a5c108920 2023-08-10T10:54:19.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a5ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c102910 0x7f0a5c19e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a5ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c102910 0x7f0a5c19e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49256/0 (socket says 172.21.15.107:49256) 2023-08-10T10:54:19.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a5ad9d700 1 -- 172.21.15.107:0/277390201 learned_addr learned my addr 172.21.15.107:0/277390201 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:19.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a5b59e700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a5c108920 0x7f0a5c198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.783+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a5c1032d0 0x7f0a5c19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a5ad9d700 1 -- 172.21.15.107:0/277390201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a5c108920 msgr2=0x7f0a5c198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:19.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a5c108920 0x7f0a5c198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a5ad9d700 1 -- 172.21.15.107:0/277390201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a5c1032d0 msgr2=0x7f0a5c19ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:19.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a5c1032d0 0x7f0a5c19ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a5ad9d700 1 -- 172.21.15.107:0/277390201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54009d00 con 0x7f0a5c102910 2023-08-10T10:54:19.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c102910 0x7f0a5c19e710 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00e9a0 tx=0x7f0a4c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:19.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a43fff700 1 -- 172.21.15.107:0/277390201 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c009790 con 0x7f0a5c102910 2023-08-10T10:54:19.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a611ff700 1 -- 172.21.15.107:0/277390201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c199400 con 0x7f0a5c102910 2023-08-10T10:54:19.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a43fff700 1 -- 172.21.15.107:0/277390201 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a4c010430 con 0x7f0a5c102910 2023-08-10T10:54:19.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a43fff700 1 -- 172.21.15.107:0/277390201 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00cea0 con 0x7f0a5c102910 2023-08-10T10:54:19.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.784+0000 7f0a611ff700 1 -- 172.21.15.107:0/277390201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c1a5700 con 0x7f0a5c102910 2023-08-10T10:54:19.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.788+0000 7f0a43fff700 1 -- 172.21.15.107:0/277390201 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0a4c0105a0 con 0x7f0a5c102910 2023-08-10T10:54:19.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.789+0000 7f0a43fff700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0a440a12c0 0x7f0a440a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.790+0000 7f0a43fff700 1 -- 172.21.15.107:0/277390201 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f0a4c014070 con 0x7f0a5c102910 2023-08-10T10:54:19.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.790+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0a440a12c0 0x7f0a440a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.790+0000 7f0a74a8ab80 1 Processor -- start 2023-08-10T10:54:19.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.790+0000 7f0a74a8ab80 1 -- start start 2023-08-10T10:54:19.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.790+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0a440a12c0 0x7f0a440a3780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c199bf0 tx=0x7f0a50009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:19.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.790+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 0x55ba7738a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.790+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba7738a870 0x55ba773842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77384c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba772ffdc0 con 0x55ba77384800 2023-08-10T10:54:19.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba772dc590 con 0x55ba77389f50 2023-08-10T10:54:19.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba772d9eb0 con 0x55ba7738a870 2023-08-10T10:54:19.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba7738a870 0x55ba773842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77384c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba7738a870 0x55ba773842c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:44906/0 (socket says 172.21.15.107:44906) 2023-08-10T10:54:19.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5a59c700 1 -- 172.21.15.107:0/1343217579 learned_addr learned my addr 172.21.15.107:0/1343217579 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:19.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/1343217579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 0x55ba7738a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5a59c700 1 -- 172.21.15.107:0/1343217579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 msgr2=0x55ba7738a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:19.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/1343217579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 0x55ba7738a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5a59c700 1 -- 172.21.15.107:0/1343217579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 msgr2=0x55ba77384c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:19.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/1343217579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77384c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.791+0000 7f0a5a59c700 1 -- 172.21.15.107:0/1343217579 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba77156630 con 0x55ba7738a870 2023-08-10T10:54:19.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.792+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/1343217579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba7738a870 0x55ba773842c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a50011d50 tx=0x7f0a50014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a709b6e442d675 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:19.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.792+0000 7f0a417fa700 1 -- 172.21.15.107:0/1343217579 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000eb20 con 0x55ba7738a870 2023-08-10T10:54:19.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.792+0000 7f0a417fa700 1 -- 172.21.15.107:0/1343217579 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a50021070 con 0x55ba7738a870 2023-08-10T10:54:19.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.792+0000 7f0a417fa700 1 -- 172.21.15.107:0/1343217579 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5001d410 con 0x55ba7738a870 2023-08-10T10:54:19.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1343217579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba7738a870 msgr2=0x55ba773842c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:19.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1343217579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba7738a870 0x55ba773842c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a50011d50 tx=0x7f0a50014000 comp rx=0 tx=0).stop 2023-08-10T10:54:19.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1343217579 shutdown_connections 2023-08-10T10:54:19.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1343217579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 0x55ba7738a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1343217579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77384c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1343217579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba7738a870 0x55ba773842c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1343217579 >> 172.21.15.107:0/1343217579 conn(0x55ba772e1cd0 msgr2=0x55ba7737f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:19.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1343217579 shutdown_connections 2023-08-10T10:54:19.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1343217579 wait complete. 2023-08-10T10:54:19.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.793+0000 7f0a74a8ab80 1 -- start start 2023-08-10T10:54:19.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.794+0000 7f0a74a8ab80 1 Processor -- start 2023-08-10T10:54:19.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.794+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77384800 0x55ba7738dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.794+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 0x55ba7738e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.794+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba7738a870 0x55ba7738e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.794+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba772d57a0 con 0x55ba7738a870 2023-08-10T10:54:19.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.794+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba77274ac0 con 0x55ba77389f50 2023-08-10T10:54:19.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.794+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba772747c0 con 0x55ba77384800 2023-08-10T10:54:19.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.794+0000 7f0a74a8ab80 10 client.0 _ll_register_callbacks cb 0x55ba77272680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:54:19.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77384800 0x55ba7738dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 0x55ba7738e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77384800 0x55ba7738dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:44918/0 (socket says 172.21.15.107:44918) 2023-08-10T10:54:19.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5ad9d700 1 -- 172.21.15.107:0/748507243 learned_addr learned my addr 172.21.15.107:0/748507243 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:19.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5b59e700 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba7738a870 0x55ba7738e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5a59c700 1 -- 172.21.15.107:0/748507243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77384800 msgr2=0x55ba7738dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:19.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77384800 0x55ba7738dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5a59c700 1 -- 172.21.15.107:0/748507243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba7738a870 msgr2=0x55ba7738e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:19.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba7738a870 0x55ba7738e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5a59c700 1 -- 172.21.15.107:0/748507243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a50017070 con 0x55ba77389f50 2023-08-10T10:54:19.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 0x55ba7738e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000e970 tx=0x7f0a5001cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eabb83e1cec11a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:19.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.795+0000 7f0a3eff5700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:54:19.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.796+0000 7f0a3eff5700 1 -- 172.21.15.107:0/748507243 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000eb20 con 0x55ba77389f50 2023-08-10T10:54:19.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.796+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/748507243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba77377470 con 0x55ba77389f50 2023-08-10T10:54:19.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.796+0000 7f0a3eff5700 1 -- 172.21.15.107:0/748507243 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f0a5000ec80 con 0x55ba77389f50 2023-08-10T10:54:19.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.796+0000 7f0a3eff5700 1 -- 172.21.15.107:0/748507243 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a5000ee40 con 0x55ba77389f50 2023-08-10T10:54:19.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.796+0000 7f0a74a8ab80 10 client.26117 fetch_fsmap learned FSMap version 32 2023-08-10T10:54:19.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.796+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/748507243 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ba77102de0 con 0x55ba77389f50 2023-08-10T10:54:19.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.797+0000 7f0a3eff5700 1 -- 172.21.15.107:0/748507243 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba77377470 con 0x55ba77389f50 2023-08-10T10:54:19.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.797+0000 7f0a3eff5700 1 -- 172.21.15.107:0/748507243 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f0a50003680 con 0x55ba77389f50 2023-08-10T10:54:19.803 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.797+0000 7f0a74a8ab80 10 client.26117 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:54:19.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.797+0000 7f0a74a8ab80 10 client.26117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:54:19.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.797+0000 7f0a74a8ab80 20 client.26117 populate_metadata read hostname 'smithi107' 2023-08-10T10:54:19.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.797+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ba7739e3b0 0x55ba773a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.797+0000 7f0a74a8ab80 4 client.26117 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:54:19.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.797+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/748507243 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba773539d0 con 0x55ba7739e3b0 2023-08-10T10:54:19.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.797+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ba7739e3b0 0x55ba773a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.798+0000 7f0a3eff5700 10 client.26117 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:54:19.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.798+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ba7739e3b0 0x55ba773a07d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57dcea3471b5f166 server_cookie=e5cf357f76497338 in_seq=0 out_seq=0 2023-08-10T10:54:19.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a3eff5700 1 -- 172.21.15.107:0/748507243 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ba773539d0 con 0x55ba7739e3b0 2023-08-10T10:54:19.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a3eff5700 10 client.26117 handle_command_reply: tid=0 2023-08-10T10:54:19.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 client.26117 shutdown 2023-08-10T10:54:19.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/748507243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 msgr2=0x55ba7738e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:19.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 0x55ba7738e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000e970 tx=0x7f0a5001cb80 comp rx=0 tx=0).stop 2023-08-10T10:54:19.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/748507243 shutdown_connections 2023-08-10T10:54:19.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ba7739e3b0 0x55ba773a07d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba7738a870 0x55ba7738e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a3eff5700 0 client.26117 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:54:19.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77384800 0x55ba7738dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/748507243 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba77389f50 0x55ba7738e130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/748507243 >> 172.21.15.107:0/748507243 conn(0x55ba772e1cd0 msgr2=0x55ba7737e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:19.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/748507243 shutdown_connections 2023-08-10T10:54:19.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/748507243 wait complete. 2023-08-10T10:54:19.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.799+0000 7f0a74a8ab80 20 client.26117 trim_cache size 0 max 16384 2023-08-10T10:54:19.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.821+0000 7f0a74a8ab80 1 Processor -- start 2023-08-10T10:54:19.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.821+0000 7f0a74a8ab80 1 -- start start 2023-08-10T10:54:19.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba773842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba7738cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 0x55ba77395360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba77158920 con 0x55ba77384800 2023-08-10T10:54:19.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba7738bc60 con 0x55ba7738a870 2023-08-10T10:54:19.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba7737f9f0 con 0x55ba77389f50 2023-08-10T10:54:19.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a5ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba773842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a5a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba7738cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a5a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba7738cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:44934/0 (socket says 172.21.15.107:44934) 2023-08-10T10:54:19.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a5ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba773842c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49282/0 (socket says 172.21.15.107:49282) 2023-08-10T10:54:19.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a5a59c700 1 -- 172.21.15.107:0/4201074604 learned_addr learned my addr 172.21.15.107:0/4201074604 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:19.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a5b59e700 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 0x55ba77395360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.822+0000 7f0a5a59c700 1 -- 172.21.15.107:0/4201074604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 msgr2=0x55ba77395360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:19.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 0x55ba77395360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a5a59c700 1 -- 172.21.15.107:0/4201074604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 msgr2=0x55ba773842c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:19.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba773842c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a5a59c700 1 -- 172.21.15.107:0/4201074604 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba7738d7a0 con 0x55ba77389f50 2023-08-10T10:54:19.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba773842c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:54:19.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a5b59e700 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 0x55ba77395360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:54:19.826 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba7738cf30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a5001cfc0 tx=0x7f0a5001ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eef3ddc95cfffffd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:19.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a41ffb700 1 -- 172.21.15.107:0/4201074604 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50003680 con 0x55ba77389f50 2023-08-10T10:54:19.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a41ffb700 1 -- 172.21.15.107:0/4201074604 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a500037e0 con 0x55ba77389f50 2023-08-10T10:54:19.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.823+0000 7f0a41ffb700 1 -- 172.21.15.107:0/4201074604 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a500050b0 con 0x55ba77389f50 2023-08-10T10:54:19.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.824+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/4201074604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 msgr2=0x55ba7738cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:19.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.824+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba7738cf30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a5001cfc0 tx=0x7f0a5001ca60 comp rx=0 tx=0).stop 2023-08-10T10:54:19.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.824+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/4201074604 shutdown_connections 2023-08-10T10:54:19.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.824+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 0x55ba77395360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.824+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba773842c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.824+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/4201074604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba7738cf30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.824+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/4201074604 >> 172.21.15.107:0/4201074604 conn(0x55ba772e1cd0 msgr2=0x55ba77387d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:19.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.824+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/4201074604 shutdown_connections 2023-08-10T10:54:19.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.824+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/4201074604 wait complete. 2023-08-10T10:54:19.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.825+0000 7f0a74a8ab80 1 -- start start 2023-08-10T10:54:19.830 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.825+0000 7f0a74a8ab80 1 Processor -- start 2023-08-10T10:54:19.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.825+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77393350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.825+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba77393890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.825+0000 7f0a74a8ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 0x55ba773f1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.825+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba773940d0 con 0x55ba77384800 2023-08-10T10:54:19.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.825+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba773f1560 con 0x55ba7738a870 2023-08-10T10:54:19.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.825+0000 7f0a74a8ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba773f16a0 con 0x55ba77389f50 2023-08-10T10:54:19.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.825+0000 7f0a74a8ab80 10 client.0 _ll_register_callbacks cb 0x55ba77272680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:54:19.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77393350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77393350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49286/0 (socket says 172.21.15.107:49286) 2023-08-10T10:54:19.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5ad9d700 1 -- 172.21.15.107:0/1499738892 learned_addr learned my addr 172.21.15.107:0/1499738892 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:19.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba77393890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5b59e700 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 0x55ba773f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5ad9d700 1 -- 172.21.15.107:0/1499738892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 msgr2=0x55ba77393890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:19.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba77393890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5ad9d700 1 -- 172.21.15.107:0/1499738892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 msgr2=0x55ba773f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:19.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 0x55ba773f1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5ad9d700 1 -- 172.21.15.107:0/1499738892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c1a5700 con 0x55ba77384800 2023-08-10T10:54:19.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba77393890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:54:19.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a5ad9d700 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77393350 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00c2d0 tx=0x7f0a4c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471c80b9a41d71a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:19.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.826+0000 7f0a3eff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:54:19.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a3eff5700 1 -- 172.21.15.107:0/1499738892 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c09dfc0 con 0x55ba77384800 2023-08-10T10:54:19.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1499738892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a50021070 con 0x55ba77384800 2023-08-10T10:54:19.833 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a3eff5700 1 -- 172.21.15.107:0/1499738892 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f0a4c0b6030 con 0x55ba77384800 2023-08-10T10:54:19.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a3eff5700 1 -- 172.21.15.107:0/1499738892 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4c0a23e0 con 0x55ba77384800 2023-08-10T10:54:19.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a74a8ab80 10 client.16452 fetch_fsmap learned FSMap version 32 2023-08-10T10:54:19.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1499738892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ba77102de0 con 0x55ba77384800 2023-08-10T10:54:19.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a3eff5700 1 -- 172.21.15.107:0/1499738892 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a50021070 con 0x55ba77384800 2023-08-10T10:54:19.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a3eff5700 1 -- 172.21.15.107:0/1499738892 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f0a4c099480 con 0x55ba77384800 2023-08-10T10:54:19.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a74a8ab80 10 client.16452 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:54:19.834 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a74a8ab80 10 client.16452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:54:19.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a74a8ab80 20 client.16452 populate_metadata read hostname 'smithi107' 2023-08-10T10:54:19.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ba773f2da0 0x55ba773f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:19.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a74a8ab80 4 client.16452 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:54:19.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.827+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1499738892 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ba772ce780 con 0x55ba773f2da0 2023-08-10T10:54:19.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.828+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ba773f2da0 0x55ba773f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:19.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.828+0000 7f0a3eff5700 10 client.16452 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:54:19.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.828+0000 7f0a5a59c700 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ba773f2da0 0x55ba773f51c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a493b413a7dabe24 server_cookie=5f5f97c0fc4b0937 in_seq=0 out_seq=0 2023-08-10T10:54:19.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a3eff5700 1 -- 172.21.15.107:0/1499738892 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ba772ce780 con 0x55ba773f2da0 2023-08-10T10:54:19.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a3eff5700 10 client.16452 handle_command_reply: tid=0 2023-08-10T10:54:19.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 client.16452 shutdown 2023-08-10T10:54:19.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1499738892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 msgr2=0x55ba77393350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:19.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77393350 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00c2d0 tx=0x7f0a4c01a040 comp rx=0 tx=0).stop 2023-08-10T10:54:19.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1499738892 shutdown_connections 2023-08-10T10:54:19.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ba773f2da0 0x55ba773f51c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ba7738a870 0x55ba773f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ba77384800 0x55ba77393350 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 --2- 172.21.15.107:0/1499738892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ba77389f50 0x55ba77393890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1499738892 >> 172.21.15.107:0/1499738892 conn(0x55ba772e1cd0 msgr2=0x55ba7738ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:19.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a3eff5700 0 client.16452 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:54:19.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1499738892 shutdown_connections 2023-08-10T10:54:19.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 1 -- 172.21.15.107:0/1499738892 wait complete. 2023-08-10T10:54:19.838 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.829+0000 7f0a74a8ab80 20 client.16452 trim_cache size 0 max 16384 2023-08-10T10:54:19.839 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:54:19.839 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:54:19.839 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:54:19.839 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:54:19.839 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:54:19.839 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:54:19.839 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:54:19.839 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:54:19.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:54:19.840 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:54:19.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 -- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0a440a12c0 msgr2=0x7f0a440a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:19.840 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0a440a12c0 0x7f0a440a3780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c199bf0 tx=0x7f0a50009260 comp rx=0 tx=0).stop 2023-08-10T10:54:19.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 -- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c102910 msgr2=0x7f0a5c19e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:19.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c102910 0x7f0a5c19e710 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00e9a0 tx=0x7f0a4c00ecb0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 -- 172.21.15.107:0/277390201 shutdown_connections 2023-08-10T10:54:19.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a5c108920 0x7f0a5c198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a5c102910 0x7f0a5c19e710 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0a440a12c0 0x7f0a440a3780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.841 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 --2- 172.21.15.107:0/277390201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a5c1032d0 0x7f0a5c19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:19.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 -- 172.21.15.107:0/277390201 >> 172.21.15.107:0/277390201 conn(0x7f0a5c0fe400 msgr2=0x7f0a5c0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:19.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 -- 172.21.15.107:0/277390201 shutdown_connections 2023-08-10T10:54:19.842 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:19.830+0000 7f0a611ff700 1 -- 172.21.15.107:0/277390201 wait complete. 2023-08-10T10:54:19.850 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:54:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:19 smithi157 ceph-mon[129604]: pgmap v96: 129 pgs: 129 active+clean; 2.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 37 MiB/s wr, 57 op/s 2023-08-10T10:54:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:19 smithi107 ceph-mon[127953]: pgmap v96: 129 pgs: 129 active+clean; 2.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 37 MiB/s wr, 57 op/s 2023-08-10T10:54:20.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:19 smithi195 ceph-mon[129938]: pgmap v96: 129 pgs: 129 active+clean; 2.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 37 MiB/s wr, 57 op/s 2023-08-10T10:54:20.649 INFO:teuthology.orchestra.run.smithi107.stderr:10500000 of 50000000 tuples (21%) done (elapsed 158.83 s, remaining 597.49 s) 2023-08-10T10:54:21.974 INFO:teuthology.orchestra.run.smithi107.stderr:10600000 of 50000000 tuples (21%) done (elapsed 160.15 s, remaining 595.28 s) 2023-08-10T10:54:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:21 smithi157 ceph-mon[129604]: pgmap v97: 129 pgs: 129 active+clean; 2.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:54:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:21 smithi107 ceph-mon[127953]: pgmap v97: 129 pgs: 129 active+clean; 2.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:54:22.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:21 smithi195 ceph-mon[129938]: pgmap v97: 129 pgs: 129 active+clean; 2.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:54:23.189 INFO:teuthology.orchestra.run.smithi107.stderr:10700000 of 50000000 tuples (21%) done (elapsed 161.37 s, remaining 592.68 s) 2023-08-10T10:54:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:23 smithi157 ceph-mon[129604]: pgmap v98: 129 pgs: 129 active+clean; 2.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:54:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:23 smithi107 ceph-mon[127953]: pgmap v98: 129 pgs: 129 active+clean; 2.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:54:24.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:23 smithi195 ceph-mon[129938]: pgmap v98: 129 pgs: 129 active+clean; 2.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:54:24.423 INFO:teuthology.orchestra.run.smithi107.stderr:10800000 of 50000000 tuples (21%) done (elapsed 162.60 s, remaining 590.18 s) 2023-08-10T10:54:25.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:24 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:54:25.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:24 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:54:25.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:24 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:54:25.673 INFO:teuthology.orchestra.run.smithi107.stderr:10900000 of 50000000 tuples (21%) done (elapsed 163.85 s, remaining 587.76 s) 2023-08-10T10:54:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:25 smithi157 ceph-mon[129604]: pgmap v99: 129 pgs: 129 active+clean; 2.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 36 MiB/s wr, 54 op/s 2023-08-10T10:54:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:25 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:54:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:25 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:54:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:25 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:54:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:25 smithi107 ceph-mon[127953]: pgmap v99: 129 pgs: 129 active+clean; 2.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 36 MiB/s wr, 54 op/s 2023-08-10T10:54:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:25 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:54:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:25 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:54:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:25 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:54:26.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:25 smithi195 ceph-mon[129938]: pgmap v99: 129 pgs: 129 active+clean; 2.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 36 MiB/s wr, 54 op/s 2023-08-10T10:54:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:25 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:54:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:25 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:54:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:25 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:54:26.861 INFO:teuthology.orchestra.run.smithi107.stderr:11000000 of 50000000 tuples (22%) done (elapsed 165.04 s, remaining 585.14 s) 2023-08-10T10:54:28.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:27 smithi157 ceph-mon[129604]: pgmap v100: 129 pgs: 129 active+clean; 2.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 23 op/s 2023-08-10T10:54:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:27 smithi107 ceph-mon[127953]: pgmap v100: 129 pgs: 129 active+clean; 2.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 23 op/s 2023-08-10T10:54:28.155 INFO:teuthology.orchestra.run.smithi107.stderr:11100000 of 50000000 tuples (22%) done (elapsed 166.33 s, remaining 582.92 s) 2023-08-10T10:54:28.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:27 smithi195 ceph-mon[129938]: pgmap v100: 129 pgs: 129 active+clean; 2.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 23 op/s 2023-08-10T10:54:29.362 INFO:teuthology.orchestra.run.smithi107.stderr:11200000 of 50000000 tuples (22%) done (elapsed 167.54 s, remaining 580.41 s) 2023-08-10T10:54:30.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:29 smithi157 ceph-mon[129604]: pgmap v101: 129 pgs: 129 active+clean; 2.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 36 MiB/s wr, 33 op/s 2023-08-10T10:54:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:29 smithi107 ceph-mon[127953]: pgmap v101: 129 pgs: 129 active+clean; 2.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 36 MiB/s wr, 33 op/s 2023-08-10T10:54:30.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:29 smithi195 ceph-mon[129938]: pgmap v101: 129 pgs: 129 active+clean; 2.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 36 MiB/s wr, 33 op/s 2023-08-10T10:54:30.543 INFO:teuthology.orchestra.run.smithi107.stderr:11300000 of 50000000 tuples (22%) done (elapsed 168.72 s, remaining 577.83 s) 2023-08-10T10:54:31.722 INFO:teuthology.orchestra.run.smithi107.stderr:11400000 of 50000000 tuples (22%) done (elapsed 169.90 s, remaining 575.27 s) 2023-08-10T10:54:32.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:31 smithi157 ceph-mon[129604]: pgmap v102: 129 pgs: 129 active+clean; 2.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-08-10T10:54:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:31 smithi107 ceph-mon[127953]: pgmap v102: 129 pgs: 129 active+clean; 2.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-08-10T10:54:32.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:31 smithi195 ceph-mon[129938]: pgmap v102: 129 pgs: 129 active+clean; 2.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-08-10T10:54:33.018 INFO:teuthology.orchestra.run.smithi107.stderr:11500000 of 50000000 tuples (23%) done (elapsed 171.20 s, remaining 573.13 s) 2023-08-10T10:54:34.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:33 smithi157 ceph-mon[129604]: pgmap v103: 129 pgs: 129 active+clean; 2.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-08-10T10:54:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:33 smithi107 ceph-mon[127953]: pgmap v103: 129 pgs: 129 active+clean; 2.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-08-10T10:54:34.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:33 smithi195 ceph-mon[129938]: pgmap v103: 129 pgs: 129 active+clean; 2.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-08-10T10:54:34.194 INFO:teuthology.orchestra.run.smithi107.stderr:11600000 of 50000000 tuples (23%) done (elapsed 172.37 s, remaining 570.61 s) 2023-08-10T10:54:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:11700000 of 50000000 tuples (23%) done (elapsed 173.59 s, remaining 568.25 s) 2023-08-10T10:54:36.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:35 smithi157 ceph-mon[129604]: pgmap v104: 129 pgs: 129 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 31 op/s 2023-08-10T10:54:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:35 smithi107 ceph-mon[127953]: pgmap v104: 129 pgs: 129 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 31 op/s 2023-08-10T10:54:36.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:35 smithi195 ceph-mon[129938]: pgmap v104: 129 pgs: 129 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 31 op/s 2023-08-10T10:54:36.686 INFO:teuthology.orchestra.run.smithi107.stderr:11800000 of 50000000 tuples (23%) done (elapsed 174.86 s, remaining 566.08 s) 2023-08-10T10:54:37.878 INFO:teuthology.orchestra.run.smithi107.stderr:11900000 of 50000000 tuples (23%) done (elapsed 176.06 s, remaining 563.67 s) 2023-08-10T10:54:38.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:37 smithi157 ceph-mon[129604]: pgmap v105: 129 pgs: 129 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-08-10T10:54:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:37 smithi107 ceph-mon[127953]: pgmap v105: 129 pgs: 129 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-08-10T10:54:38.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:37 smithi195 ceph-mon[129938]: pgmap v105: 129 pgs: 129 active+clean; 2.7 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-08-10T10:54:39.068 INFO:teuthology.orchestra.run.smithi107.stderr:12000000 of 50000000 tuples (24%) done (elapsed 177.25 s, remaining 561.28 s) 2023-08-10T10:54:40.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:39 smithi157 ceph-mon[129604]: pgmap v106: 129 pgs: 129 active+clean; 2.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-08-10T10:54:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:39 smithi107 ceph-mon[127953]: pgmap v106: 129 pgs: 129 active+clean; 2.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-08-10T10:54:40.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:39 smithi195 ceph-mon[129938]: pgmap v106: 129 pgs: 129 active+clean; 2.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-08-10T10:54:40.350 INFO:teuthology.orchestra.run.smithi107.stderr:12100000 of 50000000 tuples (24%) done (elapsed 178.53 s, remaining 559.19 s) 2023-08-10T10:54:41.562 INFO:teuthology.orchestra.run.smithi107.stderr:12200000 of 50000000 tuples (24%) done (elapsed 179.74 s, remaining 556.90 s) 2023-08-10T10:54:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:41 smithi157 ceph-mon[129604]: pgmap v107: 129 pgs: 129 active+clean; 2.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:54:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:41 smithi107 ceph-mon[127953]: pgmap v107: 129 pgs: 129 active+clean; 2.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:54:42.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:41 smithi195 ceph-mon[129938]: pgmap v107: 129 pgs: 129 active+clean; 2.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:54:42.790 INFO:teuthology.orchestra.run.smithi107.stderr:12300000 of 50000000 tuples (24%) done (elapsed 180.97 s, remaining 554.67 s) 2023-08-10T10:54:44.006 INFO:teuthology.orchestra.run.smithi107.stderr:12400000 of 50000000 tuples (24%) done (elapsed 182.18 s, remaining 552.43 s) 2023-08-10T10:54:44.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:43 smithi157 ceph-mon[129604]: pgmap v108: 129 pgs: 129 active+clean; 2.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:54:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:43 smithi107 ceph-mon[127953]: pgmap v108: 129 pgs: 129 active+clean; 2.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:54:44.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:43 smithi195 ceph-mon[129938]: pgmap v108: 129 pgs: 129 active+clean; 2.8 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:54:45.280 INFO:teuthology.orchestra.run.smithi107.stderr:12500000 of 50000000 tuples (25%) done (elapsed 183.46 s, remaining 550.37 s) 2023-08-10T10:54:46.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:45 smithi157 ceph-mon[129604]: pgmap v109: 129 pgs: 129 active+clean; 2.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 37 MiB/s wr, 34 op/s 2023-08-10T10:54:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:45 smithi107 ceph-mon[127953]: pgmap v109: 129 pgs: 129 active+clean; 2.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 37 MiB/s wr, 34 op/s 2023-08-10T10:54:46.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:45 smithi195 ceph-mon[129938]: pgmap v109: 129 pgs: 129 active+clean; 2.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 37 MiB/s wr, 34 op/s 2023-08-10T10:54:46.466 INFO:teuthology.orchestra.run.smithi107.stderr:12600000 of 50000000 tuples (25%) done (elapsed 184.64 s, remaining 548.07 s) 2023-08-10T10:54:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:12700000 of 50000000 tuples (25%) done (elapsed 185.84 s, remaining 545.82 s) 2023-08-10T10:54:48.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:47 smithi157 ceph-mon[129604]: pgmap v110: 129 pgs: 129 active+clean; 2.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 23 op/s 2023-08-10T10:54:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:47 smithi107 ceph-mon[127953]: pgmap v110: 129 pgs: 129 active+clean; 2.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 23 op/s 2023-08-10T10:54:48.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:47 smithi195 ceph-mon[129938]: pgmap v110: 129 pgs: 129 active+clean; 2.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 23 op/s 2023-08-10T10:54:48.865 INFO:teuthology.orchestra.run.smithi107.stderr:12800000 of 50000000 tuples (25%) done (elapsed 187.04 s, remaining 543.59 s) 2023-08-10T10:54:49.851 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:54:50.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:49 smithi157 ceph-mon[129604]: pgmap v111: 129 pgs: 129 active+clean; 3.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 35 op/s 2023-08-10T10:54:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:49 smithi107 ceph-mon[127953]: pgmap v111: 129 pgs: 129 active+clean; 3.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 35 op/s 2023-08-10T10:54:50.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.080+0000 7f2f1bbff700 1 -- 172.21.15.107:0/403431554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14108920 msgr2=0x7f2f14108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:50.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.080+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/403431554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14108920 0x7f2f14108d00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009990 tx=0x7f2f10009ca0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.080+0000 7f2f1bbff700 1 -- 172.21.15.107:0/403431554 shutdown_connections 2023-08-10T10:54:50.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.080+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/403431554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f141032d0 0x7f2f1410f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.080+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/403431554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14108920 0x7f2f14108d00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.080+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/403431554 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f14102910 0x7f2f14102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.080+0000 7f2f1bbff700 1 -- 172.21.15.107:0/403431554 >> 172.21.15.107:0/403431554 conn(0x7f2f140fe3c0 msgr2=0x7f2f141007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:50.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.080+0000 7f2f1bbff700 1 -- 172.21.15.107:0/403431554 shutdown_connections 2023-08-10T10:54:50.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.080+0000 7f2f1bbff700 1 -- 172.21.15.107:0/403431554 wait complete. 2023-08-10T10:54:50.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.082+0000 7f2f1bbff700 1 Processor -- start 2023-08-10T10:54:50.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.082+0000 7f2f1bbff700 1 -- start start 2023-08-10T10:54:50.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.082+0000 7f2f1bbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14102910 0x7f2f1419e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.082+0000 7f2f1bbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f141032d0 0x7f2f1419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.082+0000 7f2f1bbff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f14108920 0x7f2f14198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.082+0000 7f2f1bbff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f14198da0 con 0x7f2f14108920 2023-08-10T10:54:50.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.082+0000 7f2f1bbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f14198f10 con 0x7f2f141032d0 2023-08-10T10:54:50.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.082+0000 7f2f1bbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f141990d0 con 0x7f2f14102910 2023-08-10T10:54:50.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1a19c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f14108920 0x7f2f14198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1999b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14102910 0x7f2f1419e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1999b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14102910 0x7f2f1419e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:41680/0 (socket says 172.21.15.107:41680) 2023-08-10T10:54:50.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1999b700 1 -- 172.21.15.107:0/3935483486 learned_addr learned my addr 172.21.15.107:0/3935483486 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:50.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1919a700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f141032d0 0x7f2f1419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1a19c700 1 -- 172.21.15.107:0/3935483486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14102910 msgr2=0x7f2f1419e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:50.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1a19c700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14102910 0x7f2f1419e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1a19c700 1 -- 172.21.15.107:0/3935483486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f141032d0 msgr2=0x7f2f1419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:50.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1a19c700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f141032d0 0x7f2f1419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1a19c700 1 -- 172.21.15.107:0/3935483486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c009c40 con 0x7f2f14108920 2023-08-10T10:54:50.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1919a700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f141032d0 0x7f2f1419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:54:50.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1999b700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14102910 0x7f2f1419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:54:50.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.083+0000 7f2f1a19c700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f14108920 0x7f2f14198730 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00efb0 tx=0x7f2f0c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:50.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.084+0000 7f2f0affd700 1 -- 172.21.15.107:0/3935483486 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00ca50 con 0x7f2f14108920 2023-08-10T10:54:50.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.084+0000 7f2f0affd700 1 -- 172.21.15.107:0/3935483486 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f0c00f040 con 0x7f2f14108920 2023-08-10T10:54:50.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.084+0000 7f2f1bbff700 1 -- 172.21.15.107:0/3935483486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f100095f0 con 0x7f2f14108920 2023-08-10T10:54:50.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.084+0000 7f2f0affd700 1 -- 172.21.15.107:0/3935483486 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0045c0 con 0x7f2f14108920 2023-08-10T10:54:50.089 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.084+0000 7f2f1bbff700 1 -- 172.21.15.107:0/3935483486 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f141a54d0 con 0x7f2f14108920 2023-08-10T10:54:50.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.087+0000 7f2f0affd700 1 -- 172.21.15.107:0/3935483486 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2f0c00ccb0 con 0x7f2f14108920 2023-08-10T10:54:50.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.088+0000 7f2f2f4a3b80 1 Processor -- start 2023-08-10T10:54:50.090 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.089+0000 7f2f2f4a3b80 1 -- start start 2023-08-10T10:54:50.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.089+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4ff50 0x56419ba50330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.091 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.089+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba4a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.089+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4a800 0x56419ba4ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.089+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419b9c5dc0 con 0x56419ba4ff50 2023-08-10T10:54:50.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.089+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419b9a2590 con 0x56419ba4a800 2023-08-10T10:54:50.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.089+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419b99feb0 con 0x56419ba50870 2023-08-10T10:54:50.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.089+0000 7f2f0affd700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2f000a1340 0x7f2f000a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.089+0000 7f2f1919a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4ff50 0x56419ba50330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.092 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1999b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba4a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1919a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4ff50 0x56419ba50330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41726/0 (socket says 172.21.15.107:41726) 2023-08-10T10:54:50.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1919a700 1 -- 172.21.15.107:0/1772176624 learned_addr learned my addr 172.21.15.107:0/1772176624 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:50.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f0affd700 1 -- 172.21.15.107:0/3935483486 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f2f0c0ccbf0 con 0x7f2f14108920 2023-08-10T10:54:50.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1919a700 1 --2- 172.21.15.107:0/1772176624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4a800 0x56419ba4ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1a19c700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2f000a1340 0x7f2f000a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1999b700 1 -- 172.21.15.107:0/1772176624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4a800 msgr2=0x56419ba4ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:50.093 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1999b700 1 --2- 172.21.15.107:0/1772176624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4a800 0x56419ba4ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1999b700 1 -- 172.21.15.107:0/1772176624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4ff50 msgr2=0x56419ba50330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:50.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1999b700 1 --2- 172.21.15.107:0/1772176624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4ff50 0x56419ba50330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1999b700 1 -- 172.21.15.107:0/1772176624 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56419b81c630 con 0x56419ba50870 2023-08-10T10:54:50.094 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.090+0000 7f2f1999b700 1 --2- 172.21.15.107:0/1772176624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba4a2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2f100059d0 tx=0x7f2f10005c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a20dd281ead6cba server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:50.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.091+0000 7f2f1a19c700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2f000a1340 0x7f2f000a3800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0ca040 tx=0x7f2f0c00c8d0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:50.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.091+0000 7f2efffff700 1 -- 172.21.15.107:0/1772176624 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1001d050 con 0x56419ba50870 2023-08-10T10:54:50.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.091+0000 7f2efffff700 1 -- 172.21.15.107:0/1772176624 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f1001e040 con 0x56419ba50870 2023-08-10T10:54:50.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.091+0000 7f2efffff700 1 -- 172.21.15.107:0/1772176624 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10005410 con 0x56419ba50870 2023-08-10T10:54:50.096 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.091+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/1772176624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 msgr2=0x56419ba4a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.091+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/1772176624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba4a2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2f100059d0 tx=0x7f2f10005c40 comp rx=0 tx=0).stop 2023-08-10T10:54:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.092+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/1772176624 shutdown_connections 2023-08-10T10:54:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.092+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/1772176624 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4a800 0x56419ba4ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.092+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/1772176624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4ff50 0x56419ba50330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.092+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/1772176624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba4a2c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.092+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/1772176624 >> 172.21.15.107:0/1772176624 conn(0x56419b9a7cd0 msgr2=0x56419ba454d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.092+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/1772176624 shutdown_connections 2023-08-10T10:54:50.097 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.092+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/1772176624 wait complete. 2023-08-10T10:54:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.092+0000 7f2f2f4a3b80 1 -- start start 2023-08-10T10:54:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.093+0000 7f2f2f4a3b80 1 Processor -- start 2023-08-10T10:54:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.093+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba56810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.093+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 0x56419ba53b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.093+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba54130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.093+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419b99b7a0 con 0x56419ba4a800 2023-08-10T10:54:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.093+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419b93aac0 con 0x56419ba4ff50 2023-08-10T10:54:50.098 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.093+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419b93a7c0 con 0x56419ba50870 2023-08-10T10:54:50.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.093+0000 7f2f2f4a3b80 10 client.0 _ll_register_callbacks cb 0x56419b938680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:54:50.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.093+0000 7f2f1919a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba56810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1919a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba56810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41740/0 (socket says 172.21.15.107:41740) 2023-08-10T10:54:50.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1919a700 1 -- 172.21.15.107:0/447580552 learned_addr learned my addr 172.21.15.107:0/447580552 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:50.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1999b700 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 0x56419ba53b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1919a700 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba54130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.099 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1919a700 1 -- 172.21.15.107:0/447580552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 msgr2=0x56419ba54130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:50.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1919a700 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba54130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1919a700 1 -- 172.21.15.107:0/447580552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 msgr2=0x56419ba53b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:50.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1919a700 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 0x56419ba53b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1919a700 1 -- 172.21.15.107:0/447580552 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f141100e0 con 0x56419ba4a800 2023-08-10T10:54:50.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f1919a700 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba56810 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009610 tx=0x7f2f04009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51df1eacd73342f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:50.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2efd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:54:50.100 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2efd7fa700 1 -- 172.21.15.107:0/447580552 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400db40 con 0x56419ba4a800 2023-08-10T10:54:50.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/447580552 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56419ba3d470 con 0x56419ba4a800 2023-08-10T10:54:50.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.094+0000 7f2efd7fa700 1 -- 172.21.15.107:0/447580552 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f2f0400dca0 con 0x56419ba4a800 2023-08-10T10:54:50.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2efd7fa700 1 -- 172.21.15.107:0/447580552 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f0400de60 con 0x56419ba4a800 2023-08-10T10:54:50.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2f2f4a3b80 10 client.16464 fetch_fsmap learned FSMap version 32 2023-08-10T10:54:50.101 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/447580552 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56419b7c8de0 con 0x56419ba4a800 2023-08-10T10:54:50.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2efd7fa700 1 -- 172.21.15.107:0/447580552 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56419ba3d470 con 0x56419ba4a800 2023-08-10T10:54:50.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2efd7fa700 1 -- 172.21.15.107:0/447580552 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f2f04003a30 con 0x56419ba4a800 2023-08-10T10:54:50.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2f2f4a3b80 10 client.16464 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:54:50.103 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2f2f4a3b80 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:54:50.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2f2f4a3b80 20 client.16464 populate_metadata read hostname 'smithi107' 2023-08-10T10:54:50.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56419ba64240 0x56419ba66660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2f2f4a3b80 4 client.16464 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:54:50.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.095+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/447580552 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56419ba199d0 con 0x56419ba64240 2023-08-10T10:54:50.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.096+0000 7f2f1999b700 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56419ba64240 0x56419ba66660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.097+0000 7f2f1999b700 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56419ba64240 0x56419ba66660 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23c32241b0f0136a server_cookie=367435913501abb7 in_seq=0 out_seq=0 2023-08-10T10:54:50.104 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.097+0000 7f2efd7fa700 10 client.16464 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:54:50.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.097+0000 7f2efd7fa700 1 -- 172.21.15.107:0/447580552 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56419ba199d0 con 0x56419ba64240 2023-08-10T10:54:50.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.097+0000 7f2efd7fa700 10 client.16464 handle_command_reply: tid=0 2023-08-10T10:54:50.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.097+0000 7f2f2f4a3b80 1 client.16464 shutdown 2023-08-10T10:54:50.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/447580552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 msgr2=0x56419ba56810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:50.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba56810 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009610 tx=0x7f2f04009260 comp rx=0 tx=0).stop 2023-08-10T10:54:50.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/447580552 shutdown_connections 2023-08-10T10:54:50.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56419ba64240 0x56419ba66660 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba54130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba56810 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2efd7fa700 0 client.16464 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:54:50.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/447580552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 0x56419ba53b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/447580552 >> 172.21.15.107:0/447580552 conn(0x56419b9a7cd0 msgr2=0x56419ba449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:50.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/447580552 shutdown_connections 2023-08-10T10:54:50.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/447580552 wait complete. 2023-08-10T10:54:50.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.098+0000 7f2f2f4a3b80 20 client.16464 trim_cache size 0 max 16384 2023-08-10T10:54:50.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f2f4a3b80 1 Processor -- start 2023-08-10T10:54:50.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f2f4a3b80 1 -- start start 2023-08-10T10:54:50.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 0x56419ba45130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.123 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba45670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419b81e920 con 0x56419ba4a800 2023-08-10T10:54:50.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419ba41f80 con 0x56419ba4ff50 2023-08-10T10:54:50.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419ba550a0 con 0x56419ba50870 2023-08-10T10:54:50.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f1919a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f1919a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41744/0 (socket says 172.21.15.107:41744) 2023-08-10T10:54:50.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f1919a700 1 -- 172.21.15.107:0/862736362 learned_addr learned my addr 172.21.15.107:0/862736362 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:50.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.118+0000 7f2f1999b700 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 0x56419ba45130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f1919a700 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba45670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f1919a700 1 -- 172.21.15.107:0/862736362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 msgr2=0x56419ba45670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:50.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f1919a700 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba45670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f1919a700 1 -- 172.21.15.107:0/862736362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 msgr2=0x56419ba45130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:50.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f1919a700 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 0x56419ba45130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f1919a700 1 -- 172.21.15.107:0/862736362 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56419b7b1c60 con 0x56419ba4a800 2023-08-10T10:54:50.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f1999b700 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 0x56419ba45130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:54:50.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f1919a700 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4f3c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009f20 tx=0x7f2f040092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee9cb7072b1be28 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f08bff700 1 -- 172.21.15.107:0/862736362 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04020350 con 0x56419ba4a800 2023-08-10T10:54:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f08bff700 1 -- 172.21.15.107:0/862736362 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f040204b0 con 0x56419ba4a800 2023-08-10T10:54:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.119+0000 7f2f08bff700 1 -- 172.21.15.107:0/862736362 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040039f0 con 0x56419ba4a800 2023-08-10T10:54:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.120+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/862736362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 msgr2=0x56419ba4f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.120+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4f3c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009f20 tx=0x7f2f040092d0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.120+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/862736362 shutdown_connections 2023-08-10T10:54:50.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.120+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba50870 0x56419ba45670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.120+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4f3c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.120+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/862736362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba4ff50 0x56419ba45130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.120+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/862736362 >> 172.21.15.107:0/862736362 conn(0x56419b9a7cd0 msgr2=0x56419ba492b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.120+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/862736362 shutdown_connections 2023-08-10T10:54:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.120+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/862736362 wait complete. 2023-08-10T10:54:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.121+0000 7f2f2f4a3b80 1 -- start start 2023-08-10T10:54:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.121+0000 7f2f2f4a3b80 1 Processor -- start 2023-08-10T10:54:50.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.121+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.121+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba4ff50 0x56419ba4c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.121+0000 7f2f2f4a3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba50870 0x56419ba4c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.121+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419ba5b7c0 con 0x56419ba4a800 2023-08-10T10:54:50.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.121+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419bab7ed0 con 0x56419ba50870 2023-08-10T10:54:50.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.121+0000 7f2f2f4a3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419bab8010 con 0x56419ba4ff50 2023-08-10T10:54:50.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f2f4a3b80 10 client.0 _ll_register_callbacks cb 0x56419b938680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:54:50.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1999b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba4ff50 0x56419ba4c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1919a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1999b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba4ff50 0x56419ba4c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:41704/0 (socket says 172.21.15.107:41704) 2023-08-10T10:54:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1999b700 1 -- 172.21.15.107:0/3246060812 learned_addr learned my addr 172.21.15.107:0/3246060812 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:54:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1999b700 1 -- 172.21.15.107:0/3246060812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba50870 msgr2=0x56419ba4c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1999b700 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba50870 0x56419ba4c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1999b700 1 -- 172.21.15.107:0/3246060812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 msgr2=0x56419ba4bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:54:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1999b700 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1999b700 1 -- 172.21.15.107:0/3246060812 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56419b81c630 con 0x56419ba4ff50 2023-08-10T10:54:50.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1919a700 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:54:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2f1999b700 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba4ff50 0x56419ba4c2a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2f100059d0 tx=0x7f2f10005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3c6b98c886843e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:54:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.122+0000 7f2efd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:54:50.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.123+0000 7f2efd7fa700 1 -- 172.21.15.107:0/3246060812 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1001d040 con 0x56419ba4ff50 2023-08-10T10:54:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.123+0000 7f2efd7fa700 1 -- 172.21.15.107:0/3246060812 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f2f10004cb0 con 0x56419ba4ff50 2023-08-10T10:54:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.123+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/3246060812 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f1001e040 con 0x56419ba4ff50 2023-08-10T10:54:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.123+0000 7f2efd7fa700 1 -- 172.21.15.107:0/3246060812 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f10004e70 con 0x56419ba4ff50 2023-08-10T10:54:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.123+0000 7f2f2f4a3b80 10 client.26158 fetch_fsmap learned FSMap version 32 2023-08-10T10:54:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.123+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/3246060812 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f2f04028040 con 0x56419ba4ff50 2023-08-10T10:54:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.123+0000 7f2efd7fa700 1 -- 172.21.15.107:0/3246060812 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f1001e040 con 0x56419ba4ff50 2023-08-10T10:54:50.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.124+0000 7f2efd7fa700 1 -- 172.21.15.107:0/3246060812 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 32) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f2f1000f760 con 0x56419ba4ff50 2023-08-10T10:54:50.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.124+0000 7f2f2f4a3b80 10 client.26158 fetch_fsmap finished waiting for FSMap version 32 2023-08-10T10:54:50.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.124+0000 7f2f2f4a3b80 10 client.26158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:54:50.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.124+0000 7f2f2f4a3b80 20 client.26158 populate_metadata read hostname 'smithi107' 2023-08-10T10:54:50.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.124+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56419bab93b0 0x56419babb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:54:50.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.124+0000 7f2f2f4a3b80 4 client.26158 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:54:50.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.124+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/3246060812 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56419b994780 con 0x56419bab93b0 2023-08-10T10:54:50.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.124+0000 7f2f1919a700 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56419bab93b0 0x56419babb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:54:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f1919a700 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56419bab93b0 0x56419babb7d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11ea865c308c3e9f server_cookie=615ea30692c91f80 in_seq=0 out_seq=0 2023-08-10T10:54:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2efd7fa700 10 client.26158 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:54:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2efd7fa700 1 -- 172.21.15.107:0/3246060812 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56419b994780 con 0x56419bab93b0 2023-08-10T10:54:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2efd7fa700 10 client.26158 handle_command_reply: tid=0 2023-08-10T10:54:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 client.26158 shutdown 2023-08-10T10:54:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/3246060812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba4ff50 msgr2=0x56419ba4c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba4ff50 0x56419ba4c2a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2f100059d0 tx=0x7f2f10005a20 comp rx=0 tx=0).stop 2023-08-10T10:54:50.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/3246060812 shutdown_connections 2023-08-10T10:54:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56419bab93b0 0x56419babb7d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56419ba50870 0x56419ba4c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56419ba4a800 0x56419ba4bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 --2- 172.21.15.107:0/3246060812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56419ba4ff50 0x56419ba4c2a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/3246060812 >> 172.21.15.107:0/3246060812 conn(0x56419b9a7cd0 msgr2=0x56419ba4f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2efd7fa700 0 client.26158 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:54:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/3246060812 shutdown_connections 2023-08-10T10:54:50.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 1 -- 172.21.15.107:0/3246060812 wait complete. 2023-08-10T10:54:50.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.125+0000 7f2f2f4a3b80 20 client.26158 trim_cache size 0 max 16384 2023-08-10T10:54:50.136 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:54:50.136 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:54:50.136 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:54:50.136 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:54:50.137 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:54:50.137 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:54:50.137 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:54:50.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:54:50.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:54:50.137 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:54:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 -- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2f000a1340 msgr2=0x7f2f000a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2f000a1340 0x7f2f000a3800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0ca040 tx=0x7f2f0c00c8d0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 -- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f14108920 msgr2=0x7f2f14198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:54:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f14108920 0x7f2f14198730 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00efb0 tx=0x7f2f0c00c3a0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 -- 172.21.15.107:0/3935483486 shutdown_connections 2023-08-10T10:54:50.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f14108920 0x7f2f14198730 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f14102910 0x7f2f1419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2f000a1340 0x7f2f000a3800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 --2- 172.21.15.107:0/3935483486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f141032d0 0x7f2f1419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:54:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 -- 172.21.15.107:0/3935483486 >> 172.21.15.107:0/3935483486 conn(0x7f2f140fe3c0 msgr2=0x7f2f140fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:54:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 -- 172.21.15.107:0/3935483486 shutdown_connections 2023-08-10T10:54:50.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:54:50.126+0000 7f2f1bbff700 1 -- 172.21.15.107:0/3935483486 wait complete. 2023-08-10T10:54:50.146 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:54:50.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:49 smithi195 ceph-mon[129938]: pgmap v111: 129 pgs: 129 active+clean; 3.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 35 op/s 2023-08-10T10:54:50.192 INFO:teuthology.orchestra.run.smithi107.stderr:12900000 of 50000000 tuples (25%) done (elapsed 188.37 s, remaining 541.75 s) 2023-08-10T10:54:51.405 INFO:teuthology.orchestra.run.smithi107.stderr:13000000 of 50000000 tuples (26%) done (elapsed 189.58 s, remaining 539.58 s) 2023-08-10T10:54:52.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:51 smithi157 ceph-mon[129604]: pgmap v112: 129 pgs: 129 active+clean; 3.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-08-10T10:54:52.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:51 smithi107 ceph-mon[127953]: pgmap v112: 129 pgs: 129 active+clean; 3.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-08-10T10:54:52.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:51 smithi195 ceph-mon[129938]: pgmap v112: 129 pgs: 129 active+clean; 3.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-08-10T10:54:52.615 INFO:teuthology.orchestra.run.smithi107.stderr:13100000 of 50000000 tuples (26%) done (elapsed 190.79 s, remaining 537.42 s) 2023-08-10T10:54:53.879 INFO:teuthology.orchestra.run.smithi107.stderr:13200000 of 50000000 tuples (26%) done (elapsed 192.06 s, remaining 535.43 s) 2023-08-10T10:54:54.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:53 smithi157 ceph-mon[129604]: pgmap v113: 129 pgs: 129 active+clean; 3.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-08-10T10:54:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:53 smithi107 ceph-mon[127953]: pgmap v113: 129 pgs: 129 active+clean; 3.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-08-10T10:54:54.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:53 smithi195 ceph-mon[129938]: pgmap v113: 129 pgs: 129 active+clean; 3.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-08-10T10:54:55.072 INFO:teuthology.orchestra.run.smithi107.stderr:13300000 of 50000000 tuples (26%) done (elapsed 193.25 s, remaining 533.25 s) 2023-08-10T10:54:56.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:55 smithi157 ceph-mon[129604]: pgmap v114: 129 pgs: 129 active+clean; 3.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 37 MiB/s wr, 35 op/s 2023-08-10T10:54:56.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:55 smithi107 ceph-mon[127953]: pgmap v114: 129 pgs: 129 active+clean; 3.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 37 MiB/s wr, 35 op/s 2023-08-10T10:54:56.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:55 smithi195 ceph-mon[129938]: pgmap v114: 129 pgs: 129 active+clean; 3.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 37 MiB/s wr, 35 op/s 2023-08-10T10:54:56.261 INFO:teuthology.orchestra.run.smithi107.stderr:13400000 of 50000000 tuples (26%) done (elapsed 194.44 s, remaining 531.08 s) 2023-08-10T10:54:57.558 INFO:teuthology.orchestra.run.smithi107.stderr:13500000 of 50000000 tuples (27%) done (elapsed 195.74 s, remaining 529.21 s) 2023-08-10T10:54:58.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:57 smithi157 ceph-mon[129604]: pgmap v115: 129 pgs: 129 active+clean; 3.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-08-10T10:54:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:57 smithi107 ceph-mon[127953]: pgmap v115: 129 pgs: 129 active+clean; 3.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-08-10T10:54:58.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:57 smithi195 ceph-mon[129938]: pgmap v115: 129 pgs: 129 active+clean; 3.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-08-10T10:54:58.761 INFO:teuthology.orchestra.run.smithi107.stderr:13600000 of 50000000 tuples (27%) done (elapsed 196.94 s, remaining 527.10 s) 2023-08-10T10:54:59.997 INFO:teuthology.orchestra.run.smithi107.stderr:13700000 of 50000000 tuples (27%) done (elapsed 198.17 s, remaining 525.09 s) 2023-08-10T10:55:00.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:54:59 smithi157 ceph-mon[129604]: pgmap v116: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 37 MiB/s wr, 32 op/s 2023-08-10T10:55:00.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:54:59 smithi107 ceph-mon[127953]: pgmap v116: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 37 MiB/s wr, 32 op/s 2023-08-10T10:55:00.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:54:59 smithi195 ceph-mon[129938]: pgmap v116: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 37 MiB/s wr, 32 op/s 2023-08-10T10:55:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:01 smithi107 ceph-mon[127953]: pgmap v117: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:55:02.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:01 smithi195 ceph-mon[129938]: pgmap v117: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:55:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:01 smithi157 ceph-mon[129604]: pgmap v117: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:55:03.361 INFO:teuthology.orchestra.run.smithi107.stderr:13800000 of 50000000 tuples (27%) done (elapsed 201.54 s, remaining 528.68 s) 2023-08-10T10:55:04.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:03 smithi107 ceph-mon[127953]: pgmap v118: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:55:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:03 smithi195 ceph-mon[129938]: pgmap v118: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:55:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:03 smithi157 ceph-mon[129604]: pgmap v118: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T10:55:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:05 smithi107 ceph-mon[127953]: pgmap v119: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 31 MiB/s wr, 52 op/s 2023-08-10T10:55:06.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:05 smithi195 ceph-mon[129938]: pgmap v119: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 31 MiB/s wr, 52 op/s 2023-08-10T10:55:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:05 smithi157 ceph-mon[129604]: pgmap v119: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 31 MiB/s wr, 52 op/s 2023-08-10T10:55:07.154 INFO:teuthology.orchestra.run.smithi107.stderr:13900000 of 50000000 tuples (27%) done (elapsed 205.33 s, remaining 533.27 s) 2023-08-10T10:55:08.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:07 smithi107 ceph-mon[127953]: pgmap v120: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 19 MiB/s wr, 41 op/s 2023-08-10T10:55:08.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:07 smithi195 ceph-mon[129938]: pgmap v120: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 19 MiB/s wr, 41 op/s 2023-08-10T10:55:08.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:07 smithi157 ceph-mon[129604]: pgmap v120: 129 pgs: 129 active+clean; 3.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 19 MiB/s wr, 41 op/s 2023-08-10T10:55:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:14000000 of 50000000 tuples (28%) done (elapsed 206.59 s, remaining 531.23 s) 2023-08-10T10:55:10.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:09 smithi107 ceph-mon[127953]: pgmap v121: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 25 MiB/s wr, 55 op/s 2023-08-10T10:55:10.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:09 smithi195 ceph-mon[129938]: pgmap v121: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 25 MiB/s wr, 55 op/s 2023-08-10T10:55:10.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:09 smithi157 ceph-mon[129604]: pgmap v121: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 25 MiB/s wr, 55 op/s 2023-08-10T10:55:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:11 smithi107 ceph-mon[127953]: pgmap v122: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 13 MiB/s wr, 44 op/s 2023-08-10T10:55:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:11 smithi195 ceph-mon[129938]: pgmap v122: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 13 MiB/s wr, 44 op/s 2023-08-10T10:55:12.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:11 smithi157 ceph-mon[129604]: pgmap v122: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 13 MiB/s wr, 44 op/s 2023-08-10T10:55:13.026 INFO:teuthology.orchestra.run.smithi107.stderr:14100000 of 50000000 tuples (28%) done (elapsed 211.20 s, remaining 537.75 s) 2023-08-10T10:55:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:13 smithi107 ceph-mon[127953]: pgmap v123: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 13 MiB/s wr, 44 op/s 2023-08-10T10:55:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:13 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:55:14.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:13 smithi195 ceph-mon[129938]: pgmap v123: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 13 MiB/s wr, 44 op/s 2023-08-10T10:55:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:13 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:55:14.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:13 smithi157 ceph-mon[129604]: pgmap v123: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 13 MiB/s wr, 44 op/s 2023-08-10T10:55:14.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:13 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:55:14.343 INFO:teuthology.orchestra.run.smithi107.stderr:14200000 of 50000000 tuples (28%) done (elapsed 212.52 s, remaining 535.79 s) 2023-08-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:14300000 of 50000000 tuples (28%) done (elapsed 213.75 s, remaining 533.62 s) 2023-08-10T10:55:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:15 smithi107 ceph-mon[127953]: pgmap v124: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 16 MiB/s wr, 56 op/s 2023-08-10T10:55:16.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:15 smithi195 ceph-mon[129938]: pgmap v124: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 16 MiB/s wr, 56 op/s 2023-08-10T10:55:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:15 smithi157 ceph-mon[129604]: pgmap v124: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 16 MiB/s wr, 56 op/s 2023-08-10T10:55:16.784 INFO:teuthology.orchestra.run.smithi107.stderr:14400000 of 50000000 tuples (28%) done (elapsed 214.96 s, remaining 531.43 s) 2023-08-10T10:55:18.023 INFO:teuthology.orchestra.run.smithi107.stderr:14500000 of 50000000 tuples (29%) done (elapsed 216.20 s, remaining 529.32 s) 2023-08-10T10:55:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:17 smithi107 ceph-mon[127953]: pgmap v125: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.8 MiB/s wr, 25 op/s 2023-08-10T10:55:18.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:17 smithi195 ceph-mon[129938]: pgmap v125: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.8 MiB/s wr, 25 op/s 2023-08-10T10:55:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:17 smithi157 ceph-mon[129604]: pgmap v125: 129 pgs: 129 active+clean; 3.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.8 MiB/s wr, 25 op/s 2023-08-10T10:55:19.334 INFO:teuthology.orchestra.run.smithi107.stderr:14600000 of 50000000 tuples (29%) done (elapsed 217.51 s, remaining 527.39 s) 2023-08-10T10:55:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:19 smithi107 ceph-mon[127953]: pgmap v126: 129 pgs: 129 active+clean; 3.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 39 op/s 2023-08-10T10:55:20.148 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:55:20.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:19 smithi195 ceph-mon[129938]: pgmap v126: 129 pgs: 129 active+clean; 3.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 39 op/s 2023-08-10T10:55:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:19 smithi157 ceph-mon[129604]: pgmap v126: 129 pgs: 129 active+clean; 3.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 39 op/s 2023-08-10T10:55:20.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.430+0000 7f2415bff700 1 -- 172.21.15.107:0/2198131393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24101018e0 msgr2=0x7f2410101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:20.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.430+0000 7f2415bff700 1 --2- 172.21.15.107:0/2198131393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24101018e0 0x7f2410101cc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24000098f0 tx=0x7f2400009c00 comp rx=0 tx=0).stop 2023-08-10T10:55:20.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.430+0000 7f2415bff700 1 -- 172.21.15.107:0/2198131393 shutdown_connections 2023-08-10T10:55:20.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.430+0000 7f2415bff700 1 --2- 172.21.15.107:0/2198131393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24101018e0 0x7f2410101cc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.430+0000 7f2415bff700 1 --2- 172.21.15.107:0/2198131393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f241010acb0 0x7f241010d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.430+0000 7f2415bff700 1 --2- 172.21.15.107:0/2198131393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2410102200 0x7f241010a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.430+0000 7f2415bff700 1 -- 172.21.15.107:0/2198131393 >> 172.21.15.107:0/2198131393 conn(0x7f24100fb0c0 msgr2=0x7f24100fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:20.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.431+0000 7f2415bff700 1 -- 172.21.15.107:0/2198131393 shutdown_connections 2023-08-10T10:55:20.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.431+0000 7f2415bff700 1 -- 172.21.15.107:0/2198131393 wait complete. 2023-08-10T10:55:20.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.432+0000 7f2415bff700 1 Processor -- start 2023-08-10T10:55:20.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.432+0000 7f2415bff700 1 -- start start 2023-08-10T10:55:20.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.432+0000 7f2415bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24101018e0 0x7f241019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.432+0000 7f2415bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2410102200 0x7f241019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.432+0000 7f2415bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f241010acb0 0x7f2410198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.432+0000 7f2415bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410198f00 con 0x7f241010acb0 2023-08-10T10:55:20.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.432+0000 7f2415bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410199070 con 0x7f2410102200 2023-08-10T10:55:20.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.432+0000 7f2415bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410199230 con 0x7f24101018e0 2023-08-10T10:55:20.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24101018e0 0x7f241019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2410102200 0x7f241019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24101018e0 0x7f241019e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:48838/0 (socket says 172.21.15.107:48838) 2023-08-10T10:55:20.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240f7fe700 1 -- 172.21.15.107:0/2363740351 learned_addr learned my addr 172.21.15.107:0/2363740351 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:20.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240ffff700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f241010acb0 0x7f2410198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240f7fe700 1 -- 172.21.15.107:0/2363740351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2410102200 msgr2=0x7f241019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:20.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240f7fe700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2410102200 0x7f241019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240f7fe700 1 -- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f241010acb0 msgr2=0x7f2410198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:20.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240f7fe700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f241010acb0 0x7f2410198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240f7fe700 1 -- 172.21.15.107:0/2363740351 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400009520 con 0x7f24101018e0 2023-08-10T10:55:20.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.433+0000 7f240f7fe700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24101018e0 0x7f241019e820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2400009810 tx=0x7f240000f950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:20.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.434+0000 7f240cff9700 1 -- 172.21.15.107:0/2363740351 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240001c070 con 0x7f24101018e0 2023-08-10T10:55:20.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.434+0000 7f240cff9700 1 -- 172.21.15.107:0/2363740351 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f240000bb70 con 0x7f24101018e0 2023-08-10T10:55:20.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.434+0000 7f2415bff700 1 -- 172.21.15.107:0/2363740351 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24101994b0 con 0x7f24101018e0 2023-08-10T10:55:20.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.434+0000 7f240cff9700 1 -- 172.21.15.107:0/2363740351 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000038e0 con 0x7f24101018e0 2023-08-10T10:55:20.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.434+0000 7f2415bff700 1 -- 172.21.15.107:0/2363740351 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24101a5810 con 0x7f24101018e0 2023-08-10T10:55:20.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.438+0000 7f240cff9700 1 -- 172.21.15.107:0/2363740351 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2400020030 con 0x7f24101018e0 2023-08-10T10:55:20.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.439+0000 7f24294ddb80 1 Processor -- start 2023-08-10T10:55:20.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.439+0000 7f24294ddb80 1 -- start start 2023-08-10T10:55:20.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.439+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb6f50 0x563169bb7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.439+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb7870 0x563169bb12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb1800 0x563169bb1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.441 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f24294ddb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169b2cdc0 con 0x563169bb6f50 2023-08-10T10:55:20.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f24294ddb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169b09590 con 0x563169bb7870 2023-08-10T10:55:20.442 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f24294ddb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169b06eb0 con 0x563169bb1800 2023-08-10T10:55:20.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f240f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb7870 0x563169bb12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.446 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f240cff9700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23f80a12c0 0x7f23f80a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f240f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb7870 0x563169bb12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:55594/0 (socket says 172.21.15.107:55594) 2023-08-10T10:55:20.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f240f7fe700 1 -- 172.21.15.107:0/86067157 learned_addr learned my addr 172.21.15.107:0/86067157 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:20.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f240ffff700 1 --2- 172.21.15.107:0/86067157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb6f50 0x563169bb7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f240effd700 1 --2- 172.21.15.107:0/86067157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb1800 0x563169bb1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f240cff9700 1 -- 172.21.15.107:0/2363740351 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f24000cdfb0 con 0x7f24101018e0 2023-08-10T10:55:20.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.440+0000 7f240f7fe700 1 -- 172.21.15.107:0/86067157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb1800 msgr2=0x563169bb1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:20.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.441+0000 7f240f7fe700 1 --2- 172.21.15.107:0/86067157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb1800 0x563169bb1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.441+0000 7f240f7fe700 1 -- 172.21.15.107:0/86067157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb6f50 msgr2=0x563169bb7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:20.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.441+0000 7f240f7fe700 1 --2- 172.21.15.107:0/86067157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb6f50 0x563169bb7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.441+0000 7f240f7fe700 1 -- 172.21.15.107:0/86067157 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563169983630 con 0x563169bb7870 2023-08-10T10:55:20.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.441+0000 7f240ffff700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23f80a12c0 0x7f23f80a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.441+0000 7f240f7fe700 1 --2- 172.21.15.107:0/86067157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb7870 0x563169bb12c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f24000cb340 tx=0x7f2400009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6ad8b4c1c75f722 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:20.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.441+0000 7f23f5ffb700 1 -- 172.21.15.107:0/86067157 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240009a710 con 0x563169bb7870 2023-08-10T10:55:20.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.441+0000 7f23f5ffb700 1 -- 172.21.15.107:0/86067157 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24000d1630 con 0x563169bb7870 2023-08-10T10:55:20.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.441+0000 7f23f5ffb700 1 -- 172.21.15.107:0/86067157 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000974c0 con 0x563169bb7870 2023-08-10T10:55:20.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f24294ddb80 1 -- 172.21.15.107:0/86067157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb7870 msgr2=0x563169bb12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:20.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f240ffff700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23f80a12c0 0x7f23f80a3780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x563169bb2520 tx=0x7f2408004b40 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:20.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f24294ddb80 1 --2- 172.21.15.107:0/86067157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb7870 0x563169bb12c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f24000cb340 tx=0x7f2400009c00 comp rx=0 tx=0).stop 2023-08-10T10:55:20.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f24294ddb80 1 -- 172.21.15.107:0/86067157 shutdown_connections 2023-08-10T10:55:20.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f24294ddb80 1 --2- 172.21.15.107:0/86067157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb1800 0x563169bb1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f24294ddb80 1 --2- 172.21.15.107:0/86067157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb6f50 0x563169bb7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f24294ddb80 1 --2- 172.21.15.107:0/86067157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb7870 0x563169bb12c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f24294ddb80 1 -- 172.21.15.107:0/86067157 >> 172.21.15.107:0/86067157 conn(0x563169b0ecd0 msgr2=0x563169bac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:20.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f24294ddb80 1 -- 172.21.15.107:0/86067157 shutdown_connections 2023-08-10T10:55:20.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.442+0000 7f24294ddb80 1 -- 172.21.15.107:0/86067157 wait complete. 2023-08-10T10:55:20.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.443+0000 7f24294ddb80 1 -- start start 2023-08-10T10:55:20.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.443+0000 7f24294ddb80 1 Processor -- start 2023-08-10T10:55:20.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb1800 0x563169bbd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb6f50 0x563169bbaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb7870 0x563169bbafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f24294ddb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169b027a0 con 0x563169bb1800 2023-08-10T10:55:20.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f24294ddb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169aa1ac0 con 0x563169bb6f50 2023-08-10T10:55:20.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f24294ddb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169aa17c0 con 0x563169bb7870 2023-08-10T10:55:20.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f24294ddb80 10 client.0 _ll_register_callbacks cb 0x563169a9f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:55:20.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f240effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb6f50 0x563169bbaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f240effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb6f50 0x563169bbaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:55608/0 (socket says 172.21.15.107:55608) 2023-08-10T10:55:20.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f240effd700 1 -- 172.21.15.107:0/2828066320 learned_addr learned my addr 172.21.15.107:0/2828066320 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:20.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f240ffff700 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb7870 0x563169bbafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.444+0000 7f240f7fe700 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb1800 0x563169bbd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f240effd700 1 -- 172.21.15.107:0/2828066320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb7870 msgr2=0x563169bbafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:20.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f240effd700 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb7870 0x563169bbafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f240effd700 1 -- 172.21.15.107:0/2828066320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb1800 msgr2=0x563169bbd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:20.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f240effd700 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb1800 0x563169bbd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f240effd700 1 -- 172.21.15.107:0/2828066320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24101a5810 con 0x563169bb6f50 2023-08-10T10:55:20.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f240effd700 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb6f50 0x563169bbaa50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f24040126d0 tx=0x7f24040129e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61fe8f5c96f37300 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:20.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f23eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:55:20.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f23eeffd700 1 -- 172.21.15.107:0/2828066320 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404017070 con 0x563169bb6f50 2023-08-10T10:55:20.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f24294ddb80 1 -- 172.21.15.107:0/2828066320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563169ba4470 con 0x563169bb6f50 2023-08-10T10:55:20.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.445+0000 7f23eeffd700 1 -- 172.21.15.107:0/2828066320 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f2404004020 con 0x563169bb6f50 2023-08-10T10:55:20.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.446+0000 7f23eeffd700 1 -- 172.21.15.107:0/2828066320 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2404004220 con 0x563169bb6f50 2023-08-10T10:55:20.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.446+0000 7f24294ddb80 10 client.26147 fetch_fsmap learned FSMap version 33 2023-08-10T10:55:20.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.446+0000 7f24294ddb80 1 -- 172.21.15.107:0/2828066320 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56316992fde0 con 0x563169bb6f50 2023-08-10T10:55:20.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.446+0000 7f23eeffd700 1 -- 172.21.15.107:0/2828066320 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563169ba4470 con 0x563169bb6f50 2023-08-10T10:55:20.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.447+0000 7f23eeffd700 1 -- 172.21.15.107:0/2828066320 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 33) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f240401c470 con 0x563169bb6f50 2023-08-10T10:55:20.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.447+0000 7f24294ddb80 10 client.26147 fetch_fsmap finished waiting for FSMap version 33 2023-08-10T10:55:20.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.447+0000 7f24294ddb80 10 client.26147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:55:20.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.447+0000 7f24294ddb80 20 client.26147 populate_metadata read hostname 'smithi107' 2023-08-10T10:55:20.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.447+0000 7f24294ddb80 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563169bcaf50 0x563169bcd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.447+0000 7f24294ddb80 4 client.26147 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:55:20.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.447+0000 7f24294ddb80 1 -- 172.21.15.107:0/2828066320 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563169b809d0 con 0x563169bcaf50 2023-08-10T10:55:20.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.447+0000 7f240f7fe700 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563169bcaf50 0x563169bcd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.448+0000 7f240f7fe700 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563169bcaf50 0x563169bcd370 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427397b3dc0bff25 server_cookie=13c3f1b0fb51c617 in_seq=0 out_seq=0 2023-08-10T10:55:20.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.448+0000 7f23eeffd700 10 client.26147 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:55:20.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f23eeffd700 1 -- 172.21.15.107:0/2828066320 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x563169b809d0 con 0x563169bcaf50 2023-08-10T10:55:20.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f23eeffd700 10 client.26147 handle_command_reply: tid=0 2023-08-10T10:55:20.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 client.26147 shutdown 2023-08-10T10:55:20.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 -- 172.21.15.107:0/2828066320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb6f50 msgr2=0x563169bbaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:20.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb6f50 0x563169bbaa50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f24040126d0 tx=0x7f24040129e0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 -- 172.21.15.107:0/2828066320 shutdown_connections 2023-08-10T10:55:20.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563169bcaf50 0x563169bcd370 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb7870 0x563169bbafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb1800 0x563169bbd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 --2- 172.21.15.107:0/2828066320 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb6f50 0x563169bbaa50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 -- 172.21.15.107:0/2828066320 >> 172.21.15.107:0/2828066320 conn(0x563169b0ecd0 msgr2=0x563169bab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:20.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f23eeffd700 0 client.26147 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:55:20.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 -- 172.21.15.107:0/2828066320 shutdown_connections 2023-08-10T10:55:20.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.449+0000 7f24294ddb80 1 -- 172.21.15.107:0/2828066320 wait complete. 2023-08-10T10:55:20.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.450+0000 7f24294ddb80 20 client.26147 trim_cache size 0 max 16384 2023-08-10T10:55:20.474 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.473+0000 7f24294ddb80 1 Processor -- start 2023-08-10T10:55:20.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.473+0000 7f24294ddb80 1 -- start start 2023-08-10T10:55:20.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.473+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 0x563169bc1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.473+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bb8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.473+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 0x563169bbd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.473+0000 7f24294ddb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169985920 con 0x563169bb7870 2023-08-10T10:55:20.475 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.473+0000 7f24294ddb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169bb1650 con 0x563169bb1800 2023-08-10T10:55:20.476 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.473+0000 7f24294ddb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169bbb5b0 con 0x563169bb6f50 2023-08-10T10:55:20.477 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bb8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bb8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:48876/0 (socket says 172.21.15.107:48876) 2023-08-10T10:55:20.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240effd700 1 -- 172.21.15.107:0/1290344328 learned_addr learned my addr 172.21.15.107:0/1290344328 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:20.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240f7fe700 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 0x563169bc1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240ffff700 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 0x563169bbd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240effd700 1 -- 172.21.15.107:0/1290344328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 msgr2=0x563169bc1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:20.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240effd700 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 0x563169bc1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240effd700 1 -- 172.21.15.107:0/1290344328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 msgr2=0x563169bbd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:20.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240effd700 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 0x563169bbd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240effd700 1 -- 172.21.15.107:0/1290344328 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563169918c60 con 0x563169bb6f50 2023-08-10T10:55:20.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.474+0000 7f240ffff700 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 0x563169bbd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:55:20.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.475+0000 7f240effd700 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bb8360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2404000c00 tx=0x7f240401ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa5d6fd30f6585d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:20.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.475+0000 7f23f67fc700 1 -- 172.21.15.107:0/1290344328 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404017070 con 0x563169bb6f50 2023-08-10T10:55:20.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.475+0000 7f23f67fc700 1 -- 172.21.15.107:0/1290344328 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2404018040 con 0x563169bb6f50 2023-08-10T10:55:20.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.475+0000 7f23f67fc700 1 -- 172.21.15.107:0/1290344328 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24040038e0 con 0x563169bb6f50 2023-08-10T10:55:20.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.476+0000 7f24294ddb80 1 -- 172.21.15.107:0/1290344328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 msgr2=0x563169bb8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:20.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.476+0000 7f24294ddb80 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bb8360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2404000c00 tx=0x7f240401ca20 comp rx=0 tx=0).stop 2023-08-10T10:55:20.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.476+0000 7f24294ddb80 1 -- 172.21.15.107:0/1290344328 shutdown_connections 2023-08-10T10:55:20.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.476+0000 7f24294ddb80 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 0x563169bc1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.476+0000 7f24294ddb80 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 0x563169bbd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.476+0000 7f24294ddb80 1 --2- 172.21.15.107:0/1290344328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bb8360 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.476+0000 7f24294ddb80 1 -- 172.21.15.107:0/1290344328 >> 172.21.15.107:0/1290344328 conn(0x563169b0ecd0 msgr2=0x563169bb7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:20.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.476+0000 7f24294ddb80 1 -- 172.21.15.107:0/1290344328 shutdown_connections 2023-08-10T10:55:20.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.476+0000 7f24294ddb80 1 -- 172.21.15.107:0/1290344328 wait complete. 2023-08-10T10:55:20.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.477+0000 7f24294ddb80 1 -- start start 2023-08-10T10:55:20.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.477+0000 7f24294ddb80 1 Processor -- start 2023-08-10T10:55:20.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 0x563169bbe080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bbe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f24294ddb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 0x563169c1dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f24294ddb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169c1e0f0 con 0x563169bb7870 2023-08-10T10:55:20.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f24294ddb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169c1e230 con 0x563169bb1800 2023-08-10T10:55:20.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f24294ddb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563169c1e370 con 0x563169bb6f50 2023-08-10T10:55:20.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f24294ddb80 10 client.0 _ll_register_callbacks cb 0x563169a9f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:55:20.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f240effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bbe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f240effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bbe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:48882/0 (socket says 172.21.15.107:48882) 2023-08-10T10:55:20.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f240effd700 1 -- 172.21.15.107:0/4081347940 learned_addr learned my addr 172.21.15.107:0/4081347940 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:20.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.478+0000 7f240f7fe700 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 0x563169bbe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.479+0000 7f240effd700 1 -- 172.21.15.107:0/4081347940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 msgr2=0x563169bbe080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:20.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.479+0000 7f240effd700 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 0x563169bbe080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.479+0000 7f240effd700 1 -- 172.21.15.107:0/4081347940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 msgr2=0x563169c1dbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:55:20.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.480+0000 7f240effd700 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 0x563169c1dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.480+0000 7f240effd700 1 -- 172.21.15.107:0/4081347940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56316992fde0 con 0x563169bb6f50 2023-08-10T10:55:20.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.480+0000 7f240effd700 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bbe5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f240401c920 tx=0x7f240401c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43a7f9aa03517523 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:20.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.481+0000 7f23eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:55:20.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.481+0000 7f23eeffd700 1 -- 172.21.15.107:0/4081347940 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404017040 con 0x563169bb6f50 2023-08-10T10:55:20.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.481+0000 7f24294ddb80 1 -- 172.21.15.107:0/4081347940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24000d1630 con 0x563169bb6f50 2023-08-10T10:55:20.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.481+0000 7f23eeffd700 1 -- 172.21.15.107:0/4081347940 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f24040052d0 con 0x563169bb6f50 2023-08-10T10:55:20.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.481+0000 7f23eeffd700 1 -- 172.21.15.107:0/4081347940 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2404005780 con 0x563169bb6f50 2023-08-10T10:55:20.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.481+0000 7f24294ddb80 10 client.26176 fetch_fsmap learned FSMap version 33 2023-08-10T10:55:20.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.481+0000 7f24294ddb80 1 -- 172.21.15.107:0/4081347940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x563169956250 con 0x563169bb6f50 2023-08-10T10:55:20.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.481+0000 7f23eeffd700 1 -- 172.21.15.107:0/4081347940 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24000d1630 con 0x563169bb6f50 2023-08-10T10:55:20.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.482+0000 7f23eeffd700 1 -- 172.21.15.107:0/4081347940 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 33) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f2404010640 con 0x563169bb6f50 2023-08-10T10:55:20.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.482+0000 7f24294ddb80 10 client.26176 fetch_fsmap finished waiting for FSMap version 33 2023-08-10T10:55:20.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.482+0000 7f24294ddb80 10 client.26176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:55:20.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.482+0000 7f24294ddb80 20 client.26176 populate_metadata read hostname 'smithi107' 2023-08-10T10:55:20.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.482+0000 7f24294ddb80 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563169c1f8d0 0x563169c21cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:20.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.482+0000 7f24294ddb80 4 client.26176 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:55:20.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.482+0000 7f24294ddb80 1 -- 172.21.15.107:0/4081347940 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563169afb780 con 0x563169c1f8d0 2023-08-10T10:55:20.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.482+0000 7f240f7fe700 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563169c1f8d0 0x563169c21cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:20.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.483+0000 7f23eeffd700 10 client.26176 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:55:20.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.483+0000 7f240f7fe700 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563169c1f8d0 0x563169c21cf0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=848770e59dee6653 server_cookie=8c4cf38a6ee0a0fe in_seq=0 out_seq=0 2023-08-10T10:55:20.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.483+0000 7f23eeffd700 1 -- 172.21.15.107:0/4081347940 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563169afb780 con 0x563169c1f8d0 2023-08-10T10:55:20.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.483+0000 7f23eeffd700 10 client.26176 handle_command_reply: tid=0 2023-08-10T10:55:20.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.483+0000 7f24294ddb80 1 client.26176 shutdown 2023-08-10T10:55:20.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 -- 172.21.15.107:0/4081347940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 msgr2=0x563169bbe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:20.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bbe5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f240401c920 tx=0x7f240401c6a0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 -- 172.21.15.107:0/4081347940 shutdown_connections 2023-08-10T10:55:20.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x563169c1f8d0 0x563169c21cf0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563169bb1800 0x563169bbe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.491 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563169bb7870 0x563169c1dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 --2- 172.21.15.107:0/4081347940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563169bb6f50 0x563169bbe5c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 -- 172.21.15.107:0/4081347940 >> 172.21.15.107:0/4081347940 conn(0x563169b0ecd0 msgr2=0x563169bb84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:20.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f23eeffd700 0 client.26176 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:55:20.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 -- 172.21.15.107:0/4081347940 shutdown_connections 2023-08-10T10:55:20.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 1 -- 172.21.15.107:0/4081347940 wait complete. 2023-08-10T10:55:20.492 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.484+0000 7f24294ddb80 20 client.26176 trim_cache size 0 max 16384 2023-08-10T10:55:20.493 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:55:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:55:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:55:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:55:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:55:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:55:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:55:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:55:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:55:20.494 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:55:20.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 -- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23f80a12c0 msgr2=0x7f23f80a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:20.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23f80a12c0 0x7f23f80a3780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x563169bb2520 tx=0x7f2408004b40 comp rx=0 tx=0).stop 2023-08-10T10:55:20.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 -- 172.21.15.107:0/2363740351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24101018e0 msgr2=0x7f241019e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:20.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24101018e0 0x7f241019e820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2400009810 tx=0x7f240000f950 comp rx=0 tx=0).stop 2023-08-10T10:55:20.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 -- 172.21.15.107:0/2363740351 shutdown_connections 2023-08-10T10:55:20.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f241010acb0 0x7f2410198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24101018e0 0x7f241019e820 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23f80a12c0 0x7f23f80a3780 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 --2- 172.21.15.107:0/2363740351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2410102200 0x7f241019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:20.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.485+0000 7f2415bff700 1 -- 172.21.15.107:0/2363740351 >> 172.21.15.107:0/2363740351 conn(0x7f24100fb0c0 msgr2=0x7f24100fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:20.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.486+0000 7f2415bff700 1 -- 172.21.15.107:0/2363740351 shutdown_connections 2023-08-10T10:55:20.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:20.486+0000 7f2415bff700 1 -- 172.21.15.107:0/2363740351 wait complete. 2023-08-10T10:55:20.508 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:55:20.631 INFO:teuthology.orchestra.run.smithi107.stderr:14700000 of 50000000 tuples (29%) done (elapsed 218.81 s, remaining 525.44 s) 2023-08-10T10:55:21.819 INFO:teuthology.orchestra.run.smithi107.stderr:14800000 of 50000000 tuples (29%) done (elapsed 220.00 s, remaining 523.23 s) 2023-08-10T10:55:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:21 smithi107 ceph-mon[127953]: pgmap v127: 129 pgs: 129 active+clean; 3.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-08-10T10:55:22.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:21 smithi195 ceph-mon[129938]: pgmap v127: 129 pgs: 129 active+clean; 3.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-08-10T10:55:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:21 smithi157 ceph-mon[129604]: pgmap v127: 129 pgs: 129 active+clean; 3.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-08-10T10:55:23.169 INFO:teuthology.orchestra.run.smithi107.stderr:14900000 of 50000000 tuples (29%) done (elapsed 221.35 s, remaining 521.43 s) 2023-08-10T10:55:24.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:23 smithi195 ceph-mon[129938]: pgmap v128: 129 pgs: 129 active+clean; 3.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-08-10T10:55:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:23 smithi157 ceph-mon[129604]: pgmap v128: 129 pgs: 129 active+clean; 3.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-08-10T10:55:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:23 smithi107 ceph-mon[127953]: pgmap v128: 129 pgs: 129 active+clean; 3.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 16 MiB/s wr, 25 op/s 2023-08-10T10:55:24.464 INFO:teuthology.orchestra.run.smithi107.stderr:15000000 of 50000000 tuples (30%) done (elapsed 222.64 s, remaining 519.50 s) 2023-08-10T10:55:25.750 INFO:teuthology.orchestra.run.smithi107.stderr:15100000 of 50000000 tuples (30%) done (elapsed 223.93 s, remaining 517.55 s) 2023-08-10T10:55:26.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:25 smithi195 ceph-mon[129938]: pgmap v129: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 49 op/s 2023-08-10T10:55:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:25 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:55:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:25 smithi157 ceph-mon[129604]: pgmap v129: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 49 op/s 2023-08-10T10:55:26.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:25 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:55:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:25 smithi107 ceph-mon[127953]: pgmap v129: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 49 op/s 2023-08-10T10:55:26.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:25 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:55:27.133 INFO:teuthology.orchestra.run.smithi107.stderr:15200000 of 50000000 tuples (30%) done (elapsed 225.31 s, remaining 515.84 s) 2023-08-10T10:55:27.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:55:27.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:55:27.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:55:27.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:55:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:55:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:55:27.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:55:27.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:55:27.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:55:28.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:27 smithi195 ceph-mon[129938]: pgmap v130: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 37 op/s 2023-08-10T10:55:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:27 smithi157 ceph-mon[129604]: pgmap v130: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 37 op/s 2023-08-10T10:55:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:27 smithi107 ceph-mon[127953]: pgmap v130: 129 pgs: 129 active+clean; 3.5 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 37 op/s 2023-08-10T10:55:28.415 INFO:teuthology.orchestra.run.smithi107.stderr:15300000 of 50000000 tuples (30%) done (elapsed 226.59 s, remaining 513.91 s) 2023-08-10T10:55:29.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:29 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:55:29.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:29 smithi157 ceph-mon[129604]: pgmap v131: 129 pgs: 129 active+clean; 3.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 35 MiB/s wr, 61 op/s 2023-08-10T10:55:29.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:29 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:55:29.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:29 smithi107 ceph-mon[127953]: pgmap v131: 129 pgs: 129 active+clean; 3.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 35 MiB/s wr, 61 op/s 2023-08-10T10:55:29.638 INFO:teuthology.orchestra.run.smithi107.stderr:15400000 of 50000000 tuples (30%) done (elapsed 227.82 s, remaining 511.84 s) 2023-08-10T10:55:29.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:29 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:55:29.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:29 smithi195 ceph-mon[129938]: pgmap v131: 129 pgs: 129 active+clean; 3.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 35 MiB/s wr, 61 op/s 2023-08-10T10:55:30.861 INFO:teuthology.orchestra.run.smithi107.stderr:15500000 of 50000000 tuples (31%) done (elapsed 229.04 s, remaining 509.80 s) 2023-08-10T10:55:31.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:31 smithi157 ceph-mon[129604]: pgmap v132: 129 pgs: 129 active+clean; 3.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:55:31.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:31 smithi107 ceph-mon[127953]: pgmap v132: 129 pgs: 129 active+clean; 3.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:55:31.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:31 smithi195 ceph-mon[129938]: pgmap v132: 129 pgs: 129 active+clean; 3.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:55:32.210 INFO:teuthology.orchestra.run.smithi107.stderr:15600000 of 50000000 tuples (31%) done (elapsed 230.39 s, remaining 508.03 s) 2023-08-10T10:55:33.401 INFO:teuthology.orchestra.run.smithi107.stderr:15700000 of 50000000 tuples (31%) done (elapsed 231.58 s, remaining 505.93 s) 2023-08-10T10:55:33.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:33 smithi157 ceph-mon[129604]: pgmap v133: 129 pgs: 129 active+clean; 3.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:55:33.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:33 smithi107 ceph-mon[127953]: pgmap v133: 129 pgs: 129 active+clean; 3.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:55:33.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:33 smithi195 ceph-mon[129938]: pgmap v133: 129 pgs: 129 active+clean; 3.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:55:34.596 INFO:teuthology.orchestra.run.smithi107.stderr:15800000 of 50000000 tuples (31%) done (elapsed 232.77 s, remaining 503.85 s) 2023-08-10T10:55:35.902 INFO:teuthology.orchestra.run.smithi107.stderr:15900000 of 50000000 tuples (31%) done (elapsed 234.08 s, remaining 502.02 s) 2023-08-10T10:55:36.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:35 smithi157 ceph-mon[129604]: pgmap v134: 129 pgs: 129 active+clean; 3.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 MiB/s wr, 68 op/s 2023-08-10T10:55:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:35 smithi107 ceph-mon[127953]: pgmap v134: 129 pgs: 129 active+clean; 3.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 MiB/s wr, 68 op/s 2023-08-10T10:55:36.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:35 smithi195 ceph-mon[129938]: pgmap v134: 129 pgs: 129 active+clean; 3.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 MiB/s wr, 68 op/s 2023-08-10T10:55:37.176 INFO:teuthology.orchestra.run.smithi107.stderr:16000000 of 50000000 tuples (32%) done (elapsed 235.35 s, remaining 500.13 s) 2023-08-10T10:55:38.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:37 smithi157 ceph-mon[129604]: pgmap v135: 129 pgs: 129 active+clean; 3.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 44 op/s 2023-08-10T10:55:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:37 smithi107 ceph-mon[127953]: pgmap v135: 129 pgs: 129 active+clean; 3.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 44 op/s 2023-08-10T10:55:38.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:37 smithi195 ceph-mon[129938]: pgmap v135: 129 pgs: 129 active+clean; 3.7 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 44 op/s 2023-08-10T10:55:38.428 INFO:teuthology.orchestra.run.smithi107.stderr:16100000 of 50000000 tuples (32%) done (elapsed 236.61 s, remaining 498.19 s) 2023-08-10T10:55:39.654 INFO:teuthology.orchestra.run.smithi107.stderr:16200000 of 50000000 tuples (32%) done (elapsed 237.83 s, remaining 496.22 s) 2023-08-10T10:55:40.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:39 smithi157 ceph-mon[129604]: pgmap v136: 129 pgs: 129 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 35 MiB/s wr, 67 op/s 2023-08-10T10:55:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:39 smithi107 ceph-mon[127953]: pgmap v136: 129 pgs: 129 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 35 MiB/s wr, 67 op/s 2023-08-10T10:55:40.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:39 smithi195 ceph-mon[129938]: pgmap v136: 129 pgs: 129 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 35 MiB/s wr, 67 op/s 2023-08-10T10:55:40.930 INFO:teuthology.orchestra.run.smithi107.stderr:16300000 of 50000000 tuples (32%) done (elapsed 239.11 s, remaining 494.35 s) 2023-08-10T10:55:42.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:41 smithi157 ceph-mon[129604]: pgmap v137: 129 pgs: 129 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:55:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:41 smithi107 ceph-mon[127953]: pgmap v137: 129 pgs: 129 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:55:42.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:41 smithi195 ceph-mon[129938]: pgmap v137: 129 pgs: 129 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:55:42.173 INFO:teuthology.orchestra.run.smithi107.stderr:16400000 of 50000000 tuples (32%) done (elapsed 240.35 s, remaining 492.43 s) 2023-08-10T10:55:43.446 INFO:teuthology.orchestra.run.smithi107.stderr:16500000 of 50000000 tuples (33%) done (elapsed 241.62 s, remaining 490.57 s) 2023-08-10T10:55:44.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:43 smithi157 ceph-mon[129604]: pgmap v138: 129 pgs: 129 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:55:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:43 smithi107 ceph-mon[127953]: pgmap v138: 129 pgs: 129 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:55:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:43 smithi195 ceph-mon[129938]: pgmap v138: 129 pgs: 129 active+clean; 3.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 44 op/s 2023-08-10T10:55:44.643 INFO:teuthology.orchestra.run.smithi107.stderr:16600000 of 50000000 tuples (33%) done (elapsed 242.82 s, remaining 488.57 s) 2023-08-10T10:55:46.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:45 smithi157 ceph-mon[129604]: pgmap v139: 129 pgs: 129 active+clean; 3.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-08-10T10:55:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:45 smithi107 ceph-mon[127953]: pgmap v139: 129 pgs: 129 active+clean; 3.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-08-10T10:55:46.135 INFO:teuthology.orchestra.run.smithi107.stderr:16700000 of 50000000 tuples (33%) done (elapsed 244.31 s, remaining 487.16 s) 2023-08-10T10:55:46.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:45 smithi195 ceph-mon[129938]: pgmap v139: 129 pgs: 129 active+clean; 3.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-08-10T10:55:47.322 INFO:teuthology.orchestra.run.smithi107.stderr:16800000 of 50000000 tuples (33%) done (elapsed 245.50 s, remaining 485.15 s) 2023-08-10T10:55:48.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:47 smithi157 ceph-mon[129604]: pgmap v140: 129 pgs: 129 active+clean; 3.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-08-10T10:55:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:47 smithi107 ceph-mon[127953]: pgmap v140: 129 pgs: 129 active+clean; 3.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-08-10T10:55:48.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:47 smithi195 ceph-mon[129938]: pgmap v140: 129 pgs: 129 active+clean; 3.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-08-10T10:55:48.532 INFO:teuthology.orchestra.run.smithi107.stderr:16900000 of 50000000 tuples (33%) done (elapsed 246.71 s, remaining 483.20 s) 2023-08-10T10:55:49.836 INFO:teuthology.orchestra.run.smithi107.stderr:17000000 of 50000000 tuples (34%) done (elapsed 248.01 s, remaining 481.44 s) 2023-08-10T10:55:50.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:49 smithi157 ceph-mon[129604]: pgmap v141: 129 pgs: 129 active+clean; 3.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 66 op/s 2023-08-10T10:55:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:49 smithi107 ceph-mon[127953]: pgmap v141: 129 pgs: 129 active+clean; 3.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 66 op/s 2023-08-10T10:55:50.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:49 smithi195 ceph-mon[129938]: pgmap v141: 129 pgs: 129 active+clean; 3.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 66 op/s 2023-08-10T10:55:50.509 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:55:50.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.741+0000 7f78bdd9d700 1 -- 172.21.15.107:0/3822884698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 msgr2=0x7f78b8067d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:50.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.741+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/3822884698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 0x7f78b8067d50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f78a40099c0 tx=0x7f78a4009cd0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.741+0000 7f78bdd9d700 1 -- 172.21.15.107:0/3822884698 shutdown_connections 2023-08-10T10:55:50.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.741+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/3822884698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78b8106660 0x7f78b8106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.742+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/3822884698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b8068290 0x7f78b810d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.742+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/3822884698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 0x7f78b8067d50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.742+0000 7f78bdd9d700 1 -- 172.21.15.107:0/3822884698 >> 172.21.15.107:0/3822884698 conn(0x7f78b8074f30 msgr2=0x7f78b8075340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:50.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.742+0000 7f78bdd9d700 1 -- 172.21.15.107:0/3822884698 shutdown_connections 2023-08-10T10:55:50.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.742+0000 7f78bdd9d700 1 -- 172.21.15.107:0/3822884698 wait complete. 2023-08-10T10:55:50.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.743+0000 7f78bdd9d700 1 Processor -- start 2023-08-10T10:55:50.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.743+0000 7f78bdd9d700 1 -- start start 2023-08-10T10:55:50.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.743+0000 7f78bdd9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 0x7f78b81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.743+0000 7f78bdd9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b8068290 0x7f78b8198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.743+0000 7f78bdd9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78b8106660 0x7f78b819cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.743+0000 7f78bdd9d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b819d5c0 con 0x7f78b80678d0 2023-08-10T10:55:50.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.743+0000 7f78bdd9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b819d730 con 0x7f78b8106660 2023-08-10T10:55:50.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.743+0000 7f78bdd9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b819d8f0 con 0x7f78b8068290 2023-08-10T10:55:50.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 0x7f78b81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b8068290 0x7f78b8198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 0x7f78b81985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35178/0 (socket says 172.21.15.107:35178) 2023-08-10T10:55:50.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78bcd9b700 1 -- 172.21.15.107:0/1933622457 learned_addr learned my addr 172.21.15.107:0/1933622457 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:50.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78bd59c700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78b8106660 0x7f78b819cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78b7fff700 1 -- 172.21.15.107:0/1933622457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78b8106660 msgr2=0x7f78b819cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:50.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78b7fff700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78b8106660 0x7f78b819cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78b7fff700 1 -- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 msgr2=0x7f78b81985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:50.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78b7fff700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 0x7f78b81985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78b7fff700 1 -- 172.21.15.107:0/1933622457 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40095f0 con 0x7f78b8068290 2023-08-10T10:55:50.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.744+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 0x7f78b81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:55:50.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.745+0000 7f78b7fff700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b8068290 0x7f78b8198b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78a4000c00 tx=0x7f78a400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:50.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.745+0000 7f78b5ffb700 1 -- 172.21.15.107:0/1933622457 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a401d070 con 0x7f78b8068290 2023-08-10T10:55:50.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.745+0000 7f78b5ffb700 1 -- 172.21.15.107:0/1933622457 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78a4005050 con 0x7f78b8068290 2023-08-10T10:55:50.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.745+0000 7f78bdd9d700 1 -- 172.21.15.107:0/1933622457 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b819db70 con 0x7f78b8068290 2023-08-10T10:55:50.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.745+0000 7f78b5ffb700 1 -- 172.21.15.107:0/1933622457 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4004a00 con 0x7f78b8068290 2023-08-10T10:55:50.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.745+0000 7f78bdd9d700 1 -- 172.21.15.107:0/1933622457 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b81a5410 con 0x7f78b8068290 2023-08-10T10:55:50.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.748+0000 7f78b5ffb700 1 -- 172.21.15.107:0/1933622457 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f78a40051c0 con 0x7f78b8068290 2023-08-10T10:55:50.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.751+0000 7f78b5ffb700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f78a80a13e0 0x7f78a80a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.751+0000 7f78d29cbb80 1 Processor -- start 2023-08-10T10:55:50.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.751+0000 7f78b5ffb700 1 -- 172.21.15.107:0/1933622457 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f78a40cdca0 con 0x7f78b8068290 2023-08-10T10:55:50.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.751+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f78a80a13e0 0x7f78a80a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.751+0000 7f78d29cbb80 1 -- start start 2023-08-10T10:55:50.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.751+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e4e4b0 0x55fba5e4e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.751+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e52d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.751+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e53290 0x55fba5e536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.751+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5dc9dc0 con 0x55fba5e4e4b0 2023-08-10T10:55:50.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5da6590 con 0x55fba5e53290 2023-08-10T10:55:50.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5da3eb0 con 0x55fba5e4edd0 2023-08-10T10:55:50.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e52d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e4e4b0 0x55fba5e4e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e4e4b0 0x55fba5e4e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35192/0 (socket says 172.21.15.107:35192) 2023-08-10T10:55:50.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78bcd9b700 1 -- 172.21.15.107:0/4022365649 learned_addr learned my addr 172.21.15.107:0/4022365649 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:50.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e52d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55498/0 (socket says 172.21.15.107:55498) 2023-08-10T10:55:50.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f78a80a13e0 0x7f78a80a38a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0104e0 tx=0x7f78ac0108a0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:50.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78b7fff700 1 -- 172.21.15.107:0/4022365649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e53290 msgr2=0x55fba5e536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:50.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78b7fff700 1 --2- 172.21.15.107:0/4022365649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e53290 0x55fba5e536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78b7fff700 1 -- 172.21.15.107:0/4022365649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e4e4b0 msgr2=0x55fba5e4e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:50.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78b7fff700 1 --2- 172.21.15.107:0/4022365649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e4e4b0 0x55fba5e4e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78b7fff700 1 -- 172.21.15.107:0/4022365649 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fba5c20630 con 0x55fba5e4edd0 2023-08-10T10:55:50.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.752+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/4022365649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e4e4b0 0x55fba5e4e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:55:50.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.753+0000 7f78b7fff700 1 --2- 172.21.15.107:0/4022365649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e52d50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f78a40cb090 tx=0x7f78a409aaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=869434523d9f6b4a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:50.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.753+0000 7f78a2ffd700 1 -- 172.21.15.107:0/4022365649 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40a2e60 con 0x55fba5e4edd0 2023-08-10T10:55:50.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.753+0000 7f78a2ffd700 1 -- 172.21.15.107:0/4022365649 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78a40054a0 con 0x55fba5e4edd0 2023-08-10T10:55:50.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.753+0000 7f78a2ffd700 1 -- 172.21.15.107:0/4022365649 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40a29d0 con 0x55fba5e4edd0 2023-08-10T10:55:50.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.754+0000 7f78d29cbb80 1 -- 172.21.15.107:0/4022365649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 msgr2=0x55fba5e52d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:50.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.754+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/4022365649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e52d50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f78a40cb090 tx=0x7f78a409aaa0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.754+0000 7f78d29cbb80 1 -- 172.21.15.107:0/4022365649 shutdown_connections 2023-08-10T10:55:50.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.754+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/4022365649 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e53290 0x55fba5e536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.754+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/4022365649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e4e4b0 0x55fba5e4e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.754+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/4022365649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e52d50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.754+0000 7f78d29cbb80 1 -- 172.21.15.107:0/4022365649 >> 172.21.15.107:0/4022365649 conn(0x55fba5dabcd0 msgr2=0x55fba5e49750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:50.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.754+0000 7f78d29cbb80 1 -- 172.21.15.107:0/4022365649 shutdown_connections 2023-08-10T10:55:50.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.754+0000 7f78d29cbb80 1 -- 172.21.15.107:0/4022365649 wait complete. 2023-08-10T10:55:50.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.755+0000 7f78d29cbb80 1 -- start start 2023-08-10T10:55:50.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.755+0000 7f78d29cbb80 1 Processor -- start 2023-08-10T10:55:50.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.755+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.755+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.755+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.755+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5d9f7a0 con 0x55fba5e53290 2023-08-10T10:55:50.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.755+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5d3eac0 con 0x55fba5e4e4b0 2023-08-10T10:55:50.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.755+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5d3e7c0 con 0x55fba5e4edd0 2023-08-10T10:55:50.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.755+0000 7f78d29cbb80 10 client.0 _ll_register_callbacks cb 0x55fba5d3c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:55:50.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bd59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:36644/0 (socket says 172.21.15.107:36644) 2023-08-10T10:55:50.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bcd9b700 1 -- 172.21.15.107:0/1953440627 learned_addr learned my addr 172.21.15.107:0/1953440627 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:50.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78b7fff700 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bd59c700 1 -- 172.21.15.107:0/1953440627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 msgr2=0x55fba5e57d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:50.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bd59c700 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bd59c700 1 -- 172.21.15.107:0/1953440627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 msgr2=0x55fba5e5aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:50.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bd59c700 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bd59c700 1 -- 172.21.15.107:0/1953440627 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ac013460 con 0x55fba5e53290 2023-08-10T10:55:50.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.756+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:55:50.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.757+0000 7f78bd59c700 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e583c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f78b0011d10 tx=0x7f78b000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18be29be7654e799 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:50.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.757+0000 7f7897fff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:55:50.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.757+0000 7f7897fff700 1 -- 172.21.15.107:0/1953440627 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b000e040 con 0x55fba5e53290 2023-08-10T10:55:50.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.757+0000 7f78d29cbb80 1 -- 172.21.15.107:0/1953440627 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fba5e41470 con 0x55fba5e53290 2023-08-10T10:55:50.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.757+0000 7f7897fff700 1 -- 172.21.15.107:0/1953440627 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f78b0004bb0 con 0x55fba5e53290 2023-08-10T10:55:50.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.757+0000 7f7897fff700 1 -- 172.21.15.107:0/1953440627 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78b0011ec0 con 0x55fba5e53290 2023-08-10T10:55:50.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.757+0000 7f78d29cbb80 10 client.16494 fetch_fsmap learned FSMap version 34 2023-08-10T10:55:50.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.757+0000 7f78d29cbb80 1 -- 172.21.15.107:0/1953440627 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f78b81a5410 con 0x55fba5e53290 2023-08-10T10:55:50.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.758+0000 7f7897fff700 1 -- 172.21.15.107:0/1953440627 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fba5e41470 con 0x55fba5e53290 2023-08-10T10:55:50.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.758+0000 7f7897fff700 1 -- 172.21.15.107:0/1953440627 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 34) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f78b001b020 con 0x55fba5e53290 2023-08-10T10:55:50.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.758+0000 7f78d29cbb80 10 client.16494 fetch_fsmap finished waiting for FSMap version 34 2023-08-10T10:55:50.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.758+0000 7f78d29cbb80 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:55:50.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.758+0000 7f78d29cbb80 20 client.16494 populate_metadata read hostname 'smithi107' 2023-08-10T10:55:50.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.758+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fba5e68200 0x55fba5e6a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.758+0000 7f78d29cbb80 4 client.16494 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:55:50.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.758+0000 7f78d29cbb80 1 -- 172.21.15.107:0/1953440627 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fba5e1d9d0 con 0x55fba5e68200 2023-08-10T10:55:50.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.759+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fba5e68200 0x55fba5e6a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.759+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fba5e68200 0x55fba5e6a620 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=574182273e8b3605 server_cookie=6562e57fea084598 in_seq=0 out_seq=0 2023-08-10T10:55:50.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.759+0000 7f7897fff700 10 client.16494 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:55:50.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.760+0000 7f7897fff700 1 -- 172.21.15.107:0/1953440627 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55fba5e1d9d0 con 0x55fba5e68200 2023-08-10T10:55:50.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.760+0000 7f7897fff700 10 client.16494 handle_command_reply: tid=0 2023-08-10T10:55:50.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.760+0000 7f78d29cbb80 1 client.16494 shutdown 2023-08-10T10:55:50.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.760+0000 7f78d29cbb80 1 -- 172.21.15.107:0/1953440627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 msgr2=0x55fba5e583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:50.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.760+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e583c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f78b0011d10 tx=0x7f78b000f490 comp rx=0 tx=0).stop 2023-08-10T10:55:50.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f78d29cbb80 1 -- 172.21.15.107:0/1953440627 shutdown_connections 2023-08-10T10:55:50.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fba5e68200 0x55fba5e6a620 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e583c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f7897fff700 0 client.16494 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:55:50.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/1953440627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f78d29cbb80 1 -- 172.21.15.107:0/1953440627 >> 172.21.15.107:0/1953440627 conn(0x55fba5dabcd0 msgr2=0x55fba5e54740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:50.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f78d29cbb80 1 -- 172.21.15.107:0/1953440627 shutdown_connections 2023-08-10T10:55:50.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f78d29cbb80 1 -- 172.21.15.107:0/1953440627 wait complete. 2023-08-10T10:55:50.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.761+0000 7f78d29cbb80 20 client.16494 trim_cache size 0 max 16384 2023-08-10T10:55:50.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.783+0000 7f78d29cbb80 1 Processor -- start 2023-08-10T10:55:50.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.783+0000 7f78d29cbb80 1 -- start start 2023-08-10T10:55:50.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.783+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.783+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.783+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.783+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5c22920 con 0x55fba5e53290 2023-08-10T10:55:50.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.783+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5e4f5f0 con 0x55fba5e4e4b0 2023-08-10T10:55:50.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.783+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5e58090 con 0x55fba5e4edd0 2023-08-10T10:55:50.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bd59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bd59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35218/0 (socket says 172.21.15.107:35218) 2023-08-10T10:55:50.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:36660/0 (socket says 172.21.15.107:36660) 2023-08-10T10:55:50.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bcd9b700 1 -- 172.21.15.107:0/2332997809 learned_addr learned my addr 172.21.15.107:0/2332997809 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:50.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55524/0 (socket says 172.21.15.107:55524) 2023-08-10T10:55:50.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bcd9b700 1 -- 172.21.15.107:0/2332997809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 msgr2=0x55fba5e57610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:50.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/2332997809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bcd9b700 1 -- 172.21.15.107:0/2332997809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 msgr2=0x55fba5e57b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:50.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/2332997809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bcd9b700 1 -- 172.21.15.107:0/2332997809 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fba5bccde0 con 0x55fba5e4e4b0 2023-08-10T10:55:50.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78b7fff700 1 --2- 172.21.15.107:0/2332997809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:55:50.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bd59c700 1 --2- 172.21.15.107:0/2332997809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:55:50.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.784+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/2332997809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5f260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55fba5e6af30 tx=0x7f78ac015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e19081a826247af server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:50.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.785+0000 7f78a37fe700 1 -- 172.21.15.107:0/2332997809 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac024040 con 0x55fba5e4e4b0 2023-08-10T10:55:50.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.785+0000 7f78a37fe700 1 -- 172.21.15.107:0/2332997809 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78ac029420 con 0x55fba5e4e4b0 2023-08-10T10:55:50.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.785+0000 7f78a37fe700 1 -- 172.21.15.107:0/2332997809 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011c70 con 0x55fba5e4e4b0 2023-08-10T10:55:50.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.785+0000 7f78d29cbb80 1 -- 172.21.15.107:0/2332997809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 msgr2=0x55fba5e5f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:50.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.785+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/2332997809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5f260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55fba5e6af30 tx=0x7f78ac015000 comp rx=0 tx=0).stop 2023-08-10T10:55:50.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.785+0000 7f78d29cbb80 1 -- 172.21.15.107:0/2332997809 shutdown_connections 2023-08-10T10:55:50.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.785+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/2332997809 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4e4b0 0x55fba5e5f260 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.786+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/2332997809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.786+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/2332997809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4edd0 0x55fba5e57610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.786+0000 7f78d29cbb80 1 -- 172.21.15.107:0/2332997809 >> 172.21.15.107:0/2332997809 conn(0x55fba5dabcd0 msgr2=0x55fba5e49280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:50.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.786+0000 7f78d29cbb80 1 -- 172.21.15.107:0/2332997809 shutdown_connections 2023-08-10T10:55:50.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.786+0000 7f78d29cbb80 1 -- 172.21.15.107:0/2332997809 wait complete. 2023-08-10T10:55:50.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.786+0000 7f78d29cbb80 1 -- start start 2023-08-10T10:55:50.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.786+0000 7f78d29cbb80 1 Processor -- start 2023-08-10T10:55:50.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4e4b0 0x55fba5e56780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4edd0 0x55fba5e56cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78d29cbb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5ebbf40 con 0x55fba5e53290 2023-08-10T10:55:50.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5ebc0b0 con 0x55fba5e4edd0 2023-08-10T10:55:50.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78d29cbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba5ebc270 con 0x55fba5e4e4b0 2023-08-10T10:55:50.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78d29cbb80 10 client.0 _ll_register_callbacks cb 0x55fba5d3c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:55:50.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4e4b0 0x55fba5e56780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78bd59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78bcd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4e4b0 0x55fba5e56780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55528/0 (socket says 172.21.15.107:55528) 2023-08-10T10:55:50.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78bcd9b700 1 -- 172.21.15.107:0/3374291839 learned_addr learned my addr 172.21.15.107:0/3374291839 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:55:50.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.787+0000 7f78b7fff700 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4edd0 0x55fba5e56cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f78bcd9b700 1 -- 172.21.15.107:0/3374291839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4edd0 msgr2=0x55fba5e56cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:50.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4edd0 0x55fba5e56cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f78bcd9b700 1 -- 172.21.15.107:0/3374291839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 msgr2=0x55fba5e57200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:55:50.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f78bcd9b700 1 -- 172.21.15.107:0/3374291839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fba5c20630 con 0x55fba5e4e4b0 2023-08-10T10:55:50.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f78b7fff700 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4edd0 0x55fba5e56cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:55:50.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f78bcd9b700 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4e4b0 0x55fba5e56780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78ac007e60 tx=0x7f78ac029f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b4aa5b0f677ed9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:55:50.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f7897fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:55:50.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f7897fff700 1 -- 172.21.15.107:0/3374291839 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac024040 con 0x55fba5e4e4b0 2023-08-10T10:55:50.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f78d29cbb80 1 -- 172.21.15.107:0/3374291839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78a40054a0 con 0x55fba5e4e4b0 2023-08-10T10:55:50.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.788+0000 7f7897fff700 1 -- 172.21.15.107:0/3374291839 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f78ac019040 con 0x55fba5e4e4b0 2023-08-10T10:55:50.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f7897fff700 1 -- 172.21.15.107:0/3374291839 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78ac013bf0 con 0x55fba5e4e4b0 2023-08-10T10:55:50.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f78d29cbb80 10 client.26194 fetch_fsmap learned FSMap version 34 2023-08-10T10:55:50.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f78d29cbb80 1 -- 172.21.15.107:0/3374291839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f78b81a5410 con 0x55fba5e4e4b0 2023-08-10T10:55:50.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f7897fff700 1 -- 172.21.15.107:0/3374291839 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78a40054a0 con 0x55fba5e4e4b0 2023-08-10T10:55:50.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f7897fff700 1 -- 172.21.15.107:0/3374291839 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 34) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f78ac03b070 con 0x55fba5e4e4b0 2023-08-10T10:55:50.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f78d29cbb80 10 client.26194 fetch_fsmap finished waiting for FSMap version 34 2023-08-10T10:55:50.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f78d29cbb80 10 client.26194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:55:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f78d29cbb80 20 client.26194 populate_metadata read hostname 'smithi107' 2023-08-10T10:55:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fba5ebd960 0x55fba5ebfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:55:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f78d29cbb80 4 client.26194 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:55:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.789+0000 7f78d29cbb80 1 -- 172.21.15.107:0/3374291839 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fba5d98780 con 0x55fba5ebd960 2023-08-10T10:55:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.790+0000 7f78b7fff700 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fba5ebd960 0x55fba5ebfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:55:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.790+0000 7f78b7fff700 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fba5ebd960 0x55fba5ebfd80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d2523776de7645 server_cookie=bf918b9b5a85bf24 in_seq=0 out_seq=0 2023-08-10T10:55:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.790+0000 7f7897fff700 10 client.26194 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:55:50.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f7897fff700 1 -- 172.21.15.107:0/3374291839 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fba5d98780 con 0x55fba5ebd960 2023-08-10T10:55:50.799 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f7897fff700 10 client.26194 handle_command_reply: tid=0 2023-08-10T10:55:50.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 client.26194 shutdown 2023-08-10T10:55:50.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 -- 172.21.15.107:0/3374291839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4e4b0 msgr2=0x55fba5e56780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:50.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4e4b0 0x55fba5e56780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78ac007e60 tx=0x7f78ac029f30 comp rx=0 tx=0).stop 2023-08-10T10:55:50.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 -- 172.21.15.107:0/3374291839 shutdown_connections 2023-08-10T10:55:50.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fba5ebd960 0x55fba5ebfd80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.800 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fba5e53290 0x55fba5e57200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fba5e4e4b0 0x55fba5e56780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f7897fff700 0 client.26194 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:55:50.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 --2- 172.21.15.107:0/3374291839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fba5e4edd0 0x55fba5e56cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 -- 172.21.15.107:0/3374291839 >> 172.21.15.107:0/3374291839 conn(0x55fba5dabcd0 msgr2=0x55fba5e480f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:50.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 -- 172.21.15.107:0/3374291839 shutdown_connections 2023-08-10T10:55:50.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 1 -- 172.21.15.107:0/3374291839 wait complete. 2023-08-10T10:55:50.801 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.791+0000 7f78d29cbb80 20 client.26194 trim_cache size 0 max 16384 2023-08-10T10:55:50.802 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:55:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:55:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:55:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:55:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:55:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:55:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:55:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:55:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:55:50.803 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:55:50.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 -- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f78a80a13e0 msgr2=0x7f78a80a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:50.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f78a80a13e0 0x7f78a80a38a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0104e0 tx=0x7f78ac0108a0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.804 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 -- 172.21.15.107:0/1933622457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b8068290 msgr2=0x7f78b8198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:55:50.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b8068290 0x7f78b8198b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78a4000c00 tx=0x7f78a400f690 comp rx=0 tx=0).stop 2023-08-10T10:55:50.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 -- 172.21.15.107:0/1933622457 shutdown_connections 2023-08-10T10:55:50.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f78a80a13e0 0x7f78a80a38a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78b8106660 0x7f78b819cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b80678d0 0x7f78b81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 --2- 172.21.15.107:0/1933622457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b8068290 0x7f78b8198b20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:55:50.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 -- 172.21.15.107:0/1933622457 >> 172.21.15.107:0/1933622457 conn(0x7f78b8074f30 msgr2=0x7f78b810b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:55:50.805 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 -- 172.21.15.107:0/1933622457 shutdown_connections 2023-08-10T10:55:50.806 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:55:50.792+0000 7f78bdd9d700 1 -- 172.21.15.107:0/1933622457 wait complete. 2023-08-10T10:55:50.812 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:55:51.083 INFO:teuthology.orchestra.run.smithi107.stderr:17100000 of 50000000 tuples (34%) done (elapsed 249.26 s, remaining 479.57 s) 2023-08-10T10:55:52.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:51 smithi157 ceph-mon[129604]: pgmap v142: 129 pgs: 129 active+clean; 3.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:55:52.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:51 smithi107 ceph-mon[127953]: pgmap v142: 129 pgs: 129 active+clean; 3.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:55:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:51 smithi195 ceph-mon[129938]: pgmap v142: 129 pgs: 129 active+clean; 3.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:55:52.325 INFO:teuthology.orchestra.run.smithi107.stderr:17200000 of 50000000 tuples (34%) done (elapsed 250.50 s, remaining 477.70 s) 2023-08-10T10:55:53.558 INFO:teuthology.orchestra.run.smithi107.stderr:17300000 of 50000000 tuples (34%) done (elapsed 251.74 s, remaining 475.82 s) 2023-08-10T10:55:54.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:53 smithi157 ceph-mon[129604]: pgmap v143: 129 pgs: 129 active+clean; 3.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:55:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:53 smithi107 ceph-mon[127953]: pgmap v143: 129 pgs: 129 active+clean; 3.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:55:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:53 smithi195 ceph-mon[129938]: pgmap v143: 129 pgs: 129 active+clean; 3.9 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:55:54.837 INFO:teuthology.orchestra.run.smithi107.stderr:17400000 of 50000000 tuples (34%) done (elapsed 253.01 s, remaining 474.04 s) 2023-08-10T10:55:56.031 INFO:teuthology.orchestra.run.smithi107.stderr:17500000 of 50000000 tuples (35%) done (elapsed 254.21 s, remaining 472.10 s) 2023-08-10T10:55:56.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:55 smithi157 ceph-mon[129604]: pgmap v144: 129 pgs: 129 active+clean; 4.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 64 op/s 2023-08-10T10:55:56.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:55 smithi107 ceph-mon[127953]: pgmap v144: 129 pgs: 129 active+clean; 4.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 64 op/s 2023-08-10T10:55:56.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:55 smithi195 ceph-mon[129938]: pgmap v144: 129 pgs: 129 active+clean; 4.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 64 op/s 2023-08-10T10:55:57.289 INFO:teuthology.orchestra.run.smithi107.stderr:17600000 of 50000000 tuples (35%) done (elapsed 255.47 s, remaining 470.29 s) 2023-08-10T10:55:58.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:57 smithi157 ceph-mon[129604]: pgmap v145: 129 pgs: 129 active+clean; 4.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 32 op/s 2023-08-10T10:55:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:57 smithi107 ceph-mon[127953]: pgmap v145: 129 pgs: 129 active+clean; 4.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 32 op/s 2023-08-10T10:55:58.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:57 smithi195 ceph-mon[129938]: pgmap v145: 129 pgs: 129 active+clean; 4.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 32 op/s 2023-08-10T10:55:58.590 INFO:teuthology.orchestra.run.smithi107.stderr:17700000 of 50000000 tuples (35%) done (elapsed 256.77 s, remaining 468.56 s) 2023-08-10T10:55:59.894 INFO:teuthology.orchestra.run.smithi107.stderr:17800000 of 50000000 tuples (35%) done (elapsed 258.07 s, remaining 466.85 s) 2023-08-10T10:56:00.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:55:59 smithi157 ceph-mon[129604]: pgmap v146: 129 pgs: 129 active+clean; 4.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 49 op/s 2023-08-10T10:56:00.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:55:59 smithi107 ceph-mon[127953]: pgmap v146: 129 pgs: 129 active+clean; 4.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 49 op/s 2023-08-10T10:56:00.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:55:59 smithi195 ceph-mon[129938]: pgmap v146: 129 pgs: 129 active+clean; 4.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 49 op/s 2023-08-10T10:56:01.193 INFO:teuthology.orchestra.run.smithi107.stderr:17900000 of 50000000 tuples (35%) done (elapsed 259.37 s, remaining 465.13 s) 2023-08-10T10:56:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:01 smithi157 ceph-mon[129604]: pgmap v147: 129 pgs: 129 active+clean; 4.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-08-10T10:56:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:01 smithi107 ceph-mon[127953]: pgmap v147: 129 pgs: 129 active+clean; 4.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-08-10T10:56:02.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:01 smithi195 ceph-mon[129938]: pgmap v147: 129 pgs: 129 active+clean; 4.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-08-10T10:56:03.014 INFO:teuthology.orchestra.run.smithi107.stderr:18000000 of 50000000 tuples (36%) done (elapsed 261.19 s, remaining 464.34 s) 2023-08-10T10:56:04.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:03 smithi157 ceph-mon[129604]: pgmap v148: 129 pgs: 129 active+clean; 4.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-08-10T10:56:04.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:03 smithi107 ceph-mon[127953]: pgmap v148: 129 pgs: 129 active+clean; 4.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-08-10T10:56:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:03 smithi195 ceph-mon[129938]: pgmap v148: 129 pgs: 129 active+clean; 4.1 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-08-10T10:56:04.227 INFO:teuthology.orchestra.run.smithi107.stderr:18100000 of 50000000 tuples (36%) done (elapsed 262.40 s, remaining 462.47 s) 2023-08-10T10:56:05.502 INFO:teuthology.orchestra.run.smithi107.stderr:18200000 of 50000000 tuples (36%) done (elapsed 263.68 s, remaining 460.71 s) 2023-08-10T10:56:06.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:05 smithi157 ceph-mon[129604]: pgmap v149: 129 pgs: 129 active+clean; 4.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 34 MiB/s wr, 77 op/s 2023-08-10T10:56:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:05 smithi107 ceph-mon[127953]: pgmap v149: 129 pgs: 129 active+clean; 4.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 34 MiB/s wr, 77 op/s 2023-08-10T10:56:06.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:05 smithi195 ceph-mon[129938]: pgmap v149: 129 pgs: 129 active+clean; 4.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 34 MiB/s wr, 77 op/s 2023-08-10T10:56:07.821 INFO:teuthology.orchestra.run.smithi107.stderr:18300000 of 50000000 tuples (36%) done (elapsed 266.00 s, remaining 460.77 s) 2023-08-10T10:56:08.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:07 smithi157 ceph-mon[129604]: pgmap v150: 129 pgs: 129 active+clean; 4.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 23 MiB/s wr, 56 op/s 2023-08-10T10:56:08.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:07 smithi107 ceph-mon[127953]: pgmap v150: 129 pgs: 129 active+clean; 4.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 23 MiB/s wr, 56 op/s 2023-08-10T10:56:08.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:07 smithi195 ceph-mon[129938]: pgmap v150: 129 pgs: 129 active+clean; 4.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 23 MiB/s wr, 56 op/s 2023-08-10T10:56:09.134 INFO:teuthology.orchestra.run.smithi107.stderr:18400000 of 50000000 tuples (36%) done (elapsed 267.31 s, remaining 459.08 s) 2023-08-10T10:56:10.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:09 smithi157 ceph-mon[129604]: pgmap v151: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 32 MiB/s wr, 85 op/s 2023-08-10T10:56:10.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:09 smithi107 ceph-mon[127953]: pgmap v151: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 32 MiB/s wr, 85 op/s 2023-08-10T10:56:10.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:09 smithi195 ceph-mon[129938]: pgmap v151: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 32 MiB/s wr, 85 op/s 2023-08-10T10:56:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:11 smithi157 ceph-mon[129604]: pgmap v152: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-08-10T10:56:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:11 smithi107 ceph-mon[127953]: pgmap v152: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-08-10T10:56:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:11 smithi195 ceph-mon[129938]: pgmap v152: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-08-10T10:56:13.450 INFO:teuthology.orchestra.run.smithi107.stderr:18500000 of 50000000 tuples (37%) done (elapsed 271.63 s, remaining 462.50 s) 2023-08-10T10:56:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:13 smithi157 ceph-mon[129604]: pgmap v153: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-08-10T10:56:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:13 smithi107 ceph-mon[127953]: pgmap v153: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-08-10T10:56:14.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:13 smithi195 ceph-mon[129938]: pgmap v153: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-08-10T10:56:14.753 INFO:teuthology.orchestra.run.smithi107.stderr:18600000 of 50000000 tuples (37%) done (elapsed 272.93 s, remaining 460.75 s) 2023-08-10T10:56:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:15 smithi157 ceph-mon[129604]: pgmap v154: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 24 MiB/s wr, 77 op/s 2023-08-10T10:56:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:15 smithi107 ceph-mon[127953]: pgmap v154: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 24 MiB/s wr, 77 op/s 2023-08-10T10:56:16.144 INFO:teuthology.orchestra.run.smithi107.stderr:18700000 of 50000000 tuples (37%) done (elapsed 274.32 s, remaining 459.16 s) 2023-08-10T10:56:16.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:15 smithi195 ceph-mon[129938]: pgmap v154: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 24 MiB/s wr, 77 op/s 2023-08-10T10:56:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:18800000 of 50000000 tuples (37%) done (elapsed 275.56 s, remaining 457.31 s) 2023-08-10T10:56:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:17 smithi157 ceph-mon[129604]: pgmap v155: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 37 op/s 2023-08-10T10:56:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:17 smithi107 ceph-mon[127953]: pgmap v155: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 37 op/s 2023-08-10T10:56:18.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:17 smithi195 ceph-mon[129938]: pgmap v155: 129 pgs: 129 active+clean; 4.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 37 op/s 2023-08-10T10:56:18.835 INFO:teuthology.orchestra.run.smithi107.stderr:18900000 of 50000000 tuples (37%) done (elapsed 277.01 s, remaining 455.83 s) 2023-08-10T10:56:20.027 INFO:teuthology.orchestra.run.smithi107.stderr:19000000 of 50000000 tuples (38%) done (elapsed 278.20 s, remaining 453.91 s) 2023-08-10T10:56:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:19 smithi157 ceph-mon[129604]: pgmap v156: 129 pgs: 129 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 25 MiB/s wr, 67 op/s 2023-08-10T10:56:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:19 smithi107 ceph-mon[127953]: pgmap v156: 129 pgs: 129 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 25 MiB/s wr, 67 op/s 2023-08-10T10:56:20.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:19 smithi195 ceph-mon[129938]: pgmap v156: 129 pgs: 129 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 25 MiB/s wr, 67 op/s 2023-08-10T10:56:20.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:56:21.063 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.062+0000 7f27df7ff700 1 -- 172.21.15.107:0/1020216790 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d81066f0 msgr2=0x7f27d8106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:21.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.062+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1020216790 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d81066f0 0x7f27d8106ad0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009990 tx=0x7f27d4009ca0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.062+0000 7f27df7ff700 1 -- 172.21.15.107:0/1020216790 shutdown_connections 2023-08-10T10:56:21.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.062+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1020216790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d81010a0 0x7f27d810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.062+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1020216790 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d81066f0 0x7f27d8106ad0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.062+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1020216790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d81006e0 0x7f27d8100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.062+0000 7f27df7ff700 1 -- 172.21.15.107:0/1020216790 >> 172.21.15.107:0/1020216790 conn(0x7f27d80fc1d0 msgr2=0x7f27d80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:21.064 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.062+0000 7f27df7ff700 1 -- 172.21.15.107:0/1020216790 shutdown_connections 2023-08-10T10:56:21.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.062+0000 7f27df7ff700 1 -- 172.21.15.107:0/1020216790 wait complete. 2023-08-10T10:56:21.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.063+0000 7f27df7ff700 1 Processor -- start 2023-08-10T10:56:21.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27df7ff700 1 -- start start 2023-08-10T10:56:21.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27df7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d81006e0 0x7f27d819e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27df7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d81010a0 0x7f27d819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27df7ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d81066f0 0x7f27d81986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27df7ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8198da0 con 0x7f27d81066f0 2023-08-10T10:56:21.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27df7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8198f10 con 0x7f27d81006e0 2023-08-10T10:56:21.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27df7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d81990d0 con 0x7f27d81010a0 2023-08-10T10:56:21.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27dcd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d81010a0 0x7f27d819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27ddd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d81066f0 0x7f27d81986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27dcd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d81010a0 0x7f27d819eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58686/0 (socket says 172.21.15.107:58686) 2023-08-10T10:56:21.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27dcd9a700 1 -- 172.21.15.107:0/1108712853 learned_addr learned my addr 172.21.15.107:0/1108712853 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:21.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.064+0000 7f27dd59b700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d81006e0 0x7f27d819e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27dcd9a700 1 -- 172.21.15.107:0/1108712853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d81006e0 msgr2=0x7f27d819e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:21.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27dcd9a700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d81006e0 0x7f27d819e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27dcd9a700 1 -- 172.21.15.107:0/1108712853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d81066f0 msgr2=0x7f27d81986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:21.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27dcd9a700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d81066f0 0x7f27d81986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27dcd9a700 1 -- 172.21.15.107:0/1108712853 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40095f0 con 0x7f27d81010a0 2023-08-10T10:56:21.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27dcd9a700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d81010a0 0x7f27d819eba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f27c800e9a0 tx=0x7f27c800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:21.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27ce7fc700 1 -- 172.21.15.107:0/1108712853 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8009790 con 0x7f27d81010a0 2023-08-10T10:56:21.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27df7ff700 1 -- 172.21.15.107:0/1108712853 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d81993b0 con 0x7f27d81010a0 2023-08-10T10:56:21.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27ce7fc700 1 -- 172.21.15.107:0/1108712853 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27c8010430 con 0x7f27d81010a0 2023-08-10T10:56:21.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27ce7fc700 1 -- 172.21.15.107:0/1108712853 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800cea0 con 0x7f27d81010a0 2023-08-10T10:56:21.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.065+0000 7f27df7ff700 1 -- 172.21.15.107:0/1108712853 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d81a5690 con 0x7f27d81010a0 2023-08-10T10:56:21.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.069+0000 7f27ce7fc700 1 -- 172.21.15.107:0/1108712853 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f27c80105a0 con 0x7f27d81010a0 2023-08-10T10:56:21.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.070+0000 7f27f310ab80 1 Processor -- start 2023-08-10T10:56:21.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.070+0000 7f27f310ab80 1 -- start start 2023-08-10T10:56:21.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b9f50 0x55f0140ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27ce7fc700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f27c40a12c0 0x7f27c40a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b4800 0x55f0140b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27f310ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f01402fdc0 con 0x55f0140b9f50 2023-08-10T10:56:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27f310ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f01400c590 con 0x55f0140b4800 2023-08-10T10:56:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27f310ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f014009eb0 con 0x55f0140ba870 2023-08-10T10:56:21.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27ce7fc700 1 -- 172.21.15.107:0/1108712853 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f27c8014070 con 0x7f27d81010a0 2023-08-10T10:56:21.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27ddd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b9f50 0x55f0140ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27ddd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b9f50 0x55f0140ba330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53974/0 (socket says 172.21.15.107:53974) 2023-08-10T10:56:21.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27ddd9c700 1 -- 172.21.15.107:0/102076354 learned_addr learned my addr 172.21.15.107:0/102076354 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:21.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27dd59b700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f27c40a12c0 0x7f27c40a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/102076354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b4800 0x55f0140b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.071+0000 7f27dcd9a700 1 --2- 172.21.15.107:0/102076354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27ddd9c700 1 -- 172.21.15.107:0/102076354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 msgr2=0x55f0140b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:21.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/102076354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27ddd9c700 1 -- 172.21.15.107:0/102076354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b4800 msgr2=0x55f0140b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:21.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/102076354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b4800 0x55f0140b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27ddd9c700 1 -- 172.21.15.107:0/102076354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f013e86630 con 0x55f0140b9f50 2023-08-10T10:56:21.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/102076354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b9f50 0x55f0140ba330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f27d0014db0 tx=0x7f27d0007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cafeb9bb08ee2f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:21.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27dd59b700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f27c40a12c0 0x7f27c40a3780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f27d4006010 tx=0x7f27d400b260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:21.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27c37fe700 1 -- 172.21.15.107:0/102076354 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0014ea0 con 0x55f0140b9f50 2023-08-10T10:56:21.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27c37fe700 1 -- 172.21.15.107:0/102076354 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27d00193f0 con 0x55f0140b9f50 2023-08-10T10:56:21.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.072+0000 7f27c37fe700 1 -- 172.21.15.107:0/102076354 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0018640 con 0x55f0140b9f50 2023-08-10T10:56:21.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.073+0000 7f27f310ab80 1 -- 172.21.15.107:0/102076354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b9f50 msgr2=0x55f0140ba330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:21.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.073+0000 7f27f310ab80 1 --2- 172.21.15.107:0/102076354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b9f50 0x55f0140ba330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f27d0014db0 tx=0x7f27d0007d40 comp rx=0 tx=0).stop 2023-08-10T10:56:21.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.073+0000 7f27f310ab80 1 -- 172.21.15.107:0/102076354 shutdown_connections 2023-08-10T10:56:21.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.073+0000 7f27f310ab80 1 --2- 172.21.15.107:0/102076354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b4800 0x55f0140b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.073+0000 7f27f310ab80 1 --2- 172.21.15.107:0/102076354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b9f50 0x55f0140ba330 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.073+0000 7f27f310ab80 1 --2- 172.21.15.107:0/102076354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.073+0000 7f27f310ab80 1 -- 172.21.15.107:0/102076354 >> 172.21.15.107:0/102076354 conn(0x55f014011cd0 msgr2=0x55f0140af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:21.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.073+0000 7f27f310ab80 1 -- 172.21.15.107:0/102076354 shutdown_connections 2023-08-10T10:56:21.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.073+0000 7f27f310ab80 1 -- 172.21.15.107:0/102076354 wait complete. 2023-08-10T10:56:21.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.074+0000 7f27f310ab80 1 -- start start 2023-08-10T10:56:21.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.074+0000 7f27f310ab80 1 Processor -- start 2023-08-10T10:56:21.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 0x55f0140bdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27f310ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0140057a0 con 0x55f0140b4800 2023-08-10T10:56:21.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27f310ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f013fa4ac0 con 0x55f0140b9f50 2023-08-10T10:56:21.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27f310ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f013fa47c0 con 0x55f0140ba870 2023-08-10T10:56:21.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27f310ab80 10 client.0 _ll_register_callbacks cb 0x55f013fa2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:56:21.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27ddd9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27dd59b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27ddd9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140be2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58698/0 (socket says 172.21.15.107:58698) 2023-08-10T10:56:21.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27dcd9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 0x55f0140bdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27ddd9c700 1 -- 172.21.15.107:0/1807007904 learned_addr learned my addr 172.21.15.107:0/1807007904 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:21.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27ddd9c700 1 -- 172.21.15.107:0/1807007904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 msgr2=0x55f0140bdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:21.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 0x55f0140bdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27ddd9c700 1 -- 172.21.15.107:0/1807007904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 msgr2=0x55f0140c08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:21.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.075+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.076+0000 7f27ddd9c700 1 -- 172.21.15.107:0/1807007904 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d0014a90 con 0x55f0140ba870 2023-08-10T10:56:21.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.076+0000 7f27dcd9a700 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 0x55f0140bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:56:21.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.076+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140be2b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f27d0019cf0 tx=0x7f27d0014500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa61e59e790ac62 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:21.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.076+0000 7f27c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:56:21.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.076+0000 7f27c0ff9700 1 -- 172.21.15.107:0/1807007904 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0014ea0 con 0x55f0140ba870 2023-08-10T10:56:21.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.076+0000 7f27f310ab80 1 -- 172.21.15.107:0/1807007904 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0140a7470 con 0x55f0140ba870 2023-08-10T10:56:21.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.076+0000 7f27c0ff9700 1 -- 172.21.15.107:0/1807007904 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f27d0003a00 con 0x55f0140ba870 2023-08-10T10:56:21.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.076+0000 7f27c0ff9700 1 -- 172.21.15.107:0/1807007904 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27d0006000 con 0x55f0140ba870 2023-08-10T10:56:21.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27f310ab80 10 client.26206 fetch_fsmap learned FSMap version 34 2023-08-10T10:56:21.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27f310ab80 1 -- 172.21.15.107:0/1807007904 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f013e32de0 con 0x55f0140ba870 2023-08-10T10:56:21.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27c0ff9700 1 -- 172.21.15.107:0/1807007904 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0140a7470 con 0x55f0140ba870 2023-08-10T10:56:21.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27c0ff9700 1 -- 172.21.15.107:0/1807007904 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 34) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f27d0003cc0 con 0x55f0140ba870 2023-08-10T10:56:21.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27f310ab80 10 client.26206 fetch_fsmap finished waiting for FSMap version 34 2023-08-10T10:56:21.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27f310ab80 10 client.26206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:56:21.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27f310ab80 20 client.26206 populate_metadata read hostname 'smithi107' 2023-08-10T10:56:21.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27f310ab80 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f0140ce150 0x55f0140d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27f310ab80 4 client.26206 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:56:21.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.077+0000 7f27f310ab80 1 -- 172.21.15.107:0/1807007904 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0140839d0 con 0x55f0140ce150 2023-08-10T10:56:21.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.078+0000 7f27dd59b700 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f0140ce150 0x55f0140d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.078+0000 7f27dd59b700 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f0140ce150 0x55f0140d0570 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7153483f600d1d58 server_cookie=9bf311ad76515029 in_seq=0 out_seq=0 2023-08-10T10:56:21.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.078+0000 7f27c0ff9700 10 client.26206 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:56:21.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.079+0000 7f27c0ff9700 1 -- 172.21.15.107:0/1807007904 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f0140839d0 con 0x55f0140ce150 2023-08-10T10:56:21.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.079+0000 7f27c0ff9700 10 client.26206 handle_command_reply: tid=0 2023-08-10T10:56:21.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.079+0000 7f27f310ab80 1 client.26206 shutdown 2023-08-10T10:56:21.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.079+0000 7f27f310ab80 1 -- 172.21.15.107:0/1807007904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 msgr2=0x55f0140be2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:21.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.079+0000 7f27f310ab80 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140be2b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f27d0019cf0 tx=0x7f27d0014500 comp rx=0 tx=0).stop 2023-08-10T10:56:21.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.079+0000 7f27f310ab80 1 -- 172.21.15.107:0/1807007904 shutdown_connections 2023-08-10T10:56:21.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.079+0000 7f27f310ab80 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f0140ce150 0x55f0140d0570 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.080+0000 7f27f310ab80 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140be2b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.080+0000 7f27f310ab80 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.080+0000 7f27f310ab80 1 --2- 172.21.15.107:0/1807007904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 0x55f0140bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.080+0000 7f27f310ab80 1 -- 172.21.15.107:0/1807007904 >> 172.21.15.107:0/1807007904 conn(0x55f014011cd0 msgr2=0x55f0140ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:21.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.080+0000 7f27c0ff9700 0 client.26206 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:56:21.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.080+0000 7f27f310ab80 1 -- 172.21.15.107:0/1807007904 shutdown_connections 2023-08-10T10:56:21.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.080+0000 7f27f310ab80 1 -- 172.21.15.107:0/1807007904 wait complete. 2023-08-10T10:56:21.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.080+0000 7f27f310ab80 20 client.26206 trim_cache size 0 max 16384 2023-08-10T10:56:21.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.106+0000 7f27f310ab80 1 Processor -- start 2023-08-10T10:56:21.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.106+0000 7f27f310ab80 1 -- start start 2023-08-10T10:56:21.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.106+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.106+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 0x55f0140c0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.106+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140af130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.106+0000 7f27f310ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f013e88920 con 0x55f0140b4800 2023-08-10T10:56:21.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.106+0000 7f27f310ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0140b8800 con 0x55f0140b9f50 2023-08-10T10:56:21.108 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.106+0000 7f27f310ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0140beef0 con 0x55f0140ba870 2023-08-10T10:56:21.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27dd59b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27dcd9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 0x55f0140c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27dd59b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53986/0 (socket says 172.21.15.107:53986) 2023-08-10T10:56:21.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27dd59b700 1 -- 172.21.15.107:0/4246132961 learned_addr learned my addr 172.21.15.107:0/4246132961 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:21.109 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/4246132961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27dd59b700 1 -- 172.21.15.107:0/4246132961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 msgr2=0x55f0140af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:21.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27dd59b700 1 --2- 172.21.15.107:0/4246132961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27dd59b700 1 -- 172.21.15.107:0/4246132961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 msgr2=0x55f0140c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:21.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27dd59b700 1 --2- 172.21.15.107:0/4246132961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 0x55f0140c0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.107+0000 7f27dd59b700 1 -- 172.21.15.107:0/4246132961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f013e1bc60 con 0x55f0140b4800 2023-08-10T10:56:21.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.108+0000 7f27dd59b700 1 --2- 172.21.15.107:0/4246132961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c5360 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f27d4005910 tx=0x7f27d4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f4f0f13a1d09c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:21.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.108+0000 7f27c3fff700 1 -- 172.21.15.107:0/4246132961 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4035220 con 0x55f0140b4800 2023-08-10T10:56:21.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.108+0000 7f27c3fff700 1 -- 172.21.15.107:0/4246132961 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27d401e040 con 0x55f0140b4800 2023-08-10T10:56:21.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.108+0000 7f27c3fff700 1 -- 172.21.15.107:0/4246132961 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d400f840 con 0x55f0140b4800 2023-08-10T10:56:21.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.109+0000 7f27f310ab80 1 -- 172.21.15.107:0/4246132961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 msgr2=0x55f0140c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:21.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.109+0000 7f27f310ab80 1 --2- 172.21.15.107:0/4246132961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c5360 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f27d4005910 tx=0x7f27d4020000 comp rx=0 tx=0).stop 2023-08-10T10:56:21.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.109+0000 7f27f310ab80 1 -- 172.21.15.107:0/4246132961 shutdown_connections 2023-08-10T10:56:21.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.109+0000 7f27f310ab80 1 --2- 172.21.15.107:0/4246132961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140ba870 0x55f0140af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.109+0000 7f27f310ab80 1 --2- 172.21.15.107:0/4246132961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140c5360 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.109+0000 7f27f310ab80 1 --2- 172.21.15.107:0/4246132961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140b9f50 0x55f0140c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.109+0000 7f27f310ab80 1 -- 172.21.15.107:0/4246132961 >> 172.21.15.107:0/4246132961 conn(0x55f014011cd0 msgr2=0x55f0140ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:21.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.109+0000 7f27f310ab80 1 -- 172.21.15.107:0/4246132961 shutdown_connections 2023-08-10T10:56:21.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.109+0000 7f27f310ab80 1 -- 172.21.15.107:0/4246132961 wait complete. 2023-08-10T10:56:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.110+0000 7f27f310ab80 1 -- start start 2023-08-10T10:56:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.110+0000 7f27f310ab80 1 Processor -- start 2023-08-10T10:56:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140b9f50 0x55f0140b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27f310ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140ba870 0x55f0140b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27f310ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0140b6960 con 0x55f0140b4800 2023-08-10T10:56:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27f310ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0140b6ad0 con 0x55f0140ba870 2023-08-10T10:56:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27f310ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0140b6c90 con 0x55f0140b9f50 2023-08-10T10:56:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27f310ab80 10 client.0 _ll_register_callbacks cb 0x55f013fa2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:56:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27dcd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140b9f50 0x55f0140b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27ddd9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140ba870 0x55f0140b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27dcd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140b9f50 0x55f0140b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58714/0 (socket says 172.21.15.107:58714) 2023-08-10T10:56:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27ddd9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140ba870 0x55f0140b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:52390/0 (socket says 172.21.15.107:52390) 2023-08-10T10:56:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27dcd9a700 1 -- 172.21.15.107:0/2264706563 learned_addr learned my addr 172.21.15.107:0/2264706563 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.111+0000 7f27dd59b700 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.112+0000 7f27ddd9c700 1 -- 172.21.15.107:0/2264706563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140b9f50 msgr2=0x55f0140b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:21.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.112+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140b9f50 0x55f0140b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.112+0000 7f27ddd9c700 1 -- 172.21.15.107:0/2264706563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 msgr2=0x55f0140b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:21.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.112+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.112+0000 7f27ddd9c700 1 -- 172.21.15.107:0/2264706563 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d810deb0 con 0x55f0140ba870 2023-08-10T10:56:21.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.112+0000 7f27dcd9a700 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140b9f50 0x55f0140b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:56:21.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.112+0000 7f27ddd9c700 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140ba870 0x55f0140b63f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f0140b54d0 tx=0x7f27d0007e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdc1500b45da590 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:21.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.112+0000 7f27c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:56:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.113+0000 7f27c0ff9700 1 -- 172.21.15.107:0/2264706563 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0006000 con 0x55f0140ba870 2023-08-10T10:56:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.113+0000 7f27c0ff9700 1 -- 172.21.15.107:0/2264706563 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7f27d0004340 con 0x55f0140ba870 2023-08-10T10:56:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.113+0000 7f27f310ab80 1 -- 172.21.15.107:0/2264706563 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27d00193f0 con 0x55f0140ba870 2023-08-10T10:56:21.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.113+0000 7f27c0ff9700 1 -- 172.21.15.107:0/2264706563 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27d0014ea0 con 0x55f0140ba870 2023-08-10T10:56:21.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.113+0000 7f27f310ab80 10 client.26183 fetch_fsmap learned FSMap version 34 2023-08-10T10:56:21.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.113+0000 7f27f310ab80 1 -- 172.21.15.107:0/2264706563 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f013e59250 con 0x55f0140ba870 2023-08-10T10:56:21.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.114+0000 7f27c0ff9700 1 -- 172.21.15.107:0/2264706563 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27d00193f0 con 0x55f0140ba870 2023-08-10T10:56:21.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.114+0000 7f27c0ff9700 1 -- 172.21.15.107:0/2264706563 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 34) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f27d00168c0 con 0x55f0140ba870 2023-08-10T10:56:21.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.114+0000 7f27f310ab80 10 client.26183 fetch_fsmap finished waiting for FSMap version 34 2023-08-10T10:56:21.119 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.114+0000 7f27f310ab80 10 client.26183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:56:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.114+0000 7f27f310ab80 20 client.26183 populate_metadata read hostname 'smithi107' 2023-08-10T10:56:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.114+0000 7f27f310ab80 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f014122400 0x55f014124820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.114+0000 7f27f310ab80 4 client.26183 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:56:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.114+0000 7f27f310ab80 1 -- 172.21.15.107:0/2264706563 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f013ffe780 con 0x55f014122400 2023-08-10T10:56:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.114+0000 7f27dd59b700 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f014122400 0x55f014124820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27c0ff9700 10 client.26183 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:56:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27dd59b700 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f014122400 0x55f014124820 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12193b7724b9699d server_cookie=7c4a00654b99d593 in_seq=0 out_seq=0 2023-08-10T10:56:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27c0ff9700 1 -- 172.21.15.107:0/2264706563 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f013ffe780 con 0x55f014122400 2023-08-10T10:56:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27c0ff9700 10 client.26183 handle_command_reply: tid=0 2023-08-10T10:56:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27f310ab80 1 client.26183 shutdown 2023-08-10T10:56:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27f310ab80 1 -- 172.21.15.107:0/2264706563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140ba870 msgr2=0x55f0140b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27f310ab80 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140ba870 0x55f0140b63f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f0140b54d0 tx=0x7f27d0007e10 comp rx=0 tx=0).stop 2023-08-10T10:56:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27f310ab80 1 -- 172.21.15.107:0/2264706563 shutdown_connections 2023-08-10T10:56:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27f310ab80 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f014122400 0x55f014124820 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27f310ab80 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f0140ba870 0x55f0140b63f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27f310ab80 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f0140b4800 0x55f0140b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27f310ab80 1 --2- 172.21.15.107:0/2264706563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0140b9f50 0x55f0140b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.116+0000 7f27f310ab80 1 -- 172.21.15.107:0/2264706563 >> 172.21.15.107:0/2264706563 conn(0x55f014011cd0 msgr2=0x55f0140b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.115+0000 7f27c0ff9700 0 client.26183 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:56:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.116+0000 7f27f310ab80 1 -- 172.21.15.107:0/2264706563 shutdown_connections 2023-08-10T10:56:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.116+0000 7f27f310ab80 1 -- 172.21.15.107:0/2264706563 wait complete. 2023-08-10T10:56:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.116+0000 7f27f310ab80 20 client.26183 trim_cache size 0 max 16384 2023-08-10T10:56:21.123 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:56:21.123 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:56:21.123 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:56:21.123 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:56:21.123 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:56:21.123 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:56:21.123 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:56:21.124 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:56:21.124 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:56:21.124 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:56:21.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 -- 172.21.15.107:0/1108712853 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f27c40a12c0 msgr2=0x7f27c40a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:21.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f27c40a12c0 0x7f27c40a3780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f27d4006010 tx=0x7f27d400b260 comp rx=0 tx=0).stop 2023-08-10T10:56:21.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 -- 172.21.15.107:0/1108712853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d81010a0 msgr2=0x7f27d819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:21.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d81010a0 0x7f27d819eba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f27c800e9a0 tx=0x7f27c800ecb0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 -- 172.21.15.107:0/1108712853 shutdown_connections 2023-08-10T10:56:21.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f27c40a12c0 0x7f27c40a3780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d81006e0 0x7f27d819e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.125 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f27d81066f0 0x7f27d81986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 --2- 172.21.15.107:0/1108712853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d81010a0 0x7f27d819eba0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:21.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.117+0000 7f27df7ff700 1 -- 172.21.15.107:0/1108712853 >> 172.21.15.107:0/1108712853 conn(0x7f27d80fc1d0 msgr2=0x7f27d810ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:21.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.118+0000 7f27df7ff700 1 -- 172.21.15.107:0/1108712853 shutdown_connections 2023-08-10T10:56:21.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:21.118+0000 7f27df7ff700 1 -- 172.21.15.107:0/1108712853 wait complete. 2023-08-10T10:56:21.139 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:56:21.421 INFO:teuthology.orchestra.run.smithi107.stderr:19100000 of 50000000 tuples (38%) done (elapsed 279.60 s, remaining 452.34 s) 2023-08-10T10:56:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:21 smithi157 ceph-mon[129604]: pgmap v157: 129 pgs: 129 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 38 op/s 2023-08-10T10:56:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:21 smithi107 ceph-mon[127953]: pgmap v157: 129 pgs: 129 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 38 op/s 2023-08-10T10:56:22.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:21 smithi195 ceph-mon[129938]: pgmap v157: 129 pgs: 129 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 38 op/s 2023-08-10T10:56:22.639 INFO:teuthology.orchestra.run.smithi107.stderr:19200000 of 50000000 tuples (38%) done (elapsed 280.82 s, remaining 450.48 s) 2023-08-10T10:56:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:19300000 of 50000000 tuples (38%) done (elapsed 282.04 s, remaining 448.63 s) 2023-08-10T10:56:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:23 smithi157 ceph-mon[129604]: pgmap v158: 129 pgs: 129 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 38 op/s 2023-08-10T10:56:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:23 smithi107 ceph-mon[127953]: pgmap v158: 129 pgs: 129 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 38 op/s 2023-08-10T10:56:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:23 smithi195 ceph-mon[129938]: pgmap v158: 129 pgs: 129 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 38 op/s 2023-08-10T10:56:25.060 INFO:teuthology.orchestra.run.smithi107.stderr:19400000 of 50000000 tuples (38%) done (elapsed 283.24 s, remaining 446.76 s) 2023-08-10T10:56:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:25 smithi157 ceph-mon[129604]: pgmap v159: 129 pgs: 129 active+clean; 4.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 28 MiB/s wr, 59 op/s 2023-08-10T10:56:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:25 smithi107 ceph-mon[127953]: pgmap v159: 129 pgs: 129 active+clean; 4.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 28 MiB/s wr, 59 op/s 2023-08-10T10:56:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:25 smithi195 ceph-mon[129938]: pgmap v159: 129 pgs: 129 active+clean; 4.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 28 MiB/s wr, 59 op/s 2023-08-10T10:56:26.365 INFO:teuthology.orchestra.run.smithi107.stderr:19500000 of 50000000 tuples (39%) done (elapsed 284.54 s, remaining 445.05 s) 2023-08-10T10:56:27.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:56:27.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:56:27.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:56:27.700 INFO:teuthology.orchestra.run.smithi107.stderr:19600000 of 50000000 tuples (39%) done (elapsed 285.88 s, remaining 443.40 s) 2023-08-10T10:56:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:27 smithi107 ceph-mon[127953]: pgmap v160: 129 pgs: 129 active+clean; 4.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T10:56:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:27 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:56:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:27 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:56:28.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:27 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:56:28.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:27 smithi195 ceph-mon[129938]: pgmap v160: 129 pgs: 129 active+clean; 4.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T10:56:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:27 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:56:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:27 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:56:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:27 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:56:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:27 smithi157 ceph-mon[129604]: pgmap v160: 129 pgs: 129 active+clean; 4.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T10:56:28.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:27 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:56:28.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:27 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:56:28.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:27 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:56:28.974 INFO:teuthology.orchestra.run.smithi107.stderr:19700000 of 50000000 tuples (39%) done (elapsed 287.15 s, remaining 441.66 s) 2023-08-10T10:56:29.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:28 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:56:29.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:28 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:56:29.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:28 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:56:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:29 smithi107 ceph-mon[127953]: pgmap v161: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 35 MiB/s wr, 73 op/s 2023-08-10T10:56:30.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:29 smithi195 ceph-mon[129938]: pgmap v161: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 35 MiB/s wr, 73 op/s 2023-08-10T10:56:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:29 smithi157 ceph-mon[129604]: pgmap v161: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 35 MiB/s wr, 73 op/s 2023-08-10T10:56:30.312 INFO:teuthology.orchestra.run.smithi107.stderr:19800000 of 50000000 tuples (39%) done (elapsed 288.49 s, remaining 440.02 s) 2023-08-10T10:56:31.587 INFO:teuthology.orchestra.run.smithi107.stderr:19900000 of 50000000 tuples (39%) done (elapsed 289.76 s, remaining 438.29 s) 2023-08-10T10:56:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:31 smithi107 ceph-mon[127953]: pgmap v162: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:56:32.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:31 smithi195 ceph-mon[129938]: pgmap v162: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:56:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:31 smithi157 ceph-mon[129604]: pgmap v162: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:56:32.801 INFO:teuthology.orchestra.run.smithi107.stderr:20000000 of 50000000 tuples (40%) done (elapsed 290.98 s, remaining 436.47 s) 2023-08-10T10:56:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:33 smithi107 ceph-mon[127953]: pgmap v163: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:56:34.105 INFO:teuthology.orchestra.run.smithi107.stderr:20100000 of 50000000 tuples (40%) done (elapsed 292.28 s, remaining 434.79 s) 2023-08-10T10:56:34.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:33 smithi195 ceph-mon[129938]: pgmap v163: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:56:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:33 smithi157 ceph-mon[129604]: pgmap v163: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:56:35.310 INFO:teuthology.orchestra.run.smithi107.stderr:20200000 of 50000000 tuples (40%) done (elapsed 293.49 s, remaining 432.97 s) 2023-08-10T10:56:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:35 smithi107 ceph-mon[127953]: pgmap v164: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 MiB/s wr, 72 op/s 2023-08-10T10:56:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:35 smithi195 ceph-mon[129938]: pgmap v164: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 MiB/s wr, 72 op/s 2023-08-10T10:56:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:35 smithi157 ceph-mon[129604]: pgmap v164: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 MiB/s wr, 72 op/s 2023-08-10T10:56:36.540 INFO:teuthology.orchestra.run.smithi107.stderr:20300000 of 50000000 tuples (40%) done (elapsed 294.72 s, remaining 431.19 s) 2023-08-10T10:56:37.789 INFO:teuthology.orchestra.run.smithi107.stderr:20400000 of 50000000 tuples (40%) done (elapsed 295.97 s, remaining 429.44 s) 2023-08-10T10:56:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:37 smithi107 ceph-mon[127953]: pgmap v165: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T10:56:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:37 smithi195 ceph-mon[129938]: pgmap v165: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T10:56:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:37 smithi157 ceph-mon[129604]: pgmap v165: 129 pgs: 129 active+clean; 4.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T10:56:39.133 INFO:teuthology.orchestra.run.smithi107.stderr:20500000 of 50000000 tuples (41%) done (elapsed 297.31 s, remaining 427.84 s) 2023-08-10T10:56:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:39 smithi107 ceph-mon[127953]: pgmap v166: 129 pgs: 129 active+clean; 4.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 MiB/s wr, 71 op/s 2023-08-10T10:56:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:39 smithi195 ceph-mon[129938]: pgmap v166: 129 pgs: 129 active+clean; 4.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 MiB/s wr, 71 op/s 2023-08-10T10:56:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:39 smithi157 ceph-mon[129604]: pgmap v166: 129 pgs: 129 active+clean; 4.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 MiB/s wr, 71 op/s 2023-08-10T10:56:40.346 INFO:teuthology.orchestra.run.smithi107.stderr:20600000 of 50000000 tuples (41%) done (elapsed 298.52 s, remaining 426.05 s) 2023-08-10T10:56:41.572 INFO:teuthology.orchestra.run.smithi107.stderr:20700000 of 50000000 tuples (41%) done (elapsed 299.75 s, remaining 424.28 s) 2023-08-10T10:56:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:41 smithi107 ceph-mon[127953]: pgmap v167: 129 pgs: 129 active+clean; 4.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 49 op/s 2023-08-10T10:56:42.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:41 smithi195 ceph-mon[129938]: pgmap v167: 129 pgs: 129 active+clean; 4.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 49 op/s 2023-08-10T10:56:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:41 smithi157 ceph-mon[129604]: pgmap v167: 129 pgs: 129 active+clean; 4.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 49 op/s 2023-08-10T10:56:42.910 INFO:teuthology.orchestra.run.smithi107.stderr:20800000 of 50000000 tuples (41%) done (elapsed 301.09 s, remaining 422.68 s) 2023-08-10T10:56:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:43 smithi107 ceph-mon[127953]: pgmap v168: 129 pgs: 129 active+clean; 4.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 49 op/s 2023-08-10T10:56:44.135 INFO:teuthology.orchestra.run.smithi107.stderr:20900000 of 50000000 tuples (41%) done (elapsed 302.31 s, remaining 420.92 s) 2023-08-10T10:56:44.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:43 smithi195 ceph-mon[129938]: pgmap v168: 129 pgs: 129 active+clean; 4.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 49 op/s 2023-08-10T10:56:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:43 smithi157 ceph-mon[129604]: pgmap v168: 129 pgs: 129 active+clean; 4.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 MiB/s wr, 49 op/s 2023-08-10T10:56:45.343 INFO:teuthology.orchestra.run.smithi107.stderr:21000000 of 50000000 tuples (42%) done (elapsed 303.52 s, remaining 419.15 s) 2023-08-10T10:56:46.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:45 smithi195 ceph-mon[129938]: pgmap v169: 129 pgs: 129 active+clean; 4.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 MiB/s wr, 72 op/s 2023-08-10T10:56:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:45 smithi157 ceph-mon[129604]: pgmap v169: 129 pgs: 129 active+clean; 4.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 MiB/s wr, 72 op/s 2023-08-10T10:56:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:45 smithi107 ceph-mon[127953]: pgmap v169: 129 pgs: 129 active+clean; 4.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 MiB/s wr, 72 op/s 2023-08-10T10:56:46.552 INFO:teuthology.orchestra.run.smithi107.stderr:21100000 of 50000000 tuples (42%) done (elapsed 304.73 s, remaining 417.38 s) 2023-08-10T10:56:47.849 INFO:teuthology.orchestra.run.smithi107.stderr:21200000 of 50000000 tuples (42%) done (elapsed 306.03 s, remaining 415.73 s) 2023-08-10T10:56:48.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:47 smithi195 ceph-mon[129938]: pgmap v170: 129 pgs: 129 active+clean; 4.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:56:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:47 smithi157 ceph-mon[129604]: pgmap v170: 129 pgs: 129 active+clean; 4.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:56:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:47 smithi107 ceph-mon[127953]: pgmap v170: 129 pgs: 129 active+clean; 4.8 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-08-10T10:56:49.061 INFO:teuthology.orchestra.run.smithi107.stderr:21300000 of 50000000 tuples (42%) done (elapsed 307.24 s, remaining 413.98 s) 2023-08-10T10:56:49.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:48 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:56:49.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:48 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:56:49.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:48 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:56:50.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:49 smithi195 ceph-mon[129938]: pgmap v171: 129 pgs: 129 active+clean; 4.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 36 MiB/s wr, 56 op/s 2023-08-10T10:56:50.248 INFO:teuthology.orchestra.run.smithi107.stderr:21400000 of 50000000 tuples (42%) done (elapsed 308.43 s, remaining 412.19 s) 2023-08-10T10:56:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:49 smithi157 ceph-mon[129604]: pgmap v171: 129 pgs: 129 active+clean; 4.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 36 MiB/s wr, 56 op/s 2023-08-10T10:56:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:49 smithi107 ceph-mon[127953]: pgmap v171: 129 pgs: 129 active+clean; 4.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 36 MiB/s wr, 56 op/s 2023-08-10T10:56:51.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:56:51.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:50 smithi195 ceph-mon[129938]: pgmap v172: 129 pgs: 129 active+clean; 4.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-08-10T10:56:51.208 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:50 smithi107 ceph-mon[127953]: pgmap v172: 129 pgs: 129 active+clean; 4.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-08-10T10:56:51.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:50 smithi157 ceph-mon[129604]: pgmap v172: 129 pgs: 129 active+clean; 4.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-08-10T10:56:51.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.375+0000 7fcf0afff700 1 -- 172.21.15.107:0/45266912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf041066d0 msgr2=0x7fcf04106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:51.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.375+0000 7fcf0afff700 1 --2- 172.21.15.107:0/45266912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf041066d0 0x7fcf04106ab0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009990 tx=0x7fcf00009ca0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.375+0000 7fcf0afff700 1 -- 172.21.15.107:0/45266912 shutdown_connections 2023-08-10T10:56:51.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.375+0000 7fcf0afff700 1 --2- 172.21.15.107:0/45266912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf04101080 0x7fcf0410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.375+0000 7fcf0afff700 1 --2- 172.21.15.107:0/45266912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf041066d0 0x7fcf04106ab0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.375+0000 7fcf0afff700 1 --2- 172.21.15.107:0/45266912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf041006c0 0x7fcf04100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.375+0000 7fcf0afff700 1 -- 172.21.15.107:0/45266912 >> 172.21.15.107:0/45266912 conn(0x7fcf040fc1f0 msgr2=0x7fcf040fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:51.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.375+0000 7fcf0afff700 1 -- 172.21.15.107:0/45266912 shutdown_connections 2023-08-10T10:56:51.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.375+0000 7fcf0afff700 1 -- 172.21.15.107:0/45266912 wait complete. 2023-08-10T10:56:51.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.376+0000 7fcf0afff700 1 Processor -- start 2023-08-10T10:56:51.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.376+0000 7fcf0afff700 1 -- start start 2023-08-10T10:56:51.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.376+0000 7fcf0afff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf041006c0 0x7fcf0419e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.376+0000 7fcf0afff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf04101080 0x7fcf0419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf0afff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf041066d0 0x7fcf04198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf0afff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04198dc0 con 0x7fcf041066d0 2023-08-10T10:56:51.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf0afff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04198f30 con 0x7fcf04101080 2023-08-10T10:56:51.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf0afff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf041990f0 con 0x7fcf041006c0 2023-08-10T10:56:51.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf08d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf041006c0 0x7fcf0419e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf08d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf041006c0 0x7fcf0419e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:34124/0 (socket says 172.21.15.107:34124) 2023-08-10T10:56:51.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf08d9b700 1 -- 172.21.15.107:0/2122967089 learned_addr learned my addr 172.21.15.107:0/2122967089 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:51.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf0959c700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf041066d0 0x7fcf04198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcefbfff700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf04101080 0x7fcf0419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf08d9b700 1 -- 172.21.15.107:0/2122967089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf04101080 msgr2=0x7fcf0419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:51.381 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf04101080 0x7fcf0419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf08d9b700 1 -- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf041066d0 msgr2=0x7fcf04198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:51.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf041066d0 0x7fcf04198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.377+0000 7fcf08d9b700 1 -- 172.21.15.107:0/2122967089 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000095f0 con 0x7fcf041006c0 2023-08-10T10:56:51.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.378+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf041006c0 0x7fcf0419e6e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcf00005910 tx=0x7fcf000047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:51.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.378+0000 7fcef9ffb700 1 -- 172.21.15.107:0/2122967089 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0001d070 con 0x7fcf041006c0 2023-08-10T10:56:51.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.378+0000 7fcf0afff700 1 -- 172.21.15.107:0/2122967089 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf041993d0 con 0x7fcf041006c0 2023-08-10T10:56:51.382 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.378+0000 7fcef9ffb700 1 -- 172.21.15.107:0/2122967089 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf00021410 con 0x7fcf041006c0 2023-08-10T10:56:51.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.378+0000 7fcef9ffb700 1 -- 172.21.15.107:0/2122967089 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00017650 con 0x7fcf041006c0 2023-08-10T10:56:51.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.378+0000 7fcf0afff700 1 -- 172.21.15.107:0/2122967089 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf041a56d0 con 0x7fcf041006c0 2023-08-10T10:56:51.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.383+0000 7fcef9ffb700 1 -- 172.21.15.107:0/2122967089 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fcf0000fb00 con 0x7fcf041006c0 2023-08-10T10:56:51.385 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.384+0000 7fcf1e976b80 1 Processor -- start 2023-08-10T10:56:51.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.384+0000 7fcf1e976b80 1 -- start start 2023-08-10T10:56:51.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473820f50 0x560473821330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473821870 0x56047381b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560473796dc0 con 0x560473820f50 2023-08-10T10:56:51.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560473773590 con 0x560473821870 2023-08-10T10:56:51.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560473770eb0 con 0x56047381b800 2023-08-10T10:56:51.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcef9ffb700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fceec0a12c0 0x7fceec0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcefbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcefbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:34134/0 (socket says 172.21.15.107:34134) 2023-08-10T10:56:51.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcefbfff700 1 -- 172.21.15.107:0/1686013523 learned_addr learned my addr 172.21.15.107:0/1686013523 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:51.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcef9ffb700 1 -- 172.21.15.107:0/2122967089 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fcf000ce440 con 0x7fcf041006c0 2023-08-10T10:56:51.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcf0959c700 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473820f50 0x560473821330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473821870 0x56047381b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.385+0000 7fcf0959c700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fceec0a12c0 0x7fceec0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fcf08d9b700 1 -- 172.21.15.107:0/1686013523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 msgr2=0x56047381bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:51.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fcf08d9b700 1 -- 172.21.15.107:0/1686013523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473820f50 msgr2=0x560473821330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:51.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473820f50 0x560473821330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fcf08d9b700 1 -- 172.21.15.107:0/1686013523 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604735ed630 con 0x560473821870 2023-08-10T10:56:51.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fcf0959c700 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473820f50 0x560473821330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:56:51.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fcefbfff700 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:56:51.392 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473821870 0x56047381b2c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf000cb890 tx=0x7fcf0009b0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f82b8e26065aa89 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:51.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fcf0959c700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fceec0a12c0 0x7fceec0a3780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009ec0 tx=0x7fcefc00b040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:51.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fceeaffd700 1 -- 172.21.15.107:0/1686013523 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0009f2d0 con 0x560473821870 2023-08-10T10:56:51.393 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fceeaffd700 1 -- 172.21.15.107:0/1686013523 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf000a3660 con 0x560473821870 2023-08-10T10:56:51.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.386+0000 7fceeaffd700 1 -- 172.21.15.107:0/1686013523 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf000217f0 con 0x560473821870 2023-08-10T10:56:51.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.387+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1686013523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473821870 msgr2=0x56047381b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:51.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.387+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473821870 0x56047381b2c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf000cb890 tx=0x7fcf0009b0f0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.394 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.387+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1686013523 shutdown_connections 2023-08-10T10:56:51.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.387+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.387+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473820f50 0x560473821330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.395 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.387+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1686013523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473821870 0x56047381b2c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.387+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1686013523 >> 172.21.15.107:0/1686013523 conn(0x560473778cd0 msgr2=0x5604738164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:51.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.387+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1686013523 shutdown_connections 2023-08-10T10:56:51.396 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.387+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1686013523 wait complete. 2023-08-10T10:56:51.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.388+0000 7fcf1e976b80 1 -- start start 2023-08-10T10:56:51.397 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.388+0000 7fcf1e976b80 1 Processor -- start 2023-08-10T10:56:51.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x5604738278d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.401 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x560473824bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 0x560473825300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047376c7a0 con 0x56047381b800 2023-08-10T10:56:51.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047370bac0 con 0x560473820f50 2023-08-10T10:56:51.402 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047370b7c0 con 0x560473821870 2023-08-10T10:56:51.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcf1e976b80 10 client.0 _ll_register_callbacks cb 0x560473709680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:56:51.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcefbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x560473824bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcf0959c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 0x560473825300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcefbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x560473824bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:59762/0 (socket says 172.21.15.107:59762) 2023-08-10T10:56:51.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcefbfff700 1 -- 172.21.15.107:0/3445590063 learned_addr learned my addr 172.21.15.107:0/3445590063 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:51.403 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.389+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x5604738278d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcefbfff700 1 -- 172.21.15.107:0/3445590063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 msgr2=0x560473825300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:51.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcefbfff700 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 0x560473825300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcefbfff700 1 -- 172.21.15.107:0/3445590063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 msgr2=0x5604738278d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:51.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcefbfff700 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x5604738278d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcefbfff700 1 -- 172.21.15.107:0/3445590063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef4009910 con 0x560473820f50 2023-08-10T10:56:51.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcefbfff700 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x560473824bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcef40046b0 tx=0x7fcef4012c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c27d592c5ceb67f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:51.404 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcee3fff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:56:51.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcee3fff700 1 -- 172.21.15.107:0/3445590063 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4017070 con 0x560473820f50 2023-08-10T10:56:51.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcf1e976b80 1 -- 172.21.15.107:0/3445590063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56047380e470 con 0x560473820f50 2023-08-10T10:56:51.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcee3fff700 1 -- 172.21.15.107:0/3445590063 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fcef4011ac0 con 0x560473820f50 2023-08-10T10:56:51.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcee3fff700 1 -- 172.21.15.107:0/3445590063 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcef4011c80 con 0x560473820f50 2023-08-10T10:56:51.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcf1e976b80 10 client.26195 fetch_fsmap learned FSMap version 36 2023-08-10T10:56:51.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.390+0000 7fcf1e976b80 1 -- 172.21.15.107:0/3445590063 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7fcf041a56d0 con 0x560473820f50 2023-08-10T10:56:51.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.391+0000 7fcee3fff700 1 -- 172.21.15.107:0/3445590063 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56047380e470 con 0x560473820f50 2023-08-10T10:56:51.405 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.391+0000 7fcee3fff700 1 -- 172.21.15.107:0/3445590063 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 36) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fcef401c420 con 0x560473820f50 2023-08-10T10:56:51.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.391+0000 7fcf1e976b80 10 client.26195 fetch_fsmap finished waiting for FSMap version 36 2023-08-10T10:56:51.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.391+0000 7fcf1e976b80 10 client.26195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:56:51.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.391+0000 7fcf1e976b80 20 client.26195 populate_metadata read hostname 'smithi107' 2023-08-10T10:56:51.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.391+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5604738350c0 0x5604738374e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.391+0000 7fcf1e976b80 4 client.26195 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:56:51.406 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.391+0000 7fcf1e976b80 1 -- 172.21.15.107:0/3445590063 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604737ea9d0 con 0x5604738350c0 2023-08-10T10:56:51.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.392+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5604738350c0 0x5604738374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.393+0000 7fcee3fff700 10 client.26195 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:56:51.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.393+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5604738350c0 0x5604738374e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a42a0c18f87d5cc server_cookie=fb421211f05c4311 in_seq=0 out_seq=0 2023-08-10T10:56:51.407 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.393+0000 7fcee3fff700 1 -- 172.21.15.107:0/3445590063 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5604737ea9d0 con 0x5604738350c0 2023-08-10T10:56:51.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.393+0000 7fcee3fff700 10 client.26195 handle_command_reply: tid=0 2023-08-10T10:56:51.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.393+0000 7fcf1e976b80 1 client.26195 shutdown 2023-08-10T10:56:51.408 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 -- 172.21.15.107:0/3445590063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 msgr2=0x560473824bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:51.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x560473824bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcef40046b0 tx=0x7fcef4012c50 comp rx=0 tx=0).stop 2023-08-10T10:56:51.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 -- 172.21.15.107:0/3445590063 shutdown_connections 2023-08-10T10:56:51.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5604738350c0 0x5604738374e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.409 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 0x560473825300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x5604738278d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcee3fff700 0 client.26195 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:56:51.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/3445590063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x560473824bc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.410 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 -- 172.21.15.107:0/3445590063 >> 172.21.15.107:0/3445590063 conn(0x560473778cd0 msgr2=0x5604738159b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:51.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 -- 172.21.15.107:0/3445590063 shutdown_connections 2023-08-10T10:56:51.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 1 -- 172.21.15.107:0/3445590063 wait complete. 2023-08-10T10:56:51.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.394+0000 7fcf1e976b80 20 client.26195 trim_cache size 0 max 16384 2023-08-10T10:56:51.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.414+0000 7fcf1e976b80 1 Processor -- start 2023-08-10T10:56:51.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.414+0000 7fcf1e976b80 1 -- start start 2023-08-10T10:56:51.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x56047382c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x5604738202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 0x560473827470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604735ef920 con 0x56047381b800 2023-08-10T10:56:51.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560473826130 con 0x560473820f50 2023-08-10T10:56:51.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560473817370 con 0x560473821870 2023-08-10T10:56:51.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf08d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x56047382c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf0959c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 0x560473827470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf08d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x56047382c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57250/0 (socket says 172.21.15.107:57250) 2023-08-10T10:56:51.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf08d9b700 1 -- 172.21.15.107:0/271968769 learned_addr learned my addr 172.21.15.107:0/271968769 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:51.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcefbfff700 1 --2- 172.21.15.107:0/271968769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x5604738202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf08d9b700 1 -- 172.21.15.107:0/271968769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 msgr2=0x560473827470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:51.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/271968769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 0x560473827470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf08d9b700 1 -- 172.21.15.107:0/271968769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 msgr2=0x5604738202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:51.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/271968769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x5604738202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcf08d9b700 1 -- 172.21.15.107:0/271968769 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560473599de0 con 0x56047381b800 2023-08-10T10:56:51.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.415+0000 7fcefbfff700 1 --2- 172.21.15.107:0/271968769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x5604738202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:56:51.420 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.416+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/271968769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x56047382c0d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcf0009b1e0 tx=0x7fcf00005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d79a749c5ef660 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:51.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.416+0000 7fceeb7fe700 1 -- 172.21.15.107:0/271968769 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf000ce700 con 0x56047381b800 2023-08-10T10:56:51.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.416+0000 7fceeb7fe700 1 -- 172.21.15.107:0/271968769 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf00021580 con 0x56047381b800 2023-08-10T10:56:51.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.416+0000 7fceeb7fe700 1 -- 172.21.15.107:0/271968769 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00099760 con 0x56047381b800 2023-08-10T10:56:51.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 -- 172.21.15.107:0/271968769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 msgr2=0x56047382c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:51.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/271968769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x56047382c0d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcf0009b1e0 tx=0x7fcf00005fd0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 -- 172.21.15.107:0/271968769 shutdown_connections 2023-08-10T10:56:51.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/271968769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560473821870 0x560473827470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/271968769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56047381b800 0x56047382c0d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/271968769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x5604738202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 -- 172.21.15.107:0/271968769 >> 172.21.15.107:0/271968769 conn(0x560473778cd0 msgr2=0x56047381fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:51.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 -- 172.21.15.107:0/271968769 shutdown_connections 2023-08-10T10:56:51.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 -- 172.21.15.107:0/271968769 wait complete. 2023-08-10T10:56:51.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 -- start start 2023-08-10T10:56:51.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.417+0000 7fcf1e976b80 1 Processor -- start 2023-08-10T10:56:51.425 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x56047381c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf1e976b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473821870 0x56047381ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047381e650 con 0x560473821870 2023-08-10T10:56:51.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047381e7c0 con 0x560473820f50 2023-08-10T10:56:51.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf1e976b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56047381d470 con 0x56047381b800 2023-08-10T10:56:51.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf1e976b80 10 client.0 _ll_register_callbacks cb 0x560473709680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:56:51.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf08d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf0959c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473821870 0x56047381ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf08d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:34166/0 (socket says 172.21.15.107:34166) 2023-08-10T10:56:51.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcf08d9b700 1 -- 172.21.15.107:0/1179408667 learned_addr learned my addr 172.21.15.107:0/1179408667 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:56:51.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.418+0000 7fcefbfff700 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x56047381c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcf08d9b700 1 -- 172.21.15.107:0/1179408667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 msgr2=0x56047381c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:51.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x56047381c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcf08d9b700 1 -- 172.21.15.107:0/1179408667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473821870 msgr2=0x56047381ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:56:51.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473821870 0x56047381ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcf08d9b700 1 -- 172.21.15.107:0/1179408667 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604735ed630 con 0x56047381b800 2023-08-10T10:56:51.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcf08d9b700 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381dee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcf0009f240 tx=0x7fcf00097710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f027433f82cf6f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:56:51.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcee3fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:56:51.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcee3fff700 1 -- 172.21.15.107:0/1179408667 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0009ade0 con 0x56047381b800 2023-08-10T10:56:51.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcee3fff700 1 -- 172.21.15.107:0/1179408667 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fcf00099640 con 0x56047381b800 2023-08-10T10:56:51.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1179408667 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf000a3660 con 0x56047381b800 2023-08-10T10:56:51.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcee3fff700 1 -- 172.21.15.107:0/1179408667 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf000217f0 con 0x56047381b800 2023-08-10T10:56:51.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcf1e976b80 10 client.26230 fetch_fsmap learned FSMap version 36 2023-08-10T10:56:51.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.419+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1179408667 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560473582c60 con 0x56047381b800 2023-08-10T10:56:51.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.420+0000 7fcee3fff700 1 -- 172.21.15.107:0/1179408667 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf000a3660 con 0x56047381b800 2023-08-10T10:56:51.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.420+0000 7fcee3fff700 1 -- 172.21.15.107:0/1179408667 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 36) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fcf0009a790 con 0x56047381b800 2023-08-10T10:56:51.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.420+0000 7fcf1e976b80 10 client.26230 fetch_fsmap finished waiting for FSMap version 36 2023-08-10T10:56:51.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.420+0000 7fcf1e976b80 10 client.26230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:56:51.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.420+0000 7fcf1e976b80 20 client.26230 populate_metadata read hostname 'smithi107' 2023-08-10T10:56:51.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.420+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560473889ac0 0x56047388beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:56:51.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.420+0000 7fcf1e976b80 4 client.26230 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:56:51.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.420+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1179408667 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560473765780 con 0x560473889ac0 2023-08-10T10:56:51.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.420+0000 7fcefbfff700 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560473889ac0 0x56047388beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:56:51.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcefbfff700 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560473889ac0 0x56047388beb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=442844dc4ee2cec server_cookie=8cd82d8a55cd658d in_seq=0 out_seq=0 2023-08-10T10:56:51.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcee3fff700 10 client.26230 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:56:51.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcee3fff700 1 -- 172.21.15.107:0/1179408667 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560473765780 con 0x560473889ac0 2023-08-10T10:56:51.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcee3fff700 10 client.26230 handle_command_reply: tid=0 2023-08-10T10:56:51.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 client.26230 shutdown 2023-08-10T10:56:51.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1179408667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 msgr2=0x56047381dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:51.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381dee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcf0009f240 tx=0x7fcf00097710 comp rx=0 tx=0).stop 2023-08-10T10:56:51.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1179408667 shutdown_connections 2023-08-10T10:56:51.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560473889ac0 0x56047388beb0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560473821870 0x56047381ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56047381b800 0x56047381dee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 --2- 172.21.15.107:0/1179408667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560473820f50 0x56047381c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1179408667 >> 172.21.15.107:0/1179408667 conn(0x560473778cd0 msgr2=0x560473820450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:51.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcee3fff700 0 client.26230 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:56:51.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1179408667 shutdown_connections 2023-08-10T10:56:51.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.421+0000 7fcf1e976b80 1 -- 172.21.15.107:0/1179408667 wait complete. 2023-08-10T10:56:51.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf1e976b80 20 client.26230 trim_cache size 0 max 16384 2023-08-10T10:56:51.433 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:56:51.433 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:56:51.433 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:56:51.433 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:56:51.433 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:56:51.433 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:56:51.433 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:56:51.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:56:51.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:56:51.434 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:56:51.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 -- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fceec0a12c0 msgr2=0x7fceec0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:51.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fceec0a12c0 0x7fceec0a3780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009ec0 tx=0x7fcefc00b040 comp rx=0 tx=0).stop 2023-08-10T10:56:51.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 -- 172.21.15.107:0/2122967089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf041006c0 msgr2=0x7fcf0419e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:56:51.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf041006c0 0x7fcf0419e6e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcf00005910 tx=0x7fcf000047b0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 -- 172.21.15.107:0/2122967089 shutdown_connections 2023-08-10T10:56:51.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf041066d0 0x7fcf04198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf041006c0 0x7fcf0419e6e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fceec0a12c0 0x7fceec0a3780 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 --2- 172.21.15.107:0/2122967089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf04101080 0x7fcf0419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:56:51.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 -- 172.21.15.107:0/2122967089 >> 172.21.15.107:0/2122967089 conn(0x7fcf040fc1f0 msgr2=0x7fcf0410ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:56:51.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 -- 172.21.15.107:0/2122967089 shutdown_connections 2023-08-10T10:56:51.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:56:51.422+0000 7fcf0afff700 1 -- 172.21.15.107:0/2122967089 wait complete. 2023-08-10T10:56:51.443 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:56:51.528 INFO:teuthology.orchestra.run.smithi107.stderr:21500000 of 50000000 tuples (43%) done (elapsed 309.71 s, remaining 410.54 s) 2023-08-10T10:56:53.199 INFO:teuthology.orchestra.run.smithi107.stderr:21600000 of 50000000 tuples (43%) done (elapsed 311.38 s, remaining 409.40 s) 2023-08-10T10:56:53.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:52 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:56:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:52 smithi157 ceph-mon[129604]: pgmap v173: 129 pgs: 129 active+clean; 4.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-08-10T10:56:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:52 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:56:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:52 smithi107 ceph-mon[127953]: pgmap v173: 129 pgs: 129 active+clean; 4.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-08-10T10:56:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:52 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:56:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:52 smithi195 ceph-mon[129938]: pgmap v173: 129 pgs: 129 active+clean; 4.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-08-10T10:56:54.423 INFO:teuthology.orchestra.run.smithi107.stderr:21700000 of 50000000 tuples (43%) done (elapsed 312.60 s, remaining 407.68 s) 2023-08-10T10:56:55.699 INFO:teuthology.orchestra.run.smithi107.stderr:21800000 of 50000000 tuples (43%) done (elapsed 313.88 s, remaining 406.02 s) 2023-08-10T10:56:56.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:55 smithi157 ceph-mon[129604]: pgmap v174: 129 pgs: 129 active+clean; 5.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 35 MiB/s wr, 54 op/s 2023-08-10T10:56:56.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:55 smithi107 ceph-mon[127953]: pgmap v174: 129 pgs: 129 active+clean; 5.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 35 MiB/s wr, 54 op/s 2023-08-10T10:56:56.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:55 smithi195 ceph-mon[129938]: pgmap v174: 129 pgs: 129 active+clean; 5.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 35 MiB/s wr, 54 op/s 2023-08-10T10:56:57.046 INFO:teuthology.orchestra.run.smithi107.stderr:21900000 of 50000000 tuples (43%) done (elapsed 315.22 s, remaining 404.46 s) 2023-08-10T10:56:58.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:57 smithi157 ceph-mon[129604]: pgmap v175: 129 pgs: 129 active+clean; 5.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 23 MiB/s wr, 30 op/s 2023-08-10T10:56:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:57 smithi107 ceph-mon[127953]: pgmap v175: 129 pgs: 129 active+clean; 5.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 23 MiB/s wr, 30 op/s 2023-08-10T10:56:58.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:57 smithi195 ceph-mon[129938]: pgmap v175: 129 pgs: 129 active+clean; 5.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 23 MiB/s wr, 30 op/s 2023-08-10T10:56:58.330 INFO:teuthology.orchestra.run.smithi107.stderr:22000000 of 50000000 tuples (44%) done (elapsed 316.51 s, remaining 402.83 s) 2023-08-10T10:56:59.543 INFO:teuthology.orchestra.run.smithi107.stderr:22100000 of 50000000 tuples (44%) done (elapsed 317.72 s, remaining 401.10 s) 2023-08-10T10:57:00.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:56:59 smithi157 ceph-mon[129604]: pgmap v176: 129 pgs: 129 active+clean; 5.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 60 op/s 2023-08-10T10:57:00.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:56:59 smithi107 ceph-mon[127953]: pgmap v176: 129 pgs: 129 active+clean; 5.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 60 op/s 2023-08-10T10:57:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:56:59 smithi195 ceph-mon[129938]: pgmap v176: 129 pgs: 129 active+clean; 5.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 60 op/s 2023-08-10T10:57:00.949 INFO:teuthology.orchestra.run.smithi107.stderr:22200000 of 50000000 tuples (44%) done (elapsed 319.13 s, remaining 399.63 s) 2023-08-10T10:57:02.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:01 smithi157 ceph-mon[129604]: pgmap v177: 129 pgs: 129 active+clean; 5.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:57:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:01 smithi107 ceph-mon[127953]: pgmap v177: 129 pgs: 129 active+clean; 5.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:57:02.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:01 smithi195 ceph-mon[129938]: pgmap v177: 129 pgs: 129 active+clean; 5.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:57:02.230 INFO:teuthology.orchestra.run.smithi107.stderr:22300000 of 50000000 tuples (44%) done (elapsed 320.41 s, remaining 398.00 s) 2023-08-10T10:57:03.531 INFO:teuthology.orchestra.run.smithi107.stderr:22400000 of 50000000 tuples (44%) done (elapsed 321.71 s, remaining 396.39 s) 2023-08-10T10:57:04.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:03 smithi157 ceph-mon[129604]: pgmap v178: 129 pgs: 129 active+clean; 5.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:57:04.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:03 smithi107 ceph-mon[127953]: pgmap v178: 129 pgs: 129 active+clean; 5.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:57:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:03 smithi195 ceph-mon[129938]: pgmap v178: 129 pgs: 129 active+clean; 5.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 23 MiB/s wr, 47 op/s 2023-08-10T10:57:04.762 INFO:teuthology.orchestra.run.smithi107.stderr:22500000 of 50000000 tuples (45%) done (elapsed 322.94 s, remaining 394.70 s) 2023-08-10T10:57:06.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:05 smithi157 ceph-mon[129604]: pgmap v179: 129 pgs: 129 active+clean; 5.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 34 MiB/s wr, 91 op/s 2023-08-10T10:57:06.052 INFO:teuthology.orchestra.run.smithi107.stderr:22600000 of 50000000 tuples (45%) done (elapsed 324.23 s, remaining 393.09 s) 2023-08-10T10:57:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:05 smithi107 ceph-mon[127953]: pgmap v179: 129 pgs: 129 active+clean; 5.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 34 MiB/s wr, 91 op/s 2023-08-10T10:57:06.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:05 smithi195 ceph-mon[129938]: pgmap v179: 129 pgs: 129 active+clean; 5.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 34 MiB/s wr, 91 op/s 2023-08-10T10:57:07.362 INFO:teuthology.orchestra.run.smithi107.stderr:22700000 of 50000000 tuples (45%) done (elapsed 325.54 s, remaining 391.51 s) 2023-08-10T10:57:08.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:07 smithi157 ceph-mon[129604]: pgmap v180: 129 pgs: 129 active+clean; 5.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 23 MiB/s wr, 73 op/s 2023-08-10T10:57:08.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:07 smithi107 ceph-mon[127953]: pgmap v180: 129 pgs: 129 active+clean; 5.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 23 MiB/s wr, 73 op/s 2023-08-10T10:57:08.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:07 smithi195 ceph-mon[129938]: pgmap v180: 129 pgs: 129 active+clean; 5.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 23 MiB/s wr, 73 op/s 2023-08-10T10:57:08.622 INFO:teuthology.orchestra.run.smithi107.stderr:22800000 of 50000000 tuples (45%) done (elapsed 326.80 s, remaining 389.87 s) 2023-08-10T10:57:09.977 INFO:teuthology.orchestra.run.smithi107.stderr:22900000 of 50000000 tuples (45%) done (elapsed 328.15 s, remaining 388.34 s) 2023-08-10T10:57:10.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:09 smithi157 ceph-mon[129604]: pgmap v181: 129 pgs: 129 active+clean; 5.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-08-10T10:57:10.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:09 smithi107 ceph-mon[127953]: pgmap v181: 129 pgs: 129 active+clean; 5.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-08-10T10:57:10.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:09 smithi195 ceph-mon[129938]: pgmap v181: 129 pgs: 129 active+clean; 5.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-08-10T10:57:11.231 INFO:teuthology.orchestra.run.smithi107.stderr:23000000 of 50000000 tuples (46%) done (elapsed 329.41 s, remaining 386.70 s) 2023-08-10T10:57:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:11 smithi157 ceph-mon[129604]: pgmap v182: 129 pgs: 129 active+clean; 5.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T10:57:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:11 smithi107 ceph-mon[127953]: pgmap v182: 129 pgs: 129 active+clean; 5.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T10:57:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:11 smithi195 ceph-mon[129938]: pgmap v182: 129 pgs: 129 active+clean; 5.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T10:57:12.488 INFO:teuthology.orchestra.run.smithi107.stderr:23100000 of 50000000 tuples (46%) done (elapsed 330.67 s, remaining 385.06 s) 2023-08-10T10:57:13.802 INFO:teuthology.orchestra.run.smithi107.stderr:23200000 of 50000000 tuples (46%) done (elapsed 331.98 s, remaining 383.49 s) 2023-08-10T10:57:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:13 smithi157 ceph-mon[129604]: pgmap v183: 129 pgs: 129 active+clean; 5.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T10:57:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:13 smithi107 ceph-mon[127953]: pgmap v183: 129 pgs: 129 active+clean; 5.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T10:57:14.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:13 smithi195 ceph-mon[129938]: pgmap v183: 129 pgs: 129 active+clean; 5.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T10:57:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:15 smithi157 ceph-mon[129604]: pgmap v184: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 35 MiB/s wr, 110 op/s 2023-08-10T10:57:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:15 smithi107 ceph-mon[127953]: pgmap v184: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 35 MiB/s wr, 110 op/s 2023-08-10T10:57:16.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:15 smithi195 ceph-mon[129938]: pgmap v184: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 35 MiB/s wr, 110 op/s 2023-08-10T10:57:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:17 smithi157 ceph-mon[129604]: pgmap v185: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 66 op/s 2023-08-10T10:57:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:17 smithi107 ceph-mon[127953]: pgmap v185: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 66 op/s 2023-08-10T10:57:18.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:17 smithi195 ceph-mon[129938]: pgmap v185: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 66 op/s 2023-08-10T10:57:18.247 INFO:teuthology.orchestra.run.smithi107.stderr:23300000 of 50000000 tuples (46%) done (elapsed 336.42 s, remaining 385.52 s) 2023-08-10T10:57:19.510 INFO:teuthology.orchestra.run.smithi107.stderr:23400000 of 50000000 tuples (46%) done (elapsed 337.69 s, remaining 383.87 s) 2023-08-10T10:57:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:19 smithi157 ceph-mon[129604]: pgmap v186: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 28 MiB/s wr, 84 op/s 2023-08-10T10:57:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:19 smithi107 ceph-mon[127953]: pgmap v186: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 28 MiB/s wr, 84 op/s 2023-08-10T10:57:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:19 smithi195 ceph-mon[129938]: pgmap v186: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 28 MiB/s wr, 84 op/s 2023-08-10T10:57:20.690 INFO:teuthology.orchestra.run.smithi107.stderr:23500000 of 50000000 tuples (47%) done (elapsed 338.87 s, remaining 382.13 s) 2023-08-10T10:57:21.444 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:57:21.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.697+0000 7fb2279ff700 1 -- 172.21.15.107:0/1259891771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb220106700 msgr2=0x7fb220106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:21.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.697+0000 7fb2279ff700 1 --2- 172.21.15.107:0/1259891771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb220106700 0x7fb220106ae0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009990 tx=0x7fb21c009ca0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.697+0000 7fb2279ff700 1 -- 172.21.15.107:0/1259891771 shutdown_connections 2023-08-10T10:57:21.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.697+0000 7fb2279ff700 1 --2- 172.21.15.107:0/1259891771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2201010b0 0x7fb22010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.697+0000 7fb2279ff700 1 --2- 172.21.15.107:0/1259891771 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb220106700 0x7fb220106ae0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.697+0000 7fb2279ff700 1 --2- 172.21.15.107:0/1259891771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2201006f0 0x7fb220100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.697+0000 7fb2279ff700 1 -- 172.21.15.107:0/1259891771 >> 172.21.15.107:0/1259891771 conn(0x7fb2200fc1e0 msgr2=0x7fb2200fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:21.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.697+0000 7fb2279ff700 1 -- 172.21.15.107:0/1259891771 shutdown_connections 2023-08-10T10:57:21.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.697+0000 7fb2279ff700 1 -- 172.21.15.107:0/1259891771 wait complete. 2023-08-10T10:57:21.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.698+0000 7fb2279ff700 1 Processor -- start 2023-08-10T10:57:21.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.698+0000 7fb2279ff700 1 -- start start 2023-08-10T10:57:21.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb2279ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2201006f0 0x7fb220072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb2279ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2201010b0 0x7fb220072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb2279ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb220106700 0x7fb2201a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb2279ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2200737e0 con 0x7fb220106700 2023-08-10T10:57:21.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb2279ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2201a4e10 con 0x7fb2201006f0 2023-08-10T10:57:21.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb2279ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2201a4f50 con 0x7fb2201010b0 2023-08-10T10:57:21.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb225f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb220106700 0x7fb2201a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb224f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2201010b0 0x7fb220072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb224f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2201010b0 0x7fb220072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58290/0 (socket says 172.21.15.107:58290) 2023-08-10T10:57:21.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb224f9a700 1 -- 172.21.15.107:0/50882678 learned_addr learned my addr 172.21.15.107:0/50882678 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:21.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.699+0000 7fb22579b700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2201006f0 0x7fb220072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb224f9a700 1 -- 172.21.15.107:0/50882678 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2201006f0 msgr2=0x7fb220072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:21.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb224f9a700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2201006f0 0x7fb220072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb224f9a700 1 -- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb220106700 msgr2=0x7fb2201a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:21.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb224f9a700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb220106700 0x7fb2201a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb224f9a700 1 -- 172.21.15.107:0/50882678 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c0095f0 con 0x7fb2201010b0 2023-08-10T10:57:21.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb225f9c700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb220106700 0x7fb2201a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:57:21.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb224f9a700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2201010b0 0x7fb220072fb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e9a0 tx=0x7fb21000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:21.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb2167fc700 1 -- 172.21.15.107:0/50882678 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210009790 con 0x7fb2201010b0 2023-08-10T10:57:21.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb2279ff700 1 -- 172.21.15.107:0/50882678 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2201a51b0 con 0x7fb2201010b0 2023-08-10T10:57:21.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb2167fc700 1 -- 172.21.15.107:0/50882678 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb210010430 con 0x7fb2201010b0 2023-08-10T10:57:21.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb2167fc700 1 -- 172.21.15.107:0/50882678 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21000cea0 con 0x7fb2201010b0 2023-08-10T10:57:21.704 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.700+0000 7fb2279ff700 1 -- 172.21.15.107:0/50882678 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2201a56e0 con 0x7fb2201010b0 2023-08-10T10:57:21.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.704+0000 7fb2167fc700 1 -- 172.21.15.107:0/50882678 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fb2100105a0 con 0x7fb2201010b0 2023-08-10T10:57:21.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.705+0000 7fb23b287b80 1 Processor -- start 2023-08-10T10:57:21.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb23b287b80 1 -- start start 2023-08-10T10:57:21.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 0x559bf62c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c6080 0x559bf62bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c0010 0x559bf62c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb23b287b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf6232dc0 con 0x559bf62c0010 2023-08-10T10:57:21.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb23b287b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf620f590 con 0x559bf62c5760 2023-08-10T10:57:21.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb23b287b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf620ceb0 con 0x559bf62c6080 2023-08-10T10:57:21.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb2167fc700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb20c0a12c0 0x7fb20c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb22579b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c6080 0x559bf62bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb22579b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c6080 0x559bf62bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58296/0 (socket says 172.21.15.107:58296) 2023-08-10T10:57:21.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb22579b700 1 -- 172.21.15.107:0/534023293 learned_addr learned my addr 172.21.15.107:0/534023293 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:21.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb2167fc700 1 -- 172.21.15.107:0/50882678 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fb210014070 con 0x7fb2201010b0 2023-08-10T10:57:21.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.706+0000 7fb224f9a700 1 --2- 172.21.15.107:0/534023293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c0010 0x559bf62c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.707+0000 7fb225f9c700 1 --2- 172.21.15.107:0/534023293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 0x559bf62c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.707+0000 7fb22579b700 1 -- 172.21.15.107:0/534023293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 msgr2=0x559bf62c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:21.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.707+0000 7fb22579b700 1 --2- 172.21.15.107:0/534023293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 0x559bf62c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.707+0000 7fb225f9c700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb20c0a12c0 0x7fb20c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.707+0000 7fb22579b700 1 -- 172.21.15.107:0/534023293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c0010 msgr2=0x559bf62c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:21.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.707+0000 7fb22579b700 1 --2- 172.21.15.107:0/534023293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c0010 0x559bf62c0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.707+0000 7fb22579b700 1 -- 172.21.15.107:0/534023293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bf6089630 con 0x559bf62c6080 2023-08-10T10:57:21.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.707+0000 7fb22579b700 1 --2- 172.21.15.107:0/534023293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c6080 0x559bf62bfad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb21c015000 tx=0x7fb21c005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61a046913c74943 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:21.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.708+0000 7fb225f9c700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb20c0a12c0 0x7fb20c0a3780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x559bf62c0d30 tx=0x7fb21800b040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:21.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.708+0000 7fb20b7fe700 1 -- 172.21.15.107:0/534023293 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c01d070 con 0x559bf62c6080 2023-08-10T10:57:21.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.708+0000 7fb20b7fe700 1 -- 172.21.15.107:0/534023293 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb21c01e040 con 0x559bf62c6080 2023-08-10T10:57:21.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.708+0000 7fb20b7fe700 1 -- 172.21.15.107:0/534023293 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0047d0 con 0x559bf62c6080 2023-08-10T10:57:21.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.708+0000 7fb23b287b80 1 -- 172.21.15.107:0/534023293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c6080 msgr2=0x559bf62bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:21.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.708+0000 7fb23b287b80 1 --2- 172.21.15.107:0/534023293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c6080 0x559bf62bfad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb21c015000 tx=0x7fb21c005f00 comp rx=0 tx=0).stop 2023-08-10T10:57:21.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.709+0000 7fb23b287b80 1 -- 172.21.15.107:0/534023293 shutdown_connections 2023-08-10T10:57:21.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.709+0000 7fb23b287b80 1 --2- 172.21.15.107:0/534023293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 0x559bf62c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.709+0000 7fb23b287b80 1 --2- 172.21.15.107:0/534023293 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c0010 0x559bf62c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.709+0000 7fb23b287b80 1 --2- 172.21.15.107:0/534023293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c6080 0x559bf62bfad0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.709+0000 7fb23b287b80 1 -- 172.21.15.107:0/534023293 >> 172.21.15.107:0/534023293 conn(0x559bf6214cd0 msgr2=0x559bf62b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:21.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.709+0000 7fb23b287b80 1 -- 172.21.15.107:0/534023293 shutdown_connections 2023-08-10T10:57:21.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.709+0000 7fb23b287b80 1 -- 172.21.15.107:0/534023293 wait complete. 2023-08-10T10:57:21.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.709+0000 7fb23b287b80 1 -- start start 2023-08-10T10:57:21.713 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.710+0000 7fb23b287b80 1 Processor -- start 2023-08-10T10:57:21.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.710+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c0010 0x559bf62cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.710+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c5760 0x559bf62c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.710+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 0x559bf62c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.710+0000 7fb23b287b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf62087a0 con 0x559bf62c6080 2023-08-10T10:57:21.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.710+0000 7fb23b287b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf61a7ac0 con 0x559bf62c0010 2023-08-10T10:57:21.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.710+0000 7fb23b287b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf61a77c0 con 0x559bf62c5760 2023-08-10T10:57:21.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.710+0000 7fb23b287b80 10 client.0 _ll_register_callbacks cb 0x559bf61a5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:57:21.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.710+0000 7fb224f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c5760 0x559bf62c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb224f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c5760 0x559bf62c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58306/0 (socket says 172.21.15.107:58306) 2023-08-10T10:57:21.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb224f9a700 1 -- 172.21.15.107:0/3460266843 learned_addr learned my addr 172.21.15.107:0/3460266843 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:21.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb225f9c700 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 0x559bf62c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb22579b700 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c0010 0x559bf62cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb224f9a700 1 -- 172.21.15.107:0/3460266843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c0010 msgr2=0x559bf62cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:21.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb224f9a700 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c0010 0x559bf62cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb224f9a700 1 -- 172.21.15.107:0/3460266843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 msgr2=0x559bf62c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:21.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb224f9a700 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 0x559bf62c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb224f9a700 1 -- 172.21.15.107:0/3460266843 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22010dec0 con 0x559bf62c5760 2023-08-10T10:57:21.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb224f9a700 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c5760 0x559bf62c93e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb210096ab0 tx=0x7fb2100cac20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d56afa6570287e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:21.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb208ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:57:21.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.711+0000 7fb208ff9700 1 -- 172.21.15.107:0/3460266843 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21009e070 con 0x559bf62c5760 2023-08-10T10:57:21.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb23b287b80 1 -- 172.21.15.107:0/3460266843 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559bf62aa470 con 0x559bf62c5760 2023-08-10T10:57:21.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb208ff9700 1 -- 172.21.15.107:0/3460266843 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fb2100a2490 con 0x559bf62c5760 2023-08-10T10:57:21.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb208ff9700 1 -- 172.21.15.107:0/3460266843 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb210099530 con 0x559bf62c5760 2023-08-10T10:57:21.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb23b287b80 10 client.26242 fetch_fsmap learned FSMap version 37 2023-08-10T10:57:21.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb23b287b80 1 -- 172.21.15.107:0/3460266843 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x559bf6035de0 con 0x559bf62c5760 2023-08-10T10:57:21.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb208ff9700 1 -- 172.21.15.107:0/3460266843 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559bf62aa470 con 0x559bf62c5760 2023-08-10T10:57:21.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb208ff9700 1 -- 172.21.15.107:0/3460266843 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 37) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fb210095e30 con 0x559bf62c5760 2023-08-10T10:57:21.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb23b287b80 10 client.26242 fetch_fsmap finished waiting for FSMap version 37 2023-08-10T10:57:21.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb23b287b80 10 client.26242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:57:21.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb23b287b80 20 client.26242 populate_metadata read hostname 'smithi107' 2023-08-10T10:57:21.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x559bf62d9b30 0x559bf62dbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb23b287b80 4 client.26242 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:57:21.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.712+0000 7fb23b287b80 1 -- 172.21.15.107:0/3460266843 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559bf62869d0 con 0x559bf62d9b30 2023-08-10T10:57:21.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.713+0000 7fb22579b700 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x559bf62d9b30 0x559bf62dbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.713+0000 7fb22579b700 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x559bf62d9b30 0x559bf62dbf50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51e44e067fed3bfa server_cookie=5cc842c8cc118edf in_seq=0 out_seq=0 2023-08-10T10:57:21.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.713+0000 7fb208ff9700 10 client.26242 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:57:21.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb208ff9700 1 -- 172.21.15.107:0/3460266843 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x559bf62869d0 con 0x559bf62d9b30 2023-08-10T10:57:21.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb208ff9700 10 client.26242 handle_command_reply: tid=0 2023-08-10T10:57:21.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb23b287b80 1 client.26242 shutdown 2023-08-10T10:57:21.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb23b287b80 1 -- 172.21.15.107:0/3460266843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c5760 msgr2=0x559bf62c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:21.721 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c5760 0x559bf62c93e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb210096ab0 tx=0x7fb2100cac20 comp rx=0 tx=0).stop 2023-08-10T10:57:21.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb23b287b80 1 -- 172.21.15.107:0/3460266843 shutdown_connections 2023-08-10T10:57:21.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x559bf62d9b30 0x559bf62dbf50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c0010 0x559bf62cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 0x559bf62c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb208ff9700 0 client.26242 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:57:21.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.714+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3460266843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c5760 0x559bf62c93e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.715+0000 7fb23b287b80 1 -- 172.21.15.107:0/3460266843 >> 172.21.15.107:0/3460266843 conn(0x559bf6214cd0 msgr2=0x559bf62b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:21.722 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.715+0000 7fb23b287b80 1 -- 172.21.15.107:0/3460266843 shutdown_connections 2023-08-10T10:57:21.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.715+0000 7fb23b287b80 1 -- 172.21.15.107:0/3460266843 wait complete. 2023-08-10T10:57:21.723 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.715+0000 7fb23b287b80 20 client.26242 trim_cache size 0 max 16384 2023-08-10T10:57:21.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.739+0000 7fb23b287b80 1 Processor -- start 2023-08-10T10:57:21.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.739+0000 7fb23b287b80 1 -- start start 2023-08-10T10:57:21.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.739+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.739+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 0x559bf62cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.739+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 0x559bf62b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.739+0000 7fb23b287b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf608b920 con 0x559bf62c6080 2023-08-10T10:57:21.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.739+0000 7fb23b287b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf62ca120 con 0x559bf62c5760 2023-08-10T10:57:21.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.739+0000 7fb23b287b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf62ca730 con 0x559bf62c0010 2023-08-10T10:57:21.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb225f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 0x559bf62b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb22579b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb22579b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:58310/0 (socket says 172.21.15.107:58310) 2023-08-10T10:57:21.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb22579b700 1 -- 172.21.15.107:0/3213855751 learned_addr learned my addr 172.21.15.107:0/3213855751 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:21.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb224f9a700 1 --2- 172.21.15.107:0/3213855751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 0x559bf62cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb22579b700 1 -- 172.21.15.107:0/3213855751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 msgr2=0x559bf62cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:21.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb22579b700 1 --2- 172.21.15.107:0/3213855751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 0x559bf62cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb22579b700 1 -- 172.21.15.107:0/3213855751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 msgr2=0x559bf62b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:21.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb22579b700 1 --2- 172.21.15.107:0/3213855751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 0x559bf62b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb22579b700 1 -- 172.21.15.107:0/3213855751 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bf601ec60 con 0x559bf62c0010 2023-08-10T10:57:21.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb224f9a700 1 --2- 172.21.15.107:0/3213855751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 0x559bf62cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:57:21.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.740+0000 7fb22579b700 1 --2- 172.21.15.107:0/3213855751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62d0b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb21c015000 tx=0x7fb21c00bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f1875b0e1882cb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:21.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb20bfff700 1 -- 172.21.15.107:0/3213855751 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c032070 con 0x559bf62c0010 2023-08-10T10:57:21.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb20bfff700 1 -- 172.21.15.107:0/3213855751 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb21c00bba0 con 0x559bf62c0010 2023-08-10T10:57:21.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb20bfff700 1 -- 172.21.15.107:0/3213855751 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c01d040 con 0x559bf62c0010 2023-08-10T10:57:21.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb23b287b80 1 -- 172.21.15.107:0/3213855751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 msgr2=0x559bf62d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:21.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3213855751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62d0b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb21c015000 tx=0x7fb21c00bef0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb23b287b80 1 -- 172.21.15.107:0/3213855751 shutdown_connections 2023-08-10T10:57:21.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3213855751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c6080 0x559bf62b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3213855751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62d0b10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb23b287b80 1 --2- 172.21.15.107:0/3213855751 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c5760 0x559bf62cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.741+0000 7fb23b287b80 1 -- 172.21.15.107:0/3213855751 >> 172.21.15.107:0/3213855751 conn(0x559bf6214cd0 msgr2=0x559bf62d5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:21.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.742+0000 7fb23b287b80 1 -- 172.21.15.107:0/3213855751 shutdown_connections 2023-08-10T10:57:21.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.742+0000 7fb23b287b80 1 -- 172.21.15.107:0/3213855751 wait complete. 2023-08-10T10:57:21.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.742+0000 7fb23b287b80 1 -- start start 2023-08-10T10:57:21.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.742+0000 7fb23b287b80 1 Processor -- start 2023-08-10T10:57:21.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62c2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c5760 0x559bf62c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb23b287b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c6080 0x559bf62c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb23b287b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf62c1870 con 0x559bf62c5760 2023-08-10T10:57:21.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb23b287b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf62c19e0 con 0x559bf62c6080 2023-08-10T10:57:21.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb23b287b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bf62c1ba0 con 0x559bf62c0010 2023-08-10T10:57:21.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb23b287b80 10 client.0 _ll_register_callbacks cb 0x559bf61a5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:57:21.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb224f9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c5760 0x559bf62c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb22579b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb224f9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c5760 0x559bf62c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55064/0 (socket says 172.21.15.107:55064) 2023-08-10T10:57:21.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb224f9a700 1 -- 172.21.15.107:0/1954153960 learned_addr learned my addr 172.21.15.107:0/1954153960 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:21.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.743+0000 7fb225f9c700 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c6080 0x559bf62c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb224f9a700 1 -- 172.21.15.107:0/1954153960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 msgr2=0x559bf62c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:21.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb224f9a700 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62c2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb224f9a700 1 -- 172.21.15.107:0/1954153960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c6080 msgr2=0x559bf62c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:21.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb224f9a700 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c6080 0x559bf62c1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb224f9a700 1 -- 172.21.15.107:0/1954153960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bf6089630 con 0x559bf62c5760 2023-08-10T10:57:21.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb22579b700 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:57:21.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb224f9a700 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c5760 0x559bf62c2a80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e970 tx=0x7fb210005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0899a16b1bc545 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:21.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb208ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:57:21.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb208ff9700 1 -- 172.21.15.107:0/1954153960 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100a2490 con 0x559bf62c5760 2023-08-10T10:57:21.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb23b287b80 1 -- 172.21.15.107:0/1954153960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb21c01e040 con 0x559bf62c5760 2023-08-10T10:57:21.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb208ff9700 1 -- 172.21.15.107:0/1954153960 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7fb21009e070 con 0x559bf62c5760 2023-08-10T10:57:21.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb208ff9700 1 -- 172.21.15.107:0/1954153960 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2100b81a0 con 0x559bf62c5760 2023-08-10T10:57:21.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.744+0000 7fb23b287b80 10 client.16554 fetch_fsmap learned FSMap version 37 2023-08-10T10:57:21.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.745+0000 7fb23b287b80 1 -- 172.21.15.107:0/1954153960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x559bf605c250 con 0x559bf62c5760 2023-08-10T10:57:21.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.745+0000 7fb208ff9700 1 -- 172.21.15.107:0/1954153960 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb21c01e040 con 0x559bf62c5760 2023-08-10T10:57:21.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.745+0000 7fb208ff9700 1 -- 172.21.15.107:0/1954153960 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 37) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fb210098fa0 con 0x559bf62c5760 2023-08-10T10:57:21.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.745+0000 7fb23b287b80 10 client.16554 fetch_fsmap finished waiting for FSMap version 37 2023-08-10T10:57:21.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.745+0000 7fb23b287b80 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:57:21.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.745+0000 7fb23b287b80 20 client.16554 populate_metadata read hostname 'smithi107' 2023-08-10T10:57:21.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.745+0000 7fb23b287b80 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x559bf632e540 0x559bf6330960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:21.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.745+0000 7fb23b287b80 4 client.16554 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:57:21.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.745+0000 7fb23b287b80 1 -- 172.21.15.107:0/1954153960 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559bf6201780 con 0x559bf632e540 2023-08-10T10:57:21.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.746+0000 7fb22579b700 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x559bf632e540 0x559bf6330960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.746+0000 7fb22579b700 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x559bf632e540 0x559bf6330960 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9abf1acf85f858c1 server_cookie=17d957c51cbd880f in_seq=0 out_seq=0 2023-08-10T10:57:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.746+0000 7fb208ff9700 10 client.16554 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:57:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.746+0000 7fb208ff9700 1 -- 172.21.15.107:0/1954153960 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559bf6201780 con 0x559bf632e540 2023-08-10T10:57:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.746+0000 7fb208ff9700 10 client.16554 handle_command_reply: tid=0 2023-08-10T10:57:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.746+0000 7fb23b287b80 1 client.16554 shutdown 2023-08-10T10:57:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 -- 172.21.15.107:0/1954153960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c5760 msgr2=0x559bf62c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c5760 0x559bf62c2a80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e970 tx=0x7fb210005bb0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 -- 172.21.15.107:0/1954153960 shutdown_connections 2023-08-10T10:57:21.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x559bf632e540 0x559bf6330960 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559bf62c6080 0x559bf62c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559bf62c0010 0x559bf62c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 --2- 172.21.15.107:0/1954153960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559bf62c5760 0x559bf62c2a80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 -- 172.21.15.107:0/1954153960 >> 172.21.15.107:0/1954153960 conn(0x559bf6214cd0 msgr2=0x559bf62c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:21.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb208ff9700 0 client.16554 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:57:21.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 -- 172.21.15.107:0/1954153960 shutdown_connections 2023-08-10T10:57:21.755 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 1 -- 172.21.15.107:0/1954153960 wait complete. 2023-08-10T10:57:21.756 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb23b287b80 20 client.16554 trim_cache size 0 max 16384 2023-08-10T10:57:21.756 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:57:21.756 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:57:21.756 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:57:21.756 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:57:21.757 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:57:21.757 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:57:21.757 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:57:21.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:57:21.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:57:21.757 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:57:21.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb2279ff700 1 -- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb20c0a12c0 msgr2=0x7fb20c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:21.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.747+0000 7fb2279ff700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb20c0a12c0 0x7fb20c0a3780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x559bf62c0d30 tx=0x7fb21800b040 comp rx=0 tx=0).stop 2023-08-10T10:57:21.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 -- 172.21.15.107:0/50882678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2201010b0 msgr2=0x7fb220072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:21.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2201010b0 0x7fb220072fb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e9a0 tx=0x7fb21000ecb0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.758 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 -- 172.21.15.107:0/50882678 shutdown_connections 2023-08-10T10:57:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fb20c0a12c0 0x7fb20c0a3780 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2201006f0 0x7fb220072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb220106700 0x7fb2201a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 --2- 172.21.15.107:0/50882678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2201010b0 0x7fb220072fb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 -- 172.21.15.107:0/50882678 >> 172.21.15.107:0/50882678 conn(0x7fb2200fc1e0 msgr2=0x7fb2200fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 -- 172.21.15.107:0/50882678 shutdown_connections 2023-08-10T10:57:21.759 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:21.748+0000 7fb2279ff700 1 -- 172.21.15.107:0/50882678 wait complete. 2023-08-10T10:57:21.771 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:57:22.023 INFO:teuthology.orchestra.run.smithi107.stderr:23600000 of 50000000 tuples (47%) done (elapsed 340.20 s, remaining 380.56 s) 2023-08-10T10:57:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:21 smithi157 ceph-mon[129604]: pgmap v187: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 16 MiB/s wr, 59 op/s 2023-08-10T10:57:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:21 smithi107 ceph-mon[127953]: pgmap v187: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 16 MiB/s wr, 59 op/s 2023-08-10T10:57:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:21 smithi195 ceph-mon[129938]: pgmap v187: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 16 MiB/s wr, 59 op/s 2023-08-10T10:57:23.263 INFO:teuthology.orchestra.run.smithi107.stderr:23700000 of 50000000 tuples (47%) done (elapsed 341.44 s, remaining 378.90 s) 2023-08-10T10:57:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:23 smithi157 ceph-mon[129604]: pgmap v188: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 16 MiB/s wr, 59 op/s 2023-08-10T10:57:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:23 smithi107 ceph-mon[127953]: pgmap v188: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 16 MiB/s wr, 59 op/s 2023-08-10T10:57:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:23 smithi195 ceph-mon[129938]: pgmap v188: 129 pgs: 129 active+clean; 5.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 16 MiB/s wr, 59 op/s 2023-08-10T10:57:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:23800000 of 50000000 tuples (47%) done (elapsed 342.69 s, remaining 377.25 s) 2023-08-10T10:57:25.781 INFO:teuthology.orchestra.run.smithi107.stderr:23900000 of 50000000 tuples (47%) done (elapsed 343.96 s, remaining 375.62 s) 2023-08-10T10:57:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:25 smithi157 ceph-mon[129604]: pgmap v189: 129 pgs: 129 active+clean; 5.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 84 op/s 2023-08-10T10:57:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:25 smithi107 ceph-mon[127953]: pgmap v189: 129 pgs: 129 active+clean; 5.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 84 op/s 2023-08-10T10:57:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:25 smithi195 ceph-mon[129938]: pgmap v189: 129 pgs: 129 active+clean; 5.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 84 op/s 2023-08-10T10:57:27.489 INFO:teuthology.orchestra.run.smithi107.stderr:24000000 of 50000000 tuples (48%) done (elapsed 345.67 s, remaining 374.47 s) 2023-08-10T10:57:28.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:27 smithi157 ceph-mon[129604]: pgmap v190: 129 pgs: 129 active+clean; 5.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 43 op/s 2023-08-10T10:57:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:27 smithi107 ceph-mon[127953]: pgmap v190: 129 pgs: 129 active+clean; 5.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 43 op/s 2023-08-10T10:57:28.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:27 smithi195 ceph-mon[129938]: pgmap v190: 129 pgs: 129 active+clean; 5.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 43 op/s 2023-08-10T10:57:28.797 INFO:teuthology.orchestra.run.smithi107.stderr:24100000 of 50000000 tuples (48%) done (elapsed 346.97 s, remaining 372.89 s) 2023-08-10T10:57:29.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:57:29.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:57:29.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:57:30.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:29 smithi157 ceph-mon[129604]: pgmap v191: 129 pgs: 129 active+clean; 5.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 77 op/s 2023-08-10T10:57:30.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:29 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:57:30.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:29 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:57:30.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:29 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:57:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:29 smithi107 ceph-mon[127953]: pgmap v191: 129 pgs: 129 active+clean; 5.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 77 op/s 2023-08-10T10:57:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:29 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:57:30.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:29 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:57:30.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:29 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:57:30.107 INFO:teuthology.orchestra.run.smithi107.stderr:24200000 of 50000000 tuples (48%) done (elapsed 348.28 s, remaining 371.31 s) 2023-08-10T10:57:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:29 smithi195 ceph-mon[129938]: pgmap v191: 129 pgs: 129 active+clean; 5.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 77 op/s 2023-08-10T10:57:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:29 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:57:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:29 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:57:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:29 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:57:31.455 INFO:teuthology.orchestra.run.smithi107.stderr:24300000 of 50000000 tuples (48%) done (elapsed 349.63 s, remaining 369.78 s) 2023-08-10T10:57:32.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:31 smithi157 ceph-mon[129604]: pgmap v192: 129 pgs: 129 active+clean; 5.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:31 smithi107 ceph-mon[127953]: pgmap v192: 129 pgs: 129 active+clean; 5.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:31 smithi195 ceph-mon[129938]: pgmap v192: 129 pgs: 129 active+clean; 5.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:32.713 INFO:teuthology.orchestra.run.smithi107.stderr:24400000 of 50000000 tuples (48%) done (elapsed 350.89 s, remaining 368.15 s) 2023-08-10T10:57:33.982 INFO:teuthology.orchestra.run.smithi107.stderr:24500000 of 50000000 tuples (49%) done (elapsed 352.16 s, remaining 366.53 s) 2023-08-10T10:57:34.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:33 smithi157 ceph-mon[129604]: pgmap v193: 129 pgs: 129 active+clean; 5.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:33 smithi107 ceph-mon[127953]: pgmap v193: 129 pgs: 129 active+clean; 5.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:34.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:33 smithi195 ceph-mon[129938]: pgmap v193: 129 pgs: 129 active+clean; 5.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:35.220 INFO:teuthology.orchestra.run.smithi107.stderr:24600000 of 50000000 tuples (49%) done (elapsed 353.40 s, remaining 364.89 s) 2023-08-10T10:57:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:35 smithi107 ceph-mon[127953]: pgmap v194: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 94 op/s 2023-08-10T10:57:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:35 smithi195 ceph-mon[129938]: pgmap v194: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 94 op/s 2023-08-10T10:57:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:35 smithi157 ceph-mon[129604]: pgmap v194: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 94 op/s 2023-08-10T10:57:36.524 INFO:teuthology.orchestra.run.smithi107.stderr:24700000 of 50000000 tuples (49%) done (elapsed 354.70 s, remaining 363.32 s) 2023-08-10T10:57:37.732 INFO:teuthology.orchestra.run.smithi107.stderr:24800000 of 50000000 tuples (49%) done (elapsed 355.91 s, remaining 361.65 s) 2023-08-10T10:57:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:37 smithi107 ceph-mon[127953]: pgmap v195: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 68 op/s 2023-08-10T10:57:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:37 smithi195 ceph-mon[129938]: pgmap v195: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 68 op/s 2023-08-10T10:57:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:37 smithi157 ceph-mon[129604]: pgmap v195: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 MiB/s wr, 68 op/s 2023-08-10T10:57:38.993 INFO:teuthology.orchestra.run.smithi107.stderr:24900000 of 50000000 tuples (49%) done (elapsed 357.17 s, remaining 360.04 s) 2023-08-10T10:57:39.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:38 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:38 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:39.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:38 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:39 smithi107 ceph-mon[127953]: pgmap v196: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 34 MiB/s wr, 95 op/s 2023-08-10T10:57:40.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:39 smithi195 ceph-mon[129938]: pgmap v196: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 34 MiB/s wr, 95 op/s 2023-08-10T10:57:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:39 smithi157 ceph-mon[129604]: pgmap v196: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 34 MiB/s wr, 95 op/s 2023-08-10T10:57:40.310 INFO:teuthology.orchestra.run.smithi107.stderr:25000000 of 50000000 tuples (50%) done (elapsed 358.49 s, remaining 358.49 s) 2023-08-10T10:57:41.534 INFO:teuthology.orchestra.run.smithi107.stderr:25100000 of 50000000 tuples (50%) done (elapsed 359.71 s, remaining 356.85 s) 2023-08-10T10:57:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:41 smithi107 ceph-mon[127953]: pgmap v197: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:42.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:41 smithi195 ceph-mon[129938]: pgmap v197: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:41 smithi157 ceph-mon[129604]: pgmap v197: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:42.770 INFO:teuthology.orchestra.run.smithi107.stderr:25200000 of 50000000 tuples (50%) done (elapsed 360.95 s, remaining 355.22 s) 2023-08-10T10:57:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:43 smithi107 ceph-mon[127953]: pgmap v198: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:44.141 INFO:teuthology.orchestra.run.smithi107.stderr:25300000 of 50000000 tuples (50%) done (elapsed 362.32 s, remaining 353.73 s) 2023-08-10T10:57:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:43 smithi195 ceph-mon[129938]: pgmap v198: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:43 smithi157 ceph-mon[129604]: pgmap v198: 129 pgs: 129 active+clean; 5.7 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 MiB/s wr, 60 op/s 2023-08-10T10:57:45.385 INFO:teuthology.orchestra.run.smithi107.stderr:25400000 of 50000000 tuples (50%) done (elapsed 363.56 s, remaining 352.11 s) 2023-08-10T10:57:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:45 smithi107 ceph-mon[127953]: pgmap v199: 129 pgs: 129 active+clean; 5.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-08-10T10:57:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:45 smithi195 ceph-mon[129938]: pgmap v199: 129 pgs: 129 active+clean; 5.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-08-10T10:57:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:45 smithi157 ceph-mon[129604]: pgmap v199: 129 pgs: 129 active+clean; 5.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-08-10T10:57:46.673 INFO:teuthology.orchestra.run.smithi107.stderr:25500000 of 50000000 tuples (51%) done (elapsed 364.85 s, remaining 350.54 s) 2023-08-10T10:57:47.976 INFO:teuthology.orchestra.run.smithi107.stderr:25600000 of 50000000 tuples (51%) done (elapsed 366.15 s, remaining 348.99 s) 2023-08-10T10:57:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:47 smithi107 ceph-mon[127953]: pgmap v200: 129 pgs: 129 active+clean; 5.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-08-10T10:57:48.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:47 smithi195 ceph-mon[129938]: pgmap v200: 129 pgs: 129 active+clean; 5.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-08-10T10:57:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:47 smithi157 ceph-mon[129604]: pgmap v200: 129 pgs: 129 active+clean; 5.8 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-08-10T10:57:49.366 INFO:teuthology.orchestra.run.smithi107.stderr:25700000 of 50000000 tuples (51%) done (elapsed 367.54 s, remaining 347.52 s) 2023-08-10T10:57:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:49 smithi107 ceph-mon[127953]: pgmap v201: 129 pgs: 129 active+clean; 5.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 35 MiB/s wr, 93 op/s 2023-08-10T10:57:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:49 smithi195 ceph-mon[129938]: pgmap v201: 129 pgs: 129 active+clean; 5.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 35 MiB/s wr, 93 op/s 2023-08-10T10:57:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:49 smithi157 ceph-mon[129604]: pgmap v201: 129 pgs: 129 active+clean; 5.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 35 MiB/s wr, 93 op/s 2023-08-10T10:57:50.636 INFO:teuthology.orchestra.run.smithi107.stderr:25800000 of 50000000 tuples (51%) done (elapsed 368.81 s, remaining 345.94 s) 2023-08-10T10:57:51.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:50 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:51.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:50 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:51.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:50 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:51.771 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:57:51.875 INFO:teuthology.orchestra.run.smithi107.stderr:25900000 of 50000000 tuples (51%) done (elapsed 370.05 s, remaining 344.33 s) 2023-08-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:51.998+0000 7ffbc15ff700 1 -- 172.21.15.107:0/7015605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc106e90 msgr2=0x7ffbbc107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:51.998+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/7015605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc106e90 0x7ffbbc107310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009990 tx=0x7ffbb0009ca0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:51.998+0000 7ffbc15ff700 1 -- 172.21.15.107:0/7015605 shutdown_connections 2023-08-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:51.998+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/7015605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbbc10ce10 0x7ffbbc10d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:51.998+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/7015605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbbc107850 0x7ffbbc113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:51.998+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/7015605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc106e90 0x7ffbbc107310 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:51.998+0000 7ffbc15ff700 1 -- 172.21.15.107:0/7015605 >> 172.21.15.107:0/7015605 conn(0x7ffbbc076610 msgr2=0x7ffbbc105590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:51.998+0000 7ffbc15ff700 1 -- 172.21.15.107:0/7015605 shutdown_connections 2023-08-10T10:57:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:51.999+0000 7ffbc15ff700 1 -- 172.21.15.107:0/7015605 wait complete. 2023-08-10T10:57:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.000+0000 7ffbc15ff700 1 Processor -- start 2023-08-10T10:57:52.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.000+0000 7ffbc15ff700 1 -- start start 2023-08-10T10:57:52.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.001+0000 7ffbc15ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbbc106e90 0x7ffbbc19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.001+0000 7ffbc15ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbbc107850 0x7ffbbc19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.001+0000 7ffbc15ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc10ce10 0x7ffbbc1a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.001+0000 7ffbc15ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc1a0bb0 con 0x7ffbbc107850 2023-08-10T10:57:52.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.001+0000 7ffbc15ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc1a0d20 con 0x7ffbbc106e90 2023-08-10T10:57:52.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.001+0000 7ffbc15ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc1a0ee0 con 0x7ffbbc10ce10 2023-08-10T10:57:52.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.001+0000 7ffbbb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc10ce10 0x7ffbbc1a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.001+0000 7ffbbb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc10ce10 0x7ffbbc1a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:53676/0 (socket says 172.21.15.107:53676) 2023-08-10T10:57:52.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.001+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/4220250859 learned_addr learned my addr 172.21.15.107:0/4220250859 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:52.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.002+0000 7ffbbaffd700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbbc106e90 0x7ffbbc19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.002+0000 7ffbba7fc700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbbc107850 0x7ffbbc19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.002+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/4220250859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbbc106e90 msgr2=0x7ffbbc19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:52.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.002+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbbc106e90 0x7ffbbc19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.002+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbbc107850 msgr2=0x7ffbbc19d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:52.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.002+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbbc107850 0x7ffbbc19d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.002+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/4220250859 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb00095f0 con 0x7ffbbc10ce10 2023-08-10T10:57:52.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.003+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc10ce10 0x7ffbbc1a05b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400efc0 tx=0x7ffbb400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:52.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.003+0000 7ffba3fff700 1 -- 172.21.15.107:0/4220250859 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4018070 con 0x7ffbbc10ce10 2023-08-10T10:57:52.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.003+0000 7ffba3fff700 1 -- 172.21.15.107:0/4220250859 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbb400f040 con 0x7ffbbc10ce10 2023-08-10T10:57:52.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.003+0000 7ffbc15ff700 1 -- 172.21.15.107:0/4220250859 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbbc1a1160 con 0x7ffbbc10ce10 2023-08-10T10:57:52.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.003+0000 7ffba3fff700 1 -- 172.21.15.107:0/4220250859 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400cbb0 con 0x7ffbbc10ce10 2023-08-10T10:57:52.006 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.003+0000 7ffbc15ff700 1 -- 172.21.15.107:0/4220250859 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc1a9b20 con 0x7ffbbc10ce10 2023-08-10T10:57:52.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.008+0000 7ffba3fff700 1 -- 172.21.15.107:0/4220250859 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ffbb4007500 con 0x7ffbbc10ce10 2023-08-10T10:57:52.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.010+0000 7ffbd4fdeb80 1 Processor -- start 2023-08-10T10:57:52.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.010+0000 7ffba3fff700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffba40a13c0 0x7ffba40a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.011+0000 7ffba3fff700 1 -- 172.21.15.107:0/4220250859 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ffbb40ccb20 con 0x7ffbbc10ce10 2023-08-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.011+0000 7ffbba7fc700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffba40a13c0 0x7ffba40a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.011+0000 7ffbd4fdeb80 1 -- start start 2023-08-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.011+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea593f50 0x55f6ea594330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.011+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea594870 0x55f6ea58e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.011+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea58ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.012+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea509dc0 con 0x55f6ea594870 2023-08-10T10:57:52.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.012+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea4e6590 con 0x55f6ea593f50 2023-08-10T10:57:52.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.012+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea4e3eb0 con 0x55f6ea58e800 2023-08-10T10:57:52.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.012+0000 7ffbba7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea594870 0x55f6ea58e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.012+0000 7ffbba7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea594870 0x55f6ea58e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57838/0 (socket says 172.21.15.107:57838) 2023-08-10T10:57:52.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.012+0000 7ffbba7fc700 1 -- 172.21.15.107:0/2289973219 learned_addr learned my addr 172.21.15.107:0/2289973219 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:52.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.012+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/2289973219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea58ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffbbaffd700 1 --2- 172.21.15.107:0/2289973219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea593f50 0x55f6ea594330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/2289973219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea593f50 msgr2=0x55f6ea594330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:52.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/2289973219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea593f50 0x55f6ea594330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/2289973219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea594870 msgr2=0x55f6ea58e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:52.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/2289973219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea594870 0x55f6ea58e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/2289973219 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6ea360630 con 0x55f6ea58e800 2023-08-10T10:57:52.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffbba7fc700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffba40a13c0 0x7ffba40a3880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000c00 tx=0x7ffbb0005470 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:52.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/2289973219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea58ec80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40c9f10 tx=0x7ffbb4095cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=409b5db72ddf04c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:52.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffba17fa700 1 -- 172.21.15.107:0/2289973219 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4004ad0 con 0x55f6ea58e800 2023-08-10T10:57:52.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffba17fa700 1 -- 172.21.15.107:0/2289973219 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbb4099880 con 0x55f6ea58e800 2023-08-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.013+0000 7ffba17fa700 1 -- 172.21.15.107:0/2289973219 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40b9320 con 0x55f6ea58e800 2023-08-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.014+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/2289973219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 msgr2=0x55f6ea58ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.014+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/2289973219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea58ec80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40c9f10 tx=0x7ffbb4095cf0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.015+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/2289973219 shutdown_connections 2023-08-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.015+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/2289973219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea593f50 0x55f6ea594330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.015+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/2289973219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea58ec80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.015+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/2289973219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea594870 0x55f6ea58e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.015+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/2289973219 >> 172.21.15.107:0/2289973219 conn(0x55f6ea4ebcd0 msgr2=0x55f6ea5894d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.015+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/2289973219 shutdown_connections 2023-08-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.015+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/2289973219 wait complete. 2023-08-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.016+0000 7ffbd4fdeb80 1 -- start start 2023-08-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.016+0000 7ffbd4fdeb80 1 Processor -- start 2023-08-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea58e800 0x55f6ea59a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea593f50 0x55f6ea597b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea5982a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea4df7a0 con 0x55f6ea58e800 2023-08-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea47eac0 con 0x55f6ea594870 2023-08-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea47e7c0 con 0x55f6ea593f50 2023-08-10T10:57:52.021 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbd4fdeb80 10 client.0 _ll_register_callbacks cb 0x55f6ea47c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:57:52.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbba7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea593f50 0x55f6ea597b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbba7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea593f50 0x55f6ea597b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:53694/0 (socket says 172.21.15.107:53694) 2023-08-10T10:57:52.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.017+0000 7ffbba7fc700 1 -- 172.21.15.107:0/1345210714 learned_addr learned my addr 172.21.15.107:0/1345210714 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:52.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.018+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea5982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.018+0000 7ffbbaffd700 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea58e800 0x55f6ea59a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.018+0000 7ffbba7fc700 1 -- 172.21.15.107:0/1345210714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 msgr2=0x55f6ea5982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:52.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.018+0000 7ffbba7fc700 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea5982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.018+0000 7ffbba7fc700 1 -- 172.21.15.107:0/1345210714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea58e800 msgr2=0x55f6ea59a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:52.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.018+0000 7ffbba7fc700 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea58e800 0x55f6ea59a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.018+0000 7ffbba7fc700 1 -- 172.21.15.107:0/1345210714 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc1a9b20 con 0x55f6ea593f50 2023-08-10T10:57:52.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.018+0000 7ffbba7fc700 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea593f50 0x55f6ea597b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0005910 tx=0x7ffbb0009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e26e06a0413584a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:52.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.018+0000 7ffb9eff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:57:52.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.019+0000 7ffb9eff5700 1 -- 172.21.15.107:0/1345210714 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0004cf0 con 0x55f6ea593f50 2023-08-10T10:57:52.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.019+0000 7ffb9eff5700 1 -- 172.21.15.107:0/1345210714 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ffbb000be60 con 0x55f6ea593f50 2023-08-10T10:57:52.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.019+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/1345210714 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6ea581470 con 0x55f6ea593f50 2023-08-10T10:57:52.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.019+0000 7ffb9eff5700 1 -- 172.21.15.107:0/1345210714 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbb0004e50 con 0x55f6ea593f50 2023-08-10T10:57:52.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.019+0000 7ffbd4fdeb80 10 client.26260 fetch_fsmap learned FSMap version 39 2023-08-10T10:57:52.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.019+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/1345210714 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f6ea30cde0 con 0x55f6ea593f50 2023-08-10T10:57:52.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.019+0000 7ffb9eff5700 1 -- 172.21.15.107:0/1345210714 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f6ea581470 con 0x55f6ea593f50 2023-08-10T10:57:52.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.020+0000 7ffb9eff5700 1 -- 172.21.15.107:0/1345210714 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 39) v1 ==== 7494+0+0 (secure 0 0 0) 0x7ffbb0018400 con 0x55f6ea593f50 2023-08-10T10:57:52.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.020+0000 7ffbd4fdeb80 10 client.26260 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T10:57:52.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.020+0000 7ffbd4fdeb80 10 client.26260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:57:52.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.020+0000 7ffbd4fdeb80 20 client.26260 populate_metadata read hostname 'smithi107' 2023-08-10T10:57:52.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.020+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f6ea5a81d0 0x55f6ea5aa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.020+0000 7ffbd4fdeb80 4 client.26260 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:57:52.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.020+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/1345210714 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6ea55d9d0 con 0x55f6ea5a81d0 2023-08-10T10:57:52.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.020+0000 7ffbbaffd700 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f6ea5a81d0 0x55f6ea5aa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.021+0000 7ffbbaffd700 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f6ea5a81d0 0x55f6ea5aa5f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfa6f5e8961cc641 server_cookie=de67d326eb1372e5 in_seq=0 out_seq=0 2023-08-10T10:57:52.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.021+0000 7ffb9eff5700 10 client.26260 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:57:52.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.022+0000 7ffb9eff5700 1 -- 172.21.15.107:0/1345210714 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55f6ea55d9d0 con 0x55f6ea5a81d0 2023-08-10T10:57:52.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.022+0000 7ffb9eff5700 10 client.26260 handle_command_reply: tid=0 2023-08-10T10:57:52.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.022+0000 7ffbd4fdeb80 1 client.26260 shutdown 2023-08-10T10:57:52.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/1345210714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea593f50 msgr2=0x55f6ea597b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:52.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea593f50 0x55f6ea597b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0005910 tx=0x7ffbb0009ca0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/1345210714 shutdown_connections 2023-08-10T10:57:52.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f6ea5a81d0 0x55f6ea5aa5f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea5982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea58e800 0x55f6ea59a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/1345210714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea593f50 0x55f6ea597b60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/1345210714 >> 172.21.15.107:0/1345210714 conn(0x55f6ea4ebcd0 msgr2=0x55f6ea5889b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:52.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffb9eff5700 0 client.26260 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:57:52.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/1345210714 shutdown_connections 2023-08-10T10:57:52.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.023+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/1345210714 wait complete. 2023-08-10T10:57:52.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.024+0000 7ffbd4fdeb80 20 client.26260 trim_cache size 0 max 16384 2023-08-10T10:57:52.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.052+0000 7ffbd4fdeb80 1 Processor -- start 2023-08-10T10:57:52.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.053+0000 7ffbd4fdeb80 1 -- start start 2023-08-10T10:57:52.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.053+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea58e800 0x55f6ea59f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.053+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 0x55f6ea593280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.053+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea594870 0x55f6ea59a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.053+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea362920 con 0x55f6ea593f50 2023-08-10T10:57:52.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.053+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea5a59a0 con 0x55f6ea58e800 2023-08-10T10:57:52.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.053+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea599140 con 0x55f6ea594870 2023-08-10T10:57:52.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.054+0000 7ffbbb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea594870 0x55f6ea59a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.054+0000 7ffbbb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea594870 0x55f6ea59a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:53698/0 (socket says 172.21.15.107:53698) 2023-08-10T10:57:52.056 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.054+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/989925651 learned_addr learned my addr 172.21.15.107:0/989925651 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:52.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.054+0000 7ffbba7fc700 1 --2- 172.21.15.107:0/989925651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 0x55f6ea593280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.054+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/989925651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea58e800 msgr2=0x55f6ea59f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:52.057 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.054+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/989925651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea58e800 0x55f6ea59f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.054+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/989925651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 msgr2=0x55f6ea593280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:52.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.054+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/989925651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 0x55f6ea593280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.054+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/989925651 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6ea2f5c60 con 0x55f6ea594870 2023-08-10T10:57:52.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.055+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/989925651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea594870 0x55f6ea59a480 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40962f0 tx=0x7ffbb4099750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8cb7c820b8b4e52 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:52.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.055+0000 7ffba1ffb700 1 -- 172.21.15.107:0/989925651 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40a1c40 con 0x55f6ea594870 2023-08-10T10:57:52.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.055+0000 7ffba1ffb700 1 -- 172.21.15.107:0/989925651 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbb4004ad0 con 0x55f6ea594870 2023-08-10T10:57:52.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.055+0000 7ffba1ffb700 1 -- 172.21.15.107:0/989925651 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4099d40 con 0x55f6ea594870 2023-08-10T10:57:52.059 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.056+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/989925651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea594870 msgr2=0x55f6ea59a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:52.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.056+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/989925651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea594870 0x55f6ea59a480 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40962f0 tx=0x7ffbb4099750 comp rx=0 tx=0).stop 2023-08-10T10:57:52.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.056+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/989925651 shutdown_connections 2023-08-10T10:57:52.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.056+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/989925651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea58e800 0x55f6ea59f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.060 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.056+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/989925651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea594870 0x55f6ea59a480 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.056+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/989925651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 0x55f6ea593280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.061 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.056+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/989925651 >> 172.21.15.107:0/989925651 conn(0x55f6ea4ebcd0 msgr2=0x55f6ea592b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:52.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.056+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/989925651 shutdown_connections 2023-08-10T10:57:52.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.056+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/989925651 wait complete. 2023-08-10T10:57:52.065 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.057+0000 7ffbd4fdeb80 1 -- start start 2023-08-10T10:57:52.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.057+0000 7ffbd4fdeb80 1 Processor -- start 2023-08-10T10:57:52.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.057+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea590da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.057+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 0x55f6ea5912e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbd4fdeb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea58f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea5900a0 con 0x55f6ea593f50 2023-08-10T10:57:52.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea590210 con 0x55f6ea594870 2023-08-10T10:57:52.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbd4fdeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6ea5903d0 con 0x55f6ea58e800 2023-08-10T10:57:52.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbd4fdeb80 10 client.0 _ll_register_callbacks cb 0x55f6ea47c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:57:52.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbbaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea590da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbbb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea58f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbbb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea58f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:41634/0 (socket says 172.21.15.107:41634) 2023-08-10T10:57:52.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/279408566 learned_addr learned my addr 172.21.15.107:0/279408566 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:57:52.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.058+0000 7ffbba7fc700 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 0x55f6ea5912e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.059+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/279408566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 msgr2=0x55f6ea590da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:52.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.059+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea590da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.059+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/279408566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 msgr2=0x55f6ea5912e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:57:52.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.059+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 0x55f6ea5912e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.059+0000 7ffbbb7fe700 1 -- 172.21.15.107:0/279408566 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6ea360630 con 0x55f6ea594870 2023-08-10T10:57:52.070 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.059+0000 7ffbbaffd700 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea590da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:57:52.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.059+0000 7ffbbb7fe700 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea58f990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40a1710 tx=0x7ffbb40a1c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a29dcd4dc1aeb4e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:57:52.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.059+0000 7ffb9eff5700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:57:52.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.060+0000 7ffb9eff5700 1 -- 172.21.15.107:0/279408566 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb409d8b0 con 0x55f6ea594870 2023-08-10T10:57:52.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.060+0000 7ffb9eff5700 1 -- 172.21.15.107:0/279408566 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9286+0+0 (secure 0 0 0) 0x7ffbb4097c20 con 0x55f6ea594870 2023-08-10T10:57:52.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.060+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/279408566 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbb4099880 con 0x55f6ea594870 2023-08-10T10:57:52.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.060+0000 7ffb9eff5700 1 -- 172.21.15.107:0/279408566 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbb4098f80 con 0x55f6ea594870 2023-08-10T10:57:52.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.060+0000 7ffbd4fdeb80 10 client.26228 fetch_fsmap learned FSMap version 39 2023-08-10T10:57:52.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.061+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/279408566 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f6ea333250 con 0x55f6ea594870 2023-08-10T10:57:52.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.061+0000 7ffb9eff5700 1 -- 172.21.15.107:0/279408566 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbb4099880 con 0x55f6ea594870 2023-08-10T10:57:52.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.061+0000 7ffb9eff5700 1 -- 172.21.15.107:0/279408566 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 39) v1 ==== 7494+0+0 (secure 0 0 0) 0x7ffbb4095670 con 0x55f6ea594870 2023-08-10T10:57:52.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.061+0000 7ffbd4fdeb80 10 client.26228 fetch_fsmap finished waiting for FSMap version 39 2023-08-10T10:57:52.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.061+0000 7ffbd4fdeb80 10 client.26228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:57:52.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.061+0000 7ffbd4fdeb80 20 client.26228 populate_metadata read hostname 'smithi107' 2023-08-10T10:57:52.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.061+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f6ea5fcbd0 0x55f6ea5fefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:57:52.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.061+0000 7ffbd4fdeb80 4 client.26228 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:57:52.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.061+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/279408566 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f6ea4d8780 con 0x55f6ea5fcbd0 2023-08-10T10:57:52.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.062+0000 7ffbbaffd700 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f6ea5fcbd0 0x55f6ea5fefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:57:52.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.062+0000 7ffbbaffd700 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f6ea5fcbd0 0x55f6ea5fefc0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4694dcee944e59e server_cookie=246493717c865bf0 in_seq=0 out_seq=0 2023-08-10T10:57:52.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.062+0000 7ffb9eff5700 10 client.26228 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:57:52.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffb9eff5700 1 -- 172.21.15.107:0/279408566 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f6ea4d8780 con 0x55f6ea5fcbd0 2023-08-10T10:57:52.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffb9eff5700 10 client.26228 handle_command_reply: tid=0 2023-08-10T10:57:52.076 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffbd4fdeb80 1 client.26228 shutdown 2023-08-10T10:57:52.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/279408566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 msgr2=0x55f6ea58f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:52.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea58f990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40a1710 tx=0x7ffbb40a1c40 comp rx=0 tx=0).stop 2023-08-10T10:57:52.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/279408566 shutdown_connections 2023-08-10T10:57:52.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55f6ea5fcbd0 0x55f6ea5fefc0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f6ea594870 0x55f6ea58f990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f6ea58e800 0x55f6ea590da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffbd4fdeb80 1 --2- 172.21.15.107:0/279408566 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6ea593f50 0x55f6ea5912e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/279408566 >> 172.21.15.107:0/279408566 conn(0x55f6ea4ebcd0 msgr2=0x55f6ea593400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:52.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.063+0000 7ffb9eff5700 0 client.26228 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:57:52.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.064+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/279408566 shutdown_connections 2023-08-10T10:57:52.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.064+0000 7ffbd4fdeb80 1 -- 172.21.15.107:0/279408566 wait complete. 2023-08-10T10:57:52.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.064+0000 7ffbd4fdeb80 20 client.26228 trim_cache size 0 max 16384 2023-08-10T10:57:52.079 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:57:52.079 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:57:52.079 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:57:52.079 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:57:52.079 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:57:52.080 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:57:52.080 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:57:52.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:57:52.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:57:52.080 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:57:52.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.064+0000 7ffbc15ff700 1 -- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffba40a13c0 msgr2=0x7ffba40a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.064+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffba40a13c0 0x7ffba40a3880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000c00 tx=0x7ffbb0005470 comp rx=0 tx=0).stop 2023-08-10T10:57:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.064+0000 7ffbc15ff700 1 -- 172.21.15.107:0/4220250859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc10ce10 msgr2=0x7ffbbc1a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:57:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.064+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc10ce10 0x7ffbbc1a05b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400efc0 tx=0x7ffbb400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.065+0000 7ffbc15ff700 1 -- 172.21.15.107:0/4220250859 shutdown_connections 2023-08-10T10:57:52.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.065+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffba40a13c0 0x7ffba40a3880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.065+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbbc106e90 0x7ffbbc19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.065+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffbbc10ce10 0x7ffbbc1a05b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.065+0000 7ffbc15ff700 1 --2- 172.21.15.107:0/4220250859 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffbbc107850 0x7ffbbc19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:57:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.065+0000 7ffbc15ff700 1 -- 172.21.15.107:0/4220250859 >> 172.21.15.107:0/4220250859 conn(0x7ffbbc076610 msgr2=0x7ffbbc077630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:57:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.065+0000 7ffbc15ff700 1 -- 172.21.15.107:0/4220250859 shutdown_connections 2023-08-10T10:57:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:57:52.065+0000 7ffbc15ff700 1 -- 172.21.15.107:0/4220250859 wait complete. 2023-08-10T10:57:52.085 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:57:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:51 smithi195 ceph-mon[129938]: pgmap v202: 129 pgs: 129 active+clean; 5.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 67 op/s 2023-08-10T10:57:52.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:51 smithi157 ceph-mon[129604]: pgmap v202: 129 pgs: 129 active+clean; 5.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 67 op/s 2023-08-10T10:57:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:51 smithi107 ceph-mon[127953]: pgmap v202: 129 pgs: 129 active+clean; 5.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 67 op/s 2023-08-10T10:57:53.191 INFO:teuthology.orchestra.run.smithi107.stderr:26000000 of 50000000 tuples (52%) done (elapsed 371.37 s, remaining 342.80 s) 2023-08-10T10:57:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:53 smithi195 ceph-mon[129938]: pgmap v203: 129 pgs: 129 active+clean; 5.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 67 op/s 2023-08-10T10:57:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:53 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:53 smithi157 ceph-mon[129604]: pgmap v203: 129 pgs: 129 active+clean; 5.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 67 op/s 2023-08-10T10:57:54.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:53 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:53 smithi107 ceph-mon[127953]: pgmap v203: 129 pgs: 129 active+clean; 5.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 67 op/s 2023-08-10T10:57:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:53 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:54.603 INFO:teuthology.orchestra.run.smithi107.stderr:26100000 of 50000000 tuples (52%) done (elapsed 372.78 s, remaining 341.36 s) 2023-08-10T10:57:55.855 INFO:teuthology.orchestra.run.smithi107.stderr:26200000 of 50000000 tuples (52%) done (elapsed 374.03 s, remaining 339.77 s) 2023-08-10T10:57:56.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:55 smithi195 ceph-mon[129938]: pgmap v204: 129 pgs: 129 active+clean; 6.0 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-08-10T10:57:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:55 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:55 smithi157 ceph-mon[129604]: pgmap v204: 129 pgs: 129 active+clean; 6.0 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-08-10T10:57:56.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:55 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:55 smithi107 ceph-mon[127953]: pgmap v204: 129 pgs: 129 active+clean; 6.0 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-08-10T10:57:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:55 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:57:57.117 INFO:teuthology.orchestra.run.smithi107.stderr:26300000 of 50000000 tuples (52%) done (elapsed 375.29 s, remaining 338.19 s) 2023-08-10T10:57:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:57 smithi195 ceph-mon[129938]: pgmap v205: 129 pgs: 129 active+clean; 6.0 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 23 MiB/s wr, 68 op/s 2023-08-10T10:57:58.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:57 smithi157 ceph-mon[129604]: pgmap v205: 129 pgs: 129 active+clean; 6.0 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 23 MiB/s wr, 68 op/s 2023-08-10T10:57:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:57 smithi107 ceph-mon[127953]: pgmap v205: 129 pgs: 129 active+clean; 6.0 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 23 MiB/s wr, 68 op/s 2023-08-10T10:57:58.491 INFO:teuthology.orchestra.run.smithi107.stderr:26400000 of 50000000 tuples (52%) done (elapsed 376.67 s, remaining 336.72 s) 2023-08-10T10:57:59.710 INFO:teuthology.orchestra.run.smithi107.stderr:26500000 of 50000000 tuples (53%) done (elapsed 377.89 s, remaining 335.11 s) 2023-08-10T10:58:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:57:59 smithi195 ceph-mon[129938]: pgmap v206: 129 pgs: 129 active+clean; 6.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 34 MiB/s wr, 107 op/s 2023-08-10T10:58:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:57:59 smithi157 ceph-mon[129604]: pgmap v206: 129 pgs: 129 active+clean; 6.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 34 MiB/s wr, 107 op/s 2023-08-10T10:58:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:57:59 smithi107 ceph-mon[127953]: pgmap v206: 129 pgs: 129 active+clean; 6.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 34 MiB/s wr, 107 op/s 2023-08-10T10:58:01.008 INFO:teuthology.orchestra.run.smithi107.stderr:26600000 of 50000000 tuples (53%) done (elapsed 379.19 s, remaining 333.57 s) 2023-08-10T10:58:01.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:00 smithi195 ceph-mon[129938]: pgmap v207: 129 pgs: 129 active+clean; 6.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 23 MiB/s wr, 70 op/s 2023-08-10T10:58:01.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:00 smithi157 ceph-mon[129604]: pgmap v207: 129 pgs: 129 active+clean; 6.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 23 MiB/s wr, 70 op/s 2023-08-10T10:58:01.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:00 smithi107 ceph-mon[127953]: pgmap v207: 129 pgs: 129 active+clean; 6.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 23 MiB/s wr, 70 op/s 2023-08-10T10:58:02.553 INFO:teuthology.orchestra.run.smithi107.stderr:26700000 of 50000000 tuples (53%) done (elapsed 380.73 s, remaining 332.25 s) 2023-08-10T10:58:03.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:03 smithi107 ceph-mon[127953]: pgmap v208: 129 pgs: 129 active+clean; 6.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 23 MiB/s wr, 70 op/s 2023-08-10T10:58:03.847 INFO:teuthology.orchestra.run.smithi107.stderr:26800000 of 50000000 tuples (53%) done (elapsed 382.02 s, remaining 330.71 s) 2023-08-10T10:58:03.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:03 smithi195 ceph-mon[129938]: pgmap v208: 129 pgs: 129 active+clean; 6.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 23 MiB/s wr, 70 op/s 2023-08-10T10:58:04.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:03 smithi157 ceph-mon[129604]: pgmap v208: 129 pgs: 129 active+clean; 6.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 23 MiB/s wr, 70 op/s 2023-08-10T10:58:05.105 INFO:teuthology.orchestra.run.smithi107.stderr:26900000 of 50000000 tuples (53%) done (elapsed 383.28 s, remaining 329.14 s) 2023-08-10T10:58:06.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:05 smithi157 ceph-mon[129604]: pgmap v209: 129 pgs: 129 active+clean; 6.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 34 MiB/s wr, 119 op/s 2023-08-10T10:58:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:05 smithi107 ceph-mon[127953]: pgmap v209: 129 pgs: 129 active+clean; 6.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 34 MiB/s wr, 119 op/s 2023-08-10T10:58:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:05 smithi195 ceph-mon[129938]: pgmap v209: 129 pgs: 129 active+clean; 6.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 34 MiB/s wr, 119 op/s 2023-08-10T10:58:06.483 INFO:teuthology.orchestra.run.smithi107.stderr:27000000 of 50000000 tuples (54%) done (elapsed 384.66 s, remaining 327.67 s) 2023-08-10T10:58:07.716 INFO:teuthology.orchestra.run.smithi107.stderr:27100000 of 50000000 tuples (54%) done (elapsed 385.89 s, remaining 326.09 s) 2023-08-10T10:58:08.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:07 smithi157 ceph-mon[129604]: pgmap v210: 129 pgs: 129 active+clean; 6.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 88 op/s 2023-08-10T10:58:08.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:07 smithi107 ceph-mon[127953]: pgmap v210: 129 pgs: 129 active+clean; 6.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 88 op/s 2023-08-10T10:58:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:07 smithi195 ceph-mon[129938]: pgmap v210: 129 pgs: 129 active+clean; 6.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 88 op/s 2023-08-10T10:58:09.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:08 smithi157 ceph-mon[129604]: osdmap e95: 12 total, 12 up, 12 in 2023-08-10T10:58:09.057 INFO:teuthology.orchestra.run.smithi107.stderr:27200000 of 50000000 tuples (54%) done (elapsed 387.23 s, remaining 324.59 s) 2023-08-10T10:58:09.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:08 smithi107 ceph-mon[127953]: osdmap e95: 12 total, 12 up, 12 in 2023-08-10T10:58:09.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:08 smithi195 ceph-mon[129938]: osdmap e95: 12 total, 12 up, 12 in 2023-08-10T10:58:10.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:09 smithi157 ceph-mon[129604]: pgmap v212: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-08-10T10:58:10.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:09 smithi107 ceph-mon[127953]: pgmap v212: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-08-10T10:58:10.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:09 smithi195 ceph-mon[129938]: pgmap v212: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-08-10T10:58:10.338 INFO:teuthology.orchestra.run.smithi107.stderr:27300000 of 50000000 tuples (54%) done (elapsed 388.51 s, remaining 323.05 s) 2023-08-10T10:58:11.737 INFO:teuthology.orchestra.run.smithi107.stderr:27400000 of 50000000 tuples (54%) done (elapsed 389.91 s, remaining 321.61 s) 2023-08-10T10:58:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:11 smithi157 ceph-mon[129604]: pgmap v213: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-08-10T10:58:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:11 smithi107 ceph-mon[127953]: pgmap v213: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-08-10T10:58:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:11 smithi195 ceph-mon[129938]: pgmap v213: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-08-10T10:58:13.049 INFO:teuthology.orchestra.run.smithi107.stderr:27500000 of 50000000 tuples (55%) done (elapsed 391.23 s, remaining 320.09 s) 2023-08-10T10:58:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:13 smithi157 ceph-mon[129604]: pgmap v214: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-08-10T10:58:14.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:13 smithi157 ceph-mon[129604]: osdmap e96: 12 total, 12 up, 12 in 2023-08-10T10:58:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:13 smithi107 ceph-mon[127953]: pgmap v214: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-08-10T10:58:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:13 smithi107 ceph-mon[127953]: osdmap e96: 12 total, 12 up, 12 in 2023-08-10T10:58:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:13 smithi195 ceph-mon[129938]: pgmap v214: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 27 MiB/s wr, 103 op/s 2023-08-10T10:58:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:13 smithi195 ceph-mon[129938]: osdmap e96: 12 total, 12 up, 12 in 2023-08-10T10:58:14.290 INFO:teuthology.orchestra.run.smithi107.stderr:27600000 of 50000000 tuples (55%) done (elapsed 392.47 s, remaining 318.52 s) 2023-08-10T10:58:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:27700000 of 50000000 tuples (55%) done (elapsed 393.71 s, remaining 316.96 s) 2023-08-10T10:58:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:15 smithi157 ceph-mon[129604]: pgmap v216: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 34 MiB/s wr, 116 op/s 2023-08-10T10:58:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:15 smithi107 ceph-mon[127953]: pgmap v216: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 34 MiB/s wr, 116 op/s 2023-08-10T10:58:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:15 smithi195 ceph-mon[129938]: pgmap v216: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 34 MiB/s wr, 116 op/s 2023-08-10T10:58:16.865 INFO:teuthology.orchestra.run.smithi107.stderr:27800000 of 50000000 tuples (55%) done (elapsed 395.04 s, remaining 315.47 s) 2023-08-10T10:58:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:17 smithi157 ceph-mon[129604]: pgmap v217: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 31 MiB/s wr, 106 op/s 2023-08-10T10:58:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:17 smithi107 ceph-mon[127953]: pgmap v217: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 31 MiB/s wr, 106 op/s 2023-08-10T10:58:18.107 INFO:teuthology.orchestra.run.smithi107.stderr:27900000 of 50000000 tuples (55%) done (elapsed 396.28 s, remaining 313.90 s) 2023-08-10T10:58:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:17 smithi195 ceph-mon[129938]: pgmap v217: 129 pgs: 129 active+clean; 6.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 31 MiB/s wr, 106 op/s 2023-08-10T10:58:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:18 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:18 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:18 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:19.323 INFO:teuthology.orchestra.run.smithi107.stderr:28000000 of 50000000 tuples (56%) done (elapsed 397.50 s, remaining 312.32 s) 2023-08-10T10:58:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:19 smithi157 ceph-mon[129604]: pgmap v218: 129 pgs: 129 active+clean; 6.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-08-10T10:58:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:19 smithi107 ceph-mon[127953]: pgmap v218: 129 pgs: 129 active+clean; 6.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-08-10T10:58:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:19 smithi195 ceph-mon[129938]: pgmap v218: 129 pgs: 129 active+clean; 6.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-08-10T10:58:20.569 INFO:teuthology.orchestra.run.smithi107.stderr:28100000 of 50000000 tuples (56%) done (elapsed 398.75 s, remaining 310.77 s) 2023-08-10T10:58:21.847 INFO:teuthology.orchestra.run.smithi107.stderr:28200000 of 50000000 tuples (56%) done (elapsed 400.02 s, remaining 309.24 s) 2023-08-10T10:58:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:21 smithi107 ceph-mon[127953]: pgmap v219: 129 pgs: 129 active+clean; 6.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-08-10T10:58:22.086 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:58:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:21 smithi195 ceph-mon[129938]: pgmap v219: 129 pgs: 129 active+clean; 6.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-08-10T10:58:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:21 smithi157 ceph-mon[129604]: pgmap v219: 129 pgs: 129 active+clean; 6.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-08-10T10:58:22.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.316+0000 7feb5bdff700 1 -- 172.21.15.107:0/2040332144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb54108920 msgr2=0x7feb54108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:22.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.316+0000 7feb5bdff700 1 --2- 172.21.15.107:0/2040332144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb54108920 0x7feb54108d00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feb50009990 tx=0x7feb50009ca0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.316+0000 7feb5bdff700 1 -- 172.21.15.107:0/2040332144 shutdown_connections 2023-08-10T10:58:22.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.316+0000 7feb5bdff700 1 --2- 172.21.15.107:0/2040332144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb541032d0 0x7feb5410f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.318 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.316+0000 7feb5bdff700 1 --2- 172.21.15.107:0/2040332144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb54108920 0x7feb54108d00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.316+0000 7feb5bdff700 1 --2- 172.21.15.107:0/2040332144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb54102910 0x7feb54102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.316+0000 7feb5bdff700 1 -- 172.21.15.107:0/2040332144 >> 172.21.15.107:0/2040332144 conn(0x7feb540fe3c0 msgr2=0x7feb541007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:22.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.316+0000 7feb5bdff700 1 -- 172.21.15.107:0/2040332144 shutdown_connections 2023-08-10T10:58:22.319 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.316+0000 7feb5bdff700 1 -- 172.21.15.107:0/2040332144 wait complete. 2023-08-10T10:58:22.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.317+0000 7feb5bdff700 1 Processor -- start 2023-08-10T10:58:22.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5bdff700 1 -- start start 2023-08-10T10:58:22.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5bdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb54102910 0x7feb5419e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5bdff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb541032d0 0x7feb5419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5bdff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb54108920 0x7feb54198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5bdff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb54198de0 con 0x7feb541032d0 2023-08-10T10:58:22.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5bdff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb54198f50 con 0x7feb54108920 2023-08-10T10:58:22.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5bdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb54199110 con 0x7feb54102910 2023-08-10T10:58:22.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5939a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb541032d0 0x7feb5419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb59b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb54102910 0x7feb5419e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5939a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb541032d0 0x7feb5419ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55306/0 (socket says 172.21.15.107:55306) 2023-08-10T10:58:22.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.318+0000 7feb5939a700 1 -- 172.21.15.107:0/3689211767 learned_addr learned my addr 172.21.15.107:0/3689211767 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:22.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5a39c700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb54108920 0x7feb54198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5939a700 1 -- 172.21.15.107:0/3689211767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb54102910 msgr2=0x7feb5419e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:22.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5939a700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb54102910 0x7feb5419e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5939a700 1 -- 172.21.15.107:0/3689211767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb54108920 msgr2=0x7feb54198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:22.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5939a700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb54108920 0x7feb54198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.324 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5939a700 1 -- 172.21.15.107:0/3689211767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500095f0 con 0x7feb541032d0 2023-08-10T10:58:22.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb59b9b700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb54102910 0x7feb5419e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:58:22.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5a39c700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb54108920 0x7feb54198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:58:22.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5939a700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb541032d0 0x7feb5419ec40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7feb4400e9a0 tx=0x7feb4400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:22.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb4affd700 1 -- 172.21.15.107:0/3689211767 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44009790 con 0x7feb541032d0 2023-08-10T10:58:22.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb4affd700 1 -- 172.21.15.107:0/3689211767 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb4400cbd0 con 0x7feb541032d0 2023-08-10T10:58:22.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5bdff700 1 -- 172.21.15.107:0/3689211767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb541993f0 con 0x7feb541032d0 2023-08-10T10:58:22.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb4affd700 1 -- 172.21.15.107:0/3689211767 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44018680 con 0x7feb541032d0 2023-08-10T10:58:22.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.319+0000 7feb5bdff700 1 -- 172.21.15.107:0/3689211767 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb541a56f0 con 0x7feb541032d0 2023-08-10T10:58:22.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.323+0000 7feb4affd700 1 -- 172.21.15.107:0/3689211767 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7feb4400cd40 con 0x7feb541032d0 2023-08-10T10:58:22.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.324+0000 7feb6f7a1b80 1 Processor -- start 2023-08-10T10:58:22.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb6f7a1b80 1 -- start start 2023-08-10T10:58:22.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb4affd700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7feb400a12c0 0x7feb400a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb4001f50 0x556fb4002330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb3ffc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb3ffc800 0x556fb3ffcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3f77dc0 con 0x556fb3ffc800 2023-08-10T10:58:22.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3f54590 con 0x556fb4002870 2023-08-10T10:58:22.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3f51eb0 con 0x556fb4001f50 2023-08-10T10:58:22.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb4affd700 1 -- 172.21.15.107:0/3689211767 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9374+0+0 (secure 0 0 0) 0x7feb44014070 con 0x7feb541032d0 2023-08-10T10:58:22.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb59b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb4001f50 0x556fb4002330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb5a39c700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7feb400a12c0 0x7feb400a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb59b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb4001f50 0x556fb4002330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:44404/0 (socket says 172.21.15.107:44404) 2023-08-10T10:58:22.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.325+0000 7feb59b9b700 1 -- 172.21.15.107:0/3862489469 learned_addr learned my addr 172.21.15.107:0/3862489469 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:22.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.326+0000 7feb5a39c700 1 --2- 172.21.15.107:0/3862489469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb3ffc800 0x556fb3ffcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.326+0000 7feb5939a700 1 --2- 172.21.15.107:0/3862489469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb3ffc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.326+0000 7feb59b9b700 1 -- 172.21.15.107:0/3862489469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 msgr2=0x556fb3ffc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:22.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.326+0000 7feb59b9b700 1 --2- 172.21.15.107:0/3862489469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb3ffc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.326+0000 7feb59b9b700 1 -- 172.21.15.107:0/3862489469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb3ffc800 msgr2=0x556fb3ffcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:22.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.326+0000 7feb59b9b700 1 --2- 172.21.15.107:0/3862489469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb3ffc800 0x556fb3ffcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.326+0000 7feb59b9b700 1 -- 172.21.15.107:0/3862489469 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb3dce630 con 0x556fb4001f50 2023-08-10T10:58:22.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.326+0000 7feb5a39c700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7feb400a12c0 0x7feb400a3780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb5419f400 tx=0x7feb4c015420 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:22.332 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.326+0000 7feb59b9b700 1 --2- 172.21.15.107:0/3862489469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb4001f50 0x556fb4002330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feb50015000 tx=0x7feb50005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4215530a03d377a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:22.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.327+0000 7feb3ffff700 1 -- 172.21.15.107:0/3862489469 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5001d070 con 0x556fb4001f50 2023-08-10T10:58:22.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.327+0000 7feb3ffff700 1 -- 172.21.15.107:0/3862489469 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb5001e040 con 0x556fb4001f50 2023-08-10T10:58:22.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.327+0000 7feb3ffff700 1 -- 172.21.15.107:0/3862489469 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50004b70 con 0x556fb4001f50 2023-08-10T10:58:22.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.327+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/3862489469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb4001f50 msgr2=0x556fb4002330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:22.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.327+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/3862489469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb4001f50 0x556fb4002330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feb50015000 tx=0x7feb50005f00 comp rx=0 tx=0).stop 2023-08-10T10:58:22.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.328+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/3862489469 shutdown_connections 2023-08-10T10:58:22.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.328+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/3862489469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb3ffc800 0x556fb3ffcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.328+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/3862489469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb4001f50 0x556fb4002330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.328+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/3862489469 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb3ffc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.328+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/3862489469 >> 172.21.15.107:0/3862489469 conn(0x556fb3f59cd0 msgr2=0x556fb3ff74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:22.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.328+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/3862489469 shutdown_connections 2023-08-10T10:58:22.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.328+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/3862489469 wait complete. 2023-08-10T10:58:22.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.328+0000 7feb6f7a1b80 1 -- start start 2023-08-10T10:58:22.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb6f7a1b80 1 Processor -- start 2023-08-10T10:58:22.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb40088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb4006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3f4d7a0 con 0x556fb4001f50 2023-08-10T10:58:22.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3eecac0 con 0x556fb4002870 2023-08-10T10:58:22.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3eec7c0 con 0x556fb3ffc800 2023-08-10T10:58:22.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb6f7a1b80 10 client.0 _ll_register_callbacks cb 0x556fb3eea680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:58:22.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb59b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb40088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb5939a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb5939a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4005b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55324/0 (socket says 172.21.15.107:55324) 2023-08-10T10:58:22.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.329+0000 7feb5939a700 1 -- 172.21.15.107:0/782946719 learned_addr learned my addr 172.21.15.107:0/782946719 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:22.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.330+0000 7feb5a39c700 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb4006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.330+0000 7feb59b9b700 1 -- 172.21.15.107:0/782946719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 msgr2=0x556fb4006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:22.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.330+0000 7feb59b9b700 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb4006110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.330+0000 7feb59b9b700 1 -- 172.21.15.107:0/782946719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 msgr2=0x556fb4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:22.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.330+0000 7feb59b9b700 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.330+0000 7feb59b9b700 1 -- 172.21.15.107:0/782946719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb541100e0 con 0x556fb3ffc800 2023-08-10T10:58:22.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.330+0000 7feb5939a700 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4005b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:58:22.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.330+0000 7feb59b9b700 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb40088f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feb500098e0 tx=0x7feb5000fac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa50998199ddb87a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:22.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.330+0000 7feb3d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:58:22.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb3d7fa700 1 -- 172.21.15.107:0/782946719 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5001d040 con 0x556fb3ffc800 2023-08-10T10:58:22.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb3d7fa700 1 -- 172.21.15.107:0/782946719 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9374+0+0 (secure 0 0 0) 0x7feb50005910 con 0x556fb3ffc800 2023-08-10T10:58:22.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/782946719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556fb3fef470 con 0x556fb3ffc800 2023-08-10T10:58:22.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb3d7fa700 1 -- 172.21.15.107:0/782946719 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb50005bc0 con 0x556fb3ffc800 2023-08-10T10:58:22.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb6f7a1b80 10 client.26278 fetch_fsmap learned FSMap version 42 2023-08-10T10:58:22.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/782946719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x556fb3d7ade0 con 0x556fb3ffc800 2023-08-10T10:58:22.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb3d7fa700 1 -- 172.21.15.107:0/782946719 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556fb3fef470 con 0x556fb3ffc800 2023-08-10T10:58:22.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb3d7fa700 1 -- 172.21.15.107:0/782946719 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 42) v1 ==== 7506+0+0 (secure 0 0 0) 0x7feb50022400 con 0x556fb3ffc800 2023-08-10T10:58:22.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb6f7a1b80 10 client.26278 fetch_fsmap finished waiting for FSMap version 42 2023-08-10T10:58:22.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.331+0000 7feb6f7a1b80 10 client.26278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:58:22.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.332+0000 7feb6f7a1b80 20 client.26278 populate_metadata read hostname 'smithi107' 2023-08-10T10:58:22.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.332+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556fb4015cf0 0x556fb4018110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.345 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.332+0000 7feb6f7a1b80 4 client.26278 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:58:22.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.332+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/782946719 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556fb3fcb9d0 con 0x556fb4015cf0 2023-08-10T10:58:22.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.332+0000 7feb5939a700 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556fb4015cf0 0x556fb4018110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.333+0000 7feb5939a700 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556fb4015cf0 0x556fb4018110 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50a1b98690b0cdaf server_cookie=d6c7caa0527420b2 in_seq=0 out_seq=0 2023-08-10T10:58:22.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.333+0000 7feb3d7fa700 10 client.26278 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:58:22.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.333+0000 7feb3d7fa700 1 -- 172.21.15.107:0/782946719 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556fb3fcb9d0 con 0x556fb4015cf0 2023-08-10T10:58:22.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.333+0000 7feb3d7fa700 10 client.26278 handle_command_reply: tid=0 2023-08-10T10:58:22.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.333+0000 7feb6f7a1b80 1 client.26278 shutdown 2023-08-10T10:58:22.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/782946719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 msgr2=0x556fb40088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:22.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb40088f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feb500098e0 tx=0x7feb5000fac0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/782946719 shutdown_connections 2023-08-10T10:58:22.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556fb4015cf0 0x556fb4018110 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb4006110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb40088f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/782946719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4005b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb3d7fa700 0 client.26278 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:58:22.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/782946719 >> 172.21.15.107:0/782946719 conn(0x556fb3f59cd0 msgr2=0x556fb3ff69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:22.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/782946719 shutdown_connections 2023-08-10T10:58:22.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/782946719 wait complete. 2023-08-10T10:58:22.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.334+0000 7feb6f7a1b80 20 client.26278 trim_cache size 0 max 16384 2023-08-10T10:58:22.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.352+0000 7feb6f7a1b80 1 Processor -- start 2023-08-10T10:58:22.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.352+0000 7feb6f7a1b80 1 -- start start 2023-08-10T10:58:22.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4001230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb4008420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3dd0920 con 0x556fb4001f50 2023-08-10T10:58:22.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3ff3f80 con 0x556fb4002870 2023-08-10T10:58:22.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3ff1a80 con 0x556fb3ffc800 2023-08-10T10:58:22.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb59b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb59b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:44426/0 (socket says 172.21.15.107:44426) 2023-08-10T10:58:22.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb59b9b700 1 -- 172.21.15.107:0/104517941 learned_addr learned my addr 172.21.15.107:0/104517941 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:22.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb5939a700 1 --2- 172.21.15.107:0/104517941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4001230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb5a39c700 1 --2- 172.21.15.107:0/104517941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb4008420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb59b9b700 1 -- 172.21.15.107:0/104517941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 msgr2=0x556fb4008420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:22.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb59b9b700 1 --2- 172.21.15.107:0/104517941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb4008420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb59b9b700 1 -- 172.21.15.107:0/104517941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 msgr2=0x556fb4001230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:22.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb59b9b700 1 --2- 172.21.15.107:0/104517941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4001230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.353+0000 7feb59b9b700 1 -- 172.21.15.107:0/104517941 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb3d63c60 con 0x556fb3ffc800 2023-08-10T10:58:22.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.354+0000 7feb59b9b700 1 --2- 172.21.15.107:0/104517941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb5000c010 tx=0x7feb5000bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b15e0cf46839cc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:22.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.354+0000 7feb48bff700 1 -- 172.21.15.107:0/104517941 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50005910 con 0x556fb3ffc800 2023-08-10T10:58:22.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.354+0000 7feb48bff700 1 -- 172.21.15.107:0/104517941 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb500229d0 con 0x556fb3ffc800 2023-08-10T10:58:22.359 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.354+0000 7feb48bff700 1 -- 172.21.15.107:0/104517941 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50004820 con 0x556fb3ffc800 2023-08-10T10:58:22.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/104517941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 msgr2=0x556fb400d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:22.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/104517941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb5000c010 tx=0x7feb5000bda0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/104517941 shutdown_connections 2023-08-10T10:58:22.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/104517941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb4008420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/104517941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/104517941 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb4001230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/104517941 >> 172.21.15.107:0/104517941 conn(0x556fb3f59cd0 msgr2=0x556fb4000b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/104517941 shutdown_connections 2023-08-10T10:58:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/104517941 wait complete. 2023-08-10T10:58:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.355+0000 7feb6f7a1b80 1 -- start start 2023-08-10T10:58:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.356+0000 7feb6f7a1b80 1 Processor -- start 2023-08-10T10:58:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.356+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.356+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb400d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.365 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.356+0000 7feb6f7a1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb40094e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.356+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb4009bc0 con 0x556fb4001f50 2023-08-10T10:58:22.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.356+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb4009d00 con 0x556fb4002870 2023-08-10T10:58:22.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.356+0000 7feb6f7a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb4009ec0 con 0x556fb3ffc800 2023-08-10T10:58:22.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.356+0000 7feb6f7a1b80 10 client.0 _ll_register_callbacks cb 0x556fb3eea680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:58:22.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb59b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb5939a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb400d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb59b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:44442/0 (socket says 172.21.15.107:44442) 2023-08-10T10:58:22.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb59b9b700 1 -- 172.21.15.107:0/1468918711 learned_addr learned my addr 172.21.15.107:0/1468918711 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:22.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb5a39c700 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb40094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb59b9b700 1 -- 172.21.15.107:0/1468918711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 msgr2=0x556fb40094e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:22.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb59b9b700 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb40094e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb59b9b700 1 -- 172.21.15.107:0/1468918711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 msgr2=0x556fb400d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:22.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb59b9b700 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb400d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb59b9b700 1 -- 172.21.15.107:0/1468918711 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb3d7ade0 con 0x556fb3ffc800 2023-08-10T10:58:22.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb59b9b700 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400ce20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb50009350 tx=0x7feb50041c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a4fdaebf81c68dc server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:22.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.357+0000 7feb3d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:58:22.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb3d7fa700 1 -- 172.21.15.107:0/1468918711 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5001d030 con 0x556fb3ffc800 2023-08-10T10:58:22.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/1468918711 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb5001e040 con 0x556fb3ffc800 2023-08-10T10:58:22.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb3d7fa700 1 -- 172.21.15.107:0/1468918711 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9374+0+0 (secure 0 0 0) 0x7feb50000e40 con 0x556fb3ffc800 2023-08-10T10:58:22.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb3d7fa700 1 -- 172.21.15.107:0/1468918711 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb500056c0 con 0x556fb3ffc800 2023-08-10T10:58:22.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb6f7a1b80 10 client.26284 fetch_fsmap learned FSMap version 42 2023-08-10T10:58:22.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/1468918711 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x556fb3da1250 con 0x556fb3ffc800 2023-08-10T10:58:22.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb3d7fa700 1 -- 172.21.15.107:0/1468918711 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb5001e040 con 0x556fb3ffc800 2023-08-10T10:58:22.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb3d7fa700 1 -- 172.21.15.107:0/1468918711 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 42) v1 ==== 7506+0+0 (secure 0 0 0) 0x7feb50004910 con 0x556fb3ffc800 2023-08-10T10:58:22.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb6f7a1b80 10 client.26284 fetch_fsmap finished waiting for FSMap version 42 2023-08-10T10:58:22.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb6f7a1b80 10 client.26284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:58:22.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb6f7a1b80 20 client.26284 populate_metadata read hostname 'smithi107' 2023-08-10T10:58:22.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556fb406a910 0x556fb406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:22.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb6f7a1b80 4 client.26284 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:58:22.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.358+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/1468918711 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556fb3f46780 con 0x556fb406a910 2023-08-10T10:58:22.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.359+0000 7feb5939a700 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556fb406a910 0x556fb406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:22.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.359+0000 7feb3d7fa700 10 client.26284 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:58:22.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.359+0000 7feb5939a700 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556fb406a910 0x556fb406cd30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=975659f96f031566 server_cookie=5a1a83f01d2f980b in_seq=0 out_seq=0 2023-08-10T10:58:22.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb3d7fa700 1 -- 172.21.15.107:0/1468918711 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556fb3f46780 con 0x556fb406a910 2023-08-10T10:58:22.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb3d7fa700 10 client.26284 handle_command_reply: tid=0 2023-08-10T10:58:22.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 client.26284 shutdown 2023-08-10T10:58:22.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/1468918711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 msgr2=0x556fb400ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400ce20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb50009350 tx=0x7feb50041c30 comp rx=0 tx=0).stop 2023-08-10T10:58:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/1468918711 shutdown_connections 2023-08-10T10:58:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556fb406a910 0x556fb406cd30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556fb4002870 0x556fb40094e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556fb3ffc800 0x556fb400ce20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb3d7fa700 0 client.26284 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:58:22.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 --2- 172.21.15.107:0/1468918711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556fb4001f50 0x556fb400d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/1468918711 >> 172.21.15.107:0/1468918711 conn(0x556fb3f59cd0 msgr2=0x556fb3ffb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/1468918711 shutdown_connections 2023-08-10T10:58:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.360+0000 7feb6f7a1b80 1 -- 172.21.15.107:0/1468918711 wait complete. 2023-08-10T10:58:22.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb6f7a1b80 20 client.26284 trim_cache size 0 max 16384 2023-08-10T10:58:22.374 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:58:22.375 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:58:22.375 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:58:22.375 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:58:22.375 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:58:22.375 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:58:22.376 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:58:22.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:58:22.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:58:22.376 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:58:22.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 -- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7feb400a12c0 msgr2=0x7feb400a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:22.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7feb400a12c0 0x7feb400a3780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb5419f400 tx=0x7feb4c015420 comp rx=0 tx=0).stop 2023-08-10T10:58:22.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 -- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb541032d0 msgr2=0x7feb5419ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:22.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb541032d0 0x7feb5419ec40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7feb4400e9a0 tx=0x7feb4400ecb0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 -- 172.21.15.107:0/3689211767 shutdown_connections 2023-08-10T10:58:22.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7feb400a12c0 0x7feb400a3780 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.377 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb54108920 0x7feb54198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb54102910 0x7feb5419e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 --2- 172.21.15.107:0/3689211767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb541032d0 0x7feb5419ec40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:22.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 -- 172.21.15.107:0/3689211767 >> 172.21.15.107:0/3689211767 conn(0x7feb540fe3c0 msgr2=0x7feb540fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:22.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 -- 172.21.15.107:0/3689211767 shutdown_connections 2023-08-10T10:58:22.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:22.361+0000 7feb5bdff700 1 -- 172.21.15.107:0/3689211767 wait complete. 2023-08-10T10:58:22.382 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:58:23.075 INFO:teuthology.orchestra.run.smithi107.stderr:28300000 of 50000000 tuples (56%) done (elapsed 401.25 s, remaining 307.67 s) 2023-08-10T10:58:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:23 smithi107 ceph-mon[127953]: pgmap v220: 129 pgs: 129 active+clean; 6.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-08-10T10:58:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:23 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:23 smithi195 ceph-mon[129938]: pgmap v220: 129 pgs: 129 active+clean; 6.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-08-10T10:58:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:23 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:24.271 INFO:teuthology.orchestra.run.smithi107.stderr:28400000 of 50000000 tuples (56%) done (elapsed 402.45 s, remaining 306.09 s) 2023-08-10T10:58:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:23 smithi157 ceph-mon[129604]: pgmap v220: 129 pgs: 129 active+clean; 6.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 28 MiB/s wr, 92 op/s 2023-08-10T10:58:24.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:23 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:25.570 INFO:teuthology.orchestra.run.smithi107.stderr:28500000 of 50000000 tuples (57%) done (elapsed 403.75 s, remaining 304.58 s) 2023-08-10T10:58:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:25 smithi107 ceph-mon[127953]: pgmap v221: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 64 op/s 2023-08-10T10:58:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:25 smithi195 ceph-mon[129938]: pgmap v221: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 64 op/s 2023-08-10T10:58:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:25 smithi157 ceph-mon[129604]: pgmap v221: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 27 MiB/s wr, 64 op/s 2023-08-10T10:58:26.809 INFO:teuthology.orchestra.run.smithi107.stderr:28600000 of 50000000 tuples (57%) done (elapsed 404.99 s, remaining 303.03 s) 2023-08-10T10:58:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:27 smithi107 ceph-mon[127953]: pgmap v222: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 58 op/s 2023-08-10T10:58:28.083 INFO:teuthology.orchestra.run.smithi107.stderr:28700000 of 50000000 tuples (57%) done (elapsed 406.26 s, remaining 301.51 s) 2023-08-10T10:58:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:27 smithi195 ceph-mon[129938]: pgmap v222: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 58 op/s 2023-08-10T10:58:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:27 smithi157 ceph-mon[129604]: pgmap v222: 129 pgs: 129 active+clean; 6.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 58 op/s 2023-08-10T10:58:29.402 INFO:teuthology.orchestra.run.smithi107.stderr:28800000 of 50000000 tuples (57%) done (elapsed 407.58 s, remaining 300.02 s) 2023-08-10T10:58:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:29 smithi107 ceph-mon[127953]: pgmap v223: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 36 MiB/s wr, 79 op/s 2023-08-10T10:58:30.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:29 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:58:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:29 smithi195 ceph-mon[129938]: pgmap v223: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 36 MiB/s wr, 79 op/s 2023-08-10T10:58:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:29 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:58:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:29 smithi157 ceph-mon[129604]: pgmap v223: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 36 MiB/s wr, 79 op/s 2023-08-10T10:58:30.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:29 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:58:30.682 INFO:teuthology.orchestra.run.smithi107.stderr:28900000 of 50000000 tuples (57%) done (elapsed 408.86 s, remaining 298.51 s) 2023-08-10T10:58:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:30 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:58:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:30 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:58:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:30 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:58:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:30 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:58:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:30 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:58:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:30 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:58:31.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:30 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:58:31.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:30 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:58:31.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:30 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:58:31.875 INFO:teuthology.orchestra.run.smithi107.stderr:29000000 of 50000000 tuples (58%) done (elapsed 410.05 s, remaining 296.93 s) 2023-08-10T10:58:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:31 smithi107 ceph-mon[127953]: pgmap v224: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 42 op/s 2023-08-10T10:58:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:31 smithi195 ceph-mon[129938]: pgmap v224: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 42 op/s 2023-08-10T10:58:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:31 smithi157 ceph-mon[129604]: pgmap v224: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 42 op/s 2023-08-10T10:58:33.188 INFO:teuthology.orchestra.run.smithi107.stderr:29100000 of 50000000 tuples (58%) done (elapsed 411.37 s, remaining 295.45 s) 2023-08-10T10:58:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:33 smithi107 ceph-mon[127953]: pgmap v225: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 42 op/s 2023-08-10T10:58:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:33 smithi195 ceph-mon[129938]: pgmap v225: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 42 op/s 2023-08-10T10:58:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:33 smithi157 ceph-mon[129604]: pgmap v225: 129 pgs: 129 active+clean; 6.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 42 op/s 2023-08-10T10:58:34.433 INFO:teuthology.orchestra.run.smithi107.stderr:29200000 of 50000000 tuples (58%) done (elapsed 412.61 s, remaining 293.91 s) 2023-08-10T10:58:35.861 INFO:teuthology.orchestra.run.smithi107.stderr:29300000 of 50000000 tuples (58%) done (elapsed 414.04 s, remaining 292.51 s) 2023-08-10T10:58:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:35 smithi107 ceph-mon[127953]: pgmap v226: 129 pgs: 129 active+clean; 6.7 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 60 op/s 2023-08-10T10:58:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:35 smithi195 ceph-mon[129938]: pgmap v226: 129 pgs: 129 active+clean; 6.7 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 60 op/s 2023-08-10T10:58:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:35 smithi157 ceph-mon[129604]: pgmap v226: 129 pgs: 129 active+clean; 6.7 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 60 op/s 2023-08-10T10:58:37.645 INFO:teuthology.orchestra.run.smithi107.stderr:29400000 of 50000000 tuples (58%) done (elapsed 415.82 s, remaining 291.36 s) 2023-08-10T10:58:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:37 smithi107 ceph-mon[127953]: pgmap v227: 129 pgs: 129 active+clean; 6.7 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-08-10T10:58:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:37 smithi195 ceph-mon[129938]: pgmap v227: 129 pgs: 129 active+clean; 6.7 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-08-10T10:58:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:37 smithi157 ceph-mon[129604]: pgmap v227: 129 pgs: 129 active+clean; 6.7 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 38 op/s 2023-08-10T10:58:39.003 INFO:teuthology.orchestra.run.smithi107.stderr:29500000 of 50000000 tuples (59%) done (elapsed 417.18 s, remaining 289.90 s) 2023-08-10T10:58:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:39 smithi107 ceph-mon[127953]: pgmap v228: 129 pgs: 129 active+clean; 6.8 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 35 MiB/s wr, 56 op/s 2023-08-10T10:58:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:39 smithi195 ceph-mon[129938]: pgmap v228: 129 pgs: 129 active+clean; 6.8 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 35 MiB/s wr, 56 op/s 2023-08-10T10:58:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:39 smithi157 ceph-mon[129604]: pgmap v228: 129 pgs: 129 active+clean; 6.8 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 35 MiB/s wr, 56 op/s 2023-08-10T10:58:40.856 INFO:teuthology.orchestra.run.smithi107.stderr:29600000 of 50000000 tuples (59%) done (elapsed 419.03 s, remaining 288.79 s) 2023-08-10T10:58:42.159 INFO:teuthology.orchestra.run.smithi107.stderr:29700000 of 50000000 tuples (59%) done (elapsed 420.34 s, remaining 287.30 s) 2023-08-10T10:58:42.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:41 smithi195 ceph-mon[129938]: pgmap v229: 129 pgs: 129 active+clean; 6.8 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 23 MiB/s wr, 35 op/s 2023-08-10T10:58:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:41 smithi157 ceph-mon[129604]: pgmap v229: 129 pgs: 129 active+clean; 6.8 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 23 MiB/s wr, 35 op/s 2023-08-10T10:58:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:41 smithi107 ceph-mon[127953]: pgmap v229: 129 pgs: 129 active+clean; 6.8 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 23 MiB/s wr, 35 op/s 2023-08-10T10:58:43.540 INFO:teuthology.orchestra.run.smithi107.stderr:29800000 of 50000000 tuples (59%) done (elapsed 421.72 s, remaining 285.86 s) 2023-08-10T10:58:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:43 smithi195 ceph-mon[129938]: pgmap v230: 129 pgs: 129 active+clean; 6.8 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 23 MiB/s wr, 35 op/s 2023-08-10T10:58:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:43 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:43 smithi157 ceph-mon[129604]: pgmap v230: 129 pgs: 129 active+clean; 6.8 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 23 MiB/s wr, 35 op/s 2023-08-10T10:58:44.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:43 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:43 smithi107 ceph-mon[127953]: pgmap v230: 129 pgs: 129 active+clean; 6.8 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 23 MiB/s wr, 35 op/s 2023-08-10T10:58:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:43 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:44.862 INFO:teuthology.orchestra.run.smithi107.stderr:29900000 of 50000000 tuples (59%) done (elapsed 423.04 s, remaining 284.38 s) 2023-08-10T10:58:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:45 smithi195 ceph-mon[129938]: pgmap v231: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 33 MiB/s wr, 65 op/s 2023-08-10T10:58:46.165 INFO:teuthology.orchestra.run.smithi107.stderr:30000000 of 50000000 tuples (60%) done (elapsed 424.34 s, remaining 282.89 s) 2023-08-10T10:58:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:45 smithi157 ceph-mon[129604]: pgmap v231: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 33 MiB/s wr, 65 op/s 2023-08-10T10:58:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:45 smithi107 ceph-mon[127953]: pgmap v231: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 33 MiB/s wr, 65 op/s 2023-08-10T10:58:47.450 INFO:teuthology.orchestra.run.smithi107.stderr:30100000 of 50000000 tuples (60%) done (elapsed 425.63 s, remaining 281.40 s) 2023-08-10T10:58:48.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:47 smithi195 ceph-mon[129938]: pgmap v232: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 21 MiB/s wr, 48 op/s 2023-08-10T10:58:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:47 smithi157 ceph-mon[129604]: pgmap v232: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 21 MiB/s wr, 48 op/s 2023-08-10T10:58:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:47 smithi107 ceph-mon[127953]: pgmap v232: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 21 MiB/s wr, 48 op/s 2023-08-10T10:58:48.797 INFO:teuthology.orchestra.run.smithi107.stderr:30200000 of 50000000 tuples (60%) done (elapsed 426.97 s, remaining 279.94 s) 2023-08-10T10:58:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:49 smithi195 ceph-mon[129938]: pgmap v233: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 33 MiB/s wr, 89 op/s 2023-08-10T10:58:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:49 smithi157 ceph-mon[129604]: pgmap v233: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 33 MiB/s wr, 89 op/s 2023-08-10T10:58:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:49 smithi107 ceph-mon[127953]: pgmap v233: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 33 MiB/s wr, 89 op/s 2023-08-10T10:58:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:51 smithi195 ceph-mon[129938]: pgmap v234: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-08-10T10:58:52.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:51 smithi157 ceph-mon[129604]: pgmap v234: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-08-10T10:58:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:51 smithi107 ceph-mon[127953]: pgmap v234: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-08-10T10:58:52.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:58:52.546 INFO:teuthology.orchestra.run.smithi107.stderr:30300000 of 50000000 tuples (60%) done (elapsed 430.72 s, remaining 280.04 s) 2023-08-10T10:58:52.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.620+0000 7ffaedfff700 1 -- 172.21.15.107:0/329767238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae8101080 msgr2=0x7ffae810d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:52.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.620+0000 7ffaedfff700 1 --2- 172.21.15.107:0/329767238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae8101080 0x7ffae810d590 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffae000b0a0 tx=0x7ffae000b3b0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.620+0000 7ffaedfff700 1 -- 172.21.15.107:0/329767238 shutdown_connections 2023-08-10T10:58:52.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.620+0000 7ffaedfff700 1 --2- 172.21.15.107:0/329767238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffae81066d0 0x7ffae8106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.620+0000 7ffaedfff700 1 --2- 172.21.15.107:0/329767238 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae8101080 0x7ffae810d590 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.620+0000 7ffaedfff700 1 --2- 172.21.15.107:0/329767238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81006c0 0x7ffae8100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.620+0000 7ffaedfff700 1 -- 172.21.15.107:0/329767238 >> 172.21.15.107:0/329767238 conn(0x7ffae80fc1f0 msgr2=0x7ffae80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:52.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.620+0000 7ffaedfff700 1 -- 172.21.15.107:0/329767238 shutdown_connections 2023-08-10T10:58:52.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.620+0000 7ffaedfff700 1 -- 172.21.15.107:0/329767238 wait complete. 2023-08-10T10:58:52.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.621+0000 7ffaedfff700 1 Processor -- start 2023-08-10T10:58:52.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.621+0000 7ffaedfff700 1 -- start start 2023-08-10T10:58:52.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffaedfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81006c0 0x7ffae819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffaedfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffae8101080 0x7ffae819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffaedfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae81066d0 0x7ffae81986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffaedfff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8198d60 con 0x7ffae81066d0 2023-08-10T10:58:52.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffaedfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8198ed0 con 0x7ffae8101080 2023-08-10T10:58:52.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffaedfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8199090 con 0x7ffae81006c0 2023-08-10T10:58:52.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81006c0 0x7ffae819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81006c0 0x7ffae819e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:54988/0 (socket says 172.21.15.107:54988) 2023-08-10T10:58:52.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae77fe700 1 -- 172.21.15.107:0/634553537 learned_addr learned my addr 172.21.15.107:0/634553537 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:52.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae7fff700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae81066d0 0x7ffae81986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffae8101080 0x7ffae819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae77fe700 1 -- 172.21.15.107:0/634553537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffae8101080 msgr2=0x7ffae819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:52.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae77fe700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffae8101080 0x7ffae819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae77fe700 1 -- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae81066d0 msgr2=0x7ffae81986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:52.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae77fe700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae81066d0 0x7ffae81986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.622+0000 7ffae77fe700 1 -- 172.21.15.107:0/634553537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0009d00 con 0x7ffae81006c0 2023-08-10T10:58:52.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.623+0000 7ffae77fe700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81006c0 0x7ffae819e620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffad800e9a0 tx=0x7ffad800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:52.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.623+0000 7ffae4ff9700 1 -- 172.21.15.107:0/634553537 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8009790 con 0x7ffae81006c0 2023-08-10T10:58:52.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.623+0000 7ffae4ff9700 1 -- 172.21.15.107:0/634553537 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffad8010430 con 0x7ffae81006c0 2023-08-10T10:58:52.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.623+0000 7ffae4ff9700 1 -- 172.21.15.107:0/634553537 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad800cea0 con 0x7ffae81006c0 2023-08-10T10:58:52.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.623+0000 7ffaedfff700 1 -- 172.21.15.107:0/634553537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae8199370 con 0x7ffae81006c0 2023-08-10T10:58:52.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.623+0000 7ffaedfff700 1 -- 172.21.15.107:0/634553537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81a5650 con 0x7ffae81006c0 2023-08-10T10:58:52.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.627+0000 7ffae4ff9700 1 -- 172.21.15.107:0/634553537 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ffad80105a0 con 0x7ffae81006c0 2023-08-10T10:58:52.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.628+0000 7ffae4ff9700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffad00a1340 0x7ffad00a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.628+0000 7ffae4ff9700 1 -- 172.21.15.107:0/634553537 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 9374+0+0 (secure 0 0 0) 0x7ffad8014070 con 0x7ffae81006c0 2023-08-10T10:58:52.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffb01860b80 1 Processor -- start 2023-08-10T10:58:52.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffad00a1340 0x7ffad00a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffb01860b80 1 -- start start 2023-08-10T10:58:52.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b3f50 0x556f036b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b4870 0x556f036ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 0x556f036aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffad00a1340 0x7ffad00a3800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffae8199ea0 tx=0x7ffadc009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:52.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffb01860b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f03629dc0 con 0x556f036b3f50 2023-08-10T10:58:52.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffb01860b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f03606590 con 0x556f036ae800 2023-08-10T10:58:52.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffb01860b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f03603eb0 con 0x556f036b4870 2023-08-10T10:58:52.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b3f50 0x556f036b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b3f50 0x556f036b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59464/0 (socket says 172.21.15.107:59464) 2023-08-10T10:58:52.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.629+0000 7ffae77fe700 1 -- 172.21.15.107:0/1473309745 learned_addr learned my addr 172.21.15.107:0/1473309745 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:52.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.630+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/1473309745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b4870 0x556f036ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.630+0000 7ffae7fff700 1 --2- 172.21.15.107:0/1473309745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 0x556f036aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.630+0000 7ffae77fe700 1 -- 172.21.15.107:0/1473309745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b4870 msgr2=0x556f036ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:52.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.630+0000 7ffae77fe700 1 --2- 172.21.15.107:0/1473309745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b4870 0x556f036ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.630+0000 7ffae77fe700 1 -- 172.21.15.107:0/1473309745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 msgr2=0x556f036aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:52.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.630+0000 7ffae77fe700 1 --2- 172.21.15.107:0/1473309745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 0x556f036aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.630+0000 7ffae77fe700 1 -- 172.21.15.107:0/1473309745 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f03480630 con 0x556f036b3f50 2023-08-10T10:58:52.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.630+0000 7ffae77fe700 1 --2- 172.21.15.107:0/1473309745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b3f50 0x556f036b4330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffad8096950 tx=0x7ffad80998c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4970fae18b0b3b9d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:52.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.630+0000 7ffacdffb700 1 -- 172.21.15.107:0/1473309745 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad809df10 con 0x556f036b3f50 2023-08-10T10:58:52.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.631+0000 7ffacdffb700 1 -- 172.21.15.107:0/1473309745 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffad80a2330 con 0x556f036b3f50 2023-08-10T10:58:52.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.631+0000 7ffacdffb700 1 -- 172.21.15.107:0/1473309745 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad80a1ea0 con 0x556f036b3f50 2023-08-10T10:58:52.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.631+0000 7ffb01860b80 1 -- 172.21.15.107:0/1473309745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b3f50 msgr2=0x556f036b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:52.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.631+0000 7ffb01860b80 1 --2- 172.21.15.107:0/1473309745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b3f50 0x556f036b4330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffad8096950 tx=0x7ffad80998c0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.632+0000 7ffb01860b80 1 -- 172.21.15.107:0/1473309745 shutdown_connections 2023-08-10T10:58:52.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.632+0000 7ffb01860b80 1 --2- 172.21.15.107:0/1473309745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 0x556f036aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.632+0000 7ffb01860b80 1 --2- 172.21.15.107:0/1473309745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b3f50 0x556f036b4330 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.632+0000 7ffb01860b80 1 --2- 172.21.15.107:0/1473309745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b4870 0x556f036ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.632+0000 7ffb01860b80 1 -- 172.21.15.107:0/1473309745 >> 172.21.15.107:0/1473309745 conn(0x556f0360bcd0 msgr2=0x556f036a94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:52.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.632+0000 7ffb01860b80 1 -- 172.21.15.107:0/1473309745 shutdown_connections 2023-08-10T10:58:52.636 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.632+0000 7ffb01860b80 1 -- 172.21.15.107:0/1473309745 wait complete. 2023-08-10T10:58:52.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.632+0000 7ffb01860b80 1 -- start start 2023-08-10T10:58:52.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.632+0000 7ffb01860b80 1 Processor -- start 2023-08-10T10:58:52.638 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.633+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036ba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.633+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.633+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 0x556f036b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.633+0000 7ffb01860b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f035ff7a0 con 0x556f036ae800 2023-08-10T10:58:52.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.633+0000 7ffb01860b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f0359eac0 con 0x556f036b4870 2023-08-10T10:58:52.639 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.633+0000 7ffb01860b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f0359e7c0 con 0x556f036b3f50 2023-08-10T10:58:52.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.633+0000 7ffb01860b80 10 client.0 _ll_register_callbacks cb 0x556f0359c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:58:52.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036ba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 0x556f036b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.640 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036ba8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59478/0 (socket says 172.21.15.107:59478) 2023-08-10T10:58:52.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae77fe700 1 -- 172.21.15.107:0/541485220 learned_addr learned my addr 172.21.15.107:0/541485220 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:52.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae7fff700 1 -- 172.21.15.107:0/541485220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 msgr2=0x556f036b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:52.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae7fff700 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae7fff700 1 -- 172.21.15.107:0/541485220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 msgr2=0x556f036ba8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:52.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae7fff700 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036ba8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae7fff700 1 -- 172.21.15.107:0/541485220 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81a5650 con 0x556f036b4870 2023-08-10T10:58:52.641 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.634+0000 7ffae77fe700 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036ba8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:58:52.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.635+0000 7ffae7fff700 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 0x556f036b81e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffae00062a0 tx=0x7ffae0004c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9b014cea78e6a70 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:52.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.635+0000 7ffac6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:58:52.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.635+0000 7ffac6ffd700 1 -- 172.21.15.107:0/541485220 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae000e040 con 0x556f036b4870 2023-08-10T10:58:52.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.635+0000 7ffb01860b80 1 -- 172.21.15.107:0/541485220 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f036a1470 con 0x556f036b4870 2023-08-10T10:58:52.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.635+0000 7ffac6ffd700 1 -- 172.21.15.107:0/541485220 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9374+0+0 (secure 0 0 0) 0x7ffae00076e0 con 0x556f036b4870 2023-08-10T10:58:52.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.635+0000 7ffac6ffd700 1 -- 172.21.15.107:0/541485220 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffae00078a0 con 0x556f036b4870 2023-08-10T10:58:52.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.635+0000 7ffb01860b80 10 client.26258 fetch_fsmap learned FSMap version 44 2023-08-10T10:58:52.642 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.635+0000 7ffb01860b80 1 -- 172.21.15.107:0/541485220 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x556f0342cde0 con 0x556f036b4870 2023-08-10T10:58:52.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.636+0000 7ffac6ffd700 1 -- 172.21.15.107:0/541485220 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556f036a1470 con 0x556f036b4870 2023-08-10T10:58:52.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.636+0000 7ffac6ffd700 1 -- 172.21.15.107:0/541485220 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 44) v1 ==== 7506+0+0 (secure 0 0 0) 0x7ffae0025030 con 0x556f036b4870 2023-08-10T10:58:52.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.636+0000 7ffb01860b80 10 client.26258 fetch_fsmap finished waiting for FSMap version 44 2023-08-10T10:58:52.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.636+0000 7ffb01860b80 10 client.26258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:58:52.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.636+0000 7ffb01860b80 20 client.26258 populate_metadata read hostname 'smithi107' 2023-08-10T10:58:52.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.636+0000 7ffb01860b80 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556f036c82b0 0x556f036ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.636+0000 7ffb01860b80 4 client.26258 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:58:52.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.636+0000 7ffb01860b80 1 -- 172.21.15.107:0/541485220 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f0367d9d0 con 0x556f036c82b0 2023-08-10T10:58:52.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.636+0000 7ffae77fe700 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556f036c82b0 0x556f036ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.637+0000 7ffae77fe700 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556f036c82b0 0x556f036ca6d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a347bfa1e9cfbddb server_cookie=778f751678641ee3 in_seq=0 out_seq=0 2023-08-10T10:58:52.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.637+0000 7ffac6ffd700 10 client.26258 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:58:52.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffac6ffd700 1 -- 172.21.15.107:0/541485220 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556f0367d9d0 con 0x556f036c82b0 2023-08-10T10:58:52.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffac6ffd700 10 client.26258 handle_command_reply: tid=0 2023-08-10T10:58:52.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 client.26258 shutdown 2023-08-10T10:58:52.645 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 -- 172.21.15.107:0/541485220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 msgr2=0x556f036b81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:52.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 0x556f036b81e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffae00062a0 tx=0x7ffae0004c40 comp rx=0 tx=0).stop 2023-08-10T10:58:52.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 -- 172.21.15.107:0/541485220 shutdown_connections 2023-08-10T10:58:52.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556f036c82b0 0x556f036ca6d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 0x556f036b81e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036ba8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 --2- 172.21.15.107:0/541485220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 -- 172.21.15.107:0/541485220 >> 172.21.15.107:0/541485220 conn(0x556f0360bcd0 msgr2=0x556f036a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:52.646 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffac6ffd700 0 client.26258 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:58:52.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 -- 172.21.15.107:0/541485220 shutdown_connections 2023-08-10T10:58:52.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.638+0000 7ffb01860b80 1 -- 172.21.15.107:0/541485220 wait complete. 2023-08-10T10:58:52.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.639+0000 7ffb01860b80 20 client.26258 trim_cache size 0 max 16384 2023-08-10T10:58:52.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.662+0000 7ffb01860b80 1 Processor -- start 2023-08-10T10:58:52.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.662+0000 7ffb01860b80 1 -- start start 2023-08-10T10:58:52.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.662+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.662+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036ba480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.662+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 0x556f036a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.662+0000 7ffb01860b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f03482920 con 0x556f036ae800 2023-08-10T10:58:52.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.662+0000 7ffb01860b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f0367d9d0 con 0x556f036b4870 2023-08-10T10:58:52.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.662+0000 7ffb01860b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f036a5fd0 con 0x556f036b3f50 2023-08-10T10:58:52.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.662+0000 7ffae77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036ba480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55002/0 (socket says 172.21.15.107:55002) 2023-08-10T10:58:52.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae6ffd700 1 -- 172.21.15.107:0/1215250749 learned_addr learned my addr 172.21.15.107:0/1215250749 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:52.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae7fff700 1 --2- 172.21.15.107:0/1215250749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 0x556f036a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae6ffd700 1 -- 172.21.15.107:0/1215250749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 msgr2=0x556f036a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:52.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/1215250749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 0x556f036a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae6ffd700 1 -- 172.21.15.107:0/1215250749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 msgr2=0x556f036b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:52.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/1215250749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae6ffd700 1 -- 172.21.15.107:0/1215250749 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f03415c60 con 0x556f036b3f50 2023-08-10T10:58:52.666 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae77fe700 1 --2- 172.21.15.107:0/1215250749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:58:52.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.663+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/1215250749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036ba480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0117d0 tx=0x7ffadc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4de704e53c49efb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:52.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7fface7fc700 1 -- 172.21.15.107:0/1215250749 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc022030 con 0x556f036b3f50 2023-08-10T10:58:52.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7fface7fc700 1 -- 172.21.15.107:0/1215250749 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffadc023040 con 0x556f036b3f50 2023-08-10T10:58:52.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7fface7fc700 1 -- 172.21.15.107:0/1215250749 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc01dbe0 con 0x556f036b3f50 2023-08-10T10:58:52.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7ffb01860b80 1 -- 172.21.15.107:0/1215250749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 msgr2=0x556f036ba480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:52.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7ffb01860b80 1 --2- 172.21.15.107:0/1215250749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036ba480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0117d0 tx=0x7ffadc014000 comp rx=0 tx=0).stop 2023-08-10T10:58:52.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7ffb01860b80 1 -- 172.21.15.107:0/1215250749 shutdown_connections 2023-08-10T10:58:52.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7ffb01860b80 1 --2- 172.21.15.107:0/1215250749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036b4870 0x556f036a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7ffb01860b80 1 --2- 172.21.15.107:0/1215250749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036ae800 0x556f036b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7ffb01860b80 1 --2- 172.21.15.107:0/1215250749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036ba480 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7ffb01860b80 1 -- 172.21.15.107:0/1215250749 >> 172.21.15.107:0/1215250749 conn(0x556f0360bcd0 msgr2=0x556f036b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:52.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.664+0000 7ffb01860b80 1 -- 172.21.15.107:0/1215250749 shutdown_connections 2023-08-10T10:58:52.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.665+0000 7ffb01860b80 1 -- 172.21.15.107:0/1215250749 wait complete. 2023-08-10T10:58:52.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.665+0000 7ffb01860b80 1 -- start start 2023-08-10T10:58:52.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.665+0000 7ffb01860b80 1 Processor -- start 2023-08-10T10:58:52.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 0x556f036bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036bd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffb01860b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b4870 0x556f036bd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffb01860b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f036bde90 con 0x556f036b4870 2023-08-10T10:58:52.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffb01860b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f036bdfd0 con 0x556f036ae800 2023-08-10T10:58:52.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffb01860b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f036be190 con 0x556f036b3f50 2023-08-10T10:58:52.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffb01860b80 10 client.0 _ll_register_callbacks cb 0x556f0359c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:58:52.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b4870 0x556f036bd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b4870 0x556f036bd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59488/0 (socket says 172.21.15.107:59488) 2023-08-10T10:58:52.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae7fff700 1 -- 172.21.15.107:0/4274126263 learned_addr learned my addr 172.21.15.107:0/4274126263 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:58:52.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae77fe700 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 0x556f036bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae6ffd700 1 -- 172.21.15.107:0/4274126263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 msgr2=0x556f036bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:52.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 0x556f036bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae6ffd700 1 -- 172.21.15.107:0/4274126263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b4870 msgr2=0x556f036bd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:58:52.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b4870 0x556f036bd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.666+0000 7ffae6ffd700 1 -- 172.21.15.107:0/4274126263 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f03480630 con 0x556f036b3f50 2023-08-10T10:58:52.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.667+0000 7ffae6ffd700 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036bd410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x556f036c5a00 tx=0x7ffadc01dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9213f7fa71df827 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:58:52.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.667+0000 7ffac6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:58:52.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.667+0000 7ffac6ffd700 1 -- 172.21.15.107:0/4274126263 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc022030 con 0x556f036b3f50 2023-08-10T10:58:52.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.667+0000 7ffb01860b80 1 -- 172.21.15.107:0/4274126263 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffad80a2330 con 0x556f036b3f50 2023-08-10T10:58:52.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.667+0000 7ffac6ffd700 1 -- 172.21.15.107:0/4274126263 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 9374+0+0 (secure 0 0 0) 0x7ffadc01de40 con 0x556f036b3f50 2023-08-10T10:58:52.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.667+0000 7ffac6ffd700 1 -- 172.21.15.107:0/4274126263 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffadc01d410 con 0x556f036b3f50 2023-08-10T10:58:52.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.667+0000 7ffb01860b80 10 client.26302 fetch_fsmap learned FSMap version 44 2023-08-10T10:58:52.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.667+0000 7ffb01860b80 1 -- 172.21.15.107:0/4274126263 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x7ffadc017070 con 0x556f036b3f50 2023-08-10T10:58:52.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.668+0000 7ffac6ffd700 1 -- 172.21.15.107:0/4274126263 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffad80a2330 con 0x556f036b3f50 2023-08-10T10:58:52.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.668+0000 7ffac6ffd700 1 -- 172.21.15.107:0/4274126263 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 44) v1 ==== 7506+0+0 (secure 0 0 0) 0x7ffadc003680 con 0x556f036b3f50 2023-08-10T10:58:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.668+0000 7ffb01860b80 10 client.26302 fetch_fsmap finished waiting for FSMap version 44 2023-08-10T10:58:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.668+0000 7ffb01860b80 10 client.26302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:58:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.668+0000 7ffb01860b80 20 client.26302 populate_metadata read hostname 'smithi107' 2023-08-10T10:58:52.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.668+0000 7ffb01860b80 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556f0371d300 0x556f0371f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:58:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.668+0000 7ffb01860b80 4 client.26302 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:58:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.668+0000 7ffb01860b80 1 -- 172.21.15.107:0/4274126263 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556f035f8780 con 0x556f0371d300 2023-08-10T10:58:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.668+0000 7ffae77fe700 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556f0371d300 0x556f0371f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:58:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffae77fe700 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556f0371d300 0x556f0371f720 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30bb589c74806806 server_cookie=6a7d368ddb1e2486 in_seq=0 out_seq=0 2023-08-10T10:58:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffac6ffd700 10 client.26302 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:58:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffac6ffd700 1 -- 172.21.15.107:0/4274126263 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556f035f8780 con 0x556f0371d300 2023-08-10T10:58:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffac6ffd700 10 client.26302 handle_command_reply: tid=0 2023-08-10T10:58:52.678 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 client.26302 shutdown 2023-08-10T10:58:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 -- 172.21.15.107:0/4274126263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 msgr2=0x556f036bd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036bd410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x556f036c5a00 tx=0x7ffadc01dc10 comp rx=0 tx=0).stop 2023-08-10T10:58:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 -- 172.21.15.107:0/4274126263 shutdown_connections 2023-08-10T10:58:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x556f0371d300 0x556f0371f720 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556f036ae800 0x556f036bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556f036b4870 0x556f036bd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.679 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffac6ffd700 0 client.26302 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:58:52.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 --2- 172.21.15.107:0/4274126263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556f036b3f50 0x556f036bd410 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 -- 172.21.15.107:0/4274126263 >> 172.21.15.107:0/4274126263 conn(0x556f0360bcd0 msgr2=0x556f036ad2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:52.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 -- 172.21.15.107:0/4274126263 shutdown_connections 2023-08-10T10:58:52.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.669+0000 7ffb01860b80 1 -- 172.21.15.107:0/4274126263 wait complete. 2023-08-10T10:58:52.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffb01860b80 20 client.26302 trim_cache size 0 max 16384 2023-08-10T10:58:52.681 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:58:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:58:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:58:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:58:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:58:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:58:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:58:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:58:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:58:52.682 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:58:52.682 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 -- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffad00a1340 msgr2=0x7ffad00a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:52.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffad00a1340 0x7ffad00a3800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffae8199ea0 tx=0x7ffadc009260 comp rx=0 tx=0).stop 2023-08-10T10:58:52.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 -- 172.21.15.107:0/634553537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81006c0 msgr2=0x7ffae819e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:58:52.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81006c0 0x7ffae819e620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffad800e9a0 tx=0x7ffad800ecb0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 -- 172.21.15.107:0/634553537 shutdown_connections 2023-08-10T10:58:52.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffae81066d0 0x7ffae81986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81006c0 0x7ffae819e620 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ffad00a1340 0x7ffad00a3800 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 --2- 172.21.15.107:0/634553537 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffae8101080 0x7ffae819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:58:52.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 -- 172.21.15.107:0/634553537 >> 172.21.15.107:0/634553537 conn(0x7ffae80fc1f0 msgr2=0x7ffae810bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:58:52.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 -- 172.21.15.107:0/634553537 shutdown_connections 2023-08-10T10:58:52.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:58:52.670+0000 7ffaedfff700 1 -- 172.21.15.107:0/634553537 wait complete. 2023-08-10T10:58:52.693 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:58:53.856 INFO:teuthology.orchestra.run.smithi107.stderr:30400000 of 50000000 tuples (60%) done (elapsed 432.03 s, remaining 278.55 s) 2023-08-10T10:58:54.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:53 smithi195 ceph-mon[129938]: pgmap v235: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-08-10T10:58:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:53 smithi157 ceph-mon[129604]: pgmap v235: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-08-10T10:58:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:53 smithi107 ceph-mon[127953]: pgmap v235: 129 pgs: 129 active+clean; 6.9 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-08-10T10:58:55.124 INFO:teuthology.orchestra.run.smithi107.stderr:30500000 of 50000000 tuples (61%) done (elapsed 433.30 s, remaining 277.03 s) 2023-08-10T10:58:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:55 smithi195 ceph-mon[129938]: pgmap v236: 129 pgs: 129 active+clean; 7.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 27 MiB/s wr, 88 op/s 2023-08-10T10:58:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:55 smithi157 ceph-mon[129604]: pgmap v236: 129 pgs: 129 active+clean; 7.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 27 MiB/s wr, 88 op/s 2023-08-10T10:58:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:55 smithi107 ceph-mon[127953]: pgmap v236: 129 pgs: 129 active+clean; 7.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 27 MiB/s wr, 88 op/s 2023-08-10T10:58:56.445 INFO:teuthology.orchestra.run.smithi107.stderr:30600000 of 50000000 tuples (61%) done (elapsed 434.62 s, remaining 275.55 s) 2023-08-10T10:58:57.727 INFO:teuthology.orchestra.run.smithi107.stderr:30700000 of 50000000 tuples (61%) done (elapsed 435.90 s, remaining 274.04 s) 2023-08-10T10:58:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:57 smithi195 ceph-mon[129938]: pgmap v237: 129 pgs: 129 active+clean; 7.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 17 MiB/s wr, 57 op/s 2023-08-10T10:58:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:57 smithi157 ceph-mon[129604]: pgmap v237: 129 pgs: 129 active+clean; 7.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 17 MiB/s wr, 57 op/s 2023-08-10T10:58:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:57 smithi107 ceph-mon[127953]: pgmap v237: 129 pgs: 129 active+clean; 7.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 17 MiB/s wr, 57 op/s 2023-08-10T10:58:59.013 INFO:teuthology.orchestra.run.smithi107.stderr:30800000 of 50000000 tuples (61%) done (elapsed 437.19 s, remaining 272.53 s) 2023-08-10T10:58:59.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:58 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:59.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:58 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:58:59.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:58 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T10:59:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:58:59 smithi195 ceph-mon[129938]: pgmap v238: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 29 MiB/s wr, 90 op/s 2023-08-10T10:59:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:58:59 smithi157 ceph-mon[129604]: pgmap v238: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 29 MiB/s wr, 90 op/s 2023-08-10T10:59:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:58:59 smithi107 ceph-mon[127953]: pgmap v238: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 29 MiB/s wr, 90 op/s 2023-08-10T10:59:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:30900000 of 50000000 tuples (61%) done (elapsed 438.56 s, remaining 271.08 s) 2023-08-10T10:59:01.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:00 smithi195 ceph-mon[129938]: pgmap v239: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 17 MiB/s wr, 49 op/s 2023-08-10T10:59:01.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:00 smithi157 ceph-mon[129604]: pgmap v239: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 17 MiB/s wr, 49 op/s 2023-08-10T10:59:01.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:00 smithi107 ceph-mon[127953]: pgmap v239: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 17 MiB/s wr, 49 op/s 2023-08-10T10:59:01.667 INFO:teuthology.orchestra.run.smithi107.stderr:31000000 of 50000000 tuples (62%) done (elapsed 439.84 s, remaining 269.58 s) 2023-08-10T10:59:02.997 INFO:teuthology.orchestra.run.smithi107.stderr:31100000 of 50000000 tuples (62%) done (elapsed 441.17 s, remaining 268.11 s) 2023-08-10T10:59:03.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:02 smithi157 ceph-mon[129604]: osdmap e97: 12 total, 12 up, 12 in 2023-08-10T10:59:03.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:02 smithi157 ceph-mon[129604]: pgmap v241: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 20 MiB/s wr, 59 op/s 2023-08-10T10:59:03.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:02 smithi107 ceph-mon[127953]: osdmap e97: 12 total, 12 up, 12 in 2023-08-10T10:59:03.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:02 smithi107 ceph-mon[127953]: pgmap v241: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 20 MiB/s wr, 59 op/s 2023-08-10T10:59:03.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:02 smithi195 ceph-mon[129938]: osdmap e97: 12 total, 12 up, 12 in 2023-08-10T10:59:03.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:02 smithi195 ceph-mon[129938]: pgmap v241: 129 pgs: 129 active+clean; 7.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 20 MiB/s wr, 59 op/s 2023-08-10T10:59:04.399 INFO:teuthology.orchestra.run.smithi107.stderr:31200000 of 50000000 tuples (62%) done (elapsed 442.58 s, remaining 266.68 s) 2023-08-10T10:59:05.659 INFO:teuthology.orchestra.run.smithi107.stderr:31300000 of 50000000 tuples (62%) done (elapsed 443.84 s, remaining 265.17 s) 2023-08-10T10:59:06.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:05 smithi157 ceph-mon[129604]: pgmap v242: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 27 MiB/s wr, 109 op/s 2023-08-10T10:59:06.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:05 smithi107 ceph-mon[127953]: pgmap v242: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 27 MiB/s wr, 109 op/s 2023-08-10T10:59:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:05 smithi195 ceph-mon[129938]: pgmap v242: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 27 MiB/s wr, 109 op/s 2023-08-10T10:59:06.949 INFO:teuthology.orchestra.run.smithi107.stderr:31400000 of 50000000 tuples (62%) done (elapsed 445.13 s, remaining 263.67 s) 2023-08-10T10:59:08.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:07 smithi157 ceph-mon[129604]: pgmap v243: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 27 MiB/s wr, 109 op/s 2023-08-10T10:59:08.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:07 smithi107 ceph-mon[127953]: pgmap v243: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 27 MiB/s wr, 109 op/s 2023-08-10T10:59:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:07 smithi195 ceph-mon[129938]: pgmap v243: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 27 MiB/s wr, 109 op/s 2023-08-10T10:59:08.352 INFO:teuthology.orchestra.run.smithi107.stderr:31500000 of 50000000 tuples (63%) done (elapsed 446.53 s, remaining 262.25 s) 2023-08-10T10:59:10.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:09 smithi157 ceph-mon[129604]: pgmap v244: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 27 MiB/s wr, 113 op/s 2023-08-10T10:59:10.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:09 smithi157 ceph-mon[129604]: osdmap e98: 12 total, 12 up, 12 in 2023-08-10T10:59:10.058 INFO:teuthology.orchestra.run.smithi107.stderr:31600000 of 50000000 tuples (63%) done (elapsed 448.24 s, remaining 261.00 s) 2023-08-10T10:59:10.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:09 smithi107 ceph-mon[127953]: pgmap v244: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 27 MiB/s wr, 113 op/s 2023-08-10T10:59:10.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:09 smithi107 ceph-mon[127953]: osdmap e98: 12 total, 12 up, 12 in 2023-08-10T10:59:10.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:09 smithi195 ceph-mon[129938]: pgmap v244: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 27 MiB/s wr, 113 op/s 2023-08-10T10:59:10.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:09 smithi195 ceph-mon[129938]: osdmap e98: 12 total, 12 up, 12 in 2023-08-10T10:59:11.290 INFO:teuthology.orchestra.run.smithi107.stderr:31700000 of 50000000 tuples (63%) done (elapsed 449.47 s, remaining 259.47 s) 2023-08-10T10:59:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:11 smithi157 ceph-mon[129604]: pgmap v246: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 32 MiB/s wr, 132 op/s 2023-08-10T10:59:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:11 smithi107 ceph-mon[127953]: pgmap v246: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 32 MiB/s wr, 132 op/s 2023-08-10T10:59:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:11 smithi195 ceph-mon[129938]: pgmap v246: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 32 MiB/s wr, 132 op/s 2023-08-10T10:59:12.536 INFO:teuthology.orchestra.run.smithi107.stderr:31800000 of 50000000 tuples (63%) done (elapsed 450.71 s, remaining 257.96 s) 2023-08-10T10:59:13.863 INFO:teuthology.orchestra.run.smithi107.stderr:31900000 of 50000000 tuples (63%) done (elapsed 452.04 s, remaining 256.49 s) 2023-08-10T10:59:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:13 smithi157 ceph-mon[129604]: pgmap v247: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 27 MiB/s wr, 113 op/s 2023-08-10T10:59:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:13 smithi107 ceph-mon[127953]: pgmap v247: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 27 MiB/s wr, 113 op/s 2023-08-10T10:59:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:13 smithi195 ceph-mon[129938]: pgmap v247: 129 pgs: 129 active+clean; 7.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 27 MiB/s wr, 113 op/s 2023-08-10T10:59:15.082 INFO:teuthology.orchestra.run.smithi107.stderr:32000000 of 50000000 tuples (64%) done (elapsed 453.26 s, remaining 254.96 s) 2023-08-10T10:59:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:15 smithi157 ceph-mon[129604]: pgmap v248: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 80 op/s 2023-08-10T10:59:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:15 smithi107 ceph-mon[127953]: pgmap v248: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 80 op/s 2023-08-10T10:59:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:15 smithi195 ceph-mon[129938]: pgmap v248: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 80 op/s 2023-08-10T10:59:16.364 INFO:teuthology.orchestra.run.smithi107.stderr:32100000 of 50000000 tuples (64%) done (elapsed 454.54 s, remaining 253.47 s) 2023-08-10T10:59:17.575 INFO:teuthology.orchestra.run.smithi107.stderr:32200000 of 50000000 tuples (64%) done (elapsed 455.75 s, remaining 251.94 s) 2023-08-10T10:59:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:17 smithi157 ceph-mon[129604]: pgmap v249: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 80 op/s 2023-08-10T10:59:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:17 smithi107 ceph-mon[127953]: pgmap v249: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 80 op/s 2023-08-10T10:59:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:17 smithi195 ceph-mon[129938]: pgmap v249: 129 pgs: 129 active+clean; 7.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 80 op/s 2023-08-10T10:59:18.867 INFO:teuthology.orchestra.run.smithi107.stderr:32300000 of 50000000 tuples (64%) done (elapsed 457.04 s, remaining 250.45 s) 2023-08-10T10:59:20.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:19 smithi157 ceph-mon[129604]: pgmap v250: 129 pgs: 129 active+clean; 7.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 62 op/s 2023-08-10T10:59:20.652 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:19 smithi195 ceph-mon[129938]: pgmap v250: 129 pgs: 129 active+clean; 7.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 62 op/s 2023-08-10T10:59:20.653 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:19 smithi107 ceph-mon[127953]: pgmap v250: 129 pgs: 129 active+clean; 7.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 MiB/s wr, 62 op/s 2023-08-10T10:59:20.653 INFO:teuthology.orchestra.run.smithi107.stderr:32400000 of 50000000 tuples (64%) done (elapsed 458.33 s, remaining 248.97 s) 2023-08-10T10:59:21.366 INFO:teuthology.orchestra.run.smithi107.stderr:32500000 of 50000000 tuples (65%) done (elapsed 459.54 s, remaining 247.45 s) 2023-08-10T10:59:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:21 smithi157 ceph-mon[129604]: pgmap v251: 129 pgs: 129 active+clean; 7.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-08-10T10:59:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:21 smithi107 ceph-mon[127953]: pgmap v251: 129 pgs: 129 active+clean; 7.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-08-10T10:59:22.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:21 smithi195 ceph-mon[129938]: pgmap v251: 129 pgs: 129 active+clean; 7.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-08-10T10:59:22.569 INFO:teuthology.orchestra.run.smithi107.stderr:32600000 of 50000000 tuples (65%) done (elapsed 460.75 s, remaining 245.92 s) 2023-08-10T10:59:22.694 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:59:22.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.942+0000 7f3e885ff700 1 -- 172.21.15.107:0/2267786892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e801006e0 msgr2=0x7f3e80100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:22.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.942+0000 7f3e885ff700 1 --2- 172.21.15.107:0/2267786892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e801006e0 0x7f3e80100b60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009990 tx=0x7f3e70009ca0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.942+0000 7f3e885ff700 1 -- 172.21.15.107:0/2267786892 shutdown_connections 2023-08-10T10:59:22.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.942+0000 7f3e885ff700 1 --2- 172.21.15.107:0/2267786892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e801010a0 0x7f3e8010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.942+0000 7f3e885ff700 1 --2- 172.21.15.107:0/2267786892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e801066f0 0x7f3e80106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.942+0000 7f3e885ff700 1 --2- 172.21.15.107:0/2267786892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e801006e0 0x7f3e80100b60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.942+0000 7f3e885ff700 1 -- 172.21.15.107:0/2267786892 >> 172.21.15.107:0/2267786892 conn(0x7f3e800fc1d0 msgr2=0x7f3e800fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:22.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.942+0000 7f3e885ff700 1 -- 172.21.15.107:0/2267786892 shutdown_connections 2023-08-10T10:59:22.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.942+0000 7f3e885ff700 1 -- 172.21.15.107:0/2267786892 wait complete. 2023-08-10T10:59:22.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.943+0000 7f3e885ff700 1 Processor -- start 2023-08-10T10:59:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.943+0000 7f3e885ff700 1 -- start start 2023-08-10T10:59:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e885ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e801006e0 0x7f3e80072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e885ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e801010a0 0x7f3e80072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e885ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e801066f0 0x7f3e801a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e885ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800737e0 con 0x7f3e801006e0 2023-08-10T10:59:22.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e885ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e801a4da0 con 0x7f3e801010a0 2023-08-10T10:59:22.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e885ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e801a4ee0 con 0x7f3e801066f0 2023-08-10T10:59:22.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e8639b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e801006e0 0x7f3e80072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e8639b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e801006e0 0x7f3e80072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53142/0 (socket says 172.21.15.107:53142) 2023-08-10T10:59:22.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e8639b700 1 -- 172.21.15.107:0/3625215212 learned_addr learned my addr 172.21.15.107:0/3625215212 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:22.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e801066f0 0x7f3e801a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.944+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e801010a0 0x7f3e80072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e8639b700 1 -- 172.21.15.107:0/3625215212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e801066f0 msgr2=0x7f3e801a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e8639b700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e801066f0 0x7f3e801a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e8639b700 1 -- 172.21.15.107:0/3625215212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e801010a0 msgr2=0x7f3e80072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e8639b700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e801010a0 0x7f3e80072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e8639b700 1 -- 172.21.15.107:0/3625215212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c009520 con 0x7f3e801006e0 2023-08-10T10:59:22.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e801066f0 0x7f3e801a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:59:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e8639b700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e801006e0 0x7f3e80072a70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00eb30 tx=0x7f3e7c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e777fe700 1 -- 172.21.15.107:0/3625215212 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c009880 con 0x7f3e801006e0 2023-08-10T10:59:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e885ff700 1 -- 172.21.15.107:0/3625215212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e700095f0 con 0x7f3e801006e0 2023-08-10T10:59:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e777fe700 1 -- 172.21.15.107:0/3625215212 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e7c0044b0 con 0x7f3e801006e0 2023-08-10T10:59:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e777fe700 1 -- 172.21.15.107:0/3625215212 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c003ce0 con 0x7f3e801006e0 2023-08-10T10:59:22.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.945+0000 7f3e885ff700 1 -- 172.21.15.107:0/3625215212 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e801a54e0 con 0x7f3e801006e0 2023-08-10T10:59:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.949+0000 7f3e777fe700 1 -- 172.21.15.107:0/3625215212 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f3e7c004020 con 0x7f3e801006e0 2023-08-10T10:59:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.950+0000 7f3e9bef3b80 1 Processor -- start 2023-08-10T10:59:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.950+0000 7f3e9bef3b80 1 -- start start 2023-08-10T10:59:22.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.950+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f421330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f41b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f41bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f396dc0 con 0x55ee1f41b800 2023-08-10T10:59:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f373590 con 0x55ee1f421870 2023-08-10T10:59:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f370eb0 con 0x55ee1f420f50 2023-08-10T10:59:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e86b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f421330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e86b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f421330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:41368/0 (socket says 172.21.15.107:41368) 2023-08-10T10:59:22.954 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e86b9c700 1 -- 172.21.15.107:0/3332203267 learned_addr learned my addr 172.21.15.107:0/3332203267 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e8639b700 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f41b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f41bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e86b9c700 1 -- 172.21.15.107:0/3332203267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 msgr2=0x55ee1f41b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f41b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e86b9c700 1 -- 172.21.15.107:0/3332203267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 msgr2=0x55ee1f41bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:22.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f41bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e86b9c700 1 -- 172.21.15.107:0/3332203267 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee1f1ed630 con 0x55ee1f420f50 2023-08-10T10:59:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.951+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f41bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:59:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.952+0000 7f3e777fe700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f3e6c0a12c0 0x7f3e6c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.952+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f421330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3e78003e40 tx=0x7f3e78009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9313f050b7bf4cd3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.952+0000 7f3e777fe700 1 -- 172.21.15.107:0/3625215212 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f3e7c014070 con 0x7f3e801006e0 2023-08-10T10:59:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.952+0000 7f3e8639b700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f3e6c0a12c0 0x7f3e6c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.952+0000 7f3e74bfe700 1 -- 172.21.15.107:0/3332203267 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780092d0 con 0x55ee1f420f50 2023-08-10T10:59:22.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.952+0000 7f3e74bfe700 1 -- 172.21.15.107:0/3332203267 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e7800f040 con 0x55ee1f420f50 2023-08-10T10:59:22.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.952+0000 7f3e74bfe700 1 -- 172.21.15.107:0/3332203267 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7800e730 con 0x55ee1f420f50 2023-08-10T10:59:22.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3332203267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 msgr2=0x55ee1f421330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:22.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e8639b700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f3e6c0a12c0 0x7f3e6c0a3780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55ee1f421cf0 tx=0x7f3e7c004620 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:22.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f421330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3e78003e40 tx=0x7f3e78009920 comp rx=0 tx=0).stop 2023-08-10T10:59:22.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3332203267 shutdown_connections 2023-08-10T10:59:22.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f41bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f421330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3332203267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f41b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3332203267 >> 172.21.15.107:0/3332203267 conn(0x55ee1f378cd0 msgr2=0x55ee1f4164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:22.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3332203267 shutdown_connections 2023-08-10T10:59:22.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.953+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3332203267 wait complete. 2023-08-10T10:59:22.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.954+0000 7f3e9bef3b80 1 -- start start 2023-08-10T10:59:22.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.954+0000 7f3e9bef3b80 1 Processor -- start 2023-08-10T10:59:22.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.954+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f424c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.954+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f425150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.954+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f425690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.954+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f36c7a0 con 0x55ee1f41b800 2023-08-10T10:59:22.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.954+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f30bac0 con 0x55ee1f421870 2023-08-10T10:59:22.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.954+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f30b7c0 con 0x55ee1f420f50 2023-08-10T10:59:22.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e9bef3b80 10 client.0 _ll_register_callbacks cb 0x55ee1f309680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:59:22.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e86b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f424c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e86b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f424c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53148/0 (socket says 172.21.15.107:53148) 2023-08-10T10:59:22.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e86b9c700 1 -- 172.21.15.107:0/4062266139 learned_addr learned my addr 172.21.15.107:0/4062266139 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:22.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e85b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f425150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e86b9c700 1 -- 172.21.15.107:0/4062266139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 msgr2=0x55ee1f425150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:22.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f425150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e86b9c700 1 -- 172.21.15.107:0/4062266139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 msgr2=0x55ee1f425690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:22.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f425690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e86b9c700 1 -- 172.21.15.107:0/4062266139 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e78003b20 con 0x55ee1f41b800 2023-08-10T10:59:22.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.955+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f425150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:59:22.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.956+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f424c10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800b010 tx=0x7f3e78009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3aa7ef28e417eab server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:22.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.956+0000 7f3e69ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:59:22.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.956+0000 7f3e69ffb700 1 -- 172.21.15.107:0/4062266139 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78007910 con 0x55ee1f41b800 2023-08-10T10:59:22.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.956+0000 7f3e69ffb700 1 -- 172.21.15.107:0/4062266139 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f3e78007a70 con 0x55ee1f41b800 2023-08-10T10:59:22.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.956+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/4062266139 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee1f40e470 con 0x55ee1f41b800 2023-08-10T10:59:22.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.956+0000 7f3e69ffb700 1 -- 172.21.15.107:0/4062266139 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e78007c30 con 0x55ee1f41b800 2023-08-10T10:59:22.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.956+0000 7f3e9bef3b80 10 client.16617 fetch_fsmap learned FSMap version 45 2023-08-10T10:59:22.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.956+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/4062266139 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ee1f199de0 con 0x55ee1f41b800 2023-08-10T10:59:22.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.956+0000 7f3e69ffb700 1 -- 172.21.15.107:0/4062266139 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee1f40e470 con 0x55ee1f41b800 2023-08-10T10:59:22.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.957+0000 7f3e69ffb700 1 -- 172.21.15.107:0/4062266139 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 45) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f3e78015450 con 0x55ee1f41b800 2023-08-10T10:59:22.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.957+0000 7f3e9bef3b80 10 client.16617 fetch_fsmap finished waiting for FSMap version 45 2023-08-10T10:59:22.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.957+0000 7f3e9bef3b80 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:59:22.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.957+0000 7f3e9bef3b80 20 client.16617 populate_metadata read hostname 'smithi107' 2023-08-10T10:59:22.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.957+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ee1f435160 0x55ee1f437580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.957+0000 7f3e9bef3b80 4 client.16617 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:59:22.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.957+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/4062266139 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee1f3ea9d0 con 0x55ee1f435160 2023-08-10T10:59:22.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.958+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ee1f435160 0x55ee1f437580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.958+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ee1f435160 0x55ee1f437580 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f904cbba6fa724fa server_cookie=668e8e3717fcf257 in_seq=0 out_seq=0 2023-08-10T10:59:22.966 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.958+0000 7f3e69ffb700 10 client.16617 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:59:22.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e69ffb700 1 -- 172.21.15.107:0/4062266139 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ee1f3ea9d0 con 0x55ee1f435160 2023-08-10T10:59:22.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e69ffb700 10 client.16617 handle_command_reply: tid=0 2023-08-10T10:59:22.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 client.16617 shutdown 2023-08-10T10:59:22.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/4062266139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 msgr2=0x55ee1f424c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:22.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f424c10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800b010 tx=0x7f3e78009470 comp rx=0 tx=0).stop 2023-08-10T10:59:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/4062266139 shutdown_connections 2023-08-10T10:59:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ee1f435160 0x55ee1f437580 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f425690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f41b800 0x55ee1f424c10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/4062266139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f420f50 0x55ee1f425150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/4062266139 >> 172.21.15.107:0/4062266139 conn(0x55ee1f378cd0 msgr2=0x55ee1f4159b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:22.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e69ffb700 0 client.16617 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:59:22.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.959+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/4062266139 shutdown_connections 2023-08-10T10:59:22.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.960+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/4062266139 wait complete. 2023-08-10T10:59:22.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.960+0000 7f3e9bef3b80 20 client.16617 trim_cache size 0 max 16384 2023-08-10T10:59:22.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.984+0000 7f3e9bef3b80 1 Processor -- start 2023-08-10T10:59:22.985 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.984+0000 7f3e9bef3b80 1 -- start start 2023-08-10T10:59:22.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f41b800 0x55ee1f41b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f421870 0x55ee1f4254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f1ef920 con 0x55ee1f420f50 2023-08-10T10:59:22.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f3ea9d0 con 0x55ee1f41b800 2023-08-10T10:59:22.987 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f43c390 con 0x55ee1f421870 2023-08-10T10:59:22.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e85b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e86b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f421870 0x55ee1f4254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e85b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53152/0 (socket says 172.21.15.107:53152) 2023-08-10T10:59:22.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e85b9a700 1 -- 172.21.15.107:0/3198483812 learned_addr learned my addr 172.21.15.107:0/3198483812 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:22.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3198483812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f41b800 0x55ee1f41b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.988 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.985+0000 7f3e86b9c700 1 -- 172.21.15.107:0/3198483812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f41b800 msgr2=0x55ee1f41b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:22.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.986+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3198483812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f41b800 0x55ee1f41b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.986+0000 7f3e86b9c700 1 -- 172.21.15.107:0/3198483812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 msgr2=0x55ee1f42c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:22.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.986+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3198483812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.986+0000 7f3e86b9c700 1 -- 172.21.15.107:0/3198483812 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee1f4126a0 con 0x55ee1f421870 2023-08-10T10:59:22.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.986+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/3198483812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:59:22.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.986+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3198483812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f421870 0x55ee1f4254c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e78015860 tx=0x7f3e78023040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ee291163de442d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:22.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.986+0000 7f3e753ff700 1 -- 172.21.15.107:0/3198483812 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78015ad0 con 0x55ee1f421870 2023-08-10T10:59:22.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.986+0000 7f3e753ff700 1 -- 172.21.15.107:0/3198483812 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e78025070 con 0x55ee1f421870 2023-08-10T10:59:22.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.986+0000 7f3e753ff700 1 -- 172.21.15.107:0/3198483812 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78007dc0 con 0x55ee1f421870 2023-08-10T10:59:22.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3198483812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f421870 msgr2=0x55ee1f4254c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:22.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3198483812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f421870 0x55ee1f4254c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e78015860 tx=0x7f3e78023040 comp rx=0 tx=0).stop 2023-08-10T10:59:22.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3198483812 shutdown_connections 2023-08-10T10:59:22.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3198483812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f41b800 0x55ee1f41b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3198483812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f421870 0x55ee1f4254c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3198483812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3198483812 >> 172.21.15.107:0/3198483812 conn(0x55ee1f378cd0 msgr2=0x55ee1f421d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:22.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3198483812 shutdown_connections 2023-08-10T10:59:22.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3198483812 wait complete. 2023-08-10T10:59:22.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.987+0000 7f3e9bef3b80 1 -- start start 2023-08-10T10:59:22.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.988+0000 7f3e9bef3b80 1 Processor -- start 2023-08-10T10:59:22.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.988+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f41b800 0x55ee1f429fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.988+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.993 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.988+0000 7f3e9bef3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f487e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.988+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f42acc0 con 0x55ee1f420f50 2023-08-10T10:59:22.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.988+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f488380 con 0x55ee1f421870 2023-08-10T10:59:22.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.988+0000 7f3e9bef3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f488540 con 0x55ee1f41b800 2023-08-10T10:59:22.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.988+0000 7f3e9bef3b80 10 client.0 _ll_register_callbacks cb 0x55ee1f309680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:59:22.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e85b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e86b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f41b800 0x55ee1f429fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e85b9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53168/0 (socket says 172.21.15.107:53168) 2023-08-10T10:59:22.994 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e85b9a700 1 -- 172.21.15.107:0/3926635870 learned_addr learned my addr 172.21.15.107:0/3926635870 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:22.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f487e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e85b9a700 1 -- 172.21.15.107:0/3926635870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f41b800 msgr2=0x55ee1f429fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:22.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f41b800 0x55ee1f429fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e85b9a700 1 -- 172.21.15.107:0/3926635870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 msgr2=0x55ee1f487e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:22.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f487e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:22.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e85b9a700 1 -- 172.21.15.107:0/3926635870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8010deb0 con 0x55ee1f420f50 2023-08-10T10:59:22.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f41b800 0x55ee1f429fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:59:22.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e85b9a700 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42a520 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3e70005910 tx=0x7f3e70005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d2c5a9aa168cf6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:22.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.989+0000 7f3e69ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T10:59:22.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.990+0000 7f3e69ffb700 1 -- 172.21.15.107:0/3926635870 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70029a30 con 0x55ee1f420f50 2023-08-10T10:59:22.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.990+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3926635870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e7800f040 con 0x55ee1f420f50 2023-08-10T10:59:22.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.990+0000 7f3e69ffb700 1 -- 172.21.15.107:0/3926635870 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f3e70029b90 con 0x55ee1f420f50 2023-08-10T10:59:22.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.990+0000 7f3e69ffb700 1 -- 172.21.15.107:0/3926635870 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e70029d50 con 0x55ee1f420f50 2023-08-10T10:59:22.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.990+0000 7f3e9bef3b80 10 client.16623 fetch_fsmap learned FSMap version 45 2023-08-10T10:59:22.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.990+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3926635870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ee1f199de0 con 0x55ee1f420f50 2023-08-10T10:59:22.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.990+0000 7f3e69ffb700 1 -- 172.21.15.107:0/3926635870 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e7800f040 con 0x55ee1f420f50 2023-08-10T10:59:22.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.991+0000 7f3e69ffb700 1 -- 172.21.15.107:0/3926635870 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 45) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f3e700046c0 con 0x55ee1f420f50 2023-08-10T10:59:22.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.991+0000 7f3e9bef3b80 10 client.16623 fetch_fsmap finished waiting for FSMap version 45 2023-08-10T10:59:22.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.991+0000 7f3e9bef3b80 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:59:22.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.991+0000 7f3e9bef3b80 20 client.16623 populate_metadata read hostname 'smithi107' 2023-08-10T10:59:22.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.991+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ee1f489d60 0x55ee1f48c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:22.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.991+0000 7f3e9bef3b80 4 client.16623 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:59:22.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.991+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3926635870 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ee1f365780 con 0x55ee1f489d60 2023-08-10T10:59:22.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.991+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ee1f489d60 0x55ee1f48c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:22.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e69ffb700 10 client.16623 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:59:22.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e86b9c700 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ee1f489d60 0x55ee1f48c180 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b26500dd40ba1bb server_cookie=befdc5b01187479f in_seq=0 out_seq=0 2023-08-10T10:59:23.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e69ffb700 1 -- 172.21.15.107:0/3926635870 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ee1f365780 con 0x55ee1f489d60 2023-08-10T10:59:23.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e69ffb700 10 client.16623 handle_command_reply: tid=0 2023-08-10T10:59:23.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 client.16623 shutdown 2023-08-10T10:59:23.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3926635870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 msgr2=0x55ee1f42a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:23.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42a520 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3e70005910 tx=0x7f3e70005960 comp rx=0 tx=0).stop 2023-08-10T10:59:23.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3926635870 shutdown_connections 2023-08-10T10:59:23.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55ee1f489d60 0x55ee1f48c180 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:23.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ee1f421870 0x55ee1f487e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:23.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee1f41b800 0x55ee1f429fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:23.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e69ffb700 0 client.16623 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:59:23.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 --2- 172.21.15.107:0/3926635870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ee1f420f50 0x55ee1f42a520 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:23.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3926635870 >> 172.21.15.107:0/3926635870 conn(0x55ee1f378cd0 msgr2=0x55ee1f4204f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:23.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3926635870 shutdown_connections 2023-08-10T10:59:23.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.992+0000 7f3e9bef3b80 1 -- 172.21.15.107:0/3926635870 wait complete. 2023-08-10T10:59:23.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e9bef3b80 20 client.16623 trim_cache size 0 max 16384 2023-08-10T10:59:23.002 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:59:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:59:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:59:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:59:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:59:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:59:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:59:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:59:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:59:23.003 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:59:23.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 -- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f3e6c0a12c0 msgr2=0x7f3e6c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:23.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f3e6c0a12c0 0x7f3e6c0a3780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55ee1f421cf0 tx=0x7f3e7c004620 comp rx=0 tx=0).stop 2023-08-10T10:59:23.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 -- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e801006e0 msgr2=0x7f3e80072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:23.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e801006e0 0x7f3e80072a70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00eb30 tx=0x7f3e7c00ee40 comp rx=0 tx=0).stop 2023-08-10T10:59:23.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 -- 172.21.15.107:0/3625215212 shutdown_connections 2023-08-10T10:59:23.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e801066f0 0x7f3e801a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:23.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3e801006e0 0x7f3e80072a70 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:23.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f3e6c0a12c0 0x7f3e6c0a3780 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:23.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 --2- 172.21.15.107:0/3625215212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e801010a0 0x7f3e80072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:23.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 -- 172.21.15.107:0/3625215212 >> 172.21.15.107:0/3625215212 conn(0x7f3e800fc1d0 msgr2=0x7f3e801041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:23.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.993+0000 7f3e885ff700 1 -- 172.21.15.107:0/3625215212 shutdown_connections 2023-08-10T10:59:23.005 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:22.994+0000 7f3e885ff700 1 -- 172.21.15.107:0/3625215212 wait complete. 2023-08-10T10:59:23.013 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:59:23.871 INFO:teuthology.orchestra.run.smithi107.stderr:32700000 of 50000000 tuples (65%) done (elapsed 462.05 s, remaining 244.45 s) 2023-08-10T10:59:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:23 smithi157 ceph-mon[129604]: pgmap v252: 129 pgs: 129 active+clean; 7.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T10:59:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:23 smithi107 ceph-mon[127953]: pgmap v252: 129 pgs: 129 active+clean; 7.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T10:59:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:23 smithi195 ceph-mon[129938]: pgmap v252: 129 pgs: 129 active+clean; 7.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T10:59:25.081 INFO:teuthology.orchestra.run.smithi107.stderr:32800000 of 50000000 tuples (65%) done (elapsed 463.26 s, remaining 242.93 s) 2023-08-10T10:59:26.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:25 smithi157 ceph-mon[129604]: pgmap v253: 129 pgs: 129 active+clean; 7.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 MiB/s wr, 72 op/s 2023-08-10T10:59:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:25 smithi107 ceph-mon[127953]: pgmap v253: 129 pgs: 129 active+clean; 7.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 MiB/s wr, 72 op/s 2023-08-10T10:59:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:25 smithi195 ceph-mon[129938]: pgmap v253: 129 pgs: 129 active+clean; 7.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 MiB/s wr, 72 op/s 2023-08-10T10:59:26.308 INFO:teuthology.orchestra.run.smithi107.stderr:32900000 of 50000000 tuples (65%) done (elapsed 464.49 s, remaining 241.42 s) 2023-08-10T10:59:27.617 INFO:teuthology.orchestra.run.smithi107.stderr:33000000 of 50000000 tuples (66%) done (elapsed 465.79 s, remaining 239.95 s) 2023-08-10T10:59:28.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:27 smithi157 ceph-mon[129604]: pgmap v254: 129 pgs: 129 active+clean; 7.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-08-10T10:59:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:27 smithi107 ceph-mon[127953]: pgmap v254: 129 pgs: 129 active+clean; 7.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-08-10T10:59:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:27 smithi195 ceph-mon[129938]: pgmap v254: 129 pgs: 129 active+clean; 7.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-08-10T10:59:28.844 INFO:teuthology.orchestra.run.smithi107.stderr:33100000 of 50000000 tuples (66%) done (elapsed 467.02 s, remaining 238.45 s) 2023-08-10T10:59:30.032 INFO:teuthology.orchestra.run.smithi107.stderr:33200000 of 50000000 tuples (66%) done (elapsed 468.21 s, remaining 236.93 s) 2023-08-10T10:59:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:29 smithi107 ceph-mon[127953]: pgmap v255: 129 pgs: 129 active+clean; 7.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 36 MiB/s wr, 62 op/s 2023-08-10T10:59:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:29 smithi195 ceph-mon[129938]: pgmap v255: 129 pgs: 129 active+clean; 7.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 36 MiB/s wr, 62 op/s 2023-08-10T10:59:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:29 smithi157 ceph-mon[129604]: pgmap v255: 129 pgs: 129 active+clean; 7.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 36 MiB/s wr, 62 op/s 2023-08-10T10:59:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:30 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:59:31.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:30 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:59:31.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:30 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T10:59:31.385 INFO:teuthology.orchestra.run.smithi107.stderr:33300000 of 50000000 tuples (66%) done (elapsed 469.56 s, remaining 235.49 s) 2023-08-10T10:59:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:31 smithi107 ceph-mon[127953]: pgmap v256: 129 pgs: 129 active+clean; 7.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 40 op/s 2023-08-10T10:59:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:31 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:59:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:31 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:59:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:31 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:59:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:31 smithi195 ceph-mon[129938]: pgmap v256: 129 pgs: 129 active+clean; 7.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 40 op/s 2023-08-10T10:59:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:31 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:59:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:31 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:59:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:31 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:59:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:31 smithi157 ceph-mon[129604]: pgmap v256: 129 pgs: 129 active+clean; 7.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 40 op/s 2023-08-10T10:59:32.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:31 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T10:59:32.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:31 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T10:59:32.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:31 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T10:59:32.707 INFO:teuthology.orchestra.run.smithi107.stderr:33400000 of 50000000 tuples (66%) done (elapsed 470.88 s, remaining 234.03 s) 2023-08-10T10:59:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:33 smithi107 ceph-mon[127953]: pgmap v257: 129 pgs: 129 active+clean; 7.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 40 op/s 2023-08-10T10:59:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:33 smithi195 ceph-mon[129938]: pgmap v257: 129 pgs: 129 active+clean; 7.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 40 op/s 2023-08-10T10:59:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:33 smithi157 ceph-mon[129604]: pgmap v257: 129 pgs: 129 active+clean; 7.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 40 op/s 2023-08-10T10:59:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:33500000 of 50000000 tuples (67%) done (elapsed 474.07 s, remaining 233.50 s) 2023-08-10T10:59:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:35 smithi107 ceph-mon[127953]: pgmap v258: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 34 MiB/s wr, 65 op/s 2023-08-10T10:59:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:35 smithi195 ceph-mon[129938]: pgmap v258: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 34 MiB/s wr, 65 op/s 2023-08-10T10:59:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:35 smithi157 ceph-mon[129604]: pgmap v258: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 34 MiB/s wr, 65 op/s 2023-08-10T10:59:37.126 INFO:teuthology.orchestra.run.smithi107.stderr:33600000 of 50000000 tuples (67%) done (elapsed 475.30 s, remaining 231.99 s) 2023-08-10T10:59:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:37 smithi107 ceph-mon[127953]: pgmap v259: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 22 MiB/s wr, 44 op/s 2023-08-10T10:59:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:37 smithi195 ceph-mon[129938]: pgmap v259: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 22 MiB/s wr, 44 op/s 2023-08-10T10:59:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:37 smithi157 ceph-mon[129604]: pgmap v259: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 22 MiB/s wr, 44 op/s 2023-08-10T10:59:38.435 INFO:teuthology.orchestra.run.smithi107.stderr:33700000 of 50000000 tuples (67%) done (elapsed 476.61 s, remaining 230.53 s) 2023-08-10T10:59:39.660 INFO:teuthology.orchestra.run.smithi107.stderr:33800000 of 50000000 tuples (67%) done (elapsed 477.84 s, remaining 229.02 s) 2023-08-10T10:59:40.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:39 smithi107 ceph-mon[127953]: pgmap v260: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 31 MiB/s wr, 71 op/s 2023-08-10T10:59:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:39 smithi195 ceph-mon[129938]: pgmap v260: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 31 MiB/s wr, 71 op/s 2023-08-10T10:59:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:39 smithi157 ceph-mon[129604]: pgmap v260: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 31 MiB/s wr, 71 op/s 2023-08-10T10:59:40.923 INFO:teuthology.orchestra.run.smithi107.stderr:33900000 of 50000000 tuples (67%) done (elapsed 479.10 s, remaining 227.54 s) 2023-08-10T10:59:42.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:41 smithi107 ceph-mon[127953]: pgmap v261: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 19 MiB/s wr, 51 op/s 2023-08-10T10:59:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:41 smithi195 ceph-mon[129938]: pgmap v261: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 19 MiB/s wr, 51 op/s 2023-08-10T10:59:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:41 smithi157 ceph-mon[129604]: pgmap v261: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 19 MiB/s wr, 51 op/s 2023-08-10T10:59:42.613 INFO:teuthology.orchestra.run.smithi107.stderr:34000000 of 50000000 tuples (68%) done (elapsed 480.79 s, remaining 226.25 s) 2023-08-10T10:59:43.971 INFO:teuthology.orchestra.run.smithi107.stderr:34100000 of 50000000 tuples (68%) done (elapsed 482.15 s, remaining 224.81 s) 2023-08-10T10:59:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:43 smithi107 ceph-mon[127953]: pgmap v262: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 19 MiB/s wr, 51 op/s 2023-08-10T10:59:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:43 smithi195 ceph-mon[129938]: pgmap v262: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 19 MiB/s wr, 51 op/s 2023-08-10T10:59:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:43 smithi157 ceph-mon[129604]: pgmap v262: 129 pgs: 129 active+clean; 7.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 19 MiB/s wr, 51 op/s 2023-08-10T10:59:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:34200000 of 50000000 tuples (68%) done (elapsed 483.42 s, remaining 223.34 s) 2023-08-10T10:59:46.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:45 smithi107 ceph-mon[127953]: pgmap v263: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 30 MiB/s wr, 88 op/s 2023-08-10T10:59:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:45 smithi195 ceph-mon[129938]: pgmap v263: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 30 MiB/s wr, 88 op/s 2023-08-10T10:59:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:45 smithi157 ceph-mon[129604]: pgmap v263: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 30 MiB/s wr, 88 op/s 2023-08-10T10:59:46.487 INFO:teuthology.orchestra.run.smithi107.stderr:34300000 of 50000000 tuples (68%) done (elapsed 484.66 s, remaining 221.84 s) 2023-08-10T10:59:47.882 INFO:teuthology.orchestra.run.smithi107.stderr:34400000 of 50000000 tuples (68%) done (elapsed 486.06 s, remaining 220.42 s) 2023-08-10T10:59:48.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:47 smithi195 ceph-mon[129938]: pgmap v264: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 20 MiB/s wr, 64 op/s 2023-08-10T10:59:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:47 smithi157 ceph-mon[129604]: pgmap v264: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 20 MiB/s wr, 64 op/s 2023-08-10T10:59:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:47 smithi107 ceph-mon[127953]: pgmap v264: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 20 MiB/s wr, 64 op/s 2023-08-10T10:59:49.170 INFO:teuthology.orchestra.run.smithi107.stderr:34500000 of 50000000 tuples (69%) done (elapsed 487.35 s, remaining 218.95 s) 2023-08-10T10:59:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:49 smithi195 ceph-mon[129938]: pgmap v265: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 31 MiB/s wr, 100 op/s 2023-08-10T10:59:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:49 smithi157 ceph-mon[129604]: pgmap v265: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 31 MiB/s wr, 100 op/s 2023-08-10T10:59:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:49 smithi107 ceph-mon[127953]: pgmap v265: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 31 MiB/s wr, 100 op/s 2023-08-10T10:59:50.464 INFO:teuthology.orchestra.run.smithi107.stderr:34600000 of 50000000 tuples (69%) done (elapsed 488.64 s, remaining 217.49 s) 2023-08-10T10:59:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:51 smithi195 ceph-mon[129938]: pgmap v266: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 73 op/s 2023-08-10T10:59:52.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:51 smithi157 ceph-mon[129604]: pgmap v266: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 73 op/s 2023-08-10T10:59:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:51 smithi107 ceph-mon[127953]: pgmap v266: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 73 op/s 2023-08-10T10:59:52.798 INFO:teuthology.orchestra.run.smithi107.stderr:34700000 of 50000000 tuples (69%) done (elapsed 490.98 s, remaining 216.48 s) 2023-08-10T10:59:53.014 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T10:59:53.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.241+0000 7f76f89fe700 1 -- 172.21.15.107:0/4210776510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f4106620 msgr2=0x7f76f4106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:53.241 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.241+0000 7f76f89fe700 1 --2- 172.21.15.107:0/4210776510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f4106620 0x7f76f4106a00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f76e40099c0 tx=0x7f76e4009cd0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.241+0000 7f76f89fe700 1 -- 172.21.15.107:0/4210776510 shutdown_connections 2023-08-10T10:59:53.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.241+0000 7f76f89fe700 1 --2- 172.21.15.107:0/4210776510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4100f20 0x7f76f410d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.241+0000 7f76f89fe700 1 --2- 172.21.15.107:0/4210776510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f4106620 0x7f76f4106a00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.241+0000 7f76f89fe700 1 --2- 172.21.15.107:0/4210776510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f4100560 0x7f76f41009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.241+0000 7f76f89fe700 1 -- 172.21.15.107:0/4210776510 >> 172.21.15.107:0/4210776510 conn(0x7f76f40fc010 msgr2=0x7f76f40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:53.242 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.241+0000 7f76f89fe700 1 -- 172.21.15.107:0/4210776510 shutdown_connections 2023-08-10T10:59:53.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.241+0000 7f76f89fe700 1 -- 172.21.15.107:0/4210776510 wait complete. 2023-08-10T10:59:53.243 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.242+0000 7f76f89fe700 1 Processor -- start 2023-08-10T10:59:53.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.243+0000 7f76f89fe700 1 -- start start 2023-08-10T10:59:53.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.243+0000 7f76f89fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f4100560 0x7f76f4072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.243+0000 7f76f89fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4100f20 0x7f76f4072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.243+0000 7f76f89fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f4106620 0x7f76f41a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.243+0000 7f76f89fe700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40737e0 con 0x7f76f4106620 2023-08-10T10:59:53.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.243+0000 7f76f89fe700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f41a4bc0 con 0x7f76f4100f20 2023-08-10T10:59:53.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.243+0000 7f76f89fe700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f41a4d00 con 0x7f76f4100560 2023-08-10T10:59:53.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f4100560 0x7f76f4072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f4100560 0x7f76f4072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:49784/0 (socket says 172.21.15.107:49784) 2023-08-10T10:59:53.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f2d9d700 1 -- 172.21.15.107:0/1041497315 learned_addr learned my addr 172.21.15.107:0/1041497315 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:53.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f359e700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f4106620 0x7f76f41a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f259c700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4100f20 0x7f76f4072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f2d9d700 1 -- 172.21.15.107:0/1041497315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4100f20 msgr2=0x7f76f4072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:53.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4100f20 0x7f76f4072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f2d9d700 1 -- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f4106620 msgr2=0x7f76f41a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:53.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f4106620 0x7f76f41a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f2d9d700 1 -- 172.21.15.107:0/1041497315 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8009520 con 0x7f76f4100560 2023-08-10T10:59:53.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.244+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f4100560 0x7f76f4072a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76e4005910 tx=0x7f76e400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:53.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.245+0000 7f76dbfff700 1 -- 172.21.15.107:0/1041497315 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e401d070 con 0x7f76f4100560 2023-08-10T10:59:53.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.245+0000 7f76dbfff700 1 -- 172.21.15.107:0/1041497315 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76e4005050 con 0x7f76f4100560 2023-08-10T10:59:53.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.245+0000 7f76f89fe700 1 -- 172.21.15.107:0/1041497315 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e40095f0 con 0x7f76f4100560 2023-08-10T10:59:53.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.245+0000 7f76dbfff700 1 -- 172.21.15.107:0/1041497315 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4004950 con 0x7f76f4100560 2023-08-10T10:59:53.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.245+0000 7f76f89fe700 1 -- 172.21.15.107:0/1041497315 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f41a51a0 con 0x7f76f4100560 2023-08-10T10:59:53.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.248+0000 7f76dbfff700 1 -- 172.21.15.107:0/1041497315 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f76e40051c0 con 0x7f76f4100560 2023-08-10T10:59:53.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.249+0000 7f770cb26b80 1 Processor -- start 2023-08-10T10:59:53.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f770cb26b80 1 -- start start 2023-08-10T10:59:53.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a8364b0 0x562a2a836890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a83b290 0x562a2a83b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f770cb26b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a7b1dc0 con 0x562a2a8364b0 2023-08-10T10:59:53.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f770cb26b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a78e590 con 0x562a2a83b290 2023-08-10T10:59:53.251 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f770cb26b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a78beb0 con 0x562a2a836dd0 2023-08-10T10:59:53.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f76f359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a8364b0 0x562a2a836890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f76f359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a8364b0 0x562a2a836890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43382/0 (socket says 172.21.15.107:43382) 2023-08-10T10:59:53.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f76f359e700 1 -- 172.21.15.107:0/1779772088 learned_addr learned my addr 172.21.15.107:0/1779772088 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:53.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76dbfff700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f76dc0a13e0 0x7f76dc0a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.250+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76f259c700 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a83b290 0x562a2a83b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76dbfff700 1 -- 172.21.15.107:0/1041497315 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f76e40cdca0 con 0x7f76f4100560 2023-08-10T10:59:53.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76f359e700 1 -- 172.21.15.107:0/1779772088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 msgr2=0x562a2a83ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:53.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76f359e700 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76f359e700 1 -- 172.21.15.107:0/1779772088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a83b290 msgr2=0x562a2a83b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:53.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76f359e700 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a83b290 0x562a2a83b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76f359e700 1 -- 172.21.15.107:0/1779772088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a2a608630 con 0x562a2a8364b0 2023-08-10T10:59:53.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76f259c700 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a83b290 0x562a2a83b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:59:53.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76f359e700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f76dc0a13e0 0x7f76dc0a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.251+0000 7f76f359e700 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a8364b0 0x562a2a836890 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0116d0 tx=0x7f76ec0119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4142fab023a8e44 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:53.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.252+0000 7f76d97fa700 1 -- 172.21.15.107:0/1779772088 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00e040 con 0x562a2a8364b0 2023-08-10T10:59:53.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.252+0000 7f76d97fa700 1 -- 172.21.15.107:0/1779772088 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76ec00f040 con 0x562a2a8364b0 2023-08-10T10:59:53.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.252+0000 7f76d97fa700 1 -- 172.21.15.107:0/1779772088 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec020700 con 0x562a2a8364b0 2023-08-10T10:59:53.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.252+0000 7f770cb26b80 1 -- 172.21.15.107:0/1779772088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a8364b0 msgr2=0x562a2a836890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:53.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.252+0000 7f76f359e700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f76dc0a13e0 0x7f76dc0a38a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f76ec022000 tx=0x7f76ec023000 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:53.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.252+0000 7f770cb26b80 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a8364b0 0x562a2a836890 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0116d0 tx=0x7f76ec0119e0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.253+0000 7f770cb26b80 1 -- 172.21.15.107:0/1779772088 shutdown_connections 2023-08-10T10:59:53.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.253+0000 7f770cb26b80 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a83b290 0x562a2a83b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.253+0000 7f770cb26b80 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a8364b0 0x562a2a836890 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.253+0000 7f770cb26b80 1 --2- 172.21.15.107:0/1779772088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.253+0000 7f770cb26b80 1 -- 172.21.15.107:0/1779772088 >> 172.21.15.107:0/1779772088 conn(0x562a2a793cd0 msgr2=0x562a2a831750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:53.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.253+0000 7f770cb26b80 1 -- 172.21.15.107:0/1779772088 shutdown_connections 2023-08-10T10:59:53.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.253+0000 7f770cb26b80 1 -- 172.21.15.107:0/1779772088 wait complete. 2023-08-10T10:59:53.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.253+0000 7f770cb26b80 1 -- start start 2023-08-10T10:59:53.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.254+0000 7f770cb26b80 1 Processor -- start 2023-08-10T10:59:53.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.254+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a8429e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.254+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 0x562a2a83fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.254+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a840240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.254+0000 7f770cb26b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a7877a0 con 0x562a2a83b290 2023-08-10T10:59:53.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.254+0000 7f770cb26b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a726ac0 con 0x562a2a836dd0 2023-08-10T10:59:53.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.254+0000 7f770cb26b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a7267c0 con 0x562a2a8364b0 2023-08-10T10:59:53.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.254+0000 7f770cb26b80 10 client.0 _ll_register_callbacks cb 0x562a2a724680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:59:53.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.254+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a8429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 0x562a2a83fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a8429e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:49800/0 (socket says 172.21.15.107:49800) 2023-08-10T10:59:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f2d9d700 1 -- 172.21.15.107:0/3121013357 learned_addr learned my addr 172.21.15.107:0/3121013357 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f359e700 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a840240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f259c700 1 -- 172.21.15.107:0/3121013357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 msgr2=0x562a2a8429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f259c700 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a8429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f259c700 1 -- 172.21.15.107:0/3121013357 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 msgr2=0x562a2a840240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f259c700 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a840240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f259c700 1 -- 172.21.15.107:0/3121013357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e8009a70 con 0x562a2a836dd0 2023-08-10T10:59:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a8429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:59:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76f259c700 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 0x562a2a83fc60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76e8011ce0 tx=0x7f76e8011d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33cef609e1bd85e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T10:59:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.255+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3121013357 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8011ea0 con 0x562a2a836dd0 2023-08-10T10:59:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f770cb26b80 1 -- 172.21.15.107:0/3121013357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a2a829470 con 0x562a2a836dd0 2023-08-10T10:59:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3121013357 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f76e800fb00 con 0x562a2a836dd0 2023-08-10T10:59:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3121013357 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76e8016070 con 0x562a2a836dd0 2023-08-10T10:59:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f770cb26b80 10 client.26291 fetch_fsmap learned FSMap version 45 2023-08-10T10:59:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f770cb26b80 1 -- 172.21.15.107:0/3121013357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x7f76ec011300 con 0x562a2a836dd0 2023-08-10T10:59:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3121013357 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a2a829470 con 0x562a2a836dd0 2023-08-10T10:59:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3121013357 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 45) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f76e8019390 con 0x562a2a836dd0 2023-08-10T10:59:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f770cb26b80 10 client.26291 fetch_fsmap finished waiting for FSMap version 45 2023-08-10T10:59:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f770cb26b80 10 client.26291 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:59:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f770cb26b80 20 client.26291 populate_metadata read hostname 'smithi107' 2023-08-10T10:59:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562a2a850430 0x562a2a852850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f770cb26b80 4 client.26291 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:59:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.256+0000 7f770cb26b80 1 -- 172.21.15.107:0/3121013357 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a2a8059d0 con 0x562a2a850430 2023-08-10T10:59:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.257+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562a2a850430 0x562a2a852850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.257+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562a2a850430 0x562a2a852850 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0d082e84f459344 server_cookie=fa49c0fa97160c6d in_seq=0 out_seq=0 2023-08-10T10:59:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.257+0000 7f76d6ff5700 10 client.26291 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:59:53.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3121013357 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562a2a8059d0 con 0x562a2a850430 2023-08-10T10:59:53.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f76d6ff5700 10 client.26291 handle_command_reply: tid=0 2023-08-10T10:59:53.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 client.26291 shutdown 2023-08-10T10:59:53.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 -- 172.21.15.107:0/3121013357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 msgr2=0x562a2a83fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:53.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 0x562a2a83fc60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76e8011ce0 tx=0x7f76e8011d10 comp rx=0 tx=0).stop 2023-08-10T10:59:53.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 -- 172.21.15.107:0/3121013357 shutdown_connections 2023-08-10T10:59:53.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562a2a850430 0x562a2a852850 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a840240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a8429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f76d6ff5700 0 client.26291 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:59:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3121013357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 0x562a2a83fc60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 -- 172.21.15.107:0/3121013357 >> 172.21.15.107:0/3121013357 conn(0x562a2a793cd0 msgr2=0x562a2a83c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 -- 172.21.15.107:0/3121013357 shutdown_connections 2023-08-10T10:59:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.258+0000 7f770cb26b80 1 -- 172.21.15.107:0/3121013357 wait complete. 2023-08-10T10:59:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.259+0000 7f770cb26b80 20 client.26291 trim_cache size 0 max 16384 2023-08-10T10:59:53.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.281+0000 7f770cb26b80 1 Processor -- start 2023-08-10T10:59:53.281 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.281+0000 7f770cb26b80 1 -- start start 2023-08-10T10:59:53.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.281+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a8364b0 0x562a2a847550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.281+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.281+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a842580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.282 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.281+0000 7f770cb26b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a60a920 con 0x562a2a83b290 2023-08-10T10:59:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.281+0000 7f770cb26b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a832d70 con 0x562a2a8364b0 2023-08-10T10:59:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.281+0000 7f770cb26b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a83e1c0 con 0x562a2a836dd0 2023-08-10T10:59:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a8364b0 0x562a2a847550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:49808/0 (socket says 172.21.15.107:49808) 2023-08-10T10:59:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a8364b0 0x562a2a847550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:43428/0 (socket says 172.21.15.107:43428) 2023-08-10T10:59:53.283 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f259c700 1 -- 172.21.15.107:0/4132126405 learned_addr learned my addr 172.21.15.107:0/4132126405 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:53.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f359e700 1 --2- 172.21.15.107:0/4132126405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a842580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f259c700 1 -- 172.21.15.107:0/4132126405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a8364b0 msgr2=0x562a2a847550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:53.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f259c700 1 --2- 172.21.15.107:0/4132126405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a8364b0 0x562a2a847550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f259c700 1 -- 172.21.15.107:0/4132126405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 msgr2=0x562a2a842580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:53.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f259c700 1 --2- 172.21.15.107:0/4132126405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a842580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f259c700 1 -- 172.21.15.107:0/4132126405 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a2a5b4de0 con 0x562a2a836dd0 2023-08-10T10:59:53.284 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/4132126405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a8364b0 0x562a2a847550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:59:53.286 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.282+0000 7f76f259c700 1 --2- 172.21.15.107:0/4132126405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83d660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009340 tx=0x7f76e800f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=246f1e8864bf13fb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f76d9ffb700 1 -- 172.21.15.107:0/4132126405 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8016070 con 0x562a2a836dd0 2023-08-10T10:59:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f76d9ffb700 1 -- 172.21.15.107:0/4132126405 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76e8019910 con 0x562a2a836dd0 2023-08-10T10:59:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f76d9ffb700 1 -- 172.21.15.107:0/4132126405 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8004bd0 con 0x562a2a836dd0 2023-08-10T10:59:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f770cb26b80 1 -- 172.21.15.107:0/4132126405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 msgr2=0x562a2a83d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f770cb26b80 1 --2- 172.21.15.107:0/4132126405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83d660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009340 tx=0x7f76e800f6a0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f770cb26b80 1 -- 172.21.15.107:0/4132126405 shutdown_connections 2023-08-10T10:59:53.287 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f770cb26b80 1 --2- 172.21.15.107:0/4132126405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a8364b0 0x562a2a847550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f770cb26b80 1 --2- 172.21.15.107:0/4132126405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a842580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f770cb26b80 1 --2- 172.21.15.107:0/4132126405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a836dd0 0x562a2a83d660 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.283+0000 7f770cb26b80 1 -- 172.21.15.107:0/4132126405 >> 172.21.15.107:0/4132126405 conn(0x562a2a793cd0 msgr2=0x562a2a83cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:53.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.284+0000 7f770cb26b80 1 -- 172.21.15.107:0/4132126405 shutdown_connections 2023-08-10T10:59:53.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.284+0000 7f770cb26b80 1 -- 172.21.15.107:0/4132126405 wait complete. 2023-08-10T10:59:53.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.284+0000 7f770cb26b80 1 -- start start 2023-08-10T10:59:53.288 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.284+0000 7f770cb26b80 1 Processor -- start 2023-08-10T10:59:53.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a83fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 0x562a2a83e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f770cb26b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a83e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f770cb26b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a83f060 con 0x562a2a83b290 2023-08-10T10:59:53.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f770cb26b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a83f1d0 con 0x562a2a836dd0 2023-08-10T10:59:53.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f770cb26b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2a8a40e0 con 0x562a2a8364b0 2023-08-10T10:59:53.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f770cb26b80 10 client.0 _ll_register_callbacks cb 0x562a2a724680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:59:53.289 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f76f359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a83e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a83fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a83fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:49810/0 (socket says 172.21.15.107:49810) 2023-08-10T10:59:53.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f76f259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 0x562a2a83e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f76f2d9d700 1 -- 172.21.15.107:0/3244727978 learned_addr learned my addr 172.21.15.107:0/3244727978 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T10:59:53.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f76f2d9d700 1 -- 172.21.15.107:0/3244727978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 msgr2=0x562a2a83e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:53.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.285+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 0x562a2a83e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f76f2d9d700 1 -- 172.21.15.107:0/3244727978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 msgr2=0x562a2a83e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:59:53.290 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a83e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f76f2d9d700 1 -- 172.21.15.107:0/3244727978 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f41a51a0 con 0x562a2a8364b0 2023-08-10T10:59:53.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f76f2d9d700 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a83fba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009fd0 tx=0x7f76e40a2e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35347ec93e29ee server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:59:53.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f76d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T10:59:53.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3244727978 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40cb320 con 0x562a2a8364b0 2023-08-10T10:59:53.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3244727978 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f76e40cb480 con 0x562a2a8364b0 2023-08-10T10:59:53.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f770cb26b80 1 -- 172.21.15.107:0/3244727978 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76ec00f040 con 0x562a2a8364b0 2023-08-10T10:59:53.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3244727978 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76e409ad10 con 0x562a2a8364b0 2023-08-10T10:59:53.291 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f770cb26b80 10 client.26338 fetch_fsmap learned FSMap version 45 2023-08-10T10:59:53.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.286+0000 7f770cb26b80 1 -- 172.21.15.107:0/3244727978 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x7f76ec011300 con 0x562a2a8364b0 2023-08-10T10:59:53.292 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.287+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3244727978 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76ec00f040 con 0x562a2a8364b0 2023-08-10T10:59:53.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.287+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3244727978 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 45) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f76e40c7070 con 0x562a2a8364b0 2023-08-10T10:59:53.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.287+0000 7f770cb26b80 10 client.26338 fetch_fsmap finished waiting for FSMap version 45 2023-08-10T10:59:53.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.287+0000 7f770cb26b80 10 client.26338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T10:59:53.293 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.287+0000 7f770cb26b80 20 client.26338 populate_metadata read hostname 'smithi107' 2023-08-10T10:59:53.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.287+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562a2a8a5400 0x562a2a8a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:59:53.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.287+0000 7f770cb26b80 4 client.26338 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T10:59:53.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.287+0000 7f770cb26b80 1 -- 172.21.15.107:0/3244727978 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562a2a780780 con 0x562a2a8a5400 2023-08-10T10:59:53.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.287+0000 7f76f259c700 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562a2a8a5400 0x562a2a8a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:59:53.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f76f259c700 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562a2a8a5400 0x562a2a8a77f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd9bf70f1e862f42 server_cookie=5aaae798a9eba0d4 in_seq=0 out_seq=0 2023-08-10T10:59:53.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f76d6ff5700 10 client.26338 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T10:59:53.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f76d6ff5700 1 -- 172.21.15.107:0/3244727978 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562a2a780780 con 0x562a2a8a5400 2023-08-10T10:59:53.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f76d6ff5700 10 client.26338 handle_command_reply: tid=0 2023-08-10T10:59:53.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 client.26338 shutdown 2023-08-10T10:59:53.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 -- 172.21.15.107:0/3244727978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 msgr2=0x562a2a83fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:53.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a83fba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009fd0 tx=0x7f76e40a2e70 comp rx=0 tx=0).stop 2023-08-10T10:59:53.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 -- 172.21.15.107:0/3244727978 shutdown_connections 2023-08-10T10:59:53.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562a2a8a5400 0x562a2a8a77f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562a2a83b290 0x562a2a83e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f76d6ff5700 0 client.26338 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T10:59:53.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a2a8364b0 0x562a2a83fba0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 --2- 172.21.15.107:0/3244727978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562a2a836dd0 0x562a2a83e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 -- 172.21.15.107:0/3244727978 >> 172.21.15.107:0/3244727978 conn(0x562a2a793cd0 msgr2=0x562a2a83a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:53.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 -- 172.21.15.107:0/3244727978 shutdown_connections 2023-08-10T10:59:53.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.288+0000 7f770cb26b80 1 -- 172.21.15.107:0/3244727978 wait complete. 2023-08-10T10:59:53.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f770cb26b80 20 client.26338 trim_cache size 0 max 16384 2023-08-10T10:59:53.297 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T10:59:53.297 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T10:59:53.297 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T10:59:53.297 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T10:59:53.297 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T10:59:53.297 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T10:59:53.297 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T10:59:53.298 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:59:53.298 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T10:59:53.298 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T10:59:53.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 -- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f76dc0a13e0 msgr2=0x7f76dc0a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:53.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f76dc0a13e0 0x7f76dc0a38a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f76ec022000 tx=0x7f76ec023000 comp rx=0 tx=0).stop 2023-08-10T10:59:53.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 -- 172.21.15.107:0/1041497315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f4100560 msgr2=0x7f76f4072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:59:53.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f4100560 0x7f76f4072a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76e4005910 tx=0x7f76e400f690 comp rx=0 tx=0).stop 2023-08-10T10:59:53.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 -- 172.21.15.107:0/1041497315 shutdown_connections 2023-08-10T10:59:53.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f76f4106620 0x7f76f41a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76f4100560 0x7f76f4072a70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f76dc0a13e0 0x7f76dc0a38a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 --2- 172.21.15.107:0/1041497315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4100f20 0x7f76f4072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:59:53.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 -- 172.21.15.107:0/1041497315 >> 172.21.15.107:0/1041497315 conn(0x7f76f40fc010 msgr2=0x7f76f40fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:59:53.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 -- 172.21.15.107:0/1041497315 shutdown_connections 2023-08-10T10:59:53.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T10:59:53.289+0000 7f76f89fe700 1 -- 172.21.15.107:0/1041497315 wait complete. 2023-08-10T10:59:53.314 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T10:59:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:53 smithi195 ceph-mon[129938]: pgmap v267: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 73 op/s 2023-08-10T10:59:54.236 INFO:teuthology.orchestra.run.smithi107.stderr:34800000 of 50000000 tuples (69%) done (elapsed 492.41 s, remaining 215.08 s) 2023-08-10T10:59:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:53 smithi157 ceph-mon[129604]: pgmap v267: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 73 op/s 2023-08-10T10:59:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:53 smithi107 ceph-mon[127953]: pgmap v267: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 73 op/s 2023-08-10T10:59:55.519 INFO:teuthology.orchestra.run.smithi107.stderr:34900000 of 50000000 tuples (69%) done (elapsed 493.70 s, remaining 213.61 s) 2023-08-10T10:59:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:55 smithi195 ceph-mon[129938]: pgmap v268: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 31 MiB/s wr, 110 op/s 2023-08-10T10:59:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:55 smithi157 ceph-mon[129604]: pgmap v268: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 31 MiB/s wr, 110 op/s 2023-08-10T10:59:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:55 smithi107 ceph-mon[127953]: pgmap v268: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 31 MiB/s wr, 110 op/s 2023-08-10T10:59:56.837 INFO:teuthology.orchestra.run.smithi107.stderr:35000000 of 50000000 tuples (70%) done (elapsed 495.01 s, remaining 212.15 s) 2023-08-10T10:59:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:57 smithi195 ceph-mon[129938]: pgmap v269: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 20 MiB/s wr, 72 op/s 2023-08-10T10:59:58.177 INFO:teuthology.orchestra.run.smithi107.stderr:35100000 of 50000000 tuples (70%) done (elapsed 496.35 s, remaining 210.70 s) 2023-08-10T10:59:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:57 smithi157 ceph-mon[129604]: pgmap v269: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 20 MiB/s wr, 72 op/s 2023-08-10T10:59:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:57 smithi107 ceph-mon[127953]: pgmap v269: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 20 MiB/s wr, 72 op/s 2023-08-10T10:59:59.390 INFO:teuthology.orchestra.run.smithi107.stderr:35200000 of 50000000 tuples (70%) done (elapsed 497.57 s, remaining 209.20 s) 2023-08-10T11:00:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 10:59:59 smithi195 ceph-mon[129938]: pgmap v270: 129 pgs: 129 active+clean; 8.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 32 MiB/s wr, 111 op/s 2023-08-10T11:00:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 10:59:59 smithi157 ceph-mon[129604]: pgmap v270: 129 pgs: 129 active+clean; 8.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 32 MiB/s wr, 111 op/s 2023-08-10T11:00:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 10:59:59 smithi107 ceph-mon[127953]: pgmap v270: 129 pgs: 129 active+clean; 8.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 32 MiB/s wr, 111 op/s 2023-08-10T11:00:00.667 INFO:teuthology.orchestra.run.smithi107.stderr:35300000 of 50000000 tuples (70%) done (elapsed 498.84 s, remaining 207.73 s) 2023-08-10T11:00:01.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:00 smithi195 ceph-mon[129938]: overall HEALTH_OK 2023-08-10T11:00:01.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:00 smithi157 ceph-mon[129604]: overall HEALTH_OK 2023-08-10T11:00:01.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:00 smithi107 ceph-mon[127953]: overall HEALTH_OK 2023-08-10T11:00:02.064 INFO:teuthology.orchestra.run.smithi107.stderr:35400000 of 50000000 tuples (70%) done (elapsed 500.24 s, remaining 206.31 s) 2023-08-10T11:00:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:01 smithi195 ceph-mon[129938]: pgmap v271: 129 pgs: 129 active+clean; 8.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 20 MiB/s wr, 74 op/s 2023-08-10T11:00:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:01 smithi157 ceph-mon[129604]: pgmap v271: 129 pgs: 129 active+clean; 8.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 20 MiB/s wr, 74 op/s 2023-08-10T11:00:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:01 smithi107 ceph-mon[127953]: pgmap v271: 129 pgs: 129 active+clean; 8.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 20 MiB/s wr, 74 op/s 2023-08-10T11:00:03.377 INFO:teuthology.orchestra.run.smithi107.stderr:35500000 of 50000000 tuples (71%) done (elapsed 501.55 s, remaining 204.86 s) 2023-08-10T11:00:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:03 smithi195 ceph-mon[129938]: pgmap v272: 129 pgs: 129 active+clean; 8.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 20 MiB/s wr, 74 op/s 2023-08-10T11:00:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:03 smithi157 ceph-mon[129604]: pgmap v272: 129 pgs: 129 active+clean; 8.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 20 MiB/s wr, 74 op/s 2023-08-10T11:00:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:03 smithi107 ceph-mon[127953]: pgmap v272: 129 pgs: 129 active+clean; 8.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 20 MiB/s wr, 74 op/s 2023-08-10T11:00:04.638 INFO:teuthology.orchestra.run.smithi107.stderr:35600000 of 50000000 tuples (71%) done (elapsed 502.82 s, remaining 203.39 s) 2023-08-10T11:00:05.944 INFO:teuthology.orchestra.run.smithi107.stderr:35700000 of 50000000 tuples (71%) done (elapsed 504.12 s, remaining 201.93 s) 2023-08-10T11:00:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:05 smithi195 ceph-mon[129938]: pgmap v273: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 32 MiB/s wr, 119 op/s 2023-08-10T11:00:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:05 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:00:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:05 smithi157 ceph-mon[129604]: pgmap v273: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 32 MiB/s wr, 119 op/s 2023-08-10T11:00:06.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:05 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:00:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:05 smithi107 ceph-mon[127953]: pgmap v273: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 32 MiB/s wr, 119 op/s 2023-08-10T11:00:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:05 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:00:07.293 INFO:teuthology.orchestra.run.smithi107.stderr:35800000 of 50000000 tuples (71%) done (elapsed 505.47 s, remaining 200.49 s) 2023-08-10T11:00:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:07 smithi195 ceph-mon[129938]: pgmap v274: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 23 MiB/s wr, 82 op/s 2023-08-10T11:00:08.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:07 smithi157 ceph-mon[129604]: pgmap v274: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 23 MiB/s wr, 82 op/s 2023-08-10T11:00:08.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:07 smithi107 ceph-mon[127953]: pgmap v274: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 23 MiB/s wr, 82 op/s 2023-08-10T11:00:08.691 INFO:teuthology.orchestra.run.smithi107.stderr:35900000 of 50000000 tuples (71%) done (elapsed 506.87 s, remaining 199.08 s) 2023-08-10T11:00:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:08 smithi195 ceph-mon[129938]: osdmap e99: 12 total, 12 up, 12 in 2023-08-10T11:00:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:08 smithi195 ceph-mon[129938]: pgmap v276: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 27 MiB/s wr, 99 op/s 2023-08-10T11:00:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:08 smithi157 ceph-mon[129604]: osdmap e99: 12 total, 12 up, 12 in 2023-08-10T11:00:09.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:08 smithi157 ceph-mon[129604]: pgmap v276: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 27 MiB/s wr, 99 op/s 2023-08-10T11:00:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:08 smithi107 ceph-mon[127953]: osdmap e99: 12 total, 12 up, 12 in 2023-08-10T11:00:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:08 smithi107 ceph-mon[127953]: pgmap v276: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 27 MiB/s wr, 99 op/s 2023-08-10T11:00:09.959 INFO:teuthology.orchestra.run.smithi107.stderr:36000000 of 50000000 tuples (72%) done (elapsed 508.14 s, remaining 197.61 s) 2023-08-10T11:00:11.320 INFO:teuthology.orchestra.run.smithi107.stderr:36100000 of 50000000 tuples (72%) done (elapsed 509.50 s, remaining 196.18 s) 2023-08-10T11:00:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:11 smithi195 ceph-mon[129938]: pgmap v277: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 27 MiB/s wr, 99 op/s 2023-08-10T11:00:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:11 smithi157 ceph-mon[129604]: pgmap v277: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 27 MiB/s wr, 99 op/s 2023-08-10T11:00:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:11 smithi107 ceph-mon[127953]: pgmap v277: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 27 MiB/s wr, 99 op/s 2023-08-10T11:00:12.553 INFO:teuthology.orchestra.run.smithi107.stderr:36200000 of 50000000 tuples (72%) done (elapsed 510.73 s, remaining 194.70 s) 2023-08-10T11:00:13.852 INFO:teuthology.orchestra.run.smithi107.stderr:36300000 of 50000000 tuples (72%) done (elapsed 512.03 s, remaining 193.25 s) 2023-08-10T11:00:13.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:13 smithi195 ceph-mon[129938]: pgmap v278: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 27 MiB/s wr, 99 op/s 2023-08-10T11:00:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:13 smithi157 ceph-mon[129604]: pgmap v278: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 27 MiB/s wr, 99 op/s 2023-08-10T11:00:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:13 smithi107 ceph-mon[127953]: pgmap v278: 129 pgs: 129 active+clean; 7.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 27 MiB/s wr, 99 op/s 2023-08-10T11:00:15.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:14 smithi157 ceph-mon[129604]: osdmap e100: 12 total, 12 up, 12 in 2023-08-10T11:00:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:14 smithi107 ceph-mon[127953]: osdmap e100: 12 total, 12 up, 12 in 2023-08-10T11:00:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:14 smithi195 ceph-mon[129938]: osdmap e100: 12 total, 12 up, 12 in 2023-08-10T11:00:15.213 INFO:teuthology.orchestra.run.smithi107.stderr:36400000 of 50000000 tuples (72%) done (elapsed 513.39 s, remaining 191.82 s) 2023-08-10T11:00:16.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:15 smithi157 ceph-mon[129604]: pgmap v280: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 34 MiB/s wr, 112 op/s 2023-08-10T11:00:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:15 smithi107 ceph-mon[127953]: pgmap v280: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 34 MiB/s wr, 112 op/s 2023-08-10T11:00:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:15 smithi195 ceph-mon[129938]: pgmap v280: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 34 MiB/s wr, 112 op/s 2023-08-10T11:00:16.464 INFO:teuthology.orchestra.run.smithi107.stderr:36500000 of 50000000 tuples (73%) done (elapsed 514.64 s, remaining 190.35 s) 2023-08-10T11:00:18.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:17 smithi157 ceph-mon[129604]: pgmap v281: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 32 MiB/s wr, 103 op/s 2023-08-10T11:00:18.051 INFO:teuthology.orchestra.run.smithi107.stderr:36600000 of 50000000 tuples (73%) done (elapsed 516.23 s, remaining 189.00 s) 2023-08-10T11:00:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:17 smithi107 ceph-mon[127953]: pgmap v281: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 32 MiB/s wr, 103 op/s 2023-08-10T11:00:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:17 smithi195 ceph-mon[129938]: pgmap v281: 129 pgs: 129 active+clean; 7.9 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 32 MiB/s wr, 103 op/s 2023-08-10T11:00:19.311 INFO:teuthology.orchestra.run.smithi107.stderr:36700000 of 50000000 tuples (73%) done (elapsed 517.49 s, remaining 187.54 s) 2023-08-10T11:00:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:19 smithi107 ceph-mon[127953]: pgmap v282: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 83 op/s 2023-08-10T11:00:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:19 smithi195 ceph-mon[129938]: pgmap v282: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 83 op/s 2023-08-10T11:00:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:19 smithi157 ceph-mon[129604]: pgmap v282: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 83 op/s 2023-08-10T11:00:20.593 INFO:teuthology.orchestra.run.smithi107.stderr:36800000 of 50000000 tuples (73%) done (elapsed 518.77 s, remaining 186.08 s) 2023-08-10T11:00:21.850 INFO:teuthology.orchestra.run.smithi107.stderr:36900000 of 50000000 tuples (73%) done (elapsed 520.03 s, remaining 184.62 s) 2023-08-10T11:00:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:21 smithi107 ceph-mon[127953]: pgmap v283: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 83 op/s 2023-08-10T11:00:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:21 smithi195 ceph-mon[129938]: pgmap v283: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 83 op/s 2023-08-10T11:00:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:21 smithi157 ceph-mon[129604]: pgmap v283: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 83 op/s 2023-08-10T11:00:23.113 INFO:teuthology.orchestra.run.smithi107.stderr:37000000 of 50000000 tuples (74%) done (elapsed 521.29 s, remaining 183.16 s) 2023-08-10T11:00:23.315 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:00:23.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.568+0000 7fa54e39d700 1 -- 172.21.15.107:0/1287975217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa548106660 msgr2=0x7fa548106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:23.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.568+0000 7fa54e39d700 1 --2- 172.21.15.107:0/1287975217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa548106660 0x7fa548106a40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5440099c0 tx=0x7fa544009cd0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.568+0000 7fa54e39d700 1 -- 172.21.15.107:0/1287975217 shutdown_connections 2023-08-10T11:00:23.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.568+0000 7fa54e39d700 1 --2- 172.21.15.107:0/1287975217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa548106660 0x7fa548106a40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.568+0000 7fa54e39d700 1 --2- 172.21.15.107:0/1287975217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa548068290 0x7fa54810d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.570 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.568+0000 7fa54e39d700 1 --2- 172.21.15.107:0/1287975217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5480678d0 0x7fa548067d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.568+0000 7fa54e39d700 1 -- 172.21.15.107:0/1287975217 >> 172.21.15.107:0/1287975217 conn(0x7fa548074f30 msgr2=0x7fa548075340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:23.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.568+0000 7fa54e39d700 1 -- 172.21.15.107:0/1287975217 shutdown_connections 2023-08-10T11:00:23.571 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.568+0000 7fa54e39d700 1 -- 172.21.15.107:0/1287975217 wait complete. 2023-08-10T11:00:23.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.569+0000 7fa54e39d700 1 Processor -- start 2023-08-10T11:00:23.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.569+0000 7fa54e39d700 1 -- start start 2023-08-10T11:00:23.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54e39d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5480678d0 0x7fa5480ff780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54e39d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa548068290 0x7fa5480ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54e39d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa548106660 0x7fa5481a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54e39d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5481004f0 con 0x7fa5480678d0 2023-08-10T11:00:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54e39d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5481a4b10 con 0x7fa548068290 2023-08-10T11:00:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54e39d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5481a4c50 con 0x7fa548106660 2023-08-10T11:00:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54d39b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5480678d0 0x7fa5480ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54d39b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5480678d0 0x7fa5480ff780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44898/0 (socket says 172.21.15.107:44898) 2023-08-10T11:00:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54d39b700 1 -- 172.21.15.107:0/2715384878 learned_addr learned my addr 172.21.15.107:0/2715384878 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54db9c700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa548106660 0x7fa5481a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54cb9a700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa548068290 0x7fa5480ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54d39b700 1 -- 172.21.15.107:0/2715384878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa548106660 msgr2=0x7fa5481a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54d39b700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa548106660 0x7fa5481a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54d39b700 1 -- 172.21.15.107:0/2715384878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa548068290 msgr2=0x7fa5480ffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54d39b700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa548068290 0x7fa5480ffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.570+0000 7fa54d39b700 1 -- 172.21.15.107:0/2715384878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5440095f0 con 0x7fa5480678d0 2023-08-10T11:00:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.571+0000 7fa54d39b700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5480678d0 0x7fa5480ff780 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa544006010 tx=0x7fa54400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.571+0000 7fa53e7fc700 1 -- 172.21.15.107:0/2715384878 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54401d070 con 0x7fa5480678d0 2023-08-10T11:00:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.571+0000 7fa54e39d700 1 -- 172.21.15.107:0/2715384878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5481a4e50 con 0x7fa5480678d0 2023-08-10T11:00:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.571+0000 7fa53e7fc700 1 -- 172.21.15.107:0/2715384878 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa544005030 con 0x7fa5480678d0 2023-08-10T11:00:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.571+0000 7fa53e7fc700 1 -- 172.21.15.107:0/2715384878 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544004a00 con 0x7fa5480678d0 2023-08-10T11:00:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.571+0000 7fa54e39d700 1 -- 172.21.15.107:0/2715384878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5481a5270 con 0x7fa5480678d0 2023-08-10T11:00:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.574+0000 7fa53e7fc700 1 -- 172.21.15.107:0/2715384878 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fa5440051a0 con 0x7fa5480678d0 2023-08-10T11:00:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.576+0000 7fa562ff1b80 1 Processor -- start 2023-08-10T11:00:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.576+0000 7fa562ff1b80 1 -- start start 2023-08-10T11:00:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.576+0000 7fa53e7fc700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa5340a1360 0x7fa5340a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.576+0000 7fa53e7fc700 1 -- 172.21.15.107:0/2715384878 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fa5440cdcd0 con 0x7fa5480678d0 2023-08-10T11:00:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.576+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629777890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.576+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b62977bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b62977c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6296f2dc0 con 0x55b62977c290 2023-08-10T11:00:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6296cf590 con 0x55b629777dd0 2023-08-10T11:00:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6296cceb0 con 0x55b6297774b0 2023-08-10T11:00:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54db9c700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa5340a1360 0x7fa5340a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54db9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b62977c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54db9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b62977c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44908/0 (socket says 172.21.15.107:44908) 2023-08-10T11:00:23.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54db9c700 1 -- 172.21.15.107:0/575393496 learned_addr learned my addr 172.21.15.107:0/575393496 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:23.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54cb9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b62977bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54d39b700 1 --2- 172.21.15.107:0/575393496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629777890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54db9c700 1 -- 172.21.15.107:0/575393496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 msgr2=0x55b629777890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:23.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54db9c700 1 --2- 172.21.15.107:0/575393496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629777890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54db9c700 1 -- 172.21.15.107:0/575393496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 msgr2=0x55b62977bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.577+0000 7fa54db9c700 1 --2- 172.21.15.107:0/575393496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b62977bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.578+0000 7fa54db9c700 1 -- 172.21.15.107:0/575393496 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b629549630 con 0x55b62977c290 2023-08-10T11:00:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.578+0000 7fa54db9c700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa5340a1360 0x7fa5340a3820 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa540008c60 tx=0x7fa540009350 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.578+0000 7fa54db9c700 1 --2- 172.21.15.107:0/575393496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b62977c6f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa54001aa50 tx=0x7fa54001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf6a7aeb71d828c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.578+0000 7fa5337fe700 1 -- 172.21.15.107:0/575393496 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54000e070 con 0x55b62977c290 2023-08-10T11:00:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.578+0000 7fa5337fe700 1 -- 172.21.15.107:0/575393496 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa54000f040 con 0x55b62977c290 2023-08-10T11:00:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.578+0000 7fa5337fe700 1 -- 172.21.15.107:0/575393496 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54001b970 con 0x55b62977c290 2023-08-10T11:00:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.579+0000 7fa562ff1b80 1 -- 172.21.15.107:0/575393496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 msgr2=0x55b62977c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:23.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.579+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/575393496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b62977c6f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa54001aa50 tx=0x7fa54001d000 comp rx=0 tx=0).stop 2023-08-10T11:00:23.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.579+0000 7fa562ff1b80 1 -- 172.21.15.107:0/575393496 shutdown_connections 2023-08-10T11:00:23.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.579+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/575393496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b62977c6f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.579+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/575393496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629777890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.579+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/575393496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b62977bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.579+0000 7fa562ff1b80 1 -- 172.21.15.107:0/575393496 >> 172.21.15.107:0/575393496 conn(0x55b6296d4cd0 msgr2=0x55b629772750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:23.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.579+0000 7fa562ff1b80 1 -- 172.21.15.107:0/575393496 shutdown_connections 2023-08-10T11:00:23.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.579+0000 7fa562ff1b80 1 -- 172.21.15.107:0/575393496 wait complete. 2023-08-10T11:00:23.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.580+0000 7fa562ff1b80 1 -- start start 2023-08-10T11:00:23.584 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.580+0000 7fa562ff1b80 1 Processor -- start 2023-08-10T11:00:23.587 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.580+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6297774b0 0x55b629783b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.580+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629780d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.580+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b62977c290 0x55b629781490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6296c87a0 con 0x55b6297774b0 2023-08-10T11:00:23.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b629667ac0 con 0x55b629777dd0 2023-08-10T11:00:23.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6296677c0 con 0x55b62977c290 2023-08-10T11:00:23.588 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa562ff1b80 10 client.0 _ll_register_callbacks cb 0x55b629665680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:00:23.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54d39b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6297774b0 0x55b629783b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54db9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b62977c290 0x55b629781490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54db9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b62977c290 0x55b629781490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:53438/0 (socket says 172.21.15.107:53438) 2023-08-10T11:00:23.589 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54db9c700 1 -- 172.21.15.107:0/1288332855 learned_addr learned my addr 172.21.15.107:0/1288332855 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54cb9a700 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629780d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54d39b700 1 -- 172.21.15.107:0/1288332855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b62977c290 msgr2=0x55b629781490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54d39b700 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b62977c290 0x55b629781490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54d39b700 1 -- 172.21.15.107:0/1288332855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 msgr2=0x55b629780d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54d39b700 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629780d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54d39b700 1 -- 172.21.15.107:0/1288332855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540008da0 con 0x55b6297774b0 2023-08-10T11:00:23.590 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.581+0000 7fa54db9c700 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b62977c290 0x55b629781490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:00:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.582+0000 7fa54d39b700 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6297774b0 0x55b629783b40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa5440cb070 tx=0x7fa54409abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dddaf2f12bc5fb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.582+0000 7fa530ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:00:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.582+0000 7fa530ff9700 1 -- 172.21.15.107:0/1288332855 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54409aee0 con 0x55b6297774b0 2023-08-10T11:00:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.582+0000 7fa562ff1b80 1 -- 172.21.15.107:0/1288332855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b62976a470 con 0x55b6297774b0 2023-08-10T11:00:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.582+0000 7fa530ff9700 1 -- 172.21.15.107:0/1288332855 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fa544099f70 con 0x55b6297774b0 2023-08-10T11:00:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.582+0000 7fa530ff9700 1 -- 172.21.15.107:0/1288332855 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5440056b0 con 0x55b6297774b0 2023-08-10T11:00:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.582+0000 7fa562ff1b80 10 client.16653 fetch_fsmap learned FSMap version 46 2023-08-10T11:00:23.591 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.582+0000 7fa562ff1b80 1 -- 172.21.15.107:0/1288332855 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55b6294f5de0 con 0x55b6297774b0 2023-08-10T11:00:23.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.582+0000 7fa530ff9700 1 -- 172.21.15.107:0/1288332855 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b62976a470 con 0x55b6297774b0 2023-08-10T11:00:23.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.583+0000 7fa530ff9700 1 -- 172.21.15.107:0/1288332855 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 46) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa544096870 con 0x55b6297774b0 2023-08-10T11:00:23.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.583+0000 7fa562ff1b80 10 client.16653 fetch_fsmap finished waiting for FSMap version 46 2023-08-10T11:00:23.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.583+0000 7fa562ff1b80 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:00:23.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.583+0000 7fa562ff1b80 20 client.16653 populate_metadata read hostname 'smithi107' 2023-08-10T11:00:23.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.583+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b6297997c0 0x55b62979bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.592 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.583+0000 7fa562ff1b80 4 client.16653 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:00:23.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.583+0000 7fa562ff1b80 1 -- 172.21.15.107:0/1288332855 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6297469d0 con 0x55b6297997c0 2023-08-10T11:00:23.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.583+0000 7fa54cb9a700 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b6297997c0 0x55b62979bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.584+0000 7fa54cb9a700 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b6297997c0 0x55b62979bbb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29b3b3b502e83f65 server_cookie=e2c9bed74afce9e9 in_seq=0 out_seq=0 2023-08-10T11:00:23.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.584+0000 7fa530ff9700 10 client.16653 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:00:23.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa530ff9700 1 -- 172.21.15.107:0/1288332855 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b6297469d0 con 0x55b6297997c0 2023-08-10T11:00:23.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa530ff9700 10 client.16653 handle_command_reply: tid=0 2023-08-10T11:00:23.593 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 client.16653 shutdown 2023-08-10T11:00:23.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 -- 172.21.15.107:0/1288332855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6297774b0 msgr2=0x55b629783b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:23.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6297774b0 0x55b629783b40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa5440cb070 tx=0x7fa54409abc0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 -- 172.21.15.107:0/1288332855 shutdown_connections 2023-08-10T11:00:23.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b6297997c0 0x55b62979bbb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b62977c290 0x55b629781490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6297774b0 0x55b629783b40 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.594 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/1288332855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629780d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa530ff9700 0 client.16653 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:00:23.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 -- 172.21.15.107:0/1288332855 >> 172.21.15.107:0/1288332855 conn(0x55b6296d4cd0 msgr2=0x55b62977d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:23.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 -- 172.21.15.107:0/1288332855 shutdown_connections 2023-08-10T11:00:23.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.585+0000 7fa562ff1b80 1 -- 172.21.15.107:0/1288332855 wait complete. 2023-08-10T11:00:23.595 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.586+0000 7fa562ff1b80 20 client.16653 trim_cache size 0 max 16384 2023-08-10T11:00:23.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.614+0000 7fa562ff1b80 1 Processor -- start 2023-08-10T11:00:23.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa562ff1b80 1 -- start start 2023-08-10T11:00:23.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629790c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629783670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b629772210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62954b920 con 0x55b62977c290 2023-08-10T11:00:23.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6297785e0 con 0x55b629777dd0 2023-08-10T11:00:23.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b62976ca80 con 0x55b6297774b0 2023-08-10T11:00:23.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa54d39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629790c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa54cb9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629783670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa54d39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629790c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:53448/0 (socket says 172.21.15.107:53448) 2023-08-10T11:00:23.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa54d39b700 1 -- 172.21.15.107:0/898179703 learned_addr learned my addr 172.21.15.107:0/898179703 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:23.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.615+0000 7fa54db9c700 1 --2- 172.21.15.107:0/898179703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b629772210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.616+0000 7fa54d39b700 1 -- 172.21.15.107:0/898179703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 msgr2=0x55b629783670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.616+0000 7fa54d39b700 1 --2- 172.21.15.107:0/898179703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629783670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.616+0000 7fa54d39b700 1 -- 172.21.15.107:0/898179703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 msgr2=0x55b629772210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.616+0000 7fa54d39b700 1 --2- 172.21.15.107:0/898179703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b629772210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.616+0000 7fa54d39b700 1 -- 172.21.15.107:0/898179703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6294dec60 con 0x55b6297774b0 2023-08-10T11:00:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.616+0000 7fa54d39b700 1 --2- 172.21.15.107:0/898179703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629790c40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa54409aa10 tx=0x7fa544005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e25406266b7b69b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.616+0000 7fa533fff700 1 -- 172.21.15.107:0/898179703 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5440056b0 con 0x55b6297774b0 2023-08-10T11:00:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.617+0000 7fa533fff700 1 -- 172.21.15.107:0/898179703 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa54409a850 con 0x55b6297774b0 2023-08-10T11:00:23.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.617+0000 7fa533fff700 1 -- 172.21.15.107:0/898179703 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54409ace0 con 0x55b6297774b0 2023-08-10T11:00:23.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.617+0000 7fa562ff1b80 1 -- 172.21.15.107:0/898179703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 msgr2=0x55b629790c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:23.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.617+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/898179703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629790c40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa54409aa10 tx=0x7fa544005c00 comp rx=0 tx=0).stop 2023-08-10T11:00:23.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.618+0000 7fa562ff1b80 1 -- 172.21.15.107:0/898179703 shutdown_connections 2023-08-10T11:00:23.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.618+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/898179703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b629772210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.618+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/898179703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629790c40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.618+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/898179703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629783670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.618+0000 7fa562ff1b80 1 -- 172.21.15.107:0/898179703 >> 172.21.15.107:0/898179703 conn(0x55b6296d4cd0 msgr2=0x55b6297710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:23.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.618+0000 7fa562ff1b80 1 -- 172.21.15.107:0/898179703 shutdown_connections 2023-08-10T11:00:23.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.618+0000 7fa562ff1b80 1 -- 172.21.15.107:0/898179703 wait complete. 2023-08-10T11:00:23.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.619+0000 7fa562ff1b80 1 -- start start 2023-08-10T11:00:23.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.619+0000 7fa562ff1b80 1 Processor -- start 2023-08-10T11:00:23.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.620+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629783750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.620+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629782660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.620+0000 7fa562ff1b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b629782ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.620+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6297830e0 con 0x55b62977c290 2023-08-10T11:00:23.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.620+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b629783250 con 0x55b629777dd0 2023-08-10T11:00:23.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.620+0000 7fa562ff1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b629783410 con 0x55b6297774b0 2023-08-10T11:00:23.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.620+0000 7fa562ff1b80 10 client.0 _ll_register_callbacks cb 0x55b629665680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:00:23.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54d39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629783750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54d39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629783750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:53462/0 (socket says 172.21.15.107:53462) 2023-08-10T11:00:23.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54d39b700 1 -- 172.21.15.107:0/2872521337 learned_addr learned my addr 172.21.15.107:0/2872521337 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:23.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54cb9a700 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629782660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54db9c700 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b629782ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54d39b700 1 -- 172.21.15.107:0/2872521337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 msgr2=0x55b629782660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:23.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54d39b700 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629782660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54d39b700 1 -- 172.21.15.107:0/2872521337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 msgr2=0x55b629782ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54d39b700 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b629782ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54d39b700 1 -- 172.21.15.107:0/2872521337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6294f5de0 con 0x55b6297774b0 2023-08-10T11:00:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54cb9a700 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629782660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:00:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa54d39b700 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629783750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa54400b580 tx=0x7fa544096aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f45ea769130aec26 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.621+0000 7fa530ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:00:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.622+0000 7fa530ff9700 1 -- 172.21.15.107:0/2872521337 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54409aee0 con 0x55b6297774b0 2023-08-10T11:00:23.625 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.622+0000 7fa530ff9700 1 -- 172.21.15.107:0/2872521337 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fa544004b60 con 0x55b6297774b0 2023-08-10T11:00:23.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.622+0000 7fa562ff1b80 1 -- 172.21.15.107:0/2872521337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b629772060 con 0x55b6297774b0 2023-08-10T11:00:23.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.622+0000 7fa530ff9700 1 -- 172.21.15.107:0/2872521337 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5440056b0 con 0x55b6297774b0 2023-08-10T11:00:23.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.622+0000 7fa562ff1b80 10 client.26356 fetch_fsmap learned FSMap version 46 2023-08-10T11:00:23.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.622+0000 7fa562ff1b80 1 -- 172.21.15.107:0/2872521337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55b62951c250 con 0x55b6297774b0 2023-08-10T11:00:23.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.623+0000 7fa530ff9700 1 -- 172.21.15.107:0/2872521337 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b629772060 con 0x55b6297774b0 2023-08-10T11:00:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.623+0000 7fa530ff9700 1 -- 172.21.15.107:0/2872521337 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 46) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa5440aed20 con 0x55b6297774b0 2023-08-10T11:00:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.623+0000 7fa562ff1b80 10 client.26356 fetch_fsmap finished waiting for FSMap version 46 2023-08-10T11:00:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.623+0000 7fa562ff1b80 10 client.26356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:00:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.623+0000 7fa562ff1b80 20 client.26356 populate_metadata read hostname 'smithi107' 2023-08-10T11:00:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.623+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b6297ee270 0x55b6297f0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.623+0000 7fa562ff1b80 4 client.26356 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:00:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.623+0000 7fa562ff1b80 1 -- 172.21.15.107:0/2872521337 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7fa54000f040 con 0x55b6297ee270 2023-08-10T11:00:23.628 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.624+0000 7fa54cb9a700 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b6297ee270 0x55b6297f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:23.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.625+0000 7fa54cb9a700 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b6297ee270 0x55b6297f0660 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38ae36f5087bff42 server_cookie=d43b2cb720fffc15 in_seq=0 out_seq=0 2023-08-10T11:00:23.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.625+0000 7fa530ff9700 10 client.26356 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:00:23.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.625+0000 7fa530ff9700 1 -- 172.21.15.107:0/2872521337 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7fa54000f040 con 0x55b6297ee270 2023-08-10T11:00:23.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.625+0000 7fa530ff9700 10 client.26356 handle_command_reply: tid=0 2023-08-10T11:00:23.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.625+0000 7fa562ff1b80 1 client.26356 shutdown 2023-08-10T11:00:23.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.625+0000 7fa562ff1b80 1 -- 172.21.15.107:0/2872521337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 msgr2=0x55b629783750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:23.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.625+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629783750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa54400b580 tx=0x7fa544096aa0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.625+0000 7fa562ff1b80 1 -- 172.21.15.107:0/2872521337 shutdown_connections 2023-08-10T11:00:23.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.626+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b6297ee270 0x55b6297f0660 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.626+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b62977c290 0x55b629782ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.626+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b6297774b0 0x55b629783750 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.626+0000 7fa562ff1b80 1 --2- 172.21.15.107:0/2872521337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b629777dd0 0x55b629782660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.626+0000 7fa562ff1b80 1 -- 172.21.15.107:0/2872521337 >> 172.21.15.107:0/2872521337 conn(0x55b6296d4cd0 msgr2=0x55b6297721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:23.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.626+0000 7fa530ff9700 0 client.26356 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:00:23.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.626+0000 7fa562ff1b80 1 -- 172.21.15.107:0/2872521337 shutdown_connections 2023-08-10T11:00:23.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.626+0000 7fa562ff1b80 1 -- 172.21.15.107:0/2872521337 wait complete. 2023-08-10T11:00:23.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.626+0000 7fa562ff1b80 20 client.26356 trim_cache size 0 max 16384 2023-08-10T11:00:23.631 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:00:23.632 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:00:23.632 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:00:23.632 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:00:23.632 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:00:23.632 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:00:23.632 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:00:23.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:00:23.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:00:23.633 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:00:23.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 -- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa5340a1360 msgr2=0x7fa5340a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:23.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa5340a1360 0x7fa5340a3820 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa540008c60 tx=0x7fa540009350 comp rx=0 tx=0).stop 2023-08-10T11:00:23.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 -- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5480678d0 msgr2=0x7fa5480ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5480678d0 0x7fa5480ff780 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa544006010 tx=0x7fa54400f670 comp rx=0 tx=0).stop 2023-08-10T11:00:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 -- 172.21.15.107:0/2715384878 shutdown_connections 2023-08-10T11:00:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa548106660 0x7fa5481a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa5480678d0 0x7fa5480ff780 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa5340a1360 0x7fa5340a3820 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 --2- 172.21.15.107:0/2715384878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa548068290 0x7fa5480ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:23.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.627+0000 7fa54e39d700 1 -- 172.21.15.107:0/2715384878 >> 172.21.15.107:0/2715384878 conn(0x7fa548074f30 msgr2=0x7fa5480fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:23.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.628+0000 7fa54e39d700 1 -- 172.21.15.107:0/2715384878 shutdown_connections 2023-08-10T11:00:23.635 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:23.628+0000 7fa54e39d700 1 -- 172.21.15.107:0/2715384878 wait complete. 2023-08-10T11:00:23.655 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:00:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:23 smithi107 ceph-mon[127953]: pgmap v284: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 83 op/s 2023-08-10T11:00:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:23 smithi195 ceph-mon[129938]: pgmap v284: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 83 op/s 2023-08-10T11:00:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:23 smithi157 ceph-mon[129604]: pgmap v284: 129 pgs: 129 active+clean; 8.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 83 op/s 2023-08-10T11:00:24.386 INFO:teuthology.orchestra.run.smithi107.stderr:37100000 of 50000000 tuples (74%) done (elapsed 522.56 s, remaining 181.70 s) 2023-08-10T11:00:25.708 INFO:teuthology.orchestra.run.smithi107.stderr:37200000 of 50000000 tuples (74%) done (elapsed 523.89 s, remaining 180.26 s) 2023-08-10T11:00:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:25 smithi107 ceph-mon[127953]: pgmap v285: 129 pgs: 129 active+clean; 8.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 65 op/s 2023-08-10T11:00:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:25 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:00:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:25 smithi195 ceph-mon[129938]: pgmap v285: 129 pgs: 129 active+clean; 8.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 65 op/s 2023-08-10T11:00:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:25 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:00:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:25 smithi157 ceph-mon[129604]: pgmap v285: 129 pgs: 129 active+clean; 8.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 MiB/s wr, 65 op/s 2023-08-10T11:00:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:25 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:00:26.914 INFO:teuthology.orchestra.run.smithi107.stderr:37300000 of 50000000 tuples (74%) done (elapsed 525.09 s, remaining 178.78 s) 2023-08-10T11:00:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:27 smithi107 ceph-mon[127953]: pgmap v286: 129 pgs: 129 active+clean; 8.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 58 op/s 2023-08-10T11:00:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:27 smithi195 ceph-mon[129938]: pgmap v286: 129 pgs: 129 active+clean; 8.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 58 op/s 2023-08-10T11:00:28.200 INFO:teuthology.orchestra.run.smithi107.stderr:37400000 of 50000000 tuples (74%) done (elapsed 526.38 s, remaining 177.34 s) 2023-08-10T11:00:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:27 smithi157 ceph-mon[129604]: pgmap v286: 129 pgs: 129 active+clean; 8.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 58 op/s 2023-08-10T11:00:30.027 INFO:teuthology.orchestra.run.smithi107.stderr:37500000 of 50000000 tuples (75%) done (elapsed 528.20 s, remaining 176.07 s) 2023-08-10T11:00:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:29 smithi107 ceph-mon[127953]: pgmap v287: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 84 op/s 2023-08-10T11:00:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:29 smithi195 ceph-mon[129938]: pgmap v287: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 84 op/s 2023-08-10T11:00:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:29 smithi157 ceph-mon[129604]: pgmap v287: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 84 op/s 2023-08-10T11:00:31.303 INFO:teuthology.orchestra.run.smithi107.stderr:37600000 of 50000000 tuples (75%) done (elapsed 529.48 s, remaining 174.62 s) 2023-08-10T11:00:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:31 smithi107 ceph-mon[127953]: pgmap v288: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T11:00:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:31 smithi195 ceph-mon[129938]: pgmap v288: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T11:00:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:31 smithi157 ceph-mon[129604]: pgmap v288: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T11:00:32.638 INFO:teuthology.orchestra.run.smithi107.stderr:37700000 of 50000000 tuples (75%) done (elapsed 530.82 s, remaining 173.18 s) 2023-08-10T11:00:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:32 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:00:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:32 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:00:33.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:32 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:00:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:33 smithi107 ceph-mon[127953]: pgmap v289: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T11:00:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:33 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:00:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:33 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:00:34.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:33 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:00:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:33 smithi195 ceph-mon[129938]: pgmap v289: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T11:00:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:33 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:00:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:33 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:00:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:33 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:00:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:33 smithi157 ceph-mon[129604]: pgmap v289: 129 pgs: 129 active+clean; 8.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 51 op/s 2023-08-10T11:00:34.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:33 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:00:34.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:33 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:00:34.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:33 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:00:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:35 smithi107 ceph-mon[127953]: pgmap v290: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 35 MiB/s wr, 87 op/s 2023-08-10T11:00:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:35 smithi195 ceph-mon[129938]: pgmap v290: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 35 MiB/s wr, 87 op/s 2023-08-10T11:00:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:35 smithi157 ceph-mon[129604]: pgmap v290: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 35 MiB/s wr, 87 op/s 2023-08-10T11:00:37.571 INFO:teuthology.orchestra.run.smithi107.stderr:37800000 of 50000000 tuples (75%) done (elapsed 535.75 s, remaining 172.91 s) 2023-08-10T11:00:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:37 smithi107 ceph-mon[127953]: pgmap v291: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:00:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:37 smithi195 ceph-mon[129938]: pgmap v291: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:00:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:37 smithi157 ceph-mon[129604]: pgmap v291: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:00:38.811 INFO:teuthology.orchestra.run.smithi107.stderr:37900000 of 50000000 tuples (75%) done (elapsed 536.99 s, remaining 171.44 s) 2023-08-10T11:00:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:39 smithi195 ceph-mon[129938]: pgmap v292: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 27 MiB/s wr, 76 op/s 2023-08-10T11:00:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:39 smithi157 ceph-mon[129604]: pgmap v292: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 27 MiB/s wr, 76 op/s 2023-08-10T11:00:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:39 smithi107 ceph-mon[127953]: pgmap v292: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 27 MiB/s wr, 76 op/s 2023-08-10T11:00:40.446 INFO:teuthology.orchestra.run.smithi107.stderr:38000000 of 50000000 tuples (76%) done (elapsed 538.62 s, remaining 170.09 s) 2023-08-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stderr:38100000 of 50000000 tuples (76%) done (elapsed 539.85 s, remaining 168.61 s) 2023-08-10T11:00:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:41 smithi195 ceph-mon[129938]: pgmap v293: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 15 MiB/s wr, 50 op/s 2023-08-10T11:00:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:41 smithi157 ceph-mon[129604]: pgmap v293: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 15 MiB/s wr, 50 op/s 2023-08-10T11:00:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:41 smithi107 ceph-mon[127953]: pgmap v293: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 15 MiB/s wr, 50 op/s 2023-08-10T11:00:43.384 INFO:teuthology.orchestra.run.smithi107.stderr:38200000 of 50000000 tuples (76%) done (elapsed 541.56 s, remaining 167.29 s) 2023-08-10T11:00:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:43 smithi195 ceph-mon[129938]: pgmap v294: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 15 MiB/s wr, 50 op/s 2023-08-10T11:00:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:43 smithi157 ceph-mon[129604]: pgmap v294: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 15 MiB/s wr, 50 op/s 2023-08-10T11:00:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:43 smithi107 ceph-mon[127953]: pgmap v294: 129 pgs: 129 active+clean; 8.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 15 MiB/s wr, 50 op/s 2023-08-10T11:00:44.660 INFO:teuthology.orchestra.run.smithi107.stderr:38300000 of 50000000 tuples (76%) done (elapsed 542.84 s, remaining 165.83 s) 2023-08-10T11:00:45.904 INFO:teuthology.orchestra.run.smithi107.stderr:38400000 of 50000000 tuples (76%) done (elapsed 544.08 s, remaining 164.36 s) 2023-08-10T11:00:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:45 smithi195 ceph-mon[129938]: pgmap v295: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 25 MiB/s wr, 81 op/s 2023-08-10T11:00:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:45 smithi157 ceph-mon[129604]: pgmap v295: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 25 MiB/s wr, 81 op/s 2023-08-10T11:00:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:45 smithi107 ceph-mon[127953]: pgmap v295: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 25 MiB/s wr, 81 op/s 2023-08-10T11:00:47.307 INFO:teuthology.orchestra.run.smithi107.stderr:38500000 of 50000000 tuples (77%) done (elapsed 545.48 s, remaining 162.94 s) 2023-08-10T11:00:48.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:47 smithi195 ceph-mon[129938]: pgmap v296: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 14 MiB/s wr, 45 op/s 2023-08-10T11:00:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:47 smithi157 ceph-mon[129604]: pgmap v296: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 14 MiB/s wr, 45 op/s 2023-08-10T11:00:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:47 smithi107 ceph-mon[127953]: pgmap v296: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 14 MiB/s wr, 45 op/s 2023-08-10T11:00:48.599 INFO:teuthology.orchestra.run.smithi107.stderr:38600000 of 50000000 tuples (77%) done (elapsed 546.78 s, remaining 161.48 s) 2023-08-10T11:00:50.020 INFO:teuthology.orchestra.run.smithi107.stderr:38700000 of 50000000 tuples (77%) done (elapsed 548.20 s, remaining 160.07 s) 2023-08-10T11:00:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:49 smithi195 ceph-mon[129938]: pgmap v297: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 25 MiB/s wr, 83 op/s 2023-08-10T11:00:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:49 smithi157 ceph-mon[129604]: pgmap v297: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 25 MiB/s wr, 83 op/s 2023-08-10T11:00:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:49 smithi107 ceph-mon[127953]: pgmap v297: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 25 MiB/s wr, 83 op/s 2023-08-10T11:00:51.279 INFO:teuthology.orchestra.run.smithi107.stderr:38800000 of 50000000 tuples (77%) done (elapsed 549.46 s, remaining 158.61 s) 2023-08-10T11:00:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:51 smithi195 ceph-mon[129938]: pgmap v298: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-08-10T11:00:52.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:51 smithi157 ceph-mon[129604]: pgmap v298: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-08-10T11:00:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:51 smithi107 ceph-mon[127953]: pgmap v298: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-08-10T11:00:52.633 INFO:teuthology.orchestra.run.smithi107.stderr:38900000 of 50000000 tuples (77%) done (elapsed 550.81 s, remaining 157.17 s) 2023-08-10T11:00:53.656 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:00:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.892+0000 7ff04cbff700 1 -- 172.21.15.107:0/2452347499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff048101080 msgr2=0x7ff04810d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.892+0000 7ff04cbff700 1 --2- 172.21.15.107:0/2452347499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff048101080 0x7ff04810d590 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff040009990 tx=0x7ff040009ca0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.893+0000 7ff04cbff700 1 -- 172.21.15.107:0/2452347499 shutdown_connections 2023-08-10T11:00:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.893+0000 7ff04cbff700 1 --2- 172.21.15.107:0/2452347499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0481066d0 0x7ff048106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.893+0000 7ff04cbff700 1 --2- 172.21.15.107:0/2452347499 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff048101080 0x7ff04810d590 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.893+0000 7ff04cbff700 1 --2- 172.21.15.107:0/2452347499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0481006c0 0x7ff048100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.893+0000 7ff04cbff700 1 -- 172.21.15.107:0/2452347499 >> 172.21.15.107:0/2452347499 conn(0x7ff0480fc1f0 msgr2=0x7ff0480fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.893+0000 7ff04cbff700 1 -- 172.21.15.107:0/2452347499 shutdown_connections 2023-08-10T11:00:53.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.893+0000 7ff04cbff700 1 -- 172.21.15.107:0/2452347499 wait complete. 2023-08-10T11:00:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.894+0000 7ff04cbff700 1 Processor -- start 2023-08-10T11:00:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.894+0000 7ff04cbff700 1 -- start start 2023-08-10T11:00:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff04cbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0481006c0 0x7ff0481a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.896 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff04cbff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff048101080 0x7ff0481a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff04cbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0481066d0 0x7ff04810b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff04cbff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04810b860 con 0x7ff048101080 2023-08-10T11:00:53.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff04cbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04810b9d0 con 0x7ff0481006c0 2023-08-10T11:00:53.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff04cbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04810bb90 con 0x7ff0481066d0 2023-08-10T11:00:53.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff04659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0481006c0 0x7ff0481a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff04659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0481006c0 0x7ff0481a1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57706/0 (socket says 172.21.15.107:57706) 2023-08-10T11:00:53.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff04659c700 1 -- 172.21.15.107:0/1823778325 learned_addr learned my addr 172.21.15.107:0/1823778325 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:53.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.895+0000 7ff046d9d700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0481066d0 0x7ff04810b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.896+0000 7ff045d9b700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff048101080 0x7ff0481a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.896+0000 7ff046d9d700 1 -- 172.21.15.107:0/1823778325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0481006c0 msgr2=0x7ff0481a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.896+0000 7ff046d9d700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0481006c0 0x7ff0481a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.896+0000 7ff046d9d700 1 -- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff048101080 msgr2=0x7ff0481a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.896+0000 7ff046d9d700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff048101080 0x7ff0481a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.896+0000 7ff046d9d700 1 -- 172.21.15.107:0/1823778325 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400095f0 con 0x7ff0481066d0 2023-08-10T11:00:53.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.896+0000 7ff046d9d700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0481066d0 0x7ff04810b160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff040005910 tx=0x7ff040005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.897+0000 7ff0377fe700 1 -- 172.21.15.107:0/1823778325 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04001d070 con 0x7ff0481066d0 2023-08-10T11:00:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.897+0000 7ff0377fe700 1 -- 172.21.15.107:0/1823778325 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff040022470 con 0x7ff0481066d0 2023-08-10T11:00:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.897+0000 7ff04cbff700 1 -- 172.21.15.107:0/1823778325 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04810be10 con 0x7ff0481066d0 2023-08-10T11:00:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.897+0000 7ff0377fe700 1 -- 172.21.15.107:0/1823778325 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040017650 con 0x7ff0481066d0 2023-08-10T11:00:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.897+0000 7ff04cbff700 1 -- 172.21.15.107:0/1823778325 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0481a9a90 con 0x7ff0481066d0 2023-08-10T11:00:53.900 INFO:teuthology.orchestra.run.smithi107.stderr:39000000 of 50000000 tuples (78%) done (elapsed 552.08 s, remaining 155.71 s) 2023-08-10T11:00:53.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.901+0000 7ff0377fe700 1 -- 172.21.15.107:0/1823778325 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff0400225e0 con 0x7ff0481066d0 2023-08-10T11:00:53.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.903+0000 7ff060597b80 1 Processor -- start 2023-08-10T11:00:53.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.903+0000 7ff060597b80 1 -- start start 2023-08-10T11:00:53.904 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.903+0000 7ff0377fe700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0300a12c0 0x7ff0300a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.903+0000 7ff060597b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.903+0000 7ff0377fe700 1 -- 172.21.15.107:0/1823778325 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 9374+0+0 (secure 0 0 0) 0x7ff0400ce3d0 con 0x7ff0481066d0 2023-08-10T11:00:53.905 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.903+0000 7ff060597b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.903+0000 7ff060597b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d0800 0x55e9971d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.903+0000 7ff060597b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99714bdc0 con 0x55e9971d6870 2023-08-10T11:00:53.906 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff060597b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e997128590 con 0x55e9971d0800 2023-08-10T11:00:53.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff060597b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e997125eb0 con 0x55e9971d5f50 2023-08-10T11:00:53.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff045d9b700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0300a12c0 0x7ff0300a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff045d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff045d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47370/0 (socket says 172.21.15.107:47370) 2023-08-10T11:00:53.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff045d9b700 1 -- 172.21.15.107:0/1611403904 learned_addr learned my addr 172.21.15.107:0/1611403904 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:53.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff04659c700 1 --2- 172.21.15.107:0/1611403904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff046d9d700 1 --2- 172.21.15.107:0/1611403904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d0800 0x55e9971d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.907 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff045d9b700 1 -- 172.21.15.107:0/1611403904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 msgr2=0x55e9971d6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:53.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff045d9b700 1 --2- 172.21.15.107:0/1611403904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff045d9b700 1 -- 172.21.15.107:0/1611403904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d0800 msgr2=0x55e9971d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:53.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff045d9b700 1 --2- 172.21.15.107:0/1611403904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d0800 0x55e9971d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.904+0000 7ff045d9b700 1 -- 172.21.15.107:0/1611403904 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e996fa2630 con 0x55e9971d6870 2023-08-10T11:00:53.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.905+0000 7ff045d9b700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0300a12c0 0x7ff0300a3780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff03c011a30 tx=0x7ff03c009c70 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:53.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.905+0000 7ff045d9b700 1 --2- 172.21.15.107:0/1611403904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d02c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009ea0 tx=0x7ff03c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ef34a54b185c0a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:53.908 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.905+0000 7ff034ff9700 1 -- 172.21.15.107:0/1611403904 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c011330 con 0x55e9971d6870 2023-08-10T11:00:53.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.905+0000 7ff034ff9700 1 -- 172.21.15.107:0/1611403904 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff03c004830 con 0x55e9971d6870 2023-08-10T11:00:53.909 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.905+0000 7ff034ff9700 1 -- 172.21.15.107:0/1611403904 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c005260 con 0x55e9971d6870 2023-08-10T11:00:53.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 -- 172.21.15.107:0/1611403904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 msgr2=0x55e9971d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:53.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 --2- 172.21.15.107:0/1611403904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d02c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009ea0 tx=0x7ff03c01d000 comp rx=0 tx=0).stop 2023-08-10T11:00:53.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 -- 172.21.15.107:0/1611403904 shutdown_connections 2023-08-10T11:00:53.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 --2- 172.21.15.107:0/1611403904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d0800 0x55e9971d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 --2- 172.21.15.107:0/1611403904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 --2- 172.21.15.107:0/1611403904 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d02c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.911 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 -- 172.21.15.107:0/1611403904 >> 172.21.15.107:0/1611403904 conn(0x55e99712dcd0 msgr2=0x55e9971cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:53.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 -- 172.21.15.107:0/1611403904 shutdown_connections 2023-08-10T11:00:53.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 -- 172.21.15.107:0/1611403904 wait complete. 2023-08-10T11:00:53.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.906+0000 7ff060597b80 1 -- start start 2023-08-10T11:00:53.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.907+0000 7ff060597b80 1 Processor -- start 2023-08-10T11:00:53.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.907+0000 7ff060597b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971dc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.907+0000 7ff060597b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.912 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.907+0000 7ff060597b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 0x55e9971da190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.907+0000 7ff060597b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9971217a0 con 0x55e9971d0800 2023-08-10T11:00:53.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.907+0000 7ff060597b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9970c0ac0 con 0x55e9971d6870 2023-08-10T11:00:53.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.907+0000 7ff060597b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9970c07c0 con 0x55e9971d5f50 2023-08-10T11:00:53.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.907+0000 7ff060597b80 10 client.0 _ll_register_callbacks cb 0x55e9970be680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:00:53.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff04659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971dc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff045d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff045d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:60304/0 (socket says 172.21.15.107:60304) 2023-08-10T11:00:53.913 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff045d9b700 1 -- 172.21.15.107:0/3349846175 learned_addr learned my addr 172.21.15.107:0/3349846175 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:53.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff046d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 0x55e9971da190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff045d9b700 1 -- 172.21.15.107:0/3349846175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 msgr2=0x55e9971da190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:53.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff045d9b700 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 0x55e9971da190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff045d9b700 1 -- 172.21.15.107:0/3349846175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 msgr2=0x55e9971dc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:53.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff045d9b700 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971dc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff045d9b700 1 -- 172.21.15.107:0/3349846175 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c019040 con 0x55e9971d5f50 2023-08-10T11:00:53.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff045d9b700 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d9b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0099b0 tx=0x7ff03c0099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=619428f405ca5ede server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:53.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.908+0000 7ff02dffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:00:53.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.909+0000 7ff02dffb700 1 -- 172.21.15.107:0/3349846175 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00fd20 con 0x55e9971d5f50 2023-08-10T11:00:53.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.909+0000 7ff060597b80 1 -- 172.21.15.107:0/3349846175 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9971c3470 con 0x55e9971d5f50 2023-08-10T11:00:53.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.909+0000 7ff02dffb700 1 -- 172.21.15.107:0/3349846175 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9374+0+0 (secure 0 0 0) 0x7ff03c0049a0 con 0x55e9971d5f50 2023-08-10T11:00:53.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.909+0000 7ff02dffb700 1 -- 172.21.15.107:0/3349846175 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff03c004b60 con 0x55e9971d5f50 2023-08-10T11:00:53.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.909+0000 7ff060597b80 10 client.26368 fetch_fsmap learned FSMap version 47 2023-08-10T11:00:53.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.909+0000 7ff060597b80 1 -- 172.21.15.107:0/3349846175 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55e996f4ede0 con 0x55e9971d5f50 2023-08-10T11:00:53.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.909+0000 7ff02dffb700 1 -- 172.21.15.107:0/3349846175 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e9971c3470 con 0x55e9971d5f50 2023-08-10T11:00:53.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.909+0000 7ff02dffb700 1 -- 172.21.15.107:0/3349846175 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 47) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff03c01f760 con 0x55e9971d5f50 2023-08-10T11:00:53.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.910+0000 7ff060597b80 10 client.26368 fetch_fsmap finished waiting for FSMap version 47 2023-08-10T11:00:53.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.910+0000 7ff060597b80 10 client.26368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:00:53.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.910+0000 7ff060597b80 20 client.26368 populate_metadata read hostname 'smithi107' 2023-08-10T11:00:53.916 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.910+0000 7ff060597b80 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e9971ea100 0x55e9971ec520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.910+0000 7ff060597b80 4 client.26368 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:00:53.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.910+0000 7ff060597b80 1 -- 172.21.15.107:0/3349846175 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e99719f9d0 con 0x55e9971ea100 2023-08-10T11:00:53.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.910+0000 7ff04659c700 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e9971ea100 0x55e9971ec520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.910+0000 7ff04659c700 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e9971ea100 0x55e9971ec520 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c58bfa8cbbafad3c server_cookie=c414fa21ea12cbcd in_seq=0 out_seq=0 2023-08-10T11:00:53.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.910+0000 7ff02dffb700 10 client.26368 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:00:53.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.911+0000 7ff02dffb700 1 -- 172.21.15.107:0/3349846175 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e99719f9d0 con 0x55e9971ea100 2023-08-10T11:00:53.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.911+0000 7ff02dffb700 10 client.26368 handle_command_reply: tid=0 2023-08-10T11:00:53.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.911+0000 7ff060597b80 1 client.26368 shutdown 2023-08-10T11:00:53.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.911+0000 7ff060597b80 1 -- 172.21.15.107:0/3349846175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 msgr2=0x55e9971d9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:53.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.911+0000 7ff060597b80 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d9b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0099b0 tx=0x7ff03c0099e0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff060597b80 1 -- 172.21.15.107:0/3349846175 shutdown_connections 2023-08-10T11:00:53.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff060597b80 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e9971ea100 0x55e9971ec520 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff060597b80 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 0x55e9971da190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff060597b80 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff060597b80 1 --2- 172.21.15.107:0/3349846175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d5f50 0x55e9971d9b10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff060597b80 1 -- 172.21.15.107:0/3349846175 >> 172.21.15.107:0/3349846175 conn(0x55e99712dcd0 msgr2=0x55e9971ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:53.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff02dffb700 0 client.26368 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:00:53.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff060597b80 1 -- 172.21.15.107:0/3349846175 shutdown_connections 2023-08-10T11:00:53.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff060597b80 1 -- 172.21.15.107:0/3349846175 wait complete. 2023-08-10T11:00:53.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.912+0000 7ff060597b80 20 client.26368 trim_cache size 0 max 16384 2023-08-10T11:00:53.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.932+0000 7ff060597b80 1 Processor -- start 2023-08-10T11:00:53.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.932+0000 7ff060597b80 1 -- start start 2023-08-10T11:00:53.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.932+0000 7ff060597b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.932+0000 7ff060597b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 0x55e9971e1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.932+0000 7ff060597b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d4330 0x55e9971cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.932+0000 7ff060597b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e996fa4920 con 0x55e9971d0800 2023-08-10T11:00:53.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.932+0000 7ff060597b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9971cc920 con 0x55e9971d6870 2023-08-10T11:00:53.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.932+0000 7ff060597b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9971f12f0 con 0x55e9971d4330 2023-08-10T11:00:53.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff04659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff04659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47384/0 (socket says 172.21.15.107:47384) 2023-08-10T11:00:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff04659c700 1 -- 172.21.15.107:0/638684822 learned_addr learned my addr 172.21.15.107:0/638684822 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff046d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d4330 0x55e9971cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff045d9b700 1 --2- 172.21.15.107:0/638684822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 0x55e9971e1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff046d9d700 1 -- 172.21.15.107:0/638684822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 msgr2=0x55e9971e1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff046d9d700 1 --2- 172.21.15.107:0/638684822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 0x55e9971e1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff046d9d700 1 -- 172.21.15.107:0/638684822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 msgr2=0x55e9971d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff046d9d700 1 --2- 172.21.15.107:0/638684822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff046d9d700 1 -- 172.21.15.107:0/638684822 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e996f37c60 con 0x55e9971d4330 2023-08-10T11:00:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff04659c700 1 --2- 172.21.15.107:0/638684822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:00:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.933+0000 7ff046d9d700 1 --2- 172.21.15.107:0/638684822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d4330 0x55e9971cb130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0400cb770 tx=0x7ff0400a1040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9fb733e0ececd2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff0357fa700 1 -- 172.21.15.107:0/638684822 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04009aae0 con 0x55e9971d4330 2023-08-10T11:00:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff0357fa700 1 -- 172.21.15.107:0/638684822 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff04009b180 con 0x55e9971d4330 2023-08-10T11:00:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff0357fa700 1 -- 172.21.15.107:0/638684822 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04009b3e0 con 0x55e9971d4330 2023-08-10T11:00:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff060597b80 1 -- 172.21.15.107:0/638684822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d4330 msgr2=0x55e9971cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff060597b80 1 --2- 172.21.15.107:0/638684822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d4330 0x55e9971cb130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0400cb770 tx=0x7ff0400a1040 comp rx=0 tx=0).stop 2023-08-10T11:00:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff060597b80 1 -- 172.21.15.107:0/638684822 shutdown_connections 2023-08-10T11:00:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff060597b80 1 --2- 172.21.15.107:0/638684822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d4330 0x55e9971cb130 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff060597b80 1 --2- 172.21.15.107:0/638684822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d0800 0x55e9971d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff060597b80 1 --2- 172.21.15.107:0/638684822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d6870 0x55e9971e1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff060597b80 1 -- 172.21.15.107:0/638684822 >> 172.21.15.107:0/638684822 conn(0x55e99712dcd0 msgr2=0x55e9971d3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.934+0000 7ff060597b80 1 -- 172.21.15.107:0/638684822 shutdown_connections 2023-08-10T11:00:53.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.935+0000 7ff060597b80 1 -- 172.21.15.107:0/638684822 wait complete. 2023-08-10T11:00:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.935+0000 7ff060597b80 1 -- start start 2023-08-10T11:00:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.935+0000 7ff060597b80 1 Processor -- start 2023-08-10T11:00:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff060597b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d0800 0x55e9971d3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff060597b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d4330 0x55e9971d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff060597b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff060597b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9971d23f0 con 0x55e9971d6870 2023-08-10T11:00:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff060597b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9971d2560 con 0x55e9971d4330 2023-08-10T11:00:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff060597b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9971d2720 con 0x55e9971d0800 2023-08-10T11:00:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff060597b80 10 client.0 _ll_register_callbacks cb 0x55e9970be680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:00:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff046d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff046d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47392/0 (socket says 172.21.15.107:47392) 2023-08-10T11:00:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff046d9d700 1 -- 172.21.15.107:0/375284619 learned_addr learned my addr 172.21.15.107:0/375284619 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:00:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff04659c700 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d0800 0x55e9971d3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff045d9b700 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d4330 0x55e9971d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff046d9d700 1 -- 172.21.15.107:0/375284619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d0800 msgr2=0x55e9971d3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff046d9d700 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d0800 0x55e9971d3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff046d9d700 1 -- 172.21.15.107:0/375284619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d4330 msgr2=0x55e9971d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:00:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff046d9d700 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d4330 0x55e9971d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.936+0000 7ff046d9d700 1 -- 172.21.15.107:0/375284619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff038009040 con 0x55e9971d6870 2023-08-10T11:00:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.937+0000 7ff046d9d700 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d1eb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff0400a3010 tx=0x7ff04009ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae3de41e09d7618 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:00:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.937+0000 7ff02dffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:00:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.937+0000 7ff02dffb700 1 -- 172.21.15.107:0/375284619 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040022ac0 con 0x55e9971d6870 2023-08-10T11:00:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.937+0000 7ff02dffb700 1 -- 172.21.15.107:0/375284619 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 9374+0+0 (secure 0 0 0) 0x7ff0400a3540 con 0x55e9971d6870 2023-08-10T11:00:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.937+0000 7ff060597b80 1 -- 172.21.15.107:0/375284619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff03c004830 con 0x55e9971d6870 2023-08-10T11:00:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.937+0000 7ff02dffb700 1 -- 172.21.15.107:0/375284619 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0400b92a0 con 0x55e9971d6870 2023-08-10T11:00:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.937+0000 7ff060597b80 10 client.16677 fetch_fsmap learned FSMap version 47 2023-08-10T11:00:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.937+0000 7ff060597b80 1 -- 172.21.15.107:0/375284619 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7ff0481a9a90 con 0x55e9971d6870 2023-08-10T11:00:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.937+0000 7ff02dffb700 1 -- 172.21.15.107:0/375284619 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff03c004830 con 0x55e9971d6870 2023-08-10T11:00:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.938+0000 7ff02dffb700 1 -- 172.21.15.107:0/375284619 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 47) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff04009b3e0 con 0x55e9971d6870 2023-08-10T11:00:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.938+0000 7ff060597b80 10 client.16677 fetch_fsmap finished waiting for FSMap version 47 2023-08-10T11:00:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.938+0000 7ff060597b80 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:00:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.938+0000 7ff060597b80 20 client.16677 populate_metadata read hostname 'smithi107' 2023-08-10T11:00:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.938+0000 7ff060597b80 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e99723edc0 0x55e9972411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:00:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.938+0000 7ff060597b80 4 client.16677 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:00:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.938+0000 7ff060597b80 1 -- 172.21.15.107:0/375284619 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e99711a780 con 0x55e99723edc0 2023-08-10T11:00:53.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.938+0000 7ff04659c700 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e99723edc0 0x55e9972411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:00:53.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff02dffb700 10 client.16677 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:00:53.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff04659c700 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e99723edc0 0x55e9972411b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca2e5261258ed2ea server_cookie=554e5b1441432f87 in_seq=0 out_seq=0 2023-08-10T11:00:53.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff02dffb700 1 -- 172.21.15.107:0/375284619 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e99711a780 con 0x55e99723edc0 2023-08-10T11:00:53.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff02dffb700 10 client.16677 handle_command_reply: tid=0 2023-08-10T11:00:53.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 client.16677 shutdown 2023-08-10T11:00:53.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 -- 172.21.15.107:0/375284619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 msgr2=0x55e9971d1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:53.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d1eb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff0400a3010 tx=0x7ff04009ad80 comp rx=0 tx=0).stop 2023-08-10T11:00:53.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 -- 172.21.15.107:0/375284619 shutdown_connections 2023-08-10T11:00:53.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e99723edc0 0x55e9972411b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e9971d6870 0x55e9971d1eb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9971d0800 0x55e9971d3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 --2- 172.21.15.107:0/375284619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e9971d4330 0x55e9971d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 -- 172.21.15.107:0/375284619 >> 172.21.15.107:0/375284619 conn(0x55e99712dcd0 msgr2=0x55e9971cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:53.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff02dffb700 0 client.16677 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:00:53.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 -- 172.21.15.107:0/375284619 shutdown_connections 2023-08-10T11:00:53.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 1 -- 172.21.15.107:0/375284619 wait complete. 2023-08-10T11:00:53.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.939+0000 7ff060597b80 20 client.16677 trim_cache size 0 max 16384 2023-08-10T11:00:53.948 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:00:53.948 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:00:53.948 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:00:53.949 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:00:53.949 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:00:53.949 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:00:53.949 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:00:53.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:00:53.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:00:53.949 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:00:53.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 -- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0300a12c0 msgr2=0x7ff0300a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:53.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0300a12c0 0x7ff0300a3780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff03c011a30 tx=0x7ff03c009c70 comp rx=0 tx=0).stop 2023-08-10T11:00:53.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 -- 172.21.15.107:0/1823778325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0481066d0 msgr2=0x7ff04810b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:00:53.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0481066d0 0x7ff04810b160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff040005910 tx=0x7ff040005740 comp rx=0 tx=0).stop 2023-08-10T11:00:53.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 -- 172.21.15.107:0/1823778325 shutdown_connections 2023-08-10T11:00:53.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff0300a12c0 0x7ff0300a3780 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0481006c0 0x7ff0481a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0481066d0 0x7ff04810b160 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 --2- 172.21.15.107:0/1823778325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff048101080 0x7ff0481a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:00:53.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 -- 172.21.15.107:0/1823778325 >> 172.21.15.107:0/1823778325 conn(0x7ff0480fc1f0 msgr2=0x7ff048072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:00:53.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 -- 172.21.15.107:0/1823778325 shutdown_connections 2023-08-10T11:00:53.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:00:53.940+0000 7ff04cbff700 1 -- 172.21.15.107:0/1823778325 wait complete. 2023-08-10T11:00:53.961 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:00:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:53 smithi107 ceph-mon[127953]: pgmap v299: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-08-10T11:00:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:53 smithi195 ceph-mon[129938]: pgmap v299: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-08-10T11:00:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:53 smithi157 ceph-mon[129604]: pgmap v299: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-08-10T11:00:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:55 smithi195 ceph-mon[129938]: pgmap v300: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 33 MiB/s wr, 112 op/s 2023-08-10T11:00:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:55 smithi157 ceph-mon[129604]: pgmap v300: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 33 MiB/s wr, 112 op/s 2023-08-10T11:00:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:55 smithi107 ceph-mon[127953]: pgmap v300: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 33 MiB/s wr, 112 op/s 2023-08-10T11:00:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:57 smithi195 ceph-mon[129938]: pgmap v301: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-08-10T11:00:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:57 smithi157 ceph-mon[129604]: pgmap v301: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-08-10T11:00:58.308 INFO:teuthology.orchestra.run.smithi107.stderr:39100000 of 50000000 tuples (78%) done (elapsed 556.49 s, remaining 155.13 s) 2023-08-10T11:00:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:57 smithi107 ceph-mon[127953]: pgmap v301: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-08-10T11:00:59.590 INFO:teuthology.orchestra.run.smithi107.stderr:39200000 of 50000000 tuples (78%) done (elapsed 557.77 s, remaining 153.67 s) 2023-08-10T11:01:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:00:59 smithi195 ceph-mon[129938]: pgmap v302: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 27 MiB/s wr, 101 op/s 2023-08-10T11:01:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:00:59 smithi157 ceph-mon[129604]: pgmap v302: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 27 MiB/s wr, 101 op/s 2023-08-10T11:01:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:00:59 smithi107 ceph-mon[127953]: pgmap v302: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 27 MiB/s wr, 101 op/s 2023-08-10T11:01:00.988 INFO:teuthology.orchestra.run.smithi107.stderr:39300000 of 50000000 tuples (78%) done (elapsed 559.17 s, remaining 152.24 s) 2023-08-10T11:01:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:01 smithi195 ceph-mon[129938]: pgmap v303: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 63 op/s 2023-08-10T11:01:02.265 INFO:teuthology.orchestra.run.smithi107.stderr:39400000 of 50000000 tuples (78%) done (elapsed 560.44 s, remaining 150.78 s) 2023-08-10T11:01:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:01 smithi157 ceph-mon[129604]: pgmap v303: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 63 op/s 2023-08-10T11:01:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:01 smithi107 ceph-mon[127953]: pgmap v303: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 63 op/s 2023-08-10T11:01:03.572 INFO:teuthology.orchestra.run.smithi107.stderr:39500000 of 50000000 tuples (79%) done (elapsed 561.75 s, remaining 149.33 s) 2023-08-10T11:01:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:03 smithi195 ceph-mon[129938]: pgmap v304: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 63 op/s 2023-08-10T11:01:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:03 smithi157 ceph-mon[129604]: pgmap v304: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 63 op/s 2023-08-10T11:01:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:03 smithi107 ceph-mon[127953]: pgmap v304: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 16 MiB/s wr, 63 op/s 2023-08-10T11:01:04.920 INFO:teuthology.orchestra.run.smithi107.stderr:39600000 of 50000000 tuples (79%) done (elapsed 563.10 s, remaining 147.88 s) 2023-08-10T11:01:06.131 INFO:teuthology.orchestra.run.smithi107.stderr:39700000 of 50000000 tuples (79%) done (elapsed 564.31 s, remaining 146.41 s) 2023-08-10T11:01:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:05 smithi195 ceph-mon[129938]: pgmap v305: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 27 MiB/s wr, 112 op/s 2023-08-10T11:01:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:05 smithi157 ceph-mon[129604]: pgmap v305: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 27 MiB/s wr, 112 op/s 2023-08-10T11:01:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:05 smithi107 ceph-mon[127953]: pgmap v305: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 27 MiB/s wr, 112 op/s 2023-08-10T11:01:07.384 INFO:teuthology.orchestra.run.smithi107.stderr:39800000 of 50000000 tuples (79%) done (elapsed 565.56 s, remaining 144.94 s) 2023-08-10T11:01:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:07 smithi195 ceph-mon[129938]: pgmap v306: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 16 MiB/s wr, 69 op/s 2023-08-10T11:01:08.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:07 smithi157 ceph-mon[129604]: pgmap v306: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 16 MiB/s wr, 69 op/s 2023-08-10T11:01:08.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:07 smithi107 ceph-mon[127953]: pgmap v306: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 16 MiB/s wr, 69 op/s 2023-08-10T11:01:08.882 INFO:teuthology.orchestra.run.smithi107.stderr:39900000 of 50000000 tuples (79%) done (elapsed 567.06 s, remaining 143.54 s) 2023-08-10T11:01:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:08 smithi195 ceph-mon[129938]: osdmap e101: 12 total, 12 up, 12 in 2023-08-10T11:01:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:08 smithi195 ceph-mon[129938]: pgmap v308: 129 pgs: 129 active+clean; 8.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-08-10T11:01:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:08 smithi157 ceph-mon[129604]: osdmap e101: 12 total, 12 up, 12 in 2023-08-10T11:01:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:08 smithi157 ceph-mon[129604]: pgmap v308: 129 pgs: 129 active+clean; 8.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-08-10T11:01:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:08 smithi107 ceph-mon[127953]: osdmap e101: 12 total, 12 up, 12 in 2023-08-10T11:01:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:08 smithi107 ceph-mon[127953]: pgmap v308: 129 pgs: 129 active+clean; 8.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-08-10T11:01:10.155 INFO:teuthology.orchestra.run.smithi107.stderr:40000000 of 50000000 tuples (80%) done (elapsed 568.33 s, remaining 142.08 s) 2023-08-10T11:01:11.407 INFO:teuthology.orchestra.run.smithi107.stderr:40100000 of 50000000 tuples (80%) done (elapsed 569.59 s, remaining 140.62 s) 2023-08-10T11:01:11.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:11 smithi195 ceph-mon[129938]: pgmap v309: 129 pgs: 129 active+clean; 8.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-08-10T11:01:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:11 smithi157 ceph-mon[129604]: pgmap v309: 129 pgs: 129 active+clean; 8.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-08-10T11:01:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:11 smithi107 ceph-mon[127953]: pgmap v309: 129 pgs: 129 active+clean; 8.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-08-10T11:01:12.772 INFO:teuthology.orchestra.run.smithi107.stderr:40200000 of 50000000 tuples (80%) done (elapsed 570.95 s, remaining 139.19 s) 2023-08-10T11:01:13.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:13 smithi195 ceph-mon[129938]: pgmap v310: 129 pgs: 129 active+clean; 8.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-08-10T11:01:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:13 smithi157 ceph-mon[129604]: pgmap v310: 129 pgs: 129 active+clean; 8.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-08-10T11:01:14.039 INFO:teuthology.orchestra.run.smithi107.stderr:40300000 of 50000000 tuples (80%) done (elapsed 572.22 s, remaining 137.73 s) 2023-08-10T11:01:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:13 smithi107 ceph-mon[127953]: pgmap v310: 129 pgs: 129 active+clean; 8.3 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 102 op/s 2023-08-10T11:01:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:14 smithi107 ceph-mon[127953]: osdmap e102: 12 total, 12 up, 12 in 2023-08-10T11:01:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:14 smithi195 ceph-mon[129938]: osdmap e102: 12 total, 12 up, 12 in 2023-08-10T11:01:15.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:14 smithi157 ceph-mon[129604]: osdmap e102: 12 total, 12 up, 12 in 2023-08-10T11:01:15.289 INFO:teuthology.orchestra.run.smithi107.stderr:40400000 of 50000000 tuples (80%) done (elapsed 573.47 s, remaining 136.27 s) 2023-08-10T11:01:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:15 smithi107 ceph-mon[127953]: pgmap v312: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 108 op/s 2023-08-10T11:01:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:15 smithi195 ceph-mon[129938]: pgmap v312: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 108 op/s 2023-08-10T11:01:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:15 smithi157 ceph-mon[129604]: pgmap v312: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 108 op/s 2023-08-10T11:01:16.486 INFO:teuthology.orchestra.run.smithi107.stderr:40500000 of 50000000 tuples (81%) done (elapsed 574.66 s, remaining 134.80 s) 2023-08-10T11:01:17.824 INFO:teuthology.orchestra.run.smithi107.stderr:40600000 of 50000000 tuples (81%) done (elapsed 576.00 s, remaining 133.36 s) 2023-08-10T11:01:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:17 smithi107 ceph-mon[127953]: pgmap v313: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 100 op/s 2023-08-10T11:01:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:17 smithi195 ceph-mon[129938]: pgmap v313: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 100 op/s 2023-08-10T11:01:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:17 smithi157 ceph-mon[129604]: pgmap v313: 129 pgs: 129 active+clean; 8.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 100 op/s 2023-08-10T11:01:19.035 INFO:teuthology.orchestra.run.smithi107.stderr:40700000 of 50000000 tuples (81%) done (elapsed 577.21 s, remaining 131.89 s) 2023-08-10T11:01:20.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:19 smithi107 ceph-mon[127953]: pgmap v314: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 81 op/s 2023-08-10T11:01:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:19 smithi195 ceph-mon[129938]: pgmap v314: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 81 op/s 2023-08-10T11:01:20.263 INFO:teuthology.orchestra.run.smithi107.stderr:40800000 of 50000000 tuples (81%) done (elapsed 578.44 s, remaining 130.43 s) 2023-08-10T11:01:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:19 smithi157 ceph-mon[129604]: pgmap v314: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 81 op/s 2023-08-10T11:01:21.618 INFO:teuthology.orchestra.run.smithi107.stderr:40900000 of 50000000 tuples (81%) done (elapsed 579.80 s, remaining 129.00 s) 2023-08-10T11:01:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:21 smithi107 ceph-mon[127953]: pgmap v315: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 81 op/s 2023-08-10T11:01:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:21 smithi195 ceph-mon[129938]: pgmap v315: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 81 op/s 2023-08-10T11:01:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:21 smithi157 ceph-mon[129604]: pgmap v315: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 81 op/s 2023-08-10T11:01:22.869 INFO:teuthology.orchestra.run.smithi107.stderr:41000000 of 50000000 tuples (82%) done (elapsed 581.05 s, remaining 127.55 s) 2023-08-10T11:01:23.961 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:01:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:23 smithi107 ceph-mon[127953]: pgmap v316: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 81 op/s 2023-08-10T11:01:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:23 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:24.105 INFO:teuthology.orchestra.run.smithi107.stderr:41100000 of 50000000 tuples (82%) done (elapsed 582.28 s, remaining 126.09 s) 2023-08-10T11:01:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:23 smithi195 ceph-mon[129938]: pgmap v316: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 81 op/s 2023-08-10T11:01:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:23 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.206+0000 7f40dad9d700 1 -- 172.21.15.107:0/3401537535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40d4101750 msgr2=0x7f40d4101b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.206+0000 7f40dad9d700 1 --2- 172.21.15.107:0/3401537535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40d4101750 0x7f40d4101b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009990 tx=0x7f40d0009ca0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.206+0000 7f40dad9d700 1 -- 172.21.15.107:0/3401537535 shutdown_connections 2023-08-10T11:01:24.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.206+0000 7f40dad9d700 1 --2- 172.21.15.107:0/3401537535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d410ab70 0x7f40d410d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.206+0000 7f40dad9d700 1 --2- 172.21.15.107:0/3401537535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40d4101750 0x7f40d4101b30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.206+0000 7f40dad9d700 1 --2- 172.21.15.107:0/3401537535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d4102070 0x7f40d410a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.206+0000 7f40dad9d700 1 -- 172.21.15.107:0/3401537535 >> 172.21.15.107:0/3401537535 conn(0x7f40d40faf50 msgr2=0x7f40d40fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:24.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.206+0000 7f40dad9d700 1 -- 172.21.15.107:0/3401537535 shutdown_connections 2023-08-10T11:01:24.208 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.206+0000 7f40dad9d700 1 -- 172.21.15.107:0/3401537535 wait complete. 2023-08-10T11:01:24.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.207+0000 7f40dad9d700 1 Processor -- start 2023-08-10T11:01:24.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.207+0000 7f40dad9d700 1 -- start start 2023-08-10T11:01:24.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40dad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d4101750 0x7f40d4196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40dad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40d4102070 0x7f40d4196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.210 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40dad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d410ab70 0x7f40d419aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40dad9d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d419b4f0 con 0x7f40d4101750 2023-08-10T11:01:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40dad9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d419b660 con 0x7f40d410ab70 2023-08-10T11:01:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40dad9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d419b820 con 0x7f40d4102070 2023-08-10T11:01:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40d9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d4101750 0x7f40d4196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40d9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d4101750 0x7f40d4196510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49402/0 (socket says 172.21.15.107:49402) 2023-08-10T11:01:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40d9d9b700 1 -- 172.21.15.107:0/1676144422 learned_addr learned my addr 172.21.15.107:0/1676144422 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:24.211 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40d959a700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40d4102070 0x7f40d4196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40da59c700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d410ab70 0x7f40d419aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40d9d9b700 1 -- 172.21.15.107:0/1676144422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40d4102070 msgr2=0x7f40d4196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40d4102070 0x7f40d4196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40d9d9b700 1 -- 172.21.15.107:0/1676144422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d410ab70 msgr2=0x7f40d419aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d410ab70 0x7f40d419aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40d9d9b700 1 -- 172.21.15.107:0/1676144422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc009c40 con 0x7f40d4101750 2023-08-10T11:01:24.212 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.208+0000 7f40da59c700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d410ab70 0x7f40d419aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:01:24.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.209+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d4101750 0x7f40d4196510 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f40d0005910 tx=0x7f40d00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:24.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.209+0000 7f40caffd700 1 -- 172.21.15.107:0/1676144422 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d001d070 con 0x7f40d4101750 2023-08-10T11:01:24.213 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.209+0000 7f40caffd700 1 -- 172.21.15.107:0/1676144422 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40d0021410 con 0x7f40d4101750 2023-08-10T11:01:24.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.209+0000 7f40dad9d700 1 -- 172.21.15.107:0/1676144422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d00095f0 con 0x7f40d4101750 2023-08-10T11:01:24.214 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.209+0000 7f40caffd700 1 -- 172.21.15.107:0/1676144422 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0017650 con 0x7f40d4101750 2023-08-10T11:01:24.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.209+0000 7f40dad9d700 1 -- 172.21.15.107:0/1676144422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d41a3160 con 0x7f40d4101750 2023-08-10T11:01:24.215 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.213+0000 7f40caffd700 1 -- 172.21.15.107:0/1676144422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f40d000fb00 con 0x7f40d4101750 2023-08-10T11:01:24.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.214+0000 7f40caffd700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f40c00a1360 0x7f40c00a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.214+0000 7f40ef838b80 1 Processor -- start 2023-08-10T11:01:24.219 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.214+0000 7f40caffd700 1 -- 172.21.15.107:0/1676144422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f40d00ce580 con 0x7f40d4101750 2023-08-10T11:01:24.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.214+0000 7f40ef838b80 1 -- start start 2023-08-10T11:01:24.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.214+0000 7f40d959a700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f40c00a1360 0x7f40c00a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdafd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdb02290 0x55b7fdb026f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40ef838b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fda78dc0 con 0x55b7fdafd4b0 2023-08-10T11:01:24.220 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40ef838b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fda55590 con 0x55b7fdb02290 2023-08-10T11:01:24.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40ef838b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fda52eb0 con 0x55b7fdafddd0 2023-08-10T11:01:24.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40d9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdafd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40d9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdafd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49416/0 (socket says 172.21.15.107:49416) 2023-08-10T11:01:24.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40d9d9b700 1 -- 172.21.15.107:0/2382353440 learned_addr learned my addr 172.21.15.107:0/2382353440 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:24.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40d959a700 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40da59c700 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdb02290 0x55b7fdb026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.215+0000 7f40d959a700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f40c00a1360 0x7f40c00a3820 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40d4197b20 tx=0x7f40c40106b0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:24.221 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40d959a700 1 -- 172.21.15.107:0/2382353440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdb02290 msgr2=0x55b7fdb026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40d959a700 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdb02290 0x55b7fdb026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40d959a700 1 -- 172.21.15.107:0/2382353440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 msgr2=0x55b7fdafd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40d959a700 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdafd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40d959a700 1 -- 172.21.15.107:0/2382353440 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7fd8cf630 con 0x55b7fdafddd0 2023-08-10T11:01:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdafd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:01:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40d959a700 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01d50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f40c4010f00 tx=0x7f40c401b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70f5e8267ce28abe server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:24.222 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40bffff700 1 -- 172.21.15.107:0/2382353440 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c40132d0 con 0x55b7fdafddd0 2023-08-10T11:01:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40bffff700 1 -- 172.21.15.107:0/2382353440 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40c4013bd0 con 0x55b7fdafddd0 2023-08-10T11:01:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.216+0000 7f40bffff700 1 -- 172.21.15.107:0/2382353440 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c401e420 con 0x55b7fdafddd0 2023-08-10T11:01:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.217+0000 7f40ef838b80 1 -- 172.21.15.107:0/2382353440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 msgr2=0x55b7fdb01d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.217+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01d50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f40c4010f00 tx=0x7f40c401b000 comp rx=0 tx=0).stop 2023-08-10T11:01:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.217+0000 7f40ef838b80 1 -- 172.21.15.107:0/2382353440 shutdown_connections 2023-08-10T11:01:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.217+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdb02290 0x55b7fdb026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.217+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdafd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.223 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.217+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2382353440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01d50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.217+0000 7f40ef838b80 1 -- 172.21.15.107:0/2382353440 >> 172.21.15.107:0/2382353440 conn(0x55b7fda5acd0 msgr2=0x55b7fdaf8750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.217+0000 7f40ef838b80 1 -- 172.21.15.107:0/2382353440 shutdown_connections 2023-08-10T11:01:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.217+0000 7f40ef838b80 1 -- 172.21.15.107:0/2382353440 wait complete. 2023-08-10T11:01:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.218+0000 7f40ef838b80 1 -- start start 2023-08-10T11:01:24.224 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.218+0000 7f40ef838b80 1 Processor -- start 2023-08-10T11:01:24.226 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdb06e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb07380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdb02290 0x55b7fdb078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40ef838b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fda4e7a0 con 0x55b7fdb02290 2023-08-10T11:01:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40ef838b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fd9edac0 con 0x55b7fdafd4b0 2023-08-10T11:01:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40ef838b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fd9ed7c0 con 0x55b7fdafddd0 2023-08-10T11:01:24.227 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40ef838b80 10 client.0 _ll_register_callbacks cb 0x55b7fd9eb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:01:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d959a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb07380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d959a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb07380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38276/0 (socket says 172.21.15.107:38276) 2023-08-10T11:01:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d959a700 1 -- 172.21.15.107:0/2223013331 learned_addr learned my addr 172.21.15.107:0/2223013331 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40da59c700 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdb02290 0x55b7fdb078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdb06e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d959a700 1 -- 172.21.15.107:0/2223013331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 msgr2=0x55b7fdb06e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:24.228 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d959a700 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdb06e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d959a700 1 -- 172.21.15.107:0/2223013331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdb02290 msgr2=0x55b7fdb078c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d959a700 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdb02290 0x55b7fdb078c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d959a700 1 -- 172.21.15.107:0/2223013331 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d41a3160 con 0x55b7fdafddd0 2023-08-10T11:01:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.220+0000 7f40da59c700 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdb02290 0x55b7fdb078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:01:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.219+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdb06e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:01:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.220+0000 7f40d959a700 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb07380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40c4010fe0 tx=0x7f40c4010c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c470d50285a13436 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.220+0000 7f40bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:01:24.229 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.220+0000 7f40bd7fa700 1 -- 172.21.15.107:0/2223013331 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4011440 con 0x55b7fdafddd0 2023-08-10T11:01:24.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.220+0000 7f40bd7fa700 1 -- 172.21.15.107:0/2223013331 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f40c4019050 con 0x55b7fdafddd0 2023-08-10T11:01:24.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.220+0000 7f40ef838b80 1 -- 172.21.15.107:0/2223013331 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7fdaf0470 con 0x55b7fdafddd0 2023-08-10T11:01:24.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.220+0000 7f40bd7fa700 1 -- 172.21.15.107:0/2223013331 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40c40115a0 con 0x55b7fdafddd0 2023-08-10T11:01:24.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.220+0000 7f40ef838b80 10 client.26386 fetch_fsmap learned FSMap version 48 2023-08-10T11:01:24.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.220+0000 7f40ef838b80 1 -- 172.21.15.107:0/2223013331 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x7f40c4010c90 con 0x55b7fdafddd0 2023-08-10T11:01:24.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.221+0000 7f40bd7fa700 1 -- 172.21.15.107:0/2223013331 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b7fdaf0470 con 0x55b7fdafddd0 2023-08-10T11:01:24.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.221+0000 7f40bd7fa700 1 -- 172.21.15.107:0/2223013331 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 48) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f40c4024020 con 0x55b7fdafddd0 2023-08-10T11:01:24.230 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.221+0000 7f40ef838b80 10 client.26386 fetch_fsmap finished waiting for FSMap version 48 2023-08-10T11:01:24.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.221+0000 7f40ef838b80 10 client.26386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:01:24.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.221+0000 7f40ef838b80 20 client.26386 populate_metadata read hostname 'smithi107' 2023-08-10T11:01:24.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.221+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b7fdb1fc00 0x55b7fdb22020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.221+0000 7f40ef838b80 4 client.26386 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:01:24.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.221+0000 7f40ef838b80 1 -- 172.21.15.107:0/2223013331 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7fdacc9d0 con 0x55b7fdb1fc00 2023-08-10T11:01:24.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.222+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b7fdb1fc00 0x55b7fdb22020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.231 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.222+0000 7f40bd7fa700 10 client.26386 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:01:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.222+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b7fdb1fc00 0x55b7fdb22020 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a94db43d33b40b7c server_cookie=c22901959bad4d5d in_seq=0 out_seq=0 2023-08-10T11:01:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40bd7fa700 1 -- 172.21.15.107:0/2223013331 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b7fdacc9d0 con 0x55b7fdb1fc00 2023-08-10T11:01:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40bd7fa700 10 client.26386 handle_command_reply: tid=0 2023-08-10T11:01:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 client.26386 shutdown 2023-08-10T11:01:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 -- 172.21.15.107:0/2223013331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 msgr2=0x55b7fdb07380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb07380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40c4010fe0 tx=0x7f40c4010c20 comp rx=0 tx=0).stop 2023-08-10T11:01:24.232 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 -- 172.21.15.107:0/2223013331 shutdown_connections 2023-08-10T11:01:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b7fdb1fc00 0x55b7fdb22020 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdb06e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdb02290 0x55b7fdb078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40bd7fa700 0 client.26386 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:01:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2223013331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdafddd0 0x55b7fdb07380 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 -- 172.21.15.107:0/2223013331 >> 172.21.15.107:0/2223013331 conn(0x55b7fda5acd0 msgr2=0x55b7fdb03740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 -- 172.21.15.107:0/2223013331 shutdown_connections 2023-08-10T11:01:24.233 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.223+0000 7f40ef838b80 1 -- 172.21.15.107:0/2223013331 wait complete. 2023-08-10T11:01:24.234 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.224+0000 7f40ef838b80 20 client.26386 trim_cache size 0 max 16384 2023-08-10T11:01:24.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.243+0000 7f40ef838b80 1 Processor -- start 2023-08-10T11:01:24.244 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.243+0000 7f40ef838b80 1 -- start start 2023-08-10T11:01:24.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.243+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.243+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.243+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdb16d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.243+0000 7f40ef838b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fd8d1920 con 0x55b7fdafddd0 2023-08-10T11:01:24.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.243+0000 7f40ef838b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fdb1fa20 con 0x55b7fdafd4b0 2023-08-10T11:01:24.245 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.243+0000 7f40ef838b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fdafe5a0 con 0x55b7fdb02290 2023-08-10T11:01:24.246 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40d959a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40da59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdb16d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40da59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdb16d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38278/0 (socket says 172.21.15.107:38278) 2023-08-10T11:01:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40d959a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49426/0 (socket says 172.21.15.107:49426) 2023-08-10T11:01:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40da59c700 1 -- 172.21.15.107:0/2194212131 learned_addr learned my addr 172.21.15.107:0/2194212131 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40da59c700 1 -- 172.21.15.107:0/2194212131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 msgr2=0x55b7fdaffb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:24.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40da59c700 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaffb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40da59c700 1 -- 172.21.15.107:0/2194212131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafddd0 msgr2=0x55b7fdb01c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:24.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40da59c700 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40da59c700 1 -- 172.21.15.107:0/2194212131 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7fd87bde0 con 0x55b7fdb02290 2023-08-10T11:01:24.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40d959a700 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:01:24.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:01:24.248 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.244+0000 7f40da59c700 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdb16d40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40cc007b60 tx=0x7f40cc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d677c027c5f5700b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:24.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40c8ff9700 1 -- 172.21.15.107:0/2194212131 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc00e040 con 0x55b7fdb02290 2023-08-10T11:01:24.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40c8ff9700 1 -- 172.21.15.107:0/2194212131 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40cc00f040 con 0x55b7fdb02290 2023-08-10T11:01:24.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40c8ff9700 1 -- 172.21.15.107:0/2194212131 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0043e0 con 0x55b7fdb02290 2023-08-10T11:01:24.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40ef838b80 1 -- 172.21.15.107:0/2194212131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 msgr2=0x55b7fdb16d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:24.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdb16d40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f40cc007b60 tx=0x7f40cc00b040 comp rx=0 tx=0).stop 2023-08-10T11:01:24.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40ef838b80 1 -- 172.21.15.107:0/2194212131 shutdown_connections 2023-08-10T11:01:24.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.249 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdb16d40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40ef838b80 1 --2- 172.21.15.107:0/2194212131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafddd0 0x55b7fdb01c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40ef838b80 1 -- 172.21.15.107:0/2194212131 >> 172.21.15.107:0/2194212131 conn(0x55b7fda5acd0 msgr2=0x55b7fdafc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:24.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.245+0000 7f40ef838b80 1 -- 172.21.15.107:0/2194212131 shutdown_connections 2023-08-10T11:01:24.250 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.246+0000 7f40ef838b80 1 -- 172.21.15.107:0/2194212131 wait complete. 2023-08-10T11:01:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.246+0000 7f40ef838b80 1 -- start start 2023-08-10T11:01:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.246+0000 7f40ef838b80 1 Processor -- start 2023-08-10T11:01:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaf85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafddd0 0x55b7fdaf70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40ef838b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdaf7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40ef838b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fdaf7b70 con 0x55b7fdafd4b0 2023-08-10T11:01:24.253 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40ef838b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fdaf7ce0 con 0x55b7fdafddd0 2023-08-10T11:01:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40ef838b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7fdaf7ea0 con 0x55b7fdb02290 2023-08-10T11:01:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40ef838b80 10 client.0 _ll_register_callbacks cb 0x55b7fd9eb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:01:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40d9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaf85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40d9d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaf85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49438/0 (socket says 172.21.15.107:49438) 2023-08-10T11:01:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40d9d9b700 1 -- 172.21.15.107:0/399612718 learned_addr learned my addr 172.21.15.107:0/399612718 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40da59c700 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdaf7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40d959a700 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafddd0 0x55b7fdaf70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40d9d9b700 1 -- 172.21.15.107:0/399612718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 msgr2=0x55b7fdaf7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:24.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.247+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdaf7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40d9d9b700 1 -- 172.21.15.107:0/399612718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafddd0 msgr2=0x55b7fdaf70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:24.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafddd0 0x55b7fdaf70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40d9d9b700 1 -- 172.21.15.107:0/399612718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c4010c90 con 0x55b7fdafd4b0 2023-08-10T11:01:24.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40d9d9b700 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaf85a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f40d009b2c0 tx=0x7f40d009ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacc3d36625f51a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:24.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:01:24.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40bd7fa700 1 -- 172.21.15.107:0/399612718 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00a36f0 con 0x55b7fdafd4b0 2023-08-10T11:01:24.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40bd7fa700 1 -- 172.21.15.107:0/399612718 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f40d009f0b0 con 0x55b7fdafd4b0 2023-08-10T11:01:24.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40ef838b80 1 -- 172.21.15.107:0/399612718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40c4013bd0 con 0x55b7fdafd4b0 2023-08-10T11:01:24.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40bd7fa700 1 -- 172.21.15.107:0/399612718 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40d00996d0 con 0x55b7fdafd4b0 2023-08-10T11:01:24.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40ef838b80 10 client.16695 fetch_fsmap learned FSMap version 48 2023-08-10T11:01:24.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.248+0000 7f40ef838b80 1 -- 172.21.15.107:0/399612718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x7f40cc007810 con 0x55b7fdafd4b0 2023-08-10T11:01:24.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.249+0000 7f40bd7fa700 1 -- 172.21.15.107:0/399612718 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40c4013bd0 con 0x55b7fdafd4b0 2023-08-10T11:01:24.256 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.249+0000 7f40bd7fa700 1 -- 172.21.15.107:0/399612718 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 48) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f40d00ce150 con 0x55b7fdafd4b0 2023-08-10T11:01:24.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.249+0000 7f40ef838b80 10 client.16695 fetch_fsmap finished waiting for FSMap version 48 2023-08-10T11:01:24.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.249+0000 7f40ef838b80 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:01:24.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.249+0000 7f40ef838b80 20 client.16695 populate_metadata read hostname 'smithi107' 2023-08-10T11:01:24.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.249+0000 7f40ef838b80 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b7fdb74890 0x55b7fdb76c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:24.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.249+0000 7f40ef838b80 4 client.16695 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:01:24.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.249+0000 7f40ef838b80 1 -- 172.21.15.107:0/399612718 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b7fda47780 con 0x55b7fdb74890 2023-08-10T11:01:24.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.249+0000 7f40d959a700 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b7fdb74890 0x55b7fdb76c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:24.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.250+0000 7f40d959a700 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b7fdb74890 0x55b7fdb76c80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48bf0480c6865fdc server_cookie=c9fd07f55e3a4d25 in_seq=0 out_seq=0 2023-08-10T11:01:24.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.250+0000 7f40bd7fa700 10 client.16695 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:01:24.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.250+0000 7f40bd7fa700 1 -- 172.21.15.107:0/399612718 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b7fda47780 con 0x55b7fdb74890 2023-08-10T11:01:24.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.250+0000 7f40bd7fa700 10 client.16695 handle_command_reply: tid=0 2023-08-10T11:01:24.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.250+0000 7f40ef838b80 1 client.16695 shutdown 2023-08-10T11:01:24.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.250+0000 7f40ef838b80 1 -- 172.21.15.107:0/399612718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 msgr2=0x55b7fdaf85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:24.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.250+0000 7f40ef838b80 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaf85a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f40d009b2c0 tx=0x7f40d009ad90 comp rx=0 tx=0).stop 2023-08-10T11:01:24.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40ef838b80 1 -- 172.21.15.107:0/399612718 shutdown_connections 2023-08-10T11:01:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40ef838b80 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55b7fdb74890 0x55b7fdb76c80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40ef838b80 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7fdb02290 0x55b7fdaf7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40bd7fa700 0 client.16695 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:01:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40ef838b80 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b7fdafd4b0 0x55b7fdaf85a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40ef838b80 1 --2- 172.21.15.107:0/399612718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b7fdafddd0 0x55b7fdaf70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40ef838b80 1 -- 172.21.15.107:0/399612718 >> 172.21.15.107:0/399612718 conn(0x55b7fda5acd0 msgr2=0x55b7fdb01ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40ef838b80 1 -- 172.21.15.107:0/399612718 shutdown_connections 2023-08-10T11:01:24.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40ef838b80 1 -- 172.21.15.107:0/399612718 wait complete. 2023-08-10T11:01:24.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.251+0000 7f40ef838b80 20 client.16695 trim_cache size 0 max 16384 2023-08-10T11:01:24.260 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:01:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:01:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:01:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:01:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:01:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:01:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:01:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:01:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:01:24.261 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:01:24.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 -- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f40c00a1360 msgr2=0x7f40c00a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:24.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f40c00a1360 0x7f40c00a3820 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40d4197b20 tx=0x7f40c40106b0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 -- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d4101750 msgr2=0x7f40d4196510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:24.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d4101750 0x7f40d4196510 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f40d0005910 tx=0x7f40d00047b0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 -- 172.21.15.107:0/1676144422 shutdown_connections 2023-08-10T11:01:24.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f40c00a1360 0x7f40c00a3820 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d410ab70 0x7f40d419aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d4101750 0x7f40d4196510 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 --2- 172.21.15.107:0/1676144422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40d4102070 0x7f40d4196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:24.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 -- 172.21.15.107:0/1676144422 >> 172.21.15.107:0/1676144422 conn(0x7f40d40faf50 msgr2=0x7f40d410cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:24.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 -- 172.21.15.107:0/1676144422 shutdown_connections 2023-08-10T11:01:24.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:24.252+0000 7f40dad9d700 1 -- 172.21.15.107:0/1676144422 wait complete. 2023-08-10T11:01:24.272 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:01:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:23 smithi157 ceph-mon[129604]: pgmap v316: 129 pgs: 129 active+clean; 8.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 28 MiB/s wr, 81 op/s 2023-08-10T11:01:24.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:23 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:25.313 INFO:teuthology.orchestra.run.smithi107.stderr:41200000 of 50000000 tuples (82%) done (elapsed 583.49 s, remaining 124.63 s) 2023-08-10T11:01:26.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:25 smithi107 ceph-mon[127953]: pgmap v317: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 70 op/s 2023-08-10T11:01:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:25 smithi195 ceph-mon[129938]: pgmap v317: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 70 op/s 2023-08-10T11:01:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:25 smithi157 ceph-mon[129604]: pgmap v317: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 70 op/s 2023-08-10T11:01:26.519 INFO:teuthology.orchestra.run.smithi107.stderr:41300000 of 50000000 tuples (82%) done (elapsed 584.70 s, remaining 123.17 s) 2023-08-10T11:01:28.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:27 smithi107 ceph-mon[127953]: pgmap v318: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 63 op/s 2023-08-10T11:01:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:27 smithi195 ceph-mon[129938]: pgmap v318: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 63 op/s 2023-08-10T11:01:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:27 smithi157 ceph-mon[129604]: pgmap v318: 129 pgs: 129 active+clean; 8.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 63 op/s 2023-08-10T11:01:28.293 INFO:teuthology.orchestra.run.smithi107.stderr:41400000 of 50000000 tuples (82%) done (elapsed 586.47 s, remaining 121.83 s) 2023-08-10T11:01:29.559 INFO:teuthology.orchestra.run.smithi107.stderr:41500000 of 50000000 tuples (83%) done (elapsed 587.74 s, remaining 120.38 s) 2023-08-10T11:01:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:29 smithi107 ceph-mon[127953]: pgmap v319: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-08-10T11:01:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:29 smithi195 ceph-mon[129938]: pgmap v319: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-08-10T11:01:30.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:29 smithi157 ceph-mon[129604]: pgmap v319: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-08-10T11:01:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:31 smithi107 ceph-mon[127953]: pgmap v320: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 43 op/s 2023-08-10T11:01:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:31 smithi195 ceph-mon[129938]: pgmap v320: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 43 op/s 2023-08-10T11:01:32.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:31 smithi157 ceph-mon[129604]: pgmap v320: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 43 op/s 2023-08-10T11:01:33.109 INFO:teuthology.orchestra.run.smithi107.stderr:41600000 of 50000000 tuples (83%) done (elapsed 591.29 s, remaining 119.39 s) 2023-08-10T11:01:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:33 smithi195 ceph-mon[129938]: pgmap v321: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 43 op/s 2023-08-10T11:01:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:33 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:01:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:33 smithi157 ceph-mon[129604]: pgmap v321: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 43 op/s 2023-08-10T11:01:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:33 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:01:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:33 smithi107 ceph-mon[127953]: pgmap v321: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 43 op/s 2023-08-10T11:01:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:33 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:01:34.566 INFO:teuthology.orchestra.run.smithi107.stderr:41700000 of 50000000 tuples (83%) done (elapsed 592.74 s, remaining 117.98 s) 2023-08-10T11:01:35.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:35 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:35.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:35 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:35.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:35 smithi107 ceph-mon[127953]: pgmap v322: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 31 MiB/s wr, 56 op/s 2023-08-10T11:01:35.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:35 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:35.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:35 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:35.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:35 smithi195 ceph-mon[129938]: pgmap v322: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 31 MiB/s wr, 56 op/s 2023-08-10T11:01:35.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:35 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:35.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:35 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:35.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:35 smithi157 ceph-mon[129604]: pgmap v322: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 31 MiB/s wr, 56 op/s 2023-08-10T11:01:35.946 INFO:teuthology.orchestra.run.smithi107.stderr:41800000 of 50000000 tuples (83%) done (elapsed 594.12 s, remaining 116.55 s) 2023-08-10T11:01:37.250 INFO:teuthology.orchestra.run.smithi107.stderr:41900000 of 50000000 tuples (83%) done (elapsed 595.43 s, remaining 115.11 s) 2023-08-10T11:01:37.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:37 smithi195 ceph-mon[129938]: pgmap v323: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 19 MiB/s wr, 25 op/s 2023-08-10T11:01:37.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:37 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:37.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:37 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:38.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:37 smithi157 ceph-mon[129604]: pgmap v323: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 19 MiB/s wr, 25 op/s 2023-08-10T11:01:38.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:37 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:38.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:37 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:37 smithi107 ceph-mon[127953]: pgmap v323: 129 pgs: 129 active+clean; 8.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 19 MiB/s wr, 25 op/s 2023-08-10T11:01:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:37 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:37 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:38.712 INFO:teuthology.orchestra.run.smithi107.stderr:42000000 of 50000000 tuples (84%) done (elapsed 596.89 s, remaining 113.69 s) 2023-08-10T11:01:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:39.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:38 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:39.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:38 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:39.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:38 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:39.954 INFO:teuthology.orchestra.run.smithi107.stderr:42100000 of 50000000 tuples (84%) done (elapsed 598.13 s, remaining 112.24 s) 2023-08-10T11:01:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T11:01:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T11:01:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: pgmap v324: 129 pgs: 129 active+clean; 8.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 30 MiB/s wr, 56 op/s 2023-08-10T11:01:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T11:01:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T11:01:40.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:01:40.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:01:40.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:39 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T11:01:40.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T11:01:40.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: pgmap v324: 129 pgs: 129 active+clean; 8.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 30 MiB/s wr, 56 op/s 2023-08-10T11:01:40.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T11:01:40.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T11:01:40.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:01:40.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:01:40.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:39 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T11:01:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T11:01:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: pgmap v324: 129 pgs: 129 active+clean; 8.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 30 MiB/s wr, 56 op/s 2023-08-10T11:01:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T11:01:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T11:01:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:01:40.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:01:40.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:01:40.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:39 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:01:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:40 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T11:01:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:40 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T11:01:41.186 INFO:teuthology.orchestra.run.smithi107.stderr:42200000 of 50000000 tuples (84%) done (elapsed 599.36 s, remaining 110.78 s) 2023-08-10T11:01:41.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:40 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T11:01:41.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:40 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T11:01:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:40 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T11:01:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:40 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T11:01:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:41 smithi195 ceph-mon[129938]: pgmap v325: 129 pgs: 129 active+clean; 8.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 17 MiB/s wr, 44 op/s 2023-08-10T11:01:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:41 smithi157 ceph-mon[129604]: pgmap v325: 129 pgs: 129 active+clean; 8.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 17 MiB/s wr, 44 op/s 2023-08-10T11:01:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:41 smithi107 ceph-mon[127953]: pgmap v325: 129 pgs: 129 active+clean; 8.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 17 MiB/s wr, 44 op/s 2023-08-10T11:01:42.540 INFO:teuthology.orchestra.run.smithi107.stderr:42300000 of 50000000 tuples (84%) done (elapsed 600.72 s, remaining 109.35 s) 2023-08-10T11:01:43.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:42 smithi195 ceph-mon[129938]: pgmap v326: 129 pgs: 129 active+clean; 8.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 17 MiB/s wr, 44 op/s 2023-08-10T11:01:43.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:42 smithi157 ceph-mon[129604]: pgmap v326: 129 pgs: 129 active+clean; 8.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 17 MiB/s wr, 44 op/s 2023-08-10T11:01:43.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:42 smithi107 ceph-mon[127953]: pgmap v326: 129 pgs: 129 active+clean; 8.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 17 MiB/s wr, 44 op/s 2023-08-10T11:01:43.781 INFO:teuthology.orchestra.run.smithi107.stderr:42400000 of 50000000 tuples (84%) done (elapsed 601.96 s, remaining 107.90 s) 2023-08-10T11:01:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:43 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:43 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:43 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:45.059 INFO:teuthology.orchestra.run.smithi107.stderr:42500000 of 50000000 tuples (85%) done (elapsed 603.24 s, remaining 106.45 s) 2023-08-10T11:01:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:44 smithi195 ceph-mon[129938]: pgmap v327: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 29 MiB/s wr, 62 op/s 2023-08-10T11:01:45.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:44 smithi157 ceph-mon[129604]: pgmap v327: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 29 MiB/s wr, 62 op/s 2023-08-10T11:01:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:44 smithi107 ceph-mon[127953]: pgmap v327: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 29 MiB/s wr, 62 op/s 2023-08-10T11:01:46.317 INFO:teuthology.orchestra.run.smithi107.stderr:42600000 of 50000000 tuples (85%) done (elapsed 604.49 s, remaining 105.01 s) 2023-08-10T11:01:47.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:47 smithi195 ceph-mon[129938]: pgmap v328: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 22 MiB/s wr, 49 op/s 2023-08-10T11:01:48.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:47 smithi157 ceph-mon[129604]: pgmap v328: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 22 MiB/s wr, 49 op/s 2023-08-10T11:01:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:47 smithi107 ceph-mon[127953]: pgmap v328: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 22 MiB/s wr, 49 op/s 2023-08-10T11:01:48.456 INFO:teuthology.orchestra.run.smithi107.stderr:42700000 of 50000000 tuples (85%) done (elapsed 606.63 s, remaining 103.71 s) 2023-08-10T11:01:49.756 INFO:teuthology.orchestra.run.smithi107.stderr:42800000 of 50000000 tuples (85%) done (elapsed 607.93 s, remaining 102.27 s) 2023-08-10T11:01:50.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:49 smithi107 ceph-mon[127953]: pgmap v329: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 33 MiB/s wr, 84 op/s 2023-08-10T11:01:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:49 smithi195 ceph-mon[129938]: pgmap v329: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 33 MiB/s wr, 84 op/s 2023-08-10T11:01:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:49 smithi157 ceph-mon[129604]: pgmap v329: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 33 MiB/s wr, 84 op/s 2023-08-10T11:01:51.000 INFO:teuthology.orchestra.run.smithi107.stderr:42900000 of 50000000 tuples (85%) done (elapsed 609.18 s, remaining 100.82 s) 2023-08-10T11:01:52.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:51 smithi107 ceph-mon[127953]: pgmap v330: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-08-10T11:01:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:51 smithi195 ceph-mon[129938]: pgmap v330: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-08-10T11:01:52.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:51 smithi157 ceph-mon[129604]: pgmap v330: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-08-10T11:01:52.333 INFO:teuthology.orchestra.run.smithi107.stderr:43000000 of 50000000 tuples (86%) done (elapsed 610.51 s, remaining 99.39 s) 2023-08-10T11:01:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:53 smithi107 ceph-mon[127953]: pgmap v331: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-08-10T11:01:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:53 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:53 smithi195 ceph-mon[129938]: pgmap v331: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-08-10T11:01:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:53 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:54.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:01:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:53 smithi157 ceph-mon[129604]: pgmap v331: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-08-10T11:01:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:53 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:01:54.478 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.477+0000 7fdb203ff700 1 -- 172.21.15.107:0/3789188679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb18101080 msgr2=0x7fdb1810d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:54.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.477+0000 7fdb203ff700 1 --2- 172.21.15.107:0/3789188679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb18101080 0x7fdb1810d590 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000b0a0 tx=0x7fdb1000b3b0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.477+0000 7fdb203ff700 1 -- 172.21.15.107:0/3789188679 shutdown_connections 2023-08-10T11:01:54.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.477+0000 7fdb203ff700 1 --2- 172.21.15.107:0/3789188679 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb181066d0 0x7fdb18106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.477+0000 7fdb203ff700 1 --2- 172.21.15.107:0/3789188679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb18101080 0x7fdb1810d590 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.477+0000 7fdb203ff700 1 --2- 172.21.15.107:0/3789188679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb181006c0 0x7fdb18100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.477+0000 7fdb203ff700 1 -- 172.21.15.107:0/3789188679 >> 172.21.15.107:0/3789188679 conn(0x7fdb180fc1f0 msgr2=0x7fdb180fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:54.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.477+0000 7fdb203ff700 1 -- 172.21.15.107:0/3789188679 shutdown_connections 2023-08-10T11:01:54.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.477+0000 7fdb203ff700 1 -- 172.21.15.107:0/3789188679 wait complete. 2023-08-10T11:01:54.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.478+0000 7fdb203ff700 1 Processor -- start 2023-08-10T11:01:54.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.478+0000 7fdb203ff700 1 -- start start 2023-08-10T11:01:54.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb203ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb181006c0 0x7fdb18072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb203ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb18101080 0x7fdb18072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb203ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb181066d0 0x7fdb181a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb203ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180737e0 con 0x7fdb181066d0 2023-08-10T11:01:54.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb203ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb181a4dc0 con 0x7fdb181006c0 2023-08-10T11:01:54.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb203ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb181a4f00 con 0x7fdb18101080 2023-08-10T11:01:54.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1d99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb18101080 0x7fdb18072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1d99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb18101080 0x7fdb18072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:34480/0 (socket says 172.21.15.107:34480) 2023-08-10T11:01:54.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1d99a700 1 -- 172.21.15.107:0/1210927774 learned_addr learned my addr 172.21.15.107:0/1210927774 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:54.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1e99c700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb181066d0 0x7fdb181a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb181006c0 0x7fdb18072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1d99a700 1 -- 172.21.15.107:0/1210927774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb181006c0 msgr2=0x7fdb18072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:54.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb181006c0 0x7fdb18072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1d99a700 1 -- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb181066d0 msgr2=0x7fdb181a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:54.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb181066d0 0x7fdb181a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1d99a700 1 -- 172.21.15.107:0/1210927774 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb10009d00 con 0x7fdb18101080 2023-08-10T11:01:54.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.479+0000 7fdb1e99c700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb181066d0 0x7fdb181a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:01:54.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.480+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb18101080 0x7fdb18072fb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e9a0 tx=0x7fdb0800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:54.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.480+0000 7fdb0f7fe700 1 -- 172.21.15.107:0/1210927774 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08009790 con 0x7fdb18101080 2023-08-10T11:01:54.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.480+0000 7fdb0f7fe700 1 -- 172.21.15.107:0/1210927774 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb08010430 con 0x7fdb18101080 2023-08-10T11:01:54.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.480+0000 7fdb203ff700 1 -- 172.21.15.107:0/1210927774 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb181a5160 con 0x7fdb18101080 2023-08-10T11:01:54.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.480+0000 7fdb0f7fe700 1 -- 172.21.15.107:0/1210927774 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800cea0 con 0x7fdb18101080 2023-08-10T11:01:54.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.480+0000 7fdb203ff700 1 -- 172.21.15.107:0/1210927774 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb181a5640 con 0x7fdb18101080 2023-08-10T11:01:54.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.483+0000 7fdb0f7fe700 1 -- 172.21.15.107:0/1210927774 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdb080105a0 con 0x7fdb18101080 2023-08-10T11:01:54.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.484+0000 7fdb33c60b80 1 Processor -- start 2023-08-10T11:01:54.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb33c60b80 1 -- start start 2023-08-10T11:01:54.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133bf50 0x5601a133c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 0x5601a13362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 0x5601a1336c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a12b1dc0 con 0x5601a133c870 2023-08-10T11:01:54.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a128e590 con 0x5601a1336800 2023-08-10T11:01:54.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a128beb0 con 0x5601a133bf50 2023-08-10T11:01:54.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb1e99c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133bf50 0x5601a133c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb1e19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 0x5601a13362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.488 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb1e99c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133bf50 0x5601a133c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:34492/0 (socket says 172.21.15.107:34492) 2023-08-10T11:01:54.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb1e99c700 1 -- 172.21.15.107:0/869800199 learned_addr learned my addr 172.21.15.107:0/869800199 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:54.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb0f7fe700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdb040a12c0 0x7fdb040a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.485+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/869800199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 0x5601a1336c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb0f7fe700 1 -- 172.21.15.107:0/1210927774 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fdb08014070 con 0x7fdb18101080 2023-08-10T11:01:54.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb1e19b700 1 -- 172.21.15.107:0/869800199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133bf50 msgr2=0x5601a133c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:54.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/869800199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133bf50 0x5601a133c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.489 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb1e19b700 1 -- 172.21.15.107:0/869800199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 msgr2=0x5601a1336c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:54.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/869800199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 0x5601a1336c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb1e19b700 1 -- 172.21.15.107:0/869800199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601a1108630 con 0x5601a133c870 2023-08-10T11:01:54.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb1e99c700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdb040a12c0 0x7fdb040a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/869800199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 0x5601a13362c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009cb0 tx=0x7fdb140058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1214ed79efbc343 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:54.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb0cbfe700 1 -- 172.21.15.107:0/869800199 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14011ce0 con 0x5601a133c870 2023-08-10T11:01:54.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb0cbfe700 1 -- 172.21.15.107:0/869800199 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb14011e40 con 0x5601a133c870 2023-08-10T11:01:54.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.486+0000 7fdb0cbfe700 1 -- 172.21.15.107:0/869800199 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14005280 con 0x5601a133c870 2023-08-10T11:01:54.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb33c60b80 1 -- 172.21.15.107:0/869800199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 msgr2=0x5601a13362c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:54.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb1e99c700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdb040a12c0 0x7fdb040a3780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009610 tx=0x7fdb100099e0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:54.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/869800199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 0x5601a13362c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009cb0 tx=0x7fdb140058e0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb33c60b80 1 -- 172.21.15.107:0/869800199 shutdown_connections 2023-08-10T11:01:54.493 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/869800199 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 0x5601a1336c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/869800199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133bf50 0x5601a133c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/869800199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 0x5601a13362c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb33c60b80 1 -- 172.21.15.107:0/869800199 >> 172.21.15.107:0/869800199 conn(0x5601a1293cd0 msgr2=0x5601a13314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:54.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb33c60b80 1 -- 172.21.15.107:0/869800199 shutdown_connections 2023-08-10T11:01:54.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.487+0000 7fdb33c60b80 1 -- 172.21.15.107:0/869800199 wait complete. 2023-08-10T11:01:54.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.488+0000 7fdb33c60b80 1 -- start start 2023-08-10T11:01:54.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.488+0000 7fdb33c60b80 1 Processor -- start 2023-08-10T11:01:54.494 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a1336800 0x5601a1342910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 0x5601a133fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 0x5601a1340210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a12877a0 con 0x5601a133c870 2023-08-10T11:01:54.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a1226ac0 con 0x5601a133bf50 2023-08-10T11:01:54.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a12267c0 con 0x5601a1336800 2023-08-10T11:01:54.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb33c60b80 10 client.0 _ll_register_callbacks cb 0x5601a1224680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:01:54.495 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1e19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a1336800 0x5601a1342910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1e99c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 0x5601a1340210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1e19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a1336800 0x5601a1342910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:34502/0 (socket says 172.21.15.107:34502) 2023-08-10T11:01:54.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1e19b700 1 -- 172.21.15.107:0/4134296038 learned_addr learned my addr 172.21.15.107:0/4134296038 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:54.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 0x5601a133fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1e19b700 1 -- 172.21.15.107:0/4134296038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 msgr2=0x5601a133fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:54.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 0x5601a133fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1e19b700 1 -- 172.21.15.107:0/4134296038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 msgr2=0x5601a1340210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:54.496 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 0x5601a1340210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.489+0000 7fdb1e19b700 1 -- 172.21.15.107:0/4134296038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb140098e0 con 0x5601a1336800 2023-08-10T11:01:54.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.490+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a1336800 0x5601a1342910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000c00 tx=0x7fdb14011b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf8e286a9dc9419c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:54.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.490+0000 7fdb01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:01:54.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.490+0000 7fdb01ffb700 1 -- 172.21.15.107:0/4134296038 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14004260 con 0x5601a1336800 2023-08-10T11:01:54.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.490+0000 7fdb33c60b80 1 -- 172.21.15.107:0/4134296038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601a1329470 con 0x5601a1336800 2023-08-10T11:01:54.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.490+0000 7fdb01ffb700 1 -- 172.21.15.107:0/4134296038 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fdb140043c0 con 0x5601a1336800 2023-08-10T11:01:54.497 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.490+0000 7fdb01ffb700 1 -- 172.21.15.107:0/4134296038 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb14004580 con 0x5601a1336800 2023-08-10T11:01:54.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.490+0000 7fdb33c60b80 10 client.26404 fetch_fsmap learned FSMap version 51 2023-08-10T11:01:54.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.490+0000 7fdb33c60b80 1 -- 172.21.15.107:0/4134296038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x5601a10b4de0 con 0x5601a1336800 2023-08-10T11:01:54.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.491+0000 7fdb01ffb700 1 -- 172.21.15.107:0/4134296038 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5601a1329470 con 0x5601a1336800 2023-08-10T11:01:54.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.491+0000 7fdb01ffb700 1 -- 172.21.15.107:0/4134296038 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 51) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fdb14005180 con 0x5601a1336800 2023-08-10T11:01:54.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.491+0000 7fdb33c60b80 10 client.26404 fetch_fsmap finished waiting for FSMap version 51 2023-08-10T11:01:54.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.491+0000 7fdb33c60b80 10 client.26404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:01:54.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.491+0000 7fdb33c60b80 20 client.26404 populate_metadata read hostname 'smithi107' 2023-08-10T11:01:54.498 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.491+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601a13501d0 0x5601a13525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.491+0000 7fdb33c60b80 4 client.26404 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:01:54.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.491+0000 7fdb33c60b80 1 -- 172.21.15.107:0/4134296038 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601a13059d0 con 0x5601a13501d0 2023-08-10T11:01:54.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.491+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601a13501d0 0x5601a13525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.492+0000 7fdb01ffb700 10 client.26404 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:01:54.499 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.492+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601a13501d0 0x5601a13525f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=350497762cd62570 server_cookie=f5892fcfad23101f in_seq=0 out_seq=0 2023-08-10T11:01:54.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb01ffb700 1 -- 172.21.15.107:0/4134296038 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5601a13059d0 con 0x5601a13501d0 2023-08-10T11:01:54.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb01ffb700 10 client.26404 handle_command_reply: tid=0 2023-08-10T11:01:54.500 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 client.26404 shutdown 2023-08-10T11:01:54.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 -- 172.21.15.107:0/4134296038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a1336800 msgr2=0x5601a1342910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:54.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a1336800 0x5601a1342910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000c00 tx=0x7fdb14011b60 comp rx=0 tx=0).stop 2023-08-10T11:01:54.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 -- 172.21.15.107:0/4134296038 shutdown_connections 2023-08-10T11:01:54.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601a13501d0 0x5601a13525f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133c870 0x5601a1340210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a1336800 0x5601a1342910 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.501 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb01ffb700 0 client.26404 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:01:54.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/4134296038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 0x5601a133fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 -- 172.21.15.107:0/4134296038 >> 172.21.15.107:0/4134296038 conn(0x5601a1293cd0 msgr2=0x5601a13309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:54.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 -- 172.21.15.107:0/4134296038 shutdown_connections 2023-08-10T11:01:54.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 1 -- 172.21.15.107:0/4134296038 wait complete. 2023-08-10T11:01:54.502 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.493+0000 7fdb33c60b80 20 client.26404 trim_cache size 0 max 16384 2023-08-10T11:01:54.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.510+0000 7fdb33c60b80 1 Processor -- start 2023-08-10T11:01:54.511 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.510+0000 7fdb33c60b80 1 -- start start 2023-08-10T11:01:54.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a1336800 0x5601a1347370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 0x5601a133b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a1331130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a110a920 con 0x5601a1336800 2023-08-10T11:01:54.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a133a5d0 con 0x5601a133bf50 2023-08-10T11:01:54.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a133fe20 con 0x5601a133c870 2023-08-10T11:01:54.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a1336800 0x5601a1347370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a1336800 0x5601a1347370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44618/0 (socket says 172.21.15.107:44618) 2023-08-10T11:01:54.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e19b700 1 -- 172.21.15.107:0/3764440445 learned_addr learned my addr 172.21.15.107:0/3764440445 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:54.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e99c700 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a1331130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 0x5601a133b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e19b700 1 -- 172.21.15.107:0/3764440445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 msgr2=0x5601a1331130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:54.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a1331130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e19b700 1 -- 172.21.15.107:0/3764440445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 msgr2=0x5601a133b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:54.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 0x5601a133b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e19b700 1 -- 172.21.15.107:0/3764440445 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601a109dc60 con 0x5601a1336800 2023-08-10T11:01:54.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e99c700 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a1331130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:01:54.515 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 0x5601a133b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:01:54.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.511+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a1336800 0x5601a1347370 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005950 tx=0x7fdb14009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360977a276f57733 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:54.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb0d3ff700 1 -- 172.21.15.107:0/3764440445 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14011c80 con 0x5601a1336800 2023-08-10T11:01:54.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb0d3ff700 1 -- 172.21.15.107:0/3764440445 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb14011720 con 0x5601a1336800 2023-08-10T11:01:54.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb0d3ff700 1 -- 172.21.15.107:0/3764440445 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14003680 con 0x5601a1336800 2023-08-10T11:01:54.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb33c60b80 1 -- 172.21.15.107:0/3764440445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a1336800 msgr2=0x5601a1347370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:54.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a1336800 0x5601a1347370 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005950 tx=0x7fdb14009750 comp rx=0 tx=0).stop 2023-08-10T11:01:54.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb33c60b80 1 -- 172.21.15.107:0/3764440445 shutdown_connections 2023-08-10T11:01:54.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a1331130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a1336800 0x5601a1347370 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/3764440445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a133bf50 0x5601a133b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb33c60b80 1 -- 172.21.15.107:0/3764440445 >> 172.21.15.107:0/3764440445 conn(0x5601a1293cd0 msgr2=0x5601a133ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:54.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb33c60b80 1 -- 172.21.15.107:0/3764440445 shutdown_connections 2023-08-10T11:01:54.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.512+0000 7fdb33c60b80 1 -- 172.21.15.107:0/3764440445 wait complete. 2023-08-10T11:01:54.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.513+0000 7fdb33c60b80 1 -- start start 2023-08-10T11:01:54.520 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.513+0000 7fdb33c60b80 1 Processor -- start 2023-08-10T11:01:54.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 0x5601a13450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133bf50 0x5601a13455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb33c60b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a139ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a139d3c0 con 0x5601a133bf50 2023-08-10T11:01:54.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a139d530 con 0x5601a1336800 2023-08-10T11:01:54.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb33c60b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601a139d6f0 con 0x5601a133c870 2023-08-10T11:01:54.521 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb33c60b80 10 client.0 _ll_register_callbacks cb 0x5601a1224680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:01:54.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb1d99a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133bf50 0x5601a13455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb1d99a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133bf50 0x5601a13455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44620/0 (socket says 172.21.15.107:44620) 2023-08-10T11:01:54.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb1d99a700 1 -- 172.21.15.107:0/912352720 learned_addr learned my addr 172.21.15.107:0/912352720 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:01:54.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb1e99c700 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a139ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb1d99a700 1 -- 172.21.15.107:0/912352720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 msgr2=0x5601a139ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:54.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 0x5601a13450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a139ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.522 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb1d99a700 1 -- 172.21.15.107:0/912352720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 msgr2=0x5601a13450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:01:54.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.514+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 0x5601a13450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb1d99a700 1 -- 172.21.15.107:0/912352720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601a10b4de0 con 0x5601a133bf50 2023-08-10T11:01:54.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb1e99c700 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a139ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:01:54.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 0x5601a13450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:01:54.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb1d99a700 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133bf50 0x5601a13455f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdb08096540 tx=0x7fdb0808f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efaf0521d847340 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:01:54.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:01:54.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb01ffb700 1 -- 172.21.15.107:0/912352720 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08065700 con 0x5601a133bf50 2023-08-10T11:01:54.523 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb01ffb700 1 -- 172.21.15.107:0/912352720 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fdb08010880 con 0x5601a133bf50 2023-08-10T11:01:54.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb33c60b80 1 -- 172.21.15.107:0/912352720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb14011e40 con 0x5601a133bf50 2023-08-10T11:01:54.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb01ffb700 1 -- 172.21.15.107:0/912352720 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb0809a040 con 0x5601a133bf50 2023-08-10T11:01:54.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb33c60b80 10 client.16713 fetch_fsmap learned FSMap version 51 2023-08-10T11:01:54.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb33c60b80 1 -- 172.21.15.107:0/912352720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x5601a10db250 con 0x5601a133bf50 2023-08-10T11:01:54.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb01ffb700 1 -- 172.21.15.107:0/912352720 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb14011e40 con 0x5601a133bf50 2023-08-10T11:01:54.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.515+0000 7fdb01ffb700 1 -- 172.21.15.107:0/912352720 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 51) v1 ==== 7490+0+0 (secure 0 0 0) 0x7fdb08099530 con 0x5601a133bf50 2023-08-10T11:01:54.524 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.516+0000 7fdb33c60b80 10 client.16713 fetch_fsmap finished waiting for FSMap version 51 2023-08-10T11:01:54.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.516+0000 7fdb33c60b80 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:01:54.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.516+0000 7fdb33c60b80 20 client.16713 populate_metadata read hostname 'smithi107' 2023-08-10T11:01:54.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.516+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601a13a4ea0 0x5601a13a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:01:54.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.516+0000 7fdb33c60b80 4 client.16713 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:01:54.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.516+0000 7fdb33c60b80 1 -- 172.21.15.107:0/912352720 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5601a1280780 con 0x5601a13a4ea0 2023-08-10T11:01:54.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.516+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601a13a4ea0 0x5601a13a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:01:54.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb1e19b700 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601a13a4ea0 0x5601a13a72c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=291d67d26ea167d2 server_cookie=c892b7878e56c1e5 in_seq=0 out_seq=0 2023-08-10T11:01:54.525 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb01ffb700 10 client.16713 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:01:54.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb01ffb700 1 -- 172.21.15.107:0/912352720 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5601a1280780 con 0x5601a13a4ea0 2023-08-10T11:01:54.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb01ffb700 10 client.16713 handle_command_reply: tid=0 2023-08-10T11:01:54.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 client.16713 shutdown 2023-08-10T11:01:54.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 -- 172.21.15.107:0/912352720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133bf50 msgr2=0x5601a13455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:54.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133bf50 0x5601a13455f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdb08096540 tx=0x7fdb0808f9d0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 -- 172.21.15.107:0/912352720 shutdown_connections 2023-08-10T11:01:54.526 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601a13a4ea0 0x5601a13a72c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5601a1336800 0x5601a13450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601a133c870 0x5601a139ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb01ffb700 0 client.16713 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:01:54.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 --2- 172.21.15.107:0/912352720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601a133bf50 0x5601a13455f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 -- 172.21.15.107:0/912352720 >> 172.21.15.107:0/912352720 conn(0x5601a1293cd0 msgr2=0x5601a133cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:54.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 -- 172.21.15.107:0/912352720 shutdown_connections 2023-08-10T11:01:54.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 1 -- 172.21.15.107:0/912352720 wait complete. 2023-08-10T11:01:54.527 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.517+0000 7fdb33c60b80 20 client.16713 trim_cache size 0 max 16384 2023-08-10T11:01:54.528 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:01:54.528 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:01:54.528 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:01:54.528 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:01:54.528 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:01:54.529 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:01:54.529 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:01:54.529 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:01:54.529 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:01:54.529 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:01:54.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 -- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdb040a12c0 msgr2=0x7fdb040a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:54.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdb040a12c0 0x7fdb040a3780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009610 tx=0x7fdb100099e0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 -- 172.21.15.107:0/1210927774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb18101080 msgr2=0x7fdb18072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:01:54.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb18101080 0x7fdb18072fb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e9a0 tx=0x7fdb0800ecb0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 -- 172.21.15.107:0/1210927774 shutdown_connections 2023-08-10T11:01:54.530 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fdb040a12c0 0x7fdb040a3780 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb181006c0 0x7fdb18072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdb181066d0 0x7fdb181a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 --2- 172.21.15.107:0/1210927774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb18101080 0x7fdb18072fb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:01:54.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 -- 172.21.15.107:0/1210927774 >> 172.21.15.107:0/1210927774 conn(0x7fdb180fc1f0 msgr2=0x7fdb180fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:01:54.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 -- 172.21.15.107:0/1210927774 shutdown_connections 2023-08-10T11:01:54.531 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:01:54.518+0000 7fdb203ff700 1 -- 172.21.15.107:0/1210927774 wait complete. 2023-08-10T11:01:54.536 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:01:56.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:55 smithi107 ceph-mon[127953]: pgmap v332: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 33 MiB/s wr, 88 op/s 2023-08-10T11:01:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:55 smithi195 ceph-mon[129938]: pgmap v332: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 33 MiB/s wr, 88 op/s 2023-08-10T11:01:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:55 smithi157 ceph-mon[129604]: pgmap v332: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 33 MiB/s wr, 88 op/s 2023-08-10T11:01:57.524 INFO:teuthology.orchestra.run.smithi107.stderr:43100000 of 50000000 tuples (86%) done (elapsed 615.70 s, remaining 98.57 s) 2023-08-10T11:01:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:57 smithi107 ceph-mon[127953]: pgmap v333: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 21 MiB/s wr, 71 op/s 2023-08-10T11:01:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:57 smithi195 ceph-mon[129938]: pgmap v333: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 21 MiB/s wr, 71 op/s 2023-08-10T11:01:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:57 smithi157 ceph-mon[129604]: pgmap v333: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 21 MiB/s wr, 71 op/s 2023-08-10T11:01:59.003 INFO:teuthology.orchestra.run.smithi107.stderr:43200000 of 50000000 tuples (86%) done (elapsed 617.18 s, remaining 97.15 s) 2023-08-10T11:02:00.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:01:59 smithi107 ceph-mon[127953]: pgmap v334: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 23 MiB/s wr, 84 op/s 2023-08-10T11:02:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:01:59 smithi195 ceph-mon[129938]: pgmap v334: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 23 MiB/s wr, 84 op/s 2023-08-10T11:02:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:01:59 smithi157 ceph-mon[129604]: pgmap v334: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 23 MiB/s wr, 84 op/s 2023-08-10T11:02:00.338 INFO:teuthology.orchestra.run.smithi107.stderr:43300000 of 50000000 tuples (86%) done (elapsed 618.52 s, remaining 95.71 s) 2023-08-10T11:02:01.690 INFO:teuthology.orchestra.run.smithi107.stderr:43400000 of 50000000 tuples (86%) done (elapsed 619.87 s, remaining 94.27 s) 2023-08-10T11:02:02.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:01 smithi107 ceph-mon[127953]: pgmap v335: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 50 op/s 2023-08-10T11:02:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:01 smithi195 ceph-mon[129938]: pgmap v335: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 50 op/s 2023-08-10T11:02:02.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:01 smithi157 ceph-mon[129604]: pgmap v335: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 50 op/s 2023-08-10T11:02:03.741 INFO:teuthology.orchestra.run.smithi107.stderr:43500000 of 50000000 tuples (87%) done (elapsed 621.92 s, remaining 92.93 s) 2023-08-10T11:02:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:03 smithi195 ceph-mon[129938]: pgmap v336: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 50 op/s 2023-08-10T11:02:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:03 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:02:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:03 smithi157 ceph-mon[129604]: pgmap v336: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 50 op/s 2023-08-10T11:02:04.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:03 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:02:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:03 smithi107 ceph-mon[127953]: pgmap v336: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 50 op/s 2023-08-10T11:02:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:03 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:02:05.003 INFO:teuthology.orchestra.run.smithi107.stderr:43600000 of 50000000 tuples (87%) done (elapsed 623.18 s, remaining 91.48 s) 2023-08-10T11:02:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:05 smithi195 ceph-mon[129938]: pgmap v337: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 23 MiB/s wr, 105 op/s 2023-08-10T11:02:06.266 INFO:teuthology.orchestra.run.smithi107.stderr:43700000 of 50000000 tuples (87%) done (elapsed 624.44 s, remaining 90.02 s) 2023-08-10T11:02:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:05 smithi157 ceph-mon[129604]: pgmap v337: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 23 MiB/s wr, 105 op/s 2023-08-10T11:02:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:05 smithi107 ceph-mon[127953]: pgmap v337: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 23 MiB/s wr, 105 op/s 2023-08-10T11:02:07.605 INFO:teuthology.orchestra.run.smithi107.stderr:43800000 of 50000000 tuples (87%) done (elapsed 625.78 s, remaining 88.58 s) 2023-08-10T11:02:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:07 smithi195 ceph-mon[129938]: pgmap v338: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 12 MiB/s wr, 68 op/s 2023-08-10T11:02:08.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:07 smithi157 ceph-mon[129604]: pgmap v338: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 12 MiB/s wr, 68 op/s 2023-08-10T11:02:08.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:07 smithi107 ceph-mon[127953]: pgmap v338: 129 pgs: 129 active+clean; 9.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 12 MiB/s wr, 68 op/s 2023-08-10T11:02:09.001 INFO:teuthology.orchestra.run.smithi107.stderr:43900000 of 50000000 tuples (87%) done (elapsed 627.18 s, remaining 87.15 s) 2023-08-10T11:02:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:08 smithi195 ceph-mon[129938]: osdmap e103: 12 total, 12 up, 12 in 2023-08-10T11:02:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:08 smithi157 ceph-mon[129604]: osdmap e103: 12 total, 12 up, 12 in 2023-08-10T11:02:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:08 smithi107 ceph-mon[127953]: osdmap e103: 12 total, 12 up, 12 in 2023-08-10T11:02:10.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:09 smithi195 ceph-mon[129938]: pgmap v340: 129 pgs: 129 active+clean; 8.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 25 MiB/s wr, 108 op/s 2023-08-10T11:02:10.260 INFO:teuthology.orchestra.run.smithi107.stderr:44000000 of 50000000 tuples (88%) done (elapsed 628.44 s, remaining 85.70 s) 2023-08-10T11:02:10.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:09 smithi157 ceph-mon[129604]: pgmap v340: 129 pgs: 129 active+clean; 8.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 25 MiB/s wr, 108 op/s 2023-08-10T11:02:10.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:09 smithi107 ceph-mon[127953]: pgmap v340: 129 pgs: 129 active+clean; 8.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 25 MiB/s wr, 108 op/s 2023-08-10T11:02:11.580 INFO:teuthology.orchestra.run.smithi107.stderr:44100000 of 50000000 tuples (88%) done (elapsed 629.76 s, remaining 84.25 s) 2023-08-10T11:02:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:11 smithi195 ceph-mon[129938]: pgmap v341: 129 pgs: 129 active+clean; 8.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 25 MiB/s wr, 108 op/s 2023-08-10T11:02:12.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:11 smithi157 ceph-mon[129604]: pgmap v341: 129 pgs: 129 active+clean; 8.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 25 MiB/s wr, 108 op/s 2023-08-10T11:02:12.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:11 smithi107 ceph-mon[127953]: pgmap v341: 129 pgs: 129 active+clean; 8.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 25 MiB/s wr, 108 op/s 2023-08-10T11:02:12.862 INFO:teuthology.orchestra.run.smithi107.stderr:44200000 of 50000000 tuples (88%) done (elapsed 631.04 s, remaining 82.81 s) 2023-08-10T11:02:14.113 INFO:teuthology.orchestra.run.smithi107.stderr:44300000 of 50000000 tuples (88%) done (elapsed 632.29 s, remaining 81.36 s) 2023-08-10T11:02:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:13 smithi195 ceph-mon[129938]: pgmap v342: 129 pgs: 129 active+clean; 8.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 25 MiB/s wr, 108 op/s 2023-08-10T11:02:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:13 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:02:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:13 smithi195 ceph-mon[129938]: osdmap e104: 12 total, 12 up, 12 in 2023-08-10T11:02:14.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:13 smithi157 ceph-mon[129604]: pgmap v342: 129 pgs: 129 active+clean; 8.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 25 MiB/s wr, 108 op/s 2023-08-10T11:02:14.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:13 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:02:14.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:13 smithi157 ceph-mon[129604]: osdmap e104: 12 total, 12 up, 12 in 2023-08-10T11:02:14.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:13 smithi107 ceph-mon[127953]: pgmap v342: 129 pgs: 129 active+clean; 8.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 25 MiB/s wr, 108 op/s 2023-08-10T11:02:14.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:13 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:02:14.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:13 smithi107 ceph-mon[127953]: osdmap e104: 12 total, 12 up, 12 in 2023-08-10T11:02:15.472 INFO:teuthology.orchestra.run.smithi107.stderr:44400000 of 50000000 tuples (88%) done (elapsed 633.65 s, remaining 79.92 s) 2023-08-10T11:02:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:15 smithi195 ceph-mon[129938]: pgmap v344: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 107 op/s 2023-08-10T11:02:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:15 smithi157 ceph-mon[129604]: pgmap v344: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 107 op/s 2023-08-10T11:02:16.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:15 smithi107 ceph-mon[127953]: pgmap v344: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 107 op/s 2023-08-10T11:02:16.727 INFO:teuthology.orchestra.run.smithi107.stderr:44500000 of 50000000 tuples (89%) done (elapsed 634.90 s, remaining 78.47 s) 2023-08-10T11:02:17.957 INFO:teuthology.orchestra.run.smithi107.stderr:44600000 of 50000000 tuples (89%) done (elapsed 636.13 s, remaining 77.02 s) 2023-08-10T11:02:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:17 smithi195 ceph-mon[129938]: pgmap v345: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 MiB/s wr, 98 op/s 2023-08-10T11:02:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:17 smithi157 ceph-mon[129604]: pgmap v345: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 MiB/s wr, 98 op/s 2023-08-10T11:02:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:17 smithi107 ceph-mon[127953]: pgmap v345: 129 pgs: 129 active+clean; 8.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 MiB/s wr, 98 op/s 2023-08-10T11:02:19.195 INFO:teuthology.orchestra.run.smithi107.stderr:44700000 of 50000000 tuples (89%) done (elapsed 637.37 s, remaining 75.57 s) 2023-08-10T11:02:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:19 smithi195 ceph-mon[129938]: pgmap v346: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-08-10T11:02:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:19 smithi157 ceph-mon[129604]: pgmap v346: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-08-10T11:02:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:19 smithi107 ceph-mon[127953]: pgmap v346: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-08-10T11:02:20.492 INFO:teuthology.orchestra.run.smithi107.stderr:44800000 of 50000000 tuples (89%) done (elapsed 638.67 s, remaining 74.13 s) 2023-08-10T11:02:21.727 INFO:teuthology.orchestra.run.smithi107.stderr:44900000 of 50000000 tuples (89%) done (elapsed 639.90 s, remaining 72.68 s) 2023-08-10T11:02:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:21 smithi195 ceph-mon[129938]: pgmap v347: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-08-10T11:02:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:21 smithi157 ceph-mon[129604]: pgmap v347: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-08-10T11:02:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:21 smithi107 ceph-mon[127953]: pgmap v347: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-08-10T11:02:22.980 INFO:teuthology.orchestra.run.smithi107.stderr:45000000 of 50000000 tuples (90%) done (elapsed 641.16 s, remaining 71.24 s) 2023-08-10T11:02:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:23 smithi195 ceph-mon[129938]: pgmap v348: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-08-10T11:02:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:23 smithi157 ceph-mon[129604]: pgmap v348: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-08-10T11:02:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:23 smithi107 ceph-mon[127953]: pgmap v348: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-08-10T11:02:24.345 INFO:teuthology.orchestra.run.smithi107.stderr:45100000 of 50000000 tuples (90%) done (elapsed 642.52 s, remaining 69.81 s) 2023-08-10T11:02:24.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:02:24.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.772+0000 7f25717ff700 1 -- 172.21.15.107:0/4026311482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f256c073460 msgr2=0x7f256c10ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.772+0000 7f25717ff700 1 --2- 172.21.15.107:0/4026311482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f256c073460 0x7f256c10ca10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2560009990 tx=0x7f2560009ca0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.772+0000 7f25717ff700 1 -- 172.21.15.107:0/4026311482 shutdown_connections 2023-08-10T11:02:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.772+0000 7f25717ff700 1 --2- 172.21.15.107:0/4026311482 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f256c072b40 0x7f256c072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.772+0000 7f25717ff700 1 --2- 172.21.15.107:0/4026311482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256c10cf50 0x7f256c10f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.772+0000 7f25717ff700 1 --2- 172.21.15.107:0/4026311482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f256c073460 0x7f256c10ca10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.772+0000 7f25717ff700 1 -- 172.21.15.107:0/4026311482 >> 172.21.15.107:0/4026311482 conn(0x7f256c0fc1e0 msgr2=0x7f256c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:24.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.772+0000 7f25717ff700 1 -- 172.21.15.107:0/4026311482 shutdown_connections 2023-08-10T11:02:24.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.772+0000 7f25717ff700 1 -- 172.21.15.107:0/4026311482 wait complete. 2023-08-10T11:02:24.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.773+0000 7f25717ff700 1 Processor -- start 2023-08-10T11:02:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f25717ff700 1 -- start start 2023-08-10T11:02:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f25717ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f256c072b40 0x7f256c19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f25717ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256c073460 0x7f256c19ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f25717ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f256c10cf50 0x7f256c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f25717ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c198e70 con 0x7f256c10cf50 2023-08-10T11:02:24.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f25717ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c198fe0 con 0x7f256c072b40 2023-08-10T11:02:24.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f25717ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c1991a0 con 0x7f256c073460 2023-08-10T11:02:24.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f256affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f256c072b40 0x7f256c19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f256a7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256c073460 0x7f256c19ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f256b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f256c10cf50 0x7f256c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.774+0000 7f256affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f256c072b40 0x7f256c19e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:35512/0 (socket says 172.21.15.107:35512) 2023-08-10T11:02:24.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f256affd700 1 -- 172.21.15.107:0/1788488915 learned_addr learned my addr 172.21.15.107:0/1788488915 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:24.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f256a7fc700 1 -- 172.21.15.107:0/1788488915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f256c072b40 msgr2=0x7f256c19e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:24.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f256a7fc700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f256c072b40 0x7f256c19e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f256a7fc700 1 -- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f256c10cf50 msgr2=0x7f256c198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:24.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f256a7fc700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f256c10cf50 0x7f256c198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f256a7fc700 1 -- 172.21.15.107:0/1788488915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600095f0 con 0x7f256c073460 2023-08-10T11:02:24.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f256affd700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f256c072b40 0x7f256c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:02:24.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f256b7fe700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f256c10cf50 0x7f256c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:02:24.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f256a7fc700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256c073460 0x7f256c19ecd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2560006010 tx=0x7f2560005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:24.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.775+0000 7f2553fff700 1 -- 172.21.15.107:0/1788488915 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256001d070 con 0x7f256c073460 2023-08-10T11:02:24.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.776+0000 7f2553fff700 1 -- 172.21.15.107:0/1788488915 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25600173f0 con 0x7f256c073460 2023-08-10T11:02:24.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.776+0000 7f2553fff700 1 -- 172.21.15.107:0/1788488915 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e640 con 0x7f256c073460 2023-08-10T11:02:24.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.776+0000 7f25717ff700 1 -- 172.21.15.107:0/1788488915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c199420 con 0x7f256c073460 2023-08-10T11:02:24.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.776+0000 7f25717ff700 1 -- 172.21.15.107:0/1788488915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c199640 con 0x7f256c073460 2023-08-10T11:02:24.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.779+0000 7f2553fff700 1 -- 172.21.15.107:0/1788488915 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2560017560 con 0x7f256c073460 2023-08-10T11:02:24.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.781+0000 7f2585084b80 1 Processor -- start 2023-08-10T11:02:24.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.781+0000 7f2585084b80 1 -- start start 2023-08-10T11:02:24.782 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.781+0000 7f2553fff700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f25540a12c0 0x7f25540a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.781+0000 7f2585084b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5668330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.781+0000 7f2585084b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e56622c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.781+0000 7f2553fff700 1 -- 172.21.15.107:0/1788488915 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f25600ce370 con 0x7f256c073460 2023-08-10T11:02:24.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.781+0000 7f2585084b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5662c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f2585084b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e55dddc0 con 0x5574e5662800 2023-08-10T11:02:24.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f2585084b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e55ba590 con 0x5574e5668870 2023-08-10T11:02:24.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f2585084b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e55b7eb0 con 0x5574e5667f50 2023-08-10T11:02:24.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5668330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5668330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:56698/0 (socket says 172.21.15.107:56698) 2023-08-10T11:02:24.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256affd700 1 -- 172.21.15.107:0/2130707301 learned_addr learned my addr 172.21.15.107:0/2130707301 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:24.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256b7fe700 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5662c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256a7fc700 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e56622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256b7fe700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f25540a12c0 0x7f25540a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256affd700 1 -- 172.21.15.107:0/2130707301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 msgr2=0x5574e56622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:24.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256affd700 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e56622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256affd700 1 -- 172.21.15.107:0/2130707301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 msgr2=0x5574e5662c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:24.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256affd700 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5662c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256affd700 1 -- 172.21.15.107:0/2130707301 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574e5434630 con 0x5574e5667f50 2023-08-10T11:02:24.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.782+0000 7f256a7fc700 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e56622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:02:24.786 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.783+0000 7f256affd700 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5668330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f255c0117e0 tx=0x7f255c011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77a6f5ad85fc8fa1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:24.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.783+0000 7f256b7fe700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f25540a12c0 0x7f25540a3780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2564009ec0 tx=0x7f256400b040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:24.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.783+0000 7f25517fa700 1 -- 172.21.15.107:0/2130707301 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c00f480 con 0x5574e5667f50 2023-08-10T11:02:24.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.783+0000 7f25517fa700 1 -- 172.21.15.107:0/2130707301 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f255c00fa70 con 0x5574e5667f50 2023-08-10T11:02:24.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.783+0000 7f25517fa700 1 -- 172.21.15.107:0/2130707301 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c019980 con 0x5574e5667f50 2023-08-10T11:02:24.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.784+0000 7f2585084b80 1 -- 172.21.15.107:0/2130707301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 msgr2=0x5574e5668330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:24.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.784+0000 7f2585084b80 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5668330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f255c0117e0 tx=0x7f255c011af0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.784+0000 7f2585084b80 1 -- 172.21.15.107:0/2130707301 shutdown_connections 2023-08-10T11:02:24.789 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.784+0000 7f2585084b80 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5662c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.784+0000 7f2585084b80 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5668330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.784+0000 7f2585084b80 1 --2- 172.21.15.107:0/2130707301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e56622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.784+0000 7f2585084b80 1 -- 172.21.15.107:0/2130707301 >> 172.21.15.107:0/2130707301 conn(0x5574e55bfcd0 msgr2=0x5574e565d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:24.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.784+0000 7f2585084b80 1 -- 172.21.15.107:0/2130707301 shutdown_connections 2023-08-10T11:02:24.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.784+0000 7f2585084b80 1 -- 172.21.15.107:0/2130707301 wait complete. 2023-08-10T11:02:24.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.785+0000 7f2585084b80 1 -- start start 2023-08-10T11:02:24.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.785+0000 7f2585084b80 1 Processor -- start 2023-08-10T11:02:24.790 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.785+0000 7f2585084b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5662800 0x5574e566e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.785+0000 7f2585084b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5667f50 0x5574e566bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.785+0000 7f2585084b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5668870 0x5574e566c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.785+0000 7f2585084b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e55b37a0 con 0x5574e5668870 2023-08-10T11:02:24.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.785+0000 7f2585084b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e5552ac0 con 0x5574e5667f50 2023-08-10T11:02:24.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.785+0000 7f2585084b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e55527c0 con 0x5574e5662800 2023-08-10T11:02:24.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.785+0000 7f2585084b80 10 client.0 _ll_register_callbacks cb 0x5574e5550680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:02:24.791 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5668870 0x5574e566c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256a7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5667f50 0x5574e566bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5668870 0x5574e566c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43504/0 (socket says 172.21.15.107:43504) 2023-08-10T11:02:24.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256b7fe700 1 -- 172.21.15.107:0/2355661010 learned_addr learned my addr 172.21.15.107:0/2355661010 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:24.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256a7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5667f50 0x5574e566bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:35526/0 (socket says 172.21.15.107:35526) 2023-08-10T11:02:24.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256affd700 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5662800 0x5574e566e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256a7fc700 1 -- 172.21.15.107:0/2355661010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5662800 msgr2=0x5574e566e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:24.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256a7fc700 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5662800 0x5574e566e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.792 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256a7fc700 1 -- 172.21.15.107:0/2355661010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5668870 msgr2=0x5574e566c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:24.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256a7fc700 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5668870 0x5574e566c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256a7fc700 1 -- 172.21.15.107:0/2355661010 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c199640 con 0x5574e5667f50 2023-08-10T11:02:24.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256b7fe700 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5668870 0x5574e566c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:02:24.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256affd700 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5662800 0x5574e566e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:02:24.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f256a7fc700 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5667f50 0x5574e566bc40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f25600cb710 tx=0x7f2560005860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5dcc73b6bc8c79e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:24.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.786+0000 7f254eff5700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T11:02:24.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f254eff5700 1 -- 172.21.15.107:0/2355661010 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560020370 con 0x5574e5667f50 2023-08-10T11:02:24.793 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f254eff5700 1 -- 172.21.15.107:0/2355661010 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f256009b120 con 0x5574e5667f50 2023-08-10T11:02:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f2585084b80 1 -- 172.21.15.107:0/2355661010 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574e5655470 con 0x5574e5667f50 2023-08-10T11:02:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f254eff5700 1 -- 172.21.15.107:0/2355661010 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f256009f150 con 0x5574e5667f50 2023-08-10T11:02:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f2585084b80 10 client.26375 fetch_fsmap learned FSMap version 53 2023-08-10T11:02:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f2585084b80 1 -- 172.21.15.107:0/2355661010 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7f255c011440 con 0x5574e5667f50 2023-08-10T11:02:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f254eff5700 1 -- 172.21.15.107:0/2355661010 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5574e5655470 con 0x5574e5667f50 2023-08-10T11:02:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f254eff5700 1 -- 172.21.15.107:0/2355661010 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 53) v1 ==== 7506+0+0 (secure 0 0 0) 0x7f256009a6a0 con 0x5574e5667f50 2023-08-10T11:02:24.794 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f2585084b80 10 client.26375 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T11:02:24.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f2585084b80 10 client.26375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:02:24.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f2585084b80 20 client.26375 populate_metadata read hostname 'smithi107' 2023-08-10T11:02:24.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f2585084b80 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5574e567bef0 0x5574e567e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f2585084b80 4 client.26375 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:02:24.795 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.787+0000 7f2585084b80 1 -- 172.21.15.107:0/2355661010 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574e56319d0 con 0x5574e567bef0 2023-08-10T11:02:24.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.788+0000 7f256affd700 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5574e567bef0 0x5574e567e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.788+0000 7f254eff5700 10 client.26375 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:02:24.796 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.788+0000 7f256affd700 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5574e567bef0 0x5574e567e310 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4d16cb42f2d3477 server_cookie=94ad5659ad4d6811 in_seq=0 out_seq=0 2023-08-10T11:02:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f254eff5700 1 -- 172.21.15.107:0/2355661010 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5574e56319d0 con 0x5574e567bef0 2023-08-10T11:02:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f254eff5700 10 client.26375 handle_command_reply: tid=0 2023-08-10T11:02:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 client.26375 shutdown 2023-08-10T11:02:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 -- 172.21.15.107:0/2355661010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5667f50 msgr2=0x5574e566bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5667f50 0x5574e566bc40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f25600cb710 tx=0x7f2560005860 comp rx=0 tx=0).stop 2023-08-10T11:02:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 -- 172.21.15.107:0/2355661010 shutdown_connections 2023-08-10T11:02:24.797 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5574e567bef0 0x5574e567e310 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5668870 0x5574e566c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5662800 0x5574e566e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 --2- 172.21.15.107:0/2355661010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5667f50 0x5574e566bc40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f254eff5700 0 client.26375 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:02:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 -- 172.21.15.107:0/2355661010 >> 172.21.15.107:0/2355661010 conn(0x5574e55bfcd0 msgr2=0x5574e565c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 -- 172.21.15.107:0/2355661010 shutdown_connections 2023-08-10T11:02:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.789+0000 7f2585084b80 1 -- 172.21.15.107:0/2355661010 wait complete. 2023-08-10T11:02:24.798 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.790+0000 7f2585084b80 20 client.26375 trim_cache size 0 max 16384 2023-08-10T11:02:24.809 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.808+0000 7f2585084b80 1 Processor -- start 2023-08-10T11:02:24.810 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f2585084b80 1 -- start start 2023-08-10T11:02:24.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f2585084b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5667370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f2585084b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e565d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f2585084b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e566e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f2585084b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e5436920 con 0x5574e5662800 2023-08-10T11:02:24.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f2585084b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e565e430 con 0x5574e5668870 2023-08-10T11:02:24.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f2585084b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e566cbf0 con 0x5574e5667f50 2023-08-10T11:02:24.811 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f256affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5667370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f256affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5667370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43520/0 (socket says 172.21.15.107:43520) 2023-08-10T11:02:24.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f256affd700 1 -- 172.21.15.107:0/4004741063 learned_addr learned my addr 172.21.15.107:0/4004741063 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:24.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f256a7fc700 1 --2- 172.21.15.107:0/4004741063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e565d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.809+0000 7f256b7fe700 1 --2- 172.21.15.107:0/4004741063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e566e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.810+0000 7f256affd700 1 -- 172.21.15.107:0/4004741063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 msgr2=0x5574e565d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:24.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.810+0000 7f256affd700 1 --2- 172.21.15.107:0/4004741063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e565d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.812 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.810+0000 7f256affd700 1 -- 172.21.15.107:0/4004741063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 msgr2=0x5574e566e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:24.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.810+0000 7f256affd700 1 --2- 172.21.15.107:0/4004741063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e566e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.813 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.810+0000 7f256affd700 1 -- 172.21.15.107:0/4004741063 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574e53e0de0 con 0x5574e5662800 2023-08-10T11:02:24.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.810+0000 7f256affd700 1 --2- 172.21.15.107:0/4004741063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5667370 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f255c011e40 tx=0x7f255c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f251d447eb5eb7e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:24.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.810+0000 7f2551ffb700 1 -- 172.21.15.107:0/4004741063 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c00fee0 con 0x5574e5662800 2023-08-10T11:02:24.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.810+0000 7f2551ffb700 1 -- 172.21.15.107:0/4004741063 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f255c00f480 con 0x5574e5662800 2023-08-10T11:02:24.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.810+0000 7f2551ffb700 1 -- 172.21.15.107:0/4004741063 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c025d80 con 0x5574e5662800 2023-08-10T11:02:24.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.811+0000 7f2585084b80 1 -- 172.21.15.107:0/4004741063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 msgr2=0x5574e5667370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:24.815 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.811+0000 7f2585084b80 1 --2- 172.21.15.107:0/4004741063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5667370 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f255c011e40 tx=0x7f255c009f50 comp rx=0 tx=0).stop 2023-08-10T11:02:24.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.811+0000 7f2585084b80 1 -- 172.21.15.107:0/4004741063 shutdown_connections 2023-08-10T11:02:24.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.811+0000 7f2585084b80 1 --2- 172.21.15.107:0/4004741063 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e566e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.811+0000 7f2585084b80 1 --2- 172.21.15.107:0/4004741063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5667370 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.811+0000 7f2585084b80 1 --2- 172.21.15.107:0/4004741063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e565d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.811+0000 7f2585084b80 1 -- 172.21.15.107:0/4004741063 >> 172.21.15.107:0/4004741063 conn(0x5574e55bfcd0 msgr2=0x5574e5666c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:24.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.811+0000 7f2585084b80 1 -- 172.21.15.107:0/4004741063 shutdown_connections 2023-08-10T11:02:24.816 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.811+0000 7f2585084b80 1 -- 172.21.15.107:0/4004741063 wait complete. 2023-08-10T11:02:24.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.812+0000 7f2585084b80 1 -- start start 2023-08-10T11:02:24.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.812+0000 7f2585084b80 1 Processor -- start 2023-08-10T11:02:24.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.812+0000 7f2585084b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5672fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.812+0000 7f2585084b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5671350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.812+0000 7f2585084b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e5671890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.812+0000 7f2585084b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e5671dd0 con 0x5574e5662800 2023-08-10T11:02:24.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.812+0000 7f2585084b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e5671f40 con 0x5574e5668870 2023-08-10T11:02:24.817 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.812+0000 7f2585084b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574e5672100 con 0x5574e5667f50 2023-08-10T11:02:24.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.812+0000 7f2585084b80 10 client.0 _ll_register_callbacks cb 0x5574e5550680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:02:24.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256a7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5671350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256a7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5671350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:56720/0 (socket says 172.21.15.107:56720) 2023-08-10T11:02:24.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256a7fc700 1 -- 172.21.15.107:0/4185400304 learned_addr learned my addr 172.21.15.107:0/4185400304 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:24.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256affd700 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5672fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256b7fe700 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e5671890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.818 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256a7fc700 1 -- 172.21.15.107:0/4185400304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 msgr2=0x5574e5671890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:24.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256a7fc700 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e5671890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256a7fc700 1 -- 172.21.15.107:0/4185400304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 msgr2=0x5574e5672fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:24.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256a7fc700 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5672fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256a7fc700 1 -- 172.21.15.107:0/4185400304 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574e5434630 con 0x5574e5667f50 2023-08-10T11:02:24.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256b7fe700 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e5671890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:02:24.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f256a7fc700 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5671350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2560097b90 tx=0x7f25600cb7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63520e4fb30f937 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:24.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f254eff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:02:24.819 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.813+0000 7f254eff5700 1 -- 172.21.15.107:0/4185400304 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600a3050 con 0x5574e5667f50 2023-08-10T11:02:24.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f254eff5700 1 -- 172.21.15.107:0/4185400304 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f2560020370 con 0x5574e5667f50 2023-08-10T11:02:24.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f2585084b80 1 -- 172.21.15.107:0/4185400304 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f255c00fa70 con 0x5574e5667f50 2023-08-10T11:02:24.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f254eff5700 1 -- 172.21.15.107:0/4185400304 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f256009b120 con 0x5574e5667f50 2023-08-10T11:02:24.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f2585084b80 10 client.26425 fetch_fsmap learned FSMap version 53 2023-08-10T11:02:24.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f2585084b80 1 -- 172.21.15.107:0/4185400304 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5574e53c9c60 con 0x5574e5667f50 2023-08-10T11:02:24.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f254eff5700 1 -- 172.21.15.107:0/4185400304 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f255c00fa70 con 0x5574e5667f50 2023-08-10T11:02:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f254eff5700 1 -- 172.21.15.107:0/4185400304 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 53) v1 ==== 7506+0+0 (secure 0 0 0) 0x7f25600b92e0 con 0x5574e5667f50 2023-08-10T11:02:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f2585084b80 10 client.26425 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T11:02:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f2585084b80 10 client.26425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:02:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f2585084b80 20 client.26425 populate_metadata read hostname 'smithi107' 2023-08-10T11:02:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f2585084b80 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5574e56d0b90 0x5574e56d2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f2585084b80 4 client.26425 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:02:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.814+0000 7f2585084b80 1 -- 172.21.15.107:0/4185400304 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5574e55ac780 con 0x5574e56d0b90 2023-08-10T11:02:24.822 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.815+0000 7f256affd700 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5574e56d0b90 0x5574e56d2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:24.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.815+0000 7f254eff5700 10 client.26425 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:02:24.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.815+0000 7f256affd700 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5574e56d0b90 0x5574e56d2fb0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa691ed38d2bdfa0 server_cookie=ba22e099270644fe in_seq=0 out_seq=0 2023-08-10T11:02:24.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.815+0000 7f254eff5700 1 -- 172.21.15.107:0/4185400304 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5574e55ac780 con 0x5574e56d0b90 2023-08-10T11:02:24.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.815+0000 7f254eff5700 10 client.26425 handle_command_reply: tid=0 2023-08-10T11:02:24.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.815+0000 7f2585084b80 1 client.26425 shutdown 2023-08-10T11:02:24.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.815+0000 7f2585084b80 1 -- 172.21.15.107:0/4185400304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 msgr2=0x5574e5671350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:24.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5671350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2560097b90 tx=0x7f25600cb7f0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 1 -- 172.21.15.107:0/4185400304 shutdown_connections 2023-08-10T11:02:24.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5574e56d0b90 0x5574e56d2fb0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5574e5668870 0x5574e5671890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5574e5662800 0x5574e5672fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f254eff5700 0 client.26425 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:02:24.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 1 --2- 172.21.15.107:0/4185400304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5574e5667f50 0x5574e5671350 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 1 -- 172.21.15.107:0/4185400304 >> 172.21.15.107:0/4185400304 conn(0x5574e55bfcd0 msgr2=0x5574e5668d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:24.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 1 -- 172.21.15.107:0/4185400304 shutdown_connections 2023-08-10T11:02:24.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 1 -- 172.21.15.107:0/4185400304 wait complete. 2023-08-10T11:02:24.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.816+0000 7f2585084b80 20 client.26425 trim_cache size 0 max 16384 2023-08-10T11:02:24.825 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:02:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:02:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:02:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:02:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:02:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:02:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:02:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:02:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:02:24.826 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:02:24.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 -- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f25540a12c0 msgr2=0x7f25540a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:24.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f25540a12c0 0x7f25540a3780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2564009ec0 tx=0x7f256400b040 comp rx=0 tx=0).stop 2023-08-10T11:02:24.827 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 -- 172.21.15.107:0/1788488915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256c073460 msgr2=0x7f256c19ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:24.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256c073460 0x7f256c19ecd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2560006010 tx=0x7f2560005740 comp rx=0 tx=0).stop 2023-08-10T11:02:24.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 -- 172.21.15.107:0/1788488915 shutdown_connections 2023-08-10T11:02:24.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f25540a12c0 0x7f25540a3780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f256c072b40 0x7f256c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f256c10cf50 0x7f256c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 --2- 172.21.15.107:0/1788488915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f256c073460 0x7f256c19ecd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:24.828 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 -- 172.21.15.107:0/1788488915 >> 172.21.15.107:0/1788488915 conn(0x7f256c0fc1e0 msgr2=0x7f256c0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:24.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 -- 172.21.15.107:0/1788488915 shutdown_connections 2023-08-10T11:02:24.829 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:24.817+0000 7f25717ff700 1 -- 172.21.15.107:0/1788488915 wait complete. 2023-08-10T11:02:24.837 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:02:25.598 INFO:teuthology.orchestra.run.smithi107.stderr:45200000 of 50000000 tuples (90%) done (elapsed 643.78 s, remaining 68.37 s) 2023-08-10T11:02:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:25 smithi195 ceph-mon[129938]: pgmap v349: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 MiB/s wr, 68 op/s 2023-08-10T11:02:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:25 smithi157 ceph-mon[129604]: pgmap v349: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 MiB/s wr, 68 op/s 2023-08-10T11:02:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:25 smithi107 ceph-mon[127953]: pgmap v349: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 MiB/s wr, 68 op/s 2023-08-10T11:02:26.824 INFO:teuthology.orchestra.run.smithi107.stderr:45300000 of 50000000 tuples (90%) done (elapsed 645.00 s, remaining 66.92 s) 2023-08-10T11:02:28.083 INFO:teuthology.orchestra.run.smithi107.stderr:45400000 of 50000000 tuples (90%) done (elapsed 646.26 s, remaining 65.48 s) 2023-08-10T11:02:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:27 smithi195 ceph-mon[129938]: pgmap v350: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:02:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:27 smithi157 ceph-mon[129604]: pgmap v350: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:02:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:27 smithi107 ceph-mon[127953]: pgmap v350: 129 pgs: 129 active+clean; 9.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:02:29.420 INFO:teuthology.orchestra.run.smithi107.stderr:45500000 of 50000000 tuples (91%) done (elapsed 647.60 s, remaining 64.05 s) 2023-08-10T11:02:30.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:29 smithi107 ceph-mon[127953]: pgmap v351: 129 pgs: 129 active+clean; 9.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 89 op/s 2023-08-10T11:02:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:29 smithi195 ceph-mon[129938]: pgmap v351: 129 pgs: 129 active+clean; 9.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 89 op/s 2023-08-10T11:02:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:29 smithi157 ceph-mon[129604]: pgmap v351: 129 pgs: 129 active+clean; 9.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 89 op/s 2023-08-10T11:02:30.757 INFO:teuthology.orchestra.run.smithi107.stderr:45600000 of 50000000 tuples (91%) done (elapsed 648.93 s, remaining 62.62 s) 2023-08-10T11:02:32.010 INFO:teuthology.orchestra.run.smithi107.stderr:45700000 of 50000000 tuples (91%) done (elapsed 650.19 s, remaining 61.18 s) 2023-08-10T11:02:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:31 smithi107 ceph-mon[127953]: pgmap v352: 129 pgs: 129 active+clean; 9.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-08-10T11:02:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:31 smithi195 ceph-mon[129938]: pgmap v352: 129 pgs: 129 active+clean; 9.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-08-10T11:02:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:31 smithi157 ceph-mon[129604]: pgmap v352: 129 pgs: 129 active+clean; 9.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-08-10T11:02:33.336 INFO:teuthology.orchestra.run.smithi107.stderr:45800000 of 50000000 tuples (91%) done (elapsed 651.51 s, remaining 59.75 s) 2023-08-10T11:02:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:33 smithi107 ceph-mon[127953]: pgmap v353: 129 pgs: 129 active+clean; 9.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-08-10T11:02:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:33 smithi195 ceph-mon[129938]: pgmap v353: 129 pgs: 129 active+clean; 9.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-08-10T11:02:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:33 smithi157 ceph-mon[129604]: pgmap v353: 129 pgs: 129 active+clean; 9.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-08-10T11:02:34.718 INFO:teuthology.orchestra.run.smithi107.stderr:45900000 of 50000000 tuples (91%) done (elapsed 652.90 s, remaining 58.32 s) 2023-08-10T11:02:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:46000000 of 50000000 tuples (92%) done (elapsed 654.10 s, remaining 56.88 s) 2023-08-10T11:02:36.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:35 smithi107 ceph-mon[127953]: pgmap v354: 129 pgs: 129 active+clean; 9.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 35 MiB/s wr, 97 op/s 2023-08-10T11:02:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:35 smithi195 ceph-mon[129938]: pgmap v354: 129 pgs: 129 active+clean; 9.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 35 MiB/s wr, 97 op/s 2023-08-10T11:02:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:35 smithi157 ceph-mon[129604]: pgmap v354: 129 pgs: 129 active+clean; 9.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 35 MiB/s wr, 97 op/s 2023-08-10T11:02:37.167 INFO:teuthology.orchestra.run.smithi107.stderr:46100000 of 50000000 tuples (92%) done (elapsed 655.34 s, remaining 55.44 s) 2023-08-10T11:02:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:37 smithi107 ceph-mon[127953]: pgmap v355: 129 pgs: 129 active+clean; 9.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-08-10T11:02:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:37 smithi195 ceph-mon[129938]: pgmap v355: 129 pgs: 129 active+clean; 9.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-08-10T11:02:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:37 smithi157 ceph-mon[129604]: pgmap v355: 129 pgs: 129 active+clean; 9.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-08-10T11:02:38.502 INFO:teuthology.orchestra.run.smithi107.stderr:46200000 of 50000000 tuples (92%) done (elapsed 656.68 s, remaining 54.01 s) 2023-08-10T11:02:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:39 smithi195 ceph-mon[129938]: pgmap v356: 129 pgs: 129 active+clean; 9.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 35 MiB/s wr, 97 op/s 2023-08-10T11:02:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:39 smithi157 ceph-mon[129604]: pgmap v356: 129 pgs: 129 active+clean; 9.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 35 MiB/s wr, 97 op/s 2023-08-10T11:02:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:39 smithi107 ceph-mon[127953]: pgmap v356: 129 pgs: 129 active+clean; 9.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 35 MiB/s wr, 97 op/s 2023-08-10T11:02:41.100 INFO:teuthology.orchestra.run.smithi107.stderr:46300000 of 50000000 tuples (92%) done (elapsed 659.28 s, remaining 52.69 s) 2023-08-10T11:02:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:40 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:02:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:40 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:40 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:40 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:40 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:40 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:02:41.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:40 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:40 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:40 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:40 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:40 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:02:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:40 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:40 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:40 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:41.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:40 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:41 smithi195 ceph-mon[129938]: pgmap v357: 129 pgs: 129 active+clean; 9.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T11:02:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:41 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:02:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:41 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:02:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:41 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:41 smithi157 ceph-mon[129604]: pgmap v357: 129 pgs: 129 active+clean; 9.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T11:02:42.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:41 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:02:42.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:41 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:02:42.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:41 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:41 smithi107 ceph-mon[127953]: pgmap v357: 129 pgs: 129 active+clean; 9.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T11:02:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:41 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:02:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:41 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:02:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:41 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:02:42.423 INFO:teuthology.orchestra.run.smithi107.stderr:46400000 of 50000000 tuples (92%) done (elapsed 660.60 s, remaining 51.25 s) 2023-08-10T11:02:43.756 INFO:teuthology.orchestra.run.smithi107.stderr:46500000 of 50000000 tuples (93%) done (elapsed 661.93 s, remaining 49.82 s) 2023-08-10T11:02:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:43 smithi195 ceph-mon[129938]: pgmap v358: 129 pgs: 129 active+clean; 9.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T11:02:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:43 smithi157 ceph-mon[129604]: pgmap v358: 129 pgs: 129 active+clean; 9.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T11:02:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:43 smithi107 ceph-mon[127953]: pgmap v358: 129 pgs: 129 active+clean; 9.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T11:02:45.028 INFO:teuthology.orchestra.run.smithi107.stderr:46600000 of 50000000 tuples (93%) done (elapsed 663.21 s, remaining 48.39 s) 2023-08-10T11:02:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:45 smithi195 ceph-mon[129938]: pgmap v359: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 31 MiB/s wr, 102 op/s 2023-08-10T11:02:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:45 smithi157 ceph-mon[129604]: pgmap v359: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 31 MiB/s wr, 102 op/s 2023-08-10T11:02:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:45 smithi107 ceph-mon[127953]: pgmap v359: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 31 MiB/s wr, 102 op/s 2023-08-10T11:02:46.333 INFO:teuthology.orchestra.run.smithi107.stderr:46700000 of 50000000 tuples (93%) done (elapsed 664.51 s, remaining 46.96 s) 2023-08-10T11:02:47.563 INFO:teuthology.orchestra.run.smithi107.stderr:46800000 of 50000000 tuples (93%) done (elapsed 665.74 s, remaining 45.52 s) 2023-08-10T11:02:48.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:47 smithi195 ceph-mon[129938]: pgmap v360: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 20 MiB/s wr, 58 op/s 2023-08-10T11:02:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:47 smithi157 ceph-mon[129604]: pgmap v360: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 20 MiB/s wr, 58 op/s 2023-08-10T11:02:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:47 smithi107 ceph-mon[127953]: pgmap v360: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 20 MiB/s wr, 58 op/s 2023-08-10T11:02:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:49 smithi195 ceph-mon[129938]: pgmap v361: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 31 MiB/s wr, 95 op/s 2023-08-10T11:02:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:49 smithi157 ceph-mon[129604]: pgmap v361: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 31 MiB/s wr, 95 op/s 2023-08-10T11:02:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:49 smithi107 ceph-mon[127953]: pgmap v361: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 31 MiB/s wr, 95 op/s 2023-08-10T11:02:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:51 smithi195 ceph-mon[129938]: pgmap v362: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 19 MiB/s wr, 68 op/s 2023-08-10T11:02:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:51 smithi157 ceph-mon[129604]: pgmap v362: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 19 MiB/s wr, 68 op/s 2023-08-10T11:02:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:51 smithi107 ceph-mon[127953]: pgmap v362: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 19 MiB/s wr, 68 op/s 2023-08-10T11:02:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:53 smithi195 ceph-mon[129938]: pgmap v363: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 19 MiB/s wr, 68 op/s 2023-08-10T11:02:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:53 smithi157 ceph-mon[129604]: pgmap v363: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 19 MiB/s wr, 68 op/s 2023-08-10T11:02:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:53 smithi107 ceph-mon[127953]: pgmap v363: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 19 MiB/s wr, 68 op/s 2023-08-10T11:02:54.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:02:55.037 INFO:teuthology.orchestra.run.smithi107.stderr:46900000 of 50000000 tuples (93%) done (elapsed 673.21 s, remaining 44.50 s) 2023-08-10T11:02:55.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.085+0000 7f5ae83ff700 1 -- 172.21.15.107:0/2629165185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae0101880 msgr2=0x7f5ae0101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:55.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.085+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/2629165185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae0101880 0x7f5ae0101c60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009990 tx=0x7f5adc009ca0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.085+0000 7f5ae83ff700 1 -- 172.21.15.107:0/2629165185 shutdown_connections 2023-08-10T11:02:55.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.085+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/2629165185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ae010aca0 0x7f5ae010d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.085+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/2629165185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae0101880 0x7f5ae0101c60 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.085+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/2629165185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ae01021a0 0x7f5ae010a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.085+0000 7f5ae83ff700 1 -- 172.21.15.107:0/2629165185 >> 172.21.15.107:0/2629165185 conn(0x7f5ae00fb0c0 msgr2=0x7f5ae00fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:55.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.085+0000 7f5ae83ff700 1 -- 172.21.15.107:0/2629165185 shutdown_connections 2023-08-10T11:02:55.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.085+0000 7f5ae83ff700 1 -- 172.21.15.107:0/2629165185 wait complete. 2023-08-10T11:02:55.088 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.086+0000 7f5ae83ff700 1 Processor -- start 2023-08-10T11:02:55.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.086+0000 7f5ae83ff700 1 -- start start 2023-08-10T11:02:55.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.086+0000 7f5ae83ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ae0101880 0x7f5ae00ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.086+0000 7f5ae83ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae01021a0 0x7f5ae00ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae83ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ae010aca0 0x7f5ae00fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae83ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01a90b0 con 0x7f5ae01021a0 2023-08-10T11:02:55.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae83ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01a91f0 con 0x7f5ae0101880 2023-08-10T11:02:55.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae83ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01a9330 con 0x7f5ae010aca0 2023-08-10T11:02:55.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae599a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae01021a0 0x7f5ae00ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae599a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae01021a0 0x7f5ae00ffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60262/0 (socket says 172.21.15.107:60262) 2023-08-10T11:02:55.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae599a700 1 -- 172.21.15.107:0/3063711602 learned_addr learned my addr 172.21.15.107:0/3063711602 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:55.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae699c700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ae010aca0 0x7f5ae00fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae619b700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ae0101880 0x7f5ae00ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae599a700 1 -- 172.21.15.107:0/3063711602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ae010aca0 msgr2=0x7f5ae00fff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:55.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ae010aca0 0x7f5ae00fff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae599a700 1 -- 172.21.15.107:0/3063711602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ae0101880 msgr2=0x7f5ae00ff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:55.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ae0101880 0x7f5ae00ff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.087+0000 7f5ae599a700 1 -- 172.21.15.107:0/3063711602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0095f0 con 0x7f5ae01021a0 2023-08-10T11:02:55.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.088+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae01021a0 0x7f5ae00ffa10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000e9f0 tx=0x7f5ad000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:55.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.088+0000 7f5ad77fe700 1 -- 172.21.15.107:0/3063711602 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000c9c0 con 0x7f5ae01021a0 2023-08-10T11:02:55.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.088+0000 7f5ad77fe700 1 -- 172.21.15.107:0/3063711602 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ad0010430 con 0x7f5ae01021a0 2023-08-10T11:02:55.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.088+0000 7f5ae83ff700 1 -- 172.21.15.107:0/3063711602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae01a9610 con 0x7f5ae01021a0 2023-08-10T11:02:55.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.088+0000 7f5ad77fe700 1 -- 172.21.15.107:0/3063711602 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0018680 con 0x7f5ae01021a0 2023-08-10T11:02:55.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.088+0000 7f5ae83ff700 1 -- 172.21.15.107:0/3063711602 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae01a9b70 con 0x7f5ae01021a0 2023-08-10T11:02:55.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.091+0000 7f5ad77fe700 1 -- 172.21.15.107:0/3063711602 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5ad00105a0 con 0x7f5ae01021a0 2023-08-10T11:02:55.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5afbdb3b80 1 Processor -- start 2023-08-10T11:02:55.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5ad77fe700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5acc0a1340 0x7f5acc0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5afbdb3b80 1 -- start start 2023-08-10T11:02:55.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5ad77fe700 1 -- 172.21.15.107:0/3063711602 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f5ad0014070 con 0x7f5ae01021a0 2023-08-10T11:02:55.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5ae699c700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5acc0a1340 0x7f5acc0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 0x562edb7d7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d7870 0x562edb7d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 0x562edb7d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb74cdc0 con 0x562edb7d1800 2023-08-10T11:02:55.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb729590 con 0x562edb7d6f50 2023-08-10T11:02:55.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.093+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb726eb0 con 0x562edb7d7870 2023-08-10T11:02:55.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae599a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d7870 0x562edb7d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae599a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d7870 0x562edb7d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:57498/0 (socket says 172.21.15.107:57498) 2023-08-10T11:02:55.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae599a700 1 -- 172.21.15.107:0/3388046330 learned_addr learned my addr 172.21.15.107:0/3388046330 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:55.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae619b700 1 --2- 172.21.15.107:0/3388046330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 0x562edb7d7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae699c700 1 --2- 172.21.15.107:0/3388046330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 0x562edb7d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae599a700 1 -- 172.21.15.107:0/3388046330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 msgr2=0x562edb7d7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:55.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3388046330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 0x562edb7d7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae599a700 1 -- 172.21.15.107:0/3388046330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 msgr2=0x562edb7d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:55.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3388046330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 0x562edb7d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae599a700 1 -- 172.21.15.107:0/3388046330 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562edb5a3630 con 0x562edb7d7870 2023-08-10T11:02:55.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae699c700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5acc0a1340 0x7f5acc0a3800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800f870 tx=0x7f5ad800fc30 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:55.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.094+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3388046330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d7870 0x562edb7d12c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0096b40 tx=0x7f5ad0099ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3fb15762292efa0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:55.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.095+0000 7f5ad4bfe700 1 -- 172.21.15.107:0/3388046330 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00caea0 con 0x562edb7d7870 2023-08-10T11:02:55.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.095+0000 7f5ad4bfe700 1 -- 172.21.15.107:0/3388046330 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ad009a0d0 con 0x562edb7d7870 2023-08-10T11:02:55.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.095+0000 7f5ad4bfe700 1 -- 172.21.15.107:0/3388046330 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00995c0 con 0x562edb7d7870 2023-08-10T11:02:55.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.095+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3388046330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d7870 msgr2=0x562edb7d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:55.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.095+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3388046330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d7870 0x562edb7d12c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0096b40 tx=0x7f5ad0099ce0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.096+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3388046330 shutdown_connections 2023-08-10T11:02:55.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.096+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3388046330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 0x562edb7d7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.096+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3388046330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 0x562edb7d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.161 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.096+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3388046330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d7870 0x562edb7d12c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.096+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3388046330 >> 172.21.15.107:0/3388046330 conn(0x562edb72ecd0 msgr2=0x562edb7cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:55.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.096+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3388046330 shutdown_connections 2023-08-10T11:02:55.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.096+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3388046330 wait complete. 2023-08-10T11:02:55.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.096+0000 7f5afbdb3b80 1 -- start start 2023-08-10T11:02:55.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.096+0000 7f5afbdb3b80 1 Processor -- start 2023-08-10T11:02:55.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7dac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d6f50 0x562edb7db160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.162 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 0x562edb7db6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb7227a0 con 0x562edb7d6f50 2023-08-10T11:02:55.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb6c1ac0 con 0x562edb7d7870 2023-08-10T11:02:55.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb6c17c0 con 0x562edb7d1800 2023-08-10T11:02:55.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5afbdb3b80 10 client.0 _ll_register_callbacks cb 0x562edb6bf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:02:55.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5ae619b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7dac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5ae619b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7dac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:57512/0 (socket says 172.21.15.107:57512) 2023-08-10T11:02:55.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5ae599a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d6f50 0x562edb7db160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5ae619b700 1 -- 172.21.15.107:0/3225762283 learned_addr learned my addr 172.21.15.107:0/3225762283 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:55.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.097+0000 7f5ae699c700 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 0x562edb7db6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5ae619b700 1 -- 172.21.15.107:0/3225762283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 msgr2=0x562edb7db6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:55.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5ae619b700 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 0x562edb7db6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5ae619b700 1 -- 172.21.15.107:0/3225762283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d6f50 msgr2=0x562edb7db160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:55.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5ae619b700 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d6f50 0x562edb7db160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5ae619b700 1 -- 172.21.15.107:0/3225762283 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae01a9b70 con 0x562edb7d1800 2023-08-10T11:02:55.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5ae619b700 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7dac20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5adc000c00 tx=0x7f5adc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f53a2253226232ab server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:55.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5ac9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:02:55.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/3225762283 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc01d070 con 0x562edb7d1800 2023-08-10T11:02:55.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/3225762283 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f5adc004500 con 0x562edb7d1800 2023-08-10T11:02:55.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.098+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3225762283 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562edb7c4470 con 0x562edb7d1800 2023-08-10T11:02:55.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/3225762283 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5adc0046c0 con 0x562edb7d1800 2023-08-10T11:02:55.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5afbdb3b80 10 client.26437 fetch_fsmap learned FSMap version 53 2023-08-10T11:02:55.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3225762283 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x562edb54fde0 con 0x562edb7d1800 2023-08-10T11:02:55.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/3225762283 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562edb7c4470 con 0x562edb7d1800 2023-08-10T11:02:55.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/3225762283 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 53) v1 ==== 7506+0+0 (secure 0 0 0) 0x7f5adc00f870 con 0x562edb7d1800 2023-08-10T11:02:55.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5afbdb3b80 10 client.26437 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T11:02:55.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5afbdb3b80 10 client.26437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:02:55.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5afbdb3b80 20 client.26437 populate_metadata read hostname 'smithi107' 2023-08-10T11:02:55.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562edb7eb2c0 0x562edb7ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5afbdb3b80 4 client.26437 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:02:55.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.099+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3225762283 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562edb7a09d0 con 0x562edb7eb2c0 2023-08-10T11:02:55.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.100+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562edb7eb2c0 0x562edb7ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.100+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562edb7eb2c0 0x562edb7ed6e0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc3ef183bfcb7c81 server_cookie=63b5f92d711dbc87 in_seq=0 out_seq=0 2023-08-10T11:02:55.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.100+0000 7f5ac9ffb700 10 client.26437 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:02:55.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/3225762283 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562edb7a09d0 con 0x562edb7eb2c0 2023-08-10T11:02:55.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5ac9ffb700 10 client.26437 handle_command_reply: tid=0 2023-08-10T11:02:55.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 client.26437 shutdown 2023-08-10T11:02:55.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3225762283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 msgr2=0x562edb7dac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:55.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7dac20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5adc000c00 tx=0x7f5adc005800 comp rx=0 tx=0).stop 2023-08-10T11:02:55.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3225762283 shutdown_connections 2023-08-10T11:02:55.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562edb7eb2c0 0x562edb7ed6e0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 0x562edb7db6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7dac20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5ac9ffb700 0 client.26437 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:02:55.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3225762283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d6f50 0x562edb7db160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3225762283 >> 172.21.15.107:0/3225762283 conn(0x562edb72ecd0 msgr2=0x562edb7cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:55.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3225762283 shutdown_connections 2023-08-10T11:02:55.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.101+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3225762283 wait complete. 2023-08-10T11:02:55.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.102+0000 7f5afbdb3b80 20 client.26437 trim_cache size 0 max 16384 2023-08-10T11:02:55.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5afbdb3b80 1 Processor -- start 2023-08-10T11:02:55.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5afbdb3b80 1 -- start start 2023-08-10T11:02:55.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 0x562edb7d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d6f50 0x562edb7d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 0x562edb7d9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb5a5920 con 0x562edb7d1800 2023-08-10T11:02:55.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb7d5830 con 0x562edb7d7870 2023-08-10T11:02:55.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb7ddcd0 con 0x562edb7d6f50 2023-08-10T11:02:55.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5ae619b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 0x562edb7d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5ae599a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d6f50 0x562edb7d64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.122+0000 7f5ae599a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d6f50 0x562edb7d64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:57514/0 (socket says 172.21.15.107:57514) 2023-08-10T11:02:55.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ae599a700 1 -- 172.21.15.107:0/3865780022 learned_addr learned my addr 172.21.15.107:0/3865780022 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:55.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ae699c700 1 --2- 172.21.15.107:0/3865780022 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 0x562edb7d9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ae599a700 1 -- 172.21.15.107:0/3865780022 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 msgr2=0x562edb7d9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:55.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3865780022 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 0x562edb7d9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ae599a700 1 -- 172.21.15.107:0/3865780022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 msgr2=0x562edb7d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:55.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3865780022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 0x562edb7d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ae599a700 1 -- 172.21.15.107:0/3865780022 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562edb538c60 con 0x562edb7d6f50 2023-08-10T11:02:55.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ae619b700 1 --2- 172.21.15.107:0/3865780022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 0x562edb7d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:02:55.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ae599a700 1 --2- 172.21.15.107:0/3865780022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d6f50 0x562edb7d64d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0096b40 tx=0x7f5ad001f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec6a482ab9d15b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:55.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.123+0000 7f5ad53ff700 1 -- 172.21.15.107:0/3865780022 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad009e100 con 0x562edb7d6f50 2023-08-10T11:02:55.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5ad53ff700 1 -- 172.21.15.107:0/3865780022 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ad00cd160 con 0x562edb7d6f50 2023-08-10T11:02:55.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5ad53ff700 1 -- 172.21.15.107:0/3865780022 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad009a570 con 0x562edb7d6f50 2023-08-10T11:02:55.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3865780022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d6f50 msgr2=0x562edb7d64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:55.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3865780022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d6f50 0x562edb7d64d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0096b40 tx=0x7f5ad001f000 comp rx=0 tx=0).stop 2023-08-10T11:02:55.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3865780022 shutdown_connections 2023-08-10T11:02:55.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3865780022 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d7870 0x562edb7d9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3865780022 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d1800 0x562edb7d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/3865780022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d6f50 0x562edb7d64d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3865780022 >> 172.21.15.107:0/3865780022 conn(0x562edb72ecd0 msgr2=0x562edb7d9500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:55.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3865780022 shutdown_connections 2023-08-10T11:02:55.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.124+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/3865780022 wait complete. 2023-08-10T11:02:55.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.125+0000 7f5afbdb3b80 1 -- start start 2023-08-10T11:02:55.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.125+0000 7f5afbdb3b80 1 Processor -- start 2023-08-10T11:02:55.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.125+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.125+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 0x562edb7e2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.125+0000 7f5afbdb3b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d7870 0x562edb7e01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.125+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb7e07b0 con 0x562edb7d7870 2023-08-10T11:02:55.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.125+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb7e0920 con 0x562edb7d6f50 2023-08-10T11:02:55.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.125+0000 7f5afbdb3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edb7e0ae0 con 0x562edb7d1800 2023-08-10T11:02:55.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5afbdb3b80 10 client.0 _ll_register_callbacks cb 0x562edb6bf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:02:55.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae619b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae619b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7e1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:57530/0 (socket says 172.21.15.107:57530) 2023-08-10T11:02:55.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae619b700 1 -- 172.21.15.107:0/937209926 learned_addr learned my addr 172.21.15.107:0/937209926 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:02:55.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae699c700 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d7870 0x562edb7e01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae599a700 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 0x562edb7e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae619b700 1 -- 172.21.15.107:0/937209926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 msgr2=0x562edb7e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:55.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae619b700 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 0x562edb7e2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae619b700 1 -- 172.21.15.107:0/937209926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d7870 msgr2=0x562edb7e01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:02:55.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae619b700 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d7870 0x562edb7e01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae619b700 1 -- 172.21.15.107:0/937209926 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562edb54fde0 con 0x562edb7d1800 2023-08-10T11:02:55.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.126+0000 7f5ae599a700 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 0x562edb7e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:02:55.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.127+0000 7f5ae619b700 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7e1be0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5adc005930 tx=0x7f5adc00bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9487069e076d2791 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:02:55.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.127+0000 7f5ac9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:02:55.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.127+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/937209926 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc01d040 con 0x562edb7d1800 2023-08-10T11:02:55.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.127+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/937209926 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ad009a0d0 con 0x562edb7d1800 2023-08-10T11:02:55.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.127+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/937209926 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f5adc000e40 con 0x562edb7d1800 2023-08-10T11:02:55.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.127+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/937209926 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5adc00b2f0 con 0x562edb7d1800 2023-08-10T11:02:55.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.127+0000 7f5afbdb3b80 10 client.26443 fetch_fsmap learned FSMap version 53 2023-08-10T11:02:55.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.127+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/937209926 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x562edb5a3630 con 0x562edb7d1800 2023-08-10T11:02:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.127+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/937209926 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ad009a0d0 con 0x562edb7d1800 2023-08-10T11:02:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.128+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/937209926 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 53) v1 ==== 7506+0+0 (secure 0 0 0) 0x7f5adc03d030 con 0x562edb7d1800 2023-08-10T11:02:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.128+0000 7f5afbdb3b80 10 client.26443 fetch_fsmap finished waiting for FSMap version 53 2023-08-10T11:02:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.128+0000 7f5afbdb3b80 10 client.26443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:02:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.128+0000 7f5afbdb3b80 20 client.26443 populate_metadata read hostname 'smithi107' 2023-08-10T11:02:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.128+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562edb83fe70 0x562edb842290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:02:55.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.128+0000 7f5afbdb3b80 4 client.26443 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:02:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.128+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/937209926 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562edb71b780 con 0x562edb83fe70 2023-08-10T11:02:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.128+0000 7f5ae599a700 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562edb83fe70 0x562edb842290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:02:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5ae599a700 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562edb83fe70 0x562edb842290 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab6e2196e921d94 server_cookie=c4f832f0f1d36732 in_seq=0 out_seq=0 2023-08-10T11:02:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5ac9ffb700 10 client.26443 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:02:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5ac9ffb700 1 -- 172.21.15.107:0/937209926 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562edb71b780 con 0x562edb83fe70 2023-08-10T11:02:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5ac9ffb700 10 client.26443 handle_command_reply: tid=0 2023-08-10T11:02:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 client.26443 shutdown 2023-08-10T11:02:55.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/937209926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 msgr2=0x562edb7e1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:55.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7e1be0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5adc005930 tx=0x7f5adc00bfd0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/937209926 shutdown_connections 2023-08-10T11:02:55.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x562edb83fe70 0x562edb842290 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562edb7d7870 0x562edb7e01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562edb7d1800 0x562edb7e1be0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 --2- 172.21.15.107:0/937209926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562edb7d6f50 0x562edb7e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5ac9ffb700 0 client.26443 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:02:55.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/937209926 >> 172.21.15.107:0/937209926 conn(0x562edb72ecd0 msgr2=0x562edb7d6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:55.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/937209926 shutdown_connections 2023-08-10T11:02:55.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 1 -- 172.21.15.107:0/937209926 wait complete. 2023-08-10T11:02:55.180 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.129+0000 7f5afbdb3b80 20 client.26443 trim_cache size 0 max 16384 2023-08-10T11:02:55.180 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:02:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:02:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:02:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:02:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:02:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:02:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:02:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:02:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:02:55.181 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:02:55.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 -- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5acc0a1340 msgr2=0x7f5acc0a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:55.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5acc0a1340 0x7f5acc0a3800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800f870 tx=0x7f5ad800fc30 comp rx=0 tx=0).stop 2023-08-10T11:02:55.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 -- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae01021a0 msgr2=0x7f5ae00ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:02:55.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae01021a0 0x7f5ae00ffa10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000e9f0 tx=0x7f5ad000ed00 comp rx=0 tx=0).stop 2023-08-10T11:02:55.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 -- 172.21.15.107:0/3063711602 shutdown_connections 2023-08-10T11:02:55.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5acc0a1340 0x7f5acc0a3800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ae0101880 0x7f5ae00ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ae010aca0 0x7f5ae00fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 --2- 172.21.15.107:0/3063711602 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ae01021a0 0x7f5ae00ffa10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:02:55.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 -- 172.21.15.107:0/3063711602 >> 172.21.15.107:0/3063711602 conn(0x7f5ae00fb0c0 msgr2=0x7f5ae010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:02:55.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 -- 172.21.15.107:0/3063711602 shutdown_connections 2023-08-10T11:02:55.184 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:02:55.130+0000 7f5ae83ff700 1 -- 172.21.15.107:0/3063711602 wait complete. 2023-08-10T11:02:55.184 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:02:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:55 smithi195 ceph-mon[129938]: pgmap v364: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 20 MiB/s wr, 79 op/s 2023-08-10T11:02:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:55 smithi157 ceph-mon[129604]: pgmap v364: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 20 MiB/s wr, 79 op/s 2023-08-10T11:02:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:55 smithi107 ceph-mon[127953]: pgmap v364: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 20 MiB/s wr, 79 op/s 2023-08-10T11:02:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:47000000 of 50000000 tuples (94%) done (elapsed 674.53 s, remaining 43.06 s) 2023-08-10T11:02:57.596 INFO:teuthology.orchestra.run.smithi107.stderr:47100000 of 50000000 tuples (94%) done (elapsed 675.77 s, remaining 41.61 s) 2023-08-10T11:02:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:57 smithi195 ceph-mon[129938]: pgmap v365: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 47 op/s 2023-08-10T11:02:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:57 smithi157 ceph-mon[129604]: pgmap v365: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 47 op/s 2023-08-10T11:02:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:57 smithi107 ceph-mon[127953]: pgmap v365: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 47 op/s 2023-08-10T11:02:58.955 INFO:teuthology.orchestra.run.smithi107.stderr:47200000 of 50000000 tuples (94%) done (elapsed 677.13 s, remaining 40.17 s) 2023-08-10T11:03:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:02:59 smithi195 ceph-mon[129938]: pgmap v366: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 21 MiB/s wr, 81 op/s 2023-08-10T11:03:00.238 INFO:teuthology.orchestra.run.smithi107.stderr:47300000 of 50000000 tuples (94%) done (elapsed 678.42 s, remaining 38.73 s) 2023-08-10T11:03:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:02:59 smithi157 ceph-mon[129604]: pgmap v366: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 21 MiB/s wr, 81 op/s 2023-08-10T11:03:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:02:59 smithi107 ceph-mon[127953]: pgmap v366: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 21 MiB/s wr, 81 op/s 2023-08-10T11:03:01.603 INFO:teuthology.orchestra.run.smithi107.stderr:47400000 of 50000000 tuples (94%) done (elapsed 679.78 s, remaining 37.29 s) 2023-08-10T11:03:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:01 smithi195 ceph-mon[129938]: pgmap v367: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 9.7 MiB/s wr, 44 op/s 2023-08-10T11:03:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:01 smithi157 ceph-mon[129604]: pgmap v367: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 9.7 MiB/s wr, 44 op/s 2023-08-10T11:03:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:01 smithi107 ceph-mon[127953]: pgmap v367: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 9.7 MiB/s wr, 44 op/s 2023-08-10T11:03:03.202 INFO:teuthology.orchestra.run.smithi107.stderr:47500000 of 50000000 tuples (95%) done (elapsed 681.38 s, remaining 35.86 s) 2023-08-10T11:03:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:03 smithi195 ceph-mon[129938]: pgmap v368: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 9.7 MiB/s wr, 44 op/s 2023-08-10T11:03:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:03 smithi195 ceph-mon[129938]: osdmap e105: 12 total, 12 up, 12 in 2023-08-10T11:03:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:03 smithi157 ceph-mon[129604]: pgmap v368: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 9.7 MiB/s wr, 44 op/s 2023-08-10T11:03:04.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:03 smithi157 ceph-mon[129604]: osdmap e105: 12 total, 12 up, 12 in 2023-08-10T11:03:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:03 smithi107 ceph-mon[127953]: pgmap v368: 129 pgs: 129 active+clean; 9.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 9.7 MiB/s wr, 44 op/s 2023-08-10T11:03:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:03 smithi107 ceph-mon[127953]: osdmap e105: 12 total, 12 up, 12 in 2023-08-10T11:03:04.459 INFO:teuthology.orchestra.run.smithi107.stderr:47600000 of 50000000 tuples (95%) done (elapsed 682.64 s, remaining 34.42 s) 2023-08-10T11:03:05.714 INFO:teuthology.orchestra.run.smithi107.stderr:47700000 of 50000000 tuples (95%) done (elapsed 683.89 s, remaining 32.98 s) 2023-08-10T11:03:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:05 smithi195 ceph-mon[129938]: pgmap v370: 129 pgs: 129 active+clean; 9.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 23 MiB/s wr, 108 op/s 2023-08-10T11:03:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:05 smithi157 ceph-mon[129604]: pgmap v370: 129 pgs: 129 active+clean; 9.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 23 MiB/s wr, 108 op/s 2023-08-10T11:03:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:05 smithi107 ceph-mon[127953]: pgmap v370: 129 pgs: 129 active+clean; 9.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 23 MiB/s wr, 108 op/s 2023-08-10T11:03:07.180 INFO:teuthology.orchestra.run.smithi107.stderr:47800000 of 50000000 tuples (95%) done (elapsed 685.36 s, remaining 31.54 s) 2023-08-10T11:03:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:07 smithi195 ceph-mon[129938]: pgmap v371: 129 pgs: 129 active+clean; 9.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 23 MiB/s wr, 108 op/s 2023-08-10T11:03:08.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:07 smithi157 ceph-mon[129604]: pgmap v371: 129 pgs: 129 active+clean; 9.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 23 MiB/s wr, 108 op/s 2023-08-10T11:03:08.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:07 smithi107 ceph-mon[127953]: pgmap v371: 129 pgs: 129 active+clean; 9.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 23 MiB/s wr, 108 op/s 2023-08-10T11:03:08.466 INFO:teuthology.orchestra.run.smithi107.stderr:47900000 of 50000000 tuples (95%) done (elapsed 686.64 s, remaining 30.10 s) 2023-08-10T11:03:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:08 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:08 smithi195 ceph-mon[129938]: osdmap e106: 12 total, 12 up, 12 in 2023-08-10T11:03:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:08 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:09.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:08 smithi157 ceph-mon[129604]: osdmap e106: 12 total, 12 up, 12 in 2023-08-10T11:03:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:08 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:08 smithi107 ceph-mon[127953]: osdmap e106: 12 total, 12 up, 12 in 2023-08-10T11:03:10.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:09 smithi195 ceph-mon[129938]: pgmap v372: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 26 MiB/s wr, 110 op/s 2023-08-10T11:03:10.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:09 smithi157 ceph-mon[129604]: pgmap v372: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 26 MiB/s wr, 110 op/s 2023-08-10T11:03:10.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:09 smithi107 ceph-mon[127953]: pgmap v372: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 26 MiB/s wr, 110 op/s 2023-08-10T11:03:11.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:10 smithi157 ceph-mon[129604]: pgmap v374: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 33 MiB/s wr, 137 op/s 2023-08-10T11:03:11.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:10 smithi107 ceph-mon[127953]: pgmap v374: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 33 MiB/s wr, 137 op/s 2023-08-10T11:03:11.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:10 smithi195 ceph-mon[129938]: pgmap v374: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 33 MiB/s wr, 137 op/s 2023-08-10T11:03:13.264 INFO:teuthology.orchestra.run.smithi107.stderr:48000000 of 50000000 tuples (96%) done (elapsed 691.44 s, remaining 28.81 s) 2023-08-10T11:03:13.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:13 smithi195 ceph-mon[129938]: pgmap v375: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 27 MiB/s wr, 113 op/s 2023-08-10T11:03:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:13 smithi157 ceph-mon[129604]: pgmap v375: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 27 MiB/s wr, 113 op/s 2023-08-10T11:03:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:13 smithi107 ceph-mon[127953]: pgmap v375: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 27 MiB/s wr, 113 op/s 2023-08-10T11:03:14.507 INFO:teuthology.orchestra.run.smithi107.stderr:48100000 of 50000000 tuples (96%) done (elapsed 692.68 s, remaining 27.36 s) 2023-08-10T11:03:15.754 INFO:teuthology.orchestra.run.smithi107.stderr:48200000 of 50000000 tuples (96%) done (elapsed 693.93 s, remaining 25.91 s) 2023-08-10T11:03:16.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:15 smithi107 ceph-mon[127953]: pgmap v376: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 60 op/s 2023-08-10T11:03:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:15 smithi195 ceph-mon[129938]: pgmap v376: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 60 op/s 2023-08-10T11:03:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:15 smithi157 ceph-mon[129604]: pgmap v376: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 60 op/s 2023-08-10T11:03:17.121 INFO:teuthology.orchestra.run.smithi107.stderr:48300000 of 50000000 tuples (96%) done (elapsed 695.30 s, remaining 24.47 s) 2023-08-10T11:03:18.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:17 smithi107 ceph-mon[127953]: pgmap v377: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 60 op/s 2023-08-10T11:03:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:17 smithi195 ceph-mon[129938]: pgmap v377: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 60 op/s 2023-08-10T11:03:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:17 smithi157 ceph-mon[129604]: pgmap v377: 129 pgs: 129 active+clean; 9.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 60 op/s 2023-08-10T11:03:18.348 INFO:teuthology.orchestra.run.smithi107.stderr:48400000 of 50000000 tuples (96%) done (elapsed 696.53 s, remaining 23.03 s) 2023-08-10T11:03:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:18 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:19.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:18 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:19.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:18 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:19.635 INFO:teuthology.orchestra.run.smithi107.stderr:48500000 of 50000000 tuples (97%) done (elapsed 697.81 s, remaining 21.58 s) 2023-08-10T11:03:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:19 smithi195 ceph-mon[129938]: pgmap v378: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 61 op/s 2023-08-10T11:03:20.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:19 smithi157 ceph-mon[129604]: pgmap v378: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 61 op/s 2023-08-10T11:03:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:19 smithi107 ceph-mon[127953]: pgmap v378: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 61 op/s 2023-08-10T11:03:20.991 INFO:teuthology.orchestra.run.smithi107.stderr:48600000 of 50000000 tuples (97%) done (elapsed 699.17 s, remaining 20.14 s) 2023-08-10T11:03:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:21 smithi195 ceph-mon[129938]: pgmap v379: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 52 op/s 2023-08-10T11:03:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:21 smithi157 ceph-mon[129604]: pgmap v379: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 52 op/s 2023-08-10T11:03:22.297 INFO:teuthology.orchestra.run.smithi107.stderr:48700000 of 50000000 tuples (97%) done (elapsed 700.47 s, remaining 18.70 s) 2023-08-10T11:03:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:21 smithi107 ceph-mon[127953]: pgmap v379: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 52 op/s 2023-08-10T11:03:23.587 INFO:teuthology.orchestra.run.smithi107.stderr:48800000 of 50000000 tuples (97%) done (elapsed 701.76 s, remaining 17.26 s) 2023-08-10T11:03:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:23 smithi195 ceph-mon[129938]: pgmap v380: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 51 op/s 2023-08-10T11:03:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:23 smithi157 ceph-mon[129604]: pgmap v380: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 51 op/s 2023-08-10T11:03:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:23 smithi107 ceph-mon[127953]: pgmap v380: 129 pgs: 129 active+clean; 9.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 51 op/s 2023-08-10T11:03:24.914 INFO:teuthology.orchestra.run.smithi107.stderr:48900000 of 50000000 tuples (97%) done (elapsed 703.09 s, remaining 15.82 s) 2023-08-10T11:03:25.186 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:03:25.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.410+0000 7f62717ff700 1 -- 172.21.15.107:0/2919517949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 msgr2=0x7f626c10f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:25.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.410+0000 7f62717ff700 1 --2- 172.21.15.107:0/2919517949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 0x7f626c10f7e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f626400b0a0 tx=0x7f626400b3b0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.412 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.411+0000 7f62717ff700 1 -- 172.21.15.107:0/2919517949 shutdown_connections 2023-08-10T11:03:25.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.411+0000 7f62717ff700 1 --2- 172.21.15.107:0/2919517949 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 0x7f626c10f7e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.411+0000 7f62717ff700 1 --2- 172.21.15.107:0/2919517949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626c108920 0x7f626c108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.411+0000 7f62717ff700 1 --2- 172.21.15.107:0/2919517949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c102910 0x7f626c102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.411+0000 7f62717ff700 1 -- 172.21.15.107:0/2919517949 >> 172.21.15.107:0/2919517949 conn(0x7f626c0fe3c0 msgr2=0x7f626c1007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:25.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.411+0000 7f62717ff700 1 -- 172.21.15.107:0/2919517949 shutdown_connections 2023-08-10T11:03:25.413 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.411+0000 7f62717ff700 1 -- 172.21.15.107:0/2919517949 wait complete. 2023-08-10T11:03:25.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.412+0000 7f62717ff700 1 Processor -- start 2023-08-10T11:03:25.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.412+0000 7f62717ff700 1 -- start start 2023-08-10T11:03:25.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f62717ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626c102910 0x7f626c19e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f62717ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 0x7f626c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f62717ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c108920 0x7f626c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f62717ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c198d70 con 0x7f626c1032d0 2023-08-10T11:03:25.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f62717ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c198ee0 con 0x7f626c108920 2023-08-10T11:03:25.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f62717ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1990a0 con 0x7f626c102910 2023-08-10T11:03:25.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f626a7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 0x7f626c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f626affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626c102910 0x7f626c19e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f626a7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 0x7f626c19ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60832/0 (socket says 172.21.15.107:60832) 2023-08-10T11:03:25.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.413+0000 7f626a7fc700 1 -- 172.21.15.107:0/4288775983 learned_addr learned my addr 172.21.15.107:0/4288775983 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:25.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f626b7fe700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c108920 0x7f626c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f626a7fc700 1 -- 172.21.15.107:0/4288775983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626c102910 msgr2=0x7f626c19e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:25.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f626a7fc700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626c102910 0x7f626c19e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f626a7fc700 1 -- 172.21.15.107:0/4288775983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c108920 msgr2=0x7f626c198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:25.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f626a7fc700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c108920 0x7f626c198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.417 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f626a7fc700 1 -- 172.21.15.107:0/4288775983 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264009d00 con 0x7f626c1032d0 2023-08-10T11:03:25.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f626a7fc700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 0x7f626c19ebd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f626000e9a0 tx=0x7f626000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:25.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f6253fff700 1 -- 172.21.15.107:0/4288775983 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260009790 con 0x7f626c1032d0 2023-08-10T11:03:25.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f6253fff700 1 -- 172.21.15.107:0/4288775983 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f626000cbd0 con 0x7f626c1032d0 2023-08-10T11:03:25.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f62717ff700 1 -- 172.21.15.107:0/4288775983 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c199380 con 0x7f626c1032d0 2023-08-10T11:03:25.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f6253fff700 1 -- 172.21.15.107:0/4288775983 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260018680 con 0x7f626c1032d0 2023-08-10T11:03:25.418 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.414+0000 7f62717ff700 1 -- 172.21.15.107:0/4288775983 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c1a5680 con 0x7f626c1032d0 2023-08-10T11:03:25.419 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.418+0000 7f6253fff700 1 -- 172.21.15.107:0/4288775983 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f626000cd40 con 0x7f626c1032d0 2023-08-10T11:03:25.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.419+0000 7f6253fff700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f62540a12c0 0x7f62540a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f62850ecb80 1 Processor -- start 2023-08-10T11:03:25.421 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f6253fff700 1 -- 172.21.15.107:0/4288775983 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f6260014070 con 0x7f626c1032d0 2023-08-10T11:03:25.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f62850ecb80 1 -- start start 2023-08-10T11:03:25.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f626affd700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f62540a12c0 0x7f62540a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373bf50 0x5637d373c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d37362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.422 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 0x5637d3736c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f62850ecb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d36b1dc0 con 0x5637d373bf50 2023-08-10T11:03:25.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f62850ecb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d368e590 con 0x5637d3736800 2023-08-10T11:03:25.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.420+0000 7f62850ecb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d368beb0 con 0x5637d373c870 2023-08-10T11:03:25.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626a7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d37362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 0x5637d3736c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626a7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d37362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:47294/0 (socket says 172.21.15.107:47294) 2023-08-10T11:03:25.423 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626a7fc700 1 -- 172.21.15.107:0/2615778087 learned_addr learned my addr 172.21.15.107:0/2615778087 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:25.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626affd700 1 --2- 172.21.15.107:0/2615778087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373bf50 0x5637d373c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626a7fc700 1 -- 172.21.15.107:0/2615778087 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 msgr2=0x5637d3736c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:25.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626a7fc700 1 --2- 172.21.15.107:0/2615778087 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 0x5637d3736c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626a7fc700 1 -- 172.21.15.107:0/2615778087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373bf50 msgr2=0x5637d373c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:25.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626a7fc700 1 --2- 172.21.15.107:0/2615778087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373bf50 0x5637d373c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.424 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626a7fc700 1 -- 172.21.15.107:0/2615778087 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637d3508630 con 0x5637d373c870 2023-08-10T11:03:25.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626affd700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f62540a12c0 0x7f62540a3780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f625c0134b0 tx=0x7f625c013870 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:25.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f626a7fc700 1 --2- 172.21.15.107:0/2615778087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d37362c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6260096b00 tx=0x7f6260099cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb51e096eb9bf42a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:25.426 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.421+0000 7f62517fa700 1 -- 172.21.15.107:0/2615778087 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600cd160 con 0x5637d373c870 2023-08-10T11:03:25.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62517fa700 1 -- 172.21.15.107:0/2615778087 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f626009e0c0 con 0x5637d373c870 2023-08-10T11:03:25.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62517fa700 1 -- 172.21.15.107:0/2615778087 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600997e0 con 0x5637d373c870 2023-08-10T11:03:25.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62850ecb80 1 -- 172.21.15.107:0/2615778087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 msgr2=0x5637d37362c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:25.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2615778087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d37362c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6260096b00 tx=0x7f6260099cc0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62850ecb80 1 -- 172.21.15.107:0/2615778087 shutdown_connections 2023-08-10T11:03:25.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2615778087 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 0x5637d3736c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2615778087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373bf50 0x5637d373c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.427 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2615778087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d37362c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62850ecb80 1 -- 172.21.15.107:0/2615778087 >> 172.21.15.107:0/2615778087 conn(0x5637d3693cd0 msgr2=0x5637d37314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:25.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.422+0000 7f62850ecb80 1 -- 172.21.15.107:0/2615778087 shutdown_connections 2023-08-10T11:03:25.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.423+0000 7f62850ecb80 1 -- 172.21.15.107:0/2615778087 wait complete. 2023-08-10T11:03:25.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.423+0000 7f62850ecb80 1 -- start start 2023-08-10T11:03:25.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.423+0000 7f62850ecb80 1 Processor -- start 2023-08-10T11:03:25.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d3736800 0x5637d3742950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.428 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 0x5637d373fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d3740310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f62850ecb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d36877a0 con 0x5637d3736800 2023-08-10T11:03:25.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f62850ecb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d3626ac0 con 0x5637d373bf50 2023-08-10T11:03:25.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f62850ecb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d36267c0 con 0x5637d373c870 2023-08-10T11:03:25.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f62850ecb80 10 client.0 _ll_register_callbacks cb 0x5637d3624680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:03:25.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f626affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d3736800 0x5637d3742950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f626b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d3740310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.429 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f626affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d3736800 0x5637d3742950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60850/0 (socket says 172.21.15.107:60850) 2023-08-10T11:03:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f626affd700 1 -- 172.21.15.107:0/2471922884 learned_addr learned my addr 172.21.15.107:0/2471922884 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.424+0000 7f626a7fc700 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 0x5637d373fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f626affd700 1 -- 172.21.15.107:0/2471922884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 msgr2=0x5637d3740310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f626affd700 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d3740310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f626affd700 1 -- 172.21.15.107:0/2471922884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 msgr2=0x5637d373fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f626affd700 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 0x5637d373fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f626affd700 1 -- 172.21.15.107:0/2471922884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c1a5680 con 0x5637d3736800 2023-08-10T11:03:25.430 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f626b7fe700 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d3740310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:03:25.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f626affd700 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d3736800 0x5637d3742950 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f625c012230 tx=0x7f625c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62c2eec24cc1274 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:25.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f624eff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:03:25.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f624eff5700 1 -- 172.21.15.107:0/2471922884 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c020430 con 0x5637d3736800 2023-08-10T11:03:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f62850ecb80 1 -- 172.21.15.107:0/2471922884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637d3729470 con 0x5637d3736800 2023-08-10T11:03:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.425+0000 7f624eff5700 1 -- 172.21.15.107:0/2471922884 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f625c020590 con 0x5637d3736800 2023-08-10T11:03:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f624eff5700 1 -- 172.21.15.107:0/2471922884 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f625c020750 con 0x5637d3736800 2023-08-10T11:03:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f62850ecb80 10 client.16761 fetch_fsmap learned FSMap version 55 2023-08-10T11:03:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f62850ecb80 1 -- 172.21.15.107:0/2471922884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5637d34b4de0 con 0x5637d3736800 2023-08-10T11:03:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f624eff5700 1 -- 172.21.15.107:0/2471922884 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5637d3729470 con 0x5637d3736800 2023-08-10T11:03:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f624eff5700 1 -- 172.21.15.107:0/2471922884 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 55) v1 ==== 7518+0+0 (secure 0 0 0) 0x7f625c0107a0 con 0x5637d3736800 2023-08-10T11:03:25.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f62850ecb80 10 client.16761 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T11:03:25.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f62850ecb80 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:03:25.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f62850ecb80 20 client.16761 populate_metadata read hostname 'smithi107' 2023-08-10T11:03:25.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5637d37503e0 0x5637d3752800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f62850ecb80 4 client.16761 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:03:25.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.426+0000 7f62850ecb80 1 -- 172.21.15.107:0/2471922884 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637d37059d0 con 0x5637d37503e0 2023-08-10T11:03:25.434 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.427+0000 7f626a7fc700 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5637d37503e0 0x5637d3752800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.427+0000 7f626a7fc700 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5637d37503e0 0x5637d3752800 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ae0f18820a0713f server_cookie=747e1762326be9b6 in_seq=0 out_seq=0 2023-08-10T11:03:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.427+0000 7f624eff5700 10 client.16761 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:03:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f624eff5700 1 -- 172.21.15.107:0/2471922884 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5637d37059d0 con 0x5637d37503e0 2023-08-10T11:03:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f624eff5700 10 client.16761 handle_command_reply: tid=0 2023-08-10T11:03:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f62850ecb80 1 client.16761 shutdown 2023-08-10T11:03:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f62850ecb80 1 -- 172.21.15.107:0/2471922884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d3736800 msgr2=0x5637d3742950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d3736800 0x5637d3742950 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f625c012230 tx=0x7f625c0047c0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f62850ecb80 1 -- 172.21.15.107:0/2471922884 shutdown_connections 2023-08-10T11:03:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5637d37503e0 0x5637d3752800 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373c870 0x5637d3740310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d3736800 0x5637d3742950 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2471922884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 0x5637d373fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f62850ecb80 1 -- 172.21.15.107:0/2471922884 >> 172.21.15.107:0/2471922884 conn(0x5637d3693cd0 msgr2=0x5637d37309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.428+0000 7f624eff5700 0 client.16761 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:03:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.429+0000 7f62850ecb80 1 -- 172.21.15.107:0/2471922884 shutdown_connections 2023-08-10T11:03:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.429+0000 7f62850ecb80 1 -- 172.21.15.107:0/2471922884 wait complete. 2023-08-10T11:03:25.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.429+0000 7f62850ecb80 20 client.16761 trim_cache size 0 max 16384 2023-08-10T11:03:25.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.446+0000 7f62850ecb80 1 Processor -- start 2023-08-10T11:03:25.447 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.446+0000 7f62850ecb80 1 -- start start 2023-08-10T11:03:25.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.446+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d3736800 0x5637d373b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.448 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.446+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 0x5637d3731130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.446+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d3731670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.446+0000 7f62850ecb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d350a920 con 0x5637d373c870 2023-08-10T11:03:25.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.446+0000 7f62850ecb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d3740b50 con 0x5637d373bf50 2023-08-10T11:03:25.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.446+0000 7f62850ecb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d374d9c0 con 0x5637d3736800 2023-08-10T11:03:25.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d3731670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d3736800 0x5637d373b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.449 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d3731670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60866/0 (socket says 172.21.15.107:60866) 2023-08-10T11:03:25.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d3736800 0x5637d373b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:47310/0 (socket says 172.21.15.107:47310) 2023-08-10T11:03:25.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626b7fe700 1 -- 172.21.15.107:0/591054886 learned_addr learned my addr 172.21.15.107:0/591054886 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:25.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626a7fc700 1 --2- 172.21.15.107:0/591054886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 0x5637d3731130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626affd700 1 -- 172.21.15.107:0/591054886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 msgr2=0x5637d3731130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:25.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626affd700 1 --2- 172.21.15.107:0/591054886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 0x5637d3731130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626affd700 1 -- 172.21.15.107:0/591054886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 msgr2=0x5637d3731670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:25.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626affd700 1 --2- 172.21.15.107:0/591054886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d3731670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.450 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626affd700 1 -- 172.21.15.107:0/591054886 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637d349dc60 con 0x5637d3736800 2023-08-10T11:03:25.451 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.447+0000 7f626b7fe700 1 --2- 172.21.15.107:0/591054886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d3731670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:03:25.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.448+0000 7f626affd700 1 --2- 172.21.15.107:0/591054886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d3736800 0x5637d373b330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f625c014fd0 tx=0x7f625c0092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688d516b0984fd6b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:25.452 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.448+0000 7f6251ffb700 1 -- 172.21.15.107:0/591054886 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c013c70 con 0x5637d3736800 2023-08-10T11:03:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.448+0000 7f6251ffb700 1 -- 172.21.15.107:0/591054886 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f625c009ab0 con 0x5637d3736800 2023-08-10T11:03:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.448+0000 7f6251ffb700 1 -- 172.21.15.107:0/591054886 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c020780 con 0x5637d3736800 2023-08-10T11:03:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 -- 172.21.15.107:0/591054886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d3736800 msgr2=0x5637d373b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 --2- 172.21.15.107:0/591054886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d3736800 0x5637d373b330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f625c014fd0 tx=0x7f625c0092d0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 -- 172.21.15.107:0/591054886 shutdown_connections 2023-08-10T11:03:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 --2- 172.21.15.107:0/591054886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d3731670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 --2- 172.21.15.107:0/591054886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d3736800 0x5637d373b330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 --2- 172.21.15.107:0/591054886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d373bf50 0x5637d3731130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 -- 172.21.15.107:0/591054886 >> 172.21.15.107:0/591054886 conn(0x5637d3693cd0 msgr2=0x5637d373ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:25.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 -- 172.21.15.107:0/591054886 shutdown_connections 2023-08-10T11:03:25.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 -- 172.21.15.107:0/591054886 wait complete. 2023-08-10T11:03:25.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.449+0000 7f62850ecb80 1 -- start start 2023-08-10T11:03:25.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f62850ecb80 1 Processor -- start 2023-08-10T11:03:25.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 0x5637d37454e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.454 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373bf50 0x5637d3745a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f62850ecb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d37a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f62850ecb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d37a35f0 con 0x5637d373c870 2023-08-10T11:03:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f62850ecb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d37a3730 con 0x5637d3736800 2023-08-10T11:03:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f62850ecb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637d37a38c0 con 0x5637d373bf50 2023-08-10T11:03:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f62850ecb80 10 client.0 _ll_register_callbacks cb 0x5637d3624680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:03:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f626a7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373bf50 0x5637d3745a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.450+0000 7f626b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d37a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f626a7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373bf50 0x5637d3745a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:47312/0 (socket says 172.21.15.107:47312) 2023-08-10T11:03:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f626a7fc700 1 -- 172.21.15.107:0/2179535732 learned_addr learned my addr 172.21.15.107:0/2179535732 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f626affd700 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 0x5637d37454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f626a7fc700 1 -- 172.21.15.107:0/2179535732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 msgr2=0x5637d37454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f626a7fc700 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 0x5637d37454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f626a7fc700 1 -- 172.21.15.107:0/2179535732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 msgr2=0x5637d37a30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f626a7fc700 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d37a30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f626a7fc700 1 -- 172.21.15.107:0/2179535732 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c1100e0 con 0x5637d373bf50 2023-08-10T11:03:25.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f626a7fc700 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373bf50 0x5637d3745a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6260099d90 tx=0x7f62600cac70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8596dbfcd030210f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:25.457 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f624eff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:03:25.458 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f624eff5700 1 -- 172.21.15.107:0/2179535732 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260099780 con 0x5637d373bf50 2023-08-10T11:03:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.451+0000 7f624eff5700 1 -- 172.21.15.107:0/2179535732 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f626009a2f0 con 0x5637d373bf50 2023-08-10T11:03:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f62850ecb80 1 -- 172.21.15.107:0/2179535732 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f626009e0c0 con 0x5637d373bf50 2023-08-10T11:03:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f624eff5700 1 -- 172.21.15.107:0/2179535732 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62600a2560 con 0x5637d373bf50 2023-08-10T11:03:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f62850ecb80 10 client.26461 fetch_fsmap learned FSMap version 55 2023-08-10T11:03:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f62850ecb80 1 -- 172.21.15.107:0/2179535732 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5637d34b4de0 con 0x5637d373bf50 2023-08-10T11:03:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f624eff5700 1 -- 172.21.15.107:0/2179535732 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f626009e0c0 con 0x5637d373bf50 2023-08-10T11:03:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f624eff5700 1 -- 172.21.15.107:0/2179535732 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 55) v1 ==== 7518+0+0 (secure 0 0 0) 0x7f62600104c0 con 0x5637d373bf50 2023-08-10T11:03:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f62850ecb80 10 client.26461 fetch_fsmap finished waiting for FSMap version 55 2023-08-10T11:03:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f62850ecb80 10 client.26461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:03:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f62850ecb80 20 client.26461 populate_metadata read hostname 'smithi107' 2023-08-10T11:03:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5637d37a4d80 0x5637d37a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f62850ecb80 4 client.26461 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:03:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.452+0000 7f62850ecb80 1 -- 172.21.15.107:0/2179535732 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5637d3680780 con 0x5637d37a4d80 2023-08-10T11:03:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.453+0000 7f626affd700 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5637d37a4d80 0x5637d37a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.453+0000 7f624eff5700 10 client.26461 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:03:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.453+0000 7f626affd700 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5637d37a4d80 0x5637d37a71a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f345fae121ab813 server_cookie=e7d26bb6aff5462e in_seq=0 out_seq=0 2023-08-10T11:03:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.453+0000 7f624eff5700 1 -- 172.21.15.107:0/2179535732 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5637d3680780 con 0x5637d37a4d80 2023-08-10T11:03:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.453+0000 7f624eff5700 10 client.26461 handle_command_reply: tid=0 2023-08-10T11:03:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.453+0000 7f62850ecb80 1 client.26461 shutdown 2023-08-10T11:03:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 -- 172.21.15.107:0/2179535732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373bf50 msgr2=0x5637d3745a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373bf50 0x5637d3745a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6260099d90 tx=0x7f62600cac70 comp rx=0 tx=0).stop 2023-08-10T11:03:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 -- 172.21.15.107:0/2179535732 shutdown_connections 2023-08-10T11:03:25.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5637d37a4d80 0x5637d37a71a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5637d3736800 0x5637d37454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f624eff5700 0 client.26461 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:03:25.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637d373c870 0x5637d37a30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 --2- 172.21.15.107:0/2179535732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637d373bf50 0x5637d3745a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 -- 172.21.15.107:0/2179535732 >> 172.21.15.107:0/2179535732 conn(0x5637d3693cd0 msgr2=0x5637d373d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:25.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 -- 172.21.15.107:0/2179535732 shutdown_connections 2023-08-10T11:03:25.462 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 1 -- 172.21.15.107:0/2179535732 wait complete. 2023-08-10T11:03:25.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.454+0000 7f62850ecb80 20 client.26461 trim_cache size 0 max 16384 2023-08-10T11:03:25.463 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:03:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:03:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:03:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:03:25.463 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:03:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:03:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:03:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:03:25.464 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:03:25.464 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:03:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 -- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f62540a12c0 msgr2=0x7f62540a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f62540a12c0 0x7f62540a3780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f625c0134b0 tx=0x7f625c013870 comp rx=0 tx=0).stop 2023-08-10T11:03:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 -- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 msgr2=0x7f626c19ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 0x7f626c19ebd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f626000e9a0 tx=0x7f626000ecb0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 -- 172.21.15.107:0/4288775983 shutdown_connections 2023-08-10T11:03:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f62540a12c0 0x7f62540a3780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c108920 0x7f626c198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f626c102910 0x7f626c19e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 --2- 172.21.15.107:0/4288775983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f626c1032d0 0x7f626c19ebd0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 -- 172.21.15.107:0/4288775983 >> 172.21.15.107:0/4288775983 conn(0x7f626c0fe3c0 msgr2=0x7f626c0fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 -- 172.21.15.107:0/4288775983 shutdown_connections 2023-08-10T11:03:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:25.455+0000 7f62717ff700 1 -- 172.21.15.107:0/4288775983 wait complete. 2023-08-10T11:03:25.474 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:03:26.123 INFO:teuthology.orchestra.run.smithi107.stderr:49000000 of 50000000 tuples (98%) done (elapsed 704.30 s, remaining 14.37 s) 2023-08-10T11:03:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:25 smithi195 ceph-mon[129938]: pgmap v381: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 26 MiB/s wr, 85 op/s 2023-08-10T11:03:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:25 smithi157 ceph-mon[129604]: pgmap v381: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 26 MiB/s wr, 85 op/s 2023-08-10T11:03:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:25 smithi107 ceph-mon[127953]: pgmap v381: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 26 MiB/s wr, 85 op/s 2023-08-10T11:03:27.366 INFO:teuthology.orchestra.run.smithi107.stderr:49100000 of 50000000 tuples (98%) done (elapsed 705.54 s, remaining 12.93 s) 2023-08-10T11:03:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:27 smithi195 ceph-mon[129938]: pgmap v382: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T11:03:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:27 smithi157 ceph-mon[129604]: pgmap v382: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T11:03:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:27 smithi107 ceph-mon[127953]: pgmap v382: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-08-10T11:03:28.645 INFO:teuthology.orchestra.run.smithi107.stderr:49200000 of 50000000 tuples (98%) done (elapsed 706.82 s, remaining 11.49 s) 2023-08-10T11:03:30.025 INFO:teuthology.orchestra.run.smithi107.stderr:49300000 of 50000000 tuples (98%) done (elapsed 708.20 s, remaining 10.06 s) 2023-08-10T11:03:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:29 smithi195 ceph-mon[129938]: pgmap v383: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-08-10T11:03:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:29 smithi157 ceph-mon[129604]: pgmap v383: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-08-10T11:03:30.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:29 smithi107 ceph-mon[127953]: pgmap v383: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-08-10T11:03:31.229 INFO:teuthology.orchestra.run.smithi107.stderr:49400000 of 50000000 tuples (98%) done (elapsed 709.41 s, remaining 8.62 s) 2023-08-10T11:03:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:31 smithi195 ceph-mon[129938]: pgmap v384: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:03:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:31 smithi157 ceph-mon[129604]: pgmap v384: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:03:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:31 smithi107 ceph-mon[127953]: pgmap v384: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:03:32.504 INFO:teuthology.orchestra.run.smithi107.stderr:49500000 of 50000000 tuples (99%) done (elapsed 710.68 s, remaining 7.18 s) 2023-08-10T11:03:33.845 INFO:teuthology.orchestra.run.smithi107.stderr:49600000 of 50000000 tuples (99%) done (elapsed 712.02 s, remaining 5.74 s) 2023-08-10T11:03:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:33 smithi195 ceph-mon[129938]: pgmap v385: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:03:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:33 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:33 smithi157 ceph-mon[129604]: pgmap v385: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:03:34.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:33 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:33 smithi107 ceph-mon[127953]: pgmap v385: 129 pgs: 129 active+clean; 9.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 61 op/s 2023-08-10T11:03:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:33 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:35.104 INFO:teuthology.orchestra.run.smithi107.stderr:49700000 of 50000000 tuples (99%) done (elapsed 713.28 s, remaining 4.31 s) 2023-08-10T11:03:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:35 smithi195 ceph-mon[129938]: pgmap v386: 129 pgs: 129 active+clean; 9.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 35 MiB/s wr, 89 op/s 2023-08-10T11:03:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:35 smithi157 ceph-mon[129604]: pgmap v386: 129 pgs: 129 active+clean; 9.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 35 MiB/s wr, 89 op/s 2023-08-10T11:03:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:35 smithi107 ceph-mon[127953]: pgmap v386: 129 pgs: 129 active+clean; 9.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 35 MiB/s wr, 89 op/s 2023-08-10T11:03:36.352 INFO:teuthology.orchestra.run.smithi107.stderr:49800000 of 50000000 tuples (99%) done (elapsed 714.53 s, remaining 2.87 s) 2023-08-10T11:03:37.578 INFO:teuthology.orchestra.run.smithi107.stderr:49900000 of 50000000 tuples (99%) done (elapsed 715.76 s, remaining 1.43 s) 2023-08-10T11:03:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:37 smithi195 ceph-mon[129938]: pgmap v387: 129 pgs: 129 active+clean; 9.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-08-10T11:03:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:37 smithi157 ceph-mon[129604]: pgmap v387: 129 pgs: 129 active+clean; 9.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-08-10T11:03:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:37 smithi107 ceph-mon[127953]: pgmap v387: 129 pgs: 129 active+clean; 9.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-08-10T11:03:38.937 INFO:teuthology.orchestra.run.smithi107.stderr:50000000 of 50000000 tuples (100%) done (elapsed 717.11 s, remaining 0.00 s) 2023-08-10T11:03:39.040 INFO:teuthology.orchestra.run.smithi107.stderr:vacuum... 2023-08-10T11:03:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:39 smithi195 ceph-mon[129938]: pgmap v388: 129 pgs: 129 active+clean; 9.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 36 MiB/s wr, 81 op/s 2023-08-10T11:03:40.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:39 smithi157 ceph-mon[129604]: pgmap v388: 129 pgs: 129 active+clean; 9.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 36 MiB/s wr, 81 op/s 2023-08-10T11:03:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:39 smithi107 ceph-mon[127953]: pgmap v388: 129 pgs: 129 active+clean; 9.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 36 MiB/s wr, 81 op/s 2023-08-10T11:03:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:41 smithi195 ceph-mon[129938]: pgmap v389: 129 pgs: 129 active+clean; 9.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-08-10T11:03:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:41 smithi157 ceph-mon[129604]: pgmap v389: 129 pgs: 129 active+clean; 9.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-08-10T11:03:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:41 smithi107 ceph-mon[127953]: pgmap v389: 129 pgs: 129 active+clean; 9.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-08-10T11:03:43.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:42 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:03:43.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:42 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:03:43.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:42 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:03:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:43 smithi195 ceph-mon[129938]: pgmap v390: 129 pgs: 129 active+clean; 9.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-08-10T11:03:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:43 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:03:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:43 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:03:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:43 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:03:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:43 smithi157 ceph-mon[129604]: pgmap v390: 129 pgs: 129 active+clean; 9.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-08-10T11:03:44.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:43 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:03:44.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:43 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:03:44.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:43 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:03:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:43 smithi107 ceph-mon[127953]: pgmap v390: 129 pgs: 129 active+clean; 9.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-08-10T11:03:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:43 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:03:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:43 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:03:44.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:43 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:03:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:45 smithi195 ceph-mon[129938]: pgmap v391: 129 pgs: 129 active+clean; 9.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 35 MiB/s wr, 82 op/s 2023-08-10T11:03:46.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:45 smithi157 ceph-mon[129604]: pgmap v391: 129 pgs: 129 active+clean; 9.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 35 MiB/s wr, 82 op/s 2023-08-10T11:03:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:45 smithi107 ceph-mon[127953]: pgmap v391: 129 pgs: 129 active+clean; 9.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 35 MiB/s wr, 82 op/s 2023-08-10T11:03:48.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:47 smithi195 ceph-mon[129938]: pgmap v392: 129 pgs: 129 active+clean; 9.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-08-10T11:03:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:47 smithi157 ceph-mon[129604]: pgmap v392: 129 pgs: 129 active+clean; 9.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-08-10T11:03:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:47 smithi107 ceph-mon[127953]: pgmap v392: 129 pgs: 129 active+clean; 9.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-08-10T11:03:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:49 smithi195 ceph-mon[129938]: pgmap v393: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 36 MiB/s wr, 70 op/s 2023-08-10T11:03:50.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:49 smithi157 ceph-mon[129604]: pgmap v393: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 36 MiB/s wr, 70 op/s 2023-08-10T11:03:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:49 smithi107 ceph-mon[127953]: pgmap v393: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 36 MiB/s wr, 70 op/s 2023-08-10T11:03:51.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:50 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:51.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:50 smithi195 ceph-mon[129938]: pgmap v394: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 45 op/s 2023-08-10T11:03:51.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:50 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:51.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:50 smithi157 ceph-mon[129604]: pgmap v394: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 45 op/s 2023-08-10T11:03:51.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:50 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:51.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:50 smithi107 ceph-mon[127953]: pgmap v394: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 45 op/s 2023-08-10T11:03:53.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:52 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:52 smithi157 ceph-mon[129604]: pgmap v395: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 45 op/s 2023-08-10T11:03:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:52 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:53.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:52 smithi107 ceph-mon[127953]: pgmap v395: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 45 op/s 2023-08-10T11:03:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:52 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:52 smithi195 ceph-mon[129938]: pgmap v395: 129 pgs: 129 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 45 op/s 2023-08-10T11:03:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:53 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:53 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:53 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:03:55.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:54 smithi157 ceph-mon[129604]: pgmap v396: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 38 MiB/s wr, 62 op/s 2023-08-10T11:03:55.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:54 smithi107 ceph-mon[127953]: pgmap v396: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 38 MiB/s wr, 62 op/s 2023-08-10T11:03:55.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:54 smithi195 ceph-mon[129938]: pgmap v396: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 38 MiB/s wr, 62 op/s 2023-08-10T11:03:55.475 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:03:55.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.706+0000 7f0b9bdff700 1 -- 172.21.15.107:0/2115596257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94108910 msgr2=0x7f0b94108cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:55.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.706+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/2115596257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94108910 0x7f0b94108cf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b900098f0 tx=0x7f0b90009c00 comp rx=0 tx=0).stop 2023-08-10T11:03:55.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.706+0000 7f0b9bdff700 1 -- 172.21.15.107:0/2115596257 shutdown_connections 2023-08-10T11:03:55.709 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.706+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/2115596257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b941032c0 0x7f0b9410f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.706+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/2115596257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94108910 0x7f0b94108cf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.706+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/2115596257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102900 0x7f0b94102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.706+0000 7f0b9bdff700 1 -- 172.21.15.107:0/2115596257 >> 172.21.15.107:0/2115596257 conn(0x7f0b940fe430 msgr2=0x7f0b94100850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:55.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.706+0000 7f0b9bdff700 1 -- 172.21.15.107:0/2115596257 shutdown_connections 2023-08-10T11:03:55.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.707+0000 7f0b9bdff700 1 -- 172.21.15.107:0/2115596257 wait complete. 2023-08-10T11:03:55.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.708+0000 7f0b9bdff700 1 Processor -- start 2023-08-10T11:03:55.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.708+0000 7f0b9bdff700 1 -- start start 2023-08-10T11:03:55.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.708+0000 7f0b9bdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94102900 0x7f0b9419e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.714 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.708+0000 7f0b9bdff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b941032c0 0x7f0b9419ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.708+0000 7f0b9bdff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94108910 0x7f0b941987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.708+0000 7f0b9bdff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94198e00 con 0x7f0b94108910 2023-08-10T11:03:55.715 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.708+0000 7f0b9bdff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94198f70 con 0x7f0b941032c0 2023-08-10T11:03:55.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.708+0000 7f0b9bdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94199130 con 0x7f0b94102900 2023-08-10T11:03:55.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b99b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94102900 0x7f0b9419e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b99b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94102900 0x7f0b9419e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:41238/0 (socket says 172.21.15.107:41238) 2023-08-10T11:03:55.716 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b99b9b700 1 -- 172.21.15.107:0/152496015 learned_addr learned my addr 172.21.15.107:0/152496015 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:55.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b9a39c700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94108910 0x7f0b941987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b9939a700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b941032c0 0x7f0b9419ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b99b9b700 1 -- 172.21.15.107:0/152496015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b941032c0 msgr2=0x7f0b9419ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:55.717 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b941032c0 0x7f0b9419ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b99b9b700 1 -- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94108910 msgr2=0x7f0b941987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:55.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94108910 0x7f0b941987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.718 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b99b9b700 1 -- 172.21.15.107:0/152496015 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90009520 con 0x7f0b94102900 2023-08-10T11:03:55.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b9939a700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b941032c0 0x7f0b9419ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:03:55.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.709+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94102900 0x7f0b9419e6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009810 tx=0x7f0b9000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:55.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.710+0000 7f0b8affd700 1 -- 172.21.15.107:0/152496015 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9001c070 con 0x7f0b94102900 2023-08-10T11:03:55.719 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.710+0000 7f0b9bdff700 1 -- 172.21.15.107:0/152496015 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b941993b0 con 0x7f0b94102900 2023-08-10T11:03:55.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.710+0000 7f0b8affd700 1 -- 172.21.15.107:0/152496015 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b9000bb70 con 0x7f0b94102900 2023-08-10T11:03:55.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.710+0000 7f0b8affd700 1 -- 172.21.15.107:0/152496015 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90004930 con 0x7f0b94102900 2023-08-10T11:03:55.720 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.710+0000 7f0b9bdff700 1 -- 172.21.15.107:0/152496015 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b941a5770 con 0x7f0b94102900 2023-08-10T11:03:55.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.713+0000 7f0b8affd700 1 -- 172.21.15.107:0/152496015 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0b90020070 con 0x7f0b94102900 2023-08-10T11:03:55.729 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.715+0000 7f0baf756b80 1 Processor -- start 2023-08-10T11:03:55.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.715+0000 7f0baf756b80 1 -- start start 2023-08-10T11:03:55.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0b8affd700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0b800a12c0 0x7f0b800a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.730 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f5d870 0x55e085f572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0b8affd700 1 -- 172.21.15.107:0/152496015 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f0b900cdd20 con 0x7f0b94102900 2023-08-10T11:03:55.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f57800 0x55e085f57c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.731 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0baf756b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085ed2dc0 con 0x55e085f57800 2023-08-10T11:03:55.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0baf756b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085eaf590 con 0x55e085f5d870 2023-08-10T11:03:55.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0baf756b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085eaceb0 con 0x55e085f5cf50 2023-08-10T11:03:55.732 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0b9a39c700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0b800a12c0 0x7f0b800a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0b99b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0b99b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:41252/0 (socket says 172.21.15.107:41252) 2023-08-10T11:03:55.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0b99b9b700 1 -- 172.21.15.107:0/917562338 learned_addr learned my addr 172.21.15.107:0/917562338 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:55.733 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.716+0000 7f0b9939a700 1 --2- 172.21.15.107:0/917562338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f5d870 0x55e085f572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b9a39c700 1 --2- 172.21.15.107:0/917562338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f57800 0x55e085f57c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b99b9b700 1 -- 172.21.15.107:0/917562338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f5d870 msgr2=0x55e085f572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:55.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/917562338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f5d870 0x55e085f572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.734 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b99b9b700 1 -- 172.21.15.107:0/917562338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f57800 msgr2=0x55e085f57c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:55.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/917562338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f57800 0x55e085f57c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b99b9b700 1 -- 172.21.15.107:0/917562338 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e085d29630 con 0x55e085f5cf50 2023-08-10T11:03:55.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/917562338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b9009aac0 tx=0x7f0b9009a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f114cf4f5625166 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:55.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b9a39c700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0b800a12c0 0x7f0b800a3780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00f600 tx=0x7f0b8c00f9c0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:55.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b7ffff700 1 -- 172.21.15.107:0/917562338 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900a2ef0 con 0x55e085f5cf50 2023-08-10T11:03:55.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b7ffff700 1 -- 172.21.15.107:0/917562338 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b90097240 con 0x55e085f5cf50 2023-08-10T11:03:55.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.717+0000 7f0b7ffff700 1 -- 172.21.15.107:0/917562338 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90005460 con 0x55e085f5cf50 2023-08-10T11:03:55.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.718+0000 7f0baf756b80 1 -- 172.21.15.107:0/917562338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 msgr2=0x55e085f5d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:55.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.718+0000 7f0baf756b80 1 --2- 172.21.15.107:0/917562338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b9009aac0 tx=0x7f0b9009a7a0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.737 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.718+0000 7f0baf756b80 1 -- 172.21.15.107:0/917562338 shutdown_connections 2023-08-10T11:03:55.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.718+0000 7f0baf756b80 1 --2- 172.21.15.107:0/917562338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f57800 0x55e085f57c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.718+0000 7f0baf756b80 1 --2- 172.21.15.107:0/917562338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.718+0000 7f0baf756b80 1 --2- 172.21.15.107:0/917562338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f5d870 0x55e085f572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.718+0000 7f0baf756b80 1 -- 172.21.15.107:0/917562338 >> 172.21.15.107:0/917562338 conn(0x55e085eb4cd0 msgr2=0x55e085f524d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:55.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.718+0000 7f0baf756b80 1 -- 172.21.15.107:0/917562338 shutdown_connections 2023-08-10T11:03:55.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.718+0000 7f0baf756b80 1 -- 172.21.15.107:0/917562338 wait complete. 2023-08-10T11:03:55.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.719+0000 7f0baf756b80 1 -- start start 2023-08-10T11:03:55.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.719+0000 7f0baf756b80 1 Processor -- start 2023-08-10T11:03:55.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f63950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f60b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 0x55e085f612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0baf756b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085ea87a0 con 0x55e085f5cf50 2023-08-10T11:03:55.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0baf756b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085e47ac0 con 0x55e085f57800 2023-08-10T11:03:55.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0baf756b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085e477c0 con 0x55e085f5d870 2023-08-10T11:03:55.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0baf756b80 10 client.0 _ll_register_callbacks cb 0x55e085e45680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:03:55.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b9939a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f60b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b99b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f63950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b9939a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f60b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55988/0 (socket says 172.21.15.107:55988) 2023-08-10T11:03:55.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b99b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f63950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:36542/0 (socket says 172.21.15.107:36542) 2023-08-10T11:03:55.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b9939a700 1 -- 172.21.15.107:0/1036085192 learned_addr learned my addr 172.21.15.107:0/1036085192 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:55.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b9a39c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 0x55e085f612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b9939a700 1 -- 172.21.15.107:0/1036085192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 msgr2=0x55e085f612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:55.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b9939a700 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 0x55e085f612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b9939a700 1 -- 172.21.15.107:0/1036085192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 msgr2=0x55e085f63950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:55.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b9939a700 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f63950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.720+0000 7f0b9939a700 1 -- 172.21.15.107:0/1036085192 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b941a5770 con 0x55e085f5cf50 2023-08-10T11:03:55.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.721+0000 7f0b9939a700 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f60b60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0b84012770 tx=0x7f0b84012a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b16ec0c6f92adb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:55.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.721+0000 7f0b7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:03:55.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.721+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1036085192 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84017070 con 0x55e085f5cf50 2023-08-10T11:03:55.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.721+0000 7f0baf756b80 1 -- 172.21.15.107:0/1036085192 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e085f4a470 con 0x55e085f5cf50 2023-08-10T11:03:55.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.721+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1036085192 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f0b84011710 con 0x55e085f5cf50 2023-08-10T11:03:55.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.721+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1036085192 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b840118d0 con 0x55e085f5cf50 2023-08-10T11:03:55.746 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0baf756b80 10 client.16776 fetch_fsmap learned FSMap version 59 2023-08-10T11:03:55.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0baf756b80 1 -- 172.21.15.107:0/1036085192 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55e085cd5de0 con 0x55e085f5cf50 2023-08-10T11:03:55.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1036085192 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e085f4a470 con 0x55e085f5cf50 2023-08-10T11:03:55.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1036085192 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 59) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0b8400fb50 con 0x55e085f5cf50 2023-08-10T11:03:55.747 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0baf756b80 10 client.16776 fetch_fsmap finished waiting for FSMap version 59 2023-08-10T11:03:55.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0baf756b80 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:03:55.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0baf756b80 20 client.16776 populate_metadata read hostname 'smithi107' 2023-08-10T11:03:55.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e085f710f0 0x55e085f73510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.748 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0baf756b80 4 client.16776 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:03:55.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.722+0000 7f0baf756b80 1 -- 172.21.15.107:0/1036085192 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e085f269d0 con 0x55e085f710f0 2023-08-10T11:03:55.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.723+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e085f710f0 0x55e085f73510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.749 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.723+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e085f710f0 0x55e085f73510 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ae0da6674c34b01 server_cookie=544e1b09566b0a52 in_seq=0 out_seq=0 2023-08-10T11:03:55.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.723+0000 7f0b7d7fa700 10 client.16776 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:03:55.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1036085192 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e085f269d0 con 0x55e085f710f0 2023-08-10T11:03:55.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0b7d7fa700 10 client.16776 handle_command_reply: tid=0 2023-08-10T11:03:55.750 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 client.16776 shutdown 2023-08-10T11:03:55.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 -- 172.21.15.107:0/1036085192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 msgr2=0x55e085f60b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:55.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f60b60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0b84012770 tx=0x7f0b84012a80 comp rx=0 tx=0).stop 2023-08-10T11:03:55.751 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 -- 172.21.15.107:0/1036085192 shutdown_connections 2023-08-10T11:03:55.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e085f710f0 0x55e085f73510 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f63950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 0x55e085f612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.752 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1036085192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f60b60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 -- 172.21.15.107:0/1036085192 >> 172.21.15.107:0/1036085192 conn(0x55e085eb4cd0 msgr2=0x55e085f519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:55.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0b7d7fa700 0 client.16776 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:03:55.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 -- 172.21.15.107:0/1036085192 shutdown_connections 2023-08-10T11:03:55.753 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.724+0000 7f0baf756b80 1 -- 172.21.15.107:0/1036085192 wait complete. 2023-08-10T11:03:55.754 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.725+0000 7f0baf756b80 20 client.16776 trim_cache size 0 max 16384 2023-08-10T11:03:55.761 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.744+0000 7f0baf756b80 1 Processor -- start 2023-08-10T11:03:55.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0baf756b80 1 -- start start 2023-08-10T11:03:55.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.762 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5d870 0x55e085f52130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0baf756b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085d2b920 con 0x55e085f5d870 2023-08-10T11:03:55.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0baf756b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085f4ef80 con 0x55e085f57800 2023-08-10T11:03:55.763 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0baf756b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085f533b0 con 0x55e085f5cf50 2023-08-10T11:03:55.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0b9939a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0b9939a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:41276/0 (socket says 172.21.15.107:41276) 2023-08-10T11:03:55.764 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0b9939a700 1 -- 172.21.15.107:0/3359797319 learned_addr learned my addr 172.21.15.107:0/3359797319 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:55.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0b9a39c700 1 --2- 172.21.15.107:0/3359797319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5d870 0x55e085f52130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.745+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/3359797319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.746+0000 7f0b9939a700 1 -- 172.21.15.107:0/3359797319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 msgr2=0x55e085f680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:55.765 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.746+0000 7f0b9939a700 1 --2- 172.21.15.107:0/3359797319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.746+0000 7f0b9939a700 1 -- 172.21.15.107:0/3359797319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5d870 msgr2=0x55e085f52130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:55.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.746+0000 7f0b9939a700 1 --2- 172.21.15.107:0/3359797319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5d870 0x55e085f52130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.746+0000 7f0b9939a700 1 -- 172.21.15.107:0/3359797319 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e085cbec60 con 0x55e085f5cf50 2023-08-10T11:03:55.766 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.746+0000 7f0b9939a700 1 --2- 172.21.15.107:0/3359797319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5c290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400a010 tx=0x7f0b840097c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a1ba5337188e0e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:55.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.746+0000 7f0b88bff700 1 -- 172.21.15.107:0/3359797319 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84017040 con 0x55e085f5cf50 2023-08-10T11:03:55.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.746+0000 7f0b88bff700 1 -- 172.21.15.107:0/3359797319 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8401ce90 con 0x55e085f5cf50 2023-08-10T11:03:55.767 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.746+0000 7f0b88bff700 1 -- 172.21.15.107:0/3359797319 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840056b0 con 0x55e085f5cf50 2023-08-10T11:03:55.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 -- 172.21.15.107:0/3359797319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 msgr2=0x55e085f5c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:55.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 --2- 172.21.15.107:0/3359797319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5c290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400a010 tx=0x7f0b840097c0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 -- 172.21.15.107:0/3359797319 shutdown_connections 2023-08-10T11:03:55.768 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 --2- 172.21.15.107:0/3359797319 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 --2- 172.21.15.107:0/3359797319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5d870 0x55e085f52130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 --2- 172.21.15.107:0/3359797319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5cf50 0x55e085f5c290 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 -- 172.21.15.107:0/3359797319 >> 172.21.15.107:0/3359797319 conn(0x55e085eb4cd0 msgr2=0x55e085f5bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:55.769 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 -- 172.21.15.107:0/3359797319 shutdown_connections 2023-08-10T11:03:55.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 -- 172.21.15.107:0/3359797319 wait complete. 2023-08-10T11:03:55.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.747+0000 7f0baf756b80 1 -- start start 2023-08-10T11:03:55.770 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.748+0000 7f0baf756b80 1 Processor -- start 2023-08-10T11:03:55.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.748+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f5a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.748+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f58970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.748+0000 7f0baf756b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 0x55e085f58eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.771 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.748+0000 7f0baf756b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085f59460 con 0x55e085f5cf50 2023-08-10T11:03:55.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.748+0000 7f0baf756b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085f595d0 con 0x55e085f57800 2023-08-10T11:03:55.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.748+0000 7f0baf756b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e085f59790 con 0x55e085f5d870 2023-08-10T11:03:55.772 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.748+0000 7f0baf756b80 10 client.0 _ll_register_callbacks cb 0x55e085e45680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:03:55.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b9939a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f58970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b99b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f5a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b9939a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f58970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56000/0 (socket says 172.21.15.107:56000) 2023-08-10T11:03:55.773 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b9939a700 1 -- 172.21.15.107:0/1001130827 learned_addr learned my addr 172.21.15.107:0/1001130827 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:03:55.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b9a39c700 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 0x55e085f58eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b9939a700 1 -- 172.21.15.107:0/1001130827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 msgr2=0x55e085f58eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:55.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b9939a700 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 0x55e085f58eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.774 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b9939a700 1 -- 172.21.15.107:0/1001130827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 msgr2=0x55e085f5a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:03:55.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b9939a700 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f5a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b9939a700 1 -- 172.21.15.107:0/1001130827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e085cd5de0 con 0x55e085f5cf50 2023-08-10T11:03:55.775 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.749+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f5a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:03:55.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.750+0000 7f0b9939a700 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f58970 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x55e085f61f60 tx=0x7f0b8401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06fe38da1cbe129 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:03:55.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.750+0000 7f0b7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:03:55.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.750+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1001130827 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8403a070 con 0x55e085f5cf50 2023-08-10T11:03:55.776 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.750+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1001130827 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f0b84005040 con 0x55e085f5cf50 2023-08-10T11:03:55.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.750+0000 7f0baf756b80 1 -- 172.21.15.107:0/1001130827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b90097240 con 0x55e085f5cf50 2023-08-10T11:03:55.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.750+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1001130827 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b84017030 con 0x55e085f5cf50 2023-08-10T11:03:55.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.750+0000 7f0baf756b80 10 client.16782 fetch_fsmap learned FSMap version 59 2023-08-10T11:03:55.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.750+0000 7f0baf756b80 1 -- 172.21.15.107:0/1001130827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55e085cfc250 con 0x55e085f5cf50 2023-08-10T11:03:55.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.750+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1001130827 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b90097240 con 0x55e085f5cf50 2023-08-10T11:03:55.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.751+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1001130827 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 59) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f0b8403d020 con 0x55e085f5cf50 2023-08-10T11:03:55.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.751+0000 7f0baf756b80 10 client.16782 fetch_fsmap finished waiting for FSMap version 59 2023-08-10T11:03:55.777 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.751+0000 7f0baf756b80 10 client.16782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:03:55.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.751+0000 7f0baf756b80 20 client.16782 populate_metadata read hostname 'smithi107' 2023-08-10T11:03:55.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.751+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e085fc5ff0 0x55e085fc8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:03:55.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.751+0000 7f0baf756b80 4 client.16782 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:03:55.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.751+0000 7f0baf756b80 1 -- 172.21.15.107:0/1001130827 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e085ea1780 con 0x55e085fc5ff0 2023-08-10T11:03:55.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.751+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e085fc5ff0 0x55e085fc8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:03:55.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0b99b9b700 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e085fc5ff0 0x55e085fc8410 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a137918a098c6273 server_cookie=d54cb484688f6715 in_seq=0 out_seq=0 2023-08-10T11:03:55.778 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0b7d7fa700 10 client.16782 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:03:55.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0b7d7fa700 1 -- 172.21.15.107:0/1001130827 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e085ea1780 con 0x55e085fc5ff0 2023-08-10T11:03:55.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0b7d7fa700 10 client.16782 handle_command_reply: tid=0 2023-08-10T11:03:55.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 client.16782 shutdown 2023-08-10T11:03:55.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 -- 172.21.15.107:0/1001130827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 msgr2=0x55e085f58970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:55.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f58970 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x55e085f61f60 tx=0x7f0b8401cc20 comp rx=0 tx=0).stop 2023-08-10T11:03:55.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 -- 172.21.15.107:0/1001130827 shutdown_connections 2023-08-10T11:03:55.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55e085fc5ff0 0x55e085fc8410 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.779 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e085f57800 0x55e085f5a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e085f5d870 0x55e085f58eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0b7d7fa700 0 client.16782 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:03:55.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 --2- 172.21.15.107:0/1001130827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e085f5cf50 0x55e085f58970 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 -- 172.21.15.107:0/1001130827 >> 172.21.15.107:0/1001130827 conn(0x55e085eb4cd0 msgr2=0x55e085f5c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:55.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 -- 172.21.15.107:0/1001130827 shutdown_connections 2023-08-10T11:03:55.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.752+0000 7f0baf756b80 1 -- 172.21.15.107:0/1001130827 wait complete. 2023-08-10T11:03:55.780 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0baf756b80 20 client.16782 trim_cache size 0 max 16384 2023-08-10T11:03:55.781 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:03:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:03:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:03:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:03:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:03:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:03:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:03:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:03:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:03:55.782 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:03:55.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 -- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0b800a12c0 msgr2=0x7f0b800a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:55.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0b800a12c0 0x7f0b800a3780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00f600 tx=0x7f0b8c00f9c0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.783 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 -- 172.21.15.107:0/152496015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94102900 msgr2=0x7f0b9419e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:03:55.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94102900 0x7f0b9419e6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009810 tx=0x7f0b9000fa00 comp rx=0 tx=0).stop 2023-08-10T11:03:55.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 -- 172.21.15.107:0/152496015 shutdown_connections 2023-08-10T11:03:55.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94108910 0x7f0b941987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b94102900 0x7f0b9419e6d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0b800a12c0 0x7f0b800a3780 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 --2- 172.21.15.107:0/152496015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b941032c0 0x7f0b9419ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:03:55.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 -- 172.21.15.107:0/152496015 >> 172.21.15.107:0/152496015 conn(0x7f0b940fe430 msgr2=0x7f0b940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:03:55.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 -- 172.21.15.107:0/152496015 shutdown_connections 2023-08-10T11:03:55.785 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:03:55.753+0000 7f0b9bdff700 1 -- 172.21.15.107:0/152496015 wait complete. 2023-08-10T11:03:55.785 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:03:57.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:57 smithi195 ceph-mon[129938]: pgmap v397: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-08-10T11:03:58.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:57 smithi157 ceph-mon[129604]: pgmap v397: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-08-10T11:03:58.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:57 smithi107 ceph-mon[127953]: pgmap v397: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-08-10T11:04:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:03:59 smithi195 ceph-mon[129938]: pgmap v398: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 38 MiB/s wr, 45 op/s 2023-08-10T11:04:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:03:59 smithi157 ceph-mon[129604]: pgmap v398: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 38 MiB/s wr, 45 op/s 2023-08-10T11:04:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:03:59 smithi107 ceph-mon[127953]: pgmap v398: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 38 MiB/s wr, 45 op/s 2023-08-10T11:04:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:01 smithi195 ceph-mon[129938]: pgmap v399: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 26 MiB/s wr, 30 op/s 2023-08-10T11:04:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:01 smithi157 ceph-mon[129604]: pgmap v399: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 26 MiB/s wr, 30 op/s 2023-08-10T11:04:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:01 smithi107 ceph-mon[127953]: pgmap v399: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 26 MiB/s wr, 30 op/s 2023-08-10T11:04:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:03 smithi195 ceph-mon[129938]: pgmap v400: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 26 MiB/s wr, 30 op/s 2023-08-10T11:04:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:03 smithi195 ceph-mon[129938]: osdmap e107: 12 total, 12 up, 12 in 2023-08-10T11:04:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:03 smithi157 ceph-mon[129604]: pgmap v400: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 26 MiB/s wr, 30 op/s 2023-08-10T11:04:04.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:03 smithi157 ceph-mon[129604]: osdmap e107: 12 total, 12 up, 12 in 2023-08-10T11:04:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:03 smithi107 ceph-mon[127953]: pgmap v400: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 26 MiB/s wr, 30 op/s 2023-08-10T11:04:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:03 smithi107 ceph-mon[127953]: osdmap e107: 12 total, 12 up, 12 in 2023-08-10T11:04:06.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:05 smithi195 ceph-mon[129938]: pgmap v402: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 30 MiB/s wr, 60 op/s 2023-08-10T11:04:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:05 smithi157 ceph-mon[129604]: pgmap v402: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 30 MiB/s wr, 60 op/s 2023-08-10T11:04:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:05 smithi107 ceph-mon[127953]: pgmap v402: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 30 MiB/s wr, 60 op/s 2023-08-10T11:04:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:07 smithi195 ceph-mon[129938]: pgmap v403: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 30 MiB/s wr, 60 op/s 2023-08-10T11:04:08.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:07 smithi157 ceph-mon[129604]: pgmap v403: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 30 MiB/s wr, 60 op/s 2023-08-10T11:04:08.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:07 smithi107 ceph-mon[127953]: pgmap v403: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 30 MiB/s wr, 60 op/s 2023-08-10T11:04:10.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:09 smithi195 ceph-mon[129938]: pgmap v404: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 30 MiB/s wr, 57 op/s 2023-08-10T11:04:10.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:09 smithi195 ceph-mon[129938]: osdmap e108: 12 total, 12 up, 12 in 2023-08-10T11:04:10.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:09 smithi157 ceph-mon[129604]: pgmap v404: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 30 MiB/s wr, 57 op/s 2023-08-10T11:04:10.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:09 smithi157 ceph-mon[129604]: osdmap e108: 12 total, 12 up, 12 in 2023-08-10T11:04:10.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:09 smithi107 ceph-mon[127953]: pgmap v404: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 30 MiB/s wr, 57 op/s 2023-08-10T11:04:10.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:09 smithi107 ceph-mon[127953]: osdmap e108: 12 total, 12 up, 12 in 2023-08-10T11:04:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:11 smithi195 ceph-mon[129938]: pgmap v406: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 38 MiB/s wr, 77 op/s 2023-08-10T11:04:12.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:11 smithi157 ceph-mon[129604]: pgmap v406: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 38 MiB/s wr, 77 op/s 2023-08-10T11:04:12.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:11 smithi107 ceph-mon[127953]: pgmap v406: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 38 MiB/s wr, 77 op/s 2023-08-10T11:04:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:13 smithi195 ceph-mon[129938]: pgmap v407: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 31 MiB/s wr, 63 op/s 2023-08-10T11:04:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:13 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:04:14.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:13 smithi157 ceph-mon[129604]: pgmap v407: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 31 MiB/s wr, 63 op/s 2023-08-10T11:04:14.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:13 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:04:14.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:13 smithi107 ceph-mon[127953]: pgmap v407: 129 pgs: 129 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 31 MiB/s wr, 63 op/s 2023-08-10T11:04:14.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:13 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:04:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:15 smithi195 ceph-mon[129938]: pgmap v408: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 MiB/s wr, 30 op/s 2023-08-10T11:04:16.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:15 smithi157 ceph-mon[129604]: pgmap v408: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 MiB/s wr, 30 op/s 2023-08-10T11:04:16.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:15 smithi107 ceph-mon[127953]: pgmap v408: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 MiB/s wr, 30 op/s 2023-08-10T11:04:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:17 smithi195 ceph-mon[129938]: pgmap v409: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 MiB/s wr, 30 op/s 2023-08-10T11:04:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:17 smithi157 ceph-mon[129604]: pgmap v409: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 MiB/s wr, 30 op/s 2023-08-10T11:04:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:17 smithi107 ceph-mon[127953]: pgmap v409: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 MiB/s wr, 30 op/s 2023-08-10T11:04:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:19 smithi195 ceph-mon[129938]: pgmap v410: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 29 op/s 2023-08-10T11:04:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:19 smithi157 ceph-mon[129604]: pgmap v410: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 29 op/s 2023-08-10T11:04:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:19 smithi107 ceph-mon[127953]: pgmap v410: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 29 op/s 2023-08-10T11:04:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:21 smithi195 ceph-mon[129938]: pgmap v411: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-08-10T11:04:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:21 smithi157 ceph-mon[129604]: pgmap v411: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-08-10T11:04:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:21 smithi107 ceph-mon[127953]: pgmap v411: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-08-10T11:04:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:23 smithi195 ceph-mon[129938]: pgmap v412: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:04:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:23 smithi157 ceph-mon[129604]: pgmap v412: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:04:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:23 smithi107 ceph-mon[127953]: pgmap v412: 129 pgs: 129 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:04:25.785 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:04:26.022 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.021+0000 7f231f3ff700 1 -- 172.21.15.107:0/2097804098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23181066d0 msgr2=0x7f2318106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:26.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.021+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2097804098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23181066d0 0x7f2318106ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2314009990 tx=0x7f2314009ca0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.021+0000 7f231f3ff700 1 -- 172.21.15.107:0/2097804098 shutdown_connections 2023-08-10T11:04:26.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.021+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2097804098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2318101080 0x7f231810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.021+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2097804098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23181066d0 0x7f2318106ab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.021+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2097804098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23181006c0 0x7f2318100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.021+0000 7f231f3ff700 1 -- 172.21.15.107:0/2097804098 >> 172.21.15.107:0/2097804098 conn(0x7f23180fc1f0 msgr2=0x7f23180fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:26.023 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.021+0000 7f231f3ff700 1 -- 172.21.15.107:0/2097804098 shutdown_connections 2023-08-10T11:04:26.024 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.021+0000 7f231f3ff700 1 -- 172.21.15.107:0/2097804098 wait complete. 2023-08-10T11:04:26.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.022+0000 7f231f3ff700 1 Processor -- start 2023-08-10T11:04:26.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.022+0000 7f231f3ff700 1 -- start start 2023-08-10T11:04:26.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231f3ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23181006c0 0x7f23181989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231f3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2318101080 0x7f2318198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231f3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23181066d0 0x7f231819d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231f3ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231819d940 con 0x7f23181006c0 2023-08-10T11:04:26.025 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231f3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231819dab0 con 0x7f2318101080 2023-08-10T11:04:26.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231f3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231819dc70 con 0x7f23181066d0 2023-08-10T11:04:26.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231d19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23181006c0 0x7f23181989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231d19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23181006c0 0x7f23181989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33116/0 (socket says 172.21.15.107:33116) 2023-08-10T11:04:26.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231d19b700 1 -- 172.21.15.107:0/2323821708 learned_addr learned my addr 172.21.15.107:0/2323821708 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:26.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231d99c700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23181066d0 0x7f231819d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.023+0000 7f231c99a700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2318101080 0x7f2318198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.026 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f231d19b700 1 -- 172.21.15.107:0/2323821708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23181066d0 msgr2=0x7f231819d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:26.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f231d19b700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23181066d0 0x7f231819d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.027 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f231d19b700 1 -- 172.21.15.107:0/2323821708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2318101080 msgr2=0x7f2318198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:26.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f231d19b700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2318101080 0x7f2318198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f231d19b700 1 -- 172.21.15.107:0/2323821708 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23140095f0 con 0x7f23181006c0 2023-08-10T11:04:26.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f231d99c700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23181066d0 0x7f231819d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:04:26.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f231d19b700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23181006c0 0x7f23181989a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2314005740 tx=0x7f2314005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:26.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f230e7fc700 1 -- 172.21.15.107:0/2323821708 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231401d070 con 0x7f23181006c0 2023-08-10T11:04:26.028 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f230e7fc700 1 -- 172.21.15.107:0/2323821708 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2314022470 con 0x7f23181006c0 2023-08-10T11:04:26.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f231f3ff700 1 -- 172.21.15.107:0/2323821708 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231819def0 con 0x7f23181006c0 2023-08-10T11:04:26.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.024+0000 7f230e7fc700 1 -- 172.21.15.107:0/2323821708 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314017650 con 0x7f23181006c0 2023-08-10T11:04:26.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.025+0000 7f231f3ff700 1 -- 172.21.15.107:0/2323821708 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231819e1f0 con 0x7f23181006c0 2023-08-10T11:04:26.029 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.028+0000 7f230e7fc700 1 -- 172.21.15.107:0/2323821708 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f23140225e0 con 0x7f23181006c0 2023-08-10T11:04:26.030 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f2332dd0b80 1 Processor -- start 2023-08-10T11:04:26.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f2332dd0b80 1 -- start start 2023-08-10T11:04:26.031 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea329f50 0x5622ea32a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea32a870 0x5622ea3242c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 0x5622ea324c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea29fdc0 con 0x5622ea32a870 2023-08-10T11:04:26.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea27c590 con 0x5622ea324800 2023-08-10T11:04:26.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea279eb0 con 0x5622ea329f50 2023-08-10T11:04:26.032 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f230e7fc700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23040a12c0 0x7f23040a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.033 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.030+0000 7f231d19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea32a870 0x5622ea3242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea32a870 0x5622ea3242c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33128/0 (socket says 172.21.15.107:33128) 2023-08-10T11:04:26.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d19b700 1 -- 172.21.15.107:0/2550267898 learned_addr learned my addr 172.21.15.107:0/2550267898 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:26.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d99c700 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea329f50 0x5622ea32a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231c99a700 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 0x5622ea324c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f230e7fc700 1 -- 172.21.15.107:0/2323821708 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f23140ce400 con 0x7f23181006c0 2023-08-10T11:04:26.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d99c700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23040a12c0 0x7f23040a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.034 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d19b700 1 -- 172.21.15.107:0/2550267898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea329f50 msgr2=0x5622ea32a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:26.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d19b700 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea329f50 0x5622ea32a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d19b700 1 -- 172.21.15.107:0/2550267898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 msgr2=0x5622ea324c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:26.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d19b700 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 0x5622ea324c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d19b700 1 -- 172.21.15.107:0/2550267898 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622ea0f6630 con 0x5622ea32a870 2023-08-10T11:04:26.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231c99a700 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 0x5622ea324c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:04:26.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d19b700 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea32a870 0x5622ea3242c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f231409b140 tx=0x7f231406d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb807eccd436254 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:26.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.031+0000 7f231d99c700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23040a12c0 0x7f23040a3780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5622ea325520 tx=0x7f231000b040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:26.035 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.032+0000 7f23037fe700 1 -- 172.21.15.107:0/2550267898 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140a10d0 con 0x5622ea32a870 2023-08-10T11:04:26.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.032+0000 7f23037fe700 1 -- 172.21.15.107:0/2550267898 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f231409af80 con 0x5622ea32a870 2023-08-10T11:04:26.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.032+0000 7f23037fe700 1 -- 172.21.15.107:0/2550267898 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314022ac0 con 0x5622ea32a870 2023-08-10T11:04:26.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.032+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2550267898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea32a870 msgr2=0x5622ea3242c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:26.036 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.032+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea32a870 0x5622ea3242c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f231409b140 tx=0x7f231406d220 comp rx=0 tx=0).stop 2023-08-10T11:04:26.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.033+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2550267898 shutdown_connections 2023-08-10T11:04:26.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.033+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 0x5622ea324c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.038 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.033+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea329f50 0x5622ea32a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.033+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2550267898 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea32a870 0x5622ea3242c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.033+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2550267898 >> 172.21.15.107:0/2550267898 conn(0x5622ea281cd0 msgr2=0x5622ea31f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:26.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.033+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2550267898 shutdown_connections 2023-08-10T11:04:26.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.033+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2550267898 wait complete. 2023-08-10T11:04:26.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.033+0000 7f2332dd0b80 1 -- start start 2023-08-10T11:04:26.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.034+0000 7f2332dd0b80 1 Processor -- start 2023-08-10T11:04:26.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.034+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea324800 0x5622ea3307f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.039 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.034+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea32da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.034+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea32a870 0x5622ea32e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.034+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea2757a0 con 0x5622ea329f50 2023-08-10T11:04:26.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.034+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea214ac0 con 0x5622ea32a870 2023-08-10T11:04:26.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.034+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea2147c0 con 0x5622ea324800 2023-08-10T11:04:26.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.034+0000 7f2332dd0b80 10 client.0 _ll_register_callbacks cb 0x5622ea212680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:04:26.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea324800 0x5622ea3307f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.040 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea324800 0x5622ea3307f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:43170/0 (socket says 172.21.15.107:43170) 2023-08-10T11:04:26.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d19b700 1 -- 172.21.15.107:0/2519998251 learned_addr learned my addr 172.21.15.107:0/2519998251 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:26.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d99c700 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea32a870 0x5622ea32e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231c99a700 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea32da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d19b700 1 -- 172.21.15.107:0/2519998251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea32a870 msgr2=0x5622ea32e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:26.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d19b700 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea32a870 0x5622ea32e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d19b700 1 -- 172.21.15.107:0/2519998251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 msgr2=0x5622ea32da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:26.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d19b700 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea32da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.041 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d19b700 1 -- 172.21.15.107:0/2519998251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23080098e0 con 0x5622ea324800 2023-08-10T11:04:26.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d99c700 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea32a870 0x5622ea32e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:04:26.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f231d19b700 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea324800 0x5622ea3307f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f23140a3040 tx=0x7f231401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bf1e69d7cf0f8ff server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:26.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.035+0000 7f2300ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:04:26.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.036+0000 7f2300ff9700 1 -- 172.21.15.107:0/2519998251 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231409b1b0 con 0x5622ea324800 2023-08-10T11:04:26.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.036+0000 7f2300ff9700 1 -- 172.21.15.107:0/2519998251 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f23140a3570 con 0x5622ea324800 2023-08-10T11:04:26.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.036+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2519998251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622ea317470 con 0x5622ea324800 2023-08-10T11:04:26.042 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.036+0000 7f2300ff9700 1 -- 172.21.15.107:0/2519998251 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f231409acf0 con 0x5622ea324800 2023-08-10T11:04:26.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.036+0000 7f2332dd0b80 10 client.26491 fetch_fsmap learned FSMap version 60 2023-08-10T11:04:26.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.036+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2519998251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x7f231819e1f0 con 0x5622ea324800 2023-08-10T11:04:26.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.036+0000 7f2300ff9700 1 -- 172.21.15.107:0/2519998251 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5622ea317470 con 0x5622ea324800 2023-08-10T11:04:26.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.036+0000 7f2300ff9700 1 -- 172.21.15.107:0/2519998251 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 60) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f231409b410 con 0x5622ea324800 2023-08-10T11:04:26.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.037+0000 7f2332dd0b80 10 client.26491 fetch_fsmap finished waiting for FSMap version 60 2023-08-10T11:04:26.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.037+0000 7f2332dd0b80 10 client.26491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:04:26.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.037+0000 7f2332dd0b80 20 client.26491 populate_metadata read hostname 'smithi107' 2023-08-10T11:04:26.043 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.037+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5622ea33da20 0x5622ea33fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.037+0000 7f2332dd0b80 4 client.26491 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:04:26.044 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.037+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2519998251 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622ea2f39d0 con 0x5622ea33da20 2023-08-10T11:04:26.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.037+0000 7f231c99a700 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5622ea33da20 0x5622ea33fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.038+0000 7f231c99a700 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5622ea33da20 0x5622ea33fe40 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3287c1f9938175c0 server_cookie=56c785a5af11f399 in_seq=0 out_seq=0 2023-08-10T11:04:26.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.038+0000 7f2300ff9700 10 client.26491 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:04:26.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2300ff9700 1 -- 172.21.15.107:0/2519998251 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5622ea2f39d0 con 0x5622ea33da20 2023-08-10T11:04:26.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2300ff9700 10 client.26491 handle_command_reply: tid=0 2023-08-10T11:04:26.045 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 client.26491 shutdown 2023-08-10T11:04:26.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2519998251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea324800 msgr2=0x5622ea3307f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:26.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea324800 0x5622ea3307f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f23140a3040 tx=0x7f231401c360 comp rx=0 tx=0).stop 2023-08-10T11:04:26.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2519998251 shutdown_connections 2023-08-10T11:04:26.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5622ea33da20 0x5622ea33fe40 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea32a870 0x5622ea32e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea324800 0x5622ea3307f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2300ff9700 0 client.26491 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:04:26.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/2519998251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea32da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2519998251 >> 172.21.15.107:0/2519998251 conn(0x5622ea281cd0 msgr2=0x5622ea31e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:26.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2519998251 shutdown_connections 2023-08-10T11:04:26.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 1 -- 172.21.15.107:0/2519998251 wait complete. 2023-08-10T11:04:26.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.039+0000 7f2332dd0b80 20 client.26491 trim_cache size 0 max 16384 2023-08-10T11:04:26.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.065+0000 7f2332dd0b80 1 Processor -- start 2023-08-10T11:04:26.066 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.065+0000 7f2332dd0b80 1 -- start start 2023-08-10T11:04:26.067 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 0x5622ea3350d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea329260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 0x5622ea31f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea0f8920 con 0x5622ea329f50 2023-08-10T11:04:26.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea32f050 con 0x5622ea324800 2023-08-10T11:04:26.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea320dc0 con 0x5622ea32a870 2023-08-10T11:04:26.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231c99a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea329260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.068 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231c99a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea329260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33156/0 (socket says 172.21.15.107:33156) 2023-08-10T11:04:26.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231c99a700 1 -- 172.21.15.107:0/21532570 learned_addr learned my addr 172.21.15.107:0/21532570 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:26.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231d99c700 1 --2- 172.21.15.107:0/21532570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 0x5622ea31f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231d19b700 1 --2- 172.21.15.107:0/21532570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 0x5622ea3350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231c99a700 1 -- 172.21.15.107:0/21532570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 msgr2=0x5622ea31f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:26.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231c99a700 1 --2- 172.21.15.107:0/21532570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 0x5622ea31f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231c99a700 1 -- 172.21.15.107:0/21532570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 msgr2=0x5622ea3350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:26.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231c99a700 1 --2- 172.21.15.107:0/21532570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 0x5622ea3350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.069 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.066+0000 7f231c99a700 1 -- 172.21.15.107:0/21532570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622ea0a2de0 con 0x5622ea329f50 2023-08-10T11:04:26.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.067+0000 7f231c99a700 1 --2- 172.21.15.107:0/21532570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea329260 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x5622ea32f020 tx=0x7f2308004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e6662cc4e558cf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:26.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.067+0000 7f2303fff700 1 -- 172.21.15.107:0/21532570 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308016050 con 0x5622ea329f50 2023-08-10T11:04:26.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.067+0000 7f2303fff700 1 -- 172.21.15.107:0/21532570 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2308017040 con 0x5622ea329f50 2023-08-10T11:04:26.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.067+0000 7f2303fff700 1 -- 172.21.15.107:0/21532570 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308005410 con 0x5622ea329f50 2023-08-10T11:04:26.071 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 -- 172.21.15.107:0/21532570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 msgr2=0x5622ea329260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:26.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/21532570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea329260 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x5622ea32f020 tx=0x7f2308004750 comp rx=0 tx=0).stop 2023-08-10T11:04:26.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 -- 172.21.15.107:0/21532570 shutdown_connections 2023-08-10T11:04:26.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/21532570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea324800 0x5622ea3350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/21532570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 0x5622ea31f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/21532570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea329f50 0x5622ea329260 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 -- 172.21.15.107:0/21532570 >> 172.21.15.107:0/21532570 conn(0x5622ea281cd0 msgr2=0x5622ea328b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:26.072 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 -- 172.21.15.107:0/21532570 shutdown_connections 2023-08-10T11:04:26.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 -- 172.21.15.107:0/21532570 wait complete. 2023-08-10T11:04:26.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.068+0000 7f2332dd0b80 1 -- start start 2023-08-10T11:04:26.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f2332dd0b80 1 Processor -- start 2023-08-10T11:04:26.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea324800 0x5622ea325dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea329f50 0x5622ea326300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f2332dd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 0x5622ea326840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea3354d0 con 0x5622ea324800 2023-08-10T11:04:26.073 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea391690 con 0x5622ea329f50 2023-08-10T11:04:26.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f2332dd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622ea391820 con 0x5622ea32a870 2023-08-10T11:04:26.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f2332dd0b80 10 client.0 _ll_register_callbacks cb 0x5622ea212680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:04:26.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f231d19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea324800 0x5622ea325dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f231d19b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea324800 0x5622ea325dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33160/0 (socket says 172.21.15.107:33160) 2023-08-10T11:04:26.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f231d19b700 1 -- 172.21.15.107:0/3585584565 learned_addr learned my addr 172.21.15.107:0/3585584565 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:26.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.069+0000 7f231d99c700 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 0x5622ea326840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f231c99a700 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea329f50 0x5622ea326300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.074 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f231d19b700 1 -- 172.21.15.107:0/3585584565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 msgr2=0x5622ea326840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:26.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f231d19b700 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 0x5622ea326840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f231d19b700 1 -- 172.21.15.107:0/3585584565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea329f50 msgr2=0x5622ea326300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:26.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f231d19b700 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea329f50 0x5622ea326300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.075 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f231d19b700 1 -- 172.21.15.107:0/3585584565 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2308009ca0 con 0x5622ea324800 2023-08-10T11:04:26.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f231d19b700 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea324800 0x5622ea325dc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f231409aeb0 tx=0x7f2314009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcda57e4121ac895 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:26.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f2300ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:04:26.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f2300ff9700 1 -- 172.21.15.107:0/3585584565 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140a10d0 con 0x5622ea324800 2023-08-10T11:04:26.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f2300ff9700 1 -- 172.21.15.107:0/3585584565 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f23140cba20 con 0x5622ea324800 2023-08-10T11:04:26.077 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.070+0000 7f2332dd0b80 1 -- 172.21.15.107:0/3585584565 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f231409af80 con 0x5622ea324800 2023-08-10T11:04:26.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2300ff9700 1 -- 172.21.15.107:0/3585584565 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f231409b1b0 con 0x5622ea324800 2023-08-10T11:04:26.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2332dd0b80 10 client.16800 fetch_fsmap learned FSMap version 60 2023-08-10T11:04:26.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2332dd0b80 1 -- 172.21.15.107:0/3585584565 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x5622ea08bc60 con 0x5622ea324800 2023-08-10T11:04:26.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2300ff9700 1 -- 172.21.15.107:0/3585584565 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f231409af80 con 0x5622ea324800 2023-08-10T11:04:26.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2300ff9700 1 -- 172.21.15.107:0/3585584565 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 60) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f23140b92e0 con 0x5622ea324800 2023-08-10T11:04:26.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2332dd0b80 10 client.16800 fetch_fsmap finished waiting for FSMap version 60 2023-08-10T11:04:26.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2332dd0b80 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:04:26.078 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2332dd0b80 20 client.16800 populate_metadata read hostname 'smithi107' 2023-08-10T11:04:26.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5622ea392a80 0x5622ea394e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:26.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2332dd0b80 4 client.16800 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:04:26.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.071+0000 7f2332dd0b80 1 -- 172.21.15.107:0/3585584565 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5622ea26e780 con 0x5622ea392a80 2023-08-10T11:04:26.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.072+0000 7f231c99a700 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5622ea392a80 0x5622ea394e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:26.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.072+0000 7f231c99a700 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5622ea392a80 0x5622ea394e70 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863e111390b03f61 server_cookie=e997560f76cc90b9 in_seq=0 out_seq=0 2023-08-10T11:04:26.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.072+0000 7f2300ff9700 10 client.16800 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:04:26.079 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2300ff9700 1 -- 172.21.15.107:0/3585584565 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5622ea26e780 con 0x5622ea392a80 2023-08-10T11:04:26.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2300ff9700 10 client.16800 handle_command_reply: tid=0 2023-08-10T11:04:26.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 client.16800 shutdown 2023-08-10T11:04:26.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 -- 172.21.15.107:0/3585584565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea324800 msgr2=0x5622ea325dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:26.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea324800 0x5622ea325dc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f231409aeb0 tx=0x7f2314009310 comp rx=0 tx=0).stop 2023-08-10T11:04:26.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 -- 172.21.15.107:0/3585584565 shutdown_connections 2023-08-10T11:04:26.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5622ea392a80 0x5622ea394e70 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5622ea32a870 0x5622ea326840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.080 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622ea324800 0x5622ea325dc0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 --2- 172.21.15.107:0/3585584565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5622ea329f50 0x5622ea326300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 -- 172.21.15.107:0/3585584565 >> 172.21.15.107:0/3585584565 conn(0x5622ea281cd0 msgr2=0x5622ea3232b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:26.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2300ff9700 0 client.16800 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:04:26.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 -- 172.21.15.107:0/3585584565 shutdown_connections 2023-08-10T11:04:26.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 1 -- 172.21.15.107:0/3585584565 wait complete. 2023-08-10T11:04:26.081 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.073+0000 7f2332dd0b80 20 client.16800 trim_cache size 0 max 16384 2023-08-10T11:04:26.082 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:04:26.082 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:04:26.082 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:04:26.082 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:04:26.082 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:04:26.082 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:04:26.082 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:04:26.083 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:04:26.083 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:04:26.083 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:04:26.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 -- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23040a12c0 msgr2=0x7f23040a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:26.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23040a12c0 0x7f23040a3780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5622ea325520 tx=0x7f231000b040 comp rx=0 tx=0).stop 2023-08-10T11:04:26.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 -- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23181006c0 msgr2=0x7f23181989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:26.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23181006c0 0x7f23181989a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2314005740 tx=0x7f2314005770 comp rx=0 tx=0).stop 2023-08-10T11:04:26.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 -- 172.21.15.107:0/2323821708 shutdown_connections 2023-08-10T11:04:26.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23181066d0 0x7f231819d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f23181006c0 0x7f23181989a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.084 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f23040a12c0 0x7f23040a3780 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 --2- 172.21.15.107:0/2323821708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2318101080 0x7f2318198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:26.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 -- 172.21.15.107:0/2323821708 >> 172.21.15.107:0/2323821708 conn(0x7f23180fc1f0 msgr2=0x7f231810b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:26.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 -- 172.21.15.107:0/2323821708 shutdown_connections 2023-08-10T11:04:26.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:26.074+0000 7f231f3ff700 1 -- 172.21.15.107:0/2323821708 wait complete. 2023-08-10T11:04:26.094 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:04:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:25 smithi195 ceph-mon[129938]: pgmap v413: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 MiB/s wr, 34 op/s 2023-08-10T11:04:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:25 smithi157 ceph-mon[129604]: pgmap v413: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 MiB/s wr, 34 op/s 2023-08-10T11:04:26.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:25 smithi107 ceph-mon[127953]: pgmap v413: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 MiB/s wr, 34 op/s 2023-08-10T11:04:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:27 smithi195 ceph-mon[129938]: pgmap v414: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:04:28.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:27 smithi157 ceph-mon[129604]: pgmap v414: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:04:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:27 smithi107 ceph-mon[127953]: pgmap v414: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:04:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:29 smithi195 ceph-mon[129938]: pgmap v415: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 MiB/s wr, 32 op/s 2023-08-10T11:04:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:29 smithi157 ceph-mon[129604]: pgmap v415: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 MiB/s wr, 32 op/s 2023-08-10T11:04:30.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:29 smithi107 ceph-mon[127953]: pgmap v415: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 MiB/s wr, 32 op/s 2023-08-10T11:04:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:31 smithi195 ceph-mon[129938]: pgmap v416: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-08-10T11:04:32.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:31 smithi157 ceph-mon[129604]: pgmap v416: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-08-10T11:04:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:31 smithi107 ceph-mon[127953]: pgmap v416: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-08-10T11:04:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:33 smithi195 ceph-mon[129938]: pgmap v417: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:04:34.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:33 smithi157 ceph-mon[129604]: pgmap v417: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:04:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:33 smithi107 ceph-mon[127953]: pgmap v417: 129 pgs: 129 active+clean; 11 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:04:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:35 smithi195 ceph-mon[129938]: pgmap v418: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 MiB/s wr, 33 op/s 2023-08-10T11:04:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:35 smithi157 ceph-mon[129604]: pgmap v418: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 MiB/s wr, 33 op/s 2023-08-10T11:04:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:35 smithi107 ceph-mon[127953]: pgmap v418: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 MiB/s wr, 33 op/s 2023-08-10T11:04:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:37 smithi195 ceph-mon[129938]: pgmap v419: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:04:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:37 smithi157 ceph-mon[129604]: pgmap v419: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:04:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:37 smithi107 ceph-mon[127953]: pgmap v419: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:04:40.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:39 smithi195 ceph-mon[129938]: pgmap v420: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 MiB/s wr, 30 op/s 2023-08-10T11:04:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:39 smithi157 ceph-mon[129604]: pgmap v420: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 MiB/s wr, 30 op/s 2023-08-10T11:04:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:39 smithi107 ceph-mon[127953]: pgmap v420: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 MiB/s wr, 30 op/s 2023-08-10T11:04:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:41 smithi195 ceph-mon[129938]: pgmap v421: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:04:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:41 smithi157 ceph-mon[129604]: pgmap v421: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:04:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:41 smithi107 ceph-mon[127953]: pgmap v421: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:04:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:43 smithi195 ceph-mon[129938]: pgmap v422: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:04:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:43 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:04:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:43 smithi157 ceph-mon[129604]: pgmap v422: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:04:44.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:43 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:04:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:43 smithi107 ceph-mon[127953]: pgmap v422: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:04:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:43 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:04:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:44 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:04:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:44 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:04:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:44 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:04:45.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:44 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:04:45.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:44 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:04:45.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:44 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:04:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:44 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:04:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:44 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:04:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:44 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:04:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:45 smithi195 ceph-mon[129938]: pgmap v423: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 39 MiB/s wr, 35 op/s 2023-08-10T11:04:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:45 smithi157 ceph-mon[129604]: pgmap v423: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 39 MiB/s wr, 35 op/s 2023-08-10T11:04:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:45 smithi107 ceph-mon[127953]: pgmap v423: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 39 MiB/s wr, 35 op/s 2023-08-10T11:04:48.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:47 smithi195 ceph-mon[129938]: pgmap v424: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 26 MiB/s wr, 25 op/s 2023-08-10T11:04:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:47 smithi157 ceph-mon[129604]: pgmap v424: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 26 MiB/s wr, 25 op/s 2023-08-10T11:04:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:47 smithi107 ceph-mon[127953]: pgmap v424: 129 pgs: 129 active+clean; 11 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 26 MiB/s wr, 25 op/s 2023-08-10T11:04:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:49 smithi195 ceph-mon[129938]: pgmap v425: 129 pgs: 129 active+clean; 11 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 38 MiB/s wr, 34 op/s 2023-08-10T11:04:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:49 smithi157 ceph-mon[129604]: pgmap v425: 129 pgs: 129 active+clean; 11 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 38 MiB/s wr, 34 op/s 2023-08-10T11:04:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:49 smithi107 ceph-mon[127953]: pgmap v425: 129 pgs: 129 active+clean; 11 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 38 MiB/s wr, 34 op/s 2023-08-10T11:04:51.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:50 smithi157 ceph-mon[129604]: pgmap v426: 129 pgs: 129 active+clean; 11 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 29 MiB/s wr, 28 op/s 2023-08-10T11:04:51.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:50 smithi107 ceph-mon[127953]: pgmap v426: 129 pgs: 129 active+clean; 11 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 29 MiB/s wr, 28 op/s 2023-08-10T11:04:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:50 smithi195 ceph-mon[129938]: pgmap v426: 129 pgs: 129 active+clean; 11 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 29 MiB/s wr, 28 op/s 2023-08-10T11:04:53.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:53 smithi195 ceph-mon[129938]: pgmap v427: 129 pgs: 129 active+clean; 11 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-08-10T11:04:54.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:53 smithi157 ceph-mon[129604]: pgmap v427: 129 pgs: 129 active+clean; 11 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-08-10T11:04:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:53 smithi107 ceph-mon[127953]: pgmap v427: 129 pgs: 129 active+clean; 11 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-08-10T11:04:56.095 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:04:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:55 smithi195 ceph-mon[129938]: pgmap v428: 129 pgs: 129 active+clean; 12 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 39 MiB/s wr, 37 op/s 2023-08-10T11:04:56.168 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:55 smithi107 ceph-mon[127953]: pgmap v428: 129 pgs: 129 active+clean; 12 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 39 MiB/s wr, 37 op/s 2023-08-10T11:04:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:55 smithi157 ceph-mon[129604]: pgmap v428: 129 pgs: 129 active+clean; 12 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 39 MiB/s wr, 37 op/s 2023-08-10T11:04:56.321 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.320+0000 7f228b1ff700 1 -- 172.21.15.107:0/4035771576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22841066d0 msgr2=0x7f2284106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.320+0000 7f228b1ff700 1 --2- 172.21.15.107:0/4035771576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22841066d0 0x7f2284106ab0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2280009990 tx=0x7f2280009ca0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.320+0000 7f228b1ff700 1 -- 172.21.15.107:0/4035771576 shutdown_connections 2023-08-10T11:04:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.320+0000 7f228b1ff700 1 --2- 172.21.15.107:0/4035771576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2284101080 0x7f228410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.320+0000 7f228b1ff700 1 --2- 172.21.15.107:0/4035771576 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22841066d0 0x7f2284106ab0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.322 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.320+0000 7f228b1ff700 1 --2- 172.21.15.107:0/4035771576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22841006c0 0x7f2284100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.320+0000 7f228b1ff700 1 -- 172.21.15.107:0/4035771576 >> 172.21.15.107:0/4035771576 conn(0x7f22840fc1f0 msgr2=0x7f22840fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.320+0000 7f228b1ff700 1 -- 172.21.15.107:0/4035771576 shutdown_connections 2023-08-10T11:04:56.323 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.320+0000 7f228b1ff700 1 -- 172.21.15.107:0/4035771576 wait complete. 2023-08-10T11:04:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.321+0000 7f228b1ff700 1 Processor -- start 2023-08-10T11:04:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f228b1ff700 1 -- start start 2023-08-10T11:04:56.325 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f228b1ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22841006c0 0x7f2284072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f228b1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2284101080 0x7f2284072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f228b1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22841066d0 0x7f22841a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f228b1ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22840737e0 con 0x7f22841006c0 2023-08-10T11:04:56.326 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f228b1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22841a4de0 con 0x7f22841066d0 2023-08-10T11:04:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f228b1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22841a4f20 con 0x7f2284101080 2023-08-10T11:04:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f2288f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22841006c0 0x7f2284072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f227bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2284101080 0x7f2284072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.327 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f2288f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22841006c0 0x7f2284072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44328/0 (socket says 172.21.15.107:44328) 2023-08-10T11:04:56.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.322+0000 7f2288f9b700 1 -- 172.21.15.107:0/1406509876 learned_addr learned my addr 172.21.15.107:0/1406509876 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:56.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.323+0000 7f228979c700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22841066d0 0x7f22841a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.323+0000 7f227bfff700 1 -- 172.21.15.107:0/1406509876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22841066d0 msgr2=0x7f22841a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:56.328 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.323+0000 7f227bfff700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22841066d0 0x7f22841a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.323+0000 7f227bfff700 1 -- 172.21.15.107:0/1406509876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22841006c0 msgr2=0x7f2284072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:56.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.323+0000 7f227bfff700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22841006c0 0x7f2284072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.323+0000 7f227bfff700 1 -- 172.21.15.107:0/1406509876 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22800095f0 con 0x7f2284101080 2023-08-10T11:04:56.329 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.323+0000 7f227bfff700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2284101080 0x7f2284072fb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f227400e9f0 tx=0x7f227400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:56.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.323+0000 7f2279ffb700 1 -- 172.21.15.107:0/1406509876 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227400c9c0 con 0x7f2284101080 2023-08-10T11:04:56.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.324+0000 7f228b1ff700 1 -- 172.21.15.107:0/1406509876 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22841a5180 con 0x7f2284101080 2023-08-10T11:04:56.330 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.324+0000 7f2279ffb700 1 -- 172.21.15.107:0/1406509876 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2274010430 con 0x7f2284101080 2023-08-10T11:04:56.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.324+0000 7f2279ffb700 1 -- 172.21.15.107:0/1406509876 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274018680 con 0x7f2284101080 2023-08-10T11:04:56.331 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.324+0000 7f228b1ff700 1 -- 172.21.15.107:0/1406509876 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22841a56b0 con 0x7f2284101080 2023-08-10T11:04:56.334 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.328+0000 7f2279ffb700 1 -- 172.21.15.107:0/1406509876 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f22740105a0 con 0x7f2284101080 2023-08-10T11:04:56.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.329+0000 7f229ead6b80 1 Processor -- start 2023-08-10T11:04:56.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.329+0000 7f229ead6b80 1 -- start start 2023-08-10T11:04:56.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.329+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fabf50 0x557bc3fac330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.335 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.329+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fac870 0x557bc3fa62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.329+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fa6800 0x557bc3fa6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.329+0000 7f229ead6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3f21dc0 con 0x557bc3fabf50 2023-08-10T11:04:56.336 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.329+0000 7f229ead6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3efe590 con 0x557bc3fac870 2023-08-10T11:04:56.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.329+0000 7f229ead6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3efbeb0 con 0x557bc3fa6800 2023-08-10T11:04:56.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.329+0000 7f2279ffb700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f226c0a1340 0x7f226c0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f2279ffb700 1 -- 172.21.15.107:0/1406509876 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f2274014070 con 0x7f2284101080 2023-08-10T11:04:56.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f228979c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fabf50 0x557bc3fac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.337 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f228979c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fabf50 0x557bc3fac330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44344/0 (socket says 172.21.15.107:44344) 2023-08-10T11:04:56.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f228979c700 1 -- 172.21.15.107:0/2818008067 learned_addr learned my addr 172.21.15.107:0/2818008067 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:56.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f2288f9b700 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fac870 0x557bc3fa62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.338 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f228979c700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f226c0a1340 0x7f226c0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f227bfff700 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fa6800 0x557bc3fa6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f2288f9b700 1 -- 172.21.15.107:0/2818008067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fa6800 msgr2=0x557bc3fa6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:56.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f2288f9b700 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fa6800 0x557bc3fa6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.339 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f2288f9b700 1 -- 172.21.15.107:0/2818008067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fabf50 msgr2=0x557bc3fac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:56.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.330+0000 7f2288f9b700 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fabf50 0x557bc3fac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.331+0000 7f2288f9b700 1 -- 172.21.15.107:0/2818008067 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bc3d78630 con 0x557bc3fac870 2023-08-10T11:04:56.340 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.331+0000 7f227bfff700 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fa6800 0x557bc3fa6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:04:56.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.331+0000 7f228979c700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f226c0a1340 0x7f226c0a3800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f227c009fd0 tx=0x7f227c0090c0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:56.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.331+0000 7f2288f9b700 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fac870 0x557bc3fa62c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2280000c00 tx=0x7f2280005ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42642ccc7414e4d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:56.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.331+0000 7f226affd700 1 -- 172.21.15.107:0/2818008067 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280026070 con 0x557bc3fac870 2023-08-10T11:04:56.341 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.331+0000 7f226affd700 1 -- 172.21.15.107:0/2818008067 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f228001e040 con 0x557bc3fac870 2023-08-10T11:04:56.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.331+0000 7f226affd700 1 -- 172.21.15.107:0/2818008067 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228001d070 con 0x557bc3fac870 2023-08-10T11:04:56.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.332+0000 7f229ead6b80 1 -- 172.21.15.107:0/2818008067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fac870 msgr2=0x557bc3fa62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:56.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.332+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fac870 0x557bc3fa62c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2280000c00 tx=0x7f2280005ec0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.342 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.332+0000 7f229ead6b80 1 -- 172.21.15.107:0/2818008067 shutdown_connections 2023-08-10T11:04:56.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.332+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fa6800 0x557bc3fa6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.332+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fabf50 0x557bc3fac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.332+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2818008067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fac870 0x557bc3fa62c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.343 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.332+0000 7f229ead6b80 1 -- 172.21.15.107:0/2818008067 >> 172.21.15.107:0/2818008067 conn(0x557bc3f03cd0 msgr2=0x557bc3fa14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:56.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.332+0000 7f229ead6b80 1 -- 172.21.15.107:0/2818008067 shutdown_connections 2023-08-10T11:04:56.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.332+0000 7f229ead6b80 1 -- 172.21.15.107:0/2818008067 wait complete. 2023-08-10T11:04:56.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.333+0000 7f229ead6b80 1 -- start start 2023-08-10T11:04:56.344 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.333+0000 7f229ead6b80 1 Processor -- start 2023-08-10T11:04:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 0x557bc3fb2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fafb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 0x557bc3fb0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f229ead6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3ef77a0 con 0x557bc3fac870 2023-08-10T11:04:56.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f229ead6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3e96ac0 con 0x557bc3fa6800 2023-08-10T11:04:56.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f229ead6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3e967c0 con 0x557bc3fabf50 2023-08-10T11:04:56.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f229ead6b80 10 client.0 _ll_register_callbacks cb 0x557bc3e94680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:04:56.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f227bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fafb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f227bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fafb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:39624/0 (socket says 172.21.15.107:39624) 2023-08-10T11:04:56.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f227bfff700 1 -- 172.21.15.107:0/2843381370 learned_addr learned my addr 172.21.15.107:0/2843381370 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:56.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f2288f9b700 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 0x557bc3fb2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f228979c700 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 0x557bc3fb0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f227bfff700 1 -- 172.21.15.107:0/2843381370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 msgr2=0x557bc3fb2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:56.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f227bfff700 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 0x557bc3fb2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f227bfff700 1 -- 172.21.15.107:0/2843381370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 msgr2=0x557bc3fb0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:56.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.334+0000 7f227bfff700 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 0x557bc3fb0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f227bfff700 1 -- 172.21.15.107:0/2843381370 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22841a56b0 con 0x557bc3fabf50 2023-08-10T11:04:56.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f227bfff700 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fafb80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f22740ca590 tx=0x7f2274099880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8b5b706c131f59f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:56.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f2263fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:04:56.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f2263fff700 1 -- 172.21.15.107:0/2843381370 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274099eb0 con 0x557bc3fabf50 2023-08-10T11:04:56.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f229ead6b80 1 -- 172.21.15.107:0/2843381370 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557bc3f99470 con 0x557bc3fabf50 2023-08-10T11:04:56.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f2263fff700 1 -- 172.21.15.107:0/2843381370 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f227409dee0 con 0x557bc3fabf50 2023-08-10T11:04:56.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f2263fff700 1 -- 172.21.15.107:0/2843381370 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22740a2300 con 0x557bc3fabf50 2023-08-10T11:04:56.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f229ead6b80 10 client.26509 fetch_fsmap learned FSMap version 60 2023-08-10T11:04:56.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f229ead6b80 1 -- 172.21.15.107:0/2843381370 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x7f228410de90 con 0x557bc3fabf50 2023-08-10T11:04:56.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.335+0000 7f2263fff700 1 -- 172.21.15.107:0/2843381370 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557bc3f99470 con 0x557bc3fabf50 2023-08-10T11:04:56.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.336+0000 7f2263fff700 1 -- 172.21.15.107:0/2843381370 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 60) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f22740993a0 con 0x557bc3fabf50 2023-08-10T11:04:56.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.336+0000 7f229ead6b80 10 client.26509 fetch_fsmap finished waiting for FSMap version 60 2023-08-10T11:04:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.336+0000 7f229ead6b80 10 client.26509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:04:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.336+0000 7f229ead6b80 20 client.26509 populate_metadata read hostname 'smithi107' 2023-08-10T11:04:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.336+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557bc3fc0240 0x557bc3fc2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.336+0000 7f229ead6b80 4 client.26509 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:04:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.336+0000 7f229ead6b80 1 -- 172.21.15.107:0/2843381370 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557bc3f759d0 con 0x557bc3fc0240 2023-08-10T11:04:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.336+0000 7f2288f9b700 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557bc3fc0240 0x557bc3fc2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.337+0000 7f2263fff700 10 client.26509 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:04:56.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.337+0000 7f2288f9b700 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557bc3fc0240 0x557bc3fc2660 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78a67a5590bae137 server_cookie=48a1c628472b10a9 in_seq=0 out_seq=0 2023-08-10T11:04:56.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f2263fff700 1 -- 172.21.15.107:0/2843381370 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557bc3f759d0 con 0x557bc3fc0240 2023-08-10T11:04:56.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f2263fff700 10 client.26509 handle_command_reply: tid=0 2023-08-10T11:04:56.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 client.26509 shutdown 2023-08-10T11:04:56.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 -- 172.21.15.107:0/2843381370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 msgr2=0x557bc3fafb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:56.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fafb80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f22740ca590 tx=0x7f2274099880 comp rx=0 tx=0).stop 2023-08-10T11:04:56.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 -- 172.21.15.107:0/2843381370 shutdown_connections 2023-08-10T11:04:56.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557bc3fc0240 0x557bc3fc2660 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 0x557bc3fb2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 0x557bc3fb0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 --2- 172.21.15.107:0/2843381370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fafb80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f2263fff700 0 client.26509 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:04:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 -- 172.21.15.107:0/2843381370 >> 172.21.15.107:0/2843381370 conn(0x557bc3f03cd0 msgr2=0x557bc3fa09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 -- 172.21.15.107:0/2843381370 shutdown_connections 2023-08-10T11:04:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 1 -- 172.21.15.107:0/2843381370 wait complete. 2023-08-10T11:04:56.357 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.338+0000 7f229ead6b80 20 client.26509 trim_cache size 0 max 16384 2023-08-10T11:04:56.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.359+0000 7f229ead6b80 1 Processor -- start 2023-08-10T11:04:56.360 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.359+0000 7f229ead6b80 1 -- start start 2023-08-10T11:04:56.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.359+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fa6800 0x557bc3fb7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.361 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.359+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fabf50 0x557bc3fab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.359+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fac870 0x557bc3fa1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.359+0000 7f229ead6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3d7a920 con 0x557bc3fa6800 2023-08-10T11:04:56.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.359+0000 7f229ead6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3fa2960 con 0x557bc3fabf50 2023-08-10T11:04:56.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.359+0000 7f229ead6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3fa2d70 con 0x557bc3fac870 2023-08-10T11:04:56.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f2288f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fa6800 0x557bc3fb7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.362 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f2288f9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fa6800 0x557bc3fb7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44360/0 (socket says 172.21.15.107:44360) 2023-08-10T11:04:56.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f2288f9b700 1 -- 172.21.15.107:0/4108066920 learned_addr learned my addr 172.21.15.107:0/4108066920 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:56.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f228979c700 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fac870 0x557bc3fa1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f227bfff700 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fabf50 0x557bc3fab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f2288f9b700 1 -- 172.21.15.107:0/4108066920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fac870 msgr2=0x557bc3fa1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:56.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f2288f9b700 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fac870 0x557bc3fa1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f2288f9b700 1 -- 172.21.15.107:0/4108066920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fabf50 msgr2=0x557bc3fab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:56.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f2288f9b700 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fabf50 0x557bc3fab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f2288f9b700 1 -- 172.21.15.107:0/4108066920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bc3d24de0 con 0x557bc3fa6800 2023-08-10T11:04:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f228979c700 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fac870 0x557bc3fa1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:04:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f227bfff700 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fabf50 0x557bc3fab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:04:56.364 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.360+0000 7f2288f9b700 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fa6800 0x557bc3fb7300 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2280000c00 tx=0x7f22800057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb96586408c9424 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:56.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.361+0000 7f226b7fe700 1 -- 172.21.15.107:0/4108066920 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280026040 con 0x557bc3fa6800 2023-08-10T11:04:56.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.361+0000 7f226b7fe700 1 -- 172.21.15.107:0/4108066920 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2280027040 con 0x557bc3fa6800 2023-08-10T11:04:56.366 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.361+0000 7f226b7fe700 1 -- 172.21.15.107:0/4108066920 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228001d040 con 0x557bc3fa6800 2023-08-10T11:04:56.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.361+0000 7f229ead6b80 1 -- 172.21.15.107:0/4108066920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fa6800 msgr2=0x557bc3fb7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:56.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.361+0000 7f229ead6b80 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fa6800 0x557bc3fb7300 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2280000c00 tx=0x7f22800057d0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.361+0000 7f229ead6b80 1 -- 172.21.15.107:0/4108066920 shutdown_connections 2023-08-10T11:04:56.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.361+0000 7f229ead6b80 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fac870 0x557bc3fa1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.362+0000 7f229ead6b80 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fa6800 0x557bc3fb7300 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.362+0000 7f229ead6b80 1 --2- 172.21.15.107:0/4108066920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fabf50 0x557bc3fab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.367 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.362+0000 7f229ead6b80 1 -- 172.21.15.107:0/4108066920 >> 172.21.15.107:0/4108066920 conn(0x557bc3f03cd0 msgr2=0x557bc3faaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.362+0000 7f229ead6b80 1 -- 172.21.15.107:0/4108066920 shutdown_connections 2023-08-10T11:04:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.362+0000 7f229ead6b80 1 -- 172.21.15.107:0/4108066920 wait complete. 2023-08-10T11:04:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.362+0000 7f229ead6b80 1 -- start start 2023-08-10T11:04:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.362+0000 7f229ead6b80 1 Processor -- start 2023-08-10T11:04:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 0x557bc3fa9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fa7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f229ead6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 0x557bc3fa7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.368 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f229ead6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3fa9750 con 0x557bc3fac870 2023-08-10T11:04:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f229ead6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3fa83f0 con 0x557bc3fa6800 2023-08-10T11:04:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f229ead6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bc3fa85b0 con 0x557bc3fabf50 2023-08-10T11:04:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f229ead6b80 10 client.0 _ll_register_callbacks cb 0x557bc3e94680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:04:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f228979c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 0x557bc3fa7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f227bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fa7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f228979c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 0x557bc3fa7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44372/0 (socket says 172.21.15.107:44372) 2023-08-10T11:04:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f228979c700 1 -- 172.21.15.107:0/1423645299 learned_addr learned my addr 172.21.15.107:0/1423645299 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:04:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.363+0000 7f2288f9b700 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 0x557bc3fa9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2288f9b700 1 -- 172.21.15.107:0/1423645299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 msgr2=0x557bc3fa7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2288f9b700 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fa7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2288f9b700 1 -- 172.21.15.107:0/1423645299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 msgr2=0x557bc3fa7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:04:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2288f9b700 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 0x557bc3fa7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2288f9b700 1 -- 172.21.15.107:0/1423645299 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228410de90 con 0x557bc3fa6800 2023-08-10T11:04:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f227bfff700 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fa7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:04:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2288f9b700 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 0x557bc3fa9060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2280005f50 tx=0x7f228000b320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e307256c49dfb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:04:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2263fff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T11:04:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2263fff700 1 -- 172.21.15.107:0/1423645299 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228001d070 con 0x557bc3fa6800 2023-08-10T11:04:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f229ead6b80 1 -- 172.21.15.107:0/1423645299 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f228001e040 con 0x557bc3fa6800 2023-08-10T11:04:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2263fff700 1 -- 172.21.15.107:0/1423645299 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f228000b920 con 0x557bc3fa6800 2023-08-10T11:04:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f2263fff700 1 -- 172.21.15.107:0/1423645299 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2280026040 con 0x557bc3fa6800 2023-08-10T11:04:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f229ead6b80 10 client.26471 fetch_fsmap learned FSMap version 60 2023-08-10T11:04:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.364+0000 7f229ead6b80 1 -- 172.21.15.107:0/1423645299 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x7f227c020040 con 0x557bc3fa6800 2023-08-10T11:04:56.371 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.365+0000 7f2263fff700 1 -- 172.21.15.107:0/1423645299 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f228001e040 con 0x557bc3fa6800 2023-08-10T11:04:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.365+0000 7f2263fff700 1 -- 172.21.15.107:0/1423645299 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 60) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f2280033470 con 0x557bc3fa6800 2023-08-10T11:04:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.365+0000 7f229ead6b80 10 client.26471 fetch_fsmap finished waiting for FSMap version 60 2023-08-10T11:04:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.365+0000 7f229ead6b80 10 client.26471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:04:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.365+0000 7f229ead6b80 20 client.26471 populate_metadata read hostname 'smithi107' 2023-08-10T11:04:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.365+0000 7f229ead6b80 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557bc4014d50 0x557bc4017140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:04:56.372 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.365+0000 7f229ead6b80 4 client.26471 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:04:56.373 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.365+0000 7f229ead6b80 1 -- 172.21.15.107:0/1423645299 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557bc3ef0780 con 0x557bc4014d50 2023-08-10T11:04:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.365+0000 7f227bfff700 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557bc4014d50 0x557bc4017140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:04:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f2263fff700 10 client.26471 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:04:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f227bfff700 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557bc4014d50 0x557bc4017140 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=347a2c7cb0158c43 server_cookie=612cbf947cfa0a59 in_seq=0 out_seq=0 2023-08-10T11:04:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f2263fff700 1 -- 172.21.15.107:0/1423645299 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557bc3ef0780 con 0x557bc4014d50 2023-08-10T11:04:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f2263fff700 10 client.26471 handle_command_reply: tid=0 2023-08-10T11:04:56.374 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f229ead6b80 1 client.26471 shutdown 2023-08-10T11:04:56.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f229ead6b80 1 -- 172.21.15.107:0/1423645299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 msgr2=0x557bc3fa9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:56.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f229ead6b80 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 0x557bc3fa9060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2280005f50 tx=0x7f228000b320 comp rx=0 tx=0).stop 2023-08-10T11:04:56.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f229ead6b80 1 -- 172.21.15.107:0/1423645299 shutdown_connections 2023-08-10T11:04:56.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f229ead6b80 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557bc4014d50 0x557bc4017140 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f229ead6b80 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557bc3fa6800 0x557bc3fa9060 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f229ead6b80 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557bc3fac870 0x557bc3fa7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f229ead6b80 1 --2- 172.21.15.107:0/1423645299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bc3fabf50 0x557bc3fa7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.375 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f2263fff700 0 client.26471 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:04:56.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.366+0000 7f229ead6b80 1 -- 172.21.15.107:0/1423645299 >> 172.21.15.107:0/1423645299 conn(0x557bc3f03cd0 msgr2=0x557bc3fb1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:56.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f229ead6b80 1 -- 172.21.15.107:0/1423645299 shutdown_connections 2023-08-10T11:04:56.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f229ead6b80 1 -- 172.21.15.107:0/1423645299 wait complete. 2023-08-10T11:04:56.376 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f229ead6b80 20 client.26471 trim_cache size 0 max 16384 2023-08-10T11:04:56.376 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:04:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:04:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:04:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:04:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:04:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:04:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:04:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:04:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:04:56.378 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:04:56.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 -- 172.21.15.107:0/1406509876 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f226c0a1340 msgr2=0x7f226c0a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:56.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f226c0a1340 0x7f226c0a3800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f227c009fd0 tx=0x7f227c0090c0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.378 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 -- 172.21.15.107:0/1406509876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2284101080 msgr2=0x7f2284072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:04:56.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2284101080 0x7f2284072fb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f227400e9f0 tx=0x7f227400ed00 comp rx=0 tx=0).stop 2023-08-10T11:04:56.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 -- 172.21.15.107:0/1406509876 shutdown_connections 2023-08-10T11:04:56.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f226c0a1340 0x7f226c0a3800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22841066d0 0x7f22841a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22841006c0 0x7f2284072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 --2- 172.21.15.107:0/1406509876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2284101080 0x7f2284072fb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:04:56.379 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.367+0000 7f228b1ff700 1 -- 172.21.15.107:0/1406509876 >> 172.21.15.107:0/1406509876 conn(0x7f22840fc1f0 msgr2=0x7f22840fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:04:56.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.368+0000 7f228b1ff700 1 -- 172.21.15.107:0/1406509876 shutdown_connections 2023-08-10T11:04:56.380 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:04:56.368+0000 7f228b1ff700 1 -- 172.21.15.107:0/1406509876 wait complete. 2023-08-10T11:04:56.388 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:04:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:57 smithi195 ceph-mon[129938]: pgmap v429: 129 pgs: 129 active+clean; 12 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:04:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:57 smithi157 ceph-mon[129604]: pgmap v429: 129 pgs: 129 active+clean; 12 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:04:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:57 smithi107 ceph-mon[127953]: pgmap v429: 129 pgs: 129 active+clean; 12 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:05:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:04:59 smithi195 ceph-mon[129938]: pgmap v430: 129 pgs: 129 active+clean; 12 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 MiB/s wr, 29 op/s 2023-08-10T11:05:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:04:59 smithi157 ceph-mon[129604]: pgmap v430: 129 pgs: 129 active+clean; 12 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 MiB/s wr, 29 op/s 2023-08-10T11:05:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:04:59 smithi107 ceph-mon[127953]: pgmap v430: 129 pgs: 129 active+clean; 12 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 MiB/s wr, 29 op/s 2023-08-10T11:05:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:01 smithi195 ceph-mon[129938]: pgmap v431: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 24 op/s 2023-08-10T11:05:02.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:01 smithi157 ceph-mon[129604]: pgmap v431: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 24 op/s 2023-08-10T11:05:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:01 smithi107 ceph-mon[127953]: pgmap v431: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 28 MiB/s wr, 24 op/s 2023-08-10T11:05:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:03 smithi195 ceph-mon[129938]: pgmap v432: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:03 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:05:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:03 smithi157 ceph-mon[129604]: pgmap v432: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:04.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:03 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:05:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:03 smithi107 ceph-mon[127953]: pgmap v432: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:03 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:05:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:05 smithi195 ceph-mon[129938]: pgmap v433: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 44 op/s 2023-08-10T11:05:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:05 smithi157 ceph-mon[129604]: pgmap v433: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 44 op/s 2023-08-10T11:05:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:05 smithi107 ceph-mon[127953]: pgmap v433: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 44 op/s 2023-08-10T11:05:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:07 smithi195 ceph-mon[129938]: pgmap v434: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 33 op/s 2023-08-10T11:05:08.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:07 smithi157 ceph-mon[129604]: pgmap v434: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 33 op/s 2023-08-10T11:05:08.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:07 smithi107 ceph-mon[127953]: pgmap v434: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 33 op/s 2023-08-10T11:05:10.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:09 smithi195 ceph-mon[129938]: pgmap v435: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 42 op/s 2023-08-10T11:05:10.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:09 smithi157 ceph-mon[129604]: pgmap v435: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 42 op/s 2023-08-10T11:05:10.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:09 smithi107 ceph-mon[127953]: pgmap v435: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 42 op/s 2023-08-10T11:05:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:11 smithi195 ceph-mon[129938]: pgmap v436: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 37 op/s 2023-08-10T11:05:12.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:11 smithi157 ceph-mon[129604]: pgmap v436: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 37 op/s 2023-08-10T11:05:12.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:11 smithi107 ceph-mon[127953]: pgmap v436: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 37 op/s 2023-08-10T11:05:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:13 smithi195 ceph-mon[129938]: pgmap v437: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-08-10T11:05:14.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:13 smithi157 ceph-mon[129604]: pgmap v437: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-08-10T11:05:14.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:13 smithi107 ceph-mon[127953]: pgmap v437: 129 pgs: 129 active+clean; 12 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-08-10T11:05:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:15 smithi195 ceph-mon[129938]: pgmap v438: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 MiB/s wr, 44 op/s 2023-08-10T11:05:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:15 smithi157 ceph-mon[129604]: pgmap v438: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 MiB/s wr, 44 op/s 2023-08-10T11:05:16.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:15 smithi107 ceph-mon[127953]: pgmap v438: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 MiB/s wr, 44 op/s 2023-08-10T11:05:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:17 smithi195 ceph-mon[129938]: pgmap v439: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:17 smithi157 ceph-mon[129604]: pgmap v439: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:17 smithi107 ceph-mon[127953]: pgmap v439: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:19 smithi195 ceph-mon[129938]: pgmap v440: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 40 MiB/s wr, 30 op/s 2023-08-10T11:05:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:19 smithi157 ceph-mon[129604]: pgmap v440: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 40 MiB/s wr, 30 op/s 2023-08-10T11:05:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:19 smithi107 ceph-mon[127953]: pgmap v440: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 40 MiB/s wr, 30 op/s 2023-08-10T11:05:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:21 smithi195 ceph-mon[129938]: pgmap v441: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 MiB/s wr, 23 op/s 2023-08-10T11:05:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:21 smithi157 ceph-mon[129604]: pgmap v441: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 MiB/s wr, 23 op/s 2023-08-10T11:05:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:21 smithi107 ceph-mon[127953]: pgmap v441: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 MiB/s wr, 23 op/s 2023-08-10T11:05:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:23 smithi195 ceph-mon[129938]: pgmap v442: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:23 smithi157 ceph-mon[129604]: pgmap v442: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:23 smithi107 ceph-mon[127953]: pgmap v442: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:25 smithi195 ceph-mon[129938]: pgmap v443: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 MiB/s wr, 31 op/s 2023-08-10T11:05:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:25 smithi157 ceph-mon[129604]: pgmap v443: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 MiB/s wr, 31 op/s 2023-08-10T11:05:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:25 smithi107 ceph-mon[127953]: pgmap v443: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 MiB/s wr, 31 op/s 2023-08-10T11:05:26.389 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:05:26.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.648+0000 7faaa359e700 1 -- 172.21.15.107:0/2536113095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4106660 msgr2=0x7faaa4106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:26.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.648+0000 7faaa359e700 1 --2- 172.21.15.107:0/2536113095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4106660 0x7faaa4106a40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7faa940099c0 tx=0x7faa94009cd0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.650 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.648+0000 7faaa359e700 1 -- 172.21.15.107:0/2536113095 shutdown_connections 2023-08-10T11:05:26.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.648+0000 7faaa359e700 1 --2- 172.21.15.107:0/2536113095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4068290 0x7faaa410d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.648+0000 7faaa359e700 1 --2- 172.21.15.107:0/2536113095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4106660 0x7faaa4106a40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.648+0000 7faaa359e700 1 --2- 172.21.15.107:0/2536113095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40678d0 0x7faaa4067d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.648+0000 7faaa359e700 1 -- 172.21.15.107:0/2536113095 >> 172.21.15.107:0/2536113095 conn(0x7faaa4074f30 msgr2=0x7faaa4075340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:26.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.649+0000 7faaa359e700 1 -- 172.21.15.107:0/2536113095 shutdown_connections 2023-08-10T11:05:26.651 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.649+0000 7faaa359e700 1 -- 172.21.15.107:0/2536113095 wait complete. 2023-08-10T11:05:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.650+0000 7faaa359e700 1 Processor -- start 2023-08-10T11:05:26.652 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faaa359e700 1 -- start start 2023-08-10T11:05:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faaa359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40678d0 0x7faaa40ff780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faaa359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4068290 0x7faaa40ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faaa359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4106660 0x7faaa41a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faaa359e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa41004f0 con 0x7faaa4068290 2023-08-10T11:05:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faaa359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa41a4b60 con 0x7faaa40678d0 2023-08-10T11:05:26.653 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faaa359e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa41a4ca0 con 0x7faaa4106660 2023-08-10T11:05:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faa9bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4068290 0x7faaa40ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faa9bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4068290 0x7faaa40ffcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41068/0 (socket says 172.21.15.107:41068) 2023-08-10T11:05:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.651+0000 7faa9bfff700 1 -- 172.21.15.107:0/1630599945 learned_addr learned my addr 172.21.15.107:0/1630599945 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.652+0000 7faaa2d9d700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4106660 0x7faaa41a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.654 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.652+0000 7faaa259c700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40678d0 0x7faaa40ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.652+0000 7faa9bfff700 1 -- 172.21.15.107:0/1630599945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4106660 msgr2=0x7faaa41a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:26.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.652+0000 7faa9bfff700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4106660 0x7faaa41a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.655 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.652+0000 7faa9bfff700 1 -- 172.21.15.107:0/1630599945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40678d0 msgr2=0x7faaa40ff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:26.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.652+0000 7faa9bfff700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40678d0 0x7faaa40ff780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.652+0000 7faa9bfff700 1 -- 172.21.15.107:0/1630599945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940095f0 con 0x7faaa4068290 2023-08-10T11:05:26.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.653+0000 7faa9bfff700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4068290 0x7faaa40ffcc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00e9a0 tx=0x7faa8c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:26.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.653+0000 7faa9b7fe700 1 -- 172.21.15.107:0/1630599945 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c009790 con 0x7faaa4068290 2023-08-10T11:05:26.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.653+0000 7faa9b7fe700 1 -- 172.21.15.107:0/1630599945 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa8c010430 con 0x7faaa4068290 2023-08-10T11:05:26.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.653+0000 7faaa359e700 1 -- 172.21.15.107:0/1630599945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa41a4f00 con 0x7faaa4068290 2023-08-10T11:05:26.656 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.653+0000 7faa9b7fe700 1 -- 172.21.15.107:0/1630599945 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00cea0 con 0x7faaa4068290 2023-08-10T11:05:26.657 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.653+0000 7faaa359e700 1 -- 172.21.15.107:0/1630599945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa41a5380 con 0x7faaa4068290 2023-08-10T11:05:26.659 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.658+0000 7faa9b7fe700 1 -- 172.21.15.107:0/1630599945 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7faa8c0105a0 con 0x7faaa4068290 2023-08-10T11:05:26.660 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.659+0000 7faabc3c8b80 1 Processor -- start 2023-08-10T11:05:26.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.659+0000 7faabc3c8b80 1 -- start start 2023-08-10T11:05:26.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 0x56013432c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 0x560134330d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.661 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560134331290 0x5601343316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601342a7dc0 con 0x56013432c4b0 2023-08-10T11:05:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560134284590 con 0x560134331290 2023-08-10T11:05:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560134281eb0 con 0x56013432cdd0 2023-08-10T11:05:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faaa259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 0x560134330d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faa9bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560134331290 0x5601343316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faaa259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 0x560134330d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:36064/0 (socket says 172.21.15.107:36064) 2023-08-10T11:05:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faaa259c700 1 -- 172.21.15.107:0/3770570404 learned_addr learned my addr 172.21.15.107:0/3770570404 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.660+0000 7faaa2d9d700 1 --2- 172.21.15.107:0/3770570404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 0x56013432c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.661+0000 7faaa259c700 1 -- 172.21.15.107:0/3770570404 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560134331290 msgr2=0x5601343316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:26.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.661+0000 7faaa259c700 1 --2- 172.21.15.107:0/3770570404 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560134331290 0x5601343316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.661+0000 7faaa259c700 1 -- 172.21.15.107:0/3770570404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 msgr2=0x56013432c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:26.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.661+0000 7faaa259c700 1 --2- 172.21.15.107:0/3770570404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 0x56013432c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.661+0000 7faaa259c700 1 -- 172.21.15.107:0/3770570404 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601340fe630 con 0x56013432cdd0 2023-08-10T11:05:26.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.661+0000 7faa9b7fe700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7faa900a14c0 0x7faa900a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.661+0000 7faa9b7fe700 1 -- 172.21.15.107:0/1630599945 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7faa8c014070 con 0x7faaa4068290 2023-08-10T11:05:26.664 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.661+0000 7faaa259c700 1 --2- 172.21.15.107:0/3770570404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 0x560134330d50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa9400b580 tx=0x7faa94005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73dcb57f6eae7472 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:26.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.661+0000 7faaa2d9d700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7faa900a14c0 0x7faa900a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.662+0000 7faa98ff9700 1 -- 172.21.15.107:0/3770570404 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9400ba10 con 0x56013432cdd0 2023-08-10T11:05:26.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.662+0000 7faa98ff9700 1 -- 172.21.15.107:0/3770570404 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa9401e040 con 0x56013432cdd0 2023-08-10T11:05:26.665 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.662+0000 7faa98ff9700 1 -- 172.21.15.107:0/3770570404 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940039c0 con 0x56013432cdd0 2023-08-10T11:05:26.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.662+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3770570404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 msgr2=0x560134330d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:26.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.662+0000 7faaa2d9d700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7faa900a14c0 0x7faa900a3980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faaa4101890 tx=0x7faa9c00b040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:26.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.662+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3770570404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 0x560134330d50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa9400b580 tx=0x7faa94005bc0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.663+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3770570404 shutdown_connections 2023-08-10T11:05:26.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.663+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3770570404 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560134331290 0x5601343316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.663+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3770570404 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 0x56013432c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.667 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.663+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3770570404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 0x560134330d50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.663+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3770570404 >> 172.21.15.107:0/3770570404 conn(0x560134289cd0 msgr2=0x560134327750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.663+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3770570404 shutdown_connections 2023-08-10T11:05:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.663+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3770570404 wait complete. 2023-08-10T11:05:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.663+0000 7faabc3c8b80 1 -- start start 2023-08-10T11:05:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.664+0000 7faabc3c8b80 1 Processor -- start 2023-08-10T11:05:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.664+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 0x560134338b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.668 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.664+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432cdd0 0x560134335d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.664+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 0x560134336460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.664+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013427d7a0 con 0x56013432c4b0 2023-08-10T11:05:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.664+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013421cac0 con 0x56013432cdd0 2023-08-10T11:05:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.664+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013421c7c0 con 0x560134331290 2023-08-10T11:05:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.664+0000 7faabc3c8b80 10 client.0 _ll_register_callbacks cb 0x56013421a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:05:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faaa2d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 0x560134336460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.669 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faa9bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432cdd0 0x560134335d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faaa2d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 0x560134336460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:36068/0 (socket says 172.21.15.107:36068) 2023-08-10T11:05:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faaa2d9d700 1 -- 172.21.15.107:0/3568727108 learned_addr learned my addr 172.21.15.107:0/3568727108 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faaa259c700 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 0x560134338b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faaa2d9d700 1 -- 172.21.15.107:0/3568727108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432cdd0 msgr2=0x560134335d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faaa2d9d700 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432cdd0 0x560134335d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faaa2d9d700 1 -- 172.21.15.107:0/3568727108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 msgr2=0x560134338b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faaa2d9d700 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 0x560134338b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.670 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.665+0000 7faaa2d9d700 1 -- 172.21.15.107:0/3568727108 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa410dce0 con 0x560134331290 2023-08-10T11:05:26.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.666+0000 7faaa2d9d700 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 0x560134336460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa9c004600 tx=0x7faa9c004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62fa010c0acf1f3d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:26.671 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.666+0000 7faa89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:05:26.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.666+0000 7faa89ffb700 1 -- 172.21.15.107:0/3568727108 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00e040 con 0x560134331290 2023-08-10T11:05:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.666+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3568727108 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56013431f470 con 0x560134331290 2023-08-10T11:05:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.666+0000 7faa89ffb700 1 -- 172.21.15.107:0/3568727108 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7faa9c004db0 con 0x560134331290 2023-08-10T11:05:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.666+0000 7faa89ffb700 1 -- 172.21.15.107:0/3568727108 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa9c003e50 con 0x560134331290 2023-08-10T11:05:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.666+0000 7faabc3c8b80 10 client.26527 fetch_fsmap learned FSMap version 61 2023-08-10T11:05:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.666+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3568727108 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x5601340aade0 con 0x560134331290 2023-08-10T11:05:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.666+0000 7faa89ffb700 1 -- 172.21.15.107:0/3568727108 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56013431f470 con 0x560134331290 2023-08-10T11:05:26.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.667+0000 7faa89ffb700 1 -- 172.21.15.107:0/3568727108 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 61) v1 ==== 7478+0+0 (secure 0 0 0) 0x7faa9c023b80 con 0x560134331290 2023-08-10T11:05:26.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.667+0000 7faabc3c8b80 10 client.26527 fetch_fsmap finished waiting for FSMap version 61 2023-08-10T11:05:26.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.667+0000 7faabc3c8b80 10 client.26527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:05:26.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.667+0000 7faabc3c8b80 20 client.26527 populate_metadata read hostname 'smithi107' 2023-08-10T11:05:26.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.667+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56013434ec40 0x560134351060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.667+0000 7faabc3c8b80 4 client.26527 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:05:26.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.667+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3568727108 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601342fb9d0 con 0x56013434ec40 2023-08-10T11:05:26.674 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.667+0000 7faaa259c700 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56013434ec40 0x560134351060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.668+0000 7faaa259c700 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56013434ec40 0x560134351060 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f705b0715108f2a server_cookie=e05dbe30d3708a7 in_seq=0 out_seq=0 2023-08-10T11:05:26.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.668+0000 7faa89ffb700 10 client.26527 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:05:26.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faa89ffb700 1 -- 172.21.15.107:0/3568727108 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5601342fb9d0 con 0x56013434ec40 2023-08-10T11:05:26.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faa89ffb700 10 client.26527 handle_command_reply: tid=0 2023-08-10T11:05:26.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 client.26527 shutdown 2023-08-10T11:05:26.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3568727108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 msgr2=0x560134336460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:26.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 0x560134336460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa9c004600 tx=0x7faa9c004b40 comp rx=0 tx=0).stop 2023-08-10T11:05:26.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3568727108 shutdown_connections 2023-08-10T11:05:26.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x56013434ec40 0x560134351060 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 0x560134336460 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432c4b0 0x560134338b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faa89ffb700 0 client.26527 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:05:26.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/3568727108 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432cdd0 0x560134335d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3568727108 >> 172.21.15.107:0/3568727108 conn(0x560134289cd0 msgr2=0x560134332740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:26.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3568727108 shutdown_connections 2023-08-10T11:05:26.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 1 -- 172.21.15.107:0/3568727108 wait complete. 2023-08-10T11:05:26.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.669+0000 7faabc3c8b80 20 client.26527 trim_cache size 0 max 16384 2023-08-10T11:05:26.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.691+0000 7faabc3c8b80 1 Processor -- start 2023-08-10T11:05:26.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.691+0000 7faabc3c8b80 1 -- start start 2023-08-10T11:05:26.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x560134335cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432cdd0 0x560134338640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.693 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 0x560134327100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560134100920 con 0x56013432cdd0 2023-08-10T11:05:26.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013432feb0 con 0x56013432c4b0 2023-08-10T11:05:26.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013431f2d0 con 0x560134331290 2023-08-10T11:05:26.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faaa259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x560134335cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faaa259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x560134335cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57338/0 (socket says 172.21.15.107:57338) 2023-08-10T11:05:26.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faaa259c700 1 -- 172.21.15.107:0/2671615370 learned_addr learned my addr 172.21.15.107:0/2671615370 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:26.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.692+0000 7faa9bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432cdd0 0x560134338640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.693+0000 7faaa259c700 1 -- 172.21.15.107:0/2671615370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 msgr2=0x560134327100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:26.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.693+0000 7faaa259c700 1 --2- 172.21.15.107:0/2671615370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 0x560134327100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.693+0000 7faaa259c700 1 -- 172.21.15.107:0/2671615370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432cdd0 msgr2=0x560134338640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.693+0000 7faaa259c700 1 --2- 172.21.15.107:0/2671615370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432cdd0 0x560134338640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.693+0000 7faaa259c700 1 -- 172.21.15.107:0/2671615370 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560134093c60 con 0x56013432c4b0 2023-08-10T11:05:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.693+0000 7faa9bfff700 1 --2- 172.21.15.107:0/2671615370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432cdd0 0x560134338640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:05:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.693+0000 7faaa259c700 1 --2- 172.21.15.107:0/2671615370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x560134335cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa9400a010 tx=0x7faa9401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe6be6b34242617f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:26.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.694+0000 7faa997fa700 1 -- 172.21.15.107:0/2671615370 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9400bcf0 con 0x56013432c4b0 2023-08-10T11:05:26.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.694+0000 7faa997fa700 1 -- 172.21.15.107:0/2671615370 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa94030070 con 0x56013432c4b0 2023-08-10T11:05:26.697 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.694+0000 7faa997fa700 1 -- 172.21.15.107:0/2671615370 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940053a0 con 0x56013432c4b0 2023-08-10T11:05:26.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.695+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2671615370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 msgr2=0x560134335cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:26.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.695+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2671615370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x560134335cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa9400a010 tx=0x7faa9401a040 comp rx=0 tx=0).stop 2023-08-10T11:05:26.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.695+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2671615370 shutdown_connections 2023-08-10T11:05:26.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.695+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2671615370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x560134335cd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.695+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2671615370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560134331290 0x560134327100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.695+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2671615370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56013432cdd0 0x560134338640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.698 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.695+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2671615370 >> 172.21.15.107:0/2671615370 conn(0x560134289cd0 msgr2=0x5601343355c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.695+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2671615370 shutdown_connections 2023-08-10T11:05:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.695+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2671615370 wait complete. 2023-08-10T11:05:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.696+0000 7faabc3c8b80 1 -- start start 2023-08-10T11:05:26.699 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.696+0000 7faabc3c8b80 1 Processor -- start 2023-08-10T11:05:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x56013439bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 0x56013439c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.700 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faabc3c8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560134331290 0x56013433b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013433bad0 con 0x560134331290 2023-08-10T11:05:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013433bc40 con 0x56013432c4b0 2023-08-10T11:05:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faabc3c8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56013433be00 con 0x56013432cdd0 2023-08-10T11:05:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faabc3c8b80 10 client.0 _ll_register_callbacks cb 0x56013421a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:05:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faaa259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x56013439bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faaa259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x56013439bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:57342/0 (socket says 172.21.15.107:57342) 2023-08-10T11:05:26.701 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faaa259c700 1 -- 172.21.15.107:0/2227489965 learned_addr learned my addr 172.21.15.107:0/2227489965 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.697+0000 7faaa2d9d700 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560134331290 0x56013433b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.698+0000 7faaa259c700 1 -- 172.21.15.107:0/2227489965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 msgr2=0x56013439c1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T11:05:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.698+0000 7faaa259c700 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 0x56013439c1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.698+0000 7faaa259c700 1 -- 172.21.15.107:0/2227489965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560134331290 msgr2=0x56013433b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.698+0000 7faaa259c700 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560134331290 0x56013433b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.698+0000 7faaa259c700 1 -- 172.21.15.107:0/2227489965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa41a5380 con 0x56013432c4b0 2023-08-10T11:05:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.698+0000 7faaa259c700 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x56013439bc60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa94019040 tx=0x7faa94005cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d104e6c5f0b673 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:26.702 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.698+0000 7faa89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T11:05:26.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.698+0000 7faa89ffb700 1 -- 172.21.15.107:0/2227489965 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940303e0 con 0x56013432c4b0 2023-08-10T11:05:26.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.699+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2227489965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa9401e040 con 0x56013432c4b0 2023-08-10T11:05:26.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.699+0000 7faa89ffb700 1 -- 172.21.15.107:0/2227489965 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7faa94030a10 con 0x56013432c4b0 2023-08-10T11:05:26.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.699+0000 7faa89ffb700 1 -- 172.21.15.107:0/2227489965 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa94030bd0 con 0x56013432c4b0 2023-08-10T11:05:26.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.699+0000 7faabc3c8b80 10 client.26489 fetch_fsmap learned FSMap version 61 2023-08-10T11:05:26.703 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.699+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2227489965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x5601340fe630 con 0x56013432c4b0 2023-08-10T11:05:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.699+0000 7faa89ffb700 1 -- 172.21.15.107:0/2227489965 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa9401e040 con 0x56013432c4b0 2023-08-10T11:05:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.700+0000 7faa89ffb700 1 -- 172.21.15.107:0/2227489965 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 61) v1 ==== 7478+0+0 (secure 0 0 0) 0x7faa94003880 con 0x56013432c4b0 2023-08-10T11:05:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.700+0000 7faabc3c8b80 10 client.26489 fetch_fsmap finished waiting for FSMap version 61 2023-08-10T11:05:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.700+0000 7faabc3c8b80 10 client.26489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:05:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.700+0000 7faabc3c8b80 20 client.26489 populate_metadata read hostname 'smithi107' 2023-08-10T11:05:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.700+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601343a3530 0x5601343a5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:26.705 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.700+0000 7faabc3c8b80 4 client.26489 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:05:26.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.700+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2227489965 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560134276780 con 0x5601343a3530 2023-08-10T11:05:26.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.700+0000 7faa9bfff700 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601343a3530 0x5601343a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:26.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.701+0000 7faa9bfff700 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601343a3530 0x5601343a5920 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef09a18a06761738 server_cookie=5ced420f45646ce6 in_seq=0 out_seq=0 2023-08-10T11:05:26.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.701+0000 7faa89ffb700 10 client.26489 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:05:26.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.701+0000 7faa89ffb700 1 -- 172.21.15.107:0/2227489965 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560134276780 con 0x5601343a3530 2023-08-10T11:05:26.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.701+0000 7faa89ffb700 10 client.26489 handle_command_reply: tid=0 2023-08-10T11:05:26.706 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.701+0000 7faabc3c8b80 1 client.26489 shutdown 2023-08-10T11:05:26.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2227489965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 msgr2=0x56013439bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:26.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x56013439bc60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa94019040 tx=0x7faa94005cc0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2227489965 shutdown_connections 2023-08-10T11:05:26.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5601343a3530 0x5601343a5920 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56013432c4b0 0x56013439bc60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.707 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faa89ffb700 0 client.26489 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:05:26.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560134331290 0x56013433b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 --2- 172.21.15.107:0/2227489965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56013432cdd0 0x56013439c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2227489965 >> 172.21.15.107:0/2227489965 conn(0x560134289cd0 msgr2=0x560134330b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:26.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2227489965 shutdown_connections 2023-08-10T11:05:26.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 1 -- 172.21.15.107:0/2227489965 wait complete. 2023-08-10T11:05:26.708 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.702+0000 7faabc3c8b80 20 client.26489 trim_cache size 0 max 16384 2023-08-10T11:05:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:05:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:05:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:05:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:05:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:05:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:05:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:05:26.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:05:26.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:05:26.710 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:05:26.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 -- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7faa900a14c0 msgr2=0x7faa900a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:26.710 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7faa900a14c0 0x7faa900a3980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faaa4101890 tx=0x7faa9c00b040 comp rx=0 tx=0).stop 2023-08-10T11:05:26.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 -- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4068290 msgr2=0x7faaa40ffcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:26.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4068290 0x7faaa40ffcc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00e9a0 tx=0x7faa8c00ecb0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 -- 172.21.15.107:0/1630599945 shutdown_connections 2023-08-10T11:05:26.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7faa900a14c0 0x7faa900a3980 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faaa40678d0 0x7faaa40ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa4106660 0x7faaa41a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.711 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 --2- 172.21.15.107:0/1630599945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaa4068290 0x7faaa40ffcc0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:26.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 -- 172.21.15.107:0/1630599945 >> 172.21.15.107:0/1630599945 conn(0x7faaa4074f30 msgr2=0x7faaa40fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:26.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 -- 172.21.15.107:0/1630599945 shutdown_connections 2023-08-10T11:05:26.712 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:26.703+0000 7faaa359e700 1 -- 172.21.15.107:0/1630599945 wait complete. 2023-08-10T11:05:26.724 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:05:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:27 smithi195 ceph-mon[129938]: pgmap v444: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:05:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:27 smithi157 ceph-mon[129604]: pgmap v444: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:05:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:27 smithi107 ceph-mon[127953]: pgmap v444: 129 pgs: 129 active+clean; 12 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:05:29.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:28 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:05:29.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:28 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:05:29.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:28 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:05:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:29 smithi195 ceph-mon[129938]: pgmap v445: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 30 op/s 2023-08-10T11:05:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:29 smithi157 ceph-mon[129604]: pgmap v445: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 30 op/s 2023-08-10T11:05:30.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:29 smithi107 ceph-mon[127953]: pgmap v445: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 MiB/s wr, 30 op/s 2023-08-10T11:05:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:31 smithi157 ceph-mon[129604]: pgmap v446: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 23 op/s 2023-08-10T11:05:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:31 smithi107 ceph-mon[127953]: pgmap v446: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 23 op/s 2023-08-10T11:05:32.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:31 smithi195 ceph-mon[129938]: pgmap v446: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 23 op/s 2023-08-10T11:05:33.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:32 smithi157 ceph-mon[129604]: pgmap v447: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:05:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:32 smithi107 ceph-mon[127953]: pgmap v447: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:05:33.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:32 smithi195 ceph-mon[129938]: pgmap v447: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:05:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:35 smithi195 ceph-mon[129938]: pgmap v448: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 39 MiB/s wr, 32 op/s 2023-08-10T11:05:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:35 smithi157 ceph-mon[129604]: pgmap v448: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 39 MiB/s wr, 32 op/s 2023-08-10T11:05:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:35 smithi107 ceph-mon[127953]: pgmap v448: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 39 MiB/s wr, 32 op/s 2023-08-10T11:05:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:37 smithi195 ceph-mon[129938]: pgmap v449: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:05:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:37 smithi157 ceph-mon[129604]: pgmap v449: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:05:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:37 smithi107 ceph-mon[127953]: pgmap v449: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:05:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:39 smithi195 ceph-mon[129938]: pgmap v450: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-08-10T11:05:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:39 smithi157 ceph-mon[129604]: pgmap v450: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-08-10T11:05:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:39 smithi107 ceph-mon[127953]: pgmap v450: 129 pgs: 129 active+clean; 13 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 40 MiB/s wr, 31 op/s 2023-08-10T11:05:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:40 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:05:41.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:40 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:05:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:40 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:05:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:41 smithi195 ceph-mon[129938]: pgmap v451: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-08-10T11:05:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:41 smithi157 ceph-mon[129604]: pgmap v451: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-08-10T11:05:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:41 smithi107 ceph-mon[127953]: pgmap v451: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 22 op/s 2023-08-10T11:05:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:43 smithi195 ceph-mon[129938]: pgmap v452: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:43 smithi157 ceph-mon[129604]: pgmap v452: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:43 smithi107 ceph-mon[127953]: pgmap v452: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:05:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:44 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:05:45.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:44 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:05:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:44 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:05:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:45 smithi195 ceph-mon[129938]: pgmap v453: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 40 MiB/s wr, 35 op/s 2023-08-10T11:05:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:45 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:05:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:45 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:05:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:45 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:05:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:45 smithi157 ceph-mon[129604]: pgmap v453: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 40 MiB/s wr, 35 op/s 2023-08-10T11:05:46.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:45 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:05:46.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:45 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:05:46.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:45 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:05:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:45 smithi107 ceph-mon[127953]: pgmap v453: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 40 MiB/s wr, 35 op/s 2023-08-10T11:05:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:45 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:05:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:45 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:05:46.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:45 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:05:48.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:47 smithi195 ceph-mon[129938]: pgmap v454: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 27 MiB/s wr, 25 op/s 2023-08-10T11:05:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:47 smithi157 ceph-mon[129604]: pgmap v454: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 27 MiB/s wr, 25 op/s 2023-08-10T11:05:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:47 smithi107 ceph-mon[127953]: pgmap v454: 129 pgs: 129 active+clean; 13 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 27 MiB/s wr, 25 op/s 2023-08-10T11:05:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:49 smithi195 ceph-mon[129938]: pgmap v455: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 39 MiB/s wr, 35 op/s 2023-08-10T11:05:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:49 smithi157 ceph-mon[129604]: pgmap v455: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 39 MiB/s wr, 35 op/s 2023-08-10T11:05:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:49 smithi107 ceph-mon[127953]: pgmap v455: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 39 MiB/s wr, 35 op/s 2023-08-10T11:05:52.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:51 smithi195 ceph-mon[129938]: pgmap v456: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-08-10T11:05:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:51 smithi157 ceph-mon[129604]: pgmap v456: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-08-10T11:05:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:51 smithi107 ceph-mon[127953]: pgmap v456: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-08-10T11:05:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:53 smithi195 ceph-mon[129938]: pgmap v457: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-08-10T11:05:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:53 smithi157 ceph-mon[129604]: pgmap v457: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-08-10T11:05:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:53 smithi107 ceph-mon[127953]: pgmap v457: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 26 MiB/s wr, 26 op/s 2023-08-10T11:05:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:55 smithi195 ceph-mon[129938]: pgmap v458: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 39 MiB/s wr, 37 op/s 2023-08-10T11:05:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:55 smithi157 ceph-mon[129604]: pgmap v458: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 39 MiB/s wr, 37 op/s 2023-08-10T11:05:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:55 smithi107 ceph-mon[127953]: pgmap v458: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 39 MiB/s wr, 37 op/s 2023-08-10T11:05:56.724 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:05:56.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.950+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/83235517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf281006f0 msgr2=0x7fcf28100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:56.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.950+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/83235517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf281006f0 0x7fcf28100b70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009990 tx=0x7fcf1c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.950+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/83235517 shutdown_connections 2023-08-10T11:05:56.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.950+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/83235517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf281010b0 0x7fcf2810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.950+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/83235517 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf28106700 0x7fcf28106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.950+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/83235517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf281006f0 0x7fcf28100b70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.950+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/83235517 >> 172.21.15.107:0/83235517 conn(0x7fcf280fc1e0 msgr2=0x7fcf280fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:56.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.950+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/83235517 shutdown_connections 2023-08-10T11:05:56.953 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.950+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/83235517 wait complete. 2023-08-10T11:05:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.952+0000 7fcf2e7ff700 1 Processor -- start 2023-08-10T11:05:56.955 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.952+0000 7fcf2e7ff700 1 -- start start 2023-08-10T11:05:56.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.952+0000 7fcf2e7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf281006f0 0x7fcf2819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.952+0000 7fcf2e7ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf281010b0 0x7fcf2819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.952+0000 7fcf2e7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf28106700 0x7fcf28198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.952+0000 7fcf2e7ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28198d70 con 0x7fcf281010b0 2023-08-10T11:05:56.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.952+0000 7fcf2e7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28198ee0 con 0x7fcf281006f0 2023-08-10T11:05:56.956 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.952+0000 7fcf2e7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281990a0 con 0x7fcf28106700 2023-08-10T11:05:56.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf277fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf281010b0 0x7fcf2819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf277fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf281010b0 0x7fcf2819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58330/0 (socket says 172.21.15.107:58330) 2023-08-10T11:05:56.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf277fe700 1 -- 172.21.15.107:0/2403015475 learned_addr learned my addr 172.21.15.107:0/2403015475 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:56.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf2cd9c700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf28106700 0x7fcf28198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf27fff700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf281006f0 0x7fcf2819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf277fe700 1 -- 172.21.15.107:0/2403015475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf28106700 msgr2=0x7fcf28198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:56.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf277fe700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf28106700 0x7fcf28198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf277fe700 1 -- 172.21.15.107:0/2403015475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf281006f0 msgr2=0x7fcf2819e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:56.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf277fe700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf281006f0 0x7fcf2819e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf277fe700 1 -- 172.21.15.107:0/2403015475 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18009520 con 0x7fcf281010b0 2023-08-10T11:05:56.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.953+0000 7fcf277fe700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf281010b0 0x7fcf2819ebd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c005910 tx=0x7fcf1c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:56.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.954+0000 7fcf257fa700 1 -- 172.21.15.107:0/2403015475 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c01d070 con 0x7fcf281010b0 2023-08-10T11:05:56.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.954+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/2403015475 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c0095f0 con 0x7fcf281010b0 2023-08-10T11:05:56.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.954+0000 7fcf257fa700 1 -- 172.21.15.107:0/2403015475 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf1c021410 con 0x7fcf281010b0 2023-08-10T11:05:56.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.954+0000 7fcf257fa700 1 -- 172.21.15.107:0/2403015475 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c017650 con 0x7fcf281010b0 2023-08-10T11:05:56.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.954+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/2403015475 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf28199570 con 0x7fcf281010b0 2023-08-10T11:05:56.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.958+0000 7fcf257fa700 1 -- 172.21.15.107:0/2403015475 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fcf1c00fb00 con 0x7fcf281010b0 2023-08-10T11:05:56.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.959+0000 7fcf421cfb80 1 Processor -- start 2023-08-10T11:05:56.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.959+0000 7fcf421cfb80 1 -- start start 2023-08-10T11:05:56.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.959+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x55867114e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.959+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 0x5586711482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.959+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671148c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.959+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586710c3dc0 con 0x55867114df50 2023-08-10T11:05:56.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.959+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586710a0590 con 0x55867114e870 2023-08-10T11:05:56.961 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.959+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55867109deb0 con 0x558671148800 2023-08-10T11:05:56.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf2cd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x55867114e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf2cd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x55867114e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58332/0 (socket says 172.21.15.107:58332) 2023-08-10T11:05:56.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf2cd9c700 1 -- 172.21.15.107:0/221103476 learned_addr learned my addr 172.21.15.107:0/221103476 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:56.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf277fe700 1 --2- 172.21.15.107:0/221103476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf27fff700 1 --2- 172.21.15.107:0/221103476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 0x5586711482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf2cd9c700 1 -- 172.21.15.107:0/221103476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 msgr2=0x558671148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:56.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf2cd9c700 1 --2- 172.21.15.107:0/221103476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf2cd9c700 1 -- 172.21.15.107:0/221103476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 msgr2=0x5586711482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:56.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf2cd9c700 1 --2- 172.21.15.107:0/221103476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 0x5586711482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.960+0000 7fcf2cd9c700 1 -- 172.21.15.107:0/221103476 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558670f1a630 con 0x55867114df50 2023-08-10T11:05:56.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.961+0000 7fcf257fa700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcf100a12c0 0x7fcf100a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.961+0000 7fcf2cd9c700 1 --2- 172.21.15.107:0/221103476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x55867114e330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fcf20003fc0 tx=0x7fcf20009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9583460f6879a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:56.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.961+0000 7fcf257fa700 1 -- 172.21.15.107:0/2403015475 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fcf1c0ce2f0 con 0x7fcf281010b0 2023-08-10T11:05:56.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.961+0000 7fcf27fff700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcf100a12c0 0x7fcf100a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.961+0000 7fcf0e7fc700 1 -- 172.21.15.107:0/221103476 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20019070 con 0x55867114df50 2023-08-10T11:05:56.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.961+0000 7fcf0e7fc700 1 -- 172.21.15.107:0/221103476 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf2000f040 con 0x55867114df50 2023-08-10T11:05:56.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.961+0000 7fcf0e7fc700 1 -- 172.21.15.107:0/221103476 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf200079e0 con 0x55867114df50 2023-08-10T11:05:56.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf421cfb80 1 -- 172.21.15.107:0/221103476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 msgr2=0x55867114e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:56.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf27fff700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcf100a12c0 0x7fcf100a3780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55867114ecf0 tx=0x7fcf18009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:56.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/221103476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x55867114e330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fcf20003fc0 tx=0x7fcf20009ba0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf421cfb80 1 -- 172.21.15.107:0/221103476 shutdown_connections 2023-08-10T11:05:56.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/221103476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/221103476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x55867114e330 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/221103476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 0x5586711482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf421cfb80 1 -- 172.21.15.107:0/221103476 >> 172.21.15.107:0/221103476 conn(0x5586710a5cd0 msgr2=0x5586711434d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:56.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf421cfb80 1 -- 172.21.15.107:0/221103476 shutdown_connections 2023-08-10T11:05:56.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.962+0000 7fcf421cfb80 1 -- 172.21.15.107:0/221103476 wait complete. 2023-08-10T11:05:56.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.963+0000 7fcf421cfb80 1 -- start start 2023-08-10T11:05:56.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.963+0000 7fcf421cfb80 1 Processor -- start 2023-08-10T11:05:56.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.963+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671154890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.963+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114df50 0x558671151b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114e870 0x558671152200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586710997a0 con 0x55867114e870 2023-08-10T11:05:56.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x558671038ac0 con 0x55867114df50 2023-08-10T11:05:56.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586710387c0 con 0x558671148800 2023-08-10T11:05:56.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf421cfb80 10 client.0 _ll_register_callbacks cb 0x558671036680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:05:56.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf27fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf27fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:40660/0 (socket says 172.21.15.107:40660) 2023-08-10T11:05:56.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf27fff700 1 -- 172.21.15.107:0/3099667572 learned_addr learned my addr 172.21.15.107:0/3099667572 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:56.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf2cd9c700 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114e870 0x558671152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf277fe700 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114df50 0x558671151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf27fff700 1 -- 172.21.15.107:0/3099667572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114df50 msgr2=0x558671151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:56.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf27fff700 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114df50 0x558671151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf27fff700 1 -- 172.21.15.107:0/3099667572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114e870 msgr2=0x558671152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:56.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf27fff700 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114e870 0x558671152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf27fff700 1 -- 172.21.15.107:0/3099667572 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf20003bf0 con 0x558671148800 2023-08-10T11:05:56.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.964+0000 7fcf2cd9c700 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114e870 0x558671152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:05:56.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.965+0000 7fcf27fff700 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671154890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcf1801d9c0 tx=0x7fcf180047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48ccfb4e6fdb2177 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:56.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.965+0000 7fcf077fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:05:56.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.965+0000 7fcf077fe700 1 -- 172.21.15.107:0/3099667572 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18022070 con 0x558671148800 2023-08-10T11:05:56.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.965+0000 7fcf421cfb80 1 -- 172.21.15.107:0/3099667572 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55867113b470 con 0x558671148800 2023-08-10T11:05:56.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.965+0000 7fcf077fe700 1 -- 172.21.15.107:0/3099667572 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fcf1801dd80 con 0x558671148800 2023-08-10T11:05:56.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.965+0000 7fcf077fe700 1 -- 172.21.15.107:0/3099667572 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf18017070 con 0x558671148800 2023-08-10T11:05:56.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.965+0000 7fcf421cfb80 10 client.26539 fetch_fsmap learned FSMap version 63 2023-08-10T11:05:56.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.965+0000 7fcf421cfb80 1 -- 172.21.15.107:0/3099667572 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x558670ec6de0 con 0x558671148800 2023-08-10T11:05:56.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.966+0000 7fcf077fe700 1 -- 172.21.15.107:0/3099667572 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55867113b470 con 0x558671148800 2023-08-10T11:05:56.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.966+0000 7fcf077fe700 1 -- 172.21.15.107:0/3099667572 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcf1801c560 con 0x558671148800 2023-08-10T11:05:56.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.966+0000 7fcf421cfb80 10 client.26539 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:05:56.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.966+0000 7fcf421cfb80 10 client.26539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:05:56.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.966+0000 7fcf421cfb80 20 client.26539 populate_metadata read hostname 'smithi107' 2023-08-10T11:05:56.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.966+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x558671162200 0x558671164620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.966+0000 7fcf421cfb80 4 client.26539 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:05:56.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.966+0000 7fcf421cfb80 1 -- 172.21.15.107:0/3099667572 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586711179d0 con 0x558671162200 2023-08-10T11:05:56.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.966+0000 7fcf277fe700 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x558671162200 0x558671164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.974 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.967+0000 7fcf077fe700 10 client.26539 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:05:56.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.967+0000 7fcf277fe700 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x558671162200 0x558671164620 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f474405a268c74e6 server_cookie=be3a8d0e731e0202 in_seq=0 out_seq=0 2023-08-10T11:05:56.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf077fe700 1 -- 172.21.15.107:0/3099667572 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5586711179d0 con 0x558671162200 2023-08-10T11:05:56.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf077fe700 10 client.26539 handle_command_reply: tid=0 2023-08-10T11:05:56.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 client.26539 shutdown 2023-08-10T11:05:56.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 -- 172.21.15.107:0/3099667572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 msgr2=0x558671154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:56.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671154890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcf1801d9c0 tx=0x7fcf180047c0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 -- 172.21.15.107:0/3099667572 shutdown_connections 2023-08-10T11:05:56.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x558671162200 0x558671164620 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114e870 0x558671152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x558671154890 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/3099667572 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114df50 0x558671151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf077fe700 0 client.26539 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:05:56.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 -- 172.21.15.107:0/3099667572 >> 172.21.15.107:0/3099667572 conn(0x5586710a5cd0 msgr2=0x5586711429b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:56.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 -- 172.21.15.107:0/3099667572 shutdown_connections 2023-08-10T11:05:56.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.968+0000 7fcf421cfb80 1 -- 172.21.15.107:0/3099667572 wait complete. 2023-08-10T11:05:56.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.969+0000 7fcf421cfb80 20 client.26539 trim_cache size 0 max 16384 2023-08-10T11:05:56.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf421cfb80 1 Processor -- start 2023-08-10T11:05:56.989 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf421cfb80 1 -- start start 2023-08-10T11:05:56.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x55867114d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671154430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 0x558671143130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.990 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558670f1c920 con 0x55867114df50 2023-08-10T11:05:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55867113ff80 con 0x55867114e870 2023-08-10T11:05:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558671152b10 con 0x558671148800 2023-08-10T11:05:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf277fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf277fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58342/0 (socket says 172.21.15.107:58342) 2023-08-10T11:05:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf277fe700 1 -- 172.21.15.107:0/2371845270 learned_addr learned my addr 172.21.15.107:0/2371845270 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.988+0000 7fcf27fff700 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x55867114d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.991 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf2cd9c700 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 0x558671143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf277fe700 1 -- 172.21.15.107:0/2371845270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 msgr2=0x55867114d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf277fe700 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x55867114d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf277fe700 1 -- 172.21.15.107:0/2371845270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 msgr2=0x558671143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf277fe700 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 0x558671143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf277fe700 1 -- 172.21.15.107:0/2371845270 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558670eafc60 con 0x55867114df50 2023-08-10T11:05:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf2cd9c700 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 0x558671143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:05:56.992 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf277fe700 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671154430 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c097600 tx=0x7fcf1c0d1d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36722f102b5280f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:56.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf0effd700 1 -- 172.21.15.107:0/2371845270 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0d1910 con 0x55867114df50 2023-08-10T11:05:56.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf0effd700 1 -- 172.21.15.107:0/2371845270 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf1c09aed0 con 0x55867114df50 2023-08-10T11:05:56.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.989+0000 7fcf0effd700 1 -- 172.21.15.107:0/2371845270 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c09f130 con 0x55867114df50 2023-08-10T11:05:56.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.990+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2371845270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 msgr2=0x558671154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:56.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.990+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671154430 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c097600 tx=0x7fcf1c0d1d80 comp rx=0 tx=0).stop 2023-08-10T11:05:56.995 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.990+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2371845270 shutdown_connections 2023-08-10T11:05:56.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.990+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55867114e870 0x558671143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.990+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558671148800 0x55867114d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.990+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2371845270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671154430 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.990+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2371845270 >> 172.21.15.107:0/2371845270 conn(0x5586710a5cd0 msgr2=0x55867114cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:56.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.990+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2371845270 shutdown_connections 2023-08-10T11:05:56.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.990+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2371845270 wait complete. 2023-08-10T11:05:56.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.991+0000 7fcf421cfb80 1 -- start start 2023-08-10T11:05:56.996 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.991+0000 7fcf421cfb80 1 Processor -- start 2023-08-10T11:05:56.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.991+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558671148800 0x558671158c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.991+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671159150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.991+0000 7fcf421cfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55867114e870 0x558671157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:56.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558671157930 con 0x55867114df50 2023-08-10T11:05:56.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x558671157aa0 con 0x558671148800 2023-08-10T11:05:56.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf421cfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558671157c60 con 0x55867114e870 2023-08-10T11:05:56.997 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf421cfb80 10 client.0 _ll_register_callbacks cb 0x558671036680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:05:56.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf277fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf2cd9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55867114e870 0x558671157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf277fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58348/0 (socket says 172.21.15.107:58348) 2023-08-10T11:05:56.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf277fe700 1 -- 172.21.15.107:0/2508904316 learned_addr learned my addr 172.21.15.107:0/2508904316 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:05:56.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf27fff700 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558671148800 0x558671158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:56.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf277fe700 1 -- 172.21.15.107:0/2508904316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55867114e870 msgr2=0x558671157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:56.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf277fe700 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55867114e870 0x558671157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.998 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf277fe700 1 -- 172.21.15.107:0/2508904316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558671148800 msgr2=0x558671158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:05:56.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf277fe700 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558671148800 0x558671158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:56.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf277fe700 1 -- 172.21.15.107:0/2508904316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c0095f0 con 0x55867114df50 2023-08-10T11:05:56.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.992+0000 7fcf27fff700 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558671148800 0x558671158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:05:56.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf277fe700 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671159150 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0cb7a0 tx=0x7fcf1c0ce1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75eaf6bb522f05e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:05:56.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf077fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:05:56.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf077fe700 1 -- 172.21.15.107:0/2508904316 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c09ac40 con 0x55867114df50 2023-08-10T11:05:56.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf077fe700 1 -- 172.21.15.107:0/2508904316 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fcf1c0cbe40 con 0x55867114df50 2023-08-10T11:05:56.999 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2508904316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf2000f040 con 0x55867114df50 2023-08-10T11:05:57.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf077fe700 1 -- 172.21.15.107:0/2508904316 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf1c09aa60 con 0x55867114df50 2023-08-10T11:05:57.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf421cfb80 10 client.16854 fetch_fsmap learned FSMap version 63 2023-08-10T11:05:57.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2508904316 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x558670eed250 con 0x55867114df50 2023-08-10T11:05:57.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf077fe700 1 -- 172.21.15.107:0/2508904316 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf2000f040 con 0x55867114df50 2023-08-10T11:05:57.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf077fe700 1 -- 172.21.15.107:0/2508904316 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcf1c09b360 con 0x55867114df50 2023-08-10T11:05:57.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf421cfb80 10 client.16854 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:05:57.000 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf421cfb80 10 client.16854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:05:57.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf421cfb80 20 client.16854 populate_metadata read hostname 'smithi107' 2023-08-10T11:05:57.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.993+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5586711b6b30 0x5586711b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:05:57.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.994+0000 7fcf421cfb80 4 client.16854 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:05:57.001 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.994+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2508904316 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558671092780 con 0x5586711b6b30 2023-08-10T11:05:57.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.994+0000 7fcf27fff700 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5586711b6b30 0x5586711b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:05:57.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.994+0000 7fcf077fe700 10 client.16854 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:05:57.002 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.994+0000 7fcf27fff700 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5586711b6b30 0x5586711b8f20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=affaa0e31ec96c51 server_cookie=2e6065133b96a35c in_seq=0 out_seq=0 2023-08-10T11:05:57.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf077fe700 1 -- 172.21.15.107:0/2508904316 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558671092780 con 0x5586711b6b30 2023-08-10T11:05:57.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf077fe700 10 client.16854 handle_command_reply: tid=0 2023-08-10T11:05:57.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 client.16854 shutdown 2023-08-10T11:05:57.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2508904316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 msgr2=0x558671159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:57.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671159150 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0cb7a0 tx=0x7fcf1c0ce1c0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2508904316 shutdown_connections 2023-08-10T11:05:57.003 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x5586711b6b30 0x5586711b8f20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558671148800 0x558671158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55867114e870 0x558671157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf077fe700 0 client.16854 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:05:57.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 --2- 172.21.15.107:0/2508904316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55867114df50 0x558671159150 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2508904316 >> 172.21.15.107:0/2508904316 conn(0x5586710a5cd0 msgr2=0x55867114f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:57.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2508904316 shutdown_connections 2023-08-10T11:05:57.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 1 -- 172.21.15.107:0/2508904316 wait complete. 2023-08-10T11:05:57.004 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.995+0000 7fcf421cfb80 20 client.16854 trim_cache size 0 max 16384 2023-08-10T11:05:57.005 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:05:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:05:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:05:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:05:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:05:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:05:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:05:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:05:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:05:57.006 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:05:57.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcf100a12c0 msgr2=0x7fcf100a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:57.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcf100a12c0 0x7fcf100a3780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55867114ecf0 tx=0x7fcf18009260 comp rx=0 tx=0).stop 2023-08-10T11:05:57.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf281010b0 msgr2=0x7fcf2819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:05:57.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf281010b0 0x7fcf2819ebd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c005910 tx=0x7fcf1c0047b0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/2403015475 shutdown_connections 2023-08-10T11:05:57.007 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fcf100a12c0 0x7fcf100a3780 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf281006f0 0x7fcf2819e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf28106700 0x7fcf28198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 --2- 172.21.15.107:0/2403015475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf281010b0 0x7fcf2819ebd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:05:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/2403015475 >> 172.21.15.107:0/2403015475 conn(0x7fcf280fc1e0 msgr2=0x7fcf2810bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:05:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/2403015475 shutdown_connections 2023-08-10T11:05:57.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:05:56.996+0000 7fcf2e7ff700 1 -- 172.21.15.107:0/2403015475 wait complete. 2023-08-10T11:05:57.019 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:05:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:57 smithi195 ceph-mon[129938]: pgmap v459: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:05:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:57 smithi157 ceph-mon[129604]: pgmap v459: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:05:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:57 smithi107 ceph-mon[127953]: pgmap v459: 129 pgs: 129 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:06:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:05:59 smithi195 ceph-mon[129938]: pgmap v460: 129 pgs: 129 active+clean; 14 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-08-10T11:06:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:05:59 smithi157 ceph-mon[129604]: pgmap v460: 129 pgs: 129 active+clean; 14 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-08-10T11:06:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:05:59 smithi107 ceph-mon[127953]: pgmap v460: 129 pgs: 129 active+clean; 14 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 MiB/s wr, 31 op/s 2023-08-10T11:06:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:01 smithi195 ceph-mon[129938]: pgmap v461: 129 pgs: 129 active+clean; 14 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:06:02.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:01 smithi157 ceph-mon[129604]: pgmap v461: 129 pgs: 129 active+clean; 14 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:06:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:01 smithi107 ceph-mon[127953]: pgmap v461: 129 pgs: 129 active+clean; 14 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:06:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:03 smithi195 ceph-mon[129938]: pgmap v462: 129 pgs: 129 active+clean; 14 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T11:06:04.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:03 smithi157 ceph-mon[129604]: pgmap v462: 129 pgs: 129 active+clean; 14 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T11:06:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:03 smithi107 ceph-mon[127953]: pgmap v462: 129 pgs: 129 active+clean; 14 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-08-10T11:06:06.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:05 smithi157 ceph-mon[129604]: pgmap v463: 129 pgs: 129 active+clean; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 39 MiB/s wr, 46 op/s 2023-08-10T11:06:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:05 smithi107 ceph-mon[127953]: pgmap v463: 129 pgs: 129 active+clean; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 39 MiB/s wr, 46 op/s 2023-08-10T11:06:06.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:05 smithi195 ceph-mon[129938]: pgmap v463: 129 pgs: 129 active+clean; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 39 MiB/s wr, 46 op/s 2023-08-10T11:06:08.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:07 smithi157 ceph-mon[129604]: pgmap v464: 129 pgs: 129 active+clean; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 35 op/s 2023-08-10T11:06:08.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:07 smithi107 ceph-mon[127953]: pgmap v464: 129 pgs: 129 active+clean; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 35 op/s 2023-08-10T11:06:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:07 smithi195 ceph-mon[129938]: pgmap v464: 129 pgs: 129 active+clean; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 25 MiB/s wr, 35 op/s 2023-08-10T11:06:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:08 smithi157 ceph-mon[129604]: osdmap e109: 12 total, 12 up, 12 in 2023-08-10T11:06:09.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:08 smithi157 ceph-mon[129604]: pgmap v466: 129 pgs: 12 active+clean+snaptrim, 92 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 42 op/s 2023-08-10T11:06:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:08 smithi107 ceph-mon[127953]: osdmap e109: 12 total, 12 up, 12 in 2023-08-10T11:06:09.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:08 smithi107 ceph-mon[127953]: pgmap v466: 129 pgs: 12 active+clean+snaptrim, 92 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 42 op/s 2023-08-10T11:06:09.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:08 smithi195 ceph-mon[129938]: osdmap e109: 12 total, 12 up, 12 in 2023-08-10T11:06:09.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:08 smithi195 ceph-mon[129938]: pgmap v466: 129 pgs: 12 active+clean+snaptrim, 92 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 42 op/s 2023-08-10T11:06:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:11 smithi157 ceph-mon[129604]: pgmap v467: 129 pgs: 12 active+clean+snaptrim, 92 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-08-10T11:06:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:11 smithi107 ceph-mon[127953]: pgmap v467: 129 pgs: 12 active+clean+snaptrim, 92 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-08-10T11:06:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:11 smithi195 ceph-mon[129938]: pgmap v467: 129 pgs: 12 active+clean+snaptrim, 92 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-08-10T11:06:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:13 smithi157 ceph-mon[129604]: pgmap v468: 129 pgs: 12 active+clean+snaptrim, 92 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-08-10T11:06:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:13 smithi107 ceph-mon[127953]: pgmap v468: 129 pgs: 12 active+clean+snaptrim, 92 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-08-10T11:06:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:13 smithi195 ceph-mon[129938]: pgmap v468: 129 pgs: 12 active+clean+snaptrim, 92 active+clean, 25 active+clean+snaptrim_wait; 14 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 30 MiB/s wr, 42 op/s 2023-08-10T11:06:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:15 smithi195 ceph-mon[129938]: pgmap v469: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 25 op/s 2023-08-10T11:06:16.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:15 smithi157 ceph-mon[129604]: pgmap v469: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 25 op/s 2023-08-10T11:06:16.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:15 smithi107 ceph-mon[127953]: pgmap v469: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 25 op/s 2023-08-10T11:06:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:17 smithi195 ceph-mon[129938]: pgmap v470: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 25 op/s 2023-08-10T11:06:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:17 smithi157 ceph-mon[129604]: pgmap v470: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 25 op/s 2023-08-10T11:06:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:17 smithi107 ceph-mon[127953]: pgmap v470: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 MiB/s wr, 25 op/s 2023-08-10T11:06:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:19 smithi195 ceph-mon[129938]: pgmap v471: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 31 op/s 2023-08-10T11:06:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:19 smithi195 ceph-mon[129938]: osdmap e110: 12 total, 12 up, 12 in 2023-08-10T11:06:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:19 smithi157 ceph-mon[129604]: pgmap v471: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 31 op/s 2023-08-10T11:06:20.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:19 smithi157 ceph-mon[129604]: osdmap e110: 12 total, 12 up, 12 in 2023-08-10T11:06:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:19 smithi107 ceph-mon[127953]: pgmap v471: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 31 op/s 2023-08-10T11:06:20.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:19 smithi107 ceph-mon[127953]: osdmap e110: 12 total, 12 up, 12 in 2023-08-10T11:06:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:21 smithi195 ceph-mon[129938]: pgmap v473: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 MiB/s wr, 25 op/s 2023-08-10T11:06:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:21 smithi157 ceph-mon[129604]: pgmap v473: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 MiB/s wr, 25 op/s 2023-08-10T11:06:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:21 smithi107 ceph-mon[127953]: pgmap v473: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 MiB/s wr, 25 op/s 2023-08-10T11:06:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:23 smithi195 ceph-mon[129938]: pgmap v474: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 MiB/s wr, 25 op/s 2023-08-10T11:06:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:23 smithi157 ceph-mon[129604]: pgmap v474: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 MiB/s wr, 25 op/s 2023-08-10T11:06:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:23 smithi107 ceph-mon[127953]: pgmap v474: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 MiB/s wr, 25 op/s 2023-08-10T11:06:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:25 smithi195 ceph-mon[129938]: pgmap v475: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 31 MiB/s wr, 24 op/s 2023-08-10T11:06:26.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:25 smithi157 ceph-mon[129604]: pgmap v475: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 31 MiB/s wr, 24 op/s 2023-08-10T11:06:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:25 smithi107 ceph-mon[127953]: pgmap v475: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 31 MiB/s wr, 24 op/s 2023-08-10T11:06:27.020 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:06:27.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.253+0000 7f2f025ff700 1 -- 172.21.15.107:0/167689060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc1006c0 msgr2=0x7f2efc100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:27.254 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.253+0000 7f2f025ff700 1 --2- 172.21.15.107:0/167689060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc1006c0 0x7f2efc100b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00098f0 tx=0x7f2ef0009c00 comp rx=0 tx=0).stop 2023-08-10T11:06:27.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.253+0000 7f2f025ff700 1 -- 172.21.15.107:0/167689060 shutdown_connections 2023-08-10T11:06:27.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.253+0000 7f2f025ff700 1 --2- 172.21.15.107:0/167689060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2efc101080 0x7f2efc10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.253+0000 7f2f025ff700 1 --2- 172.21.15.107:0/167689060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc1066d0 0x7f2efc106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.253+0000 7f2f025ff700 1 --2- 172.21.15.107:0/167689060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc1006c0 0x7f2efc100b40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.253+0000 7f2f025ff700 1 -- 172.21.15.107:0/167689060 >> 172.21.15.107:0/167689060 conn(0x7f2efc0fc1f0 msgr2=0x7f2efc0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:27.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.253+0000 7f2f025ff700 1 -- 172.21.15.107:0/167689060 shutdown_connections 2023-08-10T11:06:27.255 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.253+0000 7f2f025ff700 1 -- 172.21.15.107:0/167689060 wait complete. 2023-08-10T11:06:27.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.254+0000 7f2f025ff700 1 Processor -- start 2023-08-10T11:06:27.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.254+0000 7f2f025ff700 1 -- start start 2023-08-10T11:06:27.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.254+0000 7f2f025ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2efc1006c0 0x7f2efc19e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2f025ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc101080 0x7f2efc19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.257 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2f025ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc1066d0 0x7f2efc198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2f025ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc198db0 con 0x7f2efc1066d0 2023-08-10T11:06:27.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2f025ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc198f20 con 0x7f2efc1006c0 2023-08-10T11:06:27.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2f025ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1990e0 con 0x7f2efc101080 2023-08-10T11:06:27.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2efc1006c0 0x7f2efc19e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2efc1006c0 0x7f2efc19e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:51572/0 (socket says 172.21.15.107:51572) 2023-08-10T11:06:27.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efbfff700 1 -- 172.21.15.107:0/1500385879 learned_addr learned my addr 172.21.15.107:0/1500385879 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:27.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efb7fe700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc101080 0x7f2efc19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc1066d0 0x7f2efc198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efbfff700 1 -- 172.21.15.107:0/1500385879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc101080 msgr2=0x7f2efc19ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efbfff700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc101080 0x7f2efc19ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efbfff700 1 -- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc1066d0 msgr2=0x7f2efc198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efbfff700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc1066d0 0x7f2efc198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efbfff700 1 -- 172.21.15.107:0/1500385879 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0009520 con 0x7f2efc1006c0 2023-08-10T11:06:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2efb7fe700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc101080 0x7f2efc19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:06:27.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.255+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc1066d0 0x7f2efc198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:06:27.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.256+0000 7f2efbfff700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2efc1006c0 0x7f2efc19e6d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00e9c0 tx=0x7f2eec00ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:27.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.256+0000 7f2ef97fa700 1 -- 172.21.15.107:0/1500385879 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00cbd0 con 0x7f2efc1006c0 2023-08-10T11:06:27.260 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.256+0000 7f2ef97fa700 1 -- 172.21.15.107:0/1500385879 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2eec00cd30 con 0x7f2efc1006c0 2023-08-10T11:06:27.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.256+0000 7f2ef97fa700 1 -- 172.21.15.107:0/1500385879 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec005520 con 0x7f2efc1006c0 2023-08-10T11:06:27.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.256+0000 7f2f025ff700 1 -- 172.21.15.107:0/1500385879 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc1993c0 con 0x7f2efc1006c0 2023-08-10T11:06:27.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.256+0000 7f2f025ff700 1 -- 172.21.15.107:0/1500385879 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc1a56c0 con 0x7f2efc1006c0 2023-08-10T11:06:27.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.261+0000 7f2ef97fa700 1 -- 172.21.15.107:0/1500385879 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2eec004750 con 0x7f2efc1006c0 2023-08-10T11:06:27.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.262+0000 7f2f15f5fb80 1 Processor -- start 2023-08-10T11:06:27.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.262+0000 7f2f15f5fb80 1 -- start start 2023-08-10T11:06:27.264 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.262+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d8ef50 0x557146d8f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d892c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d89800 0x557146d89c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146d04dc0 con 0x557146d89800 2023-08-10T11:06:27.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146ce1590 con 0x557146d8f870 2023-08-10T11:06:27.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146cdeeb0 con 0x557146d8ef50 2023-08-10T11:06:27.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2ef97fa700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2ee40a12c0 0x7f2ee40a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.265 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2ef97fa700 1 -- 172.21.15.107:0/1500385879 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f2eec014070 con 0x7f2efc1006c0 2023-08-10T11:06:27.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d89800 0x557146d89c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d89800 0x557146d89c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37924/0 (socket says 172.21.15.107:37924) 2023-08-10T11:06:27.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2efb7fe700 1 -- 172.21.15.107:0/433369180 learned_addr learned my addr 172.21.15.107:0/433369180 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:27.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2efbfff700 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d892c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d8ef50 0x557146d8f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.266 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2ee40a12c0 0x7f2ee40a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.268 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2efbfff700 1 -- 172.21.15.107:0/433369180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d8ef50 msgr2=0x557146d8f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.263+0000 7f2efbfff700 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d8ef50 0x557146d8f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.264+0000 7f2efbfff700 1 -- 172.21.15.107:0/433369180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d89800 msgr2=0x557146d89c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.264+0000 7f2efbfff700 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d89800 0x557146d89c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.264+0000 7f2efbfff700 1 -- 172.21.15.107:0/433369180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557146b5b630 con 0x557146d8f870 2023-08-10T11:06:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.264+0000 7f2efb7fe700 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d89800 0x557146d89c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:06:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.264+0000 7f2efbfff700 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d892c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0ca6b0 tx=0x7f2eec099bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde8c0137f9556b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:27.269 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.264+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2ee40a12c0 0x7f2ee40a3780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557146d8a520 tx=0x7f2ef400b040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.264+0000 7f2ee27fc700 1 -- 172.21.15.107:0/433369180 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec09e060 con 0x557146d8f870 2023-08-10T11:06:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.264+0000 7f2ee27fc700 1 -- 172.21.15.107:0/433369180 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2eec0a2480 con 0x557146d8f870 2023-08-10T11:06:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.264+0000 7f2ee27fc700 1 -- 172.21.15.107:0/433369180 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec079630 con 0x557146d8f870 2023-08-10T11:06:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.265+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/433369180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 msgr2=0x557146d892c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.265+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d892c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0ca6b0 tx=0x7f2eec099bf0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.265+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/433369180 shutdown_connections 2023-08-10T11:06:27.270 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.265+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d89800 0x557146d89c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.265+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d8ef50 0x557146d8f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.265+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/433369180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d892c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.265+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/433369180 >> 172.21.15.107:0/433369180 conn(0x557146ce6cd0 msgr2=0x557146d844d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.265+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/433369180 shutdown_connections 2023-08-10T11:06:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.265+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/433369180 wait complete. 2023-08-10T11:06:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.266+0000 7f2f15f5fb80 1 -- start start 2023-08-10T11:06:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.266+0000 7f2f15f5fb80 1 Processor -- start 2023-08-10T11:06:27.271 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.266+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146d95990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.266+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146d92c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.266+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 0x557146d93320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.266+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146cda7a0 con 0x557146d8f870 2023-08-10T11:06:27.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.266+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146c79ac0 con 0x557146d8ef50 2023-08-10T11:06:27.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.266+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146c797c0 con 0x557146d89800 2023-08-10T11:06:27.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2f15f5fb80 10 client.0 _ll_register_callbacks cb 0x557146c77680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:06:27.272 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2efbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146d95990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2efbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146d95990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:34616/0 (socket says 172.21.15.107:34616) 2023-08-10T11:06:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2efbfff700 1 -- 172.21.15.107:0/2325401500 learned_addr learned my addr 172.21.15.107:0/2325401500 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 0x557146d93320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2efb7fe700 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146d92c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2efbfff700 1 -- 172.21.15.107:0/2325401500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 msgr2=0x557146d92c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2efbfff700 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146d92c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2efbfff700 1 -- 172.21.15.107:0/2325401500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 msgr2=0x557146d93320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:27.273 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2efbfff700 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 0x557146d93320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.274 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.267+0000 7f2efbfff700 1 -- 172.21.15.107:0/2325401500 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc10de90 con 0x557146d89800 2023-08-10T11:06:27.275 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2efbfff700 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146d95990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2eec096aa0 tx=0x7f2eec0cd220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=599e073dc564348 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2edb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:06:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2325401500 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0795e0 con 0x557146d89800 2023-08-10T11:06:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2325401500 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557146d7c470 con 0x557146d89800 2023-08-10T11:06:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2325401500 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f2eec079740 con 0x557146d89800 2023-08-10T11:06:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2325401500 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eec05fea0 con 0x557146d89800 2023-08-10T11:06:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2f15f5fb80 10 client.26557 fetch_fsmap learned FSMap version 63 2023-08-10T11:06:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2325401500 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x7f2efc1a56c0 con 0x557146d89800 2023-08-10T11:06:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2325401500 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557146d7c470 con 0x557146d89800 2023-08-10T11:06:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.268+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2325401500 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2eec099520 con 0x557146d89800 2023-08-10T11:06:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.269+0000 7f2f15f5fb80 10 client.26557 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:06:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.269+0000 7f2f15f5fb80 10 client.26557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:06:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.269+0000 7f2f15f5fb80 20 client.26557 populate_metadata read hostname 'smithi107' 2023-08-10T11:06:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.269+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557146da2f80 0x557146da5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.269+0000 7f2f15f5fb80 4 client.26557 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:06:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.269+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2325401500 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557146d589d0 con 0x557146da2f80 2023-08-10T11:06:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.269+0000 7f2efb7fe700 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557146da2f80 0x557146da5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.270+0000 7f2edb7fe700 10 client.26557 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:06:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.270+0000 7f2efb7fe700 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557146da2f80 0x557146da5370 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9fbefceee8daeec server_cookie=37f5f6328a15becc in_seq=0 out_seq=0 2023-08-10T11:06:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.270+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2325401500 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557146d589d0 con 0x557146da2f80 2023-08-10T11:06:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.270+0000 7f2edb7fe700 10 client.26557 handle_command_reply: tid=0 2023-08-10T11:06:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.270+0000 7f2f15f5fb80 1 client.26557 shutdown 2023-08-10T11:06:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2325401500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 msgr2=0x557146d95990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146d95990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2eec096aa0 tx=0x7f2eec0cd220 comp rx=0 tx=0).stop 2023-08-10T11:06:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2325401500 shutdown_connections 2023-08-10T11:06:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557146da2f80 0x557146da5370 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 0x557146d93320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146d95990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2edb7fe700 0 client.26557 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:06:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2325401500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146d92c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2325401500 >> 172.21.15.107:0/2325401500 conn(0x557146ce6cd0 msgr2=0x557146d839b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2325401500 shutdown_connections 2023-08-10T11:06:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2325401500 wait complete. 2023-08-10T11:06:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.271+0000 7f2f15f5fb80 20 client.26557 trim_cache size 0 max 16384 2023-08-10T11:06:27.294 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.293+0000 7f2f15f5fb80 1 Processor -- start 2023-08-10T11:06:27.295 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.293+0000 7f2f15f5fb80 1 -- start start 2023-08-10T11:06:27.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146d9a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8ef50 0x557146d8e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d95530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146b5d920 con 0x557146d8ef50 2023-08-10T11:06:27.296 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146d85400 con 0x557146d8f870 2023-08-10T11:06:27.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146d7eb00 con 0x557146d89800 2023-08-10T11:06:27.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8ef50 0x557146d8e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8ef50 0x557146d8e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37948/0 (socket says 172.21.15.107:37948) 2023-08-10T11:06:27.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2efb7fe700 1 -- 172.21.15.107:0/132798351 learned_addr learned my addr 172.21.15.107:0/132798351 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:27.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.294+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/132798351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d95530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.295+0000 7f2f00b9c700 1 -- 172.21.15.107:0/132798351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 msgr2=0x557146d9a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:27.297 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.295+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/132798351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146d9a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.295+0000 7f2f00b9c700 1 -- 172.21.15.107:0/132798351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8ef50 msgr2=0x557146d8e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:27.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.295+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/132798351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8ef50 0x557146d8e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.298 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.295+0000 7f2f00b9c700 1 -- 172.21.15.107:0/132798351 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557146b07de0 con 0x557146d8f870 2023-08-10T11:06:27.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.295+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/132798351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d95530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2efc19f3d0 tx=0x7f2ef4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5353f2c98b82a6d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:27.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.295+0000 7f2ee2ffd700 1 -- 172.21.15.107:0/132798351 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400e040 con 0x557146d8f870 2023-08-10T11:06:27.299 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.295+0000 7f2ee2ffd700 1 -- 172.21.15.107:0/132798351 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ef4003e90 con 0x557146d8f870 2023-08-10T11:06:27.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.295+0000 7f2ee2ffd700 1 -- 172.21.15.107:0/132798351 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef401ab70 con 0x557146d8f870 2023-08-10T11:06:27.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.296+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/132798351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 msgr2=0x557146d95530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:27.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.296+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/132798351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d95530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2efc19f3d0 tx=0x7f2ef4009920 comp rx=0 tx=0).stop 2023-08-10T11:06:27.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.296+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/132798351 shutdown_connections 2023-08-10T11:06:27.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.296+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/132798351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8f870 0x557146d95530 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.296+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/132798351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146d9a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.300 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.296+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/132798351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8ef50 0x557146d8e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.296+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/132798351 >> 172.21.15.107:0/132798351 conn(0x557146ce6cd0 msgr2=0x557146d8dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:27.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.297+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/132798351 shutdown_connections 2023-08-10T11:06:27.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.297+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/132798351 wait complete. 2023-08-10T11:06:27.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.297+0000 7f2f15f5fb80 1 -- start start 2023-08-10T11:06:27.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.297+0000 7f2f15f5fb80 1 Processor -- start 2023-08-10T11:06:27.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146defdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146df0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.301 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2f15f5fb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 0x557146deeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146def0d0 con 0x557146d8f870 2023-08-10T11:06:27.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146def240 con 0x557146d8ef50 2023-08-10T11:06:27.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2f15f5fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557146def400 con 0x557146d89800 2023-08-10T11:06:27.302 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2f15f5fb80 10 client.0 _ll_register_callbacks cb 0x557146c77680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:06:27.303 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146df0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146df0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:51612/0 (socket says 172.21.15.107:51612) 2023-08-10T11:06:27.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.298+0000 7f2efb7fe700 1 -- 172.21.15.107:0/2707315843 learned_addr learned my addr 172.21.15.107:0/2707315843 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:27.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.299+0000 7f2f00b9c700 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 0x557146deeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.299+0000 7f2efb7fe700 1 -- 172.21.15.107:0/2707315843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 msgr2=0x557146defdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:27.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.299+0000 7f2efb7fe700 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146defdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.299+0000 7f2efb7fe700 1 -- 172.21.15.107:0/2707315843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 msgr2=0x557146deeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:27.304 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.299+0000 7f2efb7fe700 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 0x557146deeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.299+0000 7f2efb7fe700 1 -- 172.21.15.107:0/2707315843 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef4012b30 con 0x557146d8ef50 2023-08-10T11:06:27.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.299+0000 7f2efb7fe700 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146df0310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009810 tx=0x7f2ef000f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9cb3328cfede2af server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:27.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.299+0000 7f2edb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T11:06:27.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.300+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2707315843 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef001c040 con 0x557146d8ef50 2023-08-10T11:06:27.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.300+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2707315843 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f2ef00269b0 con 0x557146d8ef50 2023-08-10T11:06:27.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.300+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2707315843 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2eec0a2480 con 0x557146d8ef50 2023-08-10T11:06:27.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.300+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2707315843 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ef00264e0 con 0x557146d8ef50 2023-08-10T11:06:27.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.300+0000 7f2f15f5fb80 10 client.26525 fetch_fsmap learned FSMap version 63 2023-08-10T11:06:27.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.300+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2707315843 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x557146af0c60 con 0x557146d8ef50 2023-08-10T11:06:27.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.301+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2707315843 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2eec0a2480 con 0x557146d8ef50 2023-08-10T11:06:27.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.301+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2707315843 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2ef0015020 con 0x557146d8ef50 2023-08-10T11:06:27.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.301+0000 7f2f15f5fb80 10 client.26525 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:06:27.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.301+0000 7f2f15f5fb80 10 client.26525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:06:27.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.301+0000 7f2f15f5fb80 20 client.26525 populate_metadata read hostname 'smithi107' 2023-08-10T11:06:27.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.301+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557146df7e40 0x557146dfa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:27.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.301+0000 7f2f15f5fb80 4 client.26525 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:06:27.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.301+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2707315843 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557146cd3780 con 0x557146df7e40 2023-08-10T11:06:27.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.302+0000 7f2efbfff700 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557146df7e40 0x557146dfa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:27.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.302+0000 7f2efbfff700 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557146df7e40 0x557146dfa260 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1964a439572140d2 server_cookie=6991bdd21845093c in_seq=0 out_seq=0 2023-08-10T11:06:27.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.302+0000 7f2edb7fe700 10 client.26525 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:06:27.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2edb7fe700 1 -- 172.21.15.107:0/2707315843 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557146cd3780 con 0x557146df7e40 2023-08-10T11:06:27.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2edb7fe700 10 client.26525 handle_command_reply: tid=0 2023-08-10T11:06:27.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 client.26525 shutdown 2023-08-10T11:06:27.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2707315843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 msgr2=0x557146df0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:27.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146df0310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009810 tx=0x7f2ef000f670 comp rx=0 tx=0).stop 2023-08-10T11:06:27.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2707315843 shutdown_connections 2023-08-10T11:06:27.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x557146df7e40 0x557146dfa260 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557146d8f870 0x557146deeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557146d89800 0x557146defdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 --2- 172.21.15.107:0/2707315843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557146d8ef50 0x557146df0310 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2707315843 >> 172.21.15.107:0/2707315843 conn(0x557146ce6cd0 msgr2=0x557146d8fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:27.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2edb7fe700 0 client.26525 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:06:27.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2707315843 shutdown_connections 2023-08-10T11:06:27.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.303+0000 7f2f15f5fb80 1 -- 172.21.15.107:0/2707315843 wait complete. 2023-08-10T11:06:27.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.304+0000 7f2f15f5fb80 20 client.26525 trim_cache size 0 max 16384 2023-08-10T11:06:27.310 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:06:27.310 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:06:27.311 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:06:27.311 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:06:27.311 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:06:27.311 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:06:27.311 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:06:27.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:06:27.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:06:27.311 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:06:27.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.304+0000 7f2f025ff700 1 -- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2ee40a12c0 msgr2=0x7f2ee40a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:27.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.304+0000 7f2f025ff700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2ee40a12c0 0x7f2ee40a3780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557146d8a520 tx=0x7f2ef400b040 comp rx=0 tx=0).stop 2023-08-10T11:06:27.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.304+0000 7f2f025ff700 1 -- 172.21.15.107:0/1500385879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2efc1006c0 msgr2=0x7f2efc19e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:27.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.304+0000 7f2f025ff700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2efc1006c0 0x7f2efc19e6d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00e9c0 tx=0x7f2eec00ed80 comp rx=0 tx=0).stop 2023-08-10T11:06:27.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.305+0000 7f2f025ff700 1 -- 172.21.15.107:0/1500385879 shutdown_connections 2023-08-10T11:06:27.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.305+0000 7f2f025ff700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f2ee40a12c0 0x7f2ee40a3780 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.305+0000 7f2f025ff700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2efc1006c0 0x7f2efc19e6d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.305+0000 7f2f025ff700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2efc1066d0 0x7f2efc198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.305+0000 7f2f025ff700 1 --2- 172.21.15.107:0/1500385879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2efc101080 0x7f2efc19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:27.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.305+0000 7f2f025ff700 1 -- 172.21.15.107:0/1500385879 >> 172.21.15.107:0/1500385879 conn(0x7f2efc0fc1f0 msgr2=0x7f2efc10baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:27.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.305+0000 7f2f025ff700 1 -- 172.21.15.107:0/1500385879 shutdown_connections 2023-08-10T11:06:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:27.305+0000 7f2f025ff700 1 -- 172.21.15.107:0/1500385879 wait complete. 2023-08-10T11:06:27.326 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:06:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:27 smithi195 ceph-mon[129938]: pgmap v476: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 31 MiB/s wr, 24 op/s 2023-08-10T11:06:28.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:27 smithi157 ceph-mon[129604]: pgmap v476: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 31 MiB/s wr, 24 op/s 2023-08-10T11:06:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:27 smithi107 ceph-mon[127953]: pgmap v476: 129 pgs: 129 active+clean; 14 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 31 MiB/s wr, 24 op/s 2023-08-10T11:06:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:29 smithi195 ceph-mon[129938]: pgmap v477: 129 pgs: 129 active+clean; 14 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 MiB/s wr, 26 op/s 2023-08-10T11:06:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:29 smithi157 ceph-mon[129604]: pgmap v477: 129 pgs: 129 active+clean; 14 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 MiB/s wr, 26 op/s 2023-08-10T11:06:30.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:29 smithi107 ceph-mon[127953]: pgmap v477: 129 pgs: 129 active+clean; 14 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 MiB/s wr, 26 op/s 2023-08-10T11:06:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:31 smithi195 ceph-mon[129938]: pgmap v478: 129 pgs: 129 active+clean; 14 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:06:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:31 smithi157 ceph-mon[129604]: pgmap v478: 129 pgs: 129 active+clean; 14 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:06:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:31 smithi107 ceph-mon[127953]: pgmap v478: 129 pgs: 129 active+clean; 14 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:06:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:33 smithi195 ceph-mon[129938]: pgmap v479: 129 pgs: 129 active+clean; 14 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-08-10T11:06:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:33 smithi157 ceph-mon[129604]: pgmap v479: 129 pgs: 129 active+clean; 14 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-08-10T11:06:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:33 smithi107 ceph-mon[127953]: pgmap v479: 129 pgs: 129 active+clean; 14 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-08-10T11:06:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:35 smithi195 ceph-mon[129938]: pgmap v480: 129 pgs: 129 active+clean; 15 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 39 MiB/s wr, 31 op/s 2023-08-10T11:06:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:35 smithi157 ceph-mon[129604]: pgmap v480: 129 pgs: 129 active+clean; 15 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 39 MiB/s wr, 31 op/s 2023-08-10T11:06:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:35 smithi107 ceph-mon[127953]: pgmap v480: 129 pgs: 129 active+clean; 15 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 39 MiB/s wr, 31 op/s 2023-08-10T11:06:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:37 smithi195 ceph-mon[129938]: pgmap v481: 129 pgs: 129 active+clean; 15 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:06:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:37 smithi157 ceph-mon[129604]: pgmap v481: 129 pgs: 129 active+clean; 15 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:06:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:37 smithi107 ceph-mon[127953]: pgmap v481: 129 pgs: 129 active+clean; 15 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:06:40.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:39 smithi195 ceph-mon[129938]: pgmap v482: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 MiB/s wr, 30 op/s 2023-08-10T11:06:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:39 smithi157 ceph-mon[129604]: pgmap v482: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 MiB/s wr, 30 op/s 2023-08-10T11:06:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:39 smithi107 ceph-mon[127953]: pgmap v482: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 MiB/s wr, 30 op/s 2023-08-10T11:06:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:41 smithi195 ceph-mon[129938]: pgmap v483: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-08-10T11:06:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:41 smithi157 ceph-mon[129604]: pgmap v483: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-08-10T11:06:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:41 smithi107 ceph-mon[127953]: pgmap v483: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 24 op/s 2023-08-10T11:06:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:43 smithi195 ceph-mon[129938]: pgmap v484: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:06:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:43 smithi157 ceph-mon[129604]: pgmap v484: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:06:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:43 smithi107 ceph-mon[127953]: pgmap v484: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:06:46.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:45 smithi195 ceph-mon[129938]: pgmap v485: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 39 MiB/s wr, 36 op/s 2023-08-10T11:06:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:45 smithi157 ceph-mon[129604]: pgmap v485: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 39 MiB/s wr, 36 op/s 2023-08-10T11:06:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:45 smithi107 ceph-mon[127953]: pgmap v485: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 39 MiB/s wr, 36 op/s 2023-08-10T11:06:47.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:46 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:06:47.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:46 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:06:47.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:46 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:06:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:47 smithi157 ceph-mon[129604]: pgmap v486: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 MiB/s wr, 25 op/s 2023-08-10T11:06:48.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:47 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:06:48.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:47 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:06:48.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:47 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:06:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:47 smithi107 ceph-mon[127953]: pgmap v486: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 MiB/s wr, 25 op/s 2023-08-10T11:06:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:47 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:06:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:47 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:06:48.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:47 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:06:48.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:47 smithi195 ceph-mon[129938]: pgmap v486: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 MiB/s wr, 25 op/s 2023-08-10T11:06:48.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:47 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:06:48.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:47 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:06:48.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:47 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:06:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:49 smithi157 ceph-mon[129604]: pgmap v487: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-08-10T11:06:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:49 smithi107 ceph-mon[127953]: pgmap v487: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-08-10T11:06:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:49 smithi195 ceph-mon[129938]: pgmap v487: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-08-10T11:06:51.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:50 smithi157 ceph-mon[129604]: pgmap v488: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-08-10T11:06:51.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:50 smithi107 ceph-mon[127953]: pgmap v488: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-08-10T11:06:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:50 smithi195 ceph-mon[129938]: pgmap v488: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 27 MiB/s wr, 27 op/s 2023-08-10T11:06:54.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:53 smithi157 ceph-mon[129604]: pgmap v489: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T11:06:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:53 smithi107 ceph-mon[127953]: pgmap v489: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T11:06:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:53 smithi195 ceph-mon[129938]: pgmap v489: 129 pgs: 129 active+clean; 15 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-08-10T11:06:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:55 smithi195 ceph-mon[129938]: pgmap v490: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-08-10T11:06:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:55 smithi157 ceph-mon[129604]: pgmap v490: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-08-10T11:06:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:55 smithi107 ceph-mon[127953]: pgmap v490: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-08-10T11:06:57.327 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:06:57.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.553+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1720636337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 msgr2=0x7f47b8106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:57.554 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.553+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1720636337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 0x7f47b8106ad0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009990 tx=0x7f47a8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.553+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1720636337 shutdown_connections 2023-08-10T11:06:57.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.553+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1720636337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b81010a0 0x7f47b810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.553+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1720636337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 0x7f47b8106ad0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.553+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1720636337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47b81006e0 0x7f47b8100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.553+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1720636337 >> 172.21.15.107:0/1720636337 conn(0x7f47b80fc1d0 msgr2=0x7f47b80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:57.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.553+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1720636337 shutdown_connections 2023-08-10T11:06:57.555 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.553+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1720636337 wait complete. 2023-08-10T11:06:57.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.554+0000 7f47bd3ff700 1 Processor -- start 2023-08-10T11:06:57.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.554+0000 7f47bd3ff700 1 -- start start 2023-08-10T11:06:57.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.554+0000 7f47bd3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47b81006e0 0x7f47b819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.554+0000 7f47bd3ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b81010a0 0x7f47b819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.558 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.554+0000 7f47bd3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 0x7f47b8198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.554+0000 7f47bd3ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8198db0 con 0x7f47b81010a0 2023-08-10T11:06:57.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.554+0000 7f47bd3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8198f20 con 0x7f47b81006e0 2023-08-10T11:06:57.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.554+0000 7f47bd3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b81990e0 con 0x7f47b81066f0 2023-08-10T11:06:57.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 0x7f47b8198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b67fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b81010a0 0x7f47b819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 0x7f47b8198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:42304/0 (socket says 172.21.15.107:42304) 2023-08-10T11:06:57.559 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b77fe700 1 -- 172.21.15.107:0/1047345458 learned_addr learned my addr 172.21.15.107:0/1047345458 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:57.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47b81006e0 0x7f47b819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b77fe700 1 -- 172.21.15.107:0/1047345458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47b81006e0 msgr2=0x7f47b819e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:57.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b77fe700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47b81006e0 0x7f47b819e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b77fe700 1 -- 172.21.15.107:0/1047345458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b81010a0 msgr2=0x7f47b819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:57.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b77fe700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b81010a0 0x7f47b819ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.560 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.555+0000 7f47b77fe700 1 -- 172.21.15.107:0/1047345458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009c40 con 0x7f47b81066f0 2023-08-10T11:06:57.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.556+0000 7f47b77fe700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 0x7f47b8198740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c370 tx=0x7f47b000c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:57.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.556+0000 7f479ffff700 1 -- 172.21.15.107:0/1047345458 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0017070 con 0x7f47b81066f0 2023-08-10T11:06:57.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.556+0000 7f479ffff700 1 -- 172.21.15.107:0/1047345458 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47b000f040 con 0x7f47b81066f0 2023-08-10T11:06:57.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.556+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1047345458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a80095f0 con 0x7f47b81066f0 2023-08-10T11:06:57.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.556+0000 7f479ffff700 1 -- 172.21.15.107:0/1047345458 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000e050 con 0x7f47b81066f0 2023-08-10T11:06:57.561 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.556+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1047345458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b81074f0 con 0x7f47b81066f0 2023-08-10T11:06:57.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.560+0000 7f479ffff700 1 -- 172.21.15.107:0/1047345458 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f47b000cb60 con 0x7f47b81066f0 2023-08-10T11:06:57.562 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.561+0000 7f47d0e04b80 1 Processor -- start 2023-08-10T11:06:57.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.561+0000 7f479ffff700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f47a00a12c0 0x7f47a00a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.563 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.561+0000 7f47d0e04b80 1 -- start start 2023-08-10T11:06:57.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f479ffff700 1 -- 172.21.15.107:0/1047345458 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f47b00cc970 con 0x7f47b81066f0 2023-08-10T11:06:57.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47b67fc700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f47a00a12c0 0x7f47a00a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03de2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03de800 0x55abc03dec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.565 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc0359dc0 con 0x55abc03e4870 2023-08-10T11:06:57.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc0336590 con 0x55abc03de800 2023-08-10T11:06:57.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc0333eb0 con 0x55abc03e3f50 2023-08-10T11:06:57.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47b6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47b6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:42320/0 (socket says 172.21.15.107:42320) 2023-08-10T11:06:57.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47b6ffd700 1 -- 172.21.15.107:0/601603573 learned_addr learned my addr 172.21.15.107:0/601603573 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:57.566 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47b77fe700 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03de800 0x55abc03dec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.562+0000 7f47b67fc700 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03de2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f47b6ffd700 1 -- 172.21.15.107:0/601603573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03de800 msgr2=0x55abc03dec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:57.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03de800 0x55abc03dec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f47b6ffd700 1 -- 172.21.15.107:0/601603573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 msgr2=0x55abc03de2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:57.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03de2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f47b6ffd700 1 -- 172.21.15.107:0/601603573 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abc01b0630 con 0x55abc03e3f50 2023-08-10T11:06:57.567 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f47b67fc700 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03de2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:06:57.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f47b67fc700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f47a00a12c0 0x7f47a00a3780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47b8199bb0 tx=0x7f47ac0106b0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:57.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e4330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f47a8015000 tx=0x7f47a8005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ab1f1eca63d4714 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:57.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f479d7fa700 1 -- 172.21.15.107:0/601603573 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a801d070 con 0x55abc03e3f50 2023-08-10T11:06:57.568 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f479d7fa700 1 -- 172.21.15.107:0/601603573 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47a801e040 con 0x55abc03e3f50 2023-08-10T11:06:57.569 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.563+0000 7f479d7fa700 1 -- 172.21.15.107:0/601603573 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8004820 con 0x55abc03e3f50 2023-08-10T11:06:57.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.564+0000 7f47d0e04b80 1 -- 172.21.15.107:0/601603573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 msgr2=0x55abc03e4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:57.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.564+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e4330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f47a8015000 tx=0x7f47a8005f00 comp rx=0 tx=0).stop 2023-08-10T11:06:57.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.564+0000 7f47d0e04b80 1 -- 172.21.15.107:0/601603573 shutdown_connections 2023-08-10T11:06:57.573 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.564+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03de800 0x55abc03dec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.564+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e4330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.564+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/601603573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03de2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.564+0000 7f47d0e04b80 1 -- 172.21.15.107:0/601603573 >> 172.21.15.107:0/601603573 conn(0x55abc033bcd0 msgr2=0x55abc03d94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:57.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.564+0000 7f47d0e04b80 1 -- 172.21.15.107:0/601603573 shutdown_connections 2023-08-10T11:06:57.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.564+0000 7f47d0e04b80 1 -- 172.21.15.107:0/601603573 wait complete. 2023-08-10T11:06:57.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.565+0000 7f47d0e04b80 1 -- start start 2023-08-10T11:06:57.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.565+0000 7f47d0e04b80 1 Processor -- start 2023-08-10T11:06:57.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03ea840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 0x55abc03e7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e4870 0x55abc03e8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc032f7a0 con 0x55abc03de800 2023-08-10T11:06:57.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc02ceac0 con 0x55abc03e3f50 2023-08-10T11:06:57.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc02ce7c0 con 0x55abc03e4870 2023-08-10T11:06:57.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47d0e04b80 10 client.0 _ll_register_callbacks cb 0x55abc02cc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:06:57.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47b6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03ea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47b77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e4870 0x55abc03e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47b77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e4870 0x55abc03e8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:42324/0 (socket says 172.21.15.107:42324) 2023-08-10T11:06:57.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47b77fe700 1 -- 172.21.15.107:0/1787396999 learned_addr learned my addr 172.21.15.107:0/1787396999 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:57.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.566+0000 7f47b67fc700 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 0x55abc03e7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47b77fe700 1 -- 172.21.15.107:0/1787396999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 msgr2=0x55abc03e7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:57.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47b77fe700 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 0x55abc03e7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47b77fe700 1 -- 172.21.15.107:0/1787396999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 msgr2=0x55abc03ea840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:57.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47b77fe700 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03ea840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47b77fe700 1 -- 172.21.15.107:0/1787396999 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b810deb0 con 0x55abc03e4870 2023-08-10T11:06:57.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47b67fc700 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 0x55abc03e7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:06:57.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47b77fe700 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e4870 0x55abc03e8160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f47b00993f0 tx=0x7f47b00992b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75976ae4f979d60f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:57.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f479aff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:06:57.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f479aff5700 1 -- 172.21.15.107:0/1787396999 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000ce10 con 0x55abc03e4870 2023-08-10T11:06:57.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f479aff5700 1 -- 172.21.15.107:0/1787396999 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f47b00996f0 con 0x55abc03e4870 2023-08-10T11:06:57.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47d0e04b80 1 -- 172.21.15.107:0/1787396999 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abc03d1470 con 0x55abc03e4870 2023-08-10T11:06:57.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f479aff5700 1 -- 172.21.15.107:0/1787396999 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47b009d720 con 0x55abc03e4870 2023-08-10T11:06:57.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47d0e04b80 10 client.26569 fetch_fsmap learned FSMap version 63 2023-08-10T11:06:57.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.567+0000 7f47d0e04b80 1 -- 172.21.15.107:0/1787396999 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55abc015cde0 con 0x55abc03e4870 2023-08-10T11:06:57.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.568+0000 7f479aff5700 1 -- 172.21.15.107:0/1787396999 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55abc03d1470 con 0x55abc03e4870 2023-08-10T11:06:57.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.568+0000 7f479aff5700 1 -- 172.21.15.107:0/1787396999 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47b00b7d20 con 0x55abc03e4870 2023-08-10T11:06:57.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.568+0000 7f47d0e04b80 10 client.26569 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:06:57.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.568+0000 7f47d0e04b80 10 client.26569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:06:57.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.568+0000 7f47d0e04b80 20 client.26569 populate_metadata read hostname 'smithi107' 2023-08-10T11:06:57.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.568+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55abc03f8210 0x55abc03fa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.568+0000 7f47d0e04b80 4 client.26569 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:06:57.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.568+0000 7f47d0e04b80 1 -- 172.21.15.107:0/1787396999 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55abc03ad9d0 con 0x55abc03f8210 2023-08-10T11:06:57.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.569+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55abc03f8210 0x55abc03fa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.569+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55abc03f8210 0x55abc03fa630 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4fc083bc914e2c6 server_cookie=dac0fa65fbee045c in_seq=0 out_seq=0 2023-08-10T11:06:57.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.569+0000 7f479aff5700 10 client.26569 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:06:57.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f479aff5700 1 -- 172.21.15.107:0/1787396999 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55abc03ad9d0 con 0x55abc03f8210 2023-08-10T11:06:57.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f479aff5700 10 client.26569 handle_command_reply: tid=0 2023-08-10T11:06:57.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 client.26569 shutdown 2023-08-10T11:06:57.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 -- 172.21.15.107:0/1787396999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e4870 msgr2=0x55abc03e8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:57.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e4870 0x55abc03e8160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f47b00993f0 tx=0x7f47b00992b0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 -- 172.21.15.107:0/1787396999 shutdown_connections 2023-08-10T11:06:57.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55abc03f8210 0x55abc03fa630 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e4870 0x55abc03e8160 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03ea840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f479aff5700 0 client.26569 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:06:57.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/1787396999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 0x55abc03e7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 -- 172.21.15.107:0/1787396999 >> 172.21.15.107:0/1787396999 conn(0x55abc033bcd0 msgr2=0x55abc03d89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:57.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 -- 172.21.15.107:0/1787396999 shutdown_connections 2023-08-10T11:06:57.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.570+0000 7f47d0e04b80 1 -- 172.21.15.107:0/1787396999 wait complete. 2023-08-10T11:06:57.583 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.571+0000 7f47d0e04b80 20 client.26569 trim_cache size 0 max 16384 2023-08-10T11:06:57.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.595+0000 7f47d0e04b80 1 Processor -- start 2023-08-10T11:06:57.596 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.595+0000 7f47d0e04b80 1 -- start start 2023-08-10T11:06:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.595+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03de800 0x55abc03ef300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.595+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 0x55abc03d9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.595+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03d9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.595+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc01b2920 con 0x55abc03e4870 2023-08-10T11:06:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.595+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc03eae40 con 0x55abc03e3f50 2023-08-10T11:06:57.597 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.595+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc03dadb0 con 0x55abc03de800 2023-08-10T11:06:57.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.595+0000 7f47b77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03d9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.599 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03de800 0x55abc03ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03d9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38576/0 (socket says 172.21.15.107:38576) 2023-08-10T11:06:57.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03de800 0x55abc03ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:42330/0 (socket says 172.21.15.107:42330) 2023-08-10T11:06:57.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b77fe700 1 -- 172.21.15.107:0/3739533477 learned_addr learned my addr 172.21.15.107:0/3739533477 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:57.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b67fc700 1 --2- 172.21.15.107:0/3739533477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 0x55abc03d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.600 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b6ffd700 1 -- 172.21.15.107:0/3739533477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 msgr2=0x55abc03d9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:57.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/3739533477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 0x55abc03d9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b6ffd700 1 -- 172.21.15.107:0/3739533477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 msgr2=0x55abc03d9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:57.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/3739533477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03d9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b6ffd700 1 -- 172.21.15.107:0/3739533477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abc0145c60 con 0x55abc03de800 2023-08-10T11:06:57.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b77fe700 1 --2- 172.21.15.107:0/3739533477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:06:57.601 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.596+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/3739533477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03de800 0x55abc03ef300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47a8000c00 tx=0x7f47a8009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=551b7a84a9a495b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:57.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.597+0000 7f479dffb700 1 -- 172.21.15.107:0/3739533477 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a801d040 con 0x55abc03de800 2023-08-10T11:06:57.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.597+0000 7f479dffb700 1 -- 172.21.15.107:0/3739533477 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47a800bba0 con 0x55abc03de800 2023-08-10T11:06:57.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.597+0000 7f479dffb700 1 -- 172.21.15.107:0/3739533477 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80349d0 con 0x55abc03de800 2023-08-10T11:06:57.602 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3739533477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03de800 msgr2=0x55abc03ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:57.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3739533477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03de800 0x55abc03ef300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47a8000c00 tx=0x7f47a8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3739533477 shutdown_connections 2023-08-10T11:06:57.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3739533477 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03e4870 0x55abc03d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.603 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3739533477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03de800 0x55abc03ef300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3739533477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e3f50 0x55abc03d9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3739533477 >> 172.21.15.107:0/3739533477 conn(0x55abc033bcd0 msgr2=0x55abc03e1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:57.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3739533477 shutdown_connections 2023-08-10T11:06:57.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3739533477 wait complete. 2023-08-10T11:06:57.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 -- start start 2023-08-10T11:06:57.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.598+0000 7f47d0e04b80 1 Processor -- start 2023-08-10T11:06:57.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47d0e04b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e4870 0x55abc03df970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc03dfeb0 con 0x55abc03de800 2023-08-10T11:06:57.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc03e0020 con 0x55abc03e4870 2023-08-10T11:06:57.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47d0e04b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abc03e01e0 con 0x55abc03e3f50 2023-08-10T11:06:57.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47d0e04b80 10 client.0 _ll_register_callbacks cb 0x55abc02cc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:06:57.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47b6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47b67fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47b6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03e0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38578/0 (socket says 172.21.15.107:38578) 2023-08-10T11:06:57.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47b6ffd700 1 -- 172.21.15.107:0/3180169696 learned_addr learned my addr 172.21.15.107:0/3180169696 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:06:57.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.599+0000 7f47b77fe700 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e4870 0x55abc03df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.600+0000 7f47b6ffd700 1 -- 172.21.15.107:0/3180169696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 msgr2=0x55abc03e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:57.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.600+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.600+0000 7f47b6ffd700 1 -- 172.21.15.107:0/3180169696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e4870 msgr2=0x55abc03df970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:06:57.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.600+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e4870 0x55abc03df970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.600+0000 7f47b6ffd700 1 -- 172.21.15.107:0/3180169696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55abc015cde0 con 0x55abc03de800 2023-08-10T11:06:57.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.600+0000 7f47b6ffd700 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03e0b40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f47a800bdd0 tx=0x7f47a8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba98c0e61b0a4f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:06:57.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.600+0000 7f479aff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:06:57.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.600+0000 7f479aff5700 1 -- 172.21.15.107:0/3180169696 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a801d040 con 0x55abc03de800 2023-08-10T11:06:57.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3180169696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47a801e040 con 0x55abc03de800 2023-08-10T11:06:57.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f479aff5700 1 -- 172.21.15.107:0/3180169696 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f47a8034970 con 0x55abc03de800 2023-08-10T11:06:57.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f479aff5700 1 -- 172.21.15.107:0/3180169696 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47a8034b30 con 0x55abc03de800 2023-08-10T11:06:57.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f47d0e04b80 10 client.16890 fetch_fsmap learned FSMap version 63 2023-08-10T11:06:57.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3180169696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55abc01b0630 con 0x55abc03de800 2023-08-10T11:06:57.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f479aff5700 1 -- 172.21.15.107:0/3180169696 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47a8046080 con 0x55abc03de800 2023-08-10T11:06:57.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f479aff5700 1 -- 172.21.15.107:0/3180169696 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47a803b070 con 0x55abc03de800 2023-08-10T11:06:57.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f47d0e04b80 10 client.16890 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:06:57.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f47d0e04b80 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:06:57.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f47d0e04b80 20 client.16890 populate_metadata read hostname 'smithi107' 2023-08-10T11:06:57.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55abc044ca40 0x55abc044ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:06:57.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f47d0e04b80 4 client.16890 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:06:57.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.601+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3180169696 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55abc0328780 con 0x55abc044ca40 2023-08-10T11:06:57.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.602+0000 7f47b67fc700 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55abc044ca40 0x55abc044ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:06:57.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.602+0000 7f47b67fc700 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55abc044ca40 0x55abc044ee60 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d1bd746093abe0 server_cookie=1d9bcbcfc854ba26 in_seq=0 out_seq=0 2023-08-10T11:06:57.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.602+0000 7f479aff5700 10 client.16890 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:06:57.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f479aff5700 1 -- 172.21.15.107:0/3180169696 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55abc0328780 con 0x55abc044ca40 2023-08-10T11:06:57.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f479aff5700 10 client.16890 handle_command_reply: tid=0 2023-08-10T11:06:57.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 client.16890 shutdown 2023-08-10T11:06:57.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3180169696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 msgr2=0x55abc03e0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:57.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03e0b40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f47a800bdd0 tx=0x7f47a8009310 comp rx=0 tx=0).stop 2023-08-10T11:06:57.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3180169696 shutdown_connections 2023-08-10T11:06:57.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55abc044ca40 0x55abc044ee60 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55abc03e4870 0x55abc03df970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55abc03de800 0x55abc03e0b40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 --2- 172.21.15.107:0/3180169696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55abc03e3f50 0x55abc03e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f479aff5700 0 client.16890 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:06:57.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3180169696 >> 172.21.15.107:0/3180169696 conn(0x55abc033bcd0 msgr2=0x55abc03e4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:57.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3180169696 shutdown_connections 2023-08-10T11:06:57.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.603+0000 7f47d0e04b80 1 -- 172.21.15.107:0/3180169696 wait complete. 2023-08-10T11:06:57.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47d0e04b80 20 client.16890 trim_cache size 0 max 16384 2023-08-10T11:06:57.616 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:06:57.616 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:06:57.616 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:06:57.616 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:06:57.616 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:06:57.616 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:06:57.617 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:06:57.617 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:06:57.617 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:06:57.617 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:06:57.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1047345458 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f47a00a12c0 msgr2=0x7f47a00a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:57.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f47a00a12c0 0x7f47a00a3780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47b8199bb0 tx=0x7f47ac0106b0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1047345458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 msgr2=0x7f47b8198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:06:57.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 0x7f47b8198740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c370 tx=0x7f47b000c680 comp rx=0 tx=0).stop 2023-08-10T11:06:57.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1047345458 shutdown_connections 2023-08-10T11:06:57.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f47a00a12c0 0x7f47a00a3780 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47b81006e0 0x7f47b819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47b81066f0 0x7f47b8198740 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 --2- 172.21.15.107:0/1047345458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f47b81010a0 0x7f47b819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:06:57.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.604+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1047345458 >> 172.21.15.107:0/1047345458 conn(0x7f47b80fc1d0 msgr2=0x7f47b810ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:06:57.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.605+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1047345458 shutdown_connections 2023-08-10T11:06:57.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:06:57.605+0000 7f47bd3ff700 1 -- 172.21.15.107:0/1047345458 wait complete. 2023-08-10T11:06:57.627 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:06:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:57 smithi195 ceph-mon[129938]: pgmap v491: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:06:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:57 smithi157 ceph-mon[129604]: pgmap v491: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:06:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:57 smithi107 ceph-mon[127953]: pgmap v491: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-08-10T11:07:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:06:59 smithi195 ceph-mon[129938]: pgmap v492: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 31 op/s 2023-08-10T11:07:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:06:59 smithi157 ceph-mon[129604]: pgmap v492: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 31 op/s 2023-08-10T11:07:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:06:59 smithi107 ceph-mon[127953]: pgmap v492: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 31 op/s 2023-08-10T11:07:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:01 smithi195 ceph-mon[129938]: pgmap v493: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:07:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:01 smithi157 ceph-mon[129604]: pgmap v493: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:07:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:01 smithi107 ceph-mon[127953]: pgmap v493: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:07:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:03 smithi195 ceph-mon[129938]: pgmap v494: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:07:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:03 smithi157 ceph-mon[129604]: pgmap v494: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:07:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:03 smithi107 ceph-mon[127953]: pgmap v494: 129 pgs: 129 active+clean; 15 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-08-10T11:07:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:05 smithi195 ceph-mon[129938]: pgmap v495: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-08-10T11:07:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:05 smithi157 ceph-mon[129604]: pgmap v495: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-08-10T11:07:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:05 smithi107 ceph-mon[127953]: pgmap v495: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-08-10T11:07:06.961 INFO:teuthology.orchestra.run.smithi107.stderr:set primary keys... 2023-08-10T11:07:08.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:07 smithi157 ceph-mon[129604]: pgmap v496: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 36 op/s 2023-08-10T11:07:08.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:07 smithi107 ceph-mon[127953]: pgmap v496: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 36 op/s 2023-08-10T11:07:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:07 smithi195 ceph-mon[129938]: pgmap v496: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 36 op/s 2023-08-10T11:07:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:08 smithi157 ceph-mon[129604]: osdmap e111: 12 total, 12 up, 12 in 2023-08-10T11:07:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:08 smithi107 ceph-mon[127953]: osdmap e111: 12 total, 12 up, 12 in 2023-08-10T11:07:09.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:08 smithi195 ceph-mon[129938]: osdmap e111: 12 total, 12 up, 12 in 2023-08-10T11:07:10.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:09 smithi157 ceph-mon[129604]: pgmap v498: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 46 op/s 2023-08-10T11:07:10.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:09 smithi107 ceph-mon[127953]: pgmap v498: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 46 op/s 2023-08-10T11:07:10.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:09 smithi195 ceph-mon[129938]: pgmap v498: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 46 op/s 2023-08-10T11:07:12.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:11 smithi157 ceph-mon[129604]: pgmap v499: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 27 MiB/s wr, 47 op/s 2023-08-10T11:07:12.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:11 smithi107 ceph-mon[127953]: pgmap v499: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 27 MiB/s wr, 47 op/s 2023-08-10T11:07:12.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:11 smithi195 ceph-mon[129938]: pgmap v499: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 27 MiB/s wr, 47 op/s 2023-08-10T11:07:13.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:12 smithi157 ceph-mon[129604]: pgmap v500: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 27 MiB/s wr, 47 op/s 2023-08-10T11:07:13.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:12 smithi107 ceph-mon[127953]: pgmap v500: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 27 MiB/s wr, 47 op/s 2023-08-10T11:07:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:12 smithi195 ceph-mon[129938]: pgmap v500: 129 pgs: 16 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 27 MiB/s wr, 47 op/s 2023-08-10T11:07:16.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:15 smithi195 ceph-mon[129938]: pgmap v501: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 28 op/s 2023-08-10T11:07:16.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:15 smithi157 ceph-mon[129604]: pgmap v501: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 28 op/s 2023-08-10T11:07:16.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:15 smithi107 ceph-mon[127953]: pgmap v501: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 28 op/s 2023-08-10T11:07:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:17 smithi195 ceph-mon[129938]: pgmap v502: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 28 op/s 2023-08-10T11:07:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:17 smithi157 ceph-mon[129604]: pgmap v502: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 28 op/s 2023-08-10T11:07:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:17 smithi107 ceph-mon[127953]: pgmap v502: 129 pgs: 129 active+clean; 15 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 28 op/s 2023-08-10T11:07:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:19 smithi195 ceph-mon[129938]: pgmap v503: 129 pgs: 129 active+clean; 16 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 29 MiB/s wr, 34 op/s 2023-08-10T11:07:20.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:19 smithi195 ceph-mon[129938]: osdmap e112: 12 total, 12 up, 12 in 2023-08-10T11:07:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:19 smithi157 ceph-mon[129604]: pgmap v503: 129 pgs: 129 active+clean; 16 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 29 MiB/s wr, 34 op/s 2023-08-10T11:07:20.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:19 smithi157 ceph-mon[129604]: osdmap e112: 12 total, 12 up, 12 in 2023-08-10T11:07:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:19 smithi107 ceph-mon[127953]: pgmap v503: 129 pgs: 129 active+clean; 16 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 29 MiB/s wr, 34 op/s 2023-08-10T11:07:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:19 smithi107 ceph-mon[127953]: osdmap e112: 12 total, 12 up, 12 in 2023-08-10T11:07:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:21 smithi195 ceph-mon[129938]: pgmap v505: 129 pgs: 129 active+clean; 16 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-08-10T11:07:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:21 smithi157 ceph-mon[129604]: pgmap v505: 129 pgs: 129 active+clean; 16 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-08-10T11:07:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:21 smithi107 ceph-mon[127953]: pgmap v505: 129 pgs: 129 active+clean; 16 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-08-10T11:07:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:23 smithi195 ceph-mon[129938]: pgmap v506: 129 pgs: 129 active+clean; 16 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-08-10T11:07:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:23 smithi157 ceph-mon[129604]: pgmap v506: 129 pgs: 129 active+clean; 16 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-08-10T11:07:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:23 smithi107 ceph-mon[127953]: pgmap v506: 129 pgs: 129 active+clean; 16 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-08-10T11:07:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:25 smithi195 ceph-mon[129938]: pgmap v507: 129 pgs: 129 active+clean; 16 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-08-10T11:07:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:25 smithi157 ceph-mon[129604]: pgmap v507: 129 pgs: 129 active+clean; 16 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-08-10T11:07:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:25 smithi107 ceph-mon[127953]: pgmap v507: 129 pgs: 129 active+clean; 16 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-08-10T11:07:27.628 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:07:28.098 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:27 smithi107 ceph-mon[127953]: pgmap v508: 129 pgs: 129 active+clean; 16 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-08-10T11:07:28.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.103+0000 7f5df49ff700 1 -- 172.21.15.107:0/2219396853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 msgr2=0x7f5df0072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:28.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.103+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2219396853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 0x7f5df0072ef0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5de00098f0 tx=0x7f5de0009c00 comp rx=0 tx=0).stop 2023-08-10T11:07:28.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.103+0000 7f5df49ff700 1 -- 172.21.15.107:0/2219396853 shutdown_connections 2023-08-10T11:07:28.105 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.103+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2219396853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df01116f0 0x7f5df0113ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.103+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2219396853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 0x7f5df0072ef0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.103+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2219396853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5df0073430 0x7f5df01111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.103+0000 7f5df49ff700 1 -- 172.21.15.107:0/2219396853 >> 172.21.15.107:0/2219396853 conn(0x7f5df00fc1d0 msgr2=0x7f5df00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:28.106 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.103+0000 7f5df49ff700 1 -- 172.21.15.107:0/2219396853 shutdown_connections 2023-08-10T11:07:28.107 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.104+0000 7f5df49ff700 1 -- 172.21.15.107:0/2219396853 wait complete. 2023-08-10T11:07:28.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.105+0000 7f5df49ff700 1 Processor -- start 2023-08-10T11:07:28.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.105+0000 7f5df49ff700 1 -- start start 2023-08-10T11:07:28.110 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.105+0000 7f5df49ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 0x7f5df019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.105+0000 7f5df49ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5df0073430 0x7f5df019d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.105+0000 7f5df49ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df01116f0 0x7f5df01a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.105+0000 7f5df49ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01a1de0 con 0x7f5df0073430 2023-08-10T11:07:28.111 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.105+0000 7f5df49ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01a1f50 con 0x7f5df01116f0 2023-08-10T11:07:28.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.105+0000 7f5df49ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01a2110 con 0x7f5df0072b10 2023-08-10T11:07:28.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dee59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 0x7f5df019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dedd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5df0073430 0x7f5df019d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dedd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5df0073430 0x7f5df019d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37880/0 (socket says 172.21.15.107:37880) 2023-08-10T11:07:28.112 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dedd9b700 1 -- 172.21.15.107:0/2208768025 learned_addr learned my addr 172.21.15.107:0/2208768025 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:28.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dee59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 0x7f5df019ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:37956/0 (socket says 172.21.15.107:37956) 2023-08-10T11:07:28.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5deed9d700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df01116f0 0x7f5df01a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dee59c700 1 -- 172.21.15.107:0/2208768025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df01116f0 msgr2=0x7f5df01a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:28.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dee59c700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df01116f0 0x7f5df01a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dee59c700 1 -- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5df0073430 msgr2=0x7f5df019d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:28.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dee59c700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5df0073430 0x7f5df019d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.113 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dee59c700 1 -- 172.21.15.107:0/2208768025 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40095f0 con 0x7f5df0072b10 2023-08-10T11:07:28.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5deed9d700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df01116f0 0x7f5df01a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:07:28.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5df0073430 0x7f5df019d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:07:28.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.106+0000 7f5dee59c700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 0x7f5df019ce00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009810 tx=0x7f5de000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:28.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.107+0000 7f5ddf7fe700 1 -- 172.21.15.107:0/2208768025 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de001c070 con 0x7f5df0072b10 2023-08-10T11:07:28.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.107+0000 7f5ddf7fe700 1 -- 172.21.15.107:0/2208768025 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5de000bb70 con 0x7f5df0072b10 2023-08-10T11:07:28.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.107+0000 7f5ddf7fe700 1 -- 172.21.15.107:0/2208768025 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00038c0 con 0x7f5df0072b10 2023-08-10T11:07:28.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.107+0000 7f5df49ff700 1 -- 172.21.15.107:0/2208768025 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de0009520 con 0x7f5df0072b10 2023-08-10T11:07:28.114 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.107+0000 7f5df49ff700 1 -- 172.21.15.107:0/2208768025 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df01a9a50 con 0x7f5df0072b10 2023-08-10T11:07:28.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.110+0000 7f5ddf7fe700 1 -- 172.21.15.107:0/2208768025 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5de0020030 con 0x7f5df0072b10 2023-08-10T11:07:28.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.111+0000 7f5ddf7fe700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5dd80a1340 0x7f5dd80a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.115 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.112+0000 7f5ddf7fe700 1 -- 172.21.15.107:0/2208768025 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f5de00cde30 con 0x7f5df0072b10 2023-08-10T11:07:28.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.112+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5dd80a1340 0x7f5dd80a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.116 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.112+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5dd80a1340 0x7f5dd80a3800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5df019e410 tx=0x7f5de4009310 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:28.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.132+0000 7f5e08400b80 1 Processor -- start 2023-08-10T11:07:28.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5e08400b80 1 -- start start 2023-08-10T11:07:28.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43ece2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43ecec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5e08400b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43e49dc0 con 0x560a43ed3f50 2023-08-10T11:07:28.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5e08400b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43e26590 con 0x560a43ed4870 2023-08-10T11:07:28.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5e08400b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43e23eb0 con 0x560a43ece800 2023-08-10T11:07:28.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5dee59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5dee59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37884/0 (socket says 172.21.15.107:37884) 2023-08-10T11:07:28.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.133+0000 7f5dee59c700 1 -- 172.21.15.107:0/3817927193 learned_addr learned my addr 172.21.15.107:0/3817927193 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:28.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5deed9d700 1 --2- 172.21.15.107:0/3817927193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43ecec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/3817927193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43ece2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5dee59c700 1 -- 172.21.15.107:0/3817927193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 msgr2=0x560a43ecec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:28.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5dee59c700 1 --2- 172.21.15.107:0/3817927193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43ecec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5dee59c700 1 -- 172.21.15.107:0/3817927193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 msgr2=0x560a43ece2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:28.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5dee59c700 1 --2- 172.21.15.107:0/3817927193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43ece2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5dee59c700 1 -- 172.21.15.107:0/3817927193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a43ca0630 con 0x560a43ed3f50 2023-08-10T11:07:28.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5dee59c700 1 --2- 172.21.15.107:0/3817927193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed4330 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5de00a2ad0 tx=0x7f5de009a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf708f6d3049ea server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:28.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5ddcff9700 1 -- 172.21.15.107:0/3817927193 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de009ec70 con 0x560a43ed3f50 2023-08-10T11:07:28.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5ddcff9700 1 -- 172.21.15.107:0/3817927193 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5de009e030 con 0x560a43ed3f50 2023-08-10T11:07:28.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.134+0000 7f5ddcff9700 1 -- 172.21.15.107:0/3817927193 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00b3210 con 0x560a43ed3f50 2023-08-10T11:07:28.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.135+0000 7f5e08400b80 1 -- 172.21.15.107:0/3817927193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 msgr2=0x560a43ed4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:28.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.135+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3817927193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed4330 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5de00a2ad0 tx=0x7f5de009a5a0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.135+0000 7f5e08400b80 1 -- 172.21.15.107:0/3817927193 shutdown_connections 2023-08-10T11:07:28.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.135+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3817927193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43ecec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.135+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3817927193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed4330 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.135+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3817927193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43ece2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.135+0000 7f5e08400b80 1 -- 172.21.15.107:0/3817927193 >> 172.21.15.107:0/3817927193 conn(0x560a43e2bcd0 msgr2=0x560a43ec94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:28.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.135+0000 7f5e08400b80 1 -- 172.21.15.107:0/3817927193 shutdown_connections 2023-08-10T11:07:28.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.136+0000 7f5e08400b80 1 -- 172.21.15.107:0/3817927193 wait complete. 2023-08-10T11:07:28.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.136+0000 7f5e08400b80 1 -- start start 2023-08-10T11:07:28.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.136+0000 7f5e08400b80 1 Processor -- start 2023-08-10T11:07:28.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ece800 0x560a43eda820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed4870 0x560a43ed80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5e08400b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43e1f7a0 con 0x560a43ed4870 2023-08-10T11:07:28.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5e08400b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43dbeac0 con 0x560a43ece800 2023-08-10T11:07:28.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5e08400b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43dbe7c0 con 0x560a43ed3f50 2023-08-10T11:07:28.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5e08400b80 10 client.0 _ll_register_callbacks cb 0x560a43dbc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:07:28.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5deed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed4870 0x560a43ed80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5dedd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5deed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed4870 0x560a43ed80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37890/0 (socket says 172.21.15.107:37890) 2023-08-10T11:07:28.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5deed9d700 1 -- 172.21.15.107:0/3209857894 learned_addr learned my addr 172.21.15.107:0/3209857894 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:28.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.137+0000 7f5dee59c700 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ece800 0x560a43eda820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.138+0000 7f5dedd9b700 1 -- 172.21.15.107:0/3209857894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ece800 msgr2=0x560a43eda820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:28.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.138+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ece800 0x560a43eda820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.138+0000 7f5dedd9b700 1 -- 172.21.15.107:0/3209857894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed4870 msgr2=0x560a43ed80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:28.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.138+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed4870 0x560a43ed80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.138+0000 7f5dedd9b700 1 -- 172.21.15.107:0/3209857894 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df01a9a50 con 0x560a43ed3f50 2023-08-10T11:07:28.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.138+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed7aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5de400f630 tx=0x7f5de40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9147ce033d2fb814 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:28.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.138+0000 7f5dd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-08-10T11:07:28.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.139+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/3209857894 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4022070 con 0x560a43ed3f50 2023-08-10T11:07:28.144 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.139+0000 7f5e08400b80 1 -- 172.21.15.107:0/3209857894 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a43ec1470 con 0x560a43ed3f50 2023-08-10T11:07:28.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.139+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/3209857894 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f5de401dce0 con 0x560a43ed3f50 2023-08-10T11:07:28.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.139+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/3209857894 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5de4004020 con 0x560a43ed3f50 2023-08-10T11:07:28.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.139+0000 7f5e08400b80 10 client.26587 fetch_fsmap learned FSMap version 63 2023-08-10T11:07:28.145 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.139+0000 7f5e08400b80 1 -- 172.21.15.107:0/3209857894 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x560a43c4cde0 con 0x560a43ed3f50 2023-08-10T11:07:28.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.139+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/3209857894 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560a43ec1470 con 0x560a43ed3f50 2023-08-10T11:07:28.146 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.140+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/3209857894 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5de4003cd0 con 0x560a43ed3f50 2023-08-10T11:07:28.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.140+0000 7f5e08400b80 10 client.26587 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:07:28.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.140+0000 7f5e08400b80 10 client.26587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:07:28.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.140+0000 7f5e08400b80 20 client.26587 populate_metadata read hostname 'smithi107' 2023-08-10T11:07:28.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.140+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560a43ee7f20 0x560a43eea340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.140+0000 7f5e08400b80 4 client.26587 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:07:28.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.140+0000 7f5e08400b80 1 -- 172.21.15.107:0/3209857894 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a43e9d9d0 con 0x560a43ee7f20 2023-08-10T11:07:28.147 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.140+0000 7f5dee59c700 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560a43ee7f20 0x560a43eea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.141+0000 7f5dee59c700 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560a43ee7f20 0x560a43eea340 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93444ab583fadb91 server_cookie=7e6aaf4e228da21c in_seq=0 out_seq=0 2023-08-10T11:07:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.141+0000 7f5dd5ffb700 10 client.26587 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:07:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/3209857894 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560a43e9d9d0 con 0x560a43ee7f20 2023-08-10T11:07:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5dd5ffb700 10 client.26587 handle_command_reply: tid=0 2023-08-10T11:07:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 client.26587 shutdown 2023-08-10T11:07:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 -- 172.21.15.107:0/3209857894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 msgr2=0x560a43ed7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed7aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5de400f630 tx=0x7f5de40047c0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.148 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 -- 172.21.15.107:0/3209857894 shutdown_connections 2023-08-10T11:07:28.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560a43ee7f20 0x560a43eea340 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ece800 0x560a43eda820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed4870 0x560a43ed80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 --2- 172.21.15.107:0/3209857894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed7aa0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 -- 172.21.15.107:0/3209857894 >> 172.21.15.107:0/3209857894 conn(0x560a43e2bcd0 msgr2=0x560a43ec89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:28.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5dd5ffb700 0 client.26587 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:07:28.149 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 -- 172.21.15.107:0/3209857894 shutdown_connections 2023-08-10T11:07:28.150 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 1 -- 172.21.15.107:0/3209857894 wait complete. 2023-08-10T11:07:28.150 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.142+0000 7f5e08400b80 20 client.26587 trim_cache size 0 max 16384 2023-08-10T11:07:28.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.161+0000 7f5e08400b80 1 Processor -- start 2023-08-10T11:07:28.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5e08400b80 1 -- start start 2023-08-10T11:07:28.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43edf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43eda3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5e08400b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43ca2920 con 0x560a43ed3f50 2023-08-10T11:07:28.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5e08400b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43ed9080 con 0x560a43ed4870 2023-08-10T11:07:28.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5e08400b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43ed6070 con 0x560a43ece800 2023-08-10T11:07:28.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:27 smithi195 ceph-mon[129938]: pgmap v508: 129 pgs: 129 active+clean; 16 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-08-10T11:07:28.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5dee59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43edf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5dee59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43edf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38002/0 (socket says 172.21.15.107:38002) 2023-08-10T11:07:28.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5dee59c700 1 -- 172.21.15.107:0/2090693082 learned_addr learned my addr 172.21.15.107:0/2090693082 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:28.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5deed9d700 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43eda3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5dee59c700 1 -- 172.21.15.107:0/2090693082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 msgr2=0x560a43eda3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:28.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.162+0000 7f5dee59c700 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43eda3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.163+0000 7f5dee59c700 1 -- 172.21.15.107:0/2090693082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 msgr2=0x560a43ed3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:28.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.163+0000 7f5dee59c700 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.163+0000 7f5dee59c700 1 -- 172.21.15.107:0/2090693082 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a43c35c60 con 0x560a43ece800 2023-08-10T11:07:28.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.163+0000 7f5deed9d700 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43eda3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:07:28.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.163+0000 7f5dee59c700 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43edf0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5de00cb2e0 tx=0x7f5de0019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df8f9005167540 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:28.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.163+0000 7f5ddd7fa700 1 -- 172.21.15.107:0/2090693082 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de009ec70 con 0x560a43ece800 2023-08-10T11:07:28.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.163+0000 7f5ddd7fa700 1 -- 172.21.15.107:0/2090693082 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5de0098fe0 con 0x560a43ece800 2023-08-10T11:07:28.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.163+0000 7f5ddd7fa700 1 -- 172.21.15.107:0/2090693082 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00cb610 con 0x560a43ece800 2023-08-10T11:07:28.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.164+0000 7f5e08400b80 1 -- 172.21.15.107:0/2090693082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 msgr2=0x560a43edf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:28.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.164+0000 7f5e08400b80 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43edf0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5de00cb2e0 tx=0x7f5de0019040 comp rx=0 tx=0).stop 2023-08-10T11:07:28.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.164+0000 7f5e08400b80 1 -- 172.21.15.107:0/2090693082 shutdown_connections 2023-08-10T11:07:28.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.164+0000 7f5e08400b80 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43eda3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.164+0000 7f5e08400b80 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ece800 0x560a43edf0d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.164+0000 7f5e08400b80 1 --2- 172.21.15.107:0/2090693082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ed3f50 0x560a43ed3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.164+0000 7f5e08400b80 1 -- 172.21.15.107:0/2090693082 >> 172.21.15.107:0/2090693082 conn(0x560a43e2bcd0 msgr2=0x560a43ed2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:28.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.164+0000 7f5e08400b80 1 -- 172.21.15.107:0/2090693082 shutdown_connections 2023-08-10T11:07:28.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.164+0000 7f5e08400b80 1 -- 172.21.15.107:0/2090693082 wait complete. 2023-08-10T11:07:28.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.165+0000 7f5e08400b80 1 -- start start 2023-08-10T11:07:28.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.165+0000 7f5e08400b80 1 Processor -- start 2023-08-10T11:07:28.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.165+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ece800 0x560a43ed0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.165+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.165+0000 7f5e08400b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43ecfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.165+0000 7f5e08400b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43ed01c0 con 0x560a43ece800 2023-08-10T11:07:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.165+0000 7f5e08400b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43ed0330 con 0x560a43ed4870 2023-08-10T11:07:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.165+0000 7f5e08400b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a43ed04f0 con 0x560a43ed3f50 2023-08-10T11:07:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5e08400b80 10 client.0 _ll_register_callbacks cb 0x560a43dbc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:07:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dee59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ece800 0x560a43ed0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dedd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dedd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38004/0 (socket says 172.21.15.107:38004) 2023-08-10T11:07:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dedd9b700 1 -- 172.21.15.107:0/1173169820 learned_addr learned my addr 172.21.15.107:0/1173169820 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dee59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ece800 0x560a43ed0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37910/0 (socket says 172.21.15.107:37910) 2023-08-10T11:07:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5deed9d700 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43ecfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dee59c700 1 -- 172.21.15.107:0/1173169820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 msgr2=0x560a43ed1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:28.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dee59c700 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dee59c700 1 -- 172.21.15.107:0/1173169820 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 msgr2=0x560a43ecfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:28.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dee59c700 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43ecfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dee59c700 1 -- 172.21.15.107:0/1173169820 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a43ca0630 con 0x560a43ece800 2023-08-10T11:07:28.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:07:28.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dee59c700 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ece800 0x560a43ed0dd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5de0097140 tx=0x7f5de009adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93255260a1f393df server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:28.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.166+0000 7f5dd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:07:28.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/1173169820 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de009a5a0 con 0x560a43ece800 2023-08-10T11:07:28.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5e08400b80 1 -- 172.21.15.107:0/1173169820 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5de009e030 con 0x560a43ece800 2023-08-10T11:07:28.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/1173169820 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f5de009ec70 con 0x560a43ece800 2023-08-10T11:07:28.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/1173169820 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5de0084140 con 0x560a43ece800 2023-08-10T11:07:28.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5e08400b80 10 client.16908 fetch_fsmap learned FSMap version 63 2023-08-10T11:07:28.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5e08400b80 1 -- 172.21.15.107:0/1173169820 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x560a43c73250 con 0x560a43ece800 2023-08-10T11:07:28.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/1173169820 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5de009e030 con 0x560a43ece800 2023-08-10T11:07:28.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/1173169820 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5de0082080 con 0x560a43ece800 2023-08-10T11:07:28.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5e08400b80 10 client.16908 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:07:28.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5e08400b80 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:07:28.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.167+0000 7f5e08400b80 20 client.16908 populate_metadata read hostname 'smithi107' 2023-08-10T11:07:28.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.168+0000 7f5e08400b80 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560a43f3c8c0 0x560a43f3ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:28.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.168+0000 7f5e08400b80 4 client.16908 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:07:28.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.168+0000 7f5e08400b80 1 -- 172.21.15.107:0/1173169820 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560a43e18780 con 0x560a43f3c8c0 2023-08-10T11:07:28.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.168+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560a43f3c8c0 0x560a43f3ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:28.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5dedd9b700 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560a43f3c8c0 0x560a43f3ece0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68479e8d4ad7aef7 server_cookie=a8a5725d695ba1b5 in_seq=0 out_seq=0 2023-08-10T11:07:28.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5dd5ffb700 10 client.16908 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:07:28.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5dd5ffb700 1 -- 172.21.15.107:0/1173169820 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560a43e18780 con 0x560a43f3c8c0 2023-08-10T11:07:28.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5dd5ffb700 10 client.16908 handle_command_reply: tid=0 2023-08-10T11:07:28.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 client.16908 shutdown 2023-08-10T11:07:28.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 -- 172.21.15.107:0/1173169820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ece800 msgr2=0x560a43ed0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:28.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ece800 0x560a43ed0dd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5de0097140 tx=0x7f5de009adc0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 -- 172.21.15.107:0/1173169820 shutdown_connections 2023-08-10T11:07:28.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x560a43f3c8c0 0x560a43f3ece0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560a43ed4870 0x560a43ecfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560a43ece800 0x560a43ed0dd0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 --2- 172.21.15.107:0/1173169820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a43ed3f50 0x560a43ed1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5dd5ffb700 0 client.16908 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:07:28.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 -- 172.21.15.107:0/1173169820 >> 172.21.15.107:0/1173169820 conn(0x560a43e2bcd0 msgr2=0x560a43ed33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:28.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 -- 172.21.15.107:0/1173169820 shutdown_connections 2023-08-10T11:07:28.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.169+0000 7f5e08400b80 1 -- 172.21.15.107:0/1173169820 wait complete. 2023-08-10T11:07:28.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5e08400b80 20 client.16908 trim_cache size 0 max 16384 2023-08-10T11:07:28.179 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:07:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:07:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:07:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:07:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:07:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:07:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:07:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:07:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:07:28.180 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:07:28.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 -- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5dd80a1340 msgr2=0x7f5dd80a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:28.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5dd80a1340 0x7f5dd80a3800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5df019e410 tx=0x7f5de4009310 comp rx=0 tx=0).stop 2023-08-10T11:07:28.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 -- 172.21.15.107:0/2208768025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 msgr2=0x7f5df019ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:28.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 0x7f5df019ce00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009810 tx=0x7f5de000fa00 comp rx=0 tx=0).stop 2023-08-10T11:07:28.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 -- 172.21.15.107:0/2208768025 shutdown_connections 2023-08-10T11:07:28.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5dd80a1340 0x7f5dd80a3800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5df01116f0 0x7f5df01a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5df0072b10 0x7f5df019ce00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 --2- 172.21.15.107:0/2208768025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5df0073430 0x7f5df019d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:28.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.170+0000 7f5df49ff700 1 -- 172.21.15.107:0/2208768025 >> 172.21.15.107:0/2208768025 conn(0x7f5df00fc1d0 msgr2=0x7f5df00fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:28.182 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.171+0000 7f5df49ff700 1 -- 172.21.15.107:0/2208768025 shutdown_connections 2023-08-10T11:07:28.183 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:28.171+0000 7f5df49ff700 1 -- 172.21.15.107:0/2208768025 wait complete. 2023-08-10T11:07:28.192 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:07:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:27 smithi157 ceph-mon[129604]: pgmap v508: 129 pgs: 129 active+clean; 16 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-08-10T11:07:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:29 smithi195 ceph-mon[129938]: pgmap v509: 129 pgs: 129 active+clean; 16 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-08-10T11:07:30.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:29 smithi157 ceph-mon[129604]: pgmap v509: 129 pgs: 129 active+clean; 16 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-08-10T11:07:30.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:29 smithi107 ceph-mon[127953]: pgmap v509: 129 pgs: 129 active+clean; 16 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-08-10T11:07:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:31 smithi195 ceph-mon[129938]: pgmap v510: 129 pgs: 129 active+clean; 16 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 14 op/s 2023-08-10T11:07:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:31 smithi157 ceph-mon[129604]: pgmap v510: 129 pgs: 129 active+clean; 16 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 14 op/s 2023-08-10T11:07:32.697 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:31 smithi107 ceph-mon[127953]: pgmap v510: 129 pgs: 129 active+clean; 16 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 14 op/s 2023-08-10T11:07:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:33 smithi195 ceph-mon[129938]: pgmap v511: 129 pgs: 129 active+clean; 16 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 14 op/s 2023-08-10T11:07:34.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:33 smithi157 ceph-mon[129604]: pgmap v511: 129 pgs: 129 active+clean; 16 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 14 op/s 2023-08-10T11:07:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:33 smithi107 ceph-mon[127953]: pgmap v511: 129 pgs: 129 active+clean; 16 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 14 op/s 2023-08-10T11:07:36.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:35 smithi195 ceph-mon[129938]: pgmap v512: 129 pgs: 129 active+clean; 16 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:07:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:35 smithi157 ceph-mon[129604]: pgmap v512: 129 pgs: 129 active+clean; 16 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:07:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:35 smithi107 ceph-mon[127953]: pgmap v512: 129 pgs: 129 active+clean; 16 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 21 op/s 2023-08-10T11:07:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:37 smithi157 ceph-mon[129604]: pgmap v513: 129 pgs: 129 active+clean; 16 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 14 op/s 2023-08-10T11:07:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:37 smithi107 ceph-mon[127953]: pgmap v513: 129 pgs: 129 active+clean; 16 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 14 op/s 2023-08-10T11:07:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:37 smithi195 ceph-mon[129938]: pgmap v513: 129 pgs: 129 active+clean; 16 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 14 op/s 2023-08-10T11:07:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:39 smithi157 ceph-mon[129604]: pgmap v514: 129 pgs: 129 active+clean; 16 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-08-10T11:07:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:39 smithi107 ceph-mon[127953]: pgmap v514: 129 pgs: 129 active+clean; 16 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-08-10T11:07:40.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:39 smithi195 ceph-mon[129938]: pgmap v514: 129 pgs: 129 active+clean; 16 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 MiB/s wr, 20 op/s 2023-08-10T11:07:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:41 smithi157 ceph-mon[129604]: pgmap v515: 129 pgs: 129 active+clean; 16 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 15 op/s 2023-08-10T11:07:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:41 smithi107 ceph-mon[127953]: pgmap v515: 129 pgs: 129 active+clean; 16 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 15 op/s 2023-08-10T11:07:42.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:41 smithi195 ceph-mon[129938]: pgmap v515: 129 pgs: 129 active+clean; 16 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 15 op/s 2023-08-10T11:07:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:43 smithi157 ceph-mon[129604]: pgmap v516: 129 pgs: 129 active+clean; 16 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 14 op/s 2023-08-10T11:07:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:43 smithi107 ceph-mon[127953]: pgmap v516: 129 pgs: 129 active+clean; 16 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 14 op/s 2023-08-10T11:07:44.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:43 smithi195 ceph-mon[129938]: pgmap v516: 129 pgs: 129 active+clean; 16 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 14 op/s 2023-08-10T11:07:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:45 smithi157 ceph-mon[129604]: pgmap v517: 129 pgs: 129 active+clean; 16 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:07:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:45 smithi107 ceph-mon[127953]: pgmap v517: 129 pgs: 129 active+clean; 16 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:07:46.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:45 smithi195 ceph-mon[129938]: pgmap v517: 129 pgs: 129 active+clean; 16 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:07:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:47 smithi157 ceph-mon[129604]: pgmap v518: 129 pgs: 129 active+clean; 16 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 19 MiB/s wr, 17 op/s 2023-08-10T11:07:48.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:47 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:07:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:47 smithi107 ceph-mon[127953]: pgmap v518: 129 pgs: 129 active+clean; 16 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 19 MiB/s wr, 17 op/s 2023-08-10T11:07:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:47 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:07:48.428 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:47 smithi195 ceph-mon[129938]: pgmap v518: 129 pgs: 129 active+clean; 16 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 19 MiB/s wr, 17 op/s 2023-08-10T11:07:48.428 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:47 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:07:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:49 smithi157 ceph-mon[129604]: pgmap v519: 129 pgs: 129 active+clean; 16 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:07:50.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:49 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:07:50.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:49 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:07:50.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:49 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:07:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:49 smithi107 ceph-mon[127953]: pgmap v519: 129 pgs: 129 active+clean; 16 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:07:50.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:49 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:07:50.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:49 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:07:50.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:49 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:07:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:49 smithi195 ceph-mon[129938]: pgmap v519: 129 pgs: 129 active+clean; 16 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 23 op/s 2023-08-10T11:07:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:49 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:07:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:49 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:07:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:49 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:07:51.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:50 smithi157 ceph-mon[129604]: pgmap v520: 129 pgs: 129 active+clean; 16 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 19 MiB/s wr, 18 op/s 2023-08-10T11:07:51.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:50 smithi107 ceph-mon[127953]: pgmap v520: 129 pgs: 129 active+clean; 16 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 19 MiB/s wr, 18 op/s 2023-08-10T11:07:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:50 smithi195 ceph-mon[129938]: pgmap v520: 129 pgs: 129 active+clean; 16 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 19 MiB/s wr, 18 op/s 2023-08-10T11:07:54.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:53 smithi157 ceph-mon[129604]: pgmap v521: 129 pgs: 129 active+clean; 16 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 MiB/s wr, 17 op/s 2023-08-10T11:07:54.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:53 smithi107 ceph-mon[127953]: pgmap v521: 129 pgs: 129 active+clean; 16 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 MiB/s wr, 17 op/s 2023-08-10T11:07:54.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:53 smithi195 ceph-mon[129938]: pgmap v521: 129 pgs: 129 active+clean; 16 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 MiB/s wr, 17 op/s 2023-08-10T11:07:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:55 smithi195 ceph-mon[129938]: pgmap v522: 129 pgs: 129 active+clean; 16 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 27 MiB/s wr, 61 op/s 2023-08-10T11:07:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:55 smithi157 ceph-mon[129604]: pgmap v522: 129 pgs: 129 active+clean; 16 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 27 MiB/s wr, 61 op/s 2023-08-10T11:07:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:55 smithi107 ceph-mon[127953]: pgmap v522: 129 pgs: 129 active+clean; 16 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 27 MiB/s wr, 61 op/s 2023-08-10T11:07:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:57 smithi195 ceph-mon[129938]: pgmap v523: 129 pgs: 129 active+clean; 16 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 51 op/s 2023-08-10T11:07:58.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-08-10T11:07:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:57 smithi157 ceph-mon[129604]: pgmap v523: 129 pgs: 129 active+clean; 16 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 51 op/s 2023-08-10T11:07:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:57 smithi107 ceph-mon[127953]: pgmap v523: 129 pgs: 129 active+clean; 16 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 51 op/s 2023-08-10T11:07:59.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.918+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/3516812893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 msgr2=0x7f0ff8100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:59.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.918+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/3516812893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 0x7f0ff8100b60 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0098f0 tx=0x7f0fec009c00 comp rx=0 tx=0).stop 2023-08-10T11:07:59.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.918+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/3516812893 shutdown_connections 2023-08-10T11:07:59.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.918+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/3516812893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff81066f0 0x7f0ff8106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.918+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/3516812893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ff81010a0 0x7f0ff810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.918+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/3516812893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 0x7f0ff8100b60 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.918+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/3516812893 >> 172.21.15.107:0/3516812893 conn(0x7f0ff80fc1d0 msgr2=0x7f0ff80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:59.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.918+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/3516812893 shutdown_connections 2023-08-10T11:07:59.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.919+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/3516812893 wait complete. 2023-08-10T11:07:59.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.920+0000 7f0ffe7ff700 1 Processor -- start 2023-08-10T11:07:59.923 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.920+0000 7f0ffe7ff700 1 -- start start 2023-08-10T11:07:59.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.920+0000 7f0ffe7ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 0x7f0ff819e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.920+0000 7f0ffe7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff81010a0 0x7f0ff819ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.920+0000 7f0ffe7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ff81066f0 0x7f0ff8198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.920+0000 7f0ffe7ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8198df0 con 0x7f0ff81006e0 2023-08-10T11:07:59.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.920+0000 7f0ffe7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8198f60 con 0x7f0ff81010a0 2023-08-10T11:07:59.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.920+0000 7f0ffe7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8199120 con 0x7f0ff81066f0 2023-08-10T11:07:59.924 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 0x7f0ff819e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff81010a0 0x7f0ff819ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 0x7f0ff819e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44222/0 (socket says 172.21.15.107:44222) 2023-08-10T11:07:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff81010a0 0x7f0ff819ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38290/0 (socket says 172.21.15.107:38290) 2023-08-10T11:07:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff7fff700 1 -- 172.21.15.107:0/102323408 learned_addr learned my addr 172.21.15.107:0/102323408 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ffcd9c700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ff81066f0 0x7f0ff8198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff77fe700 1 -- 172.21.15.107:0/102323408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ff81066f0 msgr2=0x7f0ff8198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ff81066f0 0x7f0ff8198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff77fe700 1 -- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 msgr2=0x7f0ff819e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 0x7f0ff819e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff77fe700 1 -- 172.21.15.107:0/102323408 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec009520 con 0x7f0ff81010a0 2023-08-10T11:07:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.921+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 0x7f0ff819e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:07:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.922+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff81010a0 0x7f0ff819ec50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009810 tx=0x7f0fec00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.922+0000 7f0ff57fa700 1 -- 172.21.15.107:0/102323408 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec01c070 con 0x7f0ff81010a0 2023-08-10T11:07:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.922+0000 7f0ff57fa700 1 -- 172.21.15.107:0/102323408 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fec00ba70 con 0x7f0ff81010a0 2023-08-10T11:07:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.922+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/102323408 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff81993a0 con 0x7f0ff81010a0 2023-08-10T11:07:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.922+0000 7f0ff57fa700 1 -- 172.21.15.107:0/102323408 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0038e0 con 0x7f0ff81010a0 2023-08-10T11:07:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.922+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/102323408 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff81a5700 con 0x7f0ff81010a0 2023-08-10T11:07:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.925+0000 7f0ff57fa700 1 -- 172.21.15.107:0/102323408 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0fec020030 con 0x7f0ff81010a0 2023-08-10T11:07:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.927+0000 7f0ff57fa700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0fe00a12c0 0x7f0fe00a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.927+0000 7f1012052b80 1 Processor -- start 2023-08-10T11:07:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.927+0000 7f0ff57fa700 1 -- 172.21.15.107:0/102323408 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f0fec0cddf0 con 0x7f0ff81010a0 2023-08-10T11:07:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.927+0000 7f1012052b80 1 -- start start 2023-08-10T11:07:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.927+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0fe00a12c0 0x7f0fe00a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.929 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f1012052b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 0x55fa5730a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f1012052b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa5730a870 0x55fa573042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f1012052b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 0x55fa57304c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f1012052b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5727fdc0 con 0x55fa57304800 2023-08-10T11:07:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f1012052b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5725c590 con 0x55fa5730a870 2023-08-10T11:07:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f1012052b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa57259eb0 con 0x55fa57309f50 2023-08-10T11:07:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 0x55fa5730a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.930 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa5730a870 0x55fa573042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 0x55fa5730a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:50338/0 (socket says 172.21.15.107:50338) 2023-08-10T11:07:59.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f0ffcd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 0x55fa57304c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.931 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f0ff7fff700 1 -- 172.21.15.107:0/360350693 learned_addr learned my addr 172.21.15.107:0/360350693 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f0ff77fe700 1 -- 172.21.15.107:0/360350693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 msgr2=0x55fa5730a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0fe00a12c0 0x7f0fe00a3780 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8005950 tx=0x7f0fe8009310 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.928+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/360350693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 0x55fa5730a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.929+0000 7f0ff77fe700 1 -- 172.21.15.107:0/360350693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 msgr2=0x55fa57304c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.929+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/360350693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 0x55fa57304c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.929+0000 7f0ff77fe700 1 -- 172.21.15.107:0/360350693 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa570d6630 con 0x55fa5730a870 2023-08-10T11:07:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.929+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/360350693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa5730a870 0x55fa573042c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0cb190 tx=0x7f0fec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd55be6adb3d3f74 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.929+0000 7f0fde7fc700 1 -- 172.21.15.107:0/360350693 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec09aba0 con 0x55fa5730a870 2023-08-10T11:07:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.929+0000 7f0fde7fc700 1 -- 172.21.15.107:0/360350693 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fec0ba040 con 0x55fa5730a870 2023-08-10T11:07:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.929+0000 7f0fde7fc700 1 -- 172.21.15.107:0/360350693 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec097470 con 0x55fa5730a870 2023-08-10T11:07:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.930+0000 7f1012052b80 1 -- 172.21.15.107:0/360350693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa5730a870 msgr2=0x55fa573042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.930+0000 7f1012052b80 1 --2- 172.21.15.107:0/360350693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa5730a870 0x55fa573042c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0cb190 tx=0x7f0fec009c00 comp rx=0 tx=0).stop 2023-08-10T11:07:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.930+0000 7f1012052b80 1 -- 172.21.15.107:0/360350693 shutdown_connections 2023-08-10T11:07:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.930+0000 7f1012052b80 1 --2- 172.21.15.107:0/360350693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 0x55fa57304c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.930+0000 7f1012052b80 1 --2- 172.21.15.107:0/360350693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 0x55fa5730a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.930+0000 7f1012052b80 1 --2- 172.21.15.107:0/360350693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa5730a870 0x55fa573042c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.930+0000 7f1012052b80 1 -- 172.21.15.107:0/360350693 >> 172.21.15.107:0/360350693 conn(0x55fa57261cd0 msgr2=0x55fa572ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.930+0000 7f1012052b80 1 -- 172.21.15.107:0/360350693 shutdown_connections 2023-08-10T11:07:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.930+0000 7f1012052b80 1 -- 172.21.15.107:0/360350693 wait complete. 2023-08-10T11:07:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.931+0000 7f1012052b80 1 -- start start 2023-08-10T11:07:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.931+0000 7f1012052b80 1 Processor -- start 2023-08-10T11:07:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f1012052b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa57310850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f1012052b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57309f50 0x55fa5730da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.937 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f1012052b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa5730e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f1012052b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa572557a0 con 0x55fa57309f50 2023-08-10T11:07:59.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f1012052b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa571f4ac0 con 0x55fa57304800 2023-08-10T11:07:59.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f1012052b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa571f47c0 con 0x55fa5730a870 2023-08-10T11:07:59.938 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f1012052b80 10 client.0 _ll_register_callbacks cb 0x55fa571f2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:07:59.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa57310850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f0ffcd9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa5730e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57309f50 0x55fa5730da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.939 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f0ffcd9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa5730e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:50342/0 (socket says 172.21.15.107:50342) 2023-08-10T11:07:59.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f0ffcd9c700 1 -- 172.21.15.107:0/308456465 learned_addr learned my addr 172.21.15.107:0/308456465 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:59.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f0ff77fe700 1 -- 172.21.15.107:0/308456465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 msgr2=0x55fa5730e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:59.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa5730e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.940 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f0ff77fe700 1 -- 172.21.15.107:0/308456465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 msgr2=0x55fa57310850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:59.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.932+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa57310850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f0ff77fe700 1 -- 172.21.15.107:0/308456465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff81a5700 con 0x55fa57309f50 2023-08-10T11:07:59.941 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f0ffcd9c700 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa5730e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:07:59.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57309f50 0x55fa5730da60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0cb1c0 tx=0x7f0fec097560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963ec3790c2dd1a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:59.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f0fd77fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2023-08-10T11:07:59.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f0fd77fe700 1 -- 172.21.15.107:0/308456465 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0cb620 con 0x55fa57309f50 2023-08-10T11:07:59.942 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f1012052b80 1 -- 172.21.15.107:0/308456465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa572f7470 con 0x55fa57309f50 2023-08-10T11:07:59.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f0fd77fe700 1 -- 172.21.15.107:0/308456465 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f0fec09aba0 con 0x55fa57309f50 2023-08-10T11:07:59.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f0fd77fe700 1 -- 172.21.15.107:0/308456465 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fec0a2f60 con 0x55fa57309f50 2023-08-10T11:07:59.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f1012052b80 10 client.16920 fetch_fsmap learned FSMap version 63 2023-08-10T11:07:59.943 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f1012052b80 1 -- 172.21.15.107:0/308456465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55fa57082de0 con 0x55fa57309f50 2023-08-10T11:07:59.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.933+0000 7f0fd77fe700 1 -- 172.21.15.107:0/308456465 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fa572f7470 con 0x55fa57309f50 2023-08-10T11:07:59.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.934+0000 7f0fd77fe700 1 -- 172.21.15.107:0/308456465 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0fec00b5e0 con 0x55fa57309f50 2023-08-10T11:07:59.944 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.934+0000 7f1012052b80 10 client.16920 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:07:59.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.934+0000 7f1012052b80 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:07:59.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.934+0000 7f1012052b80 20 client.16920 populate_metadata read hostname 'smithi107' 2023-08-10T11:07:59.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.934+0000 7f1012052b80 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fa5731d9b0 0x55fa5731fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.945 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.934+0000 7f1012052b80 4 client.16920 mds_command: new command op to 24575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T11:07:59.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.934+0000 7f1012052b80 1 -- 172.21.15.107:0/308456465 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa572d39d0 con 0x55fa5731d9b0 2023-08-10T11:07:59.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.934+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fa5731d9b0 0x55fa5731fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.935+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fa5731d9b0 0x55fa5731fda0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6747709d6974f3c server_cookie=30380cb41eb47cca in_seq=0 out_seq=0 2023-08-10T11:07:59.946 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.935+0000 7f0fd77fe700 10 client.16920 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:07:59.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f0fd77fe700 1 -- 172.21.15.107:0/308456465 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55fa572d39d0 con 0x55fa5731d9b0 2023-08-10T11:07:59.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f0fd77fe700 10 client.16920 handle_command_reply: tid=0 2023-08-10T11:07:59.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 client.16920 shutdown 2023-08-10T11:07:59.948 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 -- 172.21.15.107:0/308456465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57309f50 msgr2=0x55fa5730da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:59.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57309f50 0x55fa5730da60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0cb1c0 tx=0x7f0fec097560 comp rx=0 tx=0).stop 2023-08-10T11:07:59.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 -- 172.21.15.107:0/308456465 shutdown_connections 2023-08-10T11:07:59.949 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fa5731d9b0 0x55fa5731fda0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa57310850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa5730e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 --2- 172.21.15.107:0/308456465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57309f50 0x55fa5730da60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 -- 172.21.15.107:0/308456465 >> 172.21.15.107:0/308456465 conn(0x55fa57261cd0 msgr2=0x55fa572fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f0fd77fe700 0 client.16920 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:07:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 -- 172.21.15.107:0/308456465 shutdown_connections 2023-08-10T11:07:59.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.936+0000 7f1012052b80 1 -- 172.21.15.107:0/308456465 wait complete. 2023-08-10T11:07:59.952 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.937+0000 7f1012052b80 20 client.16920 trim_cache size 0 max 16384 2023-08-10T11:07:59.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.955+0000 7f1012052b80 1 Processor -- start 2023-08-10T11:07:59.957 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.956+0000 7f1012052b80 1 -- start start 2023-08-10T11:07:59.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.956+0000 7f1012052b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa573042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.958 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.956+0000 7f1012052b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 0x55fa5730da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.956+0000 7f1012052b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5730a870 0x55fa57314e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.956+0000 7f1012052b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa570d8920 con 0x55fa5730a870 2023-08-10T11:07:59.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.956+0000 7f1012052b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa572f9a80 con 0x55fa57304800 2023-08-10T11:07:59.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.956+0000 7f1012052b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5730a330 con 0x55fa57309f50 2023-08-10T11:07:59.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.956+0000 7f0ffcd9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5730a870 0x55fa57314e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa573042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa573042c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38322/0 (socket says 172.21.15.107:38322) 2023-08-10T11:07:59.959 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff7fff700 1 -- 172.21.15.107:0/3906311614 learned_addr learned my addr 172.21.15.107:0/3906311614 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/3906311614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 0x55fa5730da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff7fff700 1 -- 172.21.15.107:0/3906311614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 msgr2=0x55fa5730da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/3906311614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 0x55fa5730da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff7fff700 1 -- 172.21.15.107:0/3906311614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5730a870 msgr2=0x55fa57314e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/3906311614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5730a870 0x55fa57314e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.960 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff7fff700 1 -- 172.21.15.107:0/3906311614 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa5706bc60 con 0x55fa57304800 2023-08-10T11:07:59.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.957+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/3906311614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa573042c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8011fd0 tx=0x7f0fe801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a62e4b2dba79ee server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:59.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.958+0000 7f0fdeffd700 1 -- 172.21.15.107:0/3906311614 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe802c070 con 0x55fa57304800 2023-08-10T11:07:59.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.958+0000 7f0fdeffd700 1 -- 172.21.15.107:0/3906311614 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fe801ce60 con 0x55fa57304800 2023-08-10T11:07:59.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.958+0000 7f0fdeffd700 1 -- 172.21.15.107:0/3906311614 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8005570 con 0x55fa57304800 2023-08-10T11:07:59.962 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.958+0000 7f1012052b80 1 -- 172.21.15.107:0/3906311614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 msgr2=0x55fa573042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:59.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.958+0000 7f1012052b80 1 --2- 172.21.15.107:0/3906311614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa573042c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8011fd0 tx=0x7f0fe801c000 comp rx=0 tx=0).stop 2023-08-10T11:07:59.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.959+0000 7f1012052b80 1 -- 172.21.15.107:0/3906311614 shutdown_connections 2023-08-10T11:07:59.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.959+0000 7f1012052b80 1 --2- 172.21.15.107:0/3906311614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57304800 0x55fa573042c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.959+0000 7f1012052b80 1 --2- 172.21.15.107:0/3906311614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5730a870 0x55fa57314e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.959+0000 7f1012052b80 1 --2- 172.21.15.107:0/3906311614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa57309f50 0x55fa5730da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.959+0000 7f1012052b80 1 -- 172.21.15.107:0/3906311614 >> 172.21.15.107:0/3906311614 conn(0x55fa57261cd0 msgr2=0x55fa5730d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:59.963 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.959+0000 7f1012052b80 1 -- 172.21.15.107:0/3906311614 shutdown_connections 2023-08-10T11:07:59.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.959+0000 7f1012052b80 1 -- 172.21.15.107:0/3906311614 wait complete. 2023-08-10T11:07:59.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.959+0000 7f1012052b80 1 -- start start 2023-08-10T11:07:59.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.959+0000 7f1012052b80 1 Processor -- start 2023-08-10T11:07:59.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.960+0000 7f1012052b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 0x55fa57306e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.960+0000 7f1012052b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57309f50 0x55fa57307380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.960+0000 7f1012052b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa57305a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.964 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.960+0000 7f1012052b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa57306170 con 0x55fa57304800 2023-08-10T11:07:59.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.960+0000 7f1012052b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa573062e0 con 0x55fa57309f50 2023-08-10T11:07:59.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.960+0000 7f1012052b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa573064a0 con 0x55fa5730a870 2023-08-10T11:07:59.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.960+0000 7f1012052b80 10 client.0 _ll_register_callbacks cb 0x55fa571f2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T11:07:59.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.960+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57309f50 0x55fa57307380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.960+0000 7f0ff7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 0x55fa57306e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57309f50 0x55fa57307380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:38338/0 (socket says 172.21.15.107:38338) 2023-08-10T11:07:59.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ff77fe700 1 -- 172.21.15.107:0/1338755060 learned_addr learned my addr 172.21.15.107:0/1338755060 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:07:59.965 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ffcd9c700 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa57305a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ff77fe700 1 -- 172.21.15.107:0/1338755060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 msgr2=0x55fa57305a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:59.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa57305a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.967 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ff77fe700 1 -- 172.21.15.107:0/1338755060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 msgr2=0x55fa57306e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T11:07:59.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 0x55fa57306e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ff77fe700 1 -- 172.21.15.107:0/1338755060 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe8021040 con 0x55fa57309f50 2023-08-10T11:07:59.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 0x55fa57306e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:07:59.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0ff77fe700 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57309f50 0x55fa57307380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0fec005c10 tx=0x7f0fec0b3350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54278aa60f6262e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:07:59.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0fd77fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-08-10T11:07:59.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0fd77fe700 1 -- 172.21.15.107:0/1338755060 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0052e0 con 0x55fa57309f50 2023-08-10T11:07:59.968 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f0fd77fe700 1 -- 172.21.15.107:0/1338755060 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f0fec09aba0 con 0x55fa57309f50 2023-08-10T11:07:59.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.961+0000 7f1012052b80 1 -- 172.21.15.107:0/1338755060 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fec0ba040 con 0x55fa57309f50 2023-08-10T11:07:59.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f0fd77fe700 1 -- 172.21.15.107:0/1338755060 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fec0cb620 con 0x55fa57309f50 2023-08-10T11:07:59.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f1012052b80 10 client.26579 fetch_fsmap learned FSMap version 63 2023-08-10T11:07:59.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f1012052b80 1 -- 172.21.15.107:0/1338755060 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55fa570a9250 con 0x55fa57309f50 2023-08-10T11:07:59.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f0fd77fe700 1 -- 172.21.15.107:0/1338755060 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fec0ba040 con 0x55fa57309f50 2023-08-10T11:07:59.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f0fd77fe700 1 -- 172.21.15.107:0/1338755060 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 63) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0fec09a090 con 0x55fa57309f50 2023-08-10T11:07:59.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f1012052b80 10 client.26579 fetch_fsmap finished waiting for FSMap version 63 2023-08-10T11:07:59.969 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f1012052b80 10 client.26579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-08-10T11:07:59.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f1012052b80 20 client.26579 populate_metadata read hostname 'smithi107' 2023-08-10T11:07:59.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f1012052b80 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fa57372290 0x55fa57374680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:07:59.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f1012052b80 4 client.26579 mds_command: new command op to 24575 tid=0[{"prefix": "scrub status"}] 2023-08-10T11:07:59.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.962+0000 7f1012052b80 1 -- 172.21.15.107:0/1338755060 --> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fa5724e780 con 0x55fa57372290 2023-08-10T11:07:59.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.963+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fa57372290 0x55fa57374680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:07:59.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.963+0000 7f0ff7fff700 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fa57372290 0x55fa57374680 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c61ff3d69f069b38 server_cookie=61de9c313447e5cc in_seq=0 out_seq=0 2023-08-10T11:07:59.970 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.963+0000 7f0fd77fe700 10 client.26579 ms_handle_connect on v2:172.21.15.157:6838/2476404740 2023-08-10T11:07:59.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.963+0000 7f0fd77fe700 1 -- 172.21.15.107:0/1338755060 <== mds.0 v2:172.21.15.157:6838/2476404740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fa5724e780 con 0x55fa57372290 2023-08-10T11:07:59.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.963+0000 7f0fd77fe700 10 client.26579 handle_command_reply: tid=0 2023-08-10T11:07:59.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.963+0000 7f1012052b80 1 client.26579 shutdown 2023-08-10T11:07:59.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 -- 172.21.15.107:0/1338755060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57309f50 msgr2=0x55fa57307380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:59.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57309f50 0x55fa57307380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0fec005c10 tx=0x7f0fec0b3350 comp rx=0 tx=0).stop 2023-08-10T11:07:59.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 -- 172.21.15.107:0/1338755060 shutdown_connections 2023-08-10T11:07:59.971 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.157:6838/2476404740,v1:172.21.15.157:6839/2476404740] conn(0x55fa57372290 0x55fa57374680 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa5730a870 0x55fa57305a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa57304800 0x55fa57306e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 --2- 172.21.15.107:0/1338755060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fa57309f50 0x55fa57307380 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 -- 172.21.15.107:0/1338755060 >> 172.21.15.107:0/1338755060 conn(0x55fa57261cd0 msgr2=0x55fa5730ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:59.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f0fd77fe700 0 client.26579 ms_handle_reset on v2:172.21.15.157:6838/2476404740 2023-08-10T11:07:59.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 -- 172.21.15.107:0/1338755060 shutdown_connections 2023-08-10T11:07:59.972 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 1 -- 172.21.15.107:0/1338755060 wait complete. 2023-08-10T11:07:59.973 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.964+0000 7f1012052b80 20 client.26579 trim_cache size 0 max 16384 2023-08-10T11:07:59.973 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:07:59.973 INFO:teuthology.orchestra.run.smithi107.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-10T11:07:59.973 INFO:teuthology.orchestra.run.smithi107.stdout: "scrubs": { 2023-08-10T11:07:59.973 INFO:teuthology.orchestra.run.smithi107.stdout: "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4": { 2023-08-10T11:07:59.974 INFO:teuthology.orchestra.run.smithi107.stdout: "path": "/", 2023-08-10T11:07:59.974 INFO:teuthology.orchestra.run.smithi107.stdout: "tag": "4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4", 2023-08-10T11:07:59.974 INFO:teuthology.orchestra.run.smithi107.stdout: "options": "recursive,force" 2023-08-10T11:07:59.974 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:07:59.974 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:07:59.974 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:07:59.975 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0fe00a12c0 msgr2=0x7f0fe00a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:59.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0fe00a12c0 0x7f0fe00a3780 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8005950 tx=0x7f0fe8009310 comp rx=0 tx=0).stop 2023-08-10T11:07:59.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/102323408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff81010a0 msgr2=0x7f0ff819ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:07:59.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff81010a0 0x7f0ff819ec50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009810 tx=0x7f0fec00fa00 comp rx=0 tx=0).stop 2023-08-10T11:07:59.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/102323408 shutdown_connections 2023-08-10T11:07:59.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ff81066f0 0x7f0ff8198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0ff81006e0 0x7f0ff819e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.976 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0fe00a12c0 0x7f0fe00a3780 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 --2- 172.21.15.107:0/102323408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ff81010a0 0x7f0ff819ec50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:07:59.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/102323408 >> 172.21.15.107:0/102323408 conn(0x7f0ff80fc1d0 msgr2=0x7f0ff810bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:07:59.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/102323408 shutdown_connections 2023-08-10T11:07:59.977 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:07:59.965+0000 7f0ffe7ff700 1 -- 172.21.15.107:0/102323408 wait complete. 2023-08-10T11:07:59.984 INFO:tasks.cephfs.filesystem:scrub status for tag:4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4 - {'path': '/', 'tag': '4d1c2d1c-d0a8-47c1-9c6b-9ca2937503d4', 'options': 'recursive,force'} 2023-08-10T11:07:59.984 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephfs/filesystem.py", line 1686, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2023-08-10T11:08:00.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:07:59 smithi195 ceph-mon[129938]: pgmap v524: 129 pgs: 129 active+clean; 16 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 MiB/s wr, 110 op/s 2023-08-10T11:08:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:07:59 smithi157 ceph-mon[129604]: pgmap v524: 129 pgs: 129 active+clean; 16 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 MiB/s wr, 110 op/s 2023-08-10T11:08:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:07:59 smithi107 ceph-mon[127953]: pgmap v524: 129 pgs: 129 active+clean; 16 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 MiB/s wr, 110 op/s 2023-08-10T11:08:02.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:01 smithi195 ceph-mon[129938]: pgmap v525: 129 pgs: 129 active+clean; 16 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 21 MiB/s wr, 114 op/s 2023-08-10T11:08:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:01 smithi157 ceph-mon[129604]: pgmap v525: 129 pgs: 129 active+clean; 16 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 21 MiB/s wr, 114 op/s 2023-08-10T11:08:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:01 smithi107 ceph-mon[127953]: pgmap v525: 129 pgs: 129 active+clean; 16 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 21 MiB/s wr, 114 op/s 2023-08-10T11:08:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:03 smithi195 ceph-mon[129938]: pgmap v526: 129 pgs: 129 active+clean; 16 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 20 MiB/s wr, 112 op/s 2023-08-10T11:08:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:03 smithi157 ceph-mon[129604]: pgmap v526: 129 pgs: 129 active+clean; 16 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 20 MiB/s wr, 112 op/s 2023-08-10T11:08:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:03 smithi107 ceph-mon[127953]: pgmap v526: 129 pgs: 129 active+clean; 16 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 20 MiB/s wr, 112 op/s 2023-08-10T11:08:06.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:05 smithi195 ceph-mon[129938]: pgmap v527: 129 pgs: 129 active+clean; 17 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 32 MiB/s wr, 202 op/s 2023-08-10T11:08:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:05 smithi157 ceph-mon[129604]: pgmap v527: 129 pgs: 129 active+clean; 17 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 32 MiB/s wr, 202 op/s 2023-08-10T11:08:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:05 smithi107 ceph-mon[127953]: pgmap v527: 129 pgs: 129 active+clean; 17 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 32 MiB/s wr, 202 op/s 2023-08-10T11:08:08.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:07 smithi157 ceph-mon[129604]: pgmap v528: 129 pgs: 129 active+clean; 17 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 24 MiB/s wr, 158 op/s 2023-08-10T11:08:08.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:07 smithi107 ceph-mon[127953]: pgmap v528: 129 pgs: 129 active+clean; 17 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 24 MiB/s wr, 158 op/s 2023-08-10T11:08:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:07 smithi195 ceph-mon[129938]: pgmap v528: 129 pgs: 129 active+clean; 17 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 24 MiB/s wr, 158 op/s 2023-08-10T11:08:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:08 smithi157 ceph-mon[129604]: osdmap e113: 12 total, 12 up, 12 in 2023-08-10T11:08:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:08 smithi107 ceph-mon[127953]: osdmap e113: 12 total, 12 up, 12 in 2023-08-10T11:08:09.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:08 smithi195 ceph-mon[129938]: osdmap e113: 12 total, 12 up, 12 in 2023-08-10T11:08:10.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:09 smithi157 ceph-mon[129604]: pgmap v530: 129 pgs: 15 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 63 active+clean; 16 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 27 MiB/s wr, 184 op/s 2023-08-10T11:08:10.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:09 smithi107 ceph-mon[127953]: pgmap v530: 129 pgs: 15 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 63 active+clean; 16 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 27 MiB/s wr, 184 op/s 2023-08-10T11:08:10.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:09 smithi195 ceph-mon[129938]: pgmap v530: 129 pgs: 15 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 63 active+clean; 16 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 27 MiB/s wr, 184 op/s 2023-08-10T11:08:12.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:11 smithi157 ceph-mon[129604]: pgmap v531: 129 pgs: 16 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 179 op/s 2023-08-10T11:08:12.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:11 smithi107 ceph-mon[127953]: pgmap v531: 129 pgs: 16 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 179 op/s 2023-08-10T11:08:12.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:11 smithi195 ceph-mon[129938]: pgmap v531: 129 pgs: 16 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 179 op/s 2023-08-10T11:08:14.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:13 smithi157 ceph-mon[129604]: pgmap v532: 129 pgs: 16 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 179 op/s 2023-08-10T11:08:14.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:13 smithi107 ceph-mon[127953]: pgmap v532: 129 pgs: 16 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 179 op/s 2023-08-10T11:08:14.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:13 smithi195 ceph-mon[129938]: pgmap v532: 129 pgs: 16 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 179 op/s 2023-08-10T11:08:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:15 smithi157 ceph-mon[129604]: pgmap v533: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 26 MiB/s wr, 137 op/s 2023-08-10T11:08:16.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:15 smithi107 ceph-mon[127953]: pgmap v533: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 26 MiB/s wr, 137 op/s 2023-08-10T11:08:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:15 smithi195 ceph-mon[129938]: pgmap v533: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 26 MiB/s wr, 137 op/s 2023-08-10T11:08:17.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:16 smithi157 ceph-mon[129604]: pgmap v534: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 26 MiB/s wr, 137 op/s 2023-08-10T11:08:17.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:16 smithi107 ceph-mon[127953]: pgmap v534: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 26 MiB/s wr, 137 op/s 2023-08-10T11:08:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:16 smithi195 ceph-mon[129938]: pgmap v534: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 26 MiB/s wr, 137 op/s 2023-08-10T11:08:19.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:18 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:08:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:18 smithi157 ceph-mon[129604]: pgmap v535: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 29 MiB/s wr, 167 op/s 2023-08-10T11:08:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:18 smithi157 ceph-mon[129604]: osdmap e114: 12 total, 12 up, 12 in 2023-08-10T11:08:19.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:18 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:08:19.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:18 smithi107 ceph-mon[127953]: pgmap v535: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 29 MiB/s wr, 167 op/s 2023-08-10T11:08:19.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:18 smithi107 ceph-mon[127953]: osdmap e114: 12 total, 12 up, 12 in 2023-08-10T11:08:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:18 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:08:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:18 smithi195 ceph-mon[129938]: pgmap v535: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 29 MiB/s wr, 167 op/s 2023-08-10T11:08:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:18 smithi195 ceph-mon[129938]: osdmap e114: 12 total, 12 up, 12 in 2023-08-10T11:08:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:21 smithi157 ceph-mon[129604]: pgmap v537: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 19 MiB/s wr, 123 op/s 2023-08-10T11:08:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:21 smithi107 ceph-mon[127953]: pgmap v537: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 19 MiB/s wr, 123 op/s 2023-08-10T11:08:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:21 smithi195 ceph-mon[129938]: pgmap v537: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 19 MiB/s wr, 123 op/s 2023-08-10T11:08:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:23 smithi157 ceph-mon[129604]: pgmap v538: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 19 MiB/s wr, 123 op/s 2023-08-10T11:08:24.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:23 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:08:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:23 smithi107 ceph-mon[127953]: pgmap v538: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 19 MiB/s wr, 123 op/s 2023-08-10T11:08:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:23 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:08:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:23 smithi195 ceph-mon[129938]: pgmap v538: 129 pgs: 129 active+clean; 16 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 19 MiB/s wr, 123 op/s 2023-08-10T11:08:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:23 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:08:26.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:25 smithi195 ceph-mon[129938]: pgmap v539: 129 pgs: 129 active+clean; 17 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 19 MiB/s wr, 111 op/s 2023-08-10T11:08:26.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:25 smithi157 ceph-mon[129604]: pgmap v539: 129 pgs: 129 active+clean; 17 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 19 MiB/s wr, 111 op/s 2023-08-10T11:08:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:25 smithi107 ceph-mon[127953]: pgmap v539: 129 pgs: 129 active+clean; 17 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 19 MiB/s wr, 111 op/s 2023-08-10T11:08:28.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:27 smithi195 ceph-mon[129938]: pgmap v540: 129 pgs: 129 active+clean; 17 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 19 MiB/s wr, 111 op/s 2023-08-10T11:08:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:27 smithi157 ceph-mon[129604]: pgmap v540: 129 pgs: 129 active+clean; 17 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 19 MiB/s wr, 111 op/s 2023-08-10T11:08:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:27 smithi107 ceph-mon[127953]: pgmap v540: 129 pgs: 129 active+clean; 17 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 19 MiB/s wr, 111 op/s 2023-08-10T11:08:30.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:29 smithi195 ceph-mon[129938]: pgmap v541: 129 pgs: 129 active+clean; 17 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-08-10T11:08:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:29 smithi157 ceph-mon[129604]: pgmap v541: 129 pgs: 129 active+clean; 17 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-08-10T11:08:30.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:29 smithi107 ceph-mon[127953]: pgmap v541: 129 pgs: 129 active+clean; 17 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-08-10T11:08:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:31 smithi157 ceph-mon[129604]: pgmap v542: 129 pgs: 129 active+clean; 17 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 18 MiB/s wr, 88 op/s 2023-08-10T11:08:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:31 smithi107 ceph-mon[127953]: pgmap v542: 129 pgs: 129 active+clean; 17 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 18 MiB/s wr, 88 op/s 2023-08-10T11:08:32.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:31 smithi195 ceph-mon[129938]: pgmap v542: 129 pgs: 129 active+clean; 17 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 18 MiB/s wr, 88 op/s 2023-08-10T11:08:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:33 smithi157 ceph-mon[129604]: pgmap v543: 129 pgs: 129 active+clean; 17 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 17 MiB/s wr, 86 op/s 2023-08-10T11:08:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:33 smithi107 ceph-mon[127953]: pgmap v543: 129 pgs: 129 active+clean; 17 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 17 MiB/s wr, 86 op/s 2023-08-10T11:08:34.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:33 smithi195 ceph-mon[129938]: pgmap v543: 129 pgs: 129 active+clean; 17 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 17 MiB/s wr, 86 op/s 2023-08-10T11:08:36.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:35 smithi157 ceph-mon[129604]: pgmap v544: 129 pgs: 129 active+clean; 17 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 23 MiB/s wr, 130 op/s 2023-08-10T11:08:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:35 smithi107 ceph-mon[127953]: pgmap v544: 129 pgs: 129 active+clean; 17 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 23 MiB/s wr, 130 op/s 2023-08-10T11:08:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:35 smithi195 ceph-mon[129938]: pgmap v544: 129 pgs: 129 active+clean; 17 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 23 MiB/s wr, 130 op/s 2023-08-10T11:08:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:37 smithi157 ceph-mon[129604]: pgmap v545: 129 pgs: 129 active+clean; 17 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 12 MiB/s wr, 87 op/s 2023-08-10T11:08:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:37 smithi107 ceph-mon[127953]: pgmap v545: 129 pgs: 129 active+clean; 17 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 12 MiB/s wr, 87 op/s 2023-08-10T11:08:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:37 smithi195 ceph-mon[129938]: pgmap v545: 129 pgs: 129 active+clean; 17 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 12 MiB/s wr, 87 op/s 2023-08-10T11:08:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:39 smithi157 ceph-mon[129604]: pgmap v546: 129 pgs: 129 active+clean; 17 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 23 MiB/s wr, 151 op/s 2023-08-10T11:08:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:39 smithi107 ceph-mon[127953]: pgmap v546: 129 pgs: 129 active+clean; 17 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 23 MiB/s wr, 151 op/s 2023-08-10T11:08:40.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:39 smithi195 ceph-mon[129938]: pgmap v546: 129 pgs: 129 active+clean; 17 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 23 MiB/s wr, 151 op/s 2023-08-10T11:08:42.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:41 smithi157 ceph-mon[129604]: pgmap v547: 129 pgs: 129 active+clean; 17 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 17 MiB/s wr, 120 op/s 2023-08-10T11:08:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:41 smithi107 ceph-mon[127953]: pgmap v547: 129 pgs: 129 active+clean; 17 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 17 MiB/s wr, 120 op/s 2023-08-10T11:08:42.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:41 smithi195 ceph-mon[129938]: pgmap v547: 129 pgs: 129 active+clean; 17 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 17 MiB/s wr, 120 op/s 2023-08-10T11:08:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:43 smithi157 ceph-mon[129604]: pgmap v548: 129 pgs: 129 active+clean; 17 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 17 MiB/s wr, 116 op/s 2023-08-10T11:08:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:43 smithi107 ceph-mon[127953]: pgmap v548: 129 pgs: 129 active+clean; 17 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 17 MiB/s wr, 116 op/s 2023-08-10T11:08:44.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:43 smithi195 ceph-mon[129938]: pgmap v548: 129 pgs: 129 active+clean; 17 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 17 MiB/s wr, 116 op/s 2023-08-10T11:08:46.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:45 smithi157 ceph-mon[129604]: pgmap v549: 129 pgs: 129 active+clean; 17 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 29 MiB/s wr, 186 op/s 2023-08-10T11:08:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:45 smithi107 ceph-mon[127953]: pgmap v549: 129 pgs: 129 active+clean; 17 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 29 MiB/s wr, 186 op/s 2023-08-10T11:08:46.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:45 smithi195 ceph-mon[129938]: pgmap v549: 129 pgs: 129 active+clean; 17 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 29 MiB/s wr, 186 op/s 2023-08-10T11:08:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:47 smithi157 ceph-mon[129604]: pgmap v550: 129 pgs: 129 active+clean; 17 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 24 MiB/s wr, 142 op/s 2023-08-10T11:08:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:47 smithi107 ceph-mon[127953]: pgmap v550: 129 pgs: 129 active+clean; 17 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 24 MiB/s wr, 142 op/s 2023-08-10T11:08:48.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:47 smithi195 ceph-mon[129938]: pgmap v550: 129 pgs: 129 active+clean; 17 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 24 MiB/s wr, 142 op/s 2023-08-10T11:08:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:49 smithi195 ceph-mon[129938]: pgmap v551: 129 pgs: 129 active+clean; 17 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 34 MiB/s wr, 204 op/s 2023-08-10T11:08:50.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:49 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:08:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:49 smithi157 ceph-mon[129604]: pgmap v551: 129 pgs: 129 active+clean; 17 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 34 MiB/s wr, 204 op/s 2023-08-10T11:08:50.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:49 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:08:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:49 smithi107 ceph-mon[127953]: pgmap v551: 129 pgs: 129 active+clean; 17 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 34 MiB/s wr, 204 op/s 2023-08-10T11:08:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:49 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:08:52.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:51 smithi157 ceph-mon[129604]: pgmap v552: 129 pgs: 129 active+clean; 17 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 23 MiB/s wr, 143 op/s 2023-08-10T11:08:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:51 smithi107 ceph-mon[127953]: pgmap v552: 129 pgs: 129 active+clean; 17 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 23 MiB/s wr, 143 op/s 2023-08-10T11:08:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:51 smithi195 ceph-mon[129938]: pgmap v552: 129 pgs: 129 active+clean; 17 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 23 MiB/s wr, 143 op/s 2023-08-10T11:08:54.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:53 smithi157 ceph-mon[129604]: pgmap v553: 129 pgs: 129 active+clean; 17 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 22 MiB/s wr, 134 op/s 2023-08-10T11:08:54.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:53 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:08:54.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:53 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:08:54.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:53 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:08:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:53 smithi107 ceph-mon[127953]: pgmap v553: 129 pgs: 129 active+clean; 17 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 22 MiB/s wr, 134 op/s 2023-08-10T11:08:54.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:53 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:08:54.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:53 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:08:54.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:53 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:08:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:53 smithi195 ceph-mon[129938]: pgmap v553: 129 pgs: 129 active+clean; 17 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 22 MiB/s wr, 134 op/s 2023-08-10T11:08:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:53 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:08:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:53 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:08:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:53 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:08:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:55 smithi157 ceph-mon[129604]: pgmap v554: 129 pgs: 129 active+clean; 17 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 29 MiB/s wr, 190 op/s 2023-08-10T11:08:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:55 smithi107 ceph-mon[127953]: pgmap v554: 129 pgs: 129 active+clean; 17 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 29 MiB/s wr, 190 op/s 2023-08-10T11:08:56.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:55 smithi195 ceph-mon[129938]: pgmap v554: 129 pgs: 129 active+clean; 17 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 29 MiB/s wr, 190 op/s 2023-08-10T11:08:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:57 smithi157 ceph-mon[129604]: pgmap v555: 129 pgs: 129 active+clean; 17 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 17 MiB/s wr, 120 op/s 2023-08-10T11:08:58.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:57 smithi107 ceph-mon[127953]: pgmap v555: 129 pgs: 129 active+clean; 17 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 17 MiB/s wr, 120 op/s 2023-08-10T11:08:58.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:57 smithi195 ceph-mon[129938]: pgmap v555: 129 pgs: 129 active+clean; 17 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 17 MiB/s wr, 120 op/s 2023-08-10T11:09:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:08:59 smithi157 ceph-mon[129604]: pgmap v556: 129 pgs: 129 active+clean; 17 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 25 MiB/s wr, 173 op/s 2023-08-10T11:09:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:08:59 smithi107 ceph-mon[127953]: pgmap v556: 129 pgs: 129 active+clean; 17 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 25 MiB/s wr, 173 op/s 2023-08-10T11:09:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:08:59 smithi195 ceph-mon[129938]: pgmap v556: 129 pgs: 129 active+clean; 17 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 25 MiB/s wr, 173 op/s 2023-08-10T11:09:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:01 smithi157 ceph-mon[129604]: pgmap v557: 129 pgs: 129 active+clean; 17 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 18 MiB/s wr, 118 op/s 2023-08-10T11:09:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:01 smithi107 ceph-mon[127953]: pgmap v557: 129 pgs: 129 active+clean; 17 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 18 MiB/s wr, 118 op/s 2023-08-10T11:09:02.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:01 smithi195 ceph-mon[129938]: pgmap v557: 129 pgs: 129 active+clean; 17 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 18 MiB/s wr, 118 op/s 2023-08-10T11:09:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:03 smithi157 ceph-mon[129604]: pgmap v558: 129 pgs: 129 active+clean; 17 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 17 MiB/s wr, 115 op/s 2023-08-10T11:09:04.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:03 smithi107 ceph-mon[127953]: pgmap v558: 129 pgs: 129 active+clean; 17 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 17 MiB/s wr, 115 op/s 2023-08-10T11:09:04.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:03 smithi195 ceph-mon[129938]: pgmap v558: 129 pgs: 129 active+clean; 17 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 17 MiB/s wr, 115 op/s 2023-08-10T11:09:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:05 smithi157 ceph-mon[129604]: pgmap v559: 129 pgs: 129 active+clean; 17 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 20 MiB/s wr, 154 op/s 2023-08-10T11:09:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:05 smithi107 ceph-mon[127953]: pgmap v559: 129 pgs: 129 active+clean; 17 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 20 MiB/s wr, 154 op/s 2023-08-10T11:09:06.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:05 smithi195 ceph-mon[129938]: pgmap v559: 129 pgs: 129 active+clean; 17 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 20 MiB/s wr, 154 op/s 2023-08-10T11:09:07.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:06 smithi157 ceph-mon[129604]: pgmap v560: 129 pgs: 129 active+clean; 17 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 13 MiB/s wr, 98 op/s 2023-08-10T11:09:07.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:06 smithi107 ceph-mon[127953]: pgmap v560: 129 pgs: 129 active+clean; 17 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 13 MiB/s wr, 98 op/s 2023-08-10T11:09:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:06 smithi195 ceph-mon[129938]: pgmap v560: 129 pgs: 129 active+clean; 17 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 13 MiB/s wr, 98 op/s 2023-08-10T11:09:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:08 smithi157 ceph-mon[129604]: osdmap e115: 12 total, 12 up, 12 in 2023-08-10T11:09:09.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:08 smithi157 ceph-mon[129604]: pgmap v562: 129 pgs: 17 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 60 active+clean; 17 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 19 MiB/s wr, 118 op/s 2023-08-10T11:09:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:08 smithi107 ceph-mon[127953]: osdmap e115: 12 total, 12 up, 12 in 2023-08-10T11:09:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:08 smithi107 ceph-mon[127953]: pgmap v562: 129 pgs: 17 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 60 active+clean; 17 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 19 MiB/s wr, 118 op/s 2023-08-10T11:09:09.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:08 smithi195 ceph-mon[129938]: osdmap e115: 12 total, 12 up, 12 in 2023-08-10T11:09:09.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:08 smithi195 ceph-mon[129938]: pgmap v562: 129 pgs: 17 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 60 active+clean; 17 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 19 MiB/s wr, 118 op/s 2023-08-10T11:09:12.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:11 smithi157 ceph-mon[129604]: pgmap v563: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 17 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 16 MiB/s wr, 118 op/s 2023-08-10T11:09:12.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:11 smithi107 ceph-mon[127953]: pgmap v563: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 17 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 16 MiB/s wr, 118 op/s 2023-08-10T11:09:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:11 smithi195 ceph-mon[129938]: pgmap v563: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 17 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 16 MiB/s wr, 118 op/s 2023-08-10T11:09:14.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:13 smithi157 ceph-mon[129604]: pgmap v564: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 17 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 16 MiB/s wr, 118 op/s 2023-08-10T11:09:14.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:13 smithi107 ceph-mon[127953]: pgmap v564: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 17 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 16 MiB/s wr, 118 op/s 2023-08-10T11:09:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:13 smithi195 ceph-mon[129938]: pgmap v564: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 17 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 16 MiB/s wr, 118 op/s 2023-08-10T11:09:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:15 smithi157 ceph-mon[129604]: pgmap v565: 129 pgs: 129 active+clean; 17 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 26 MiB/s wr, 151 op/s 2023-08-10T11:09:16.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:15 smithi107 ceph-mon[127953]: pgmap v565: 129 pgs: 129 active+clean; 17 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 26 MiB/s wr, 151 op/s 2023-08-10T11:09:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:15 smithi195 ceph-mon[129938]: pgmap v565: 129 pgs: 129 active+clean; 17 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 26 MiB/s wr, 151 op/s 2023-08-10T11:09:18.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:17 smithi157 ceph-mon[129604]: pgmap v566: 129 pgs: 129 active+clean; 17 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 26 MiB/s wr, 151 op/s 2023-08-10T11:09:18.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:17 smithi107 ceph-mon[127953]: pgmap v566: 129 pgs: 129 active+clean; 17 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 26 MiB/s wr, 151 op/s 2023-08-10T11:09:18.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:17 smithi195 ceph-mon[129938]: pgmap v566: 129 pgs: 129 active+clean; 17 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 26 MiB/s wr, 151 op/s 2023-08-10T11:09:20.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:19 smithi157 ceph-mon[129604]: pgmap v567: 129 pgs: 129 active+clean; 17 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 36 MiB/s wr, 212 op/s 2023-08-10T11:09:20.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:19 smithi157 ceph-mon[129604]: osdmap e116: 12 total, 12 up, 12 in 2023-08-10T11:09:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:19 smithi107 ceph-mon[127953]: pgmap v567: 129 pgs: 129 active+clean; 17 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 36 MiB/s wr, 212 op/s 2023-08-10T11:09:20.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:19 smithi107 ceph-mon[127953]: osdmap e116: 12 total, 12 up, 12 in 2023-08-10T11:09:20.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:19 smithi195 ceph-mon[129938]: pgmap v567: 129 pgs: 129 active+clean; 17 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 36 MiB/s wr, 212 op/s 2023-08-10T11:09:20.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:19 smithi195 ceph-mon[129938]: osdmap e116: 12 total, 12 up, 12 in 2023-08-10T11:09:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:21 smithi157 ceph-mon[129604]: pgmap v569: 129 pgs: 129 active+clean; 17 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 26 MiB/s wr, 159 op/s 2023-08-10T11:09:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:21 smithi107 ceph-mon[127953]: pgmap v569: 129 pgs: 129 active+clean; 17 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 26 MiB/s wr, 159 op/s 2023-08-10T11:09:22.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:21 smithi195 ceph-mon[129938]: pgmap v569: 129 pgs: 129 active+clean; 17 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 26 MiB/s wr, 159 op/s 2023-08-10T11:09:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:23 smithi157 ceph-mon[129604]: pgmap v570: 129 pgs: 129 active+clean; 17 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 26 MiB/s wr, 159 op/s 2023-08-10T11:09:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:23 smithi107 ceph-mon[127953]: pgmap v570: 129 pgs: 129 active+clean; 17 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 26 MiB/s wr, 159 op/s 2023-08-10T11:09:24.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:23 smithi195 ceph-mon[129938]: pgmap v570: 129 pgs: 129 active+clean; 17 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 26 MiB/s wr, 159 op/s 2023-08-10T11:09:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:25 smithi157 ceph-mon[129604]: pgmap v571: 129 pgs: 129 active+clean; 18 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 19 MiB/s wr, 114 op/s 2023-08-10T11:09:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:25 smithi107 ceph-mon[127953]: pgmap v571: 129 pgs: 129 active+clean; 18 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 19 MiB/s wr, 114 op/s 2023-08-10T11:09:26.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:25 smithi195 ceph-mon[129938]: pgmap v571: 129 pgs: 129 active+clean; 18 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 19 MiB/s wr, 114 op/s 2023-08-10T11:09:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:27 smithi157 ceph-mon[129604]: pgmap v572: 129 pgs: 129 active+clean; 18 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 19 MiB/s wr, 114 op/s 2023-08-10T11:09:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:27 smithi107 ceph-mon[127953]: pgmap v572: 129 pgs: 129 active+clean; 18 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 19 MiB/s wr, 114 op/s 2023-08-10T11:09:28.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:27 smithi195 ceph-mon[129938]: pgmap v572: 129 pgs: 129 active+clean; 18 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 19 MiB/s wr, 114 op/s 2023-08-10T11:09:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:29 smithi157 ceph-mon[129604]: pgmap v573: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.2 MiB/s wr, 64 op/s 2023-08-10T11:09:30.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:29 smithi107 ceph-mon[127953]: pgmap v573: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.2 MiB/s wr, 64 op/s 2023-08-10T11:09:30.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:29 smithi195 ceph-mon[129938]: pgmap v573: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.2 MiB/s wr, 64 op/s 2023-08-10T11:09:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:31 smithi157 ceph-mon[129604]: pgmap v574: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.9 MiB/s wr, 54 op/s 2023-08-10T11:09:32.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:31 smithi107 ceph-mon[127953]: pgmap v574: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.9 MiB/s wr, 54 op/s 2023-08-10T11:09:32.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:31 smithi195 ceph-mon[129938]: pgmap v574: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.9 MiB/s wr, 54 op/s 2023-08-10T11:09:33.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:32 smithi157 ceph-mon[129604]: pgmap v575: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.8 MiB/s wr, 52 op/s 2023-08-10T11:09:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:32 smithi107 ceph-mon[127953]: pgmap v575: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.8 MiB/s wr, 52 op/s 2023-08-10T11:09:33.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:32 smithi195 ceph-mon[129938]: pgmap v575: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.8 MiB/s wr, 52 op/s 2023-08-10T11:09:35.370 INFO:teuthology.orchestra.run.smithi107.stderr:done. 2023-08-10T11:09:35.392 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-08-10T11:09:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:starting vacuum...end. 2023-08-10T11:09:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:35 smithi157 ceph-mon[129604]: pgmap v576: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 9.5 MiB/s wr, 63 op/s 2023-08-10T11:09:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:35 smithi107 ceph-mon[127953]: pgmap v576: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 9.5 MiB/s wr, 63 op/s 2023-08-10T11:09:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:35 smithi195 ceph-mon[129938]: pgmap v576: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 9.5 MiB/s wr, 63 op/s 2023-08-10T11:09:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:37 smithi157 ceph-mon[129604]: pgmap v577: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.3 MiB/s wr, 33 op/s 2023-08-10T11:09:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:37 smithi107 ceph-mon[127953]: pgmap v577: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.3 MiB/s wr, 33 op/s 2023-08-10T11:09:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:37 smithi195 ceph-mon[129938]: pgmap v577: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.3 MiB/s wr, 33 op/s 2023-08-10T11:09:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:39 smithi157 ceph-mon[129604]: pgmap v578: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 8.0 MiB/s wr, 87 op/s 2023-08-10T11:09:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:39 smithi107 ceph-mon[127953]: pgmap v578: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 8.0 MiB/s wr, 87 op/s 2023-08-10T11:09:40.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:39 smithi195 ceph-mon[129938]: pgmap v578: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 8.0 MiB/s wr, 87 op/s 2023-08-10T11:09:40.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 5.0 s, 667.6 tps, lat 133.891 ms stddev 191.349 2023-08-10T11:09:41.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:41 smithi157 ceph-mon[129604]: pgmap v579: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 6.1 MiB/s wr, 75 op/s 2023-08-10T11:09:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:41 smithi107 ceph-mon[127953]: pgmap v579: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 6.1 MiB/s wr, 75 op/s 2023-08-10T11:09:41.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:41 smithi195 ceph-mon[129938]: pgmap v579: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 6.1 MiB/s wr, 75 op/s 2023-08-10T11:09:44.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:43 smithi157 ceph-mon[129604]: pgmap v580: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 5.8 MiB/s wr, 73 op/s 2023-08-10T11:09:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:43 smithi107 ceph-mon[127953]: pgmap v580: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 5.8 MiB/s wr, 73 op/s 2023-08-10T11:09:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:43 smithi195 ceph-mon[129938]: pgmap v580: 129 pgs: 129 active+clean; 18 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 5.8 MiB/s wr, 73 op/s 2023-08-10T11:09:45.803 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 10.0 s, 913.6 tps, lat 108.462 ms stddev 44.237 2023-08-10T11:09:46.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:45 smithi157 ceph-mon[129604]: pgmap v581: 129 pgs: 129 active+clean; 18 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 13 MiB/s wr, 169 op/s 2023-08-10T11:09:46.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:45 smithi107 ceph-mon[127953]: pgmap v581: 129 pgs: 129 active+clean; 18 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 13 MiB/s wr, 169 op/s 2023-08-10T11:09:46.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:45 smithi195 ceph-mon[129938]: pgmap v581: 129 pgs: 129 active+clean; 18 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 13 MiB/s wr, 169 op/s 2023-08-10T11:09:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:47 smithi157 ceph-mon[129604]: pgmap v582: 129 pgs: 129 active+clean; 18 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 11 MiB/s wr, 159 op/s 2023-08-10T11:09:48.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:47 smithi107 ceph-mon[127953]: pgmap v582: 129 pgs: 129 active+clean; 18 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 11 MiB/s wr, 159 op/s 2023-08-10T11:09:48.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:47 smithi195 ceph-mon[129938]: pgmap v582: 129 pgs: 129 active+clean; 18 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 11 MiB/s wr, 159 op/s 2023-08-10T11:09:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:49 smithi157 ceph-mon[129604]: pgmap v583: 129 pgs: 129 active+clean; 18 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 15 MiB/s wr, 339 op/s 2023-08-10T11:09:50.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:49 smithi107 ceph-mon[127953]: pgmap v583: 129 pgs: 129 active+clean; 18 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 15 MiB/s wr, 339 op/s 2023-08-10T11:09:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:49 smithi195 ceph-mon[129938]: pgmap v583: 129 pgs: 129 active+clean; 18 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 15 MiB/s wr, 339 op/s 2023-08-10T11:09:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 15.0 s, 300.7 tps, lat 300.934 ms stddev 329.557 2023-08-10T11:09:52.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:51 smithi157 ceph-mon[129604]: pgmap v584: 129 pgs: 129 active+clean; 18 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 13 MiB/s wr, 319 op/s 2023-08-10T11:09:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:51 smithi107 ceph-mon[127953]: pgmap v584: 129 pgs: 129 active+clean; 18 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 13 MiB/s wr, 319 op/s 2023-08-10T11:09:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:51 smithi195 ceph-mon[129938]: pgmap v584: 129 pgs: 129 active+clean; 18 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 13 MiB/s wr, 319 op/s 2023-08-10T11:09:53.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:53 smithi157 ceph-mon[129604]: pgmap v585: 129 pgs: 129 active+clean; 18 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 13 MiB/s wr, 309 op/s 2023-08-10T11:09:53.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:53 smithi107 ceph-mon[127953]: pgmap v585: 129 pgs: 129 active+clean; 18 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 13 MiB/s wr, 309 op/s 2023-08-10T11:09:53.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:53 smithi195 ceph-mon[129938]: pgmap v585: 129 pgs: 129 active+clean; 18 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 13 MiB/s wr, 309 op/s 2023-08-10T11:09:55.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:54 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:09:55.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:54 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:09:55.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:54 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:09:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 20.0 s, 334.0 tps, lat 325.460 ms stddev 429.163 2023-08-10T11:09:56.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:55 smithi157 ceph-mon[129604]: pgmap v586: 129 pgs: 129 active+clean; 18 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 17 MiB/s wr, 620 op/s 2023-08-10T11:09:56.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:55 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:09:56.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:55 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:09:56.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:55 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:09:56.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:55 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:09:56.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:55 smithi107 ceph-mon[127953]: pgmap v586: 129 pgs: 129 active+clean; 18 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 17 MiB/s wr, 620 op/s 2023-08-10T11:09:56.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:55 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:09:56.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:55 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:09:56.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:55 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:09:56.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:55 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:09:56.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:55 smithi195 ceph-mon[129938]: pgmap v586: 129 pgs: 129 active+clean; 18 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 17 MiB/s wr, 620 op/s 2023-08-10T11:09:56.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:55 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:09:56.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:55 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:09:56.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:55 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:09:56.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:55 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:09:57.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:57 smithi157 ceph-mon[129604]: pgmap v587: 129 pgs: 129 active+clean; 18 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 9.3 MiB/s wr, 524 op/s 2023-08-10T11:09:57.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:57 smithi107 ceph-mon[127953]: pgmap v587: 129 pgs: 129 active+clean; 18 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 9.3 MiB/s wr, 524 op/s 2023-08-10T11:09:57.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:57 smithi195 ceph-mon[129938]: pgmap v587: 129 pgs: 129 active+clean; 18 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 9.3 MiB/s wr, 524 op/s 2023-08-10T11:10:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:09:59 smithi157 ceph-mon[129604]: pgmap v588: 129 pgs: 129 active+clean; 18 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 14 MiB/s wr, 840 op/s 2023-08-10T11:10:00.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:09:59 smithi107 ceph-mon[127953]: pgmap v588: 129 pgs: 129 active+clean; 18 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 14 MiB/s wr, 840 op/s 2023-08-10T11:10:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:09:59 smithi195 ceph-mon[129938]: pgmap v588: 129 pgs: 129 active+clean; 18 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 14 MiB/s wr, 840 op/s 2023-08-10T11:10:00.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 25.0 s, 498.7 tps, lat 195.209 ms stddev 101.856 2023-08-10T11:10:01.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:00 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:01.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:00 smithi157 ceph-mon[129604]: overall HEALTH_OK 2023-08-10T11:10:01.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:00 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:01.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:00 smithi107 ceph-mon[127953]: overall HEALTH_OK 2023-08-10T11:10:01.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:00 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:01.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:00 smithi195 ceph-mon[129938]: overall HEALTH_OK 2023-08-10T11:10:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:01 smithi157 ceph-mon[129604]: pgmap v589: 129 pgs: 129 active+clean; 18 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 10 MiB/s wr, 707 op/s 2023-08-10T11:10:02.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:01 smithi107 ceph-mon[127953]: pgmap v589: 129 pgs: 129 active+clean; 18 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 10 MiB/s wr, 707 op/s 2023-08-10T11:10:02.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:01 smithi195 ceph-mon[129938]: pgmap v589: 129 pgs: 129 active+clean; 18 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 10 MiB/s wr, 707 op/s 2023-08-10T11:10:03.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:02 smithi157 ceph-mon[129604]: pgmap v590: 129 pgs: 129 active+clean; 18 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 9.6 MiB/s wr, 673 op/s 2023-08-10T11:10:03.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:02 smithi107 ceph-mon[127953]: pgmap v590: 129 pgs: 129 active+clean; 18 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 9.6 MiB/s wr, 673 op/s 2023-08-10T11:10:03.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:02 smithi195 ceph-mon[129938]: pgmap v590: 129 pgs: 129 active+clean; 18 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 9.6 MiB/s wr, 673 op/s 2023-08-10T11:10:05.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 30.0 s, 415.1 tps, lat 240.690 ms stddev 165.912 2023-08-10T11:10:06.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:05 smithi157 ceph-mon[129604]: pgmap v591: 129 pgs: 129 active+clean; 18 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-08-10T11:10:06.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:05 smithi107 ceph-mon[127953]: pgmap v591: 129 pgs: 129 active+clean; 18 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-08-10T11:10:06.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:05 smithi195 ceph-mon[129938]: pgmap v591: 129 pgs: 129 active+clean; 18 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-08-10T11:10:07.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:07 smithi157 ceph-mon[129604]: pgmap v592: 129 pgs: 129 active+clean; 18 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 11 MiB/s wr, 756 op/s 2023-08-10T11:10:07.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:07 smithi157 ceph-mon[129604]: osdmap e117: 12 total, 12 up, 12 in 2023-08-10T11:10:07.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:07 smithi107 ceph-mon[127953]: pgmap v592: 129 pgs: 129 active+clean; 18 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 11 MiB/s wr, 756 op/s 2023-08-10T11:10:07.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:07 smithi107 ceph-mon[127953]: osdmap e117: 12 total, 12 up, 12 in 2023-08-10T11:10:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:07 smithi195 ceph-mon[129938]: pgmap v592: 129 pgs: 129 active+clean; 18 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 11 MiB/s wr, 756 op/s 2023-08-10T11:10:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:07 smithi195 ceph-mon[129938]: osdmap e117: 12 total, 12 up, 12 in 2023-08-10T11:10:10.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:09 smithi157 ceph-mon[129604]: pgmap v594: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 18 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 12 MiB/s wr, 795 op/s 2023-08-10T11:10:10.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:09 smithi107 ceph-mon[127953]: pgmap v594: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 18 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 12 MiB/s wr, 795 op/s 2023-08-10T11:10:10.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:09 smithi195 ceph-mon[129938]: pgmap v594: 129 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 111 active+clean; 18 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 12 MiB/s wr, 795 op/s 2023-08-10T11:10:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 35.0 s, 262.6 tps, lat 380.206 ms stddev 576.885 2023-08-10T11:10:12.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:11 smithi157 ceph-mon[129604]: pgmap v595: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 18 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 11 MiB/s wr, 771 op/s 2023-08-10T11:10:12.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:11 smithi107 ceph-mon[127953]: pgmap v595: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 18 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 11 MiB/s wr, 771 op/s 2023-08-10T11:10:12.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:11 smithi195 ceph-mon[129938]: pgmap v595: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 18 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 11 MiB/s wr, 771 op/s 2023-08-10T11:10:13.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:13 smithi157 ceph-mon[129604]: pgmap v596: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 18 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 11 MiB/s wr, 771 op/s 2023-08-10T11:10:13.341 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:13 smithi107 ceph-mon[127953]: pgmap v596: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 18 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 11 MiB/s wr, 771 op/s 2023-08-10T11:10:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:13 smithi195 ceph-mon[129938]: pgmap v596: 129 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 110 active+clean; 18 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 11 MiB/s wr, 771 op/s 2023-08-10T11:10:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 40.0 s, 387.0 tps, lat 264.272 ms stddev 151.067 2023-08-10T11:10:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:15 smithi157 ceph-mon[129604]: pgmap v597: 129 pgs: 129 active+clean; 18 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 9.7 MiB/s wr, 684 op/s 2023-08-10T11:10:16.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:15 smithi107 ceph-mon[127953]: pgmap v597: 129 pgs: 129 active+clean; 18 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 9.7 MiB/s wr, 684 op/s 2023-08-10T11:10:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:15 smithi195 ceph-mon[129938]: pgmap v597: 129 pgs: 129 active+clean; 18 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 9.7 MiB/s wr, 684 op/s 2023-08-10T11:10:17.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:16 smithi157 ceph-mon[129604]: pgmap v598: 129 pgs: 129 active+clean; 18 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 9.7 MiB/s wr, 684 op/s 2023-08-10T11:10:17.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:16 smithi107 ceph-mon[127953]: pgmap v598: 129 pgs: 129 active+clean; 18 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 9.7 MiB/s wr, 684 op/s 2023-08-10T11:10:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:16 smithi195 ceph-mon[129938]: pgmap v598: 129 pgs: 129 active+clean; 18 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 9.7 MiB/s wr, 684 op/s 2023-08-10T11:10:20.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:19 smithi157 ceph-mon[129604]: pgmap v599: 129 pgs: 129 active+clean; 18 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 13 MiB/s wr, 963 op/s 2023-08-10T11:10:20.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:19 smithi157 ceph-mon[129604]: osdmap e118: 12 total, 12 up, 12 in 2023-08-10T11:10:20.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:19 smithi107 ceph-mon[127953]: pgmap v599: 129 pgs: 129 active+clean; 18 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 13 MiB/s wr, 963 op/s 2023-08-10T11:10:20.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:19 smithi107 ceph-mon[127953]: osdmap e118: 12 total, 12 up, 12 in 2023-08-10T11:10:20.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:19 smithi195 ceph-mon[129938]: pgmap v599: 129 pgs: 129 active+clean; 18 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 13 MiB/s wr, 963 op/s 2023-08-10T11:10:20.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:19 smithi195 ceph-mon[129938]: osdmap e118: 12 total, 12 up, 12 in 2023-08-10T11:10:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 45.0 s, 419.4 tps, lat 242.104 ms stddev 121.889 2023-08-10T11:10:22.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:21 smithi157 ceph-mon[129604]: pgmap v601: 129 pgs: 129 active+clean; 18 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 12 MiB/s wr, 885 op/s 2023-08-10T11:10:22.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:21 smithi107 ceph-mon[127953]: pgmap v601: 129 pgs: 129 active+clean; 18 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 12 MiB/s wr, 885 op/s 2023-08-10T11:10:22.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:21 smithi195 ceph-mon[129938]: pgmap v601: 129 pgs: 129 active+clean; 18 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 12 MiB/s wr, 885 op/s 2023-08-10T11:10:23.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:23 smithi157 ceph-mon[129604]: pgmap v602: 129 pgs: 129 active+clean; 18 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 12 MiB/s wr, 885 op/s 2023-08-10T11:10:23.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:23 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:23.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:23 smithi107 ceph-mon[127953]: pgmap v602: 129 pgs: 129 active+clean; 18 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 12 MiB/s wr, 885 op/s 2023-08-10T11:10:23.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:23 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:23 smithi195 ceph-mon[129938]: pgmap v602: 129 pgs: 129 active+clean; 18 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 12 MiB/s wr, 885 op/s 2023-08-10T11:10:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:23 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 50.0 s, 422.9 tps, lat 229.890 ms stddev 133.660 2023-08-10T11:10:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:25 smithi157 ceph-mon[129604]: pgmap v603: 129 pgs: 129 active+clean; 18 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 13 MiB/s wr, 945 op/s 2023-08-10T11:10:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:25 smithi107 ceph-mon[127953]: pgmap v603: 129 pgs: 129 active+clean; 18 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 13 MiB/s wr, 945 op/s 2023-08-10T11:10:26.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:25 smithi195 ceph-mon[129938]: pgmap v603: 129 pgs: 129 active+clean; 18 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 13 MiB/s wr, 945 op/s 2023-08-10T11:10:27.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:27 smithi157 ceph-mon[129604]: pgmap v604: 129 pgs: 129 active+clean; 18 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 13 MiB/s wr, 945 op/s 2023-08-10T11:10:27.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:27 smithi107 ceph-mon[127953]: pgmap v604: 129 pgs: 129 active+clean; 18 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 13 MiB/s wr, 945 op/s 2023-08-10T11:10:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:27 smithi195 ceph-mon[129938]: pgmap v604: 129 pgs: 129 active+clean; 18 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 13 MiB/s wr, 945 op/s 2023-08-10T11:10:29.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:29 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:29.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:29 smithi107 ceph-mon[127953]: pgmap v605: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 11 MiB/s wr, 878 op/s 2023-08-10T11:10:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:29 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:29 smithi195 ceph-mon[129938]: pgmap v605: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 11 MiB/s wr, 878 op/s 2023-08-10T11:10:29.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:29 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:29.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:29 smithi157 ceph-mon[129604]: pgmap v605: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 11 MiB/s wr, 878 op/s 2023-08-10T11:10:30.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 55.0 s, 383.2 tps, lat 260.926 ms stddev 137.863 2023-08-10T11:10:32.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:31 smithi157 ceph-mon[129604]: pgmap v606: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 10 MiB/s wr, 747 op/s 2023-08-10T11:10:32.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:31 smithi107 ceph-mon[127953]: pgmap v606: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 10 MiB/s wr, 747 op/s 2023-08-10T11:10:32.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:31 smithi195 ceph-mon[129938]: pgmap v606: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 10 MiB/s wr, 747 op/s 2023-08-10T11:10:34.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:33 smithi107 ceph-mon[127953]: pgmap v607: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 10 MiB/s wr, 730 op/s 2023-08-10T11:10:34.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:33 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:33 smithi195 ceph-mon[129938]: pgmap v607: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 10 MiB/s wr, 730 op/s 2023-08-10T11:10:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:33 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:34.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:33 smithi157 ceph-mon[129604]: pgmap v607: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 10 MiB/s wr, 730 op/s 2023-08-10T11:10:34.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:33 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 60.0 s, 353.3 tps, lat 283.601 ms stddev 119.823 2023-08-10T11:10:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:35 smithi157 ceph-mon[129604]: pgmap v608: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 15 MiB/s wr, 1.12k op/s 2023-08-10T11:10:36.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:35 smithi107 ceph-mon[127953]: pgmap v608: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 15 MiB/s wr, 1.12k op/s 2023-08-10T11:10:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:35 smithi195 ceph-mon[129938]: pgmap v608: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 15 MiB/s wr, 1.12k op/s 2023-08-10T11:10:37.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:37 smithi107 ceph-mon[127953]: pgmap v609: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 10 MiB/s wr, 745 op/s 2023-08-10T11:10:37.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:37 smithi195 ceph-mon[129938]: pgmap v609: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 10 MiB/s wr, 745 op/s 2023-08-10T11:10:37.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:37 smithi157 ceph-mon[129604]: pgmap v609: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 10 MiB/s wr, 745 op/s 2023-08-10T11:10:40.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:39 smithi157 ceph-mon[129604]: pgmap v610: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-08-10T11:10:40.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:39 smithi107 ceph-mon[127953]: pgmap v610: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-08-10T11:10:40.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:39 smithi195 ceph-mon[129938]: pgmap v610: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-08-10T11:10:40.803 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 65.0 s, 381.5 tps, lat 266.979 ms stddev 134.057 2023-08-10T11:10:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:41 smithi157 ceph-mon[129604]: pgmap v611: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 11 MiB/s wr, 882 op/s 2023-08-10T11:10:42.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:41 smithi107 ceph-mon[127953]: pgmap v611: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 11 MiB/s wr, 882 op/s 2023-08-10T11:10:42.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:41 smithi195 ceph-mon[129938]: pgmap v611: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 11 MiB/s wr, 882 op/s 2023-08-10T11:10:43.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:43 smithi157 ceph-mon[129604]: pgmap v612: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 10 MiB/s wr, 837 op/s 2023-08-10T11:10:43.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:43 smithi107 ceph-mon[127953]: pgmap v612: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 10 MiB/s wr, 837 op/s 2023-08-10T11:10:43.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:43 smithi195 ceph-mon[129938]: pgmap v612: 129 pgs: 129 active+clean; 18 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 10 MiB/s wr, 837 op/s 2023-08-10T11:10:44.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:44 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:44.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:44 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:44.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:44 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:45.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:45 smithi157 ceph-mon[129604]: pgmap v613: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 16 MiB/s wr, 1.20k op/s 2023-08-10T11:10:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:45 smithi107 ceph-mon[127953]: pgmap v613: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 16 MiB/s wr, 1.20k op/s 2023-08-10T11:10:45.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:45 smithi195 ceph-mon[129938]: pgmap v613: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 16 MiB/s wr, 1.20k op/s 2023-08-10T11:10:45.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 70.0 s, 425.1 tps, lat 235.111 ms stddev 87.346 2023-08-10T11:10:48.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:47 smithi157 ceph-mon[129604]: pgmap v614: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 11 MiB/s wr, 814 op/s 2023-08-10T11:10:48.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:47 smithi107 ceph-mon[127953]: pgmap v614: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 11 MiB/s wr, 814 op/s 2023-08-10T11:10:48.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:47 smithi195 ceph-mon[129938]: pgmap v614: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 11 MiB/s wr, 814 op/s 2023-08-10T11:10:49.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:48 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:49.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:48 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:49.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:48 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:10:50.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:49 smithi157 ceph-mon[129604]: pgmap v615: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-08-10T11:10:50.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:49 smithi107 ceph-mon[127953]: pgmap v615: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-08-10T11:10:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:49 smithi195 ceph-mon[129938]: pgmap v615: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-08-10T11:10:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 75.0 s, 378.4 tps, lat 266.937 ms stddev 179.562 2023-08-10T11:10:52.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:51 smithi157 ceph-mon[129604]: pgmap v616: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 11 MiB/s wr, 770 op/s 2023-08-10T11:10:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:51 smithi107 ceph-mon[127953]: pgmap v616: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 11 MiB/s wr, 770 op/s 2023-08-10T11:10:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:51 smithi195 ceph-mon[129938]: pgmap v616: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 11 MiB/s wr, 770 op/s 2023-08-10T11:10:54.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:53 smithi157 ceph-mon[129604]: pgmap v617: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 10 MiB/s wr, 722 op/s 2023-08-10T11:10:54.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:53 smithi107 ceph-mon[127953]: pgmap v617: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 10 MiB/s wr, 722 op/s 2023-08-10T11:10:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:53 smithi195 ceph-mon[129938]: pgmap v617: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 10 MiB/s wr, 722 op/s 2023-08-10T11:10:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 80.0 s, 372.6 tps, lat 264.224 ms stddev 91.944 2023-08-10T11:10:56.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:56 smithi157 ceph-mon[129604]: pgmap v618: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-08-10T11:10:56.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:56 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:10:56.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:56 smithi107 ceph-mon[127953]: pgmap v618: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-08-10T11:10:56.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:56 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:10:56.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:56 smithi195 ceph-mon[129938]: pgmap v618: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-08-10T11:10:56.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:56 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:10:57.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:57 smithi157 ceph-mon[129604]: pgmap v619: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 9.6 MiB/s wr, 708 op/s 2023-08-10T11:10:57.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:57 smithi107 ceph-mon[127953]: pgmap v619: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 9.6 MiB/s wr, 708 op/s 2023-08-10T11:10:57.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:57 smithi195 ceph-mon[129938]: pgmap v619: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 9.6 MiB/s wr, 708 op/s 2023-08-10T11:10:58.833 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:58 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:10:58.833 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:58 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:10:58.833 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:58 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:10:58.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:58 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:10:58.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:58 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:10:58.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:58 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:10:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:58 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:10:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:58 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:10:59.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:58 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:11:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:10:59 smithi157 ceph-mon[129604]: pgmap v620: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2023-08-10T11:11:00.333 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:10:59 smithi107 ceph-mon[127953]: pgmap v620: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2023-08-10T11:11:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:10:59 smithi195 ceph-mon[129938]: pgmap v620: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2023-08-10T11:11:00.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 85.0 s, 392.6 tps, lat 260.265 ms stddev 82.009 2023-08-10T11:11:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:02 smithi157 ceph-mon[129604]: pgmap v621: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 9.7 MiB/s wr, 756 op/s 2023-08-10T11:11:02.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:02 smithi107 ceph-mon[127953]: pgmap v621: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 9.7 MiB/s wr, 756 op/s 2023-08-10T11:11:02.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:02 smithi195 ceph-mon[129938]: pgmap v621: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 9.7 MiB/s wr, 756 op/s 2023-08-10T11:11:03.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:03 smithi195 ceph-mon[129938]: pgmap v622: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 9.4 MiB/s wr, 715 op/s 2023-08-10T11:11:03.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:03 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:03.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:03 smithi157 ceph-mon[129604]: pgmap v622: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 9.4 MiB/s wr, 715 op/s 2023-08-10T11:11:03.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:03 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:03.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:03 smithi107 ceph-mon[127953]: pgmap v622: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 9.4 MiB/s wr, 715 op/s 2023-08-10T11:11:03.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:03 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:04.416 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:04 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T11:11:04.417 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:04 smithi195 ceph-mon[129938]: scrub summary: active paths [/] 2023-08-10T11:11:04.417 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:04 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T11:11:04.417 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:04 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T11:11:04.417 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:04 smithi195 ceph-mon[129938]: scrub summary: idle+waiting paths [/] 2023-08-10T11:11:04.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:04 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T11:11:04.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:04 smithi157 ceph-mon[129604]: scrub summary: active paths [/] 2023-08-10T11:11:04.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:04 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T11:11:04.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:04 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T11:11:04.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:04 smithi157 ceph-mon[129604]: scrub summary: idle+waiting paths [/] 2023-08-10T11:11:04.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:04 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T11:11:04.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:04 smithi107 ceph-mon[127953]: scrub summary: active paths [/] 2023-08-10T11:11:04.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:04 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T11:11:04.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:04 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T11:11:04.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:04 smithi107 ceph-mon[127953]: scrub summary: idle+waiting paths [/] 2023-08-10T11:11:05.418 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:05 smithi195 ceph-mon[129938]: pgmap v623: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-08-10T11:11:05.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:05 smithi157 ceph-mon[129604]: pgmap v623: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-08-10T11:11:05.595 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:05 smithi107 ceph-mon[127953]: pgmap v623: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-08-10T11:11:05.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 90.0 s, 375.9 tps, lat 242.123 ms stddev 157.341 2023-08-10T11:11:08.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:07 smithi107 ceph-mon[127953]: pgmap v624: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 9.9 MiB/s wr, 747 op/s 2023-08-10T11:11:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:07 smithi195 ceph-mon[129938]: pgmap v624: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 9.9 MiB/s wr, 747 op/s 2023-08-10T11:11:08.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:07 smithi157 ceph-mon[129604]: pgmap v624: 129 pgs: 129 active+clean; 19 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 9.9 MiB/s wr, 747 op/s 2023-08-10T11:11:09.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:08 smithi107 ceph-mon[127953]: osdmap e119: 12 total, 12 up, 12 in 2023-08-10T11:11:09.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:08 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:08 smithi195 ceph-mon[129938]: osdmap e119: 12 total, 12 up, 12 in 2023-08-10T11:11:09.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:08 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:08 smithi157 ceph-mon[129604]: osdmap e119: 12 total, 12 up, 12 in 2023-08-10T11:11:09.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:08 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:10.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:10 smithi157 ceph-mon[129604]: pgmap v626: 129 pgs: 18 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 61 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 12 MiB/s wr, 827 op/s 2023-08-10T11:11:10.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:10 smithi107 ceph-mon[127953]: pgmap v626: 129 pgs: 18 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 61 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 12 MiB/s wr, 827 op/s 2023-08-10T11:11:10.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:10 smithi195 ceph-mon[129938]: pgmap v626: 129 pgs: 18 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 61 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 12 MiB/s wr, 827 op/s 2023-08-10T11:11:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 95.0 s, 268.3 tps, lat 400.026 ms stddev 541.530 2023-08-10T11:11:12.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:12 smithi157 ceph-mon[129604]: pgmap v627: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 810 op/s 2023-08-10T11:11:12.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:12 smithi107 ceph-mon[127953]: pgmap v627: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 810 op/s 2023-08-10T11:11:12.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:12 smithi195 ceph-mon[129938]: pgmap v627: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 810 op/s 2023-08-10T11:11:13.077 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 11:11:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T11:11:12.468+0000 7f1a7cd3e700 -1 calc_pg_upmaps abort due to max <= 0 2023-08-10T11:11:14.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:14 smithi157 ceph-mon[129604]: pgmap v628: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 810 op/s 2023-08-10T11:11:14.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:14 smithi107 ceph-mon[127953]: pgmap v628: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 810 op/s 2023-08-10T11:11:14.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:14 smithi195 ceph-mon[129938]: pgmap v628: 129 pgs: 19 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 54 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 810 op/s 2023-08-10T11:11:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 100.0 s, 116.0 tps, lat 207.242 ms stddev 112.129 2023-08-10T11:11:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:16 smithi157 ceph-mon[129604]: pgmap v629: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.7 MiB/s wr, 694 op/s 2023-08-10T11:11:16.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:16 smithi107 ceph-mon[127953]: pgmap v629: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.7 MiB/s wr, 694 op/s 2023-08-10T11:11:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:16 smithi195 ceph-mon[129938]: pgmap v629: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.7 MiB/s wr, 694 op/s 2023-08-10T11:11:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:17 smithi195 ceph-mon[129938]: pgmap v630: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.7 MiB/s wr, 694 op/s 2023-08-10T11:11:17.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:17 smithi157 ceph-mon[129604]: pgmap v630: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.7 MiB/s wr, 694 op/s 2023-08-10T11:11:17.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:17 smithi107 ceph-mon[127953]: pgmap v630: 129 pgs: 129 active+clean; 18 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.7 MiB/s wr, 694 op/s 2023-08-10T11:11:18.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:18 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T11:11:18.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:18 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T11:11:18.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:18 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T11:11:18.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:18 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T11:11:18.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:18 smithi195 ceph-mon[129938]: scrub summary: idle 2023-08-10T11:11:18.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:18 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T11:11:18.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:18 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T11:11:18.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:18 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T11:11:18.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:18 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T11:11:18.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:18 smithi157 ceph-mon[129604]: scrub summary: idle 2023-08-10T11:11:18.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:18 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T11:11:18.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:18 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T11:11:18.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:18 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T11:11:18.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:18 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T11:11:18.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:18 smithi107 ceph-mon[127953]: scrub summary: idle 2023-08-10T11:11:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:19 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:19 smithi195 ceph-mon[129938]: pgmap v631: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 9.9 MiB/s wr, 801 op/s 2023-08-10T11:11:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:19 smithi195 ceph-mon[129938]: osdmap e120: 12 total, 12 up, 12 in 2023-08-10T11:11:19.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:19 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:19.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:19 smithi157 ceph-mon[129604]: pgmap v631: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 9.9 MiB/s wr, 801 op/s 2023-08-10T11:11:19.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:19 smithi157 ceph-mon[129604]: osdmap e120: 12 total, 12 up, 12 in 2023-08-10T11:11:19.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:19 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:19.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:19 smithi107 ceph-mon[127953]: pgmap v631: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 9.9 MiB/s wr, 801 op/s 2023-08-10T11:11:19.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:19 smithi107 ceph-mon[127953]: osdmap e120: 12 total, 12 up, 12 in 2023-08-10T11:11:20.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 105.0 s, 52.2 tps, lat 2415.321 ms stddev 2984.272 2023-08-10T11:11:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:21 smithi157 ceph-mon[129604]: pgmap v633: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 6.2 MiB/s wr, 547 op/s 2023-08-10T11:11:22.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:21 smithi107 ceph-mon[127953]: pgmap v633: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 6.2 MiB/s wr, 547 op/s 2023-08-10T11:11:22.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:21 smithi195 ceph-mon[129938]: pgmap v633: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 6.2 MiB/s wr, 547 op/s 2023-08-10T11:11:24.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:23 smithi107 ceph-mon[127953]: pgmap v634: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 6.2 MiB/s wr, 547 op/s 2023-08-10T11:11:24.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:23 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:23 smithi195 ceph-mon[129938]: pgmap v634: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 6.2 MiB/s wr, 547 op/s 2023-08-10T11:11:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:23 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:23 smithi157 ceph-mon[129604]: pgmap v634: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 6.2 MiB/s wr, 547 op/s 2023-08-10T11:11:24.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:23 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:25.801 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 110.0 s, 366.3 tps, lat 406.972 ms stddev 1007.473 2023-08-10T11:11:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:26 smithi157 ceph-mon[129604]: pgmap v635: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 3.9 MiB/s wr, 301 op/s 2023-08-10T11:11:26.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:26 smithi107 ceph-mon[127953]: pgmap v635: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 3.9 MiB/s wr, 301 op/s 2023-08-10T11:11:26.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:26 smithi195 ceph-mon[129938]: pgmap v635: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 3.9 MiB/s wr, 301 op/s 2023-08-10T11:11:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:28 smithi157 ceph-mon[129604]: pgmap v636: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 3.9 MiB/s wr, 301 op/s 2023-08-10T11:11:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:28 smithi107 ceph-mon[127953]: pgmap v636: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 3.9 MiB/s wr, 301 op/s 2023-08-10T11:11:28.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:28 smithi195 ceph-mon[129938]: pgmap v636: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 3.9 MiB/s wr, 301 op/s 2023-08-10T11:11:30.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:30 smithi157 ceph-mon[129604]: pgmap v637: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 6.2 MiB/s wr, 467 op/s 2023-08-10T11:11:30.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:30 smithi107 ceph-mon[127953]: pgmap v637: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 6.2 MiB/s wr, 467 op/s 2023-08-10T11:11:30.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:30 smithi195 ceph-mon[129938]: pgmap v637: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 6.2 MiB/s wr, 467 op/s 2023-08-10T11:11:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 115.0 s, 242.2 tps, lat 418.703 ms stddev 641.979 2023-08-10T11:11:32.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:32 smithi157 ceph-mon[129604]: pgmap v638: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 5.3 MiB/s wr, 418 op/s 2023-08-10T11:11:32.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:32 smithi107 ceph-mon[127953]: pgmap v638: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 5.3 MiB/s wr, 418 op/s 2023-08-10T11:11:32.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:32 smithi195 ceph-mon[129938]: pgmap v638: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 5.3 MiB/s wr, 418 op/s 2023-08-10T11:11:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:34 smithi157 ceph-mon[129604]: pgmap v639: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 5.2 MiB/s wr, 408 op/s 2023-08-10T11:11:34.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:34 smithi107 ceph-mon[127953]: pgmap v639: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 5.2 MiB/s wr, 408 op/s 2023-08-10T11:11:34.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:34 smithi195 ceph-mon[129938]: pgmap v639: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 5.2 MiB/s wr, 408 op/s 2023-08-10T11:11:35.802 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 120.0 s, 395.1 tps, lat 252.830 ms stddev 93.685 2023-08-10T11:11:36.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:36 smithi157 ceph-mon[129604]: pgmap v640: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.3 MiB/s wr, 733 op/s 2023-08-10T11:11:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:36 smithi107 ceph-mon[127953]: pgmap v640: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.3 MiB/s wr, 733 op/s 2023-08-10T11:11:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:36 smithi195 ceph-mon[129938]: pgmap v640: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.3 MiB/s wr, 733 op/s 2023-08-10T11:11:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:38 smithi107 ceph-mon[127953]: pgmap v641: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.9 MiB/s wr, 652 op/s 2023-08-10T11:11:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:38 smithi195 ceph-mon[129938]: pgmap v641: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.9 MiB/s wr, 652 op/s 2023-08-10T11:11:38.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:38 smithi157 ceph-mon[129604]: pgmap v641: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.9 MiB/s wr, 652 op/s 2023-08-10T11:11:40.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:40 smithi157 ceph-mon[129604]: pgmap v642: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 985 op/s 2023-08-10T11:11:40.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:40 smithi107 ceph-mon[127953]: pgmap v642: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 985 op/s 2023-08-10T11:11:40.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:40 smithi195 ceph-mon[129938]: pgmap v642: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 11 MiB/s wr, 985 op/s 2023-08-10T11:11:40.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 125.0 s, 372.5 tps, lat 269.343 ms stddev 88.234 2023-08-10T11:11:42.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:42 smithi157 ceph-mon[129604]: pgmap v643: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.1 MiB/s wr, 746 op/s 2023-08-10T11:11:42.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:42 smithi107 ceph-mon[127953]: pgmap v643: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.1 MiB/s wr, 746 op/s 2023-08-10T11:11:42.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:42 smithi195 ceph-mon[129938]: pgmap v643: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.1 MiB/s wr, 746 op/s 2023-08-10T11:11:44.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:44 smithi107 ceph-mon[127953]: pgmap v644: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.9 MiB/s wr, 706 op/s 2023-08-10T11:11:44.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:44 smithi195 ceph-mon[129938]: pgmap v644: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.9 MiB/s wr, 706 op/s 2023-08-10T11:11:44.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:44 smithi157 ceph-mon[129604]: pgmap v644: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.9 MiB/s wr, 706 op/s 2023-08-10T11:11:45.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 130.0 s, 349.9 tps, lat 284.181 ms stddev 94.642 2023-08-10T11:11:46.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:46 smithi107 ceph-mon[127953]: pgmap v645: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 1.11k op/s 2023-08-10T11:11:46.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:46 smithi195 ceph-mon[129938]: pgmap v645: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 1.11k op/s 2023-08-10T11:11:46.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:46 smithi157 ceph-mon[129604]: pgmap v645: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 1.11k op/s 2023-08-10T11:11:47.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:47 smithi195 ceph-mon[129938]: pgmap v646: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.6 MiB/s wr, 783 op/s 2023-08-10T11:11:47.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:47 smithi157 ceph-mon[129604]: pgmap v646: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.6 MiB/s wr, 783 op/s 2023-08-10T11:11:47.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:47 smithi107 ceph-mon[127953]: pgmap v646: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.6 MiB/s wr, 783 op/s 2023-08-10T11:11:50.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:50 smithi157 ceph-mon[129604]: pgmap v647: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-08-10T11:11:50.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:50 smithi107 ceph-mon[127953]: pgmap v647: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-08-10T11:11:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:50 smithi195 ceph-mon[129938]: pgmap v647: 129 pgs: 129 active+clean; 18 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-08-10T11:11:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 135.0 s, 263.5 tps, lat 304.081 ms stddev 140.571 2023-08-10T11:11:51.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:51 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:51.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:51 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:51 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:11:52.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:52 smithi107 ceph-mon[127953]: pgmap v648: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 10 MiB/s wr, 834 op/s 2023-08-10T11:11:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:52 smithi195 ceph-mon[129938]: pgmap v648: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 10 MiB/s wr, 834 op/s 2023-08-10T11:11:52.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:52 smithi157 ceph-mon[129604]: pgmap v648: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 10 MiB/s wr, 834 op/s 2023-08-10T11:11:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:54 smithi107 ceph-mon[127953]: pgmap v649: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.1 MiB/s wr, 785 op/s 2023-08-10T11:11:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:54 smithi195 ceph-mon[129938]: pgmap v649: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.1 MiB/s wr, 785 op/s 2023-08-10T11:11:54.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:54 smithi157 ceph-mon[129604]: pgmap v649: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.1 MiB/s wr, 785 op/s 2023-08-10T11:11:55.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:55 smithi195 ceph-mon[129938]: pgmap v650: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 13 MiB/s wr, 1.05k op/s 2023-08-10T11:11:55.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:55 smithi157 ceph-mon[129604]: pgmap v650: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 13 MiB/s wr, 1.05k op/s 2023-08-10T11:11:55.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:55 smithi107 ceph-mon[127953]: pgmap v650: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 13 MiB/s wr, 1.05k op/s 2023-08-10T11:11:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 140.0 s, 326.6 tps, lat 364.224 ms stddev 522.968 2023-08-10T11:11:58.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:11:57 smithi107 ceph-mon[127953]: pgmap v651: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.7 MiB/s wr, 646 op/s 2023-08-10T11:11:58.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:11:57 smithi195 ceph-mon[129938]: pgmap v651: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.7 MiB/s wr, 646 op/s 2023-08-10T11:11:58.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:11:57 smithi157 ceph-mon[129604]: pgmap v651: 129 pgs: 129 active+clean; 19 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.7 MiB/s wr, 646 op/s 2023-08-10T11:12:00.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:00 smithi107 ceph-mon[127953]: pgmap v652: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 993 op/s 2023-08-10T11:12:00.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:00 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:12:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:00 smithi195 ceph-mon[129938]: pgmap v652: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 993 op/s 2023-08-10T11:12:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:00 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:12:00.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:00 smithi157 ceph-mon[129604]: pgmap v652: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 993 op/s 2023-08-10T11:12:00.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:00 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:12:00.801 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 145.0 s, 307.7 tps, lat 307.625 ms stddev 101.999 2023-08-10T11:12:01.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:01 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:01.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:01 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:01.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:01 smithi157 ceph-mon[129604]: pgmap v653: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.1 MiB/s wr, 696 op/s 2023-08-10T11:12:01.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:01 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:01.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:01 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:01.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:01 smithi107 ceph-mon[127953]: pgmap v653: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.1 MiB/s wr, 696 op/s 2023-08-10T11:12:01.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:01 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:01.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:01 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:01.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:01 smithi195 ceph-mon[129938]: pgmap v653: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.1 MiB/s wr, 696 op/s 2023-08-10T11:12:04.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:03 smithi195 ceph-mon[129938]: pgmap v654: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.9 MiB/s wr, 653 op/s 2023-08-10T11:12:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:03 smithi157 ceph-mon[129604]: pgmap v654: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.9 MiB/s wr, 653 op/s 2023-08-10T11:12:04.337 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:03 smithi107 ceph-mon[127953]: pgmap v654: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.9 MiB/s wr, 653 op/s 2023-08-10T11:12:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:05 smithi195 ceph-mon[129938]: pgmap v655: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 975 op/s 2023-08-10T11:12:05.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:05 smithi157 ceph-mon[129604]: pgmap v655: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 975 op/s 2023-08-10T11:12:05.584 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:05 smithi107 ceph-mon[127953]: pgmap v655: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 975 op/s 2023-08-10T11:12:05.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 150.0 s, 227.3 tps, lat 430.874 ms stddev 403.564 2023-08-10T11:12:08.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:08 smithi157 ceph-mon[129604]: pgmap v656: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 768 op/s 2023-08-10T11:12:08.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:08 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:08.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:08 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:08.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:08 smithi157 ceph-mon[129604]: osdmap e121: 12 total, 12 up, 12 in 2023-08-10T11:12:08.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:08 smithi107 ceph-mon[127953]: pgmap v656: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 768 op/s 2023-08-10T11:12:08.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:08 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:08.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:08 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:08.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:08 smithi107 ceph-mon[127953]: osdmap e121: 12 total, 12 up, 12 in 2023-08-10T11:12:08.416 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:08 smithi195 ceph-mon[129938]: pgmap v656: 129 pgs: 129 active+clean; 19 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 768 op/s 2023-08-10T11:12:08.416 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:08 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:08.416 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:08 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:08.416 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:08 smithi195 ceph-mon[129938]: osdmap e121: 12 total, 12 up, 12 in 2023-08-10T11:12:10.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:10 smithi107 ceph-mon[127953]: pgmap v658: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 18 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.3 MiB/s wr, 817 op/s 2023-08-10T11:12:10.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:10 smithi195 ceph-mon[129938]: pgmap v658: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 18 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.3 MiB/s wr, 817 op/s 2023-08-10T11:12:10.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:10 smithi157 ceph-mon[129604]: pgmap v658: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 18 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.3 MiB/s wr, 817 op/s 2023-08-10T11:12:10.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 155.0 s, 207.1 tps, lat 476.011 ms stddev 466.723 2023-08-10T11:12:11.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:11 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T11:12:11.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:11 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T11:12:11.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:11 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T11:12:11.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:11 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T11:12:11.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:11 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T11:12:11.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:11 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T11:12:12.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:12 smithi107 ceph-mon[127953]: pgmap v659: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 18 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.0 MiB/s wr, 841 op/s 2023-08-10T11:12:12.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:12 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:12 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:12 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:12 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:12 smithi195 ceph-mon[129938]: pgmap v659: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 18 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.0 MiB/s wr, 841 op/s 2023-08-10T11:12:12.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:12 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:12 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:12 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:12 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:12 smithi157 ceph-mon[129604]: pgmap v659: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 18 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.0 MiB/s wr, 841 op/s 2023-08-10T11:12:12.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:12 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:12 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:12 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:12 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:12.829 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 11:12:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T11:12:12.472+0000 7f1a7cd3e700 -1 calc_pg_upmaps abort due to max <= 0 2023-08-10T11:12:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:12:13.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:12:13.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:13 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:13.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:12:13.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:12:13.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:13 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:12:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:12:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:12:13.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:13 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:12:14.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:14 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T11:12:14.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:14 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T11:12:14.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:14 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T11:12:14.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:14 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T11:12:14.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:14 smithi195 ceph-mon[129938]: pgmap v660: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 18 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.0 MiB/s wr, 841 op/s 2023-08-10T11:12:14.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:14 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T11:12:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:14 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T11:12:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:14 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T11:12:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:14 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T11:12:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:14 smithi157 ceph-mon[129604]: pgmap v660: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 18 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.0 MiB/s wr, 841 op/s 2023-08-10T11:12:14.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:14 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T11:12:14.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:14 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T11:12:14.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:14 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T11:12:14.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:14 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T11:12:14.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:14 smithi107 ceph-mon[127953]: pgmap v660: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 18 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.0 MiB/s wr, 841 op/s 2023-08-10T11:12:15.802 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 160.0 s, 366.2 tps, lat 301.363 ms stddev 306.325 2023-08-10T11:12:16.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:16 smithi195 ceph-mon[129938]: pgmap v661: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.8 MiB/s wr, 704 op/s 2023-08-10T11:12:16.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:16 smithi157 ceph-mon[129604]: pgmap v661: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.8 MiB/s wr, 704 op/s 2023-08-10T11:12:16.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:16 smithi107 ceph-mon[127953]: pgmap v661: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.8 MiB/s wr, 704 op/s 2023-08-10T11:12:18.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:18 smithi195 ceph-mon[129938]: pgmap v662: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.6 MiB/s wr, 689 op/s 2023-08-10T11:12:18.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:18 smithi157 ceph-mon[129604]: pgmap v662: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.6 MiB/s wr, 689 op/s 2023-08-10T11:12:18.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:18 smithi107 ceph-mon[127953]: pgmap v662: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.6 MiB/s wr, 689 op/s 2023-08-10T11:12:20.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:20 smithi107 ceph-mon[127953]: pgmap v663: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 950 op/s 2023-08-10T11:12:20.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:20 smithi107 ceph-mon[127953]: osdmap e122: 12 total, 12 up, 12 in 2023-08-10T11:12:20.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:20 smithi195 ceph-mon[129938]: pgmap v663: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 950 op/s 2023-08-10T11:12:20.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:20 smithi195 ceph-mon[129938]: osdmap e122: 12 total, 12 up, 12 in 2023-08-10T11:12:20.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:20 smithi157 ceph-mon[129604]: pgmap v663: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 950 op/s 2023-08-10T11:12:20.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:20 smithi157 ceph-mon[129604]: osdmap e122: 12 total, 12 up, 12 in 2023-08-10T11:12:20.805 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 165.0 s, 374.4 tps, lat 266.656 ms stddev 90.957 2023-08-10T11:12:21.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:21 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:12:21.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:21 smithi195 ceph-mon[129938]: pgmap v665: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 762 op/s 2023-08-10T11:12:21.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:21 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:12:21.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:21 smithi157 ceph-mon[129604]: pgmap v665: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 762 op/s 2023-08-10T11:12:21.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:21 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:12:21.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:21 smithi107 ceph-mon[127953]: pgmap v665: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 762 op/s 2023-08-10T11:12:24.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:23 smithi195 ceph-mon[129938]: pgmap v666: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 762 op/s 2023-08-10T11:12:24.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:23 smithi157 ceph-mon[129604]: pgmap v666: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 762 op/s 2023-08-10T11:12:24.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:23 smithi107 ceph-mon[127953]: pgmap v666: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 762 op/s 2023-08-10T11:12:25.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 170.0 s, 334.8 tps, lat 295.154 ms stddev 92.868 2023-08-10T11:12:26.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:26 smithi195 ceph-mon[129938]: pgmap v667: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 950 op/s 2023-08-10T11:12:26.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:26 smithi157 ceph-mon[129604]: pgmap v667: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 950 op/s 2023-08-10T11:12:26.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:26 smithi107 ceph-mon[127953]: pgmap v667: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 950 op/s 2023-08-10T11:12:28.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:28 smithi195 ceph-mon[129938]: pgmap v668: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 958 op/s 2023-08-10T11:12:28.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:28 smithi157 ceph-mon[129604]: pgmap v668: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 958 op/s 2023-08-10T11:12:28.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:28 smithi107 ceph-mon[127953]: pgmap v668: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 958 op/s 2023-08-10T11:12:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:29 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:12:29.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:29 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:12:29.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:29 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:12:30.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:30 smithi195 ceph-mon[129938]: pgmap v669: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 986 op/s 2023-08-10T11:12:30.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:30 smithi157 ceph-mon[129604]: pgmap v669: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 986 op/s 2023-08-10T11:12:30.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:30 smithi107 ceph-mon[127953]: pgmap v669: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 986 op/s 2023-08-10T11:12:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 175.0 s, 346.0 tps, lat 289.769 ms stddev 92.272 2023-08-10T11:12:31.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:31 smithi195 ceph-mon[129938]: pgmap v670: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 926 op/s 2023-08-10T11:12:31.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:31 smithi157 ceph-mon[129604]: pgmap v670: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 926 op/s 2023-08-10T11:12:31.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:31 smithi107 ceph-mon[127953]: pgmap v670: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 926 op/s 2023-08-10T11:12:34.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:33 smithi195 ceph-mon[129938]: pgmap v671: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.9 MiB/s wr, 808 op/s 2023-08-10T11:12:34.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:33 smithi157 ceph-mon[129604]: pgmap v671: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.9 MiB/s wr, 808 op/s 2023-08-10T11:12:34.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:33 smithi107 ceph-mon[127953]: pgmap v671: 129 pgs: 129 active+clean; 17 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.9 MiB/s wr, 808 op/s 2023-08-10T11:12:35.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 180.0 s, 353.9 tps, lat 283.152 ms stddev 119.161 2023-08-10T11:12:36.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:36 smithi107 ceph-mon[127953]: pgmap v672: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-08-10T11:12:36.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:36 smithi195 ceph-mon[129938]: pgmap v672: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-08-10T11:12:36.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:36 smithi157 ceph-mon[129604]: pgmap v672: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-08-10T11:12:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:38 smithi195 ceph-mon[129938]: pgmap v673: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.0 MiB/s wr, 854 op/s 2023-08-10T11:12:38.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:38 smithi157 ceph-mon[129604]: pgmap v673: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.0 MiB/s wr, 854 op/s 2023-08-10T11:12:38.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:38 smithi107 ceph-mon[127953]: pgmap v673: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.0 MiB/s wr, 854 op/s 2023-08-10T11:12:40.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:40 smithi195 ceph-mon[129938]: pgmap v674: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.10k op/s 2023-08-10T11:12:40.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:40 smithi157 ceph-mon[129604]: pgmap v674: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.10k op/s 2023-08-10T11:12:40.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:40 smithi107 ceph-mon[127953]: pgmap v674: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.10k op/s 2023-08-10T11:12:40.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 185.0 s, 330.3 tps, lat 298.751 ms stddev 120.050 2023-08-10T11:12:42.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:42 smithi195 ceph-mon[129938]: pgmap v675: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.4 MiB/s wr, 876 op/s 2023-08-10T11:12:42.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:42 smithi157 ceph-mon[129604]: pgmap v675: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.4 MiB/s wr, 876 op/s 2023-08-10T11:12:42.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:42 smithi107 ceph-mon[127953]: pgmap v675: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.4 MiB/s wr, 876 op/s 2023-08-10T11:12:44.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:44 smithi195 ceph-mon[129938]: pgmap v676: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 794 op/s 2023-08-10T11:12:44.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:44 smithi157 ceph-mon[129604]: pgmap v676: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 794 op/s 2023-08-10T11:12:44.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:44 smithi107 ceph-mon[127953]: pgmap v676: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.6 MiB/s wr, 794 op/s 2023-08-10T11:12:45.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 190.0 s, 353.0 tps, lat 285.662 ms stddev 141.328 2023-08-10T11:12:46.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:46 smithi195 ceph-mon[129938]: pgmap v677: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-08-10T11:12:46.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:46 smithi157 ceph-mon[129604]: pgmap v677: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-08-10T11:12:46.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:46 smithi107 ceph-mon[127953]: pgmap v677: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-08-10T11:12:47.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:47 smithi157 ceph-mon[129604]: pgmap v678: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.4 MiB/s wr, 860 op/s 2023-08-10T11:12:47.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:47 smithi107 ceph-mon[127953]: pgmap v678: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.4 MiB/s wr, 860 op/s 2023-08-10T11:12:47.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:47 smithi195 ceph-mon[129938]: pgmap v678: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.4 MiB/s wr, 860 op/s 2023-08-10T11:12:50.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:50 smithi195 ceph-mon[129938]: pgmap v679: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-08-10T11:12:50.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:50 smithi157 ceph-mon[129604]: pgmap v679: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-08-10T11:12:50.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:50 smithi107 ceph-mon[127953]: pgmap v679: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-08-10T11:12:50.801 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 195.0 s, 311.7 tps, lat 316.366 ms stddev 133.799 2023-08-10T11:12:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:52 smithi195 ceph-mon[129938]: pgmap v680: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.6 MiB/s wr, 908 op/s 2023-08-10T11:12:52.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:52 smithi157 ceph-mon[129604]: pgmap v680: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.6 MiB/s wr, 908 op/s 2023-08-10T11:12:52.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:52 smithi107 ceph-mon[127953]: pgmap v680: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.6 MiB/s wr, 908 op/s 2023-08-10T11:12:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:54 smithi195 ceph-mon[129938]: pgmap v681: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.6 MiB/s wr, 819 op/s 2023-08-10T11:12:54.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:54 smithi157 ceph-mon[129604]: pgmap v681: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.6 MiB/s wr, 819 op/s 2023-08-10T11:12:54.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:54 smithi107 ceph-mon[127953]: pgmap v681: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.6 MiB/s wr, 819 op/s 2023-08-10T11:12:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 200.0 s, 270.3 tps, lat 381.454 ms stddev 344.167 2023-08-10T11:12:56.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:56 smithi195 ceph-mon[129938]: pgmap v682: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 12 MiB/s wr, 1.18k op/s 2023-08-10T11:12:56.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:56 smithi157 ceph-mon[129604]: pgmap v682: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 12 MiB/s wr, 1.18k op/s 2023-08-10T11:12:56.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:56 smithi107 ceph-mon[127953]: pgmap v682: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 12 MiB/s wr, 1.18k op/s 2023-08-10T11:12:58.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:58 smithi195 ceph-mon[129938]: pgmap v683: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.7 MiB/s wr, 851 op/s 2023-08-10T11:12:58.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:58 smithi157 ceph-mon[129604]: pgmap v683: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.7 MiB/s wr, 851 op/s 2023-08-10T11:12:58.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:58 smithi107 ceph-mon[127953]: pgmap v683: 129 pgs: 129 active+clean; 17 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.7 MiB/s wr, 851 op/s 2023-08-10T11:12:59.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:59 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:12:59.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:12:59 smithi157 ceph-mon[129604]: pgmap v684: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-08-10T11:12:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:59 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:12:59.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:12:59 smithi107 ceph-mon[127953]: pgmap v684: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-08-10T11:12:59.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:59 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:12:59.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:12:59 smithi195 ceph-mon[129938]: pgmap v684: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-08-10T11:13:00.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 205.0 s, 321.0 tps, lat 279.416 ms stddev 92.930 2023-08-10T11:13:02.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:01 smithi195 ceph-mon[129938]: pgmap v685: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.1 MiB/s wr, 836 op/s 2023-08-10T11:13:02.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:01 smithi157 ceph-mon[129604]: pgmap v685: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.1 MiB/s wr, 836 op/s 2023-08-10T11:13:02.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:01 smithi107 ceph-mon[127953]: pgmap v685: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.1 MiB/s wr, 836 op/s 2023-08-10T11:13:04.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:03 smithi195 ceph-mon[129938]: pgmap v686: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.6 MiB/s wr, 750 op/s 2023-08-10T11:13:04.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:03 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:04.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:03 smithi195 ceph-mon[129938]: osdmap e123: 12 total, 12 up, 12 in 2023-08-10T11:13:04.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:03 smithi157 ceph-mon[129604]: pgmap v686: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.6 MiB/s wr, 750 op/s 2023-08-10T11:13:04.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:03 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:04.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:03 smithi157 ceph-mon[129604]: osdmap e123: 12 total, 12 up, 12 in 2023-08-10T11:13:04.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:03 smithi107 ceph-mon[127953]: pgmap v686: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.6 MiB/s wr, 750 op/s 2023-08-10T11:13:04.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:03 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:04.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:03 smithi107 ceph-mon[127953]: osdmap e123: 12 total, 12 up, 12 in 2023-08-10T11:13:05.801 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 210.0 s, 216.5 tps, lat 405.335 ms stddev 337.419 2023-08-10T11:13:06.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:06 smithi195 ceph-mon[129938]: pgmap v688: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.9 MiB/s wr, 857 op/s 2023-08-10T11:13:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:06 smithi157 ceph-mon[129604]: pgmap v688: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.9 MiB/s wr, 857 op/s 2023-08-10T11:13:06.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:06 smithi107 ceph-mon[127953]: pgmap v688: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.9 MiB/s wr, 857 op/s 2023-08-10T11:13:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:08 smithi195 ceph-mon[129938]: pgmap v689: 129 pgs: 20 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 56 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.8 MiB/s wr, 858 op/s 2023-08-10T11:13:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:08 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:08.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:08 smithi157 ceph-mon[129604]: pgmap v689: 129 pgs: 20 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 56 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.8 MiB/s wr, 858 op/s 2023-08-10T11:13:08.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:08 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:08.590 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:08 smithi107 ceph-mon[127953]: pgmap v689: 129 pgs: 20 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 56 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.8 MiB/s wr, 858 op/s 2023-08-10T11:13:08.590 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:08 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:10.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:10 smithi195 ceph-mon[129938]: pgmap v690: 129 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 107 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 715 op/s 2023-08-10T11:13:10.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:10 smithi157 ceph-mon[129604]: pgmap v690: 129 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 107 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 715 op/s 2023-08-10T11:13:10.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:10 smithi107 ceph-mon[127953]: pgmap v690: 129 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 107 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 715 op/s 2023-08-10T11:13:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 215.0 s, 236.9 tps, lat 286.714 ms stddev 208.577 2023-08-10T11:13:12.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:12 smithi195 ceph-mon[129938]: pgmap v691: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.2 MiB/s wr, 708 op/s 2023-08-10T11:13:12.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:12 smithi157 ceph-mon[129604]: pgmap v691: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.2 MiB/s wr, 708 op/s 2023-08-10T11:13:12.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:12 smithi107 ceph-mon[127953]: pgmap v691: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.2 MiB/s wr, 708 op/s 2023-08-10T11:13:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:14 smithi157 ceph-mon[129604]: pgmap v692: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.2 MiB/s wr, 708 op/s 2023-08-10T11:13:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:14 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:14 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:13:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:14 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:14 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:14.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:14 smithi157 ceph-mon[129604]: osdmap e124: 12 total, 12 up, 12 in 2023-08-10T11:13:14.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:14 smithi107 ceph-mon[127953]: pgmap v692: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.2 MiB/s wr, 708 op/s 2023-08-10T11:13:14.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:14 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:14.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:14 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:13:14.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:14 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:14.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:14 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:14.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:14 smithi107 ceph-mon[127953]: osdmap e124: 12 total, 12 up, 12 in 2023-08-10T11:13:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:14 smithi195 ceph-mon[129938]: pgmap v692: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.2 MiB/s wr, 708 op/s 2023-08-10T11:13:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:14 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:14 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:13:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:14 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:14.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:14 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:14.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:14 smithi195 ceph-mon[129938]: osdmap e124: 12 total, 12 up, 12 in 2023-08-10T11:13:15.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:15 smithi157 ceph-mon[129604]: pgmap v694: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 673 op/s 2023-08-10T11:13:15.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:15 smithi107 ceph-mon[127953]: pgmap v694: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 673 op/s 2023-08-10T11:13:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:15 smithi195 ceph-mon[129938]: pgmap v694: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 673 op/s 2023-08-10T11:13:15.803 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 220.0 s, 266.7 tps, lat 577.405 ms stddev 1499.324 2023-08-10T11:13:16.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:16 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:16.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:16 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:16.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:16 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:17.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:17 smithi157 ceph-mon[129604]: pgmap v695: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 667 op/s 2023-08-10T11:13:17.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:17 smithi107 ceph-mon[127953]: pgmap v695: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 667 op/s 2023-08-10T11:13:17.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:17 smithi195 ceph-mon[129938]: pgmap v695: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 667 op/s 2023-08-10T11:13:20.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:20 smithi195 ceph-mon[129938]: pgmap v696: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.9 MiB/s wr, 828 op/s 2023-08-10T11:13:20.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:20 smithi157 ceph-mon[129604]: pgmap v696: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.9 MiB/s wr, 828 op/s 2023-08-10T11:13:20.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:20 smithi107 ceph-mon[127953]: pgmap v696: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.9 MiB/s wr, 828 op/s 2023-08-10T11:13:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 225.0 s, 326.7 tps, lat 309.495 ms stddev 148.172 2023-08-10T11:13:21.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:21 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:21.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:21.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:21 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:21.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:21.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:21 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:21.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:22.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:22 smithi157 ceph-mon[129604]: pgmap v697: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 841 op/s 2023-08-10T11:13:22.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:22 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:22.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:22 smithi107 ceph-mon[127953]: pgmap v697: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 841 op/s 2023-08-10T11:13:22.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:22 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:22.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:22 smithi195 ceph-mon[129938]: pgmap v697: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 841 op/s 2023-08-10T11:13:22.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:22 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:23.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:23 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:13:23.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:23 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:13:23.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:23 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:23.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:23 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:13:23.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:23 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:13:23.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:23 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:23.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:23 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:13:23.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:23 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:13:23.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:23 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:13:24.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:24 smithi157 ceph-mon[129604]: pgmap v698: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 840 op/s 2023-08-10T11:13:24.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:24 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:24.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:24 smithi107 ceph-mon[127953]: pgmap v698: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 840 op/s 2023-08-10T11:13:24.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:24 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:24.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:24 smithi195 ceph-mon[129938]: pgmap v698: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 840 op/s 2023-08-10T11:13:24.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:24 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:25.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:25 smithi157 ceph-mon[129604]: pgmap v699: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 872 op/s 2023-08-10T11:13:25.588 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:25 smithi107 ceph-mon[127953]: pgmap v699: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 872 op/s 2023-08-10T11:13:25.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:25 smithi195 ceph-mon[129938]: pgmap v699: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 872 op/s 2023-08-10T11:13:25.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 230.0 s, 310.2 tps, lat 316.584 ms stddev 134.472 2023-08-10T11:13:28.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:27 smithi195 ceph-mon[129938]: pgmap v700: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.8 MiB/s wr, 797 op/s 2023-08-10T11:13:28.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:27 smithi157 ceph-mon[129604]: pgmap v700: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.8 MiB/s wr, 797 op/s 2023-08-10T11:13:28.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:27 smithi107 ceph-mon[127953]: pgmap v700: 129 pgs: 129 active+clean; 17 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.8 MiB/s wr, 797 op/s 2023-08-10T11:13:29.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:28 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:29.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:28 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:28 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:13:30.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:30 smithi195 ceph-mon[129938]: pgmap v701: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.05k op/s 2023-08-10T11:13:30.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:30 smithi157 ceph-mon[129604]: pgmap v701: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.05k op/s 2023-08-10T11:13:30.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:30 smithi107 ceph-mon[127953]: pgmap v701: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.05k op/s 2023-08-10T11:13:30.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 235.0 s, 300.8 tps, lat 328.525 ms stddev 130.996 2023-08-10T11:13:32.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:32 smithi195 ceph-mon[129938]: pgmap v702: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.3 MiB/s wr, 844 op/s 2023-08-10T11:13:32.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:32 smithi157 ceph-mon[129604]: pgmap v702: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.3 MiB/s wr, 844 op/s 2023-08-10T11:13:32.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:32 smithi107 ceph-mon[127953]: pgmap v702: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.3 MiB/s wr, 844 op/s 2023-08-10T11:13:34.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:34 smithi157 ceph-mon[129604]: pgmap v703: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.6 MiB/s wr, 766 op/s 2023-08-10T11:13:34.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:34 smithi107 ceph-mon[127953]: pgmap v703: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.6 MiB/s wr, 766 op/s 2023-08-10T11:13:34.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:34 smithi195 ceph-mon[129938]: pgmap v703: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.6 MiB/s wr, 766 op/s 2023-08-10T11:13:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 240.0 s, 312.7 tps, lat 327.809 ms stddev 99.841 2023-08-10T11:13:36.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:36 smithi157 ceph-mon[129604]: pgmap v704: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.09k op/s 2023-08-10T11:13:36.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:36 smithi107 ceph-mon[127953]: pgmap v704: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.09k op/s 2023-08-10T11:13:36.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:36 smithi195 ceph-mon[129938]: pgmap v704: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.09k op/s 2023-08-10T11:13:37.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:37 smithi157 ceph-mon[129604]: pgmap v705: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.5 MiB/s wr, 791 op/s 2023-08-10T11:13:37.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:37 smithi107 ceph-mon[127953]: pgmap v705: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.5 MiB/s wr, 791 op/s 2023-08-10T11:13:37.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:37 smithi195 ceph-mon[129938]: pgmap v705: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.5 MiB/s wr, 791 op/s 2023-08-10T11:13:40.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:40 smithi195 ceph-mon[129938]: pgmap v706: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-08-10T11:13:40.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:40 smithi157 ceph-mon[129604]: pgmap v706: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-08-10T11:13:40.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:40 smithi107 ceph-mon[127953]: pgmap v706: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-08-10T11:13:40.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 245.0 s, 235.0 tps, lat 410.158 ms stddev 191.896 2023-08-10T11:13:42.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:42 smithi157 ceph-mon[129604]: pgmap v707: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 842 op/s 2023-08-10T11:13:42.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:42 smithi107 ceph-mon[127953]: pgmap v707: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 842 op/s 2023-08-10T11:13:42.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:42 smithi195 ceph-mon[129938]: pgmap v707: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 842 op/s 2023-08-10T11:13:44.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:44 smithi157 ceph-mon[129604]: pgmap v708: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.3 MiB/s wr, 761 op/s 2023-08-10T11:13:44.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:44 smithi107 ceph-mon[127953]: pgmap v708: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.3 MiB/s wr, 761 op/s 2023-08-10T11:13:44.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:44 smithi195 ceph-mon[129938]: pgmap v708: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.3 MiB/s wr, 761 op/s 2023-08-10T11:13:45.803 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 250.0 s, 363.7 tps, lat 284.654 ms stddev 124.748 2023-08-10T11:13:46.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:46 smithi157 ceph-mon[129604]: pgmap v709: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-08-10T11:13:46.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:46 smithi107 ceph-mon[127953]: pgmap v709: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-08-10T11:13:46.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:46 smithi195 ceph-mon[129938]: pgmap v709: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-08-10T11:13:48.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:48 smithi157 ceph-mon[129604]: pgmap v710: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 837 op/s 2023-08-10T11:13:48.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:48 smithi107 ceph-mon[127953]: pgmap v710: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 837 op/s 2023-08-10T11:13:48.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:48 smithi195 ceph-mon[129938]: pgmap v710: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 837 op/s 2023-08-10T11:13:50.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:50 smithi195 ceph-mon[129938]: pgmap v711: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 1.03k op/s 2023-08-10T11:13:50.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:50 smithi157 ceph-mon[129604]: pgmap v711: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 1.03k op/s 2023-08-10T11:13:50.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:50 smithi107 ceph-mon[127953]: pgmap v711: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 1.03k op/s 2023-08-10T11:13:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 255.0 s, 313.9 tps, lat 307.565 ms stddev 106.406 2023-08-10T11:13:52.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:52 smithi195 ceph-mon[129938]: pgmap v712: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.6 MiB/s wr, 880 op/s 2023-08-10T11:13:52.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:52 smithi157 ceph-mon[129604]: pgmap v712: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.6 MiB/s wr, 880 op/s 2023-08-10T11:13:52.584 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:52 smithi107 ceph-mon[127953]: pgmap v712: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 9.6 MiB/s wr, 880 op/s 2023-08-10T11:13:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:54 smithi195 ceph-mon[129938]: pgmap v713: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.9 MiB/s wr, 764 op/s 2023-08-10T11:13:54.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:54 smithi157 ceph-mon[129604]: pgmap v713: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.9 MiB/s wr, 764 op/s 2023-08-10T11:13:54.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:54 smithi107 ceph-mon[127953]: pgmap v713: 129 pgs: 129 active+clean; 17 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.9 MiB/s wr, 764 op/s 2023-08-10T11:13:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 260.0 s, 336.0 tps, lat 303.140 ms stddev 118.449 2023-08-10T11:13:56.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:56 smithi157 ceph-mon[129604]: pgmap v714: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 1.09k op/s 2023-08-10T11:13:56.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:56 smithi107 ceph-mon[127953]: pgmap v714: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 1.09k op/s 2023-08-10T11:13:56.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:56 smithi195 ceph-mon[129938]: pgmap v714: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 1.09k op/s 2023-08-10T11:13:58.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:13:58 smithi157 ceph-mon[129604]: pgmap v715: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.0 MiB/s wr, 785 op/s 2023-08-10T11:13:58.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:13:58 smithi107 ceph-mon[127953]: pgmap v715: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.0 MiB/s wr, 785 op/s 2023-08-10T11:13:58.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:13:58 smithi195 ceph-mon[129938]: pgmap v715: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.0 MiB/s wr, 785 op/s 2023-08-10T11:14:00.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:00 smithi157 ceph-mon[129604]: pgmap v716: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-08-10T11:14:00.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:00 smithi107 ceph-mon[127953]: pgmap v716: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-08-10T11:14:00.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:00 smithi195 ceph-mon[129938]: pgmap v716: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-08-10T11:14:00.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 265.0 s, 293.7 tps, lat 324.679 ms stddev 150.430 2023-08-10T11:14:01.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:01 smithi157 ceph-mon[129604]: pgmap v717: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 915 op/s 2023-08-10T11:14:01.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:01 smithi107 ceph-mon[127953]: pgmap v717: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 915 op/s 2023-08-10T11:14:01.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:01 smithi195 ceph-mon[129938]: pgmap v717: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 915 op/s 2023-08-10T11:14:03.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:03 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:03.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:03 smithi157 ceph-mon[129604]: pgmap v718: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.9 MiB/s wr, 784 op/s 2023-08-10T11:14:03.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:03 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:03.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:03 smithi107 ceph-mon[127953]: pgmap v718: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.9 MiB/s wr, 784 op/s 2023-08-10T11:14:03.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:03 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:03.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:03 smithi195 ceph-mon[129938]: pgmap v718: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.9 MiB/s wr, 784 op/s 2023-08-10T11:14:05.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 270.0 s, 226.2 tps, lat 464.417 ms stddev 685.113 2023-08-10T11:14:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:06 smithi157 ceph-mon[129604]: pgmap v719: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-08-10T11:14:06.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:06 smithi107 ceph-mon[127953]: pgmap v719: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-08-10T11:14:06.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:06 smithi195 ceph-mon[129938]: pgmap v719: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-08-10T11:14:08.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:08 smithi157 ceph-mon[129604]: pgmap v720: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.0 MiB/s wr, 781 op/s 2023-08-10T11:14:08.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:08 smithi157 ceph-mon[129604]: osdmap e125: 12 total, 12 up, 12 in 2023-08-10T11:14:08.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:08 smithi107 ceph-mon[127953]: pgmap v720: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.0 MiB/s wr, 781 op/s 2023-08-10T11:14:08.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:08 smithi107 ceph-mon[127953]: osdmap e125: 12 total, 12 up, 12 in 2023-08-10T11:14:08.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:08 smithi195 ceph-mon[129938]: pgmap v720: 129 pgs: 129 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.0 MiB/s wr, 781 op/s 2023-08-10T11:14:08.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:08 smithi195 ceph-mon[129938]: osdmap e125: 12 total, 12 up, 12 in 2023-08-10T11:14:10.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:10 smithi157 ceph-mon[129604]: pgmap v722: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.1 MiB/s wr, 706 op/s 2023-08-10T11:14:10.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:10 smithi107 ceph-mon[127953]: pgmap v722: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.1 MiB/s wr, 706 op/s 2023-08-10T11:14:10.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:10 smithi195 ceph-mon[129938]: pgmap v722: 129 pgs: 10 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 94 active+clean; 18 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.1 MiB/s wr, 706 op/s 2023-08-10T11:14:10.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 275.0 s, 198.0 tps, lat 427.850 ms stddev 318.777 2023-08-10T11:14:11.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:11 smithi157 ceph-mon[129604]: pgmap v723: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.8 MiB/s wr, 656 op/s 2023-08-10T11:14:11.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:11 smithi107 ceph-mon[127953]: pgmap v723: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.8 MiB/s wr, 656 op/s 2023-08-10T11:14:11.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:11 smithi195 ceph-mon[129938]: pgmap v723: 129 pgs: 18 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 59 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.8 MiB/s wr, 656 op/s 2023-08-10T11:14:14.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:13 smithi157 ceph-mon[129604]: pgmap v724: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.8 MiB/s wr, 688 op/s 2023-08-10T11:14:14.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:13 smithi107 ceph-mon[127953]: pgmap v724: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.8 MiB/s wr, 688 op/s 2023-08-10T11:14:14.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:13 smithi195 ceph-mon[129938]: pgmap v724: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.8 MiB/s wr, 688 op/s 2023-08-10T11:14:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 280.0 s, 264.5 tps, lat 414.371 ms stddev 746.233 2023-08-10T11:14:16.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:16 smithi157 ceph-mon[129604]: pgmap v725: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.1 MiB/s wr, 592 op/s 2023-08-10T11:14:16.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:16 smithi107 ceph-mon[127953]: pgmap v725: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.1 MiB/s wr, 592 op/s 2023-08-10T11:14:16.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:16 smithi195 ceph-mon[129938]: pgmap v725: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.1 MiB/s wr, 592 op/s 2023-08-10T11:14:18.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:18 smithi157 ceph-mon[129604]: pgmap v726: 129 pgs: 129 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.2 MiB/s wr, 593 op/s 2023-08-10T11:14:18.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:18 smithi107 ceph-mon[127953]: pgmap v726: 129 pgs: 129 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.2 MiB/s wr, 593 op/s 2023-08-10T11:14:18.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:18 smithi195 ceph-mon[129938]: pgmap v726: 129 pgs: 129 active+clean; 17 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.2 MiB/s wr, 593 op/s 2023-08-10T11:14:19.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:19 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:19.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:19 smithi157 ceph-mon[129604]: osdmap e126: 12 total, 12 up, 12 in 2023-08-10T11:14:19.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:19 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:19.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:19 smithi107 ceph-mon[127953]: osdmap e126: 12 total, 12 up, 12 in 2023-08-10T11:14:19.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:19 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:19.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:19 smithi195 ceph-mon[129938]: osdmap e126: 12 total, 12 up, 12 in 2023-08-10T11:14:20.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:20 smithi157 ceph-mon[129604]: pgmap v727: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.8 MiB/s wr, 716 op/s 2023-08-10T11:14:20.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:20 smithi107 ceph-mon[127953]: pgmap v727: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.8 MiB/s wr, 716 op/s 2023-08-10T11:14:20.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:20 smithi195 ceph-mon[129938]: pgmap v727: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.8 MiB/s wr, 716 op/s 2023-08-10T11:14:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 285.0 s, 285.8 tps, lat 355.946 ms stddev 442.715 2023-08-10T11:14:21.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:21 smithi107 ceph-mon[127953]: pgmap v729: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.5 MiB/s wr, 688 op/s 2023-08-10T11:14:21.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:21 smithi195 ceph-mon[129938]: pgmap v729: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.5 MiB/s wr, 688 op/s 2023-08-10T11:14:21.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:21 smithi157 ceph-mon[129604]: pgmap v729: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.5 MiB/s wr, 688 op/s 2023-08-10T11:14:23.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:23 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:23.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:23 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:14:23.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:23 smithi157 ceph-mon[129604]: pgmap v730: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.8 MiB/s wr, 705 op/s 2023-08-10T11:14:23.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:23 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:23.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:23 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:14:23.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:23 smithi107 ceph-mon[127953]: pgmap v730: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.8 MiB/s wr, 705 op/s 2023-08-10T11:14:23.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:23 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:23.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:23 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:14:23.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:23 smithi195 ceph-mon[129938]: pgmap v730: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.8 MiB/s wr, 705 op/s 2023-08-10T11:14:25.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 290.0 s, 330.7 tps, lat 311.487 ms stddev 286.805 2023-08-10T11:14:26.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:26 smithi157 ceph-mon[129604]: pgmap v731: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.2 MiB/s wr, 823 op/s 2023-08-10T11:14:26.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:14:26.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:14:26.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:14:26.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:26 smithi107 ceph-mon[127953]: pgmap v731: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.2 MiB/s wr, 823 op/s 2023-08-10T11:14:26.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:14:26.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:14:26.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:14:26.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:26 smithi195 ceph-mon[129938]: pgmap v731: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.2 MiB/s wr, 823 op/s 2023-08-10T11:14:26.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:14:26.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:14:26.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:14:28.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:28 smithi157 ceph-mon[129604]: pgmap v732: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.2 MiB/s wr, 833 op/s 2023-08-10T11:14:28.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:28 smithi107 ceph-mon[127953]: pgmap v732: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.2 MiB/s wr, 833 op/s 2023-08-10T11:14:28.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:28 smithi195 ceph-mon[129938]: pgmap v732: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.2 MiB/s wr, 833 op/s 2023-08-10T11:14:30.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:30 smithi157 ceph-mon[129604]: pgmap v733: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.6 MiB/s wr, 852 op/s 2023-08-10T11:14:30.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:30 smithi107 ceph-mon[127953]: pgmap v733: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.6 MiB/s wr, 852 op/s 2023-08-10T11:14:30.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:30 smithi195 ceph-mon[129938]: pgmap v733: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.6 MiB/s wr, 852 op/s 2023-08-10T11:14:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 295.0 s, 274.1 tps, lat 367.028 ms stddev 190.498 2023-08-10T11:14:32.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:32 smithi157 ceph-mon[129604]: pgmap v734: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 772 op/s 2023-08-10T11:14:32.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:32 smithi107 ceph-mon[127953]: pgmap v734: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 772 op/s 2023-08-10T11:14:32.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:32 smithi195 ceph-mon[129938]: pgmap v734: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.9 MiB/s wr, 772 op/s 2023-08-10T11:14:34.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:34 smithi157 ceph-mon[129604]: pgmap v735: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.0 MiB/s wr, 768 op/s 2023-08-10T11:14:34.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:34 smithi107 ceph-mon[127953]: pgmap v735: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.0 MiB/s wr, 768 op/s 2023-08-10T11:14:34.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:34 smithi195 ceph-mon[129938]: pgmap v735: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.0 MiB/s wr, 768 op/s 2023-08-10T11:14:35.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 300.0 s, 286.5 tps, lat 346.980 ms stddev 133.719 2023-08-10T11:14:36.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:36 smithi157 ceph-mon[129604]: pgmap v736: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 1.06k op/s 2023-08-10T11:14:36.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:36 smithi107 ceph-mon[127953]: pgmap v736: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 1.06k op/s 2023-08-10T11:14:36.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:36 smithi195 ceph-mon[129938]: pgmap v736: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 11 MiB/s wr, 1.06k op/s 2023-08-10T11:14:37.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:37 smithi157 ceph-mon[129604]: pgmap v737: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.5 MiB/s wr, 793 op/s 2023-08-10T11:14:37.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:37 smithi107 ceph-mon[127953]: pgmap v737: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.5 MiB/s wr, 793 op/s 2023-08-10T11:14:37.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:37 smithi195 ceph-mon[129938]: pgmap v737: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.5 MiB/s wr, 793 op/s 2023-08-10T11:14:40.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:40 smithi157 ceph-mon[129604]: pgmap v738: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.5 MiB/s wr, 952 op/s 2023-08-10T11:14:40.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:40 smithi107 ceph-mon[127953]: pgmap v738: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.5 MiB/s wr, 952 op/s 2023-08-10T11:14:40.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:40 smithi195 ceph-mon[129938]: pgmap v738: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.5 MiB/s wr, 952 op/s 2023-08-10T11:14:40.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 305.0 s, 270.1 tps, lat 372.236 ms stddev 451.540 2023-08-10T11:14:42.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:42 smithi157 ceph-mon[129604]: pgmap v739: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.6 MiB/s wr, 830 op/s 2023-08-10T11:14:42.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:42 smithi107 ceph-mon[127953]: pgmap v739: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.6 MiB/s wr, 830 op/s 2023-08-10T11:14:42.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:42 smithi195 ceph-mon[129938]: pgmap v739: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.6 MiB/s wr, 830 op/s 2023-08-10T11:14:44.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:44 smithi157 ceph-mon[129604]: pgmap v740: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 754 op/s 2023-08-10T11:14:44.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:44 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:44.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:44 smithi107 ceph-mon[127953]: pgmap v740: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 754 op/s 2023-08-10T11:14:44.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:44 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:44.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:44 smithi195 ceph-mon[129938]: pgmap v740: 129 pgs: 129 active+clean; 17 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 754 op/s 2023-08-10T11:14:44.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:44 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:45.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 310.0 s, 292.7 tps, lat 343.857 ms stddev 145.889 2023-08-10T11:14:46.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:46 smithi157 ceph-mon[129604]: pgmap v741: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-08-10T11:14:46.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:46 smithi107 ceph-mon[127953]: pgmap v741: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-08-10T11:14:46.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:46 smithi195 ceph-mon[129938]: pgmap v741: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-08-10T11:14:48.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:48 smithi157 ceph-mon[129604]: pgmap v742: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.0 MiB/s wr, 717 op/s 2023-08-10T11:14:48.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:48 smithi107 ceph-mon[127953]: pgmap v742: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.0 MiB/s wr, 717 op/s 2023-08-10T11:14:48.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:48 smithi195 ceph-mon[129938]: pgmap v742: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.0 MiB/s wr, 717 op/s 2023-08-10T11:14:50.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:50 smithi157 ceph-mon[129604]: pgmap v743: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.9 MiB/s wr, 895 op/s 2023-08-10T11:14:50.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:50 smithi107 ceph-mon[127953]: pgmap v743: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.9 MiB/s wr, 895 op/s 2023-08-10T11:14:50.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:50 smithi195 ceph-mon[129938]: pgmap v743: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.9 MiB/s wr, 895 op/s 2023-08-10T11:14:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 315.0 s, 290.8 tps, lat 344.868 ms stddev 163.768 2023-08-10T11:14:52.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:52 smithi157 ceph-mon[129604]: pgmap v744: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 800 op/s 2023-08-10T11:14:52.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:52 smithi107 ceph-mon[127953]: pgmap v744: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 800 op/s 2023-08-10T11:14:52.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:52 smithi195 ceph-mon[129938]: pgmap v744: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 800 op/s 2023-08-10T11:14:54.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:54 smithi157 ceph-mon[129604]: pgmap v745: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 750 op/s 2023-08-10T11:14:54.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:54 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:54.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:54 smithi107 ceph-mon[127953]: pgmap v745: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 750 op/s 2023-08-10T11:14:54.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:54 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:54.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:54 smithi195 ceph-mon[129938]: pgmap v745: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 750 op/s 2023-08-10T11:14:54.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:54 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:14:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 320.0 s, 105.0 tps, lat 961.373 ms stddev 1328.592 2023-08-10T11:14:56.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:56 smithi157 ceph-mon[129604]: pgmap v746: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.9 MiB/s wr, 916 op/s 2023-08-10T11:14:56.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:56 smithi107 ceph-mon[127953]: pgmap v746: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.9 MiB/s wr, 916 op/s 2023-08-10T11:14:56.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:56 smithi195 ceph-mon[129938]: pgmap v746: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.9 MiB/s wr, 916 op/s 2023-08-10T11:14:58.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:14:58 smithi157 ceph-mon[129604]: pgmap v747: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 636 op/s 2023-08-10T11:14:58.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:14:58 smithi107 ceph-mon[127953]: pgmap v747: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 636 op/s 2023-08-10T11:14:58.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:14:58 smithi195 ceph-mon[129938]: pgmap v747: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 636 op/s 2023-08-10T11:15:00.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:00 smithi107 ceph-mon[127953]: pgmap v748: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.4 MiB/s wr, 757 op/s 2023-08-10T11:15:00.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:00 smithi195 ceph-mon[129938]: pgmap v748: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.4 MiB/s wr, 757 op/s 2023-08-10T11:15:00.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:00 smithi157 ceph-mon[129604]: pgmap v748: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.4 MiB/s wr, 757 op/s 2023-08-10T11:15:00.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 325.0 s, 301.0 tps, lat 331.355 ms stddev 128.128 2023-08-10T11:15:01.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:01 smithi195 ceph-mon[129938]: pgmap v749: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.1 MiB/s wr, 621 op/s 2023-08-10T11:15:01.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:01 smithi157 ceph-mon[129604]: pgmap v749: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.1 MiB/s wr, 621 op/s 2023-08-10T11:15:01.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:01 smithi107 ceph-mon[127953]: pgmap v749: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.1 MiB/s wr, 621 op/s 2023-08-10T11:15:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:03 smithi157 ceph-mon[129604]: pgmap v750: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 561 op/s 2023-08-10T11:15:04.333 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:03 smithi107 ceph-mon[127953]: pgmap v750: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 561 op/s 2023-08-10T11:15:04.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:03 smithi195 ceph-mon[129938]: pgmap v750: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 561 op/s 2023-08-10T11:15:05.802 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 330.0 s, 239.2 tps, lat 402.906 ms stddev 312.744 2023-08-10T11:15:06.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:06 smithi157 ceph-mon[129604]: pgmap v751: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.2 MiB/s wr, 832 op/s 2023-08-10T11:15:06.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:06 smithi107 ceph-mon[127953]: pgmap v751: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.2 MiB/s wr, 832 op/s 2023-08-10T11:15:06.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:06 smithi195 ceph-mon[129938]: pgmap v751: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.2 MiB/s wr, 832 op/s 2023-08-10T11:15:08.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:08 smithi107 ceph-mon[127953]: pgmap v752: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.8 MiB/s wr, 669 op/s 2023-08-10T11:15:08.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:08 smithi107 ceph-mon[127953]: osdmap e127: 12 total, 12 up, 12 in 2023-08-10T11:15:08.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:08 smithi195 ceph-mon[129938]: pgmap v752: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.8 MiB/s wr, 669 op/s 2023-08-10T11:15:08.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:08 smithi195 ceph-mon[129938]: osdmap e127: 12 total, 12 up, 12 in 2023-08-10T11:15:08.802 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:08 smithi157 ceph-mon[129604]: pgmap v752: 129 pgs: 129 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.8 MiB/s wr, 669 op/s 2023-08-10T11:15:08.802 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:08 smithi157 ceph-mon[129604]: osdmap e127: 12 total, 12 up, 12 in 2023-08-10T11:15:10.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:10 smithi107 ceph-mon[127953]: pgmap v754: 129 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 95 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.6 MiB/s wr, 732 op/s 2023-08-10T11:15:10.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:10 smithi195 ceph-mon[129938]: pgmap v754: 129 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 95 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.6 MiB/s wr, 732 op/s 2023-08-10T11:15:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:10 smithi157 ceph-mon[129604]: pgmap v754: 129 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 95 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.6 MiB/s wr, 732 op/s 2023-08-10T11:15:10.804 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 335.0 s, 115.9 tps, lat 764.999 ms stddev 488.471 2023-08-10T11:15:12.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:12 smithi195 ceph-mon[129938]: pgmap v755: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 698 op/s 2023-08-10T11:15:12.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:12 smithi157 ceph-mon[129604]: pgmap v755: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 698 op/s 2023-08-10T11:15:12.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:12 smithi107 ceph-mon[127953]: pgmap v755: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 698 op/s 2023-08-10T11:15:13.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:13 smithi195 ceph-mon[129938]: pgmap v756: 129 pgs: 19 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 61 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 655 op/s 2023-08-10T11:15:13.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:13 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:15:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:13 smithi157 ceph-mon[129604]: pgmap v756: 129 pgs: 19 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 61 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 655 op/s 2023-08-10T11:15:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:13 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:15:13.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:13 smithi107 ceph-mon[127953]: pgmap v756: 129 pgs: 19 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 61 active+clean; 17 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 655 op/s 2023-08-10T11:15:13.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:13 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:15:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 340.0 s, 193.5 tps, lat 567.306 ms stddev 422.889 2023-08-10T11:15:16.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:16 smithi157 ceph-mon[129604]: pgmap v757: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 457 op/s 2023-08-10T11:15:16.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:16 smithi107 ceph-mon[127953]: pgmap v757: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 457 op/s 2023-08-10T11:15:16.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:16 smithi195 ceph-mon[129938]: pgmap v757: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 457 op/s 2023-08-10T11:15:18.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:18 smithi157 ceph-mon[129604]: pgmap v758: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 447 op/s 2023-08-10T11:15:18.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:18 smithi107 ceph-mon[127953]: pgmap v758: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 447 op/s 2023-08-10T11:15:18.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:18 smithi195 ceph-mon[129938]: pgmap v758: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 447 op/s 2023-08-10T11:15:19.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:19 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:15:19.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:19 smithi107 ceph-mon[127953]: osdmap e128: 12 total, 12 up, 12 in 2023-08-10T11:15:19.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:19 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:15:19.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:19 smithi195 ceph-mon[129938]: osdmap e128: 12 total, 12 up, 12 in 2023-08-10T11:15:19.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:19 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:15:19.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:19 smithi157 ceph-mon[129604]: osdmap e128: 12 total, 12 up, 12 in 2023-08-10T11:15:20.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:20 smithi195 ceph-mon[129938]: pgmap v759: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 569 op/s 2023-08-10T11:15:20.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:20 smithi157 ceph-mon[129604]: pgmap v759: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 569 op/s 2023-08-10T11:15:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 345.0 s, 233.0 tps, lat 248.953 ms stddev 126.799 2023-08-10T11:15:20.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:20 smithi107 ceph-mon[127953]: pgmap v759: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 569 op/s 2023-08-10T11:15:21.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:21 smithi195 ceph-mon[129938]: pgmap v761: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 572 op/s 2023-08-10T11:15:21.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:21 smithi157 ceph-mon[129604]: pgmap v761: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 572 op/s 2023-08-10T11:15:21.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:21 smithi107 ceph-mon[127953]: pgmap v761: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 572 op/s 2023-08-10T11:15:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:24 smithi157 ceph-mon[129604]: pgmap v762: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.7 MiB/s wr, 597 op/s 2023-08-10T11:15:24.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:24 smithi107 ceph-mon[127953]: pgmap v762: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.7 MiB/s wr, 597 op/s 2023-08-10T11:15:24.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:24 smithi195 ceph-mon[129938]: pgmap v762: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.7 MiB/s wr, 597 op/s 2023-08-10T11:15:25.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:25 smithi157 ceph-mon[129604]: osdmap e129: 12 total, 12 up, 12 in 2023-08-10T11:15:25.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:25 smithi107 ceph-mon[127953]: osdmap e129: 12 total, 12 up, 12 in 2023-08-10T11:15:25.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:25 smithi195 ceph-mon[129938]: osdmap e129: 12 total, 12 up, 12 in 2023-08-10T11:15:25.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 350.0 s, 191.8 tps, lat 301.097 ms stddev 167.252 2023-08-10T11:15:26.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:26 smithi107 ceph-mon[127953]: pgmap v764: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.9 MiB/s wr, 913 op/s 2023-08-10T11:15:26.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:15:26.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:26 smithi195 ceph-mon[129938]: pgmap v764: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.9 MiB/s wr, 913 op/s 2023-08-10T11:15:26.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:15:26.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:26 smithi157 ceph-mon[129604]: pgmap v764: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.9 MiB/s wr, 913 op/s 2023-08-10T11:15:26.795 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:15:28.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:28 smithi107 ceph-mon[127953]: pgmap v765: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.3 MiB/s wr, 705 op/s 2023-08-10T11:15:28.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:28 smithi195 ceph-mon[129938]: pgmap v765: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.3 MiB/s wr, 705 op/s 2023-08-10T11:15:28.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:28 smithi157 ceph-mon[129604]: pgmap v765: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.3 MiB/s wr, 705 op/s 2023-08-10T11:15:30.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:30 smithi195 ceph-mon[129938]: pgmap v766: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.8 MiB/s wr, 774 op/s 2023-08-10T11:15:30.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:30 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:15:30.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:30 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:15:30.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:30 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:15:30.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:30 smithi157 ceph-mon[129604]: pgmap v766: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.8 MiB/s wr, 774 op/s 2023-08-10T11:15:30.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:30 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:15:30.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:30 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:15:30.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:30 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:15:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 355.0 s, 254.8 tps, lat 726.134 ms stddev 2156.707 2023-08-10T11:15:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:30 smithi107 ceph-mon[127953]: pgmap v766: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.8 MiB/s wr, 774 op/s 2023-08-10T11:15:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:30 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:15:30.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:30 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:15:30.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:30 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:15:32.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:32 smithi195 ceph-mon[129938]: pgmap v767: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.6 MiB/s wr, 831 op/s 2023-08-10T11:15:32.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:32 smithi157 ceph-mon[129604]: pgmap v767: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.6 MiB/s wr, 831 op/s 2023-08-10T11:15:32.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:32 smithi107 ceph-mon[127953]: pgmap v767: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.6 MiB/s wr, 831 op/s 2023-08-10T11:15:33.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:33 smithi157 ceph-mon[129604]: pgmap v768: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.6 MiB/s wr, 833 op/s 2023-08-10T11:15:33.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:33 smithi107 ceph-mon[127953]: pgmap v768: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.6 MiB/s wr, 833 op/s 2023-08-10T11:15:33.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:33 smithi195 ceph-mon[129938]: pgmap v768: 129 pgs: 129 active+clean; 16 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.6 MiB/s wr, 833 op/s 2023-08-10T11:15:35.807 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 360.0 s, 343.2 tps, lat 302.040 ms stddev 146.854 2023-08-10T11:15:36.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:36 smithi157 ceph-mon[129604]: pgmap v769: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.8 MiB/s wr, 874 op/s 2023-08-10T11:15:36.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:36 smithi107 ceph-mon[127953]: pgmap v769: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.8 MiB/s wr, 874 op/s 2023-08-10T11:15:36.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:36 smithi195 ceph-mon[129938]: pgmap v769: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.8 MiB/s wr, 874 op/s 2023-08-10T11:15:38.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:38 smithi107 ceph-mon[127953]: pgmap v770: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.7 MiB/s wr, 764 op/s 2023-08-10T11:15:38.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:38 smithi195 ceph-mon[129938]: pgmap v770: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.7 MiB/s wr, 764 op/s 2023-08-10T11:15:38.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:38 smithi157 ceph-mon[129604]: pgmap v770: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.7 MiB/s wr, 764 op/s 2023-08-10T11:15:40.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:40 smithi107 ceph-mon[127953]: pgmap v771: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.3 MiB/s wr, 928 op/s 2023-08-10T11:15:40.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:40 smithi195 ceph-mon[129938]: pgmap v771: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.3 MiB/s wr, 928 op/s 2023-08-10T11:15:40.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:40 smithi157 ceph-mon[129604]: pgmap v771: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.3 MiB/s wr, 928 op/s 2023-08-10T11:15:40.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 365.0 s, 329.2 tps, lat 306.387 ms stddev 108.169 2023-08-10T11:15:42.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:42 smithi195 ceph-mon[129938]: pgmap v772: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 819 op/s 2023-08-10T11:15:42.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:42 smithi157 ceph-mon[129604]: pgmap v772: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 819 op/s 2023-08-10T11:15:42.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:42 smithi107 ceph-mon[127953]: pgmap v772: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 819 op/s 2023-08-10T11:15:44.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:44 smithi195 ceph-mon[129938]: pgmap v773: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.1 MiB/s wr, 755 op/s 2023-08-10T11:15:44.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:44 smithi157 ceph-mon[129604]: pgmap v773: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.1 MiB/s wr, 755 op/s 2023-08-10T11:15:44.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:44 smithi107 ceph-mon[127953]: pgmap v773: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.1 MiB/s wr, 755 op/s 2023-08-10T11:15:45.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:45 smithi157 ceph-mon[129604]: pgmap v774: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-08-10T11:15:45.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 370.0 s, 306.2 tps, lat 316.357 ms stddev 138.072 2023-08-10T11:15:45.836 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:45 smithi107 ceph-mon[127953]: pgmap v774: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-08-10T11:15:45.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:45 smithi195 ceph-mon[129938]: pgmap v774: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-08-10T11:15:48.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:48 smithi157 ceph-mon[129604]: pgmap v775: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.8 MiB/s wr, 736 op/s 2023-08-10T11:15:48.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:48 smithi107 ceph-mon[127953]: pgmap v775: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.8 MiB/s wr, 736 op/s 2023-08-10T11:15:48.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:48 smithi195 ceph-mon[129938]: pgmap v775: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.8 MiB/s wr, 736 op/s 2023-08-10T11:15:50.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:50 smithi157 ceph-mon[129604]: pgmap v776: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.9 MiB/s wr, 898 op/s 2023-08-10T11:15:50.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:50 smithi107 ceph-mon[127953]: pgmap v776: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.9 MiB/s wr, 898 op/s 2023-08-10T11:15:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:50 smithi195 ceph-mon[129938]: pgmap v776: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.9 MiB/s wr, 898 op/s 2023-08-10T11:15:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 375.0 s, 257.2 tps, lat 393.921 ms stddev 125.715 2023-08-10T11:15:52.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:52 smithi107 ceph-mon[127953]: pgmap v777: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.5 MiB/s wr, 798 op/s 2023-08-10T11:15:52.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:52 smithi195 ceph-mon[129938]: pgmap v777: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.5 MiB/s wr, 798 op/s 2023-08-10T11:15:52.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:52 smithi157 ceph-mon[129604]: pgmap v777: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.5 MiB/s wr, 798 op/s 2023-08-10T11:15:54.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:54 smithi107 ceph-mon[127953]: pgmap v778: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.6 MiB/s wr, 737 op/s 2023-08-10T11:15:54.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:54 smithi195 ceph-mon[129938]: pgmap v778: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.6 MiB/s wr, 737 op/s 2023-08-10T11:15:54.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:54 smithi157 ceph-mon[129604]: pgmap v778: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.6 MiB/s wr, 737 op/s 2023-08-10T11:15:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 380.0 s, 281.2 tps, lat 353.763 ms stddev 138.755 2023-08-10T11:15:56.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:56 smithi195 ceph-mon[129938]: pgmap v779: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 993 op/s 2023-08-10T11:15:56.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:56 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:15:56.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:56 smithi157 ceph-mon[129604]: pgmap v779: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 993 op/s 2023-08-10T11:15:56.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:56 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:15:56.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:56 smithi107 ceph-mon[127953]: pgmap v779: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 993 op/s 2023-08-10T11:15:56.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:56 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:15:58.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:15:58 smithi195 ceph-mon[129938]: pgmap v780: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.7 MiB/s wr, 733 op/s 2023-08-10T11:15:58.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:15:58 smithi157 ceph-mon[129604]: pgmap v780: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.7 MiB/s wr, 733 op/s 2023-08-10T11:15:58.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:15:58 smithi107 ceph-mon[127953]: pgmap v780: 129 pgs: 129 active+clean; 16 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.7 MiB/s wr, 733 op/s 2023-08-10T11:16:00.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:00 smithi157 ceph-mon[129604]: pgmap v781: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.4 MiB/s wr, 909 op/s 2023-08-10T11:16:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:00 smithi107 ceph-mon[127953]: pgmap v781: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.4 MiB/s wr, 909 op/s 2023-08-10T11:16:00.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:00 smithi195 ceph-mon[129938]: pgmap v781: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.4 MiB/s wr, 909 op/s 2023-08-10T11:16:00.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 385.0 s, 313.2 tps, lat 321.485 ms stddev 172.580 2023-08-10T11:16:01.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:01 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:01.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:01 smithi157 ceph-mon[129604]: pgmap v782: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.7 MiB/s wr, 812 op/s 2023-08-10T11:16:01.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:01 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:01.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:01 smithi107 ceph-mon[127953]: pgmap v782: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.7 MiB/s wr, 812 op/s 2023-08-10T11:16:01.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:01 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:01.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:01 smithi195 ceph-mon[129938]: pgmap v782: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.7 MiB/s wr, 812 op/s 2023-08-10T11:16:04.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:04 smithi157 ceph-mon[129604]: pgmap v783: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 765 op/s 2023-08-10T11:16:04.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:04 smithi107 ceph-mon[127953]: pgmap v783: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 765 op/s 2023-08-10T11:16:04.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:04 smithi195 ceph-mon[129938]: pgmap v783: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.5 MiB/s wr, 765 op/s 2023-08-10T11:16:05.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 390.0 s, 280.0 tps, lat 336.422 ms stddev 281.828 2023-08-10T11:16:06.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:06 smithi107 ceph-mon[127953]: pgmap v784: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-08-10T11:16:06.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:06 smithi195 ceph-mon[129938]: pgmap v784: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-08-10T11:16:06.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:06 smithi157 ceph-mon[129604]: pgmap v784: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-08-10T11:16:08.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:08 smithi195 ceph-mon[129938]: pgmap v785: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.1 MiB/s wr, 764 op/s 2023-08-10T11:16:08.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:08 smithi195 ceph-mon[129938]: osdmap e130: 12 total, 12 up, 12 in 2023-08-10T11:16:08.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:08 smithi157 ceph-mon[129604]: pgmap v785: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.1 MiB/s wr, 764 op/s 2023-08-10T11:16:08.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:08 smithi157 ceph-mon[129604]: osdmap e130: 12 total, 12 up, 12 in 2023-08-10T11:16:08.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:08 smithi107 ceph-mon[127953]: pgmap v785: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.1 MiB/s wr, 764 op/s 2023-08-10T11:16:08.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:08 smithi107 ceph-mon[127953]: osdmap e130: 12 total, 12 up, 12 in 2023-08-10T11:16:10.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:10 smithi107 ceph-mon[127953]: pgmap v787: 129 pgs: 10 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 93 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.9 MiB/s wr, 767 op/s 2023-08-10T11:16:10.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:10 smithi195 ceph-mon[129938]: pgmap v787: 129 pgs: 10 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 93 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.9 MiB/s wr, 767 op/s 2023-08-10T11:16:10.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 395.0 s, 149.0 tps, lat 459.685 ms stddev 664.477 2023-08-10T11:16:12.186 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:10 smithi157 ceph-mon[129604]: pgmap v787: 129 pgs: 10 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 93 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.9 MiB/s wr, 767 op/s 2023-08-10T11:16:12.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:12 smithi195 ceph-mon[129938]: pgmap v788: 129 pgs: 18 active+clean+snaptrim, 46 active+clean+snaptrim_wait, 65 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 727 op/s 2023-08-10T11:16:12.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:12 smithi157 ceph-mon[129604]: pgmap v788: 129 pgs: 18 active+clean+snaptrim, 46 active+clean+snaptrim_wait, 65 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 727 op/s 2023-08-10T11:16:12.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:12 smithi107 ceph-mon[127953]: pgmap v788: 129 pgs: 18 active+clean+snaptrim, 46 active+clean+snaptrim_wait, 65 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 727 op/s 2023-08-10T11:16:13.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:13 smithi157 ceph-mon[129604]: pgmap v789: 129 pgs: 20 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 58 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.9 MiB/s wr, 678 op/s 2023-08-10T11:16:13.834 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:13 smithi107 ceph-mon[127953]: pgmap v789: 129 pgs: 20 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 58 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.9 MiB/s wr, 678 op/s 2023-08-10T11:16:13.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:13 smithi195 ceph-mon[129938]: pgmap v789: 129 pgs: 20 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 58 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.9 MiB/s wr, 678 op/s 2023-08-10T11:16:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 400.0 s, 150.6 tps, lat 849.090 ms stddev 1775.037 2023-08-10T11:16:16.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:16 smithi195 ceph-mon[129938]: pgmap v790: 129 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 112 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 483 op/s 2023-08-10T11:16:16.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:16 smithi157 ceph-mon[129604]: pgmap v790: 129 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 112 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 483 op/s 2023-08-10T11:16:16.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:16 smithi107 ceph-mon[127953]: pgmap v790: 129 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 112 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 483 op/s 2023-08-10T11:16:18.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:18 smithi195 ceph-mon[129938]: pgmap v791: 129 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 112 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 441 op/s 2023-08-10T11:16:18.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:18 smithi157 ceph-mon[129604]: pgmap v791: 129 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 112 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 441 op/s 2023-08-10T11:16:18.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:18 smithi107 ceph-mon[127953]: pgmap v791: 129 pgs: 5 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 112 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 441 op/s 2023-08-10T11:16:20.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:20 smithi195 ceph-mon[129938]: pgmap v792: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 580 op/s 2023-08-10T11:16:20.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:20 smithi157 ceph-mon[129604]: pgmap v792: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 580 op/s 2023-08-10T11:16:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 405.0 s, 235.2 tps, lat 414.826 ms stddev 429.235 2023-08-10T11:16:20.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:20 smithi107 ceph-mon[127953]: pgmap v792: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 580 op/s 2023-08-10T11:16:21.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:21 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:21.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:21 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:21.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:21 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:22.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:22 smithi195 ceph-mon[129938]: pgmap v793: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 513 op/s 2023-08-10T11:16:22.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:22 smithi157 ceph-mon[129604]: pgmap v793: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 513 op/s 2023-08-10T11:16:22.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:22 smithi107 ceph-mon[127953]: pgmap v793: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 513 op/s 2023-08-10T11:16:24.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:24 smithi157 ceph-mon[129604]: pgmap v794: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 469 op/s 2023-08-10T11:16:24.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:24 smithi157 ceph-mon[129604]: osdmap e131: 12 total, 12 up, 12 in 2023-08-10T11:16:24.834 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:24 smithi107 ceph-mon[127953]: pgmap v794: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 469 op/s 2023-08-10T11:16:24.834 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:24 smithi107 ceph-mon[127953]: osdmap e131: 12 total, 12 up, 12 in 2023-08-10T11:16:24.919 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:24 smithi195 ceph-mon[129938]: pgmap v794: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.7 MiB/s wr, 469 op/s 2023-08-10T11:16:24.920 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:24 smithi195 ceph-mon[129938]: osdmap e131: 12 total, 12 up, 12 in 2023-08-10T11:16:25.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:25 smithi157 ceph-mon[129604]: pgmap v796: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 637 op/s 2023-08-10T11:16:25.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 410.0 s, 222.6 tps, lat 494.699 ms stddev 763.087 2023-08-10T11:16:25.832 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:25 smithi107 ceph-mon[127953]: pgmap v796: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 637 op/s 2023-08-10T11:16:25.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:25 smithi195 ceph-mon[129938]: pgmap v796: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 637 op/s 2023-08-10T11:16:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:28 smithi107 ceph-mon[127953]: pgmap v797: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 637 op/s 2023-08-10T11:16:28.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:28 smithi195 ceph-mon[129938]: pgmap v797: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 637 op/s 2023-08-10T11:16:28.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:28 smithi157 ceph-mon[129604]: pgmap v797: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 637 op/s 2023-08-10T11:16:30.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:30 smithi107 ceph-mon[127953]: pgmap v798: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.5 MiB/s wr, 707 op/s 2023-08-10T11:16:30.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:30 smithi195 ceph-mon[129938]: pgmap v798: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.5 MiB/s wr, 707 op/s 2023-08-10T11:16:30.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:30 smithi157 ceph-mon[129604]: pgmap v798: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.5 MiB/s wr, 707 op/s 2023-08-10T11:16:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 415.0 s, 282.4 tps, lat 352.644 ms stddev 304.846 2023-08-10T11:16:31.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:31 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:16:31.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:31 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:16:31.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:31 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:16:32.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:32 smithi195 ceph-mon[129938]: pgmap v799: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.2 MiB/s wr, 746 op/s 2023-08-10T11:16:32.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:32 smithi157 ceph-mon[129604]: pgmap v799: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.2 MiB/s wr, 746 op/s 2023-08-10T11:16:32.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:32 smithi107 ceph-mon[127953]: pgmap v799: 129 pgs: 129 active+clean; 16 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.2 MiB/s wr, 746 op/s 2023-08-10T11:16:34.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:34 smithi195 ceph-mon[129938]: pgmap v800: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.1 MiB/s wr, 762 op/s 2023-08-10T11:16:34.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:34 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:16:34.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:34 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:16:34.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:34 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:16:34.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:34 smithi157 ceph-mon[129604]: pgmap v800: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.1 MiB/s wr, 762 op/s 2023-08-10T11:16:34.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:34 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:16:34.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:34 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:16:34.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:34 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:16:34.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:34 smithi107 ceph-mon[127953]: pgmap v800: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.1 MiB/s wr, 762 op/s 2023-08-10T11:16:34.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:34 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:16:34.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:34 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:16:34.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:34 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:16:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 420.0 s, 250.1 tps, lat 410.235 ms stddev 195.966 2023-08-10T11:16:36.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:36 smithi195 ceph-mon[129938]: pgmap v801: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 822 op/s 2023-08-10T11:16:36.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:36 smithi157 ceph-mon[129604]: pgmap v801: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 822 op/s 2023-08-10T11:16:36.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:36 smithi107 ceph-mon[127953]: pgmap v801: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 822 op/s 2023-08-10T11:16:38.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:38 smithi157 ceph-mon[129604]: pgmap v802: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 694 op/s 2023-08-10T11:16:38.834 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:38 smithi107 ceph-mon[127953]: pgmap v802: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 694 op/s 2023-08-10T11:16:38.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:38 smithi195 ceph-mon[129938]: pgmap v802: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 694 op/s 2023-08-10T11:16:40.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:40 smithi157 ceph-mon[129604]: pgmap v803: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.7 MiB/s wr, 953 op/s 2023-08-10T11:16:40.802 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 425.0 s, 247.3 tps, lat 388.176 ms stddev 150.077 2023-08-10T11:16:40.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:40 smithi107 ceph-mon[127953]: pgmap v803: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.7 MiB/s wr, 953 op/s 2023-08-10T11:16:40.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:40 smithi195 ceph-mon[129938]: pgmap v803: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.7 MiB/s wr, 953 op/s 2023-08-10T11:16:42.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:42 smithi157 ceph-mon[129604]: pgmap v804: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-08-10T11:16:42.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:42 smithi107 ceph-mon[127953]: pgmap v804: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-08-10T11:16:42.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:42 smithi195 ceph-mon[129938]: pgmap v804: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-08-10T11:16:43.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:43 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:43.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:43 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:43.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:43 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:44 smithi157 ceph-mon[129604]: pgmap v805: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.5 MiB/s wr, 690 op/s 2023-08-10T11:16:44.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:44 smithi107 ceph-mon[127953]: pgmap v805: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.5 MiB/s wr, 690 op/s 2023-08-10T11:16:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:44 smithi195 ceph-mon[129938]: pgmap v805: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.5 MiB/s wr, 690 op/s 2023-08-10T11:16:45.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 430.0 s, 261.0 tps, lat 390.022 ms stddev 131.692 2023-08-10T11:16:45.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:45 smithi107 ceph-mon[127953]: pgmap v806: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.5 MiB/s wr, 964 op/s 2023-08-10T11:16:45.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:45 smithi195 ceph-mon[129938]: pgmap v806: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.5 MiB/s wr, 964 op/s 2023-08-10T11:16:46.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:45 smithi157 ceph-mon[129604]: pgmap v806: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.5 MiB/s wr, 964 op/s 2023-08-10T11:16:48.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:48 smithi107 ceph-mon[127953]: pgmap v807: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 679 op/s 2023-08-10T11:16:48.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:48 smithi195 ceph-mon[129938]: pgmap v807: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 679 op/s 2023-08-10T11:16:48.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:48 smithi157 ceph-mon[129604]: pgmap v807: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 679 op/s 2023-08-10T11:16:50.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:50 smithi195 ceph-mon[129938]: pgmap v808: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.7 MiB/s wr, 961 op/s 2023-08-10T11:16:50.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:50 smithi157 ceph-mon[129604]: pgmap v808: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.7 MiB/s wr, 961 op/s 2023-08-10T11:16:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 435.0 s, 278.6 tps, lat 366.851 ms stddev 143.744 2023-08-10T11:16:50.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:50 smithi107 ceph-mon[127953]: pgmap v808: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.7 MiB/s wr, 961 op/s 2023-08-10T11:16:52.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:52 smithi195 ceph-mon[129938]: pgmap v809: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.0 MiB/s wr, 768 op/s 2023-08-10T11:16:52.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:52 smithi157 ceph-mon[129604]: pgmap v809: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.0 MiB/s wr, 768 op/s 2023-08-10T11:16:52.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:52 smithi107 ceph-mon[127953]: pgmap v809: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.0 MiB/s wr, 768 op/s 2023-08-10T11:16:54.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:54 smithi195 ceph-mon[129938]: pgmap v810: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.9 MiB/s wr, 738 op/s 2023-08-10T11:16:54.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:54 smithi157 ceph-mon[129604]: pgmap v810: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.9 MiB/s wr, 738 op/s 2023-08-10T11:16:54.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:54 smithi107 ceph-mon[127953]: pgmap v810: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.9 MiB/s wr, 738 op/s 2023-08-10T11:16:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 440.0 s, 291.6 tps, lat 344.294 ms stddev 187.043 2023-08-10T11:16:56.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:56 smithi157 ceph-mon[129604]: pgmap v811: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-08-10T11:16:56.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:56 smithi107 ceph-mon[127953]: pgmap v811: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-08-10T11:16:56.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:56 smithi195 ceph-mon[129938]: pgmap v811: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-08-10T11:16:58.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:58 smithi157 ceph-mon[129604]: pgmap v812: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 704 op/s 2023-08-10T11:16:58.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:16:58 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:58.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:58 smithi107 ceph-mon[127953]: pgmap v812: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 704 op/s 2023-08-10T11:16:58.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:16:58 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:16:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:58 smithi195 ceph-mon[129938]: pgmap v812: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 704 op/s 2023-08-10T11:16:58.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:16:58 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:00 smithi157 ceph-mon[129604]: pgmap v813: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.0 MiB/s wr, 966 op/s 2023-08-10T11:17:00.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 445.0 s, 261.6 tps, lat 375.443 ms stddev 146.283 2023-08-10T11:17:00.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:00 smithi107 ceph-mon[127953]: pgmap v813: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.0 MiB/s wr, 966 op/s 2023-08-10T11:17:00.918 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:00 smithi195 ceph-mon[129938]: pgmap v813: 129 pgs: 129 active+clean; 16 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.0 MiB/s wr, 966 op/s 2023-08-10T11:17:02.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:02 smithi157 ceph-mon[129604]: pgmap v814: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.8 MiB/s wr, 757 op/s 2023-08-10T11:17:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:02 smithi107 ceph-mon[127953]: pgmap v814: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.8 MiB/s wr, 757 op/s 2023-08-10T11:17:02.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:02 smithi195 ceph-mon[129938]: pgmap v814: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.8 MiB/s wr, 757 op/s 2023-08-10T11:17:04.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:04 smithi157 ceph-mon[129604]: pgmap v815: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 750 op/s 2023-08-10T11:17:04.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:04 smithi107 ceph-mon[127953]: pgmap v815: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 750 op/s 2023-08-10T11:17:04.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:04 smithi195 ceph-mon[129938]: pgmap v815: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 750 op/s 2023-08-10T11:17:05.804 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 450.0 s, 211.8 tps, lat 458.199 ms stddev 327.309 2023-08-10T11:17:05.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:05 smithi107 ceph-mon[127953]: pgmap v816: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.1 MiB/s wr, 962 op/s 2023-08-10T11:17:05.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:05 smithi195 ceph-mon[129938]: pgmap v816: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.1 MiB/s wr, 962 op/s 2023-08-10T11:17:06.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:05 smithi157 ceph-mon[129604]: pgmap v816: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.1 MiB/s wr, 962 op/s 2023-08-10T11:17:08.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:08 smithi107 ceph-mon[127953]: pgmap v817: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 674 op/s 2023-08-10T11:17:08.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:08 smithi107 ceph-mon[127953]: osdmap e132: 12 total, 12 up, 12 in 2023-08-10T11:17:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:08 smithi195 ceph-mon[129938]: pgmap v817: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 674 op/s 2023-08-10T11:17:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:08 smithi195 ceph-mon[129938]: osdmap e132: 12 total, 12 up, 12 in 2023-08-10T11:17:08.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:08 smithi157 ceph-mon[129604]: pgmap v817: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 674 op/s 2023-08-10T11:17:08.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:08 smithi157 ceph-mon[129604]: osdmap e132: 12 total, 12 up, 12 in 2023-08-10T11:17:10.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:10 smithi157 ceph-mon[129604]: pgmap v819: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 641 op/s 2023-08-10T11:17:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 455.0 s, 93.9 tps, lat 902.414 ms stddev 727.001 2023-08-10T11:17:10.839 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:10 smithi107 ceph-mon[127953]: pgmap v819: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 641 op/s 2023-08-10T11:17:10.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:10 smithi195 ceph-mon[129938]: pgmap v819: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 641 op/s 2023-08-10T11:17:12.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:12 smithi157 ceph-mon[129604]: pgmap v820: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 613 op/s 2023-08-10T11:17:12.828 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 11:17:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T11:17:12.500+0000 7f1a7cd3e700 -1 calc_pg_upmaps abort due to max <= 0 2023-08-10T11:17:12.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:12 smithi107 ceph-mon[127953]: pgmap v820: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 613 op/s 2023-08-10T11:17:12.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:12 smithi195 ceph-mon[129938]: pgmap v820: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 613 op/s 2023-08-10T11:17:14.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:14 smithi157 ceph-mon[129604]: pgmap v821: 129 pgs: 19 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 60 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 557 op/s 2023-08-10T11:17:14.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:14 smithi107 ceph-mon[127953]: pgmap v821: 129 pgs: 19 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 60 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 557 op/s 2023-08-10T11:17:14.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:14 smithi195 ceph-mon[129938]: pgmap v821: 129 pgs: 19 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 60 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 557 op/s 2023-08-10T11:17:15.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 460.0 s, 160.8 tps, lat 695.282 ms stddev 947.979 2023-08-10T11:17:16.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:16 smithi157 ceph-mon[129604]: pgmap v822: 129 pgs: 5 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 111 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 389 op/s 2023-08-10T11:17:16.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:16 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:16.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:16 smithi107 ceph-mon[127953]: pgmap v822: 129 pgs: 5 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 111 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 389 op/s 2023-08-10T11:17:16.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:16 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:16.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:16 smithi195 ceph-mon[129938]: pgmap v822: 129 pgs: 5 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 111 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 389 op/s 2023-08-10T11:17:16.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:16 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:18.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:18 smithi157 ceph-mon[129604]: pgmap v823: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 370 op/s 2023-08-10T11:17:18.836 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:18 smithi107 ceph-mon[127953]: pgmap v823: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 370 op/s 2023-08-10T11:17:18.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:18 smithi195 ceph-mon[129938]: pgmap v823: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 370 op/s 2023-08-10T11:17:20.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:20 smithi195 ceph-mon[129938]: pgmap v824: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 507 op/s 2023-08-10T11:17:20.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:20 smithi195 ceph-mon[129938]: osdmap e133: 12 total, 12 up, 12 in 2023-08-10T11:17:20.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:20 smithi157 ceph-mon[129604]: pgmap v824: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 507 op/s 2023-08-10T11:17:20.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:20 smithi157 ceph-mon[129604]: osdmap e133: 12 total, 12 up, 12 in 2023-08-10T11:17:20.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 465.0 s, 249.6 tps, lat 426.205 ms stddev 357.376 2023-08-10T11:17:20.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:20 smithi107 ceph-mon[127953]: pgmap v824: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 507 op/s 2023-08-10T11:17:20.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:20 smithi107 ceph-mon[127953]: osdmap e133: 12 total, 12 up, 12 in 2023-08-10T11:17:21.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:21 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:21.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:21 smithi107 ceph-mon[127953]: pgmap v826: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 515 op/s 2023-08-10T11:17:21.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:21 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:21.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:21 smithi195 ceph-mon[129938]: pgmap v826: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 515 op/s 2023-08-10T11:17:22.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:21 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:22.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:21 smithi157 ceph-mon[129604]: pgmap v826: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 515 op/s 2023-08-10T11:17:24.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:24 smithi195 ceph-mon[129938]: pgmap v827: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 545 op/s 2023-08-10T11:17:24.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:24 smithi157 ceph-mon[129604]: pgmap v827: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 545 op/s 2023-08-10T11:17:24.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:24 smithi107 ceph-mon[127953]: pgmap v827: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 545 op/s 2023-08-10T11:17:25.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:25 smithi157 ceph-mon[129604]: osdmap e134: 12 total, 12 up, 12 in 2023-08-10T11:17:25.804 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 470.0 s, 216.6 tps, lat 406.213 ms stddev 206.625 2023-08-10T11:17:25.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:25 smithi107 ceph-mon[127953]: osdmap e134: 12 total, 12 up, 12 in 2023-08-10T11:17:25.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:25 smithi195 ceph-mon[129938]: osdmap e134: 12 total, 12 up, 12 in 2023-08-10T11:17:26.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:26 smithi157 ceph-mon[129604]: pgmap v829: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.7 MiB/s wr, 896 op/s 2023-08-10T11:17:26.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:26 smithi107 ceph-mon[127953]: pgmap v829: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.7 MiB/s wr, 896 op/s 2023-08-10T11:17:26.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:26 smithi195 ceph-mon[129938]: pgmap v829: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.7 MiB/s wr, 896 op/s 2023-08-10T11:17:28.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:28 smithi157 ceph-mon[129604]: pgmap v830: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 650 op/s 2023-08-10T11:17:28.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:28 smithi107 ceph-mon[127953]: pgmap v830: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 650 op/s 2023-08-10T11:17:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:28 smithi195 ceph-mon[129938]: pgmap v830: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 650 op/s 2023-08-10T11:17:30.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:30 smithi157 ceph-mon[129604]: pgmap v831: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.2 MiB/s wr, 811 op/s 2023-08-10T11:17:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 475.0 s, 222.8 tps, lat 503.855 ms stddev 438.345 2023-08-10T11:17:30.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:30 smithi107 ceph-mon[127953]: pgmap v831: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.2 MiB/s wr, 811 op/s 2023-08-10T11:17:30.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:30 smithi195 ceph-mon[129938]: pgmap v831: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.2 MiB/s wr, 811 op/s 2023-08-10T11:17:32.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:32 smithi157 ceph-mon[129604]: pgmap v832: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.5 MiB/s wr, 847 op/s 2023-08-10T11:17:32.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:32 smithi107 ceph-mon[127953]: pgmap v832: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.5 MiB/s wr, 847 op/s 2023-08-10T11:17:32.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:32 smithi195 ceph-mon[129938]: pgmap v832: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.5 MiB/s wr, 847 op/s 2023-08-10T11:17:34.832 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:34 smithi107 ceph-mon[127953]: pgmap v833: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.0 MiB/s wr, 851 op/s 2023-08-10T11:17:34.832 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:34 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:17:34.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:34 smithi195 ceph-mon[129938]: pgmap v833: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.0 MiB/s wr, 851 op/s 2023-08-10T11:17:34.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:34 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:17:35.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:34 smithi157 ceph-mon[129604]: pgmap v833: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.0 MiB/s wr, 851 op/s 2023-08-10T11:17:35.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:34 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:17:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 480.0 s, 285.8 tps, lat 354.922 ms stddev 161.762 2023-08-10T11:17:36.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:36 smithi107 ceph-mon[127953]: pgmap v834: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.8 MiB/s wr, 818 op/s 2023-08-10T11:17:36.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:36 smithi195 ceph-mon[129938]: pgmap v834: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.8 MiB/s wr, 818 op/s 2023-08-10T11:17:37.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:36 smithi157 ceph-mon[129604]: pgmap v834: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.8 MiB/s wr, 818 op/s 2023-08-10T11:17:37.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:37 smithi107 ceph-mon[127953]: pgmap v835: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.9 MiB/s wr, 734 op/s 2023-08-10T11:17:37.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:37 smithi195 ceph-mon[129938]: pgmap v835: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.9 MiB/s wr, 734 op/s 2023-08-10T11:17:38.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:37 smithi157 ceph-mon[129604]: pgmap v835: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.9 MiB/s wr, 734 op/s 2023-08-10T11:17:40.756 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:40 smithi157 ceph-mon[129604]: pgmap v836: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.6 MiB/s wr, 940 op/s 2023-08-10T11:17:40.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 485.0 s, 306.4 tps, lat 326.551 ms stddev 126.439 2023-08-10T11:17:40.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:40 smithi107 ceph-mon[127953]: pgmap v836: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.6 MiB/s wr, 940 op/s 2023-08-10T11:17:40.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:40 smithi195 ceph-mon[129938]: pgmap v836: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.6 MiB/s wr, 940 op/s 2023-08-10T11:17:42.708 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:42 smithi157 ceph-mon[129604]: pgmap v837: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.3 MiB/s wr, 787 op/s 2023-08-10T11:17:42.832 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:42 smithi107 ceph-mon[127953]: pgmap v837: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.3 MiB/s wr, 787 op/s 2023-08-10T11:17:42.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:42 smithi195 ceph-mon[129938]: pgmap v837: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.3 MiB/s wr, 787 op/s 2023-08-10T11:17:44.699 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:44 smithi107 ceph-mon[127953]: pgmap v838: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 710 op/s 2023-08-10T11:17:44.699 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:44 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:44.700 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:44 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:44.700 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:44 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:44.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:44 smithi157 ceph-mon[129604]: pgmap v838: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 710 op/s 2023-08-10T11:17:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:44 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:44 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:44.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:44 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:44 smithi195 ceph-mon[129938]: pgmap v838: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 710 op/s 2023-08-10T11:17:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:44 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:44 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:44.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:44 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:45.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 490.0 s, 229.2 tps, lat 358.141 ms stddev 132.053 2023-08-10T11:17:46.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:46 smithi157 ceph-mon[129604]: pgmap v839: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.0 MiB/s wr, 922 op/s 2023-08-10T11:17:46.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:46 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:46.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:46 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:46.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:46 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:17:46.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:46 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:17:46.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:46 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:46.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:46 smithi107 ceph-mon[127953]: pgmap v839: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.0 MiB/s wr, 922 op/s 2023-08-10T11:17:46.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:46 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:46.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:46 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:46.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:46 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:17:46.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:46 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:17:46.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:46 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:46 smithi195 ceph-mon[129938]: pgmap v839: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.0 MiB/s wr, 922 op/s 2023-08-10T11:17:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:46 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:46 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:46 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:17:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:46 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:17:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:46 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:17:48.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:48 smithi157 ceph-mon[129604]: pgmap v840: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 689 op/s 2023-08-10T11:17:48.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:48 smithi107 ceph-mon[127953]: pgmap v840: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 689 op/s 2023-08-10T11:17:48.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:48 smithi195 ceph-mon[129938]: pgmap v840: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 689 op/s 2023-08-10T11:17:49.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:49 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:49.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:49 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:49.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:49 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:50.806 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 495.0 s, 257.6 tps, lat 452.908 ms stddev 1002.244 2023-08-10T11:17:50.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:50 smithi107 ceph-mon[127953]: pgmap v841: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.2 MiB/s wr, 897 op/s 2023-08-10T11:17:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:50 smithi195 ceph-mon[129938]: pgmap v841: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.2 MiB/s wr, 897 op/s 2023-08-10T11:17:51.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:50 smithi157 ceph-mon[129604]: pgmap v841: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.2 MiB/s wr, 897 op/s 2023-08-10T11:17:52.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:52 smithi107 ceph-mon[127953]: pgmap v842: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.6 MiB/s wr, 754 op/s 2023-08-10T11:17:52.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:52 smithi195 ceph-mon[129938]: pgmap v842: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.6 MiB/s wr, 754 op/s 2023-08-10T11:17:53.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:52 smithi157 ceph-mon[129604]: pgmap v842: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.6 MiB/s wr, 754 op/s 2023-08-10T11:17:53.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:53 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:53.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:53 smithi195 ceph-mon[129938]: pgmap v843: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.9 MiB/s wr, 689 op/s 2023-08-10T11:17:54.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:53 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:54.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:53 smithi157 ceph-mon[129604]: pgmap v843: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.9 MiB/s wr, 689 op/s 2023-08-10T11:17:54.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:53 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:54.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:53 smithi107 ceph-mon[127953]: pgmap v843: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.9 MiB/s wr, 689 op/s 2023-08-10T11:17:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:54 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:55.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:54 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:55.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:54 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:17:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 500.0 s, 238.8 tps, lat 423.365 ms stddev 133.655 2023-08-10T11:17:55.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:55 smithi195 ceph-mon[129938]: pgmap v844: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.5 MiB/s wr, 933 op/s 2023-08-10T11:17:56.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:55 smithi157 ceph-mon[129604]: pgmap v844: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.5 MiB/s wr, 933 op/s 2023-08-10T11:17:56.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:55 smithi107 ceph-mon[127953]: pgmap v844: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.5 MiB/s wr, 933 op/s 2023-08-10T11:17:58.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:17:58 smithi195 ceph-mon[129938]: pgmap v845: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 711 op/s 2023-08-10T11:17:58.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:17:58 smithi157 ceph-mon[129604]: pgmap v845: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 711 op/s 2023-08-10T11:17:58.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:17:58 smithi107 ceph-mon[127953]: pgmap v845: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 711 op/s 2023-08-10T11:18:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:00 smithi157 ceph-mon[129604]: pgmap v846: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.6 MiB/s wr, 946 op/s 2023-08-10T11:18:00.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 505.0 s, 294.2 tps, lat 338.192 ms stddev 163.436 2023-08-10T11:18:00.833 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:00 smithi107 ceph-mon[127953]: pgmap v846: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.6 MiB/s wr, 946 op/s 2023-08-10T11:18:00.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:00 smithi195 ceph-mon[129938]: pgmap v846: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.6 MiB/s wr, 946 op/s 2023-08-10T11:18:02.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:02 smithi157 ceph-mon[129604]: pgmap v847: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.2 MiB/s wr, 818 op/s 2023-08-10T11:18:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:02 smithi107 ceph-mon[127953]: pgmap v847: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.2 MiB/s wr, 818 op/s 2023-08-10T11:18:02.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:02 smithi195 ceph-mon[129938]: pgmap v847: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.2 MiB/s wr, 818 op/s 2023-08-10T11:18:03.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:03 smithi157 ceph-mon[129604]: osdmap e135: 12 total, 12 up, 12 in 2023-08-10T11:18:03.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:03 smithi107 ceph-mon[127953]: osdmap e135: 12 total, 12 up, 12 in 2023-08-10T11:18:03.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:03 smithi195 ceph-mon[129938]: osdmap e135: 12 total, 12 up, 12 in 2023-08-10T11:18:04.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:04 smithi107 ceph-mon[127953]: pgmap v849: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.3 MiB/s wr, 884 op/s 2023-08-10T11:18:04.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:04 smithi195 ceph-mon[129938]: pgmap v849: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.3 MiB/s wr, 884 op/s 2023-08-10T11:18:05.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:04 smithi157 ceph-mon[129604]: pgmap v849: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.3 MiB/s wr, 884 op/s 2023-08-10T11:18:05.803 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 510.0 s, 162.5 tps, lat 547.535 ms stddev 397.609 2023-08-10T11:18:06.918 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:06 smithi195 ceph-mon[129938]: pgmap v850: 129 pgs: 18 active+clean+snaptrim, 46 active+clean+snaptrim_wait, 65 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.7 MiB/s wr, 819 op/s 2023-08-10T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:06 smithi157 ceph-mon[129604]: pgmap v850: 129 pgs: 18 active+clean+snaptrim, 46 active+clean+snaptrim_wait, 65 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.7 MiB/s wr, 819 op/s 2023-08-10T11:18:07.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:06 smithi107 ceph-mon[127953]: pgmap v850: 129 pgs: 18 active+clean+snaptrim, 46 active+clean+snaptrim_wait, 65 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.7 MiB/s wr, 819 op/s 2023-08-10T11:18:08.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:07 smithi157 ceph-mon[129604]: pgmap v851: 129 pgs: 20 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 58 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.6 MiB/s wr, 811 op/s 2023-08-10T11:18:08.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:07 smithi107 ceph-mon[127953]: pgmap v851: 129 pgs: 20 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 58 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.6 MiB/s wr, 811 op/s 2023-08-10T11:18:08.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:07 smithi195 ceph-mon[129938]: pgmap v851: 129 pgs: 20 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 58 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.6 MiB/s wr, 811 op/s 2023-08-10T11:18:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:10 smithi157 ceph-mon[129604]: pgmap v852: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.1 MiB/s wr, 616 op/s 2023-08-10T11:18:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 515.0 s, 104.5 tps, lat 939.671 ms stddev 472.215 2023-08-10T11:18:10.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:10 smithi107 ceph-mon[127953]: pgmap v852: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.1 MiB/s wr, 616 op/s 2023-08-10T11:18:10.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:10 smithi195 ceph-mon[129938]: pgmap v852: 129 pgs: 17 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 65 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.1 MiB/s wr, 616 op/s 2023-08-10T11:18:12.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:12 smithi157 ceph-mon[129604]: pgmap v853: 129 pgs: 9 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 95 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 550 op/s 2023-08-10T11:18:12.833 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:12 smithi107 ceph-mon[127953]: pgmap v853: 129 pgs: 9 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 95 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 550 op/s 2023-08-10T11:18:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:12 smithi195 ceph-mon[129938]: pgmap v853: 129 pgs: 9 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 95 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.3 MiB/s wr, 550 op/s 2023-08-10T11:18:14.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:14 smithi107 ceph-mon[127953]: pgmap v854: 129 pgs: 9 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 95 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 519 op/s 2023-08-10T11:18:14.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:14 smithi195 ceph-mon[129938]: pgmap v854: 129 pgs: 9 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 95 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 519 op/s 2023-08-10T11:18:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:14 smithi157 ceph-mon[129604]: pgmap v854: 129 pgs: 9 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 95 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.0 MiB/s wr, 519 op/s 2023-08-10T11:18:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 520.0 s, 245.0 tps, lat 456.755 ms stddev 278.271 2023-08-10T11:18:16.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:16 smithi107 ceph-mon[127953]: pgmap v855: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 569 op/s 2023-08-10T11:18:16.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:16 smithi195 ceph-mon[129938]: pgmap v855: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 569 op/s 2023-08-10T11:18:17.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:16 smithi157 ceph-mon[129604]: pgmap v855: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 569 op/s 2023-08-10T11:18:18.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:18 smithi195 ceph-mon[129938]: pgmap v856: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.4 MiB/s wr, 385 op/s 2023-08-10T11:18:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:18 smithi157 ceph-mon[129604]: pgmap v856: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.4 MiB/s wr, 385 op/s 2023-08-10T11:18:19.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:18 smithi107 ceph-mon[127953]: pgmap v856: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.4 MiB/s wr, 385 op/s 2023-08-10T11:18:20.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:20 smithi157 ceph-mon[129604]: pgmap v857: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.6 MiB/s wr, 584 op/s 2023-08-10T11:18:20.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:20 smithi157 ceph-mon[129604]: osdmap e136: 12 total, 12 up, 12 in 2023-08-10T11:18:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 525.0 s, 241.6 tps, lat 420.381 ms stddev 217.288 2023-08-10T11:18:20.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:20 smithi107 ceph-mon[127953]: pgmap v857: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.6 MiB/s wr, 584 op/s 2023-08-10T11:18:20.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:20 smithi107 ceph-mon[127953]: osdmap e136: 12 total, 12 up, 12 in 2023-08-10T11:18:20.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:20 smithi195 ceph-mon[129938]: pgmap v857: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.6 MiB/s wr, 584 op/s 2023-08-10T11:18:20.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:20 smithi195 ceph-mon[129938]: osdmap e136: 12 total, 12 up, 12 in 2023-08-10T11:18:22.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:22 smithi157 ceph-mon[129604]: pgmap v859: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.2 MiB/s wr, 630 op/s 2023-08-10T11:18:22.832 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:22 smithi107 ceph-mon[127953]: pgmap v859: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.2 MiB/s wr, 630 op/s 2023-08-10T11:18:22.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:22 smithi195 ceph-mon[129938]: pgmap v859: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.2 MiB/s wr, 630 op/s 2023-08-10T11:18:23.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:23 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:18:23.832 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:23 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:18:23.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:23 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:18:24.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:24 smithi157 ceph-mon[129604]: pgmap v860: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.2 MiB/s wr, 630 op/s 2023-08-10T11:18:24.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:24 smithi107 ceph-mon[127953]: pgmap v860: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.2 MiB/s wr, 630 op/s 2023-08-10T11:18:24.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:24 smithi195 ceph-mon[129938]: pgmap v860: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.2 MiB/s wr, 630 op/s 2023-08-10T11:18:25.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 530.0 s, 212.2 tps, lat 460.735 ms stddev 157.272 2023-08-10T11:18:26.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:26 smithi107 ceph-mon[127953]: pgmap v861: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 751 op/s 2023-08-10T11:18:26.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:26 smithi195 ceph-mon[129938]: pgmap v861: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 751 op/s 2023-08-10T11:18:27.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:26 smithi157 ceph-mon[129604]: pgmap v861: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 751 op/s 2023-08-10T11:18:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:28 smithi195 ceph-mon[129938]: pgmap v862: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.6 MiB/s wr, 773 op/s 2023-08-10T11:18:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:28 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:18:29.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:28 smithi157 ceph-mon[129604]: pgmap v862: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.6 MiB/s wr, 773 op/s 2023-08-10T11:18:29.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:28 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:18:29.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:28 smithi107 ceph-mon[127953]: pgmap v862: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.6 MiB/s wr, 773 op/s 2023-08-10T11:18:29.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:28 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:18:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 535.0 s, 289.6 tps, lat 348.904 ms stddev 125.457 2023-08-10T11:18:30.914 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:30 smithi195 ceph-mon[129938]: pgmap v863: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 781 op/s 2023-08-10T11:18:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:30 smithi157 ceph-mon[129604]: pgmap v863: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 781 op/s 2023-08-10T11:18:31.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:30 smithi107 ceph-mon[127953]: pgmap v863: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 781 op/s 2023-08-10T11:18:33.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:32 smithi157 ceph-mon[129604]: pgmap v864: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.0 MiB/s wr, 736 op/s 2023-08-10T11:18:33.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:32 smithi107 ceph-mon[127953]: pgmap v864: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.0 MiB/s wr, 736 op/s 2023-08-10T11:18:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:32 smithi195 ceph-mon[129938]: pgmap v864: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.0 MiB/s wr, 736 op/s 2023-08-10T11:18:34.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:33 smithi157 ceph-mon[129604]: pgmap v865: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 655 op/s 2023-08-10T11:18:34.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:33 smithi107 ceph-mon[127953]: pgmap v865: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 655 op/s 2023-08-10T11:18:34.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:33 smithi195 ceph-mon[129938]: pgmap v865: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 655 op/s 2023-08-10T11:18:35.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 540.0 s, 109.7 tps, lat 386.573 ms stddev 176.409 2023-08-10T11:18:36.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:36 smithi157 ceph-mon[129604]: pgmap v866: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.3 MiB/s wr, 932 op/s 2023-08-10T11:18:36.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:36 smithi107 ceph-mon[127953]: pgmap v866: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.3 MiB/s wr, 932 op/s 2023-08-10T11:18:36.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:36 smithi195 ceph-mon[129938]: pgmap v866: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.3 MiB/s wr, 932 op/s 2023-08-10T11:18:38.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:38 smithi157 ceph-mon[129604]: pgmap v867: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 701 op/s 2023-08-10T11:18:38.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:38 smithi107 ceph-mon[127953]: pgmap v867: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 701 op/s 2023-08-10T11:18:38.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:38 smithi195 ceph-mon[129938]: pgmap v867: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 701 op/s 2023-08-10T11:18:40.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:40 smithi157 ceph-mon[129604]: pgmap v868: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 723 op/s 2023-08-10T11:18:40.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 545.0 s, 225.5 tps, lat 693.905 ms stddev 1299.072 2023-08-10T11:18:40.832 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:40 smithi107 ceph-mon[127953]: pgmap v868: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 723 op/s 2023-08-10T11:18:40.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:40 smithi195 ceph-mon[129938]: pgmap v868: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 723 op/s 2023-08-10T11:18:42.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:42 smithi107 ceph-mon[127953]: pgmap v869: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 553 op/s 2023-08-10T11:18:42.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:42 smithi195 ceph-mon[129938]: pgmap v869: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 553 op/s 2023-08-10T11:18:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:42 smithi157 ceph-mon[129604]: pgmap v869: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 553 op/s 2023-08-10T11:18:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:44 smithi195 ceph-mon[129938]: pgmap v870: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 447 op/s 2023-08-10T11:18:45.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:44 smithi157 ceph-mon[129604]: pgmap v870: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 447 op/s 2023-08-10T11:18:45.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:44 smithi107 ceph-mon[127953]: pgmap v870: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 447 op/s 2023-08-10T11:18:45.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 550.0 s, 252.2 tps, lat 390.858 ms stddev 122.019 2023-08-10T11:18:46.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:46 smithi195 ceph-mon[129938]: pgmap v871: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.9 MiB/s wr, 726 op/s 2023-08-10T11:18:47.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:46 smithi157 ceph-mon[129604]: pgmap v871: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.9 MiB/s wr, 726 op/s 2023-08-10T11:18:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:46 smithi107 ceph-mon[127953]: pgmap v871: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.9 MiB/s wr, 726 op/s 2023-08-10T11:18:48.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:47 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:18:48.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:47 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:18:48.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:47 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:18:49.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:48 smithi157 ceph-mon[129604]: pgmap v872: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 500 op/s 2023-08-10T11:18:49.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:48 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:18:49.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:48 smithi107 ceph-mon[127953]: pgmap v872: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 500 op/s 2023-08-10T11:18:49.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:48 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:18:49.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:48 smithi195 ceph-mon[129938]: pgmap v872: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 500 op/s 2023-08-10T11:18:49.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:48 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:18:50.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:50 smithi157 ceph-mon[129604]: pgmap v873: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.2 MiB/s wr, 692 op/s 2023-08-10T11:18:50.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 555.0 s, 214.2 tps, lat 480.756 ms stddev 170.919 2023-08-10T11:18:50.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:50 smithi107 ceph-mon[127953]: pgmap v873: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.2 MiB/s wr, 692 op/s 2023-08-10T11:18:50.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:50 smithi195 ceph-mon[129938]: pgmap v873: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.2 MiB/s wr, 692 op/s 2023-08-10T11:18:52.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:52 smithi157 ceph-mon[129604]: pgmap v874: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 717 op/s 2023-08-10T11:18:52.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:52 smithi107 ceph-mon[127953]: pgmap v874: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 717 op/s 2023-08-10T11:18:52.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:52 smithi195 ceph-mon[129938]: pgmap v874: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 717 op/s 2023-08-10T11:18:54.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:54 smithi107 ceph-mon[127953]: pgmap v875: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 659 op/s 2023-08-10T11:18:54.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:54 smithi195 ceph-mon[129938]: pgmap v875: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 659 op/s 2023-08-10T11:18:55.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:54 smithi157 ceph-mon[129604]: pgmap v875: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 659 op/s 2023-08-10T11:18:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 560.0 s, 244.8 tps, lat 414.167 ms stddev 140.664 2023-08-10T11:18:56.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:56 smithi107 ceph-mon[127953]: pgmap v876: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.6 MiB/s wr, 936 op/s 2023-08-10T11:18:56.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:56 smithi195 ceph-mon[129938]: pgmap v876: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.6 MiB/s wr, 936 op/s 2023-08-10T11:18:57.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:56 smithi157 ceph-mon[129604]: pgmap v876: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.6 MiB/s wr, 936 op/s 2023-08-10T11:18:58.874 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:58 smithi195 ceph-mon[129938]: pgmap v877: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 708 op/s 2023-08-10T11:18:59.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:58 smithi157 ceph-mon[129604]: pgmap v877: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 708 op/s 2023-08-10T11:18:59.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:58 smithi107 ceph-mon[127953]: pgmap v877: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 708 op/s 2023-08-10T11:19:00.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:59 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:19:00.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:59 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:19:00.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:59 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:19:00.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:59 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:19:00.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:59 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:19:00.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:18:59 smithi157 ceph-mon[129604]: pgmap v878: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 892 op/s 2023-08-10T11:19:00.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:59 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:19:00.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:59 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:19:00.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:59 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:19:00.333 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:59 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:19:00.333 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:59 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:19:00.333 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:18:59 smithi107 ceph-mon[127953]: pgmap v878: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 892 op/s 2023-08-10T11:19:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:59 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:19:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:59 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:19:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:59 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:19:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:59 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:19:00.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:59 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:19:00.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:18:59 smithi195 ceph-mon[129938]: pgmap v878: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 892 op/s 2023-08-10T11:19:00.806 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 565.0 s, 268.9 tps, lat 368.306 ms stddev 136.326 2023-08-10T11:19:02.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:02 smithi157 ceph-mon[129604]: pgmap v879: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.4 MiB/s wr, 746 op/s 2023-08-10T11:19:02.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:02 smithi107 ceph-mon[127953]: pgmap v879: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.4 MiB/s wr, 746 op/s 2023-08-10T11:19:02.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:02 smithi195 ceph-mon[129938]: pgmap v879: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.4 MiB/s wr, 746 op/s 2023-08-10T11:19:04.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:04 smithi107 ceph-mon[127953]: pgmap v880: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.3 MiB/s wr, 671 op/s 2023-08-10T11:19:04.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:04 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:04.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:04 smithi195 ceph-mon[129938]: pgmap v880: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.3 MiB/s wr, 671 op/s 2023-08-10T11:19:04.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:04 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:04.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:04 smithi157 ceph-mon[129604]: pgmap v880: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.3 MiB/s wr, 671 op/s 2023-08-10T11:19:04.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:04 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:05.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 570.0 s, 235.7 tps, lat 402.470 ms stddev 327.651 2023-08-10T11:19:06.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:06 smithi157 ceph-mon[129604]: pgmap v881: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.3 MiB/s wr, 972 op/s 2023-08-10T11:19:06.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:06 smithi107 ceph-mon[127953]: pgmap v881: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.3 MiB/s wr, 972 op/s 2023-08-10T11:19:06.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:06 smithi195 ceph-mon[129938]: pgmap v881: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.3 MiB/s wr, 972 op/s 2023-08-10T11:19:08.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:08 smithi107 ceph-mon[127953]: pgmap v882: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 740 op/s 2023-08-10T11:19:08.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:08 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:08.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:08 smithi107 ceph-mon[127953]: osdmap e137: 12 total, 12 up, 12 in 2023-08-10T11:19:08.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:08 smithi195 ceph-mon[129938]: pgmap v882: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 740 op/s 2023-08-10T11:19:08.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:08 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:08.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:08 smithi195 ceph-mon[129938]: osdmap e137: 12 total, 12 up, 12 in 2023-08-10T11:19:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:08 smithi157 ceph-mon[129604]: pgmap v882: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 740 op/s 2023-08-10T11:19:09.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:08 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:09.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:08 smithi157 ceph-mon[129604]: osdmap e137: 12 total, 12 up, 12 in 2023-08-10T11:19:10.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 575.0 s, 81.0 tps, lat 781.421 ms stddev 338.790 2023-08-10T11:19:10.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:10 smithi195 ceph-mon[129938]: pgmap v884: 129 pgs: 10 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 93 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.9 MiB/s wr, 694 op/s 2023-08-10T11:19:11.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:10 smithi157 ceph-mon[129604]: pgmap v884: 129 pgs: 10 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 93 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.9 MiB/s wr, 694 op/s 2023-08-10T11:19:11.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:10 smithi107 ceph-mon[127953]: pgmap v884: 129 pgs: 10 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 93 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.9 MiB/s wr, 694 op/s 2023-08-10T11:19:12.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:12 smithi195 ceph-mon[129938]: pgmap v885: 129 pgs: 18 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 64 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 672 op/s 2023-08-10T11:19:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:12 smithi157 ceph-mon[129604]: pgmap v885: 129 pgs: 18 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 64 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 672 op/s 2023-08-10T11:19:13.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:12 smithi107 ceph-mon[127953]: pgmap v885: 129 pgs: 18 active+clean+snaptrim, 47 active+clean+snaptrim_wait, 64 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 672 op/s 2023-08-10T11:19:13.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:13 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:14.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:13 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:14.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:13 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:14.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:14 smithi195 ceph-mon[129938]: pgmap v886: 129 pgs: 20 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 57 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.0 MiB/s wr, 649 op/s 2023-08-10T11:19:15.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:14 smithi157 ceph-mon[129604]: pgmap v886: 129 pgs: 20 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 57 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.0 MiB/s wr, 649 op/s 2023-08-10T11:19:15.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:14 smithi107 ceph-mon[127953]: pgmap v886: 129 pgs: 20 active+clean+snaptrim, 52 active+clean+snaptrim_wait, 57 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.0 MiB/s wr, 649 op/s 2023-08-10T11:19:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 580.0 s, 129.7 tps, lat 1093.050 ms stddev 705.033 2023-08-10T11:19:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:16 smithi157 ceph-mon[129604]: pgmap v887: 129 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 94 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 377 op/s 2023-08-10T11:19:17.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:16 smithi107 ceph-mon[127953]: pgmap v887: 129 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 94 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 377 op/s 2023-08-10T11:19:17.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:16 smithi195 ceph-mon[129938]: pgmap v887: 129 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 94 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 377 op/s 2023-08-10T11:19:19.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:18 smithi157 ceph-mon[129604]: pgmap v888: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 347 op/s 2023-08-10T11:19:19.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:18 smithi107 ceph-mon[127953]: pgmap v888: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 347 op/s 2023-08-10T11:19:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:18 smithi195 ceph-mon[129938]: pgmap v888: 129 pgs: 7 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 109 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 347 op/s 2023-08-10T11:19:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 585.0 s, 266.8 tps, lat 377.278 ms stddev 144.150 2023-08-10T11:19:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:20 smithi157 ceph-mon[129604]: pgmap v889: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 459 op/s 2023-08-10T11:19:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:20 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:21.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:20 smithi107 ceph-mon[127953]: pgmap v889: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 459 op/s 2023-08-10T11:19:21.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:20 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:20 smithi195 ceph-mon[129938]: pgmap v889: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 459 op/s 2023-08-10T11:19:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:20 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:22.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:21 smithi157 ceph-mon[129604]: pgmap v890: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 417 op/s 2023-08-10T11:19:22.087 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:21 smithi107 ceph-mon[127953]: pgmap v890: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 417 op/s 2023-08-10T11:19:22.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:21 smithi195 ceph-mon[129938]: pgmap v890: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 417 op/s 2023-08-10T11:19:24.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:24 smithi157 ceph-mon[129604]: pgmap v891: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 386 op/s 2023-08-10T11:19:24.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:24 smithi107 ceph-mon[127953]: pgmap v891: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 386 op/s 2023-08-10T11:19:24.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:24 smithi195 ceph-mon[129938]: pgmap v891: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 386 op/s 2023-08-10T11:19:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 590.0 s, 226.5 tps, lat 435.474 ms stddev 161.803 2023-08-10T11:19:25.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:25 smithi107 ceph-mon[127953]: osdmap e138: 12 total, 12 up, 12 in 2023-08-10T11:19:25.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:25 smithi195 ceph-mon[129938]: osdmap e138: 12 total, 12 up, 12 in 2023-08-10T11:19:26.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:25 smithi157 ceph-mon[129604]: osdmap e138: 12 total, 12 up, 12 in 2023-08-10T11:19:26.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:26 smithi195 ceph-mon[129938]: pgmap v893: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 692 op/s 2023-08-10T11:19:27.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:26 smithi157 ceph-mon[129604]: pgmap v893: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 692 op/s 2023-08-10T11:19:27.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:26 smithi107 ceph-mon[127953]: pgmap v893: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 692 op/s 2023-08-10T11:19:28.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:28 smithi195 ceph-mon[129938]: pgmap v894: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 727 op/s 2023-08-10T11:19:29.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:28 smithi157 ceph-mon[129604]: pgmap v894: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 727 op/s 2023-08-10T11:19:29.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:28 smithi107 ceph-mon[127953]: pgmap v894: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 727 op/s 2023-08-10T11:19:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 595.0 s, 219.7 tps, lat 462.577 ms stddev 467.518 2023-08-10T11:19:30.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:30 smithi195 ceph-mon[129938]: pgmap v895: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.6 MiB/s wr, 727 op/s 2023-08-10T11:19:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:30 smithi157 ceph-mon[129604]: pgmap v895: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.6 MiB/s wr, 727 op/s 2023-08-10T11:19:31.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:30 smithi107 ceph-mon[127953]: pgmap v895: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.6 MiB/s wr, 727 op/s 2023-08-10T11:19:33.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:32 smithi157 ceph-mon[129604]: pgmap v896: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.8 MiB/s wr, 798 op/s 2023-08-10T11:19:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:32 smithi107 ceph-mon[127953]: pgmap v896: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.8 MiB/s wr, 798 op/s 2023-08-10T11:19:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:32 smithi195 ceph-mon[129938]: pgmap v896: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.8 MiB/s wr, 798 op/s 2023-08-10T11:19:35.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:34 smithi157 ceph-mon[129604]: pgmap v897: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 795 op/s 2023-08-10T11:19:35.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:34 smithi107 ceph-mon[127953]: pgmap v897: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 795 op/s 2023-08-10T11:19:35.167 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:34 smithi195 ceph-mon[129938]: pgmap v897: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 795 op/s 2023-08-10T11:19:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 600.0 s, 241.0 tps, lat 412.880 ms stddev 138.325 2023-08-10T11:19:37.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:36 smithi157 ceph-mon[129604]: pgmap v898: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.3 MiB/s wr, 779 op/s 2023-08-10T11:19:37.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:36 smithi107 ceph-mon[127953]: pgmap v898: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.3 MiB/s wr, 779 op/s 2023-08-10T11:19:37.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:36 smithi195 ceph-mon[129938]: pgmap v898: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.3 MiB/s wr, 779 op/s 2023-08-10T11:19:38.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:37 smithi107 ceph-mon[127953]: pgmap v899: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 718 op/s 2023-08-10T11:19:38.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:37 smithi195 ceph-mon[129938]: pgmap v899: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 718 op/s 2023-08-10T11:19:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:37 smithi157 ceph-mon[129604]: pgmap v899: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 718 op/s 2023-08-10T11:19:40.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 605.0 s, 169.0 tps, lat 583.255 ms stddev 309.309 2023-08-10T11:19:40.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:40 smithi195 ceph-mon[129938]: pgmap v900: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.0 MiB/s wr, 830 op/s 2023-08-10T11:19:41.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:40 smithi157 ceph-mon[129604]: pgmap v900: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.0 MiB/s wr, 830 op/s 2023-08-10T11:19:41.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:40 smithi107 ceph-mon[127953]: pgmap v900: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.0 MiB/s wr, 830 op/s 2023-08-10T11:19:42.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:42 smithi195 ceph-mon[129938]: pgmap v901: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.8 MiB/s wr, 826 op/s 2023-08-10T11:19:43.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:42 smithi157 ceph-mon[129604]: pgmap v901: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.8 MiB/s wr, 826 op/s 2023-08-10T11:19:43.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:42 smithi107 ceph-mon[127953]: pgmap v901: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.8 MiB/s wr, 826 op/s 2023-08-10T11:19:45.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:44 smithi157 ceph-mon[129604]: pgmap v902: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 701 op/s 2023-08-10T11:19:45.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:44 smithi107 ceph-mon[127953]: pgmap v902: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 701 op/s 2023-08-10T11:19:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:44 smithi195 ceph-mon[129938]: pgmap v902: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 701 op/s 2023-08-10T11:19:45.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 610.0 s, 301.8 tps, lat 340.132 ms stddev 149.693 2023-08-10T11:19:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:46 smithi157 ceph-mon[129604]: pgmap v903: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.4 MiB/s wr, 993 op/s 2023-08-10T11:19:47.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:46 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:46 smithi107 ceph-mon[127953]: pgmap v903: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.4 MiB/s wr, 993 op/s 2023-08-10T11:19:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:46 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:46 smithi195 ceph-mon[129938]: pgmap v903: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.4 MiB/s wr, 993 op/s 2023-08-10T11:19:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:46 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:49.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:48 smithi157 ceph-mon[129604]: pgmap v904: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.2 MiB/s wr, 765 op/s 2023-08-10T11:19:49.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:48 smithi107 ceph-mon[127953]: pgmap v904: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.2 MiB/s wr, 765 op/s 2023-08-10T11:19:49.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:48 smithi195 ceph-mon[129938]: pgmap v904: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.2 MiB/s wr, 765 op/s 2023-08-10T11:19:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 615.0 s, 309.2 tps, lat 307.349 ms stddev 137.841 2023-08-10T11:19:51.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:50 smithi157 ceph-mon[129604]: pgmap v905: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.3 MiB/s wr, 877 op/s 2023-08-10T11:19:51.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:50 smithi107 ceph-mon[127953]: pgmap v905: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.3 MiB/s wr, 877 op/s 2023-08-10T11:19:51.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:50 smithi195 ceph-mon[129938]: pgmap v905: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.3 MiB/s wr, 877 op/s 2023-08-10T11:19:53.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:52 smithi157 ceph-mon[129604]: pgmap v906: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.6 MiB/s wr, 867 op/s 2023-08-10T11:19:53.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:52 smithi107 ceph-mon[127953]: pgmap v906: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.6 MiB/s wr, 867 op/s 2023-08-10T11:19:53.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:52 smithi195 ceph-mon[129938]: pgmap v906: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.6 MiB/s wr, 867 op/s 2023-08-10T11:19:55.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:54 smithi157 ceph-mon[129604]: pgmap v907: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.2 MiB/s wr, 745 op/s 2023-08-10T11:19:55.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:54 smithi107 ceph-mon[127953]: pgmap v907: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.2 MiB/s wr, 745 op/s 2023-08-10T11:19:55.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:54 smithi195 ceph-mon[129938]: pgmap v907: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.2 MiB/s wr, 745 op/s 2023-08-10T11:19:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 620.0 s, 300.8 tps, lat 349.111 ms stddev 133.524 2023-08-10T11:19:56.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:55 smithi107 ceph-mon[127953]: pgmap v908: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-08-10T11:19:56.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:55 smithi195 ceph-mon[129938]: pgmap v908: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-08-10T11:19:56.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:55 smithi157 ceph-mon[129604]: pgmap v908: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-08-10T11:19:58.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:58 smithi157 ceph-mon[129604]: pgmap v909: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 737 op/s 2023-08-10T11:19:58.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:58 smithi107 ceph-mon[127953]: pgmap v909: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 737 op/s 2023-08-10T11:19:58.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:58 smithi195 ceph-mon[129938]: pgmap v909: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 737 op/s 2023-08-10T11:19:59.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:19:59 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:59.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:19:59 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:19:59.665 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:19:59 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:00.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:00 smithi107 ceph-mon[127953]: pgmap v910: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.6 MiB/s wr, 833 op/s 2023-08-10T11:20:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:00 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:20:00.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:00 smithi107 ceph-mon[127953]: overall HEALTH_OK 2023-08-10T11:20:00.599 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:00 smithi195 ceph-mon[129938]: pgmap v910: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.6 MiB/s wr, 833 op/s 2023-08-10T11:20:00.600 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:00 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:20:00.600 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:00 smithi195 ceph-mon[129938]: overall HEALTH_OK 2023-08-10T11:20:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:00 smithi157 ceph-mon[129604]: pgmap v910: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.6 MiB/s wr, 833 op/s 2023-08-10T11:20:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:00 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:20:00.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:00 smithi157 ceph-mon[129604]: overall HEALTH_OK 2023-08-10T11:20:00.802 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 625.0 s, 235.7 tps, lat 407.387 ms stddev 158.640 2023-08-10T11:20:02.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:02 smithi195 ceph-mon[129938]: pgmap v911: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.1 MiB/s wr, 837 op/s 2023-08-10T11:20:02.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:02 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:20:02.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:02 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:20:02.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:02 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:20:02.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:02 smithi157 ceph-mon[129604]: pgmap v911: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.1 MiB/s wr, 837 op/s 2023-08-10T11:20:02.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:02 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:20:02.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:02 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:20:02.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:02 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:20:02.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:02 smithi107 ceph-mon[127953]: pgmap v911: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.1 MiB/s wr, 837 op/s 2023-08-10T11:20:02.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:02 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:20:02.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:02 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:20:02.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:02 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:20:04.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:04 smithi195 ceph-mon[129938]: pgmap v912: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 720 op/s 2023-08-10T11:20:04.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:04 smithi157 ceph-mon[129604]: pgmap v912: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 720 op/s 2023-08-10T11:20:04.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:04 smithi107 ceph-mon[127953]: pgmap v912: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 720 op/s 2023-08-10T11:20:05.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 630.0 s, 233.9 tps, lat 423.221 ms stddev 309.041 2023-08-10T11:20:06.919 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:06 smithi195 ceph-mon[129938]: pgmap v913: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.3 MiB/s wr, 973 op/s 2023-08-10T11:20:07.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:06 smithi157 ceph-mon[129604]: pgmap v913: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.3 MiB/s wr, 973 op/s 2023-08-10T11:20:07.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:06 smithi107 ceph-mon[127953]: pgmap v913: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.3 MiB/s wr, 973 op/s 2023-08-10T11:20:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:08 smithi157 ceph-mon[129604]: pgmap v914: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 720 op/s 2023-08-10T11:20:09.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:08 smithi157 ceph-mon[129604]: osdmap e139: 12 total, 12 up, 12 in 2023-08-10T11:20:09.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:08 smithi107 ceph-mon[127953]: pgmap v914: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 720 op/s 2023-08-10T11:20:09.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:08 smithi107 ceph-mon[127953]: osdmap e139: 12 total, 12 up, 12 in 2023-08-10T11:20:09.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:08 smithi195 ceph-mon[129938]: pgmap v914: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 720 op/s 2023-08-10T11:20:09.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:08 smithi195 ceph-mon[129938]: osdmap e139: 12 total, 12 up, 12 in 2023-08-10T11:20:10.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 635.0 s, 105.8 tps, lat 919.368 ms stddev 526.640 2023-08-10T11:20:11.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:10 smithi157 ceph-mon[129604]: pgmap v916: 129 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 101 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 735 op/s 2023-08-10T11:20:11.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:10 smithi107 ceph-mon[127953]: pgmap v916: 129 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 101 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 735 op/s 2023-08-10T11:20:11.168 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:10 smithi195 ceph-mon[129938]: pgmap v916: 129 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 101 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 735 op/s 2023-08-10T11:20:13.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:12 smithi157 ceph-mon[129604]: pgmap v917: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 634 op/s 2023-08-10T11:20:13.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:12 smithi107 ceph-mon[127953]: pgmap v917: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 634 op/s 2023-08-10T11:20:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:12 smithi195 ceph-mon[129938]: pgmap v917: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.1 MiB/s wr, 634 op/s 2023-08-10T11:20:15.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:14 smithi107 ceph-mon[127953]: pgmap v918: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 608 op/s 2023-08-10T11:20:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:14 smithi195 ceph-mon[129938]: pgmap v918: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 608 op/s 2023-08-10T11:20:15.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:14 smithi157 ceph-mon[129604]: pgmap v918: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.7 MiB/s wr, 608 op/s 2023-08-10T11:20:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 640.0 s, 78.4 tps, lat 1297.437 ms stddev 594.376 2023-08-10T11:20:17.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:16 smithi107 ceph-mon[127953]: pgmap v919: 129 pgs: 12 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 85 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 372 op/s 2023-08-10T11:20:17.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:16 smithi195 ceph-mon[129938]: pgmap v919: 129 pgs: 12 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 85 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 372 op/s 2023-08-10T11:20:17.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:16 smithi157 ceph-mon[129604]: pgmap v919: 129 pgs: 12 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 85 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 372 op/s 2023-08-10T11:20:18.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:17 smithi195 ceph-mon[129938]: pgmap v920: 129 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 101 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 345 op/s 2023-08-10T11:20:18.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:17 smithi157 ceph-mon[129604]: pgmap v920: 129 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 101 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 345 op/s 2023-08-10T11:20:18.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:17 smithi107 ceph-mon[127953]: pgmap v920: 129 pgs: 8 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 101 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 345 op/s 2023-08-10T11:20:20.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 645.0 s, 259.2 tps, lat 404.923 ms stddev 169.082 2023-08-10T11:20:20.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:20 smithi195 ceph-mon[129938]: pgmap v921: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 409 op/s 2023-08-10T11:20:20.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:20 smithi195 ceph-mon[129938]: osdmap e140: 12 total, 12 up, 12 in 2023-08-10T11:20:21.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:20 smithi157 ceph-mon[129604]: pgmap v921: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 409 op/s 2023-08-10T11:20:21.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:20 smithi157 ceph-mon[129604]: osdmap e140: 12 total, 12 up, 12 in 2023-08-10T11:20:21.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:20 smithi107 ceph-mon[127953]: pgmap v921: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 409 op/s 2023-08-10T11:20:21.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:20 smithi107 ceph-mon[127953]: osdmap e140: 12 total, 12 up, 12 in 2023-08-10T11:20:22.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:22 smithi195 ceph-mon[129938]: pgmap v923: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 409 op/s 2023-08-10T11:20:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:22 smithi157 ceph-mon[129604]: pgmap v923: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 409 op/s 2023-08-10T11:20:23.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:22 smithi107 ceph-mon[127953]: pgmap v923: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 409 op/s 2023-08-10T11:20:23.917 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:23 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:24.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:23 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:24.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:23 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:24.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:24 smithi195 ceph-mon[129938]: pgmap v924: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 431 op/s 2023-08-10T11:20:24.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:24 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:24.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:24 smithi195 ceph-mon[129938]: osdmap e141: 12 total, 12 up, 12 in 2023-08-10T11:20:25.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:24 smithi157 ceph-mon[129604]: pgmap v924: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 431 op/s 2023-08-10T11:20:25.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:24 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:25.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:24 smithi157 ceph-mon[129604]: osdmap e141: 12 total, 12 up, 12 in 2023-08-10T11:20:25.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:24 smithi107 ceph-mon[127953]: pgmap v924: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 431 op/s 2023-08-10T11:20:25.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:24 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:25.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:24 smithi107 ceph-mon[127953]: osdmap e141: 12 total, 12 up, 12 in 2023-08-10T11:20:25.811 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 650.0 s, 242.6 tps, lat 402.064 ms stddev 138.913 2023-08-10T11:20:27.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:26 smithi157 ceph-mon[129604]: pgmap v926: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 820 op/s 2023-08-10T11:20:27.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:26 smithi107 ceph-mon[127953]: pgmap v926: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 820 op/s 2023-08-10T11:20:27.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:26 smithi195 ceph-mon[129938]: pgmap v926: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 820 op/s 2023-08-10T11:20:29.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:28 smithi157 ceph-mon[129604]: pgmap v927: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.9 MiB/s wr, 743 op/s 2023-08-10T11:20:29.086 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:28 smithi107 ceph-mon[127953]: pgmap v927: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.9 MiB/s wr, 743 op/s 2023-08-10T11:20:29.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:28 smithi195 ceph-mon[129938]: pgmap v927: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.9 MiB/s wr, 743 op/s 2023-08-10T11:20:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 655.0 s, 257.1 tps, lat 374.930 ms stddev 179.010 2023-08-10T11:20:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:30 smithi157 ceph-mon[129604]: pgmap v928: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 745 op/s 2023-08-10T11:20:31.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:30 smithi107 ceph-mon[127953]: pgmap v928: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 745 op/s 2023-08-10T11:20:31.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:30 smithi195 ceph-mon[129938]: pgmap v928: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 745 op/s 2023-08-10T11:20:33.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:32 smithi107 ceph-mon[127953]: pgmap v929: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.8 MiB/s wr, 820 op/s 2023-08-10T11:20:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:32 smithi195 ceph-mon[129938]: pgmap v929: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.8 MiB/s wr, 820 op/s 2023-08-10T11:20:33.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:32 smithi157 ceph-mon[129604]: pgmap v929: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.8 MiB/s wr, 820 op/s 2023-08-10T11:20:35.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:34 smithi107 ceph-mon[127953]: pgmap v930: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.4 MiB/s wr, 822 op/s 2023-08-10T11:20:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:34 smithi195 ceph-mon[129938]: pgmap v930: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.4 MiB/s wr, 822 op/s 2023-08-10T11:20:35.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:34 smithi157 ceph-mon[129604]: pgmap v930: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.4 MiB/s wr, 822 op/s 2023-08-10T11:20:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 660.0 s, 246.0 tps, lat 426.829 ms stddev 446.378 2023-08-10T11:20:37.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:36 smithi107 ceph-mon[127953]: pgmap v931: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 822 op/s 2023-08-10T11:20:37.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:36 smithi195 ceph-mon[129938]: pgmap v931: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 822 op/s 2023-08-10T11:20:37.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:36 smithi157 ceph-mon[129604]: pgmap v931: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 822 op/s 2023-08-10T11:20:38.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:37 smithi157 ceph-mon[129604]: pgmap v932: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 710 op/s 2023-08-10T11:20:38.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:37 smithi107 ceph-mon[127953]: pgmap v932: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 710 op/s 2023-08-10T11:20:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:37 smithi195 ceph-mon[129938]: pgmap v932: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 710 op/s 2023-08-10T11:20:39.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:38 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:39.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:38 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:38 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:40.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 665.0 s, 263.3 tps, lat 380.088 ms stddev 151.704 2023-08-10T11:20:40.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:40 smithi195 ceph-mon[129938]: pgmap v933: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 803 op/s 2023-08-10T11:20:41.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:40 smithi157 ceph-mon[129604]: pgmap v933: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 803 op/s 2023-08-10T11:20:41.089 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:40 smithi107 ceph-mon[127953]: pgmap v933: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 803 op/s 2023-08-10T11:20:42.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:42 smithi195 ceph-mon[129938]: pgmap v934: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 800 op/s 2023-08-10T11:20:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:42 smithi157 ceph-mon[129604]: pgmap v934: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 800 op/s 2023-08-10T11:20:43.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:42 smithi107 ceph-mon[127953]: pgmap v934: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 800 op/s 2023-08-10T11:20:44.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:43 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:44.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:43 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:44.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:43 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:44 smithi157 ceph-mon[129604]: pgmap v935: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 680 op/s 2023-08-10T11:20:45.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:44 smithi107 ceph-mon[127953]: pgmap v935: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 680 op/s 2023-08-10T11:20:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:44 smithi195 ceph-mon[129938]: pgmap v935: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 680 op/s 2023-08-10T11:20:45.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 670.0 s, 239.7 tps, lat 416.080 ms stddev 314.582 2023-08-10T11:20:47.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:46 smithi157 ceph-mon[129604]: pgmap v936: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.7 MiB/s wr, 958 op/s 2023-08-10T11:20:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:46 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:47.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:46 smithi107 ceph-mon[127953]: pgmap v936: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.7 MiB/s wr, 958 op/s 2023-08-10T11:20:47.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:46 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:46 smithi195 ceph-mon[129938]: pgmap v936: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.7 MiB/s wr, 958 op/s 2023-08-10T11:20:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:46 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:20:49.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:48 smithi157 ceph-mon[129604]: pgmap v937: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.6 MiB/s wr, 720 op/s 2023-08-10T11:20:49.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:48 smithi107 ceph-mon[127953]: pgmap v937: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.6 MiB/s wr, 720 op/s 2023-08-10T11:20:49.167 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:48 smithi195 ceph-mon[129938]: pgmap v937: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.6 MiB/s wr, 720 op/s 2023-08-10T11:20:50.803 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 675.0 s, 262.7 tps, lat 390.474 ms stddev 134.977 2023-08-10T11:20:51.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:50 smithi157 ceph-mon[129604]: pgmap v938: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.2 MiB/s wr, 874 op/s 2023-08-10T11:20:51.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:50 smithi107 ceph-mon[127953]: pgmap v938: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.2 MiB/s wr, 874 op/s 2023-08-10T11:20:51.167 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:50 smithi195 ceph-mon[129938]: pgmap v938: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.2 MiB/s wr, 874 op/s 2023-08-10T11:20:53.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:52 smithi107 ceph-mon[127953]: pgmap v939: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.3 MiB/s wr, 886 op/s 2023-08-10T11:20:53.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:52 smithi195 ceph-mon[129938]: pgmap v939: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.3 MiB/s wr, 886 op/s 2023-08-10T11:20:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:52 smithi157 ceph-mon[129604]: pgmap v939: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.3 MiB/s wr, 886 op/s 2023-08-10T11:20:55.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:54 smithi195 ceph-mon[129938]: pgmap v940: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 762 op/s 2023-08-10T11:20:55.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:54 smithi157 ceph-mon[129604]: pgmap v940: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 762 op/s 2023-08-10T11:20:55.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:54 smithi107 ceph-mon[127953]: pgmap v940: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 762 op/s 2023-08-10T11:20:55.802 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 680.0 s, 284.3 tps, lat 340.850 ms stddev 101.331 2023-08-10T11:20:57.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:56 smithi195 ceph-mon[129938]: pgmap v941: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.8 MiB/s wr, 1.04k op/s 2023-08-10T11:20:57.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:56 smithi157 ceph-mon[129604]: pgmap v941: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.8 MiB/s wr, 1.04k op/s 2023-08-10T11:20:57.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:56 smithi107 ceph-mon[127953]: pgmap v941: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.8 MiB/s wr, 1.04k op/s 2023-08-10T11:20:59.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:20:58 smithi195 ceph-mon[129938]: pgmap v942: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 755 op/s 2023-08-10T11:20:59.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:20:58 smithi157 ceph-mon[129604]: pgmap v942: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 755 op/s 2023-08-10T11:20:59.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:20:58 smithi107 ceph-mon[127953]: pgmap v942: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 755 op/s 2023-08-10T11:21:00.802 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 685.0 s, 229.4 tps, lat 385.417 ms stddev 129.905 2023-08-10T11:21:01.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:00 smithi157 ceph-mon[129604]: pgmap v943: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.6 MiB/s wr, 927 op/s 2023-08-10T11:21:01.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:00 smithi107 ceph-mon[127953]: pgmap v943: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.6 MiB/s wr, 927 op/s 2023-08-10T11:21:01.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:00 smithi195 ceph-mon[129938]: pgmap v943: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.6 MiB/s wr, 927 op/s 2023-08-10T11:21:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:02 smithi157 ceph-mon[129604]: pgmap v944: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.2 MiB/s wr, 882 op/s 2023-08-10T11:21:03.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:02 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:21:03.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:02 smithi107 ceph-mon[127953]: pgmap v944: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.2 MiB/s wr, 882 op/s 2023-08-10T11:21:03.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:02 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:21:03.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:02 smithi195 ceph-mon[129938]: pgmap v944: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.2 MiB/s wr, 882 op/s 2023-08-10T11:21:03.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:02 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:21:04.042 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:03 smithi157 ceph-mon[129604]: osdmap e142: 12 total, 12 up, 12 in 2023-08-10T11:21:04.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:03 smithi107 ceph-mon[127953]: osdmap e142: 12 total, 12 up, 12 in 2023-08-10T11:21:04.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:03 smithi195 ceph-mon[129938]: osdmap e142: 12 total, 12 up, 12 in 2023-08-10T11:21:05.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:04 smithi195 ceph-mon[129938]: pgmap v946: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.2 MiB/s wr, 867 op/s 2023-08-10T11:21:05.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:04 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:21:05.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:04 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:21:05.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:04 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:21:05.295 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:04 smithi157 ceph-mon[129604]: pgmap v946: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.2 MiB/s wr, 867 op/s 2023-08-10T11:21:05.295 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:04 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:21:05.295 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:04 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:21:05.295 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:04 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:21:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:04 smithi107 ceph-mon[127953]: pgmap v946: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.2 MiB/s wr, 867 op/s 2023-08-10T11:21:05.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:04 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:21:05.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:04 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:21:05.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:04 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:21:05.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 690.0 s, 187.9 tps, lat 540.849 ms stddev 554.557 2023-08-10T11:21:07.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:06 smithi195 ceph-mon[129938]: pgmap v947: 129 pgs: 16 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 74 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.3 MiB/s wr, 791 op/s 2023-08-10T11:21:07.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:06 smithi157 ceph-mon[129604]: pgmap v947: 129 pgs: 16 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 74 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.3 MiB/s wr, 791 op/s 2023-08-10T11:21:07.335 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:06 smithi107 ceph-mon[127953]: pgmap v947: 129 pgs: 16 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 74 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.3 MiB/s wr, 791 op/s 2023-08-10T11:21:09.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:08 smithi157 ceph-mon[129604]: pgmap v948: 129 pgs: 18 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 66 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 777 op/s 2023-08-10T11:21:09.345 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:08 smithi107 ceph-mon[127953]: pgmap v948: 129 pgs: 18 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 66 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 777 op/s 2023-08-10T11:21:09.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:08 smithi195 ceph-mon[129938]: pgmap v948: 129 pgs: 18 active+clean+snaptrim, 45 active+clean+snaptrim_wait, 66 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 777 op/s 2023-08-10T11:21:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 695.0 s, 84.6 tps, lat 1281.982 ms stddev 742.673 2023-08-10T11:21:10.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:10 smithi195 ceph-mon[129938]: pgmap v949: 129 pgs: 19 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 60 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 594 op/s 2023-08-10T11:21:11.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:10 smithi157 ceph-mon[129604]: pgmap v949: 129 pgs: 19 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 60 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 594 op/s 2023-08-10T11:21:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:10 smithi107 ceph-mon[127953]: pgmap v949: 129 pgs: 19 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 60 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.3 MiB/s wr, 594 op/s 2023-08-10T11:21:13.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:12 smithi157 ceph-mon[129604]: pgmap v950: 129 pgs: 17 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 71 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 462 op/s 2023-08-10T11:21:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:12 smithi107 ceph-mon[127953]: pgmap v950: 129 pgs: 17 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 71 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 462 op/s 2023-08-10T11:21:13.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:12 smithi195 ceph-mon[129938]: pgmap v950: 129 pgs: 17 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 71 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 462 op/s 2023-08-10T11:21:15.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:14 smithi157 ceph-mon[129604]: pgmap v951: 129 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 86 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 421 op/s 2023-08-10T11:21:15.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:14 smithi107 ceph-mon[127953]: pgmap v951: 129 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 86 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 421 op/s 2023-08-10T11:21:15.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:14 smithi195 ceph-mon[129938]: pgmap v951: 129 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 86 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 421 op/s 2023-08-10T11:21:15.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 700.0 s, 153.4 tps, lat 655.830 ms stddev 256.287 2023-08-10T11:21:17.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:16 smithi157 ceph-mon[129604]: pgmap v952: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.3 MiB/s wr, 488 op/s 2023-08-10T11:21:17.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:16 smithi107 ceph-mon[127953]: pgmap v952: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.3 MiB/s wr, 488 op/s 2023-08-10T11:21:17.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:16 smithi195 ceph-mon[129938]: pgmap v952: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.3 MiB/s wr, 488 op/s 2023-08-10T11:21:19.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:18 smithi107 ceph-mon[127953]: pgmap v953: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 241 op/s 2023-08-10T11:21:19.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:18 smithi195 ceph-mon[129938]: pgmap v953: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 241 op/s 2023-08-10T11:21:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:18 smithi157 ceph-mon[129604]: pgmap v953: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 241 op/s 2023-08-10T11:21:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 705.0 s, 225.0 tps, lat 442.352 ms stddev 339.449 2023-08-10T11:21:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:20 smithi157 ceph-mon[129604]: pgmap v954: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 512 op/s 2023-08-10T11:21:21.040 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:20 smithi157 ceph-mon[129604]: osdmap e143: 12 total, 12 up, 12 in 2023-08-10T11:21:21.087 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:20 smithi107 ceph-mon[127953]: pgmap v954: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 512 op/s 2023-08-10T11:21:21.087 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:20 smithi107 ceph-mon[127953]: osdmap e143: 12 total, 12 up, 12 in 2023-08-10T11:21:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:20 smithi195 ceph-mon[129938]: pgmap v954: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 512 op/s 2023-08-10T11:21:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:20 smithi195 ceph-mon[129938]: osdmap e143: 12 total, 12 up, 12 in 2023-08-10T11:21:23.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:22 smithi157 ceph-mon[129604]: pgmap v956: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 502 op/s 2023-08-10T11:21:23.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:22 smithi107 ceph-mon[127953]: pgmap v956: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 502 op/s 2023-08-10T11:21:23.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:22 smithi195 ceph-mon[129938]: pgmap v956: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 502 op/s 2023-08-10T11:21:25.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:24 smithi157 ceph-mon[129604]: pgmap v957: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 481 op/s 2023-08-10T11:21:25.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:24 smithi157 ceph-mon[129604]: osdmap e144: 12 total, 12 up, 12 in 2023-08-10T11:21:25.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:24 smithi107 ceph-mon[127953]: pgmap v957: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 481 op/s 2023-08-10T11:21:25.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:24 smithi107 ceph-mon[127953]: osdmap e144: 12 total, 12 up, 12 in 2023-08-10T11:21:25.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:24 smithi195 ceph-mon[129938]: pgmap v957: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 481 op/s 2023-08-10T11:21:25.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:24 smithi195 ceph-mon[129938]: osdmap e144: 12 total, 12 up, 12 in 2023-08-10T11:21:25.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 710.0 s, 240.6 tps, lat 421.643 ms stddev 189.342 2023-08-10T11:21:27.041 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:26 smithi157 ceph-mon[129604]: pgmap v959: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 899 op/s 2023-08-10T11:21:27.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:26 smithi107 ceph-mon[127953]: pgmap v959: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 899 op/s 2023-08-10T11:21:27.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:26 smithi195 ceph-mon[129938]: pgmap v959: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.7 MiB/s wr, 899 op/s 2023-08-10T11:21:29.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:28 smithi107 ceph-mon[127953]: pgmap v960: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 469 op/s 2023-08-10T11:21:29.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:28 smithi195 ceph-mon[129938]: pgmap v960: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 469 op/s 2023-08-10T11:21:29.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:28 smithi157 ceph-mon[129604]: pgmap v960: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 469 op/s 2023-08-10T11:21:30.802 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 715.0 s, 263.0 tps, lat 383.034 ms stddev 145.145 2023-08-10T11:21:31.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:30 smithi157 ceph-mon[129604]: pgmap v961: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 824 op/s 2023-08-10T11:21:31.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:30 smithi157 ceph-mon[129604]: osdmap e145: 12 total, 12 up, 12 in 2023-08-10T11:21:31.087 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:30 smithi107 ceph-mon[127953]: pgmap v961: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 824 op/s 2023-08-10T11:21:31.087 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:30 smithi107 ceph-mon[127953]: osdmap e145: 12 total, 12 up, 12 in 2023-08-10T11:21:31.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:30 smithi195 ceph-mon[129938]: pgmap v961: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 824 op/s 2023-08-10T11:21:31.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:30 smithi195 ceph-mon[129938]: osdmap e145: 12 total, 12 up, 12 in 2023-08-10T11:21:33.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:32 smithi157 ceph-mon[129604]: pgmap v963: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.7 MiB/s wr, 996 op/s 2023-08-10T11:21:33.089 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:32 smithi107 ceph-mon[127953]: pgmap v963: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.7 MiB/s wr, 996 op/s 2023-08-10T11:21:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:32 smithi195 ceph-mon[129938]: pgmap v963: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 8.7 MiB/s wr, 996 op/s 2023-08-10T11:21:35.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:34 smithi157 ceph-mon[129604]: pgmap v964: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 487 op/s 2023-08-10T11:21:35.088 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:34 smithi107 ceph-mon[127953]: pgmap v964: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 487 op/s 2023-08-10T11:21:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:34 smithi195 ceph-mon[129938]: pgmap v964: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 487 op/s 2023-08-10T11:21:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 720.0 s, 242.6 tps, lat 416.724 ms stddev 186.823 2023-08-10T11:21:37.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:36 smithi157 ceph-mon[129604]: pgmap v965: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 825 op/s 2023-08-10T11:21:37.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:36 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:21:37.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:36 smithi107 ceph-mon[127953]: pgmap v965: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 825 op/s 2023-08-10T11:21:37.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:36 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:21:37.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:36 smithi195 ceph-mon[129938]: pgmap v965: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 825 op/s 2023-08-10T11:21:37.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:36 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:21:39.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:38 smithi157 ceph-mon[129604]: pgmap v966: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 825 op/s 2023-08-10T11:21:39.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:38 smithi107 ceph-mon[127953]: pgmap v966: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 825 op/s 2023-08-10T11:21:39.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:38 smithi195 ceph-mon[129938]: pgmap v966: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 825 op/s 2023-08-10T11:21:40.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 725.0 s, 255.9 tps, lat 385.594 ms stddev 151.474 2023-08-10T11:21:41.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:40 smithi157 ceph-mon[129604]: pgmap v967: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 797 op/s 2023-08-10T11:21:41.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:40 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:21:41.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:40 smithi107 ceph-mon[127953]: pgmap v967: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 797 op/s 2023-08-10T11:21:41.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:40 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:21:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:40 smithi195 ceph-mon[129938]: pgmap v967: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 797 op/s 2023-08-10T11:21:41.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:40 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:21:43.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:42 smithi157 ceph-mon[129604]: pgmap v968: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 685 op/s 2023-08-10T11:21:43.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:42 smithi107 ceph-mon[127953]: pgmap v968: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 685 op/s 2023-08-10T11:21:43.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:42 smithi195 ceph-mon[129938]: pgmap v968: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.0 MiB/s wr, 685 op/s 2023-08-10T11:21:45.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:44 smithi157 ceph-mon[129604]: pgmap v969: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 664 op/s 2023-08-10T11:21:45.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:44 smithi107 ceph-mon[127953]: pgmap v969: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 664 op/s 2023-08-10T11:21:45.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:44 smithi195 ceph-mon[129938]: pgmap v969: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 664 op/s 2023-08-10T11:21:45.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 730.0 s, 184.3 tps, lat 523.552 ms stddev 345.847 2023-08-10T11:21:47.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:46 smithi157 ceph-mon[129604]: pgmap v970: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.1 MiB/s wr, 1.01k op/s 2023-08-10T11:21:47.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:46 smithi107 ceph-mon[127953]: pgmap v970: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.1 MiB/s wr, 1.01k op/s 2023-08-10T11:21:47.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:46 smithi195 ceph-mon[129938]: pgmap v970: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.1 MiB/s wr, 1.01k op/s 2023-08-10T11:21:49.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:48 smithi107 ceph-mon[127953]: pgmap v971: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 668 op/s 2023-08-10T11:21:49.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:48 smithi195 ceph-mon[129938]: pgmap v971: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 668 op/s 2023-08-10T11:21:49.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:48 smithi157 ceph-mon[129604]: pgmap v971: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 668 op/s 2023-08-10T11:21:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 735.0 s, 252.2 tps, lat 408.928 ms stddev 162.347 2023-08-10T11:21:51.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:50 smithi195 ceph-mon[129938]: pgmap v972: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.4 MiB/s wr, 1.01k op/s 2023-08-10T11:21:51.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:50 smithi157 ceph-mon[129604]: pgmap v972: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.4 MiB/s wr, 1.01k op/s 2023-08-10T11:21:51.334 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:50 smithi107 ceph-mon[127953]: pgmap v972: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.4 MiB/s wr, 1.01k op/s 2023-08-10T11:21:53.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:52 smithi195 ceph-mon[129938]: pgmap v973: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 682 op/s 2023-08-10T11:21:53.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:52 smithi157 ceph-mon[129604]: pgmap v973: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 682 op/s 2023-08-10T11:21:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:52 smithi107 ceph-mon[127953]: pgmap v973: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 682 op/s 2023-08-10T11:21:55.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:54 smithi195 ceph-mon[129938]: pgmap v974: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 682 op/s 2023-08-10T11:21:55.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:54 smithi157 ceph-mon[129604]: pgmap v974: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 682 op/s 2023-08-10T11:21:55.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:54 smithi107 ceph-mon[127953]: pgmap v974: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 682 op/s 2023-08-10T11:21:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 740.0 s, 287.4 tps, lat 352.079 ms stddev 202.033 2023-08-10T11:21:57.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:56 smithi195 ceph-mon[129938]: pgmap v975: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.7 MiB/s wr, 1.03k op/s 2023-08-10T11:21:57.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:56 smithi157 ceph-mon[129604]: pgmap v975: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.7 MiB/s wr, 1.03k op/s 2023-08-10T11:21:57.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:56 smithi107 ceph-mon[127953]: pgmap v975: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.7 MiB/s wr, 1.03k op/s 2023-08-10T11:21:59.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:21:58 smithi195 ceph-mon[129938]: pgmap v976: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 691 op/s 2023-08-10T11:21:59.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:21:58 smithi157 ceph-mon[129604]: pgmap v976: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 691 op/s 2023-08-10T11:21:59.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:21:58 smithi107 ceph-mon[127953]: pgmap v976: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 691 op/s 2023-08-10T11:22:00.808 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 745.0 s, 295.6 tps, lat 300.519 ms stddev 96.993 2023-08-10T11:22:01.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:00 smithi195 ceph-mon[129938]: pgmap v977: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 1.06k op/s 2023-08-10T11:22:01.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:00 smithi157 ceph-mon[129604]: pgmap v977: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 1.06k op/s 2023-08-10T11:22:01.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:00 smithi107 ceph-mon[127953]: pgmap v977: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 1.06k op/s 2023-08-10T11:22:03.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:02 smithi157 ceph-mon[129604]: pgmap v978: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 723 op/s 2023-08-10T11:22:03.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:02 smithi107 ceph-mon[127953]: pgmap v978: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 723 op/s 2023-08-10T11:22:03.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:02 smithi195 ceph-mon[129938]: pgmap v978: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 723 op/s 2023-08-10T11:22:05.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:04 smithi157 ceph-mon[129604]: pgmap v979: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 723 op/s 2023-08-10T11:22:05.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:04 smithi107 ceph-mon[127953]: pgmap v979: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 723 op/s 2023-08-10T11:22:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:04 smithi195 ceph-mon[129938]: pgmap v979: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.8 MiB/s wr, 723 op/s 2023-08-10T11:22:05.801 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 750.0 s, 304.7 tps, lat 368.294 ms stddev 323.692 2023-08-10T11:22:06.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:05 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:22:06.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:05 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:22:06.417 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:05 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:22:07.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:06 smithi157 ceph-mon[129604]: pgmap v980: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 10 MiB/s wr, 1.10k op/s 2023-08-10T11:22:07.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:06 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:06 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:06 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:06 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:06 smithi107 ceph-mon[127953]: pgmap v980: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 10 MiB/s wr, 1.10k op/s 2023-08-10T11:22:07.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:06 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:06 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:06 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:06 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:06 smithi195 ceph-mon[129938]: pgmap v980: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 10 MiB/s wr, 1.10k op/s 2023-08-10T11:22:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:06 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:06 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:06 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:06 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:08 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:08 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:08 smithi195 ceph-mon[129938]: pgmap v981: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.0 MiB/s wr, 753 op/s 2023-08-10T11:22:08.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:08 smithi195 ceph-mon[129938]: osdmap e146: 12 total, 12 up, 12 in 2023-08-10T11:22:08.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:08 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:08.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:08 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:08.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:08 smithi157 ceph-mon[129604]: pgmap v981: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.0 MiB/s wr, 753 op/s 2023-08-10T11:22:08.542 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:08 smithi157 ceph-mon[129604]: osdmap e146: 12 total, 12 up, 12 in 2023-08-10T11:22:08.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:08 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:08.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:08 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:08.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:08 smithi107 ceph-mon[127953]: pgmap v981: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.0 MiB/s wr, 753 op/s 2023-08-10T11:22:08.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:08 smithi107 ceph-mon[127953]: osdmap e146: 12 total, 12 up, 12 in 2023-08-10T11:22:10.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:10.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:10 smithi195 ceph-mon[129938]: pgmap v983: 129 pgs: 18 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 61 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 696 op/s 2023-08-10T11:22:10.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:10.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:22:10.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:22:10.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:10.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:10 smithi157 ceph-mon[129604]: pgmap v983: 129 pgs: 18 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 61 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 696 op/s 2023-08-10T11:22:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:22:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:22:10.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 755.0 s, 89.6 tps, lat 808.869 ms stddev 475.947 2023-08-10T11:22:10.835 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:10.835 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:10 smithi107 ceph-mon[127953]: pgmap v983: 129 pgs: 18 active+clean+snaptrim, 50 active+clean+snaptrim_wait, 61 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 696 op/s 2023-08-10T11:22:10.836 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:10.836 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:22:10.836 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:22:10.836 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:22:12.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:12 smithi157 ceph-mon[129604]: pgmap v984: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 730 op/s 2023-08-10T11:22:12.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:12 smithi107 ceph-mon[127953]: pgmap v984: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 730 op/s 2023-08-10T11:22:12.828 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 11:22:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T11:22:12.519+0000 7f1a7cd3e700 -1 calc_pg_upmaps abort due to max <= 0 2023-08-10T11:22:12.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:12 smithi195 ceph-mon[129938]: pgmap v984: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 730 op/s 2023-08-10T11:22:13.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:13 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:22:13.833 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:13 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:22:13.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:13 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:22:14.835 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:14 smithi107 ceph-mon[127953]: pgmap v985: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 730 op/s 2023-08-10T11:22:14.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:14 smithi195 ceph-mon[129938]: pgmap v985: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 730 op/s 2023-08-10T11:22:15.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:14 smithi157 ceph-mon[129604]: pgmap v985: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.7 MiB/s wr, 730 op/s 2023-08-10T11:22:15.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 760.0 s, 72.2 tps, lat 1612.786 ms stddev 739.598 2023-08-10T11:22:17.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:16 smithi157 ceph-mon[129604]: pgmap v986: 129 pgs: 14 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 82 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 389 op/s 2023-08-10T11:22:17.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:16 smithi107 ceph-mon[127953]: pgmap v986: 129 pgs: 14 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 82 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 389 op/s 2023-08-10T11:22:17.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:16 smithi195 ceph-mon[129938]: pgmap v986: 129 pgs: 14 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 82 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 389 op/s 2023-08-10T11:22:19.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:18 smithi107 ceph-mon[127953]: pgmap v987: 129 pgs: 14 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 82 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 388 op/s 2023-08-10T11:22:19.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:18 smithi195 ceph-mon[129938]: pgmap v987: 129 pgs: 14 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 82 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 388 op/s 2023-08-10T11:22:19.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:18 smithi157 ceph-mon[129604]: pgmap v987: 129 pgs: 14 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 82 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 388 op/s 2023-08-10T11:22:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 765.0 s, 197.1 tps, lat 543.930 ms stddev 300.212 2023-08-10T11:22:21.085 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:20 smithi107 ceph-mon[127953]: pgmap v988: 129 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 125 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 507 op/s 2023-08-10T11:22:21.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:20 smithi195 ceph-mon[129938]: pgmap v988: 129 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 125 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 507 op/s 2023-08-10T11:22:21.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:20 smithi157 ceph-mon[129604]: pgmap v988: 129 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 125 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 507 op/s 2023-08-10T11:22:23.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:22 smithi195 ceph-mon[129938]: pgmap v989: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 310 op/s 2023-08-10T11:22:23.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:22 smithi157 ceph-mon[129604]: pgmap v989: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 310 op/s 2023-08-10T11:22:23.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:22 smithi107 ceph-mon[127953]: pgmap v989: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 310 op/s 2023-08-10T11:22:25.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:24 smithi195 ceph-mon[129938]: pgmap v990: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 281 op/s 2023-08-10T11:22:25.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:24 smithi195 ceph-mon[129938]: osdmap e147: 12 total, 12 up, 12 in 2023-08-10T11:22:25.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:24 smithi157 ceph-mon[129604]: pgmap v990: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 281 op/s 2023-08-10T11:22:25.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:24 smithi157 ceph-mon[129604]: osdmap e147: 12 total, 12 up, 12 in 2023-08-10T11:22:25.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:24 smithi107 ceph-mon[127953]: pgmap v990: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 281 op/s 2023-08-10T11:22:25.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:24 smithi107 ceph-mon[127953]: osdmap e147: 12 total, 12 up, 12 in 2023-08-10T11:22:25.804 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 770.0 s, 221.0 tps, lat 460.483 ms stddev 185.309 2023-08-10T11:22:27.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:26 smithi157 ceph-mon[129604]: pgmap v992: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 561 op/s 2023-08-10T11:22:27.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:26 smithi107 ceph-mon[127953]: pgmap v992: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 561 op/s 2023-08-10T11:22:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:26 smithi195 ceph-mon[129938]: pgmap v992: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 561 op/s 2023-08-10T11:22:29.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:28 smithi157 ceph-mon[129604]: pgmap v993: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 563 op/s 2023-08-10T11:22:29.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:28 smithi107 ceph-mon[127953]: pgmap v993: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 563 op/s 2023-08-10T11:22:29.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:28 smithi195 ceph-mon[129938]: pgmap v993: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 563 op/s 2023-08-10T11:22:30.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 775.0 s, 169.0 tps, lat 305.908 ms stddev 172.722 2023-08-10T11:22:31.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:30 smithi157 ceph-mon[129604]: pgmap v994: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 711 op/s 2023-08-10T11:22:31.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:30 smithi107 ceph-mon[127953]: pgmap v994: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 711 op/s 2023-08-10T11:22:31.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:30 smithi195 ceph-mon[129938]: pgmap v994: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 711 op/s 2023-08-10T11:22:33.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:33 smithi157 ceph-mon[129604]: pgmap v995: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 726 op/s 2023-08-10T11:22:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:32 smithi107 ceph-mon[127953]: pgmap v995: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 726 op/s 2023-08-10T11:22:33.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:32 smithi195 ceph-mon[129938]: pgmap v995: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 726 op/s 2023-08-10T11:22:35.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:35 smithi157 ceph-mon[129604]: pgmap v996: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 726 op/s 2023-08-10T11:22:35.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:35 smithi107 ceph-mon[127953]: pgmap v996: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 726 op/s 2023-08-10T11:22:35.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:35 smithi195 ceph-mon[129938]: pgmap v996: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.3 MiB/s wr, 726 op/s 2023-08-10T11:22:35.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 780.0 s, 327.2 tps, lat 455.948 ms stddev 664.501 2023-08-10T11:22:37.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:37 smithi107 ceph-mon[127953]: pgmap v997: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.3 MiB/s wr, 757 op/s 2023-08-10T11:22:37.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:37 smithi195 ceph-mon[129938]: pgmap v997: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.3 MiB/s wr, 757 op/s 2023-08-10T11:22:37.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:37 smithi157 ceph-mon[129604]: pgmap v997: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.3 MiB/s wr, 757 op/s 2023-08-10T11:22:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:39 smithi107 ceph-mon[127953]: pgmap v998: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 645 op/s 2023-08-10T11:22:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:39 smithi195 ceph-mon[129938]: pgmap v998: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 645 op/s 2023-08-10T11:22:39.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:39 smithi157 ceph-mon[129604]: pgmap v998: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 645 op/s 2023-08-10T11:22:40.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 785.0 s, 263.6 tps, lat 368.974 ms stddev 121.986 2023-08-10T11:22:41.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:41 smithi195 ceph-mon[129938]: pgmap v999: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.3 MiB/s wr, 974 op/s 2023-08-10T11:22:41.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:41 smithi157 ceph-mon[129604]: pgmap v999: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.3 MiB/s wr, 974 op/s 2023-08-10T11:22:41.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:41 smithi107 ceph-mon[127953]: pgmap v999: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.3 MiB/s wr, 974 op/s 2023-08-10T11:22:42.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:42 smithi195 ceph-mon[129938]: pgmap v1000: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 732 op/s 2023-08-10T11:22:42.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:42 smithi157 ceph-mon[129604]: pgmap v1000: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 732 op/s 2023-08-10T11:22:42.584 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:42 smithi107 ceph-mon[127953]: pgmap v1000: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 732 op/s 2023-08-10T11:22:44.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:44 smithi107 ceph-mon[127953]: pgmap v1001: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 694 op/s 2023-08-10T11:22:44.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:44 smithi195 ceph-mon[129938]: pgmap v1001: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 694 op/s 2023-08-10T11:22:45.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:44 smithi157 ceph-mon[129604]: pgmap v1001: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 694 op/s 2023-08-10T11:22:45.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 790.0 s, 264.6 tps, lat 382.430 ms stddev 221.130 2023-08-10T11:22:47.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:46 smithi157 ceph-mon[129604]: pgmap v1002: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-08-10T11:22:47.082 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:46 smithi107 ceph-mon[127953]: pgmap v1002: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-08-10T11:22:47.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:46 smithi195 ceph-mon[129938]: pgmap v1002: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-08-10T11:22:49.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:48 smithi107 ceph-mon[127953]: pgmap v1003: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 726 op/s 2023-08-10T11:22:49.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:48 smithi195 ceph-mon[129938]: pgmap v1003: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 726 op/s 2023-08-10T11:22:49.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:48 smithi157 ceph-mon[129604]: pgmap v1003: 129 pgs: 129 active+clean; 16 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 726 op/s 2023-08-10T11:22:50.801 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 795.0 s, 267.4 tps, lat 376.079 ms stddev 152.895 2023-08-10T11:22:51.081 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:50 smithi107 ceph-mon[127953]: pgmap v1004: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.6 MiB/s wr, 1.03k op/s 2023-08-10T11:22:51.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:50 smithi195 ceph-mon[129938]: pgmap v1004: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.6 MiB/s wr, 1.03k op/s 2023-08-10T11:22:51.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:50 smithi157 ceph-mon[129604]: pgmap v1004: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.6 MiB/s wr, 1.03k op/s 2023-08-10T11:22:53.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:52 smithi195 ceph-mon[129938]: pgmap v1005: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 741 op/s 2023-08-10T11:22:53.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:52 smithi157 ceph-mon[129604]: pgmap v1005: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 741 op/s 2023-08-10T11:22:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:52 smithi107 ceph-mon[127953]: pgmap v1005: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 741 op/s 2023-08-10T11:22:55.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:54 smithi195 ceph-mon[129938]: pgmap v1006: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 711 op/s 2023-08-10T11:22:55.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:54 smithi157 ceph-mon[129604]: pgmap v1006: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 711 op/s 2023-08-10T11:22:55.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:54 smithi107 ceph-mon[127953]: pgmap v1006: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 711 op/s 2023-08-10T11:22:55.803 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 800.0 s, 271.8 tps, lat 376.249 ms stddev 110.702 2023-08-10T11:22:57.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:56 smithi195 ceph-mon[129938]: pgmap v1007: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-08-10T11:22:57.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:56 smithi157 ceph-mon[129604]: pgmap v1007: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-08-10T11:22:57.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:56 smithi107 ceph-mon[127953]: pgmap v1007: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-08-10T11:22:59.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:22:58 smithi157 ceph-mon[129604]: pgmap v1008: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.4 MiB/s wr, 717 op/s 2023-08-10T11:22:59.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:22:58 smithi107 ceph-mon[127953]: pgmap v1008: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.4 MiB/s wr, 717 op/s 2023-08-10T11:22:59.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:22:58 smithi195 ceph-mon[129938]: pgmap v1008: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.4 MiB/s wr, 717 op/s 2023-08-10T11:23:00.804 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 805.0 s, 229.6 tps, lat 377.147 ms stddev 230.487 2023-08-10T11:23:01.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:01 smithi157 ceph-mon[129604]: pgmap v1009: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.03k op/s 2023-08-10T11:23:01.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:00 smithi107 ceph-mon[127953]: pgmap v1009: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.03k op/s 2023-08-10T11:23:01.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:01 smithi195 ceph-mon[129938]: pgmap v1009: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.03k op/s 2023-08-10T11:23:03.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:03 smithi107 ceph-mon[127953]: pgmap v1010: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 785 op/s 2023-08-10T11:23:03.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:03 smithi107 ceph-mon[127953]: osdmap e148: 12 total, 12 up, 12 in 2023-08-10T11:23:03.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:03 smithi195 ceph-mon[129938]: pgmap v1010: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 785 op/s 2023-08-10T11:23:03.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:03 smithi195 ceph-mon[129938]: osdmap e148: 12 total, 12 up, 12 in 2023-08-10T11:23:03.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:03 smithi157 ceph-mon[129604]: pgmap v1010: 129 pgs: 129 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 785 op/s 2023-08-10T11:23:03.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:03 smithi157 ceph-mon[129604]: osdmap e148: 12 total, 12 up, 12 in 2023-08-10T11:23:04.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:04 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:23:04.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:04 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:23:04.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:04 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:23:05.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:05 smithi195 ceph-mon[129938]: pgmap v1012: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 889 op/s 2023-08-10T11:23:05.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:05 smithi157 ceph-mon[129604]: pgmap v1012: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 889 op/s 2023-08-10T11:23:05.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:05 smithi107 ceph-mon[127953]: pgmap v1012: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 889 op/s 2023-08-10T11:23:05.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 810.0 s, 120.9 tps, lat 753.017 ms stddev 1056.245 2023-08-10T11:23:06.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:06 smithi157 ceph-mon[129604]: pgmap v1013: 129 pgs: 48 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 63 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 750 op/s 2023-08-10T11:23:06.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:06 smithi107 ceph-mon[127953]: pgmap v1013: 129 pgs: 48 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 63 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 750 op/s 2023-08-10T11:23:06.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:06 smithi195 ceph-mon[129938]: pgmap v1013: 129 pgs: 48 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 63 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 750 op/s 2023-08-10T11:23:08.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:08 smithi195 ceph-mon[129938]: pgmap v1014: 129 pgs: 53 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 56 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 782 op/s 2023-08-10T11:23:09.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:08 smithi157 ceph-mon[129604]: pgmap v1014: 129 pgs: 53 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 56 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 782 op/s 2023-08-10T11:23:09.079 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:08 smithi107 ceph-mon[127953]: pgmap v1014: 129 pgs: 53 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 56 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.6 MiB/s wr, 782 op/s 2023-08-10T11:23:10.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 815.0 s, 79.6 tps, lat 1462.870 ms stddev 930.265 2023-08-10T11:23:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:10 smithi107 ceph-mon[127953]: pgmap v1015: 129 pgs: 38 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 77 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 473 op/s 2023-08-10T11:23:11.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:10 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:23:11.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:10 smithi195 ceph-mon[129938]: pgmap v1015: 129 pgs: 38 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 77 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 473 op/s 2023-08-10T11:23:11.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:10 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:23:11.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:10 smithi157 ceph-mon[129604]: pgmap v1015: 129 pgs: 38 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 77 active+clean; 16 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 473 op/s 2023-08-10T11:23:11.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:10 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:23:13.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:12 smithi107 ceph-mon[127953]: pgmap v1016: 129 pgs: 26 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 92 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 419 op/s 2023-08-10T11:23:13.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:12 smithi195 ceph-mon[129938]: pgmap v1016: 129 pgs: 26 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 92 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 419 op/s 2023-08-10T11:23:13.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:12 smithi157 ceph-mon[129604]: pgmap v1016: 129 pgs: 26 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 92 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 419 op/s 2023-08-10T11:23:14.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:13 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:23:14.295 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:13 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:23:14.351 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:13 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:23:15.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:14 smithi195 ceph-mon[129938]: pgmap v1017: 129 pgs: 21 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 99 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 377 op/s 2023-08-10T11:23:15.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:14 smithi157 ceph-mon[129604]: pgmap v1017: 129 pgs: 21 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 99 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 377 op/s 2023-08-10T11:23:15.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:14 smithi107 ceph-mon[127953]: pgmap v1017: 129 pgs: 21 active+clean+snaptrim_wait, 9 active+clean+snaptrim, 99 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 377 op/s 2023-08-10T11:23:15.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 820.0 s, 165.6 tps, lat 629.184 ms stddev 735.090 2023-08-10T11:23:16.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:15 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:16.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:15 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:16.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:15 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:16.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:15 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:16.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:15 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:16.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:15 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:17.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:16 smithi157 ceph-mon[129604]: pgmap v1018: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 474 op/s 2023-08-10T11:23:17.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:16 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:16 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T11:23:17.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:16 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T11:23:17.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:16 smithi107 ceph-mon[127953]: pgmap v1018: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 474 op/s 2023-08-10T11:23:17.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:16 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:16 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T11:23:17.332 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:16 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T11:23:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:16 smithi195 ceph-mon[129938]: pgmap v1018: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 474 op/s 2023-08-10T11:23:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:16 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:17.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:16 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi157 to 220.9M 2023-08-10T11:23:17.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:16 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi157 to 231676928: error parsing value: Value '231676928' is below minimum 939524096 2023-08-10T11:23:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:18 smithi157 ceph-mon[129604]: pgmap v1019: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 252 op/s 2023-08-10T11:23:19.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:18 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:23:19.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:18 smithi107 ceph-mon[127953]: pgmap v1019: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 252 op/s 2023-08-10T11:23:19.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:18 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:23:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:18 smithi195 ceph-mon[129938]: pgmap v1019: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 252 op/s 2023-08-10T11:23:19.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:18 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:23:20.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:20.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:20 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:20.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:20 smithi157 ceph-mon[129604]: pgmap v1020: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 403 op/s 2023-08-10T11:23:20.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:20 smithi157 ceph-mon[129604]: osdmap e149: 12 total, 12 up, 12 in 2023-08-10T11:23:20.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 825.0 s, 227.2 tps, lat 425.885 ms stddev 242.103 2023-08-10T11:23:20.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:20.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:20 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:20.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:20 smithi107 ceph-mon[127953]: pgmap v1020: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 403 op/s 2023-08-10T11:23:20.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:20 smithi107 ceph-mon[127953]: osdmap e149: 12 total, 12 up, 12 in 2023-08-10T11:23:20.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:20.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:20 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:20.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:20 smithi195 ceph-mon[129938]: pgmap v1020: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 403 op/s 2023-08-10T11:23:20.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:20 smithi195 ceph-mon[129938]: osdmap e149: 12 total, 12 up, 12 in 2023-08-10T11:23:21.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:21 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:21 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T11:23:21.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:21 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T11:23:21.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:21 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:21 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T11:23:21.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:21 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T11:23:21.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:21 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:21.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:21 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-08-10T11:23:21.916 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:21 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi195 to 231659724: error parsing value: Value '231659724' is below minimum 939524096 2023-08-10T11:23:22.915 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:22 smithi195 ceph-mon[129938]: pgmap v1022: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.5 MiB/s wr, 485 op/s 2023-08-10T11:23:23.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:22 smithi157 ceph-mon[129604]: pgmap v1022: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.5 MiB/s wr, 485 op/s 2023-08-10T11:23:23.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:22 smithi107 ceph-mon[127953]: pgmap v1022: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.5 MiB/s wr, 485 op/s 2023-08-10T11:23:24.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:24 smithi195 ceph-mon[129938]: pgmap v1023: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.7 MiB/s wr, 522 op/s 2023-08-10T11:23:25.038 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:24 smithi157 ceph-mon[129604]: pgmap v1023: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.7 MiB/s wr, 522 op/s 2023-08-10T11:23:25.085 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:24 smithi107 ceph-mon[127953]: pgmap v1023: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.7 MiB/s wr, 522 op/s 2023-08-10T11:23:25.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 830.0 s, 199.0 tps, lat 503.384 ms stddev 164.870 2023-08-10T11:23:26.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:26.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:26 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:26.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:26.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:26 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:26.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:26.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:26 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:27 smithi195 ceph-mon[129938]: pgmap v1024: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.1 MiB/s wr, 699 op/s 2023-08-10T11:23:27.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:27 smithi157 ceph-mon[129604]: pgmap v1024: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.1 MiB/s wr, 699 op/s 2023-08-10T11:23:27.584 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:27 smithi107 ceph-mon[127953]: pgmap v1024: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.1 MiB/s wr, 699 op/s 2023-08-10T11:23:28.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:23:28.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:23:28.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:28.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:23:28.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:23:28.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:28.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-08-10T11:23:28.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:23:28.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:23:28.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:23:29.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:29 smithi157 ceph-mon[129604]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T11:23:29.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:29 smithi157 ceph-mon[129604]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T11:23:29.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:29 smithi157 ceph-mon[129604]: pgmap v1025: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.2 MiB/s wr, 710 op/s 2023-08-10T11:23:29.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:29 smithi107 ceph-mon[127953]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T11:23:29.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:29 smithi107 ceph-mon[127953]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T11:23:29.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:29 smithi107 ceph-mon[127953]: pgmap v1025: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.2 MiB/s wr, 710 op/s 2023-08-10T11:23:29.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:29 smithi195 ceph-mon[129938]: Adjusting osd_memory_target on smithi107 to 220.8M 2023-08-10T11:23:29.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:29 smithi195 ceph-mon[129938]: Unable to set osd_memory_target on smithi107 to 231616000: error parsing value: Value '231616000' is below minimum 939524096 2023-08-10T11:23:29.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:29 smithi195 ceph-mon[129938]: pgmap v1025: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.2 MiB/s wr, 710 op/s 2023-08-10T11:23:30.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 835.0 s, 244.1 tps, lat 425.132 ms stddev 154.479 2023-08-10T11:23:31.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:30 smithi195 ceph-mon[129938]: pgmap v1026: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 744 op/s 2023-08-10T11:23:31.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:30 smithi157 ceph-mon[129604]: pgmap v1026: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 744 op/s 2023-08-10T11:23:31.333 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:30 smithi107 ceph-mon[127953]: pgmap v1026: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 744 op/s 2023-08-10T11:23:33.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:32 smithi195 ceph-mon[129938]: pgmap v1027: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 697 op/s 2023-08-10T11:23:33.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:32 smithi157 ceph-mon[129604]: pgmap v1027: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 697 op/s 2023-08-10T11:23:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:32 smithi107 ceph-mon[127953]: pgmap v1027: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 697 op/s 2023-08-10T11:23:35.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:34 smithi195 ceph-mon[129938]: pgmap v1028: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.3 MiB/s wr, 710 op/s 2023-08-10T11:23:35.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:34 smithi157 ceph-mon[129604]: pgmap v1028: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.3 MiB/s wr, 710 op/s 2023-08-10T11:23:35.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:34 smithi107 ceph-mon[127953]: pgmap v1028: 129 pgs: 129 active+clean; 15 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.3 MiB/s wr, 710 op/s 2023-08-10T11:23:35.804 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 840.0 s, 314.3 tps, lat 322.399 ms stddev 120.054 2023-08-10T11:23:37.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:36 smithi157 ceph-mon[129604]: pgmap v1029: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.0 MiB/s wr, 942 op/s 2023-08-10T11:23:37.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:36 smithi107 ceph-mon[127953]: pgmap v1029: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.0 MiB/s wr, 942 op/s 2023-08-10T11:23:37.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:36 smithi195 ceph-mon[129938]: pgmap v1029: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.0 MiB/s wr, 942 op/s 2023-08-10T11:23:39.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:38 smithi157 ceph-mon[129604]: pgmap v1030: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 717 op/s 2023-08-10T11:23:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:38 smithi107 ceph-mon[127953]: pgmap v1030: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 717 op/s 2023-08-10T11:23:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:38 smithi195 ceph-mon[129938]: pgmap v1030: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 717 op/s 2023-08-10T11:23:40.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 845.0 s, 236.1 tps, lat 399.551 ms stddev 141.970 2023-08-10T11:23:41.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:40 smithi157 ceph-mon[129604]: pgmap v1031: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 940 op/s 2023-08-10T11:23:41.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:40 smithi107 ceph-mon[127953]: pgmap v1031: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 940 op/s 2023-08-10T11:23:41.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:40 smithi195 ceph-mon[129938]: pgmap v1031: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.1 MiB/s wr, 940 op/s 2023-08-10T11:23:43.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:43 smithi195 ceph-mon[129938]: pgmap v1032: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 813 op/s 2023-08-10T11:23:43.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:43 smithi157 ceph-mon[129604]: pgmap v1032: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 813 op/s 2023-08-10T11:23:43.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:43 smithi107 ceph-mon[127953]: pgmap v1032: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 813 op/s 2023-08-10T11:23:45.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:45 smithi195 ceph-mon[129938]: pgmap v1033: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.7 MiB/s wr, 820 op/s 2023-08-10T11:23:45.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:45 smithi157 ceph-mon[129604]: pgmap v1033: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.7 MiB/s wr, 820 op/s 2023-08-10T11:23:45.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:45 smithi107 ceph-mon[127953]: pgmap v1033: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.7 MiB/s wr, 820 op/s 2023-08-10T11:23:45.805 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 850.0 s, 276.9 tps, lat 379.310 ms stddev 307.698 2023-08-10T11:23:47.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:47 smithi195 ceph-mon[129938]: pgmap v1034: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.6 MiB/s wr, 1.02k op/s 2023-08-10T11:23:47.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:47 smithi157 ceph-mon[129604]: pgmap v1034: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.6 MiB/s wr, 1.02k op/s 2023-08-10T11:23:47.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:47 smithi107 ceph-mon[127953]: pgmap v1034: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.6 MiB/s wr, 1.02k op/s 2023-08-10T11:23:49.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:49 smithi157 ceph-mon[129604]: pgmap v1035: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 788 op/s 2023-08-10T11:23:49.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:49 smithi107 ceph-mon[127953]: pgmap v1035: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 788 op/s 2023-08-10T11:23:49.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:49 smithi195 ceph-mon[129938]: pgmap v1035: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 788 op/s 2023-08-10T11:23:50.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 855.0 s, 258.4 tps, lat 374.291 ms stddev 140.371 2023-08-10T11:23:51.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:51 smithi157 ceph-mon[129604]: pgmap v1036: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.8 MiB/s wr, 978 op/s 2023-08-10T11:23:51.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:51 smithi107 ceph-mon[127953]: pgmap v1036: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.8 MiB/s wr, 978 op/s 2023-08-10T11:23:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:51 smithi195 ceph-mon[129938]: pgmap v1036: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.8 MiB/s wr, 978 op/s 2023-08-10T11:23:53.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:53 smithi157 ceph-mon[129604]: pgmap v1037: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.2 MiB/s wr, 808 op/s 2023-08-10T11:23:53.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:53 smithi107 ceph-mon[127953]: pgmap v1037: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.2 MiB/s wr, 808 op/s 2023-08-10T11:23:53.666 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:53 smithi195 ceph-mon[129938]: pgmap v1037: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.2 MiB/s wr, 808 op/s 2023-08-10T11:23:54.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:54 smithi157 ceph-mon[129604]: pgmap v1038: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.0 MiB/s wr, 850 op/s 2023-08-10T11:23:54.588 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:54 smithi107 ceph-mon[127953]: pgmap v1038: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.0 MiB/s wr, 850 op/s 2023-08-10T11:23:54.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:54 smithi195 ceph-mon[129938]: pgmap v1038: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.0 MiB/s wr, 850 op/s 2023-08-10T11:23:55.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 860.0 s, 262.5 tps, lat 390.179 ms stddev 139.047 2023-08-10T11:23:57.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:56 smithi195 ceph-mon[129938]: pgmap v1039: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.8 MiB/s wr, 998 op/s 2023-08-10T11:23:57.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:56 smithi157 ceph-mon[129604]: pgmap v1039: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.8 MiB/s wr, 998 op/s 2023-08-10T11:23:57.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:56 smithi107 ceph-mon[127953]: pgmap v1039: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 8.8 MiB/s wr, 998 op/s 2023-08-10T11:23:59.172 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:23:58 smithi195 ceph-mon[129938]: pgmap v1040: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.6 MiB/s wr, 755 op/s 2023-08-10T11:23:59.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:23:58 smithi157 ceph-mon[129604]: pgmap v1040: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.6 MiB/s wr, 755 op/s 2023-08-10T11:23:59.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:23:58 smithi107 ceph-mon[127953]: pgmap v1040: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.6 MiB/s wr, 755 op/s 2023-08-10T11:24:00.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 865.0 s, 165.0 tps, lat 520.870 ms stddev 306.065 2023-08-10T11:24:01.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:00 smithi195 ceph-mon[129938]: pgmap v1041: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.6 MiB/s wr, 945 op/s 2023-08-10T11:24:01.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:00 smithi157 ceph-mon[129604]: pgmap v1041: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.6 MiB/s wr, 945 op/s 2023-08-10T11:24:01.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:00 smithi107 ceph-mon[127953]: pgmap v1041: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.6 MiB/s wr, 945 op/s 2023-08-10T11:24:03.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:02 smithi157 ceph-mon[129604]: pgmap v1042: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.6 MiB/s wr, 783 op/s 2023-08-10T11:24:03.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:02 smithi107 ceph-mon[127953]: pgmap v1042: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.6 MiB/s wr, 783 op/s 2023-08-10T11:24:03.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:02 smithi195 ceph-mon[129938]: pgmap v1042: 129 pgs: 129 active+clean; 16 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.6 MiB/s wr, 783 op/s 2023-08-10T11:24:05.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:04 smithi157 ceph-mon[129604]: pgmap v1043: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.1 MiB/s wr, 845 op/s 2023-08-10T11:24:05.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:04 smithi107 ceph-mon[127953]: pgmap v1043: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.1 MiB/s wr, 845 op/s 2023-08-10T11:24:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:04 smithi195 ceph-mon[129938]: pgmap v1043: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.1 MiB/s wr, 845 op/s 2023-08-10T11:24:05.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 870.0 s, 233.6 tps, lat 475.826 ms stddev 372.308 2023-08-10T11:24:07.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:06 smithi157 ceph-mon[129604]: pgmap v1044: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.8 MiB/s wr, 959 op/s 2023-08-10T11:24:07.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:06 smithi107 ceph-mon[127953]: pgmap v1044: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.8 MiB/s wr, 959 op/s 2023-08-10T11:24:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:06 smithi195 ceph-mon[129938]: pgmap v1044: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.8 MiB/s wr, 959 op/s 2023-08-10T11:24:09.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:09 smithi107 ceph-mon[127953]: pgmap v1045: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.4 MiB/s wr, 756 op/s 2023-08-10T11:24:09.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:09 smithi107 ceph-mon[127953]: osdmap e150: 12 total, 12 up, 12 in 2023-08-10T11:24:09.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:09 smithi195 ceph-mon[129938]: pgmap v1045: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.4 MiB/s wr, 756 op/s 2023-08-10T11:24:09.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:09 smithi195 ceph-mon[129938]: osdmap e150: 12 total, 12 up, 12 in 2023-08-10T11:24:09.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:09 smithi157 ceph-mon[129604]: pgmap v1045: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.4 MiB/s wr, 756 op/s 2023-08-10T11:24:09.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:09 smithi157 ceph-mon[129604]: osdmap e150: 12 total, 12 up, 12 in 2023-08-10T11:24:10.803 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 875.0 s, 122.2 tps, lat 817.600 ms stddev 502.969 2023-08-10T11:24:11.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:11 smithi107 ceph-mon[127953]: pgmap v1047: 129 pgs: 12 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 88 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 769 op/s 2023-08-10T11:24:11.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:11 smithi195 ceph-mon[129938]: pgmap v1047: 129 pgs: 12 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 88 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 769 op/s 2023-08-10T11:24:11.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:11 smithi157 ceph-mon[129604]: pgmap v1047: 129 pgs: 12 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 88 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 769 op/s 2023-08-10T11:24:13.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:13 smithi195 ceph-mon[129938]: pgmap v1048: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 731 op/s 2023-08-10T11:24:13.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:13 smithi157 ceph-mon[129604]: pgmap v1048: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 731 op/s 2023-08-10T11:24:13.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:13 smithi107 ceph-mon[127953]: pgmap v1048: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 731 op/s 2023-08-10T11:24:14.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:14 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:14.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:14 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:14.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:14 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:15.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:15 smithi157 ceph-mon[129604]: pgmap v1049: 129 pgs: 19 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 56 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 588 op/s 2023-08-10T11:24:15.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:15 smithi107 ceph-mon[127953]: pgmap v1049: 129 pgs: 19 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 56 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 588 op/s 2023-08-10T11:24:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:15 smithi195 ceph-mon[129938]: pgmap v1049: 129 pgs: 19 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 56 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 588 op/s 2023-08-10T11:24:15.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 880.0 s, 65.4 tps, lat 1417.938 ms stddev 631.126 2023-08-10T11:24:17.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:17 smithi157 ceph-mon[129604]: pgmap v1050: 129 pgs: 13 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 81 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 376 op/s 2023-08-10T11:24:17.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:17 smithi107 ceph-mon[127953]: pgmap v1050: 129 pgs: 13 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 81 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 376 op/s 2023-08-10T11:24:17.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:17 smithi195 ceph-mon[129938]: pgmap v1050: 129 pgs: 13 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 81 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 376 op/s 2023-08-10T11:24:18.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:18 smithi195 ceph-mon[129938]: pgmap v1051: 129 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 95 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 372 op/s 2023-08-10T11:24:18.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:18 smithi157 ceph-mon[129604]: pgmap v1051: 129 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 95 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 372 op/s 2023-08-10T11:24:18.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:18 smithi107 ceph-mon[127953]: pgmap v1051: 129 pgs: 10 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 95 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 372 op/s 2023-08-10T11:24:20.800 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 885.0 s, 252.1 tps, lat 432.282 ms stddev 226.668 2023-08-10T11:24:21.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:20 smithi195 ceph-mon[129938]: pgmap v1052: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 453 op/s 2023-08-10T11:24:21.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:20 smithi195 ceph-mon[129938]: osdmap e151: 12 total, 12 up, 12 in 2023-08-10T11:24:21.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:20 smithi157 ceph-mon[129604]: pgmap v1052: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 453 op/s 2023-08-10T11:24:21.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:20 smithi157 ceph-mon[129604]: osdmap e151: 12 total, 12 up, 12 in 2023-08-10T11:24:21.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:20 smithi107 ceph-mon[127953]: pgmap v1052: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 453 op/s 2023-08-10T11:24:21.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:20 smithi107 ceph-mon[127953]: osdmap e151: 12 total, 12 up, 12 in 2023-08-10T11:24:23.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:22 smithi195 ceph-mon[129938]: pgmap v1054: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 360 op/s 2023-08-10T11:24:23.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:22 smithi157 ceph-mon[129604]: pgmap v1054: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 360 op/s 2023-08-10T11:24:23.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:22 smithi107 ceph-mon[127953]: pgmap v1054: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 360 op/s 2023-08-10T11:24:25.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:24 smithi157 ceph-mon[129604]: pgmap v1055: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 387 op/s 2023-08-10T11:24:25.336 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:24 smithi107 ceph-mon[127953]: pgmap v1055: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 387 op/s 2023-08-10T11:24:25.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:24 smithi195 ceph-mon[129938]: pgmap v1055: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 387 op/s 2023-08-10T11:24:25.798 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 890.0 s, 323.7 tps, lat 312.461 ms stddev 138.528 2023-08-10T11:24:27.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:26 smithi157 ceph-mon[129604]: pgmap v1056: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 623 op/s 2023-08-10T11:24:27.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:26 smithi107 ceph-mon[127953]: pgmap v1056: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 623 op/s 2023-08-10T11:24:27.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:26 smithi195 ceph-mon[129938]: pgmap v1056: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 623 op/s 2023-08-10T11:24:29.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:28 smithi157 ceph-mon[129604]: pgmap v1057: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.4 MiB/s wr, 683 op/s 2023-08-10T11:24:29.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:24:29.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:29.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:28 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:29.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:28 smithi107 ceph-mon[127953]: pgmap v1057: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.4 MiB/s wr, 683 op/s 2023-08-10T11:24:29.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:24:29.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:29.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:28 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:28 smithi195 ceph-mon[129938]: pgmap v1057: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.4 MiB/s wr, 683 op/s 2023-08-10T11:24:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:24:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:28 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:30.803 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 895.0 s, 218.8 tps, lat 449.589 ms stddev 189.813 2023-08-10T11:24:31.164 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:30 smithi195 ceph-mon[129938]: pgmap v1058: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.9 MiB/s wr, 795 op/s 2023-08-10T11:24:31.165 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:30 smithi195 ceph-mon[129938]: osdmap e152: 12 total, 12 up, 12 in 2023-08-10T11:24:31.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:30 smithi157 ceph-mon[129604]: pgmap v1058: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.9 MiB/s wr, 795 op/s 2023-08-10T11:24:31.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:30 smithi157 ceph-mon[129604]: osdmap e152: 12 total, 12 up, 12 in 2023-08-10T11:24:31.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:30 smithi107 ceph-mon[127953]: pgmap v1058: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.9 MiB/s wr, 795 op/s 2023-08-10T11:24:31.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:30 smithi107 ceph-mon[127953]: osdmap e152: 12 total, 12 up, 12 in 2023-08-10T11:24:32.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:32 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:32.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:32 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:32.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:32 smithi195 ceph-mon[129938]: pgmap v1060: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.9 MiB/s wr, 807 op/s 2023-08-10T11:24:32.790 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:32 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:32.791 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:32 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:32.792 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:32 smithi157 ceph-mon[129604]: pgmap v1060: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.9 MiB/s wr, 807 op/s 2023-08-10T11:24:32.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:32 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:32.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:32 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:32.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:32 smithi107 ceph-mon[127953]: pgmap v1060: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.9 MiB/s wr, 807 op/s 2023-08-10T11:24:33.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:33 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:24:33.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:33 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:24:33.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:33 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:33.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:33 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:24:33.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:33 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:24:33.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:33 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:33.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:33 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:24:33.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:33 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:24:33.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:33 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:24:34.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:34 smithi157 ceph-mon[129604]: pgmap v1061: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.2 MiB/s wr, 849 op/s 2023-08-10T11:24:34.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:34 smithi107 ceph-mon[127953]: pgmap v1061: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.2 MiB/s wr, 849 op/s 2023-08-10T11:24:34.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:34 smithi195 ceph-mon[129938]: pgmap v1061: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.2 MiB/s wr, 849 op/s 2023-08-10T11:24:35.799 INFO:teuthology.orchestra.run.smithi107.stderr:progress: 900.0 s, 248.6 tps, lat 400.503 ms stddev 171.187 2023-08-10T11:24:36.130 INFO:teuthology.orchestra.run.smithi107.stdout:transaction type: 2023-08-10T11:24:36.130 INFO:teuthology.orchestra.run.smithi107.stdout:scaling factor: 500 2023-08-10T11:24:36.131 INFO:teuthology.orchestra.run.smithi107.stdout:query mode: simple 2023-08-10T11:24:36.131 INFO:teuthology.orchestra.run.smithi107.stdout:number of clients: 100 2023-08-10T11:24:36.131 INFO:teuthology.orchestra.run.smithi107.stdout:number of threads: 4 2023-08-10T11:24:36.131 INFO:teuthology.orchestra.run.smithi107.stdout:duration: 900 s 2023-08-10T11:24:36.131 INFO:teuthology.orchestra.run.smithi107.stdout:number of transactions actually processed: 236448 2023-08-10T11:24:36.131 INFO:teuthology.orchestra.run.smithi107.stdout:latency average = 380.504 ms 2023-08-10T11:24:36.131 INFO:teuthology.orchestra.run.smithi107.stdout:latency stddev = 434.707 ms 2023-08-10T11:24:36.132 INFO:teuthology.orchestra.run.smithi107.stdout:tps = 262.623010 (including connections establishing) 2023-08-10T11:24:36.132 INFO:teuthology.orchestra.run.smithi107.stdout:tps = 262.628302 (excluding connections establishing) 2023-08-10T11:24:36.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-08-10T11:24:37.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:36 smithi157 ceph-mon[129604]: pgmap v1062: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.9 MiB/s wr, 782 op/s 2023-08-10T11:24:37.335 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:36 smithi107 ceph-mon[127953]: pgmap v1062: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.9 MiB/s wr, 782 op/s 2023-08-10T11:24:37.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:36 smithi195 ceph-mon[129938]: pgmap v1062: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.9 MiB/s wr, 782 op/s 2023-08-10T11:24:39.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:38 smithi157 ceph-mon[129604]: pgmap v1063: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 773 op/s 2023-08-10T11:24:39.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:38 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:38 smithi107 ceph-mon[127953]: pgmap v1063: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 773 op/s 2023-08-10T11:24:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:38 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:38 smithi195 ceph-mon[129938]: pgmap v1063: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 773 op/s 2023-08-10T11:24:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:38 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:41.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:41 smithi157 ceph-mon[129604]: pgmap v1064: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 730 op/s 2023-08-10T11:24:41.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:41 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:41 smithi107 ceph-mon[127953]: pgmap v1064: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 730 op/s 2023-08-10T11:24:41.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:41 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:41.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:41 smithi195 ceph-mon[129938]: pgmap v1064: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 730 op/s 2023-08-10T11:24:41.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:41 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:43.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:43 smithi157 ceph-mon[129604]: pgmap v1065: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.9 MiB/s wr, 657 op/s 2023-08-10T11:24:43.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:43 smithi107 ceph-mon[127953]: pgmap v1065: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.9 MiB/s wr, 657 op/s 2023-08-10T11:24:43.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:43 smithi195 ceph-mon[129938]: pgmap v1065: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.9 MiB/s wr, 657 op/s 2023-08-10T11:24:45.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:45 smithi157 ceph-mon[129604]: pgmap v1066: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 578 op/s 2023-08-10T11:24:45.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:45 smithi107 ceph-mon[127953]: pgmap v1066: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 578 op/s 2023-08-10T11:24:45.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:45 smithi195 ceph-mon[129938]: pgmap v1066: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 578 op/s 2023-08-10T11:24:46.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:46 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:46.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:46 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:46.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:46 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:47.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:47 smithi157 ceph-mon[129604]: pgmap v1067: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 498 op/s 2023-08-10T11:24:47.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:47 smithi107 ceph-mon[127953]: pgmap v1067: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 498 op/s 2023-08-10T11:24:47.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:47 smithi195 ceph-mon[129938]: pgmap v1067: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 498 op/s 2023-08-10T11:24:49.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:49 smithi157 ceph-mon[129604]: pgmap v1068: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 304 op/s 2023-08-10T11:24:49.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:49 smithi107 ceph-mon[127953]: pgmap v1068: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 304 op/s 2023-08-10T11:24:49.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:49 smithi195 ceph-mon[129938]: pgmap v1068: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 304 op/s 2023-08-10T11:24:51.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:51 smithi157 ceph-mon[129604]: pgmap v1069: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 2.5 MiB/s wr, 240 op/s 2023-08-10T11:24:51.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:51 smithi107 ceph-mon[127953]: pgmap v1069: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 2.5 MiB/s wr, 240 op/s 2023-08-10T11:24:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:51 smithi195 ceph-mon[129938]: pgmap v1069: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 2.5 MiB/s wr, 240 op/s 2023-08-10T11:24:53.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:53 smithi157 ceph-mon[129604]: pgmap v1070: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 574 KiB/s wr, 59 op/s 2023-08-10T11:24:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:53 smithi107 ceph-mon[127953]: pgmap v1070: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 574 KiB/s wr, 59 op/s 2023-08-10T11:24:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:53 smithi195 ceph-mon[129938]: pgmap v1070: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 574 KiB/s wr, 59 op/s 2023-08-10T11:24:54.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:54 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:54.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:54 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:54.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:54 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:24:55.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:55 smithi107 ceph-mon[127953]: pgmap v1071: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 378 KiB/s wr, 33 op/s 2023-08-10T11:24:55.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:55 smithi195 ceph-mon[129938]: pgmap v1071: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 378 KiB/s wr, 33 op/s 2023-08-10T11:24:55.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:55 smithi157 ceph-mon[129604]: pgmap v1071: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 378 KiB/s wr, 33 op/s 2023-08-10T11:24:57.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:57 smithi107 ceph-mon[127953]: pgmap v1072: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 364 KiB/s wr, 28 op/s 2023-08-10T11:24:57.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:57 smithi195 ceph-mon[129938]: pgmap v1072: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 364 KiB/s wr, 28 op/s 2023-08-10T11:24:57.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:57 smithi157 ceph-mon[129604]: pgmap v1072: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 364 KiB/s wr, 28 op/s 2023-08-10T11:24:59.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:24:59 smithi107 ceph-mon[127953]: pgmap v1073: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 248 KiB/s wr, 23 op/s 2023-08-10T11:24:59.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:24:59 smithi195 ceph-mon[129938]: pgmap v1073: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 248 KiB/s wr, 23 op/s 2023-08-10T11:24:59.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:24:59 smithi157 ceph-mon[129604]: pgmap v1073: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 248 KiB/s wr, 23 op/s 2023-08-10T11:25:01.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:01 smithi107 ceph-mon[127953]: pgmap v1074: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 308 KiB/s wr, 24 op/s 2023-08-10T11:25:01.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:01 smithi195 ceph-mon[129938]: pgmap v1074: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 308 KiB/s wr, 24 op/s 2023-08-10T11:25:01.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:01 smithi157 ceph-mon[129604]: pgmap v1074: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 308 KiB/s wr, 24 op/s 2023-08-10T11:25:03.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:03 smithi107 ceph-mon[127953]: pgmap v1075: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 220 KiB/s wr, 22 op/s 2023-08-10T11:25:03.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:03 smithi195 ceph-mon[129938]: pgmap v1075: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 220 KiB/s wr, 22 op/s 2023-08-10T11:25:03.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:03 smithi157 ceph-mon[129604]: pgmap v1075: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 220 KiB/s wr, 22 op/s 2023-08-10T11:25:05.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:05 smithi107 ceph-mon[127953]: pgmap v1076: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 225 KiB/s wr, 27 op/s 2023-08-10T11:25:05.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:05 smithi195 ceph-mon[129938]: pgmap v1076: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 225 KiB/s wr, 27 op/s 2023-08-10T11:25:05.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:05 smithi157 ceph-mon[129604]: pgmap v1076: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 225 KiB/s wr, 27 op/s 2023-08-10T11:25:07.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:07 smithi107 ceph-mon[127953]: pgmap v1077: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 225 KiB/s wr, 24 op/s 2023-08-10T11:25:07.420 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:07 smithi195 ceph-mon[129938]: pgmap v1077: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 225 KiB/s wr, 24 op/s 2023-08-10T11:25:07.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:07 smithi157 ceph-mon[129604]: pgmap v1077: 129 pgs: 129 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 225 KiB/s wr, 24 op/s 2023-08-10T11:25:08.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:08 smithi195 ceph-mon[129938]: osdmap e153: 12 total, 12 up, 12 in 2023-08-10T11:25:08.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:08 smithi157 ceph-mon[129604]: osdmap e153: 12 total, 12 up, 12 in 2023-08-10T11:25:08.584 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:08 smithi107 ceph-mon[127953]: osdmap e153: 12 total, 12 up, 12 in 2023-08-10T11:25:09.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:09 smithi195 ceph-mon[129938]: pgmap v1079: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 245 KiB/s wr, 41 op/s 2023-08-10T11:25:09.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:09 smithi157 ceph-mon[129604]: pgmap v1079: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 245 KiB/s wr, 41 op/s 2023-08-10T11:25:09.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:09 smithi107 ceph-mon[127953]: pgmap v1079: 129 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 122 active+clean; 16 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 245 KiB/s wr, 41 op/s 2023-08-10T11:25:11.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:11 smithi157 ceph-mon[129604]: pgmap v1080: 129 pgs: 14 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 79 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 239 KiB/s wr, 42 op/s 2023-08-10T11:25:11.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:11 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:25:11.587 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:11 smithi107 ceph-mon[127953]: pgmap v1080: 129 pgs: 14 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 79 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 239 KiB/s wr, 42 op/s 2023-08-10T11:25:11.588 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:11 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:25:11.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:11 smithi195 ceph-mon[129938]: pgmap v1080: 129 pgs: 14 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 79 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 239 KiB/s wr, 42 op/s 2023-08-10T11:25:11.667 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:11 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:25:12.828 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 11:25:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T11:25:12.550+0000 7f1a7cd3e700 -1 calc_pg_upmaps abort due to max <= 0 2023-08-10T11:25:13.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:13 smithi157 ceph-mon[129604]: pgmap v1081: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 229 KiB/s wr, 40 op/s 2023-08-10T11:25:13.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:13 smithi107 ceph-mon[127953]: pgmap v1081: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 229 KiB/s wr, 40 op/s 2023-08-10T11:25:13.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:13 smithi195 ceph-mon[129938]: pgmap v1081: 129 pgs: 20 active+clean+snaptrim, 58 active+clean+snaptrim_wait, 51 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 229 KiB/s wr, 40 op/s 2023-08-10T11:25:15.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:15 smithi157 ceph-mon[129604]: pgmap v1082: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 216 KiB/s wr, 37 op/s 2023-08-10T11:25:15.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:15 smithi107 ceph-mon[127953]: pgmap v1082: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 216 KiB/s wr, 37 op/s 2023-08-10T11:25:15.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:15 smithi195 ceph-mon[129938]: pgmap v1082: 129 pgs: 18 active+clean+snaptrim, 53 active+clean+snaptrim_wait, 58 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 216 KiB/s wr, 37 op/s 2023-08-10T11:25:17.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:17 smithi157 ceph-mon[129604]: pgmap v1083: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 328 KiB/s wr, 38 op/s 2023-08-10T11:25:17.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:17 smithi107 ceph-mon[127953]: pgmap v1083: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 328 KiB/s wr, 38 op/s 2023-08-10T11:25:17.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:17 smithi195 ceph-mon[129938]: pgmap v1083: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 328 KiB/s wr, 38 op/s 2023-08-10T11:25:19.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:19 smithi157 ceph-mon[129604]: pgmap v1084: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 348 KiB/s wr, 43 op/s 2023-08-10T11:25:19.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:19 smithi107 ceph-mon[127953]: pgmap v1084: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 348 KiB/s wr, 43 op/s 2023-08-10T11:25:19.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:19 smithi195 ceph-mon[129938]: pgmap v1084: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 348 KiB/s wr, 43 op/s 2023-08-10T11:25:21.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:20 smithi157 ceph-mon[129604]: pgmap v1085: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 615 KiB/s wr, 62 op/s 2023-08-10T11:25:21.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:20 smithi157 ceph-mon[129604]: osdmap e154: 12 total, 12 up, 12 in 2023-08-10T11:25:21.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:20 smithi107 ceph-mon[127953]: pgmap v1085: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 615 KiB/s wr, 62 op/s 2023-08-10T11:25:21.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:20 smithi107 ceph-mon[127953]: osdmap e154: 12 total, 12 up, 12 in 2023-08-10T11:25:21.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:20 smithi195 ceph-mon[129938]: pgmap v1085: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 615 KiB/s wr, 62 op/s 2023-08-10T11:25:21.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:20 smithi195 ceph-mon[129938]: osdmap e154: 12 total, 12 up, 12 in 2023-08-10T11:25:23.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:23 smithi157 ceph-mon[129604]: pgmap v1087: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 1.1 MiB/s wr, 116 op/s 2023-08-10T11:25:23.331 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:23 smithi107 ceph-mon[127953]: pgmap v1087: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 1.1 MiB/s wr, 116 op/s 2023-08-10T11:25:23.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:23 smithi195 ceph-mon[129938]: pgmap v1087: 129 pgs: 129 active+clean; 15 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 1.1 MiB/s wr, 116 op/s 2023-08-10T11:25:25.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:25 smithi107 ceph-mon[127953]: pgmap v1088: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2023-08-10T11:25:25.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:25 smithi107 ceph-mon[127953]: osdmap e155: 12 total, 12 up, 12 in 2023-08-10T11:25:25.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:25 smithi195 ceph-mon[129938]: pgmap v1088: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2023-08-10T11:25:25.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:25 smithi195 ceph-mon[129938]: osdmap e155: 12 total, 12 up, 12 in 2023-08-10T11:25:25.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:25 smithi157 ceph-mon[129604]: pgmap v1088: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2023-08-10T11:25:25.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:25 smithi157 ceph-mon[129604]: osdmap e155: 12 total, 12 up, 12 in 2023-08-10T11:25:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:27 smithi195 ceph-mon[129938]: pgmap v1090: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 4.6 MiB/s wr, 558 op/s 2023-08-10T11:25:27.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:27 smithi157 ceph-mon[129604]: pgmap v1090: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 4.6 MiB/s wr, 558 op/s 2023-08-10T11:25:27.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:27 smithi107 ceph-mon[127953]: pgmap v1090: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 4.6 MiB/s wr, 558 op/s 2023-08-10T11:25:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:29 smithi195 ceph-mon[129938]: pgmap v1091: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.7 MiB/s wr, 584 op/s 2023-08-10T11:25:29.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:29 smithi157 ceph-mon[129604]: pgmap v1091: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.7 MiB/s wr, 584 op/s 2023-08-10T11:25:29.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:29 smithi107 ceph-mon[127953]: pgmap v1091: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.7 MiB/s wr, 584 op/s 2023-08-10T11:25:31.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:31 smithi157 ceph-mon[129604]: pgmap v1092: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 6.6 MiB/s wr, 804 op/s 2023-08-10T11:25:31.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:31 smithi107 ceph-mon[127953]: pgmap v1092: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 6.6 MiB/s wr, 804 op/s 2023-08-10T11:25:31.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:31 smithi195 ceph-mon[129938]: pgmap v1092: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 6.6 MiB/s wr, 804 op/s 2023-08-10T11:25:33.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:33 smithi157 ceph-mon[129604]: pgmap v1093: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.4 MiB/s wr, 791 op/s 2023-08-10T11:25:33.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:33 smithi107 ceph-mon[127953]: pgmap v1093: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.4 MiB/s wr, 791 op/s 2023-08-10T11:25:33.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:33 smithi195 ceph-mon[129938]: pgmap v1093: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.4 MiB/s wr, 791 op/s 2023-08-10T11:25:34.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:34 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:25:34.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:34 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:25:34.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:34 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:25:35.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:35 smithi157 ceph-mon[129604]: pgmap v1094: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.7 MiB/s wr, 819 op/s 2023-08-10T11:25:35.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:35 smithi107 ceph-mon[127953]: pgmap v1094: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.7 MiB/s wr, 819 op/s 2023-08-10T11:25:35.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:35 smithi195 ceph-mon[129938]: pgmap v1094: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.7 MiB/s wr, 819 op/s 2023-08-10T11:25:37.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:37 smithi157 ceph-mon[129604]: pgmap v1095: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 6.5 MiB/s wr, 771 op/s 2023-08-10T11:25:37.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:37 smithi107 ceph-mon[127953]: pgmap v1095: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 6.5 MiB/s wr, 771 op/s 2023-08-10T11:25:37.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:37 smithi195 ceph-mon[129938]: pgmap v1095: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 6.5 MiB/s wr, 771 op/s 2023-08-10T11:25:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:39 smithi157 ceph-mon[129604]: pgmap v1096: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 5.6 MiB/s wr, 671 op/s 2023-08-10T11:25:39.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:39 smithi107 ceph-mon[127953]: pgmap v1096: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 5.6 MiB/s wr, 671 op/s 2023-08-10T11:25:39.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:39 smithi195 ceph-mon[129938]: pgmap v1096: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 5.6 MiB/s wr, 671 op/s 2023-08-10T11:25:41.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:41 smithi157 ceph-mon[129604]: pgmap v1097: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 5.2 MiB/s wr, 620 op/s 2023-08-10T11:25:41.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:41 smithi107 ceph-mon[127953]: pgmap v1097: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 5.2 MiB/s wr, 620 op/s 2023-08-10T11:25:41.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:41 smithi195 ceph-mon[129938]: pgmap v1097: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 5.2 MiB/s wr, 620 op/s 2023-08-10T11:25:42.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:42 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:25:42.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:42 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:25:42.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:42 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:25:42.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:42 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:25:42.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:42 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:25:42.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:42 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:25:42.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:42 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:25:42.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:42 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:25:42.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:42 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:25:43.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:43 smithi157 ceph-mon[129604]: pgmap v1098: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 3.0 MiB/s wr, 361 op/s 2023-08-10T11:25:43.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:43 smithi107 ceph-mon[127953]: pgmap v1098: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 3.0 MiB/s wr, 361 op/s 2023-08-10T11:25:43.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:43 smithi195 ceph-mon[129938]: pgmap v1098: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 3.0 MiB/s wr, 361 op/s 2023-08-10T11:25:45.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:45 smithi157 ceph-mon[129604]: pgmap v1099: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 2.6 MiB/s wr, 311 op/s 2023-08-10T11:25:45.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:45 smithi107 ceph-mon[127953]: pgmap v1099: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 2.6 MiB/s wr, 311 op/s 2023-08-10T11:25:45.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:45 smithi195 ceph-mon[129938]: pgmap v1099: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 2.6 MiB/s wr, 311 op/s 2023-08-10T11:25:47.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:47 smithi157 ceph-mon[129604]: pgmap v1100: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 2.4 MiB/s wr, 280 op/s 2023-08-10T11:25:47.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:47 smithi107 ceph-mon[127953]: pgmap v1100: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 2.4 MiB/s wr, 280 op/s 2023-08-10T11:25:47.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:47 smithi195 ceph-mon[129938]: pgmap v1100: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 2.4 MiB/s wr, 280 op/s 2023-08-10T11:25:49.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:49 smithi157 ceph-mon[129604]: pgmap v1101: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 270 KiB/s wr, 27 op/s 2023-08-10T11:25:49.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:49 smithi107 ceph-mon[127953]: pgmap v1101: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 270 KiB/s wr, 27 op/s 2023-08-10T11:25:49.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:49 smithi195 ceph-mon[129938]: pgmap v1101: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 270 KiB/s wr, 27 op/s 2023-08-10T11:25:51.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:51 smithi157 ceph-mon[129604]: pgmap v1102: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 23 op/s 2023-08-10T11:25:51.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:51 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:25:51.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:51 smithi107 ceph-mon[127953]: pgmap v1102: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 23 op/s 2023-08-10T11:25:51.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:51 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:25:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:51 smithi195 ceph-mon[129938]: pgmap v1102: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 23 op/s 2023-08-10T11:25:51.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:51 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:25:53.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:53 smithi157 ceph-mon[129604]: pgmap v1103: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 17 op/s 2023-08-10T11:25:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:53 smithi107 ceph-mon[127953]: pgmap v1103: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 17 op/s 2023-08-10T11:25:53.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:53 smithi195 ceph-mon[129938]: pgmap v1103: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 17 op/s 2023-08-10T11:25:55.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:55 smithi107 ceph-mon[127953]: pgmap v1104: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 209 KiB/s wr, 21 op/s 2023-08-10T11:25:55.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:55 smithi195 ceph-mon[129938]: pgmap v1104: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 209 KiB/s wr, 21 op/s 2023-08-10T11:25:55.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:55 smithi157 ceph-mon[129604]: pgmap v1104: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 209 KiB/s wr, 21 op/s 2023-08-10T11:25:56.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:56 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:25:56.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:56 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:25:56.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:56 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:25:57.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:57 smithi107 ceph-mon[127953]: pgmap v1105: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-08-10T11:25:57.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:57 smithi195 ceph-mon[129938]: pgmap v1105: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-08-10T11:25:57.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:57 smithi157 ceph-mon[129604]: pgmap v1105: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-08-10T11:25:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:25:59 smithi107 ceph-mon[127953]: pgmap v1106: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 227 KiB/s wr, 23 op/s 2023-08-10T11:25:59.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:25:59 smithi195 ceph-mon[129938]: pgmap v1106: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 227 KiB/s wr, 23 op/s 2023-08-10T11:25:59.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:25:59 smithi157 ceph-mon[129604]: pgmap v1106: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 227 KiB/s wr, 23 op/s 2023-08-10T11:26:01.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:01 smithi107 ceph-mon[127953]: pgmap v1107: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 270 KiB/s wr, 28 op/s 2023-08-10T11:26:01.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:01 smithi195 ceph-mon[129938]: pgmap v1107: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 270 KiB/s wr, 28 op/s 2023-08-10T11:26:01.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:01 smithi157 ceph-mon[129604]: pgmap v1107: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 270 KiB/s wr, 28 op/s 2023-08-10T11:26:03.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:03 smithi107 ceph-mon[127953]: pgmap v1108: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 210 KiB/s wr, 22 op/s 2023-08-10T11:26:03.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:03 smithi195 ceph-mon[129938]: pgmap v1108: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 210 KiB/s wr, 22 op/s 2023-08-10T11:26:03.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:03 smithi157 ceph-mon[129604]: pgmap v1108: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 210 KiB/s wr, 22 op/s 2023-08-10T11:26:05.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:05 smithi107 ceph-mon[127953]: pgmap v1109: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 233 KiB/s wr, 25 op/s 2023-08-10T11:26:05.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:05 smithi195 ceph-mon[129938]: pgmap v1109: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 233 KiB/s wr, 25 op/s 2023-08-10T11:26:05.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:05 smithi157 ceph-mon[129604]: pgmap v1109: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 233 KiB/s wr, 25 op/s 2023-08-10T11:26:07.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:07 smithi195 ceph-mon[129938]: pgmap v1110: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 303 KiB/s wr, 40 op/s 2023-08-10T11:26:07.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:07 smithi157 ceph-mon[129604]: pgmap v1110: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 303 KiB/s wr, 40 op/s 2023-08-10T11:26:07.834 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:07 smithi107 ceph-mon[127953]: pgmap v1110: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 303 KiB/s wr, 40 op/s 2023-08-10T11:26:08.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:08 smithi195 ceph-mon[129938]: osdmap e156: 12 total, 12 up, 12 in 2023-08-10T11:26:08.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:08 smithi195 ceph-mon[129938]: pgmap v1112: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 185 KiB/s wr, 36 op/s 2023-08-10T11:26:08.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:08 smithi157 ceph-mon[129604]: osdmap e156: 12 total, 12 up, 12 in 2023-08-10T11:26:08.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:08 smithi157 ceph-mon[129604]: pgmap v1112: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 185 KiB/s wr, 36 op/s 2023-08-10T11:26:08.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:08 smithi107 ceph-mon[127953]: osdmap e156: 12 total, 12 up, 12 in 2023-08-10T11:26:08.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:08 smithi107 ceph-mon[127953]: pgmap v1112: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 185 KiB/s wr, 36 op/s 2023-08-10T11:26:11.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:11 smithi157 ceph-mon[129604]: pgmap v1113: 129 pgs: 14 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 79 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 172 KiB/s wr, 34 op/s 2023-08-10T11:26:11.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:11 smithi107 ceph-mon[127953]: pgmap v1113: 129 pgs: 14 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 79 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 172 KiB/s wr, 34 op/s 2023-08-10T11:26:11.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:11 smithi195 ceph-mon[129938]: pgmap v1113: 129 pgs: 14 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 79 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 172 KiB/s wr, 34 op/s 2023-08-10T11:26:13.335 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:13 smithi107 ceph-mon[127953]: pgmap v1114: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 172 KiB/s wr, 34 op/s 2023-08-10T11:26:13.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:13 smithi195 ceph-mon[129938]: pgmap v1114: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 172 KiB/s wr, 34 op/s 2023-08-10T11:26:13.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:13 smithi157 ceph-mon[129604]: pgmap v1114: 129 pgs: 18 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 60 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 172 KiB/s wr, 34 op/s 2023-08-10T11:26:15.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:15 smithi107 ceph-mon[127953]: pgmap v1115: 129 pgs: 17 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 61 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 164 KiB/s wr, 34 op/s 2023-08-10T11:26:15.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:15 smithi195 ceph-mon[129938]: pgmap v1115: 129 pgs: 17 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 61 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 164 KiB/s wr, 34 op/s 2023-08-10T11:26:15.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:15 smithi157 ceph-mon[129604]: pgmap v1115: 129 pgs: 17 active+clean+snaptrim, 51 active+clean+snaptrim_wait, 61 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 164 KiB/s wr, 34 op/s 2023-08-10T11:26:17.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:17 smithi107 ceph-mon[127953]: pgmap v1116: 129 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 118 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 246 KiB/s wr, 22 op/s 2023-08-10T11:26:17.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:17 smithi195 ceph-mon[129938]: pgmap v1116: 129 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 118 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 246 KiB/s wr, 22 op/s 2023-08-10T11:26:17.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:17 smithi157 ceph-mon[129604]: pgmap v1116: 129 pgs: 4 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 118 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 246 KiB/s wr, 22 op/s 2023-08-10T11:26:19.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:19 smithi107 ceph-mon[127953]: pgmap v1117: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 237 KiB/s wr, 21 op/s 2023-08-10T11:26:19.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:19 smithi195 ceph-mon[129938]: pgmap v1117: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 237 KiB/s wr, 21 op/s 2023-08-10T11:26:19.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:19 smithi157 ceph-mon[129604]: pgmap v1117: 129 pgs: 2 active+clean+snaptrim, 127 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 237 KiB/s wr, 21 op/s 2023-08-10T11:26:21.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:20 smithi157 ceph-mon[129604]: pgmap v1118: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 24 op/s 2023-08-10T11:26:21.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:20 smithi157 ceph-mon[129604]: osdmap e157: 12 total, 12 up, 12 in 2023-08-10T11:26:21.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:20 smithi107 ceph-mon[127953]: pgmap v1118: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 24 op/s 2023-08-10T11:26:21.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:20 smithi107 ceph-mon[127953]: osdmap e157: 12 total, 12 up, 12 in 2023-08-10T11:26:21.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:20 smithi195 ceph-mon[129938]: pgmap v1118: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 24 op/s 2023-08-10T11:26:21.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:20 smithi195 ceph-mon[129938]: osdmap e157: 12 total, 12 up, 12 in 2023-08-10T11:26:23.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:22 smithi157 ceph-mon[129604]: pgmap v1120: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 230 KiB/s wr, 23 op/s 2023-08-10T11:26:23.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:22 smithi107 ceph-mon[127953]: pgmap v1120: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 230 KiB/s wr, 23 op/s 2023-08-10T11:26:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:22 smithi195 ceph-mon[129938]: pgmap v1120: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 230 KiB/s wr, 23 op/s 2023-08-10T11:26:25.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:24 smithi157 ceph-mon[129604]: pgmap v1121: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 216 KiB/s wr, 22 op/s 2023-08-10T11:26:25.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:24 smithi107 ceph-mon[127953]: pgmap v1121: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 216 KiB/s wr, 22 op/s 2023-08-10T11:26:25.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:24 smithi195 ceph-mon[129938]: pgmap v1121: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 216 KiB/s wr, 22 op/s 2023-08-10T11:26:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:25 smithi157 ceph-mon[129604]: osdmap e158: 12 total, 12 up, 12 in 2023-08-10T11:26:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:25 smithi107 ceph-mon[127953]: osdmap e158: 12 total, 12 up, 12 in 2023-08-10T11:26:26.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:25 smithi195 ceph-mon[129938]: osdmap e158: 12 total, 12 up, 12 in 2023-08-10T11:26:27.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:26 smithi157 ceph-mon[129604]: pgmap v1123: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 124 KiB/s wr, 20 op/s 2023-08-10T11:26:27.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:26 smithi107 ceph-mon[127953]: pgmap v1123: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 124 KiB/s wr, 20 op/s 2023-08-10T11:26:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:26 smithi195 ceph-mon[129938]: pgmap v1123: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 124 KiB/s wr, 20 op/s 2023-08-10T11:26:29.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:28 smithi157 ceph-mon[129604]: pgmap v1124: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 103 KiB/s wr, 14 op/s 2023-08-10T11:26:29.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:28 smithi107 ceph-mon[127953]: pgmap v1124: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 103 KiB/s wr, 14 op/s 2023-08-10T11:26:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:28 smithi195 ceph-mon[129938]: pgmap v1124: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 103 KiB/s wr, 14 op/s 2023-08-10T11:26:31.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:31 smithi157 ceph-mon[129604]: pgmap v1125: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 19 op/s 2023-08-10T11:26:31.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:30 smithi107 ceph-mon[127953]: pgmap v1125: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 19 op/s 2023-08-10T11:26:31.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:30 smithi195 ceph-mon[129938]: pgmap v1125: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 19 op/s 2023-08-10T11:26:32.988 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-08-10T11:26:33.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:33 smithi157 ceph-mon[129604]: pgmap v1126: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 19 op/s 2023-08-10T11:26:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:33 smithi107 ceph-mon[127953]: pgmap v1126: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 19 op/s 2023-08-10T11:26:33.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:33 smithi195 ceph-mon[129938]: pgmap v1126: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 19 op/s 2023-08-10T11:26:33.767 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/: 2023-08-10T11:26:33.767 INFO:teuthology.orchestra.run.smithi107.stdout:total 2 2023-08-10T11:26:33.767 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 8980019484 Aug 10 10:51 . 2023-08-10T11:26:33.767 INFO:teuthology.orchestra.run.smithi107.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 8980019484 Aug 10 10:51 .. 2023-08-10T11:26:33.767 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 data 2023-08-10T11:26:33.768 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:33.768 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data: 2023-08-10T11:26:33.768 INFO:teuthology.orchestra.run.smithi107.stdout:total 41 2023-08-10T11:26:33.768 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 . 2023-08-10T11:26:33.768 INFO:teuthology.orchestra.run.smithi107.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 8980019484 Aug 10 10:51 .. 2023-08-10T11:26:33.768 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7905394829 Aug 10 11:07 base 2023-08-10T11:26:33.768 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Aug 10 10:51 current_logfiles 2023-08-10T11:26:33.769 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Aug 10 10:51 global 2023-08-10T11:26:33.769 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Aug 10 10:51 log 2023-08-10T11:26:33.769 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_commit_ts 2023-08-10T11:26:33.769 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_dynshmem 2023-08-10T11:26:33.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Aug 10 10:51 pg_hba.conf 2023-08-10T11:26:33.769 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Aug 10 10:51 pg_ident.conf 2023-08-10T11:26:33.769 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 11:25 pg_logical 2023-08-10T11:26:33.769 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 pg_multixact 2023-08-10T11:26:33.770 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 pg_notify 2023-08-10T11:26:33.770 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_replslot 2023-08-10T11:26:33.770 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_serial 2023-08-10T11:26:33.770 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_snapshots 2023-08-10T11:26:33.770 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Aug 10 11:26 pg_stat 2023-08-10T11:26:33.770 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Aug 10 11:26 pg_stat_tmp 2023-08-10T11:26:33.770 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Aug 10 11:23 pg_subtrans 2023-08-10T11:26:33.771 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_tblspc 2023-08-10T11:26:33.771 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 pg_twophase 2023-08-10T11:26:33.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 10 10:51 PG_VERSION 2023-08-10T11:26:33.771 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:26 pg_wal 2023-08-10T11:26:33.771 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 10 10:51 pg_xact 2023-08-10T11:26:33.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Aug 10 10:51 postgresql.auto.conf 2023-08-10T11:26:33.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Aug 10 10:51 postgresql.conf 2023-08-10T11:26:33.771 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Aug 10 10:51 postmaster.opts 2023-08-10T11:26:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:33.772 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/base: 2023-08-10T11:26:33.772 INFO:teuthology.orchestra.run.smithi107.stdout:total 3 2023-08-10T11:26:33.772 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7905394829 Aug 10 11:07 . 2023-08-10T11:26:33.772 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:33.772 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 1 2023-08-10T11:26:33.772 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 12346 2023-08-10T11:26:33.772 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7890680967 Aug 10 11:11 12347 2023-08-10T11:26:33.773 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 11:09 pgsql_tmp 2023-08-10T11:26:33.773 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:33.773 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/base/1: 2023-08-10T11:26:33.773 INFO:teuthology.orchestra.run.smithi107.stdout:total 7186 2023-08-10T11:26:33.773 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 . 2023-08-10T11:26:33.773 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7905394829 Aug 10 11:07 .. 2023-08-10T11:26:33.773 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 112 2023-08-10T11:26:33.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 113 2023-08-10T11:26:33.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 10 10:51 12182 2023-08-10T11:26:33.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12182_fsm 2023-08-10T11:26:33.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12182_vm 2023-08-10T11:26:33.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12184 2023-08-10T11:26:33.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12186 2023-08-10T11:26:33.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187 2023-08-10T11:26:33.774 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12187_fsm 2023-08-10T11:26:33.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187_vm 2023-08-10T11:26:33.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12189 2023-08-10T11:26:33.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12191 2023-08-10T11:26:33.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192 2023-08-10T11:26:33.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12192_fsm 2023-08-10T11:26:33.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192_vm 2023-08-10T11:26:33.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12194 2023-08-10T11:26:33.775 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12196 2023-08-10T11:26:33.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197 2023-08-10T11:26:33.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12197_fsm 2023-08-10T11:26:33.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197_vm 2023-08-10T11:26:33.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12199 2023-08-10T11:26:33.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12201 2023-08-10T11:26:33.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202 2023-08-10T11:26:33.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12202_fsm 2023-08-10T11:26:33.776 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202_vm 2023-08-10T11:26:33.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12204 2023-08-10T11:26:33.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12206 2023-08-10T11:26:33.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207 2023-08-10T11:26:33.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12207_fsm 2023-08-10T11:26:33.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207_vm 2023-08-10T11:26:33.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12209 2023-08-10T11:26:33.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12211 2023-08-10T11:26:33.777 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12212 2023-08-10T11:26:33.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12214 2023-08-10T11:26:33.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12216 2023-08-10T11:26:33.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 10 10:51 1247 2023-08-10T11:26:33.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1247_fsm 2023-08-10T11:26:33.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1247_vm 2023-08-10T11:26:33.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Aug 10 10:51 1249 2023-08-10T11:26:33.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1249_fsm 2023-08-10T11:26:33.778 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1249_vm 2023-08-10T11:26:33.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Aug 10 10:51 1255 2023-08-10T11:26:33.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1255_fsm 2023-08-10T11:26:33.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1255_vm 2023-08-10T11:26:33.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 10 10:51 1259 2023-08-10T11:26:33.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1259_fsm 2023-08-10T11:26:33.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1259_vm 2023-08-10T11:26:33.779 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417 2023-08-10T11:26:33.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417_vm 2023-08-10T11:26:33.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418 2023-08-10T11:26:33.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418_vm 2023-08-10T11:26:33.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 174 2023-08-10T11:26:33.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 175 2023-08-10T11:26:33.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2187 2023-08-10T11:26:33.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224 2023-08-10T11:26:33.780 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224_vm 2023-08-10T11:26:33.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328 2023-08-10T11:26:33.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328_vm 2023-08-10T11:26:33.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336 2023-08-10T11:26:33.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336_vm 2023-08-10T11:26:33.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2337 2023-08-10T11:26:33.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2600 2023-08-10T11:26:33.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2600_fsm 2023-08-10T11:26:33.781 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2600_vm 2023-08-10T11:26:33.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601 2023-08-10T11:26:33.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2601_fsm 2023-08-10T11:26:33.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601_vm 2023-08-10T11:26:33.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2602 2023-08-10T11:26:33.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2602_fsm 2023-08-10T11:26:33.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2602_vm 2023-08-10T11:26:33.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2603 2023-08-10T11:26:33.782 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2603_fsm 2023-08-10T11:26:33.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2603_vm 2023-08-10T11:26:33.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604 2023-08-10T11:26:33.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604_vm 2023-08-10T11:26:33.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2605 2023-08-10T11:26:33.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2605_fsm 2023-08-10T11:26:33.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2605_vm 2023-08-10T11:26:33.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606 2023-08-10T11:26:33.783 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2606_fsm 2023-08-10T11:26:33.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606_vm 2023-08-10T11:26:33.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607 2023-08-10T11:26:33.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607_fsm 2023-08-10T11:26:33.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2607_vm 2023-08-10T11:26:33.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Aug 10 10:51 2608 2023-08-10T11:26:33.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2608_fsm 2023-08-10T11:26:33.784 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2608_vm 2023-08-10T11:26:33.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Aug 10 10:51 2609 2023-08-10T11:26:33.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2609_fsm 2023-08-10T11:26:33.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2609_vm 2023-08-10T11:26:33.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610 2023-08-10T11:26:33.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610_fsm 2023-08-10T11:26:33.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2610_vm 2023-08-10T11:26:33.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611 2023-08-10T11:26:33.785 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611_vm 2023-08-10T11:26:33.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612 2023-08-10T11:26:33.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2612_fsm 2023-08-10T11:26:33.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612_vm 2023-08-10T11:26:33.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613 2023-08-10T11:26:33.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613_vm 2023-08-10T11:26:33.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615 2023-08-10T11:26:33.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2615_fsm 2023-08-10T11:26:33.786 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615_vm 2023-08-10T11:26:33.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616 2023-08-10T11:26:33.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616_fsm 2023-08-10T11:26:33.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2616_vm 2023-08-10T11:26:33.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 10 10:51 2617 2023-08-10T11:26:33.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2617_fsm 2023-08-10T11:26:33.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2617_vm 2023-08-10T11:26:33.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 10 10:51 2618 2023-08-10T11:26:33.787 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2618_fsm 2023-08-10T11:26:33.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2618_vm 2023-08-10T11:26:33.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 10 10:51 2619 2023-08-10T11:26:33.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2619_fsm 2023-08-10T11:26:33.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2619_vm 2023-08-10T11:26:33.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620 2023-08-10T11:26:33.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620_vm 2023-08-10T11:26:33.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2650 2023-08-10T11:26:33.788 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2651 2023-08-10T11:26:33.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2652 2023-08-10T11:26:33.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2653 2023-08-10T11:26:33.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2654 2023-08-10T11:26:33.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2655 2023-08-10T11:26:33.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2656 2023-08-10T11:26:33.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2657 2023-08-10T11:26:33.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 10 10:51 2658 2023-08-10T11:26:33.789 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2659 2023-08-10T11:26:33.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2660 2023-08-10T11:26:33.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2661 2023-08-10T11:26:33.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2662 2023-08-10T11:26:33.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2663 2023-08-10T11:26:33.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2664 2023-08-10T11:26:33.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2665 2023-08-10T11:26:33.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2666 2023-08-10T11:26:33.790 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2667 2023-08-10T11:26:33.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2668 2023-08-10T11:26:33.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2669 2023-08-10T11:26:33.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2670 2023-08-10T11:26:33.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 303104 Aug 10 10:51 2673 2023-08-10T11:26:33.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Aug 10 10:51 2674 2023-08-10T11:26:33.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Aug 10 10:51 2675 2023-08-10T11:26:33.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2678 2023-08-10T11:26:33.791 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2679 2023-08-10T11:26:33.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2680 2023-08-10T11:26:33.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2681 2023-08-10T11:26:33.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2682 2023-08-10T11:26:33.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2683 2023-08-10T11:26:33.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2684 2023-08-10T11:26:33.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2685 2023-08-10T11:26:33.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2686 2023-08-10T11:26:33.792 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2687 2023-08-10T11:26:33.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2688 2023-08-10T11:26:33.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2689 2023-08-10T11:26:33.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2690 2023-08-10T11:26:33.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Aug 10 10:51 2691 2023-08-10T11:26:33.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2692 2023-08-10T11:26:33.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2693 2023-08-10T11:26:33.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2696 2023-08-10T11:26:33.793 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2699 2023-08-10T11:26:33.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2701 2023-08-10T11:26:33.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2702 2023-08-10T11:26:33.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2703 2023-08-10T11:26:33.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2704 2023-08-10T11:26:33.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2753 2023-08-10T11:26:33.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2753_fsm 2023-08-10T11:26:33.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2753_vm 2023-08-10T11:26:33.794 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2754 2023-08-10T11:26:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2755 2023-08-10T11:26:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2756 2023-08-10T11:26:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2757 2023-08-10T11:26:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830 2023-08-10T11:26:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830_vm 2023-08-10T11:26:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2831 2023-08-10T11:26:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832 2023-08-10T11:26:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832_vm 2023-08-10T11:26:33.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2833 2023-08-10T11:26:33.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834 2023-08-10T11:26:33.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834_vm 2023-08-10T11:26:33.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2835 2023-08-10T11:26:33.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836 2023-08-10T11:26:33.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836_vm 2023-08-10T11:26:33.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2837 2023-08-10T11:26:33.796 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Aug 10 10:51 2838 2023-08-10T11:26:33.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2838_fsm 2023-08-10T11:26:33.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2838_vm 2023-08-10T11:26:33.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2839 2023-08-10T11:26:33.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840 2023-08-10T11:26:33.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840_fsm 2023-08-10T11:26:33.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2840_vm 2023-08-10T11:26:33.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2841 2023-08-10T11:26:33.797 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995 2023-08-10T11:26:33.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995_vm 2023-08-10T11:26:33.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2996 2023-08-10T11:26:33.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079 2023-08-10T11:26:33.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3079_fsm 2023-08-10T11:26:33.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079_vm 2023-08-10T11:26:33.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3080 2023-08-10T11:26:33.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3081 2023-08-10T11:26:33.798 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3085 2023-08-10T11:26:33.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118 2023-08-10T11:26:33.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118_vm 2023-08-10T11:26:33.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3119 2023-08-10T11:26:33.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3164 2023-08-10T11:26:33.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256 2023-08-10T11:26:33.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256_vm 2023-08-10T11:26:33.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3257 2023-08-10T11:26:33.799 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3258 2023-08-10T11:26:33.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350 2023-08-10T11:26:33.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350_vm 2023-08-10T11:26:33.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3351 2023-08-10T11:26:33.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3379 2023-08-10T11:26:33.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3380 2023-08-10T11:26:33.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381 2023-08-10T11:26:33.800 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381_vm 2023-08-10T11:26:33.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3394 2023-08-10T11:26:33.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3394_fsm 2023-08-10T11:26:33.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3394_vm 2023-08-10T11:26:33.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3395 2023-08-10T11:26:33.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439 2023-08-10T11:26:33.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439_vm 2023-08-10T11:26:33.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3440 2023-08-10T11:26:33.801 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 3455 2023-08-10T11:26:33.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3456 2023-08-10T11:26:33.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3456_fsm 2023-08-10T11:26:33.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3456_vm 2023-08-10T11:26:33.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466 2023-08-10T11:26:33.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466_vm 2023-08-10T11:26:33.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3467 2023-08-10T11:26:33.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3468 2023-08-10T11:26:33.802 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501 2023-08-10T11:26:33.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501_vm 2023-08-10T11:26:33.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3502 2023-08-10T11:26:33.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3503 2023-08-10T11:26:33.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3534 2023-08-10T11:26:33.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541 2023-08-10T11:26:33.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3541_fsm 2023-08-10T11:26:33.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541_vm 2023-08-10T11:26:33.803 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3542 2023-08-10T11:26:33.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3574 2023-08-10T11:26:33.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3575 2023-08-10T11:26:33.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576 2023-08-10T11:26:33.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576_vm 2023-08-10T11:26:33.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596 2023-08-10T11:26:33.804 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596_vm 2023-08-10T11:26:33.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3597 2023-08-10T11:26:33.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598 2023-08-10T11:26:33.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598_vm 2023-08-10T11:26:33.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3599 2023-08-10T11:26:33.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600 2023-08-10T11:26:33.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3600_fsm 2023-08-10T11:26:33.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600_vm 2023-08-10T11:26:33.805 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601 2023-08-10T11:26:33.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3601_fsm 2023-08-10T11:26:33.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601_vm 2023-08-10T11:26:33.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602 2023-08-10T11:26:33.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3602_fsm 2023-08-10T11:26:33.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602_vm 2023-08-10T11:26:33.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3603 2023-08-10T11:26:33.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3603_fsm 2023-08-10T11:26:33.806 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3603_vm 2023-08-10T11:26:33.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3604 2023-08-10T11:26:33.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3605 2023-08-10T11:26:33.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3606 2023-08-10T11:26:33.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3607 2023-08-10T11:26:33.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3608 2023-08-10T11:26:33.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 3609 2023-08-10T11:26:33.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3712 2023-08-10T11:26:33.807 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764 2023-08-10T11:26:33.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3764_fsm 2023-08-10T11:26:33.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764_vm 2023-08-10T11:26:33.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3766 2023-08-10T11:26:33.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3767 2023-08-10T11:26:33.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3997 2023-08-10T11:26:33.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 5002 2023-08-10T11:26:33.808 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 548 2023-08-10T11:26:33.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 549 2023-08-10T11:26:33.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102 2023-08-10T11:26:33.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102_vm 2023-08-10T11:26:33.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104 2023-08-10T11:26:33.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104_vm 2023-08-10T11:26:33.809 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106 2023-08-10T11:26:33.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106_vm 2023-08-10T11:26:33.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6110 2023-08-10T11:26:33.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6111 2023-08-10T11:26:33.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6112 2023-08-10T11:26:33.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6113 2023-08-10T11:26:33.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6117 2023-08-10T11:26:33.810 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826 2023-08-10T11:26:33.811 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826_vm 2023-08-10T11:26:34.339 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 827 2023-08-10T11:26:34.340 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 828 2023-08-10T11:26:34.340 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 10 10:51 pg_filenode.map 2023-08-10T11:26:34.340 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 10 10:51 PG_VERSION 2023-08-10T11:26:34.340 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:34.340 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-08-10T11:26:34.340 INFO:teuthology.orchestra.run.smithi107.stdout:total 7186 2023-08-10T11:26:34.341 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7356931 Aug 10 10:51 . 2023-08-10T11:26:34.341 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7905394829 Aug 10 11:07 .. 2023-08-10T11:26:34.341 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 112 2023-08-10T11:26:34.341 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 113 2023-08-10T11:26:34.341 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 10 10:51 12182 2023-08-10T11:26:34.341 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12182_fsm 2023-08-10T11:26:34.341 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12182_vm 2023-08-10T11:26:34.341 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12184 2023-08-10T11:26:34.342 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12186 2023-08-10T11:26:34.342 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187 2023-08-10T11:26:34.342 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12187_fsm 2023-08-10T11:26:34.342 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187_vm 2023-08-10T11:26:34.342 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12189 2023-08-10T11:26:34.342 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12191 2023-08-10T11:26:34.342 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192 2023-08-10T11:26:34.343 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12192_fsm 2023-08-10T11:26:34.343 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192_vm 2023-08-10T11:26:34.343 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12194 2023-08-10T11:26:34.343 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12196 2023-08-10T11:26:34.343 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197 2023-08-10T11:26:34.343 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12197_fsm 2023-08-10T11:26:34.343 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197_vm 2023-08-10T11:26:34.343 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12199 2023-08-10T11:26:34.344 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12201 2023-08-10T11:26:34.344 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202 2023-08-10T11:26:34.344 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12202_fsm 2023-08-10T11:26:34.344 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202_vm 2023-08-10T11:26:34.344 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12204 2023-08-10T11:26:34.344 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12206 2023-08-10T11:26:34.344 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207 2023-08-10T11:26:34.345 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12207_fsm 2023-08-10T11:26:34.345 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207_vm 2023-08-10T11:26:34.345 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12209 2023-08-10T11:26:34.345 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12211 2023-08-10T11:26:34.345 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12212 2023-08-10T11:26:34.345 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12214 2023-08-10T11:26:34.345 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12216 2023-08-10T11:26:34.345 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 10 10:51 1247 2023-08-10T11:26:34.346 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1247_fsm 2023-08-10T11:26:34.346 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1247_vm 2023-08-10T11:26:34.346 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Aug 10 10:51 1249 2023-08-10T11:26:34.346 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1249_fsm 2023-08-10T11:26:34.346 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1249_vm 2023-08-10T11:26:34.346 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Aug 10 10:51 1255 2023-08-10T11:26:34.346 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1255_fsm 2023-08-10T11:26:34.346 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1255_vm 2023-08-10T11:26:34.347 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 10 10:51 1259 2023-08-10T11:26:34.347 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1259_fsm 2023-08-10T11:26:34.347 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1259_vm 2023-08-10T11:26:34.347 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417 2023-08-10T11:26:34.347 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417_vm 2023-08-10T11:26:34.347 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418 2023-08-10T11:26:34.347 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418_vm 2023-08-10T11:26:34.347 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 174 2023-08-10T11:26:34.348 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 175 2023-08-10T11:26:34.348 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2187 2023-08-10T11:26:34.348 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224 2023-08-10T11:26:34.348 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224_vm 2023-08-10T11:26:34.348 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328 2023-08-10T11:26:34.348 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328_vm 2023-08-10T11:26:34.348 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336 2023-08-10T11:26:34.348 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336_vm 2023-08-10T11:26:34.349 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2337 2023-08-10T11:26:34.349 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2600 2023-08-10T11:26:34.349 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2600_fsm 2023-08-10T11:26:34.349 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2600_vm 2023-08-10T11:26:34.349 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601 2023-08-10T11:26:34.349 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2601_fsm 2023-08-10T11:26:34.349 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601_vm 2023-08-10T11:26:34.349 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2602 2023-08-10T11:26:34.350 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2602_fsm 2023-08-10T11:26:34.350 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2602_vm 2023-08-10T11:26:34.350 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2603 2023-08-10T11:26:34.350 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2603_fsm 2023-08-10T11:26:34.350 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2603_vm 2023-08-10T11:26:34.350 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604 2023-08-10T11:26:34.350 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604_vm 2023-08-10T11:26:34.350 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2605 2023-08-10T11:26:34.351 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2605_fsm 2023-08-10T11:26:34.351 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2605_vm 2023-08-10T11:26:34.351 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606 2023-08-10T11:26:34.351 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2606_fsm 2023-08-10T11:26:34.351 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2606_vm 2023-08-10T11:26:34.351 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607 2023-08-10T11:26:34.351 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607_fsm 2023-08-10T11:26:34.351 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2607_vm 2023-08-10T11:26:34.352 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Aug 10 10:51 2608 2023-08-10T11:26:34.352 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2608_fsm 2023-08-10T11:26:34.352 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2608_vm 2023-08-10T11:26:34.352 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Aug 10 10:51 2609 2023-08-10T11:26:34.352 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2609_fsm 2023-08-10T11:26:34.352 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2609_vm 2023-08-10T11:26:34.352 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610 2023-08-10T11:26:34.353 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2610_fsm 2023-08-10T11:26:34.353 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2610_vm 2023-08-10T11:26:34.353 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611 2023-08-10T11:26:34.353 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611_vm 2023-08-10T11:26:34.353 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612 2023-08-10T11:26:34.353 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2612_fsm 2023-08-10T11:26:34.353 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612_vm 2023-08-10T11:26:34.353 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613 2023-08-10T11:26:34.354 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613_vm 2023-08-10T11:26:34.354 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615 2023-08-10T11:26:34.354 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2615_fsm 2023-08-10T11:26:34.354 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615_vm 2023-08-10T11:26:34.354 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616 2023-08-10T11:26:34.354 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616_fsm 2023-08-10T11:26:34.354 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2616_vm 2023-08-10T11:26:34.354 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 10 10:51 2617 2023-08-10T11:26:34.355 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2617_fsm 2023-08-10T11:26:34.355 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2617_vm 2023-08-10T11:26:34.355 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 10 10:51 2618 2023-08-10T11:26:34.355 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2618_fsm 2023-08-10T11:26:34.355 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2618_vm 2023-08-10T11:26:34.355 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 10 10:51 2619 2023-08-10T11:26:34.355 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2619_fsm 2023-08-10T11:26:34.355 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2619_vm 2023-08-10T11:26:34.356 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620 2023-08-10T11:26:34.356 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620_vm 2023-08-10T11:26:34.356 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2650 2023-08-10T11:26:34.356 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2651 2023-08-10T11:26:34.356 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2652 2023-08-10T11:26:34.356 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2653 2023-08-10T11:26:34.356 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2654 2023-08-10T11:26:34.356 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2655 2023-08-10T11:26:34.357 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2656 2023-08-10T11:26:34.357 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2657 2023-08-10T11:26:34.357 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 10 10:51 2658 2023-08-10T11:26:34.357 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2659 2023-08-10T11:26:34.357 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2660 2023-08-10T11:26:34.357 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2661 2023-08-10T11:26:34.357 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2662 2023-08-10T11:26:34.357 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2663 2023-08-10T11:26:34.358 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2664 2023-08-10T11:26:34.358 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2665 2023-08-10T11:26:34.358 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2666 2023-08-10T11:26:34.358 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2667 2023-08-10T11:26:34.358 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2668 2023-08-10T11:26:34.358 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2669 2023-08-10T11:26:34.358 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2670 2023-08-10T11:26:34.358 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 303104 Aug 10 10:51 2673 2023-08-10T11:26:34.359 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Aug 10 10:51 2674 2023-08-10T11:26:34.359 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Aug 10 10:51 2675 2023-08-10T11:26:34.359 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2678 2023-08-10T11:26:34.359 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2679 2023-08-10T11:26:34.359 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2680 2023-08-10T11:26:34.359 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2681 2023-08-10T11:26:34.359 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2682 2023-08-10T11:26:34.360 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2683 2023-08-10T11:26:34.360 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2684 2023-08-10T11:26:34.360 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2685 2023-08-10T11:26:34.360 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2686 2023-08-10T11:26:34.360 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2687 2023-08-10T11:26:34.360 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2688 2023-08-10T11:26:34.360 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2689 2023-08-10T11:26:34.360 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2690 2023-08-10T11:26:34.361 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Aug 10 10:51 2691 2023-08-10T11:26:34.361 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2692 2023-08-10T11:26:34.361 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2693 2023-08-10T11:26:34.361 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2696 2023-08-10T11:26:34.361 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2699 2023-08-10T11:26:34.361 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2701 2023-08-10T11:26:34.361 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2702 2023-08-10T11:26:34.361 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2703 2023-08-10T11:26:34.362 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2704 2023-08-10T11:26:34.362 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2753 2023-08-10T11:26:34.362 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2753_fsm 2023-08-10T11:26:34.362 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2753_vm 2023-08-10T11:26:34.362 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2754 2023-08-10T11:26:34.362 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2755 2023-08-10T11:26:34.362 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2756 2023-08-10T11:26:34.362 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2757 2023-08-10T11:26:34.363 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830 2023-08-10T11:26:34.363 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830_vm 2023-08-10T11:26:34.363 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2831 2023-08-10T11:26:34.363 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832 2023-08-10T11:26:34.363 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832_vm 2023-08-10T11:26:34.363 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2833 2023-08-10T11:26:34.363 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834 2023-08-10T11:26:34.363 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834_vm 2023-08-10T11:26:34.364 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2835 2023-08-10T11:26:34.364 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836 2023-08-10T11:26:34.364 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836_vm 2023-08-10T11:26:34.364 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2837 2023-08-10T11:26:34.364 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Aug 10 10:51 2838 2023-08-10T11:26:34.364 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2838_fsm 2023-08-10T11:26:34.364 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2838_vm 2023-08-10T11:26:34.365 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2839 2023-08-10T11:26:34.365 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840 2023-08-10T11:26:34.365 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840_fsm 2023-08-10T11:26:34.365 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2840_vm 2023-08-10T11:26:34.365 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2841 2023-08-10T11:26:34.365 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995 2023-08-10T11:26:34.365 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995_vm 2023-08-10T11:26:34.365 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2996 2023-08-10T11:26:34.366 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079 2023-08-10T11:26:34.366 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3079_fsm 2023-08-10T11:26:34.366 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079_vm 2023-08-10T11:26:34.366 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3080 2023-08-10T11:26:34.366 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3081 2023-08-10T11:26:34.366 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3085 2023-08-10T11:26:34.366 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118 2023-08-10T11:26:34.366 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118_vm 2023-08-10T11:26:34.366 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3119 2023-08-10T11:26:34.367 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3164 2023-08-10T11:26:34.367 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256 2023-08-10T11:26:34.367 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256_vm 2023-08-10T11:26:34.367 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3257 2023-08-10T11:26:34.367 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3258 2023-08-10T11:26:34.367 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350 2023-08-10T11:26:34.367 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350_vm 2023-08-10T11:26:34.367 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3351 2023-08-10T11:26:34.368 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3379 2023-08-10T11:26:34.368 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3380 2023-08-10T11:26:34.368 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381 2023-08-10T11:26:34.368 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381_vm 2023-08-10T11:26:34.368 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3394 2023-08-10T11:26:34.368 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3394_fsm 2023-08-10T11:26:34.368 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3394_vm 2023-08-10T11:26:34.369 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3395 2023-08-10T11:26:34.369 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439 2023-08-10T11:26:34.369 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439_vm 2023-08-10T11:26:34.369 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3440 2023-08-10T11:26:34.369 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 3455 2023-08-10T11:26:34.369 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3456 2023-08-10T11:26:34.369 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3456_fsm 2023-08-10T11:26:34.369 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3456_vm 2023-08-10T11:26:34.370 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466 2023-08-10T11:26:34.370 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466_vm 2023-08-10T11:26:34.370 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3467 2023-08-10T11:26:34.370 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3468 2023-08-10T11:26:34.370 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501 2023-08-10T11:26:34.370 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501_vm 2023-08-10T11:26:34.370 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3502 2023-08-10T11:26:34.370 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3503 2023-08-10T11:26:34.371 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3534 2023-08-10T11:26:34.371 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541 2023-08-10T11:26:34.371 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3541_fsm 2023-08-10T11:26:34.371 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541_vm 2023-08-10T11:26:34.371 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3542 2023-08-10T11:26:34.371 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3574 2023-08-10T11:26:34.371 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3575 2023-08-10T11:26:34.371 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576 2023-08-10T11:26:34.372 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576_vm 2023-08-10T11:26:34.372 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596 2023-08-10T11:26:34.372 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596_vm 2023-08-10T11:26:34.372 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3597 2023-08-10T11:26:34.372 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598 2023-08-10T11:26:34.372 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598_vm 2023-08-10T11:26:34.372 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3599 2023-08-10T11:26:34.373 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600 2023-08-10T11:26:34.373 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3600_fsm 2023-08-10T11:26:34.373 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600_vm 2023-08-10T11:26:34.373 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601 2023-08-10T11:26:34.373 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3601_fsm 2023-08-10T11:26:34.373 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601_vm 2023-08-10T11:26:34.373 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602 2023-08-10T11:26:34.373 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3602_fsm 2023-08-10T11:26:34.374 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602_vm 2023-08-10T11:26:34.374 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3603 2023-08-10T11:26:34.374 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3603_fsm 2023-08-10T11:26:34.374 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3603_vm 2023-08-10T11:26:34.374 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3604 2023-08-10T11:26:34.374 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3605 2023-08-10T11:26:34.374 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3606 2023-08-10T11:26:34.374 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3607 2023-08-10T11:26:34.375 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3608 2023-08-10T11:26:34.375 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 3609 2023-08-10T11:26:34.375 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3712 2023-08-10T11:26:34.375 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764 2023-08-10T11:26:34.375 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3764_fsm 2023-08-10T11:26:34.375 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764_vm 2023-08-10T11:26:34.375 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3766 2023-08-10T11:26:34.375 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3767 2023-08-10T11:26:34.376 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3997 2023-08-10T11:26:34.376 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 5002 2023-08-10T11:26:34.376 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 548 2023-08-10T11:26:34.376 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 549 2023-08-10T11:26:34.376 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102 2023-08-10T11:26:34.376 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102_vm 2023-08-10T11:26:34.376 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104 2023-08-10T11:26:34.376 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104_vm 2023-08-10T11:26:34.377 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106 2023-08-10T11:26:34.377 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106_vm 2023-08-10T11:26:35.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6110 2023-08-10T11:26:35.037 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6111 2023-08-10T11:26:35.038 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6112 2023-08-10T11:26:35.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6113 2023-08-10T11:26:35.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6117 2023-08-10T11:26:35.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826 2023-08-10T11:26:35.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826_vm 2023-08-10T11:26:35.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 827 2023-08-10T11:26:35.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 828 2023-08-10T11:26:35.039 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 10 10:51 pg_filenode.map 2023-08-10T11:26:35.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 10 10:51 PG_VERSION 2023-08-10T11:26:35.040 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.040 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-08-10T11:26:35.040 INFO:teuthology.orchestra.run.smithi107.stdout:total 7705745 2023-08-10T11:26:35.040 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7890680967 Aug 10 11:11 . 2023-08-10T11:26:35.040 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7905394829 Aug 10 11:07 .. 2023-08-10T11:26:35.040 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 112 2023-08-10T11:26:35.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 113 2023-08-10T11:26:35.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 10 10:51 12182 2023-08-10T11:26:35.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12182_fsm 2023-08-10T11:26:35.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12182_vm 2023-08-10T11:26:35.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12184 2023-08-10T11:26:35.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12186 2023-08-10T11:26:35.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187 2023-08-10T11:26:35.041 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12187_fsm 2023-08-10T11:26:35.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12187_vm 2023-08-10T11:26:35.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12189 2023-08-10T11:26:35.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12191 2023-08-10T11:26:35.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192 2023-08-10T11:26:35.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12192_fsm 2023-08-10T11:26:35.042 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12192_vm 2023-08-10T11:26:35.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12194 2023-08-10T11:26:35.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12196 2023-08-10T11:26:35.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197 2023-08-10T11:26:35.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12197_fsm 2023-08-10T11:26:35.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12197_vm 2023-08-10T11:26:35.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12199 2023-08-10T11:26:35.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12201 2023-08-10T11:26:35.043 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202 2023-08-10T11:26:35.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12202_fsm 2023-08-10T11:26:35.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12202_vm 2023-08-10T11:26:35.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12204 2023-08-10T11:26:35.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12206 2023-08-10T11:26:35.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207 2023-08-10T11:26:35.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 12207_fsm 2023-08-10T11:26:35.044 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12207_vm 2023-08-10T11:26:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12209 2023-08-10T11:26:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12211 2023-08-10T11:26:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12212 2023-08-10T11:26:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 12214 2023-08-10T11:26:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 12216 2023-08-10T11:26:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 10 10:52 1247 2023-08-10T11:26:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:52 1247_fsm 2023-08-10T11:26:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:52 1247_vm 2023-08-10T11:26:35.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Aug 10 11:10 1249 2023-08-10T11:26:35.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:52 1249_fsm 2023-08-10T11:26:35.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:52 1249_vm 2023-08-10T11:26:35.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Aug 10 10:51 1255 2023-08-10T11:26:35.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1255_fsm 2023-08-10T11:26:35.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1255_vm 2023-08-10T11:26:35.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 10 11:23 1259 2023-08-10T11:26:35.046 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1259_fsm 2023-08-10T11:26:35.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:52 1259_vm 2023-08-10T11:26:35.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417 2023-08-10T11:26:35.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1417_vm 2023-08-10T11:26:35.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418 2023-08-10T11:26:35.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 1418_vm 2023-08-10T11:26:35.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 909312 Aug 10 11:25 16387 2023-08-10T11:26:35.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 11:23 16387_fsm 2023-08-10T11:26:35.047 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 11:23 16387_vm 2023-08-10T11:26:35.048 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 401408 Aug 10 11:25 16393 2023-08-10T11:26:35.048 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 11:23 16393_fsm 2023-08-10T11:26:35.048 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 11:23 16393_vm 2023-08-10T11:26:35.048 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:25 16396 2023-08-10T11:26:35.048 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:25 16396.1 2023-08-10T11:26:35.048 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:25 16396.2 2023-08-10T11:26:35.049 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:25 16396.3 2023-08-10T11:26:35.049 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:25 16396.4 2023-08-10T11:26:35.049 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:25 16396.5 2023-08-10T11:26:35.049 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 301277184 Aug 10 11:25 16396.6 2023-08-10T11:26:35.049 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1679360 Aug 10 11:25 16396_fsm 2023-08-10T11:26:35.050 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 212992 Aug 10 11:25 16396_vm 2023-08-10T11:26:35.050 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 11:24 16397 2023-08-10T11:26:35.050 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 10 11:24 16399 2023-08-10T11:26:35.050 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:25 16401 2023-08-10T11:26:35.050 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49373184 Aug 10 11:25 16401.1 2023-08-10T11:26:35.050 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 12705792 Aug 10 11:25 16403 2023-08-10T11:26:35.050 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 11:25 16403_fsm 2023-08-10T11:26:35.051 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 174 2023-08-10T11:26:35.051 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 175 2023-08-10T11:26:35.051 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2187 2023-08-10T11:26:35.051 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224 2023-08-10T11:26:35.051 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2224_vm 2023-08-10T11:26:35.051 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328 2023-08-10T11:26:35.051 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2328_vm 2023-08-10T11:26:35.051 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336 2023-08-10T11:26:35.052 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2336_vm 2023-08-10T11:26:35.052 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2337 2023-08-10T11:26:35.052 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2600 2023-08-10T11:26:35.052 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2600_fsm 2023-08-10T11:26:35.052 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2600_vm 2023-08-10T11:26:35.052 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601 2023-08-10T11:26:35.052 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2601_fsm 2023-08-10T11:26:35.053 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2601_vm 2023-08-10T11:26:35.053 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2602 2023-08-10T11:26:35.053 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2602_fsm 2023-08-10T11:26:35.053 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2602_vm 2023-08-10T11:26:35.053 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2603 2023-08-10T11:26:35.053 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2603_fsm 2023-08-10T11:26:35.053 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2603_vm 2023-08-10T11:26:35.053 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604 2023-08-10T11:26:35.054 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2604_vm 2023-08-10T11:26:35.054 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2605 2023-08-10T11:26:35.054 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2605_fsm 2023-08-10T11:26:35.054 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2605_vm 2023-08-10T11:26:35.054 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 11:07 2606 2023-08-10T11:26:35.054 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2606_fsm 2023-08-10T11:26:35.054 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 11:07 2606_vm 2023-08-10T11:26:35.054 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607 2023-08-10T11:26:35.055 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2607_fsm 2023-08-10T11:26:35.055 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2607_vm 2023-08-10T11:26:35.055 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Aug 10 11:07 2608 2023-08-10T11:26:35.055 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 11:07 2608_fsm 2023-08-10T11:26:35.055 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 11:07 2608_vm 2023-08-10T11:26:35.055 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Aug 10 10:51 2609 2023-08-10T11:26:35.055 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2609_fsm 2023-08-10T11:26:35.055 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2609_vm 2023-08-10T11:26:35.056 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 11:10 2610 2023-08-10T11:26:35.056 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 11:07 2610_fsm 2023-08-10T11:26:35.056 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 11:07 2610_vm 2023-08-10T11:26:35.056 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611 2023-08-10T11:26:35.056 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2611_vm 2023-08-10T11:26:35.056 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612 2023-08-10T11:26:35.057 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2612_fsm 2023-08-10T11:26:35.057 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2612_vm 2023-08-10T11:26:35.057 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613 2023-08-10T11:26:35.057 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2613_vm 2023-08-10T11:26:35.057 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615 2023-08-10T11:26:35.057 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2615_fsm 2023-08-10T11:26:35.057 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2615_vm 2023-08-10T11:26:35.058 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616 2023-08-10T11:26:35.058 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2616_fsm 2023-08-10T11:26:35.058 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2616_vm 2023-08-10T11:26:35.058 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 10 10:51 2617 2023-08-10T11:26:35.058 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2617_fsm 2023-08-10T11:26:35.058 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2617_vm 2023-08-10T11:26:35.058 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 10 10:51 2618 2023-08-10T11:26:35.058 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2618_fsm 2023-08-10T11:26:35.059 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2618_vm 2023-08-10T11:26:35.059 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Aug 10 11:23 2619 2023-08-10T11:26:35.059 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 11:23 2619_fsm 2023-08-10T11:26:35.059 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 11:07 2619_vm 2023-08-10T11:26:35.059 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620 2023-08-10T11:26:35.059 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2620_vm 2023-08-10T11:26:35.059 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2650 2023-08-10T11:26:35.059 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2651 2023-08-10T11:26:35.060 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2652 2023-08-10T11:26:35.060 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2653 2023-08-10T11:26:35.060 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2654 2023-08-10T11:26:35.060 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2655 2023-08-10T11:26:35.060 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2656 2023-08-10T11:26:35.060 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2657 2023-08-10T11:26:35.060 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 10 11:07 2658 2023-08-10T11:26:35.061 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 11:07 2659 2023-08-10T11:26:35.061 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2660 2023-08-10T11:26:35.061 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2661 2023-08-10T11:26:35.061 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 11:10 2662 2023-08-10T11:26:35.061 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 11:10 2663 2023-08-10T11:26:35.061 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 11:07 2664 2023-08-10T11:26:35.061 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 11:07 2665 2023-08-10T11:26:35.062 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 11:07 2666 2023-08-10T11:26:35.062 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 11:07 2667 2023-08-10T11:26:35.062 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2668 2023-08-10T11:26:35.062 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2669 2023-08-10T11:26:35.062 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2670 2023-08-10T11:26:35.062 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 303104 Aug 10 11:07 2673 2023-08-10T11:26:35.062 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 Aug 10 11:07 2674 2023-08-10T11:26:35.063 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Aug 10 10:51 2675 2023-08-10T11:26:35.063 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 11:07 2678 2023-08-10T11:26:35.063 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 11:07 2679 2023-08-10T11:26:35.063 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2680 2023-08-10T11:26:35.063 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2681 2023-08-10T11:26:35.063 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2682 2023-08-10T11:26:35.063 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2683 2023-08-10T11:26:35.063 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2684 2023-08-10T11:26:35.064 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2685 2023-08-10T11:26:35.064 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2686 2023-08-10T11:26:35.064 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2687 2023-08-10T11:26:35.064 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:51 2688 2023-08-10T11:26:35.064 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 10 10:51 2689 2023-08-10T11:26:35.064 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 10 10:51 2690 2023-08-10T11:26:35.064 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Aug 10 10:51 2691 2023-08-10T11:26:35.064 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2692 2023-08-10T11:26:35.065 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2693 2023-08-10T11:26:35.065 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 11:23 2696 2023-08-10T11:26:35.065 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2699 2023-08-10T11:26:35.065 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2701 2023-08-10T11:26:35.065 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2702 2023-08-10T11:26:35.065 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:52 2703 2023-08-10T11:26:35.065 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 10:52 2704 2023-08-10T11:26:35.065 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2753 2023-08-10T11:26:35.066 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2753_fsm 2023-08-10T11:26:35.066 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2753_vm 2023-08-10T11:26:35.066 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2754 2023-08-10T11:26:35.066 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2755 2023-08-10T11:26:35.066 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2756 2023-08-10T11:26:35.066 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 2757 2023-08-10T11:26:35.066 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830 2023-08-10T11:26:35.066 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2830_vm 2023-08-10T11:26:35.067 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2831 2023-08-10T11:26:35.067 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832 2023-08-10T11:26:35.067 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2832_vm 2023-08-10T11:26:35.067 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2833 2023-08-10T11:26:35.067 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834 2023-08-10T11:26:35.067 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2834_vm 2023-08-10T11:26:35.067 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2835 2023-08-10T11:26:35.067 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836 2023-08-10T11:26:35.068 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2836_vm 2023-08-10T11:26:35.068 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2837 2023-08-10T11:26:35.068 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Aug 10 10:51 2838 2023-08-10T11:26:35.068 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2838_fsm 2023-08-10T11:26:35.068 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2838_vm 2023-08-10T11:26:35.068 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2839 2023-08-10T11:26:35.068 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840 2023-08-10T11:26:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2840_fsm 2023-08-10T11:26:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2840_vm 2023-08-10T11:26:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2841 2023-08-10T11:26:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995 2023-08-10T11:26:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2995_vm 2023-08-10T11:26:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2996 2023-08-10T11:26:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079 2023-08-10T11:26:35.069 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3079_fsm 2023-08-10T11:26:35.070 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3079_vm 2023-08-10T11:26:35.070 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3080 2023-08-10T11:26:35.070 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3081 2023-08-10T11:26:35.070 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3085 2023-08-10T11:26:35.070 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118 2023-08-10T11:26:35.070 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3118_vm 2023-08-10T11:26:35.070 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3119 2023-08-10T11:26:35.070 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3164 2023-08-10T11:26:35.071 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256 2023-08-10T11:26:35.071 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3256_vm 2023-08-10T11:26:35.071 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3257 2023-08-10T11:26:35.071 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3258 2023-08-10T11:26:35.071 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350 2023-08-10T11:26:35.071 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3350_vm 2023-08-10T11:26:35.071 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3351 2023-08-10T11:26:35.072 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3379 2023-08-10T11:26:35.072 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3380 2023-08-10T11:26:35.072 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381 2023-08-10T11:26:35.072 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3381_vm 2023-08-10T11:26:35.072 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3394 2023-08-10T11:26:35.072 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3394_fsm 2023-08-10T11:26:35.072 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3394_vm 2023-08-10T11:26:35.073 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3395 2023-08-10T11:26:35.073 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439 2023-08-10T11:26:35.073 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3439_vm 2023-08-10T11:26:35.073 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3440 2023-08-10T11:26:35.073 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 10 11:10 3455 2023-08-10T11:26:35.073 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3456 2023-08-10T11:26:35.073 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3456_fsm 2023-08-10T11:26:35.073 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3456_vm 2023-08-10T11:26:35.074 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466 2023-08-10T11:26:35.074 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3466_vm 2023-08-10T11:26:35.074 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3467 2023-08-10T11:26:35.074 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3468 2023-08-10T11:26:35.074 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501 2023-08-10T11:26:35.074 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3501_vm 2023-08-10T11:26:35.074 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3502 2023-08-10T11:26:35.074 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3503 2023-08-10T11:26:35.075 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3534 2023-08-10T11:26:35.075 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541 2023-08-10T11:26:35.075 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3541_fsm 2023-08-10T11:26:35.075 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3541_vm 2023-08-10T11:26:35.075 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3542 2023-08-10T11:26:35.075 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3574 2023-08-10T11:26:35.075 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3575 2023-08-10T11:26:35.075 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576 2023-08-10T11:26:35.076 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3576_vm 2023-08-10T11:26:35.076 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596 2023-08-10T11:26:35.076 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3596_vm 2023-08-10T11:26:35.076 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3597 2023-08-10T11:26:35.076 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598 2023-08-10T11:26:35.076 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3598_vm 2023-08-10T11:26:35.076 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3599 2023-08-10T11:26:35.077 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600 2023-08-10T11:26:35.077 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3600_fsm 2023-08-10T11:26:35.077 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3600_vm 2023-08-10T11:26:35.077 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601 2023-08-10T11:26:35.077 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3601_fsm 2023-08-10T11:26:35.077 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3601_vm 2023-08-10T11:26:35.078 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602 2023-08-10T11:26:35.078 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3602_fsm 2023-08-10T11:26:35.078 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3602_vm 2023-08-10T11:26:35.078 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3603 2023-08-10T11:26:35.078 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3603_fsm 2023-08-10T11:26:35.078 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3603_vm 2023-08-10T11:26:35.079 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3604 2023-08-10T11:26:35.079 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3605 2023-08-10T11:26:35.079 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3606 2023-08-10T11:26:35.079 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3607 2023-08-10T11:26:35.079 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3608 2023-08-10T11:26:35.079 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 10 10:51 3609 2023-08-10T11:26:35.079 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3712 2023-08-10T11:26:35.079 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764 2023-08-10T11:26:35.080 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 3764_fsm 2023-08-10T11:26:35.080 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3764_vm 2023-08-10T11:26:35.080 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3766 2023-08-10T11:26:35.080 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 3767 2023-08-10T11:26:35.080 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3997 2023-08-10T11:26:35.080 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 5002 2023-08-10T11:26:35.080 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 548 2023-08-10T11:26:35.080 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 549 2023-08-10T11:26:35.081 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102 2023-08-10T11:26:35.081 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6102_vm 2023-08-10T11:26:35.081 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104 2023-08-10T11:26:35.081 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6104_vm 2023-08-10T11:26:35.081 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106 2023-08-10T11:26:35.081 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6106_vm 2023-08-10T11:26:35.081 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6110 2023-08-10T11:26:35.082 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6111 2023-08-10T11:26:35.082 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6112 2023-08-10T11:26:35.082 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6113 2023-08-10T11:26:35.082 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6117 2023-08-10T11:26:35.082 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826 2023-08-10T11:26:35.082 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 826_vm 2023-08-10T11:26:35.082 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 827 2023-08-10T11:26:35.083 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 828 2023-08-10T11:26:35.083 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 10 10:51 pg_filenode.map 2023-08-10T11:26:35.083 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Aug 10 10:51 pg_internal.init 2023-08-10T11:26:35.083 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 10 10:51 PG_VERSION 2023-08-10T11:26:35.083 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.083 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-08-10T11:26:35.083 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.161 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 11:09 . 2023-08-10T11:26:35.162 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7905394829 Aug 10 11:07 .. 2023-08-10T11:26:35.162 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.162 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/global: 2023-08-10T11:26:35.162 INFO:teuthology.orchestra.run.smithi107.stdout:total 575 2023-08-10T11:26:35.162 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Aug 10 10:51 . 2023-08-10T11:26:35.162 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.162 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1136 2023-08-10T11:26:35.163 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1136_fsm 2023-08-10T11:26:35.163 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1136_vm 2023-08-10T11:26:35.163 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 1137 2023-08-10T11:26:35.163 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1213 2023-08-10T11:26:35.163 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1213_fsm 2023-08-10T11:26:35.163 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1213_vm 2023-08-10T11:26:35.163 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1214 2023-08-10T11:26:35.164 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1214_fsm 2023-08-10T11:26:35.164 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1214_vm 2023-08-10T11:26:35.164 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 1232 2023-08-10T11:26:35.164 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 1233 2023-08-10T11:26:35.164 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1260 2023-08-10T11:26:35.164 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1260_fsm 2023-08-10T11:26:35.164 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1260_vm 2023-08-10T11:26:35.165 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1261 2023-08-10T11:26:35.165 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1261_fsm 2023-08-10T11:26:35.165 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1261_vm 2023-08-10T11:26:35.165 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1262 2023-08-10T11:26:35.165 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 1262_fsm 2023-08-10T11:26:35.165 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 1262_vm 2023-08-10T11:26:35.165 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2396 2023-08-10T11:26:35.165 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 10 10:51 2396_fsm 2023-08-10T11:26:35.166 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2396_vm 2023-08-10T11:26:35.166 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2397 2023-08-10T11:26:35.166 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2671 2023-08-10T11:26:35.166 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2672 2023-08-10T11:26:35.166 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2676 2023-08-10T11:26:35.166 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2677 2023-08-10T11:26:35.166 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2694 2023-08-10T11:26:35.167 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2695 2023-08-10T11:26:35.167 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2697 2023-08-10T11:26:35.167 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 2698 2023-08-10T11:26:35.167 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2846 2023-08-10T11:26:35.167 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2846_vm 2023-08-10T11:26:35.167 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2847 2023-08-10T11:26:35.167 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2964 2023-08-10T11:26:35.215 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2964_vm 2023-08-10T11:26:35.215 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2965 2023-08-10T11:26:35.215 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2966 2023-08-10T11:26:35.215 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 2966_vm 2023-08-10T11:26:35.215 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 2967 2023-08-10T11:26:35.216 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3592 2023-08-10T11:26:35.216 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 3592_vm 2023-08-10T11:26:35.216 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 3593 2023-08-10T11:26:35.216 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 4060 2023-08-10T11:26:35.216 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 4060_vm 2023-08-10T11:26:35.216 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 4061 2023-08-10T11:26:35.216 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6000 2023-08-10T11:26:35.217 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6000_vm 2023-08-10T11:26:35.217 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6001 2023-08-10T11:26:35.217 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6002 2023-08-10T11:26:35.217 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6100 2023-08-10T11:26:35.217 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 6100_vm 2023-08-10T11:26:35.217 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6114 2023-08-10T11:26:35.217 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 6115 2023-08-10T11:26:35.218 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 11:25 pg_control 2023-08-10T11:26:35.218 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 10 10:51 pg_filenode.map 2023-08-10T11:26:35.218 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Aug 10 10:51 pg_internal.init 2023-08-10T11:26:35.218 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.218 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/log: 2023-08-10T11:26:35.218 INFO:teuthology.orchestra.run.smithi107.stdout:total 2 2023-08-10T11:26:35.218 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Aug 10 10:51 . 2023-08-10T11:26:35.219 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.219 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 594 Aug 10 11:26 postgresql-Thu.log 2023-08-10T11:26:35.219 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.219 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-08-10T11:26:35.219 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.219 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.219 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.219 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.220 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-08-10T11:26:35.220 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.220 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.220 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.220 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.220 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-08-10T11:26:35.220 INFO:teuthology.orchestra.run.smithi107.stdout:total 3 2023-08-10T11:26:35.221 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 11:25 . 2023-08-10T11:26:35.221 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.221 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 mappings 2023-08-10T11:26:35.221 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 11:25 replorigin_checkpoint 2023-08-10T11:26:35.221 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 snapshots 2023-08-10T11:26:35.221 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.221 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-08-10T11:26:35.221 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.222 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.222 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 11:25 .. 2023-08-10T11:26:35.222 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.222 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-08-10T11:26:35.222 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.222 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.222 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 10 11:25 .. 2023-08-10T11:26:35.222 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.223 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-08-10T11:26:35.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:35 smithi157 ceph-mon[129604]: pgmap v1127: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 143 KiB/s wr, 20 op/s 2023-08-10T11:26:35.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:35 smithi107 ceph-mon[127953]: pgmap v1127: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 143 KiB/s wr, 20 op/s 2023-08-10T11:26:35.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:35 smithi195 ceph-mon[129938]: pgmap v1127: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 143 KiB/s wr, 20 op/s 2023-08-10T11:26:35.424 INFO:teuthology.orchestra.run.smithi107.stdout:total 2 2023-08-10T11:26:35.424 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 . 2023-08-10T11:26:35.425 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.425 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 members 2023-08-10T11:26:35.425 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 offsets 2023-08-10T11:26:35.425 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.425 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-08-10T11:26:35.425 INFO:teuthology.orchestra.run.smithi107.stdout:total 9 2023-08-10T11:26:35.425 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 . 2023-08-10T11:26:35.426 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 .. 2023-08-10T11:26:35.426 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 0000 2023-08-10T11:26:35.426 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.426 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-08-10T11:26:35.426 INFO:teuthology.orchestra.run.smithi107.stdout:total 9 2023-08-10T11:26:35.426 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 . 2023-08-10T11:26:35.426 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 10 10:51 .. 2023-08-10T11:26:35.426 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:52 0000 2023-08-10T11:26:35.427 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.427 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-08-10T11:26:35.427 INFO:teuthology.orchestra.run.smithi107.stdout:total 9 2023-08-10T11:26:35.427 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 . 2023-08-10T11:26:35.427 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.427 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 10 10:51 0000 2023-08-10T11:26:35.427 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.427 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-08-10T11:26:35.428 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.428 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.428 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.428 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.428 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-08-10T11:26:35.428 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.428 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.429 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.429 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.429 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-08-10T11:26:35.429 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.429 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.429 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.429 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.429 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-08-10T11:26:35.430 INFO:teuthology.orchestra.run.smithi107.stdout:total 14 2023-08-10T11:26:35.430 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Aug 10 11:26 . 2023-08-10T11:26:35.430 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.430 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Aug 10 11:26 db_0.stat 2023-08-10T11:26:35.430 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Aug 10 11:26 db_12347.stat 2023-08-10T11:26:35.430 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Aug 10 11:26 global.stat 2023-08-10T11:26:35.430 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.430 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-08-10T11:26:35.431 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.431 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Aug 10 11:26 . 2023-08-10T11:26:35.431 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.431 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-08-10T11:26:35.431 INFO:teuthology.orchestra.run.smithi107.stdout:total 161 2023-08-10T11:26:35.431 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Aug 10 11:23 . 2023-08-10T11:26:35.431 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.432 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Aug 10 11:25 0003 2023-08-10T11:26:35.432 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.432 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-08-10T11:26:35.432 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.432 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.432 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.432 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.433 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-08-10T11:26:35.433 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.433 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.433 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.433 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.433 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-08-10T11:26:35.433 INFO:teuthology.orchestra.run.smithi107.stdout:total 1048578 2023-08-10T11:26:35.433 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:26 . 2023-08-10T11:26:35.434 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.434 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 000000010000000200000047 2023-08-10T11:26:35.434 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:24 000000010000000200000048 2023-08-10T11:26:35.434 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:24 000000010000000200000049 2023-08-10T11:26:35.434 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:24 00000001000000020000004A 2023-08-10T11:26:35.434 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:24 00000001000000020000004B 2023-08-10T11:26:35.434 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:24 00000001000000020000004C 2023-08-10T11:26:35.434 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:24 00000001000000020000004D 2023-08-10T11:26:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:25 00000001000000020000004E 2023-08-10T11:26:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:18 00000001000000020000004F 2023-08-10T11:26:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:17 000000010000000200000050 2023-08-10T11:26:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:17 000000010000000200000051 2023-08-10T11:26:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:18 000000010000000200000052 2023-08-10T11:26:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:17 000000010000000200000053 2023-08-10T11:26:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:18 000000010000000200000054 2023-08-10T11:26:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 000000010000000200000055 2023-08-10T11:26:35.436 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 000000010000000200000056 2023-08-10T11:26:35.436 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 000000010000000200000057 2023-08-10T11:26:35.436 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 000000010000000200000058 2023-08-10T11:26:35.436 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 000000010000000200000059 2023-08-10T11:26:35.436 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 00000001000000020000005A 2023-08-10T11:26:35.436 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:19 00000001000000020000005B 2023-08-10T11:26:35.436 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 00000001000000020000005C 2023-08-10T11:26:35.436 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:19 00000001000000020000005D 2023-08-10T11:26:35.437 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 00000001000000020000005E 2023-08-10T11:26:35.437 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 00000001000000020000005F 2023-08-10T11:26:35.437 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 000000010000000200000060 2023-08-10T11:26:35.437 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:19 000000010000000200000061 2023-08-10T11:26:35.437 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 000000010000000200000062 2023-08-10T11:26:35.437 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 000000010000000200000063 2023-08-10T11:26:35.437 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 000000010000000200000064 2023-08-10T11:26:35.437 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 000000010000000200000065 2023-08-10T11:26:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:19 000000010000000200000066 2023-08-10T11:26:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 000000010000000200000067 2023-08-10T11:26:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:19 000000010000000200000068 2023-08-10T11:26:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 000000010000000200000069 2023-08-10T11:26:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 00000001000000020000006A 2023-08-10T11:26:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:19 00000001000000020000006B 2023-08-10T11:26:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:19 00000001000000020000006C 2023-08-10T11:26:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:20 00000001000000020000006D 2023-08-10T11:26:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 00000001000000020000006E 2023-08-10T11:26:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 00000001000000020000006F 2023-08-10T11:26:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 000000010000000200000070 2023-08-10T11:26:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 000000010000000200000071 2023-08-10T11:26:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 000000010000000200000072 2023-08-10T11:26:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 000000010000000200000073 2023-08-10T11:26:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 000000010000000200000074 2023-08-10T11:26:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 000000010000000200000075 2023-08-10T11:26:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 000000010000000200000076 2023-08-10T11:26:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 000000010000000200000077 2023-08-10T11:26:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 000000010000000200000078 2023-08-10T11:26:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 000000010000000200000079 2023-08-10T11:26:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 00000001000000020000007A 2023-08-10T11:26:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 00000001000000020000007B 2023-08-10T11:26:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 00000001000000020000007C 2023-08-10T11:26:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 00000001000000020000007D 2023-08-10T11:26:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 00000001000000020000007E 2023-08-10T11:26:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:21 00000001000000020000007F 2023-08-10T11:26:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 000000010000000200000080 2023-08-10T11:26:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 000000010000000200000081 2023-08-10T11:26:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 000000010000000200000082 2023-08-10T11:26:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 000000010000000200000083 2023-08-10T11:26:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:23 000000010000000200000084 2023-08-10T11:26:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 000000010000000200000085 2023-08-10T11:26:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 10 11:22 000000010000000200000086 2023-08-10T11:26:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 archive_status 2023-08-10T11:26:35.442 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-08-10T11:26:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:total 1 2023-08-10T11:26:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 10 10:51 . 2023-08-10T11:26:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Aug 10 11:26 .. 2023-08-10T11:26:35.443 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-08-10T11:26:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:total 65 2023-08-10T11:26:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 10 10:51 . 2023-08-10T11:26:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8980031147 Aug 10 11:26 .. 2023-08-10T11:26:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 10 11:25 0000 2023-08-10T11:26:35.444 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-08-10T11:26:35.455 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-08-10T11:26:35.456 INFO:teuthology.task.exec:Executing custom commands... 2023-08-10T11:26:35.456 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T11:26:35.456 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-08-10T11:26:35.624 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-08-10T11:26:35.723 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-08-10T11:26:36.164 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.163+0000 7fbd2cfff700 1 -- 172.21.15.107:0/465200085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd28073460 msgr2=0x7fbd2810ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.163+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/465200085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd28073460 0x7fbd2810ca50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0098f0 tx=0x7fbd1c009c00 comp rx=0 tx=0).stop 2023-08-10T11:26:36.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.163+0000 7fbd2cfff700 1 -- 172.21.15.107:0/465200085 shutdown_connections 2023-08-10T11:26:36.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.163+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/465200085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2810cf90 0x7fbd2810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.163+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/465200085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd28072b40 0x7fbd28072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.163+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/465200085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd28073460 0x7fbd2810ca50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.163+0000 7fbd2cfff700 1 -- 172.21.15.107:0/465200085 >> 172.21.15.107:0/465200085 conn(0x7fbd280fc220 msgr2=0x7fbd280fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:36.165 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.163+0000 7fbd2cfff700 1 -- 172.21.15.107:0/465200085 shutdown_connections 2023-08-10T11:26:36.166 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.163+0000 7fbd2cfff700 1 -- 172.21.15.107:0/465200085 wait complete. 2023-08-10T11:26:36.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.164+0000 7fbd2cfff700 1 Processor -- start 2023-08-10T11:26:36.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.164+0000 7fbd2cfff700 1 -- start start 2023-08-10T11:26:36.167 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd2cfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd28072b40 0x7fbd2819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:36.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd2cfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd28073460 0x7fbd2819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:36.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd2cfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2810cf90 0x7fbd28198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:36.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd2cfff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28198ef0 con 0x7fbd28073460 2023-08-10T11:26:36.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd2cfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28199060 con 0x7fbd2810cf90 2023-08-10T11:26:36.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd2cfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28199220 con 0x7fbd28072b40 2023-08-10T11:26:36.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd25d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd28073460 0x7fbd2819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:36.168 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd25d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd28073460 0x7fbd2819ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39518/0 (socket says 172.21.15.107:39518) 2023-08-10T11:26:36.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd25d9b700 1 -- 172.21.15.107:0/3388621640 learned_addr learned my addr 172.21.15.107:0/3388621640 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:26:36.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd26d9d700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2810cf90 0x7fbd28198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:36.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd2659c700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd28072b40 0x7fbd2819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:36.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd26d9d700 1 -- 172.21.15.107:0/3388621640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd28072b40 msgr2=0x7fbd2819ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd26d9d700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd28072b40 0x7fbd2819ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd26d9d700 1 -- 172.21.15.107:0/3388621640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd28073460 msgr2=0x7fbd2819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd26d9d700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd28073460 0x7fbd2819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.169 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.165+0000 7fbd26d9d700 1 -- 172.21.15.107:0/3388621640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c009520 con 0x7fbd2810cf90 2023-08-10T11:26:36.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.166+0000 7fbd26d9d700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2810cf90 0x7fbd28198880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000ef90 tx=0x7fbd2000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:36.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.166+0000 7fbd177fe700 1 -- 172.21.15.107:0/3388621640 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20018070 con 0x7fbd2810cf90 2023-08-10T11:26:36.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.166+0000 7fbd177fe700 1 -- 172.21.15.107:0/3388621640 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd2000f040 con 0x7fbd2810cf90 2023-08-10T11:26:36.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.166+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd281994a0 con 0x7fbd2810cf90 2023-08-10T11:26:36.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.166+0000 7fbd177fe700 1 -- 172.21.15.107:0/3388621640 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000cc50 con 0x7fbd2810cf90 2023-08-10T11:26:36.170 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.166+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd281a5a10 con 0x7fbd2810cf90 2023-08-10T11:26:36.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.167+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd280ffe70 con 0x7fbd2810cf90 2023-08-10T11:26:36.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.169+0000 7fbd177fe700 1 -- 172.21.15.107:0/3388621640 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fbd20003a00 con 0x7fbd2810cf90 2023-08-10T11:26:36.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.170+0000 7fbd177fe700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbd100a1340 0x7fbd100a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:36.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.171+0000 7fbd177fe700 1 -- 172.21.15.107:0/3388621640 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 9330+0+0 (secure 0 0 0) 0x7fbd200cd570 con 0x7fbd2810cf90 2023-08-10T11:26:36.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.171+0000 7fbd2659c700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbd100a1340 0x7fbd100a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:36.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.171+0000 7fbd2659c700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbd100a1340 0x7fbd100a3800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009c60 tx=0x7fbd18009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:36.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.173+0000 7fbd177fe700 1 -- 172.21.15.107:0/3388621640 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fbd20096680 con 0x7fbd2810cf90 2023-08-10T11:26:36.400 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.399+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 --> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd280fdea0 con 0x7fbd100a1340 2023-08-10T11:26:36.411 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.410+0000 7fbd177fe700 1 -- 172.21.15.107:0/3388621640 <== mgr.15747 v2:172.21.15.107:6800/391042332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fbd280fdea0 con 0x7fbd100a1340 2023-08-10T11:26:36.412 INFO:teuthology.orchestra.run.smithi107.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-08-10T00:00:00", "created": "2023-08-10T10:51:13", "first": "2023-08-10T10:52:00", "last": "2023-08-10T11:26:00", "last_pruned": "2023-08-10T11:26:02", "created_count": 35, "pruned_count": 28, "active": true} 2023-08-10T11:26:36.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbd100a1340 msgr2=0x7fbd100a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbd100a1340 0x7fbd100a3800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009c60 tx=0x7fbd18009260 comp rx=0 tx=0).stop 2023-08-10T11:26:36.414 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2810cf90 msgr2=0x7fbd28198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2810cf90 0x7fbd28198880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000ef90 tx=0x7fbd2000c3a0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 shutdown_connections 2023-08-10T11:26:36.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbd100a1340 0x7fbd100a3800 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd2810cf90 0x7fbd28198880 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd28072b40 0x7fbd2819ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 --2- 172.21.15.107:0/3388621640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd28073460 0x7fbd2819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.415 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.412+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 >> 172.21.15.107:0/3388621640 conn(0x7fbd280fc220 msgr2=0x7fbd2810f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:36.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.413+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 shutdown_connections 2023-08-10T11:26:36.416 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.413+0000 7fbd2cfff700 1 -- 172.21.15.107:0/3388621640 wait complete. 2023-08-10T11:26:36.432 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-08-10T11:26:36.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.625+0000 7f5b13fff700 1 -- 172.21.15.107:0/455139861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c106710 msgr2=0x7f5b0c106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.626 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.625+0000 7f5b13fff700 1 --2- 172.21.15.107:0/455139861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c106710 0x7f5b0c106af0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009990 tx=0x7f5b08009ca0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.625+0000 7f5b13fff700 1 -- 172.21.15.107:0/455139861 shutdown_connections 2023-08-10T11:26:36.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.625+0000 7f5b13fff700 1 --2- 172.21.15.107:0/455139861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b0c1010c0 0x7f5b0c10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.625+0000 7f5b13fff700 1 --2- 172.21.15.107:0/455139861 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c106710 0x7f5b0c106af0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.625+0000 7f5b13fff700 1 --2- 172.21.15.107:0/455139861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c100700 0x7f5b0c100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.625+0000 7f5b13fff700 1 -- 172.21.15.107:0/455139861 >> 172.21.15.107:0/455139861 conn(0x7f5b0c0fc1d0 msgr2=0x7f5b0c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:36.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.625+0000 7f5b13fff700 1 -- 172.21.15.107:0/455139861 shutdown_connections 2023-08-10T11:26:36.627 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.625+0000 7f5b13fff700 1 -- 172.21.15.107:0/455139861 wait complete. 2023-08-10T11:26:36.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.626+0000 7f5b13fff700 1 Processor -- start 2023-08-10T11:26:36.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.626+0000 7f5b13fff700 1 -- start start 2023-08-10T11:26:36.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.626+0000 7f5b13fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c100700 0x7f5b0c19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:36.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.626+0000 7f5b13fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c1010c0 0x7f5b0c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:36.629 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.626+0000 7f5b13fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b0c106710 0x7f5b0c1964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:36.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.626+0000 7f5b13fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c196b50 con 0x7f5b0c100700 2023-08-10T11:26:36.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.626+0000 7f5b13fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c196cc0 con 0x7f5b0c106710 2023-08-10T11:26:36.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.626+0000 7f5b13fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c196e80 con 0x7f5b0c1010c0 2023-08-10T11:26:36.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b11d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c100700 0x7f5b0c19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:36.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b11d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c100700 0x7f5b0c19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39528/0 (socket says 172.21.15.107:39528) 2023-08-10T11:26:36.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b11d9b700 1 -- 172.21.15.107:0/2262280244 learned_addr learned my addr 172.21.15.107:0/2262280244 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:26:36.630 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b1159a700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c1010c0 0x7f5b0c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:36.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b1259c700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b0c106710 0x7f5b0c1964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:36.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b11d9b700 1 -- 172.21.15.107:0/2262280244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c1010c0 msgr2=0x7f5b0c19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b11d9b700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c1010c0 0x7f5b0c19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b11d9b700 1 -- 172.21.15.107:0/2262280244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b0c106710 msgr2=0x7f5b0c1964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b11d9b700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b0c106710 0x7f5b0c1964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b11d9b700 1 -- 172.21.15.107:0/2262280244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080095f0 con 0x7f5b0c100700 2023-08-10T11:26:36.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.627+0000 7f5b11d9b700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c100700 0x7f5b0c19c680 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5b08005910 tx=0x7f5b08009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:36.631 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.628+0000 7f5b02ffd700 1 -- 172.21.15.107:0/2262280244 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0801d070 con 0x7f5b0c100700 2023-08-10T11:26:36.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.628+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c197100 con 0x7f5b0c100700 2023-08-10T11:26:36.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.628+0000 7f5b02ffd700 1 -- 172.21.15.107:0/2262280244 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b08004c80 con 0x7f5b0c100700 2023-08-10T11:26:36.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.628+0000 7f5b02ffd700 1 -- 172.21.15.107:0/2262280244 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08003a30 con 0x7f5b0c100700 2023-08-10T11:26:36.632 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.628+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c1a3670 con 0x7f5b0c100700 2023-08-10T11:26:36.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.629+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c0ffe40 con 0x7f5b0c100700 2023-08-10T11:26:36.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.631+0000 7f5b02ffd700 1 -- 172.21.15.107:0/2262280244 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5b08004fd0 con 0x7f5b0c100700 2023-08-10T11:26:36.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.632+0000 7f5b02ffd700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5af80a12c0 0x7f5af80a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:36.633 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.632+0000 7f5b02ffd700 1 -- 172.21.15.107:0/2262280244 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 9330+0+0 (secure 0 0 0) 0x7f5b080cded0 con 0x7f5b0c100700 2023-08-10T11:26:36.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.632+0000 7f5b1159a700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5af80a12c0 0x7f5af80a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:36.634 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.633+0000 7f5b1159a700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5af80a12c0 0x7f5af80a3780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c197950 tx=0x7f5afc00b410 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:36.637 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.636+0000 7f5b02ffd700 1 -- 172.21.15.107:0/2262280244 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5b08096fe0 con 0x7f5b0c100700 2023-08-10T11:26:36.862 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.861+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 --> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f5b0c197ce0 con 0x7f5af80a12c0 2023-08-10T11:26:36.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.870+0000 7f5b02ffd700 1 -- 172.21.15.107:0/2262280244 <== mgr.15747 v2:172.21.15.107:6800/391042332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f5b0c197ce0 con 0x7f5af80a12c0 2023-08-10T11:26:36.871 INFO:teuthology.orchestra.run.smithi107.stdout:/ 1M 6M3h 2023-08-10T11:26:36.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5af80a12c0 msgr2=0x7f5af80a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5af80a12c0 0x7f5af80a3780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c197950 tx=0x7f5afc00b410 comp rx=0 tx=0).stop 2023-08-10T11:26:36.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c100700 msgr2=0x7f5b0c19c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:36.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c100700 0x7f5b0c19c680 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5b08005910 tx=0x7f5b08009580 comp rx=0 tx=0).stop 2023-08-10T11:26:36.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 shutdown_connections 2023-08-10T11:26:36.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5af80a12c0 0x7f5af80a3780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b0c106710 0x7f5b0c1964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b0c100700 0x7f5b0c19c680 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 --2- 172.21.15.107:0/2262280244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b0c1010c0 0x7f5b0c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:36.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 >> 172.21.15.107:0/2262280244 conn(0x7f5b0c0fc1d0 msgr2=0x7f5b0c0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:36.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 shutdown_connections 2023-08-10T11:26:36.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:36.872+0000 7f5b13fff700 1 -- 172.21.15.107:0/2262280244 wait complete. 2023-08-10T11:26:36.892 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-08-10T11:26:36.903 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-08-10T11:26:36.903 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-08-10T11:26:36.904 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-08-10T11:26:36.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:26:37.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.151+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/906169025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 msgr2=0x7ff1b4106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.151+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/906169025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 0x7ff1b4106ad0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009990 tx=0x7ff1a4009ca0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.152 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.151+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/906169025 shutdown_connections 2023-08-10T11:26:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.151+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/906169025 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1b41010a0 0x7ff1b410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.151+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/906169025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 0x7ff1b4106ad0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.151+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/906169025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1b41006e0 0x7ff1b4100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.151+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/906169025 >> 172.21.15.107:0/906169025 conn(0x7ff1b40fc190 msgr2=0x7ff1b40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.151+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/906169025 shutdown_connections 2023-08-10T11:26:37.153 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.151+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/906169025 wait complete. 2023-08-10T11:26:37.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.152+0000 7ff1ba5ff700 1 Processor -- start 2023-08-10T11:26:37.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.152+0000 7ff1ba5ff700 1 -- start start 2023-08-10T11:26:37.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.152+0000 7ff1ba5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1b41006e0 0x7ff1b4196670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:37.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.152+0000 7ff1ba5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1b41010a0 0x7ff1b4196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:37.155 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.152+0000 7ff1ba5ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 0x7ff1b419b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:37.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.152+0000 7ff1ba5ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b419b650 con 0x7ff1b41066f0 2023-08-10T11:26:37.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.152+0000 7ff1ba5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b419b7c0 con 0x7ff1b41010a0 2023-08-10T11:26:37.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.152+0000 7ff1ba5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b419b980 con 0x7ff1b41006e0 2023-08-10T11:26:37.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.152+0000 7ff1b8b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 0x7ff1b419b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:37.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b8b9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 0x7ff1b419b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39546/0 (socket says 172.21.15.107:39546) 2023-08-10T11:26:37.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1b41010a0 0x7ff1b4196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:37.156 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b8b9c700 1 -- 172.21.15.107:0/687747764 learned_addr learned my addr 172.21.15.107:0/687747764 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:26:37.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b3fff700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1b41006e0 0x7ff1b4196670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:37.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b8b9c700 1 -- 172.21.15.107:0/687747764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1b41006e0 msgr2=0x7ff1b4196670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b8b9c700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1b41006e0 0x7ff1b4196670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b8b9c700 1 -- 172.21.15.107:0/687747764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1b41010a0 msgr2=0x7ff1b4196bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b8b9c700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1b41010a0 0x7ff1b4196bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b8b9c700 1 -- 172.21.15.107:0/687747764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40095f0 con 0x7ff1b41066f0 2023-08-10T11:26:37.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b8b9c700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 0x7ff1b419b010 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac007ee0 tx=0x7ff1ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:37.157 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b1ffb700 1 -- 172.21.15.107:0/687747764 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac017070 con 0x7ff1b41066f0 2023-08-10T11:26:37.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b419bc60 con 0x7ff1b41066f0 2023-08-10T11:26:37.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b1ffb700 1 -- 172.21.15.107:0/687747764 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1ac00f040 con 0x7ff1b41066f0 2023-08-10T11:26:37.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.153+0000 7ff1b1ffb700 1 -- 172.21.15.107:0/687747764 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac005710 con 0x7ff1b41066f0 2023-08-10T11:26:37.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.154+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b41a34a0 con 0x7ff1b41066f0 2023-08-10T11:26:37.158 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.155+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b4067560 con 0x7ff1b41066f0 2023-08-10T11:26:37.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.156+0000 7ff1b1ffb700 1 -- 172.21.15.107:0/687747764 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff1ac005870 con 0x7ff1b41066f0 2023-08-10T11:26:37.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.158+0000 7ff1b1ffb700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1a00a1300 0x7ff1a00a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:37.159 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.158+0000 7ff1b1ffb700 1 -- 172.21.15.107:0/687747764 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 9330+0+0 (secure 0 0 0) 0x7ff1ac0cc8a0 con 0x7ff1b41066f0 2023-08-10T11:26:37.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.158+0000 7ff1b3fff700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1a00a1300 0x7ff1a00a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:37.160 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.159+0000 7ff1b3fff700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1a00a1300 0x7ff1a00a37c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400b5c0 tx=0x7ff1a4005fb0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:37.163 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.162+0000 7ff1b1ffb700 1 -- 172.21.15.107:0/687747764 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff1ac095920 con 0x7ff1b41066f0 2023-08-10T11:26:37.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:37 smithi157 ceph-mon[129604]: pgmap v1128: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 145 KiB/s wr, 20 op/s 2023-08-10T11:26:37.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:37 smithi107 ceph-mon[127953]: pgmap v1128: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 145 KiB/s wr, 20 op/s 2023-08-10T11:26:37.363 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.362+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1b41a3760 con 0x7ff1b41066f0 2023-08-10T11:26:37.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.386+0000 7ff1b1ffb700 1 -- 172.21.15.107:0/687747764 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+25064 (secure 0 0 0) 0x7ff1ac098f40 con 0x7ff1b41066f0 2023-08-10T11:26:37.388 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:37.388 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":158,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T11:26:24.963556+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":64,"snap_epoch":156,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":64,"snap_epoch":156,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3715609072":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6801/438388714":"2023-08-11T10:51:12.376658+0000","172.21.15.107:0/1857104840":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/438388714":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/3894575131":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4083524194":"2023-08-11T10:51:12.376658+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":51,"length":1},{"begin":64,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:26:37.389 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1a00a1300 msgr2=0x7ff1a00a37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1a00a1300 0x7ff1a00a37c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400b5c0 tx=0x7ff1a4005fb0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 msgr2=0x7ff1b419b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 0x7ff1b419b010 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac007ee0 tx=0x7ff1ac00d3b0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 shutdown_connections 2023-08-10T11:26:37.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff1b41066f0 0x7ff1b419b010 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1b41006e0 0x7ff1b4196670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.390 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7ff1a00a1300 0x7ff1a00a37c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 --2- 172.21.15.107:0/687747764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1b41010a0 0x7ff1b4196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 >> 172.21.15.107:0/687747764 conn(0x7ff1b40fc190 msgr2=0x7ff1b40fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:37.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 shutdown_connections 2023-08-10T11:26:37.391 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.388+0000 7ff1ba5ff700 1 -- 172.21.15.107:0/687747764 wait complete. 2023-08-10T11:26:37.408 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 64, 'snap_epoch': 156, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 64, 'snap_epoch': 156, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T11:26:37.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:26:37.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:37 smithi195 ceph-mon[129938]: pgmap v1128: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 145 KiB/s wr, 20 op/s 2023-08-10T11:26:37.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.608+0000 7efd7e9ff700 1 -- 172.21.15.107:0/71163969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd780734c0 msgr2=0x7efd7810c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.608+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/71163969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd780734c0 0x7efd7810c9c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7efd64009990 tx=0x7efd64009ca0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.608+0000 7efd7e9ff700 1 -- 172.21.15.107:0/71163969 shutdown_connections 2023-08-10T11:26:37.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.608+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/71163969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7810cf00 0x7efd7810f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.608+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/71163969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd78072ba0 0x7efd78072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.608+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/71163969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd780734c0 0x7efd7810c9c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.608+0000 7efd7e9ff700 1 -- 172.21.15.107:0/71163969 >> 172.21.15.107:0/71163969 conn(0x7efd780fc1f0 msgr2=0x7efd780fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:37.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.608+0000 7efd7e9ff700 1 -- 172.21.15.107:0/71163969 shutdown_connections 2023-08-10T11:26:37.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.608+0000 7efd7e9ff700 1 -- 172.21.15.107:0/71163969 wait complete. 2023-08-10T11:26:37.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.609+0000 7efd7e9ff700 1 Processor -- start 2023-08-10T11:26:37.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.609+0000 7efd7e9ff700 1 -- start start 2023-08-10T11:26:37.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd7e9ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd78072ba0 0x7efd781989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:37.615 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd7e9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd780734c0 0x7efd78198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:37.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd7e9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7810cf00 0x7efd7819d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:37.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd7e9ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7819d940 con 0x7efd78072ba0 2023-08-10T11:26:37.616 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd7e9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7819dab0 con 0x7efd7810cf00 2023-08-10T11:26:37.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd7e9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7819dc70 con 0x7efd780734c0 2023-08-10T11:26:37.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd77fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd78072ba0 0x7efd781989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:37.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd77fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd78072ba0 0x7efd781989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39572/0 (socket says 172.21.15.107:39572) 2023-08-10T11:26:37.617 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd77fff700 1 -- 172.21.15.107:0/2461978003 learned_addr learned my addr 172.21.15.107:0/2461978003 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:26:37.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd7cf9c700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7810cf00 0x7efd7819d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:37.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd777fe700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd780734c0 0x7efd78198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:37.618 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd77fff700 1 -- 172.21.15.107:0/2461978003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd780734c0 msgr2=0x7efd78198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.610+0000 7efd77fff700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd780734c0 0x7efd78198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd77fff700 1 -- 172.21.15.107:0/2461978003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7810cf00 msgr2=0x7efd7819d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd77fff700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7810cf00 0x7efd7819d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.619 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd77fff700 1 -- 172.21.15.107:0/2461978003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd640095f0 con 0x7efd78072ba0 2023-08-10T11:26:37.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd777fe700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd780734c0 0x7efd78198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:26:37.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd7cf9c700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7810cf00 0x7efd7819d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:26:37.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd77fff700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd78072ba0 0x7efd781989a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7efd6800d950 tx=0x7efd6800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:37.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd757fa700 1 -- 172.21.15.107:0/2461978003 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68009b40 con 0x7efd78072ba0 2023-08-10T11:26:37.620 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7819df50 con 0x7efd78072ba0 2023-08-10T11:26:37.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd757fa700 1 -- 172.21.15.107:0/2461978003 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd68009ca0 con 0x7efd78072ba0 2023-08-10T11:26:37.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd757fa700 1 -- 172.21.15.107:0/2461978003 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6800f620 con 0x7efd78072ba0 2023-08-10T11:26:37.621 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.611+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd781a5800 con 0x7efd78072ba0 2023-08-10T11:26:37.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.612+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd78108110 con 0x7efd78072ba0 2023-08-10T11:26:37.622 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.614+0000 7efd757fa700 1 -- 172.21.15.107:0/2461978003 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7efd68010460 con 0x7efd78072ba0 2023-08-10T11:26:37.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.616+0000 7efd757fa700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efd5c0a12c0 0x7efd5c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:37.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.616+0000 7efd757fa700 1 -- 172.21.15.107:0/2461978003 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 9330+0+0 (secure 0 0 0) 0x7efd680cd460 con 0x7efd78072ba0 2023-08-10T11:26:37.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.616+0000 7efd777fe700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efd5c0a12c0 0x7efd5c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:37.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.616+0000 7efd777fe700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efd5c0a12c0 0x7efd5c0a3780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd64000c00 tx=0x7efd64005fb0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:37.623 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.619+0000 7efd757fa700 1 -- 172.21.15.107:0/2461978003 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7efd680964e0 con 0x7efd78072ba0 2023-08-10T11:26:37.820 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.819+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd78107af0 con 0x7efd78072ba0 2023-08-10T11:26:37.821 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.820+0000 7efd757fa700 1 -- 172.21.15.107:0/2461978003 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd68099b00 con 0x7efd78072ba0 2023-08-10T11:26:37.821 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T11:26:37.823 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efd5c0a12c0 msgr2=0x7efd5c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efd5c0a12c0 0x7efd5c0a3780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd64000c00 tx=0x7efd64005fb0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd78072ba0 msgr2=0x7efd781989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:37.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd78072ba0 0x7efd781989a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7efd6800d950 tx=0x7efd6800dd10 comp rx=0 tx=0).stop 2023-08-10T11:26:37.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 shutdown_connections 2023-08-10T11:26:37.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efd5c0a12c0 0x7efd5c0a3780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.824 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7810cf00 0x7efd7819d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd78072ba0 0x7efd781989a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 --2- 172.21.15.107:0/2461978003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd780734c0 0x7efd78198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:37.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 >> 172.21.15.107:0/2461978003 conn(0x7efd780fc1f0 msgr2=0x7efd780fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:37.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 shutdown_connections 2023-08-10T11:26:37.825 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:37.822+0000 7efd7e9ff700 1 -- 172.21.15.107:0/2461978003 wait complete. 2023-08-10T11:26:37.843 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:26:38.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.044+0000 7f8a073ff700 1 -- 172.21.15.107:0/531821669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 msgr2=0x7f8a00106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.044+0000 7f8a073ff700 1 --2- 172.21.15.107:0/531821669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 0x7f8a00106ab0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009990 tx=0x7f89fc009ca0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.044+0000 7f8a073ff700 1 -- 172.21.15.107:0/531821669 shutdown_connections 2023-08-10T11:26:38.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.044+0000 7f8a073ff700 1 --2- 172.21.15.107:0/531821669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a00101080 0x7f8a0010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.046 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.044+0000 7f8a073ff700 1 --2- 172.21.15.107:0/531821669 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 0x7f8a00106ab0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.044+0000 7f8a073ff700 1 --2- 172.21.15.107:0/531821669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a001006c0 0x7f8a00100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.044+0000 7f8a073ff700 1 -- 172.21.15.107:0/531821669 >> 172.21.15.107:0/531821669 conn(0x7f8a000fc1f0 msgr2=0x7f8a000fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:38.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.044+0000 7f8a073ff700 1 -- 172.21.15.107:0/531821669 shutdown_connections 2023-08-10T11:26:38.047 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.045+0000 7f8a073ff700 1 -- 172.21.15.107:0/531821669 wait complete. 2023-08-10T11:26:38.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.046+0000 7f8a073ff700 1 Processor -- start 2023-08-10T11:26:38.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.046+0000 7f8a073ff700 1 -- start start 2023-08-10T11:26:38.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a073ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a001006c0 0x7f8a00196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a073ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a00101080 0x7f8a00196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.048 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a073ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 0x7f8a00199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a073ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0019a5f0 con 0x7f8a001066d0 2023-08-10T11:26:38.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a073ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0019a760 con 0x7f8a00101080 2023-08-10T11:26:38.049 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a073ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0019a920 con 0x7f8a001006c0 2023-08-10T11:26:38.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0599c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 0x7f8a00199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0599c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 0x7f8a00199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39584/0 (socket says 172.21.15.107:39584) 2023-08-10T11:26:38.050 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0599c700 1 -- 172.21.15.107:0/3423419519 learned_addr learned my addr 172.21.15.107:0/3423419519 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:26:38.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0519b700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a001006c0 0x7f8a00196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0499a700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a00101080 0x7f8a00196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0599c700 1 -- 172.21.15.107:0/3423419519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a001006c0 msgr2=0x7f8a00196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0599c700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a001006c0 0x7f8a00196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0599c700 1 -- 172.21.15.107:0/3423419519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a00101080 msgr2=0x7f8a00196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0599c700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a00101080 0x7f8a00196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.051 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0599c700 1 -- 172.21.15.107:0/3423419519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0095f0 con 0x7f8a001066d0 2023-08-10T11:26:38.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.047+0000 7f8a0499a700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a00101080 0x7f8a00196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:26:38.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.048+0000 7f8a0599c700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 0x7f8a00199ff0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f89f8007ee0 tx=0x7f89f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:38.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.048+0000 7f89f67fc700 1 -- 172.21.15.107:0/3423419519 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8017070 con 0x7f8a001066d0 2023-08-10T11:26:38.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.048+0000 7f89f67fc700 1 -- 172.21.15.107:0/3423419519 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89f800f040 con 0x7f8a001066d0 2023-08-10T11:26:38.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.048+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0019ac00 con 0x7f8a001066d0 2023-08-10T11:26:38.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.048+0000 7f89f67fc700 1 -- 172.21.15.107:0/3423419519 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8005710 con 0x7f8a001066d0 2023-08-10T11:26:38.052 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.048+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a001a3560 con 0x7f8a001066d0 2023-08-10T11:26:38.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.049+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a000674f0 con 0x7f8a001066d0 2023-08-10T11:26:38.053 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.051+0000 7f89f67fc700 1 -- 172.21.15.107:0/3423419519 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f89f8005870 con 0x7f8a001066d0 2023-08-10T11:26:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.053+0000 7f89f67fc700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f89ec0a1340 0x7f89ec0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.054 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.053+0000 7f89f67fc700 1 -- 172.21.15.107:0/3423419519 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 9330+0+0 (secure 0 0 0) 0x7f89f80cc8a0 con 0x7f8a001066d0 2023-08-10T11:26:38.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.053+0000 7f8a0519b700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f89ec0a1340 0x7f89ec0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.055 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.054+0000 7f8a0519b700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f89ec0a1340 0x7f89ec0a3800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00b5c0 tx=0x7f89fc005fb0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:38.058 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.057+0000 7f89f67fc700 1 -- 172.21.15.107:0/3423419519 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f89f8095920 con 0x7f8a001066d0 2023-08-10T11:26:38.258 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.257+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a001a3820 con 0x7f8a001066d0 2023-08-10T11:26:38.259 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.257+0000 7f89f67fc700 1 -- 172.21.15.107:0/3423419519 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v158) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89f8098f40 con 0x7f8a001066d0 2023-08-10T11:26:38.259 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T11:26:38.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f89ec0a1340 msgr2=0x7f89ec0a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f89ec0a1340 0x7f89ec0a3800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00b5c0 tx=0x7f89fc005fb0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 msgr2=0x7f8a00199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.261 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 0x7f8a00199ff0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f89f8007ee0 tx=0x7f89f800d3b0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 shutdown_connections 2023-08-10T11:26:38.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8a001066d0 0x7f8a00199ff0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a001006c0 0x7f8a00196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f89ec0a1340 0x7f89ec0a3800 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 --2- 172.21.15.107:0/3423419519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a00101080 0x7f8a00196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 >> 172.21.15.107:0/3423419519 conn(0x7f8a000fc1f0 msgr2=0x7f8a000fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:38.262 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 shutdown_connections 2023-08-10T11:26:38.263 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.260+0000 7f8a073ff700 1 -- 172.21.15.107:0/3423419519 wait complete. 2023-08-10T11:26:38.277 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:38 smithi107 ceph-mon[127953]: from='client.26585 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:26:38.278 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:38 smithi107 ceph-mon[127953]: from='client.16938 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:26:38.278 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:38 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/687747764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:26:38.278 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:38 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2461978003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:26:38.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:26:38.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:38 smithi157 ceph-mon[129604]: from='client.26585 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:26:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:38 smithi157 ceph-mon[129604]: from='client.16938 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:26:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:38 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/687747764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:26:38.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:38 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2461978003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:26:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:38 smithi195 ceph-mon[129938]: from='client.26585 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:26:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:38 smithi195 ceph-mon[129938]: from='client.16938 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-08-10T11:26:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:38 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/687747764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:26:38.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:38 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2461978003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:26:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.477+0000 7fefc8fff700 1 -- 172.21.15.107:0/3303299630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41006e0 msgr2=0x7fefc4100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.477+0000 7fefc8fff700 1 --2- 172.21.15.107:0/3303299630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41006e0 0x7fefc4100b60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009990 tx=0x7fefb8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.477+0000 7fefc8fff700 1 -- 172.21.15.107:0/3303299630 shutdown_connections 2023-08-10T11:26:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.477+0000 7fefc8fff700 1 --2- 172.21.15.107:0/3303299630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc41010a0 0x7fefc410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.477+0000 7fefc8fff700 1 --2- 172.21.15.107:0/3303299630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc41066f0 0x7fefc4106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.479 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.477+0000 7fefc8fff700 1 --2- 172.21.15.107:0/3303299630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41006e0 0x7fefc4100b60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.477+0000 7fefc8fff700 1 -- 172.21.15.107:0/3303299630 >> 172.21.15.107:0/3303299630 conn(0x7fefc40fc1d0 msgr2=0x7fefc40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:38.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.477+0000 7fefc8fff700 1 -- 172.21.15.107:0/3303299630 shutdown_connections 2023-08-10T11:26:38.480 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.477+0000 7fefc8fff700 1 -- 172.21.15.107:0/3303299630 wait complete. 2023-08-10T11:26:38.481 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.479+0000 7fefc8fff700 1 Processor -- start 2023-08-10T11:26:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.479+0000 7fefc8fff700 1 -- start start 2023-08-10T11:26:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.479+0000 7fefc8fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc41006e0 0x7fefc419c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.479+0000 7fefc8fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc41010a0 0x7fefc419ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc8fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41066f0 0x7fefc41965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc8fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc4196c30 con 0x7fefc41066f0 2023-08-10T11:26:38.482 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc8fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc4196da0 con 0x7fefc41010a0 2023-08-10T11:26:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc8fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc4196f60 con 0x7fefc41006e0 2023-08-10T11:26:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc2d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41066f0 0x7fefc41965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc2d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41066f0 0x7fefc41965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39608/0 (socket says 172.21.15.107:39608) 2023-08-10T11:26:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc2d9d700 1 -- 172.21.15.107:0/1930167354 learned_addr learned my addr 172.21.15.107:0/1930167354 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:26:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc1d9b700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc41010a0 0x7fefc419ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc259c700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc41006e0 0x7fefc419c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.483 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc2d9d700 1 -- 172.21.15.107:0/1930167354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc41006e0 msgr2=0x7fefc419c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc2d9d700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc41006e0 0x7fefc419c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc2d9d700 1 -- 172.21.15.107:0/1930167354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc41010a0 msgr2=0x7fefc419ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc2d9d700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc41010a0 0x7fefc419ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc2d9d700 1 -- 172.21.15.107:0/1930167354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80095f0 con 0x7fefc41066f0 2023-08-10T11:26:38.484 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.480+0000 7fefc2d9d700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41066f0 0x7fefc41965c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fefbc007ee0 tx=0x7fefbc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:38.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.481+0000 7fefb37fe700 1 -- 172.21.15.107:0/1930167354 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc017070 con 0x7fefc41066f0 2023-08-10T11:26:38.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.481+0000 7fefb37fe700 1 -- 172.21.15.107:0/1930167354 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefbc00f040 con 0x7fefc41066f0 2023-08-10T11:26:38.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.481+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc4197240 con 0x7fefc41066f0 2023-08-10T11:26:38.485 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.481+0000 7fefb37fe700 1 -- 172.21.15.107:0/1930167354 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc005710 con 0x7fefc41066f0 2023-08-10T11:26:38.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.481+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc41a3540 con 0x7fefc41066f0 2023-08-10T11:26:38.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.482+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc40674f0 con 0x7fefc41066f0 2023-08-10T11:26:38.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.484+0000 7fefb37fe700 1 -- 172.21.15.107:0/1930167354 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fefbc005870 con 0x7fefc41066f0 2023-08-10T11:26:38.486 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.485+0000 7fefb37fe700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefac0a1340 0x7fefac0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.485+0000 7fefb37fe700 1 -- 172.21.15.107:0/1930167354 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 9330+0+0 (secure 0 0 0) 0x7fefbc0cc8f0 con 0x7fefc41066f0 2023-08-10T11:26:38.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.485+0000 7fefc259c700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefac0a1340 0x7fefac0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.487 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.486+0000 7fefc259c700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefac0a1340 0x7fefac0a3800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefb4006fd0 tx=0x7fefb4008040 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:38.490 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.490+0000 7fefb37fe700 1 -- 172.21.15.107:0/1930167354 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fefbc095970 con 0x7fefc41066f0 2023-08-10T11:26:38.691 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.690+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefc41a37e0 con 0x7fefc41066f0 2023-08-10T11:26:38.692 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.691+0000 7fefb37fe700 1 -- 172.21.15.107:0/1930167354 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v158) v1 ==== 100+0+11 (secure 0 0 0) 0x7fefbc098f90 con 0x7fefc41066f0 2023-08-10T11:26:38.692 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T11:26:38.694 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefac0a1340 msgr2=0x7fefac0a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefac0a1340 0x7fefac0a3800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefb4006fd0 tx=0x7fefb4008040 comp rx=0 tx=0).stop 2023-08-10T11:26:38.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41066f0 msgr2=0x7fefc41965c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41066f0 0x7fefc41965c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fefbc007ee0 tx=0x7fefbc00d3b0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 shutdown_connections 2023-08-10T11:26:38.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fefc41066f0 0x7fefc41965c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefc41006e0 0x7fefc419c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.695 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fefac0a1340 0x7fefac0a3800 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 --2- 172.21.15.107:0/1930167354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fefc41010a0 0x7fefc419ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 >> 172.21.15.107:0/1930167354 conn(0x7fefc40fc1d0 msgr2=0x7fefc40fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:38.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 shutdown_connections 2023-08-10T11:26:38.696 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.693+0000 7fefc8fff700 1 -- 172.21.15.107:0/1930167354 wait complete. 2023-08-10T11:26:38.713 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T11:26:38.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.913+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3620785502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 msgr2=0x7f0e8410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.913+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3620785502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 0x7f0e8410c9c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009990 tx=0x7f0e78009ca0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.914 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.913+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3620785502 shutdown_connections 2023-08-10T11:26:38.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.913+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3620785502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e8410cf00 0x7f0e8410f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.913+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3620785502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e84072ba0 0x7f0e84072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.913+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3620785502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 0x7f0e8410c9c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.913+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3620785502 >> 172.21.15.107:0/3620785502 conn(0x7f0e840fc1f0 msgr2=0x7f0e840fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:38.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.913+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3620785502 shutdown_connections 2023-08-10T11:26:38.915 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.913+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3620785502 wait complete. 2023-08-10T11:26:38.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.914+0000 7f0e8a9ff700 1 Processor -- start 2023-08-10T11:26:38.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.914+0000 7f0e8a9ff700 1 -- start start 2023-08-10T11:26:38.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.914+0000 7f0e8a9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e84072ba0 0x7f0e84198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.914+0000 7f0e8a9ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 0x7f0e84198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.917 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.914+0000 7f0e8a9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e8410cf00 0x7f0e8419d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.914+0000 7f0e8a9ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8419d930 con 0x7f0e840734c0 2023-08-10T11:26:38.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.914+0000 7f0e8a9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8419daa0 con 0x7f0e84072ba0 2023-08-10T11:26:38.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.914+0000 7f0e8a9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8419dc60 con 0x7f0e8410cf00 2023-08-10T11:26:38.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e837fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 0x7f0e84198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e837fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 0x7f0e84198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39634/0 (socket says 172.21.15.107:39634) 2023-08-10T11:26:38.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e837fe700 1 -- 172.21.15.107:0/3229246960 learned_addr learned my addr 172.21.15.107:0/3229246960 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:26:38.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e88f9c700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e8410cf00 0x7f0e8419d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.918 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e83fff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e84072ba0 0x7f0e84198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e837fe700 1 -- 172.21.15.107:0/3229246960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e8410cf00 msgr2=0x7f0e8419d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e837fe700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e8410cf00 0x7f0e8419d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e837fe700 1 -- 172.21.15.107:0/3229246960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e84072ba0 msgr2=0x7f0e84198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:38.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e837fe700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e84072ba0 0x7f0e84198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:38.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e837fe700 1 -- 172.21.15.107:0/3229246960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e780095f0 con 0x7f0e840734c0 2023-08-10T11:26:38.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e83fff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e84072ba0 0x7f0e84198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:26:38.919 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e837fe700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 0x7f0e84198ed0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0e78005910 tx=0x7f0e78009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:38.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e817fa700 1 -- 172.21.15.107:0/3229246960 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7801d070 con 0x7f0e840734c0 2023-08-10T11:26:38.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e817fa700 1 -- 172.21.15.107:0/3229246960 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e78003f40 con 0x7f0e840734c0 2023-08-10T11:26:38.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8419dee0 con 0x7f0e840734c0 2023-08-10T11:26:38.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.915+0000 7f0e817fa700 1 -- 172.21.15.107:0/3229246960 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800fc60 con 0x7f0e840734c0 2023-08-10T11:26:38.920 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.916+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8419e1b0 con 0x7f0e840734c0 2023-08-10T11:26:38.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.916+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e84108110 con 0x7f0e840734c0 2023-08-10T11:26:38.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.918+0000 7f0e817fa700 1 -- 172.21.15.107:0/3229246960 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0e780040b0 con 0x7f0e840734c0 2023-08-10T11:26:38.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.920+0000 7f0e817fa700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0e6c0a12c0 0x7f0e6c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:38.921 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.920+0000 7f0e817fa700 1 -- 172.21.15.107:0/3229246960 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 9330+0+0 (secure 0 0 0) 0x7f0e780ce310 con 0x7f0e840734c0 2023-08-10T11:26:38.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.920+0000 7f0e83fff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0e6c0a12c0 0x7f0e6c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:38.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.921+0000 7f0e83fff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0e6c0a12c0 0x7f0e6c0a3780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0e74005950 tx=0x7f0e740058e0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:38.922 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:38.921+0000 7f0e817fa700 1 -- 172.21.15.107:0/3229246960 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0e78097420 con 0x7f0e840734c0 2023-08-10T11:26:39.025 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:39 smithi157 ceph-mon[129604]: pgmap v1129: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 131 KiB/s wr, 20 op/s 2023-08-10T11:26:39.026 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:39 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:26:39.026 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:39 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3423419519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:26:39.026 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:39 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/1930167354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:26:39.126 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.125+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0e84107af0 con 0x7f0e840734c0 2023-08-10T11:26:39.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.126+0000 7f0e817fa700 1 -- 172.21.15.107:0/3229246960 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v158) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0e7809aa40 con 0x7f0e840734c0 2023-08-10T11:26:39.128 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T11:26:39.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0e6c0a12c0 msgr2=0x7f0e6c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:39.130 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0e6c0a12c0 0x7f0e6c0a3780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0e74005950 tx=0x7f0e740058e0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 msgr2=0x7f0e84198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:39.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 0x7f0e84198ed0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0e78005910 tx=0x7f0e78009580 comp rx=0 tx=0).stop 2023-08-10T11:26:39.131 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 shutdown_connections 2023-08-10T11:26:39.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0e6c0a12c0 0x7f0e6c0a3780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e84072ba0 0x7f0e84198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e8410cf00 0x7f0e8419d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.132 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 --2- 172.21.15.107:0/3229246960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e840734c0 0x7f0e84198ed0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.128+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 >> 172.21.15.107:0/3229246960 conn(0x7f0e840fc1f0 msgr2=0x7f0e840fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:39.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.129+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 shutdown_connections 2023-08-10T11:26:39.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.129+0000 7f0e8a9ff700 1 -- 172.21.15.107:0/3229246960 wait complete. 2023-08-10T11:26:39.148 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-08-10T11:26:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:39 smithi107 ceph-mon[127953]: pgmap v1129: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 131 KiB/s wr, 20 op/s 2023-08-10T11:26:39.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:39 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:26:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:39 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3423419519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:26:39.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:39 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/1930167354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:26:39.346 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.345+0000 7f7411dff700 1 -- 172.21.15.107:0/2794789589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 msgr2=0x7f740c100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:39.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.345+0000 7f7411dff700 1 --2- 172.21.15.107:0/2794789589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 0x7f740c100b60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009990 tx=0x7f73f4009ca0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.345+0000 7f7411dff700 1 -- 172.21.15.107:0/2794789589 shutdown_connections 2023-08-10T11:26:39.347 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.345+0000 7f7411dff700 1 --2- 172.21.15.107:0/2794789589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f740c1066f0 0x7f740c106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.345+0000 7f7411dff700 1 --2- 172.21.15.107:0/2794789589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f740c1010a0 0x7f740c10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.345+0000 7f7411dff700 1 --2- 172.21.15.107:0/2794789589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 0x7f740c100b60 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.345+0000 7f7411dff700 1 -- 172.21.15.107:0/2794789589 >> 172.21.15.107:0/2794789589 conn(0x7f740c0fc190 msgr2=0x7f740c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:39.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.345+0000 7f7411dff700 1 -- 172.21.15.107:0/2794789589 shutdown_connections 2023-08-10T11:26:39.349 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.345+0000 7f7411dff700 1 -- 172.21.15.107:0/2794789589 wait complete. 2023-08-10T11:26:39.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.346+0000 7f7411dff700 1 Processor -- start 2023-08-10T11:26:39.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.346+0000 7f7411dff700 1 -- start start 2023-08-10T11:26:39.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f7411dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 0x7f740c196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:39.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f7411dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f740c1010a0 0x7f740c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:39.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f7411dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f740c1066f0 0x7f740c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:39.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f7411dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c19a5f0 con 0x7f740c1006e0 2023-08-10T11:26:39.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f7411dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c19a760 con 0x7f740c1066f0 2023-08-10T11:26:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f7411dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c19a920 con 0x7f740c1010a0 2023-08-10T11:26:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 0x7f740c196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 0x7f740c196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39652/0 (socket says 172.21.15.107:39652) 2023-08-10T11:26:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740b7fe700 1 -- 172.21.15.107:0/3332918144 learned_addr learned my addr 172.21.15.107:0/3332918144 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:26:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f7403fff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f740c1010a0 0x7f740c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740bfff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f740c1066f0 0x7f740c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:39.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740b7fe700 1 -- 172.21.15.107:0/3332918144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f740c1010a0 msgr2=0x7f740c196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:39.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740b7fe700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f740c1010a0 0x7f740c196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740b7fe700 1 -- 172.21.15.107:0/3332918144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f740c1066f0 msgr2=0x7f740c199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:39.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740b7fe700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f740c1066f0 0x7f740c199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:39.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740b7fe700 1 -- 172.21.15.107:0/3332918144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f40095f0 con 0x7f740c1006e0 2023-08-10T11:26:39.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f740bfff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f740c1066f0 0x7f740c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:26:39.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.347+0000 7f7403fff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f740c1010a0 0x7f740c196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:26:39.353 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.348+0000 7f740b7fe700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 0x7f740c196700 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00d950 tx=0x7f73fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:39.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.348+0000 7f74097fa700 1 -- 172.21.15.107:0/3332918144 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc009b40 con 0x7f740c1006e0 2023-08-10T11:26:39.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.348+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c19ac00 con 0x7f740c1006e0 2023-08-10T11:26:39.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.348+0000 7f74097fa700 1 -- 172.21.15.107:0/3332918144 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73fc009ca0 con 0x7f740c1006e0 2023-08-10T11:26:39.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.348+0000 7f74097fa700 1 -- 172.21.15.107:0/3332918144 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00f620 con 0x7f740c1006e0 2023-08-10T11:26:39.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.348+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c1a3560 con 0x7f740c1006e0 2023-08-10T11:26:39.354 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.349+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c067560 con 0x7f740c1006e0 2023-08-10T11:26:39.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.351+0000 7f74097fa700 1 -- 172.21.15.107:0/3332918144 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f73fc010460 con 0x7f740c1006e0 2023-08-10T11:26:39.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.353+0000 7f74097fa700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f73f80a1300 0x7f73f80a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:26:39.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.353+0000 7f74097fa700 1 -- 172.21.15.107:0/3332918144 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 9330+0+0 (secure 0 0 0) 0x7f73fc0cd3b0 con 0x7f740c1006e0 2023-08-10T11:26:39.355 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.353+0000 7f7403fff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f73f80a1300 0x7f73f80a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:26:39.356 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.354+0000 7f7403fff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f73f80a1300 0x7f73f80a37c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f740c197d10 tx=0x7f73f4005fb0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:26:39.358 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.357+0000 7f74097fa700 1 -- 172.21.15.107:0/3332918144 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f73fc096430 con 0x7f740c1006e0 2023-08-10T11:26:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:39 smithi195 ceph-mon[129938]: pgmap v1129: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 131 KiB/s wr, 20 op/s 2023-08-10T11:26:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:39 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:26:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:39 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3423419519' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:26:39.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:39 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/1930167354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:26:39.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.612+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f740c1a3750 con 0x7f740c1006e0 2023-08-10T11:26:39.624 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.623+0000 7f74097fa700 1 -- 172.21.15.107:0/3332918144 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) v1 ==== 81+0+733783 (secure 0 0 0) 0x7f73fc099a50 con 0x7f740c1006e0 2023-08-10T11:26:39.633 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:26:39.633 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:26:39.633 INFO:teuthology.orchestra.run.smithi107.stdout: "epoch": 26, 2023-08-10T11:26:39.633 INFO:teuthology.orchestra.run.smithi107.stdout: "active_gid": 15747, 2023-08-10T11:26:39.634 INFO:teuthology.orchestra.run.smithi107.stdout: "active_name": "x", 2023-08-10T11:26:39.634 INFO:teuthology.orchestra.run.smithi107.stdout: "active_addrs": { 2023-08-10T11:26:39.634 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-10T11:26:39.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2023-08-10T11:26:39.634 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:6800", 2023-08-10T11:26:39.635 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 391042332 2023-08-10T11:26:39.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.635 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2023-08-10T11:26:39.635 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:6801", 2023-08-10T11:26:39.635 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 391042332 2023-08-10T11:26:39.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.636 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:39.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.636 INFO:teuthology.orchestra.run.smithi107.stdout: "active_addr": "172.21.15.107:6801/391042332", 2023-08-10T11:26:39.636 INFO:teuthology.orchestra.run.smithi107.stdout: "active_change": "2023-08-10T10:51:12.376887+0000", 2023-08-10T11:26:39.636 INFO:teuthology.orchestra.run.smithi107.stdout: "active_mgr_features": 4540138322906710015, 2023-08-10T11:26:39.636 INFO:teuthology.orchestra.run.smithi107.stdout: "available": true, 2023-08-10T11:26:39.636 INFO:teuthology.orchestra.run.smithi107.stdout: "standbys": [ 2023-08-10T11:26:39.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.637 INFO:teuthology.orchestra.run.smithi107.stdout: "gid": 25457, 2023-08-10T11:26:39.637 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "y", 2023-08-10T11:26:39.637 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr_features": 4540138322906710015, 2023-08-10T11:26:39.637 INFO:teuthology.orchestra.run.smithi107.stdout: "available_modules": [ 2023-08-10T11:26:39.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.637 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alerts", 2023-08-10T11:26:39.638 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:39.638 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:39.638 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:39.638 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:39.638 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:39.638 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.638 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.638 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How frequently to reexamine health status", 2023-08-10T11:26:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.639 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.640 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.640 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:39.640 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:39.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.640 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.641 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.641 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.641 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.641 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.641 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.641 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.641 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.642 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.642 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.642 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.642 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.642 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.642 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.642 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.643 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.643 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:39.643 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:39.643 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.643 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.643 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.643 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.644 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.644 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.644 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.644 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.644 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.644 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.644 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.645 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:39.645 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:39.645 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.645 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.645 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.645 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.646 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.647 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.647 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.647 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.647 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.647 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.647 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.647 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.648 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:39.648 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:39.648 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.648 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.648 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.648 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.648 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.649 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.649 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.649 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.649 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.649 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.649 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.650 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_destination": { 2023-08-10T11:26:39.650 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_destination", 2023-08-10T11:26:39.650 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.650 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.650 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.650 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.651 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.651 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.651 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email address to send alerts to", 2023-08-10T11:26:39.651 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.651 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.651 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.652 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_from_name": { 2023-08-10T11:26:39.652 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_from_name", 2023-08-10T11:26:39.652 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.652 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.652 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.652 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "Ceph", 2023-08-10T11:26:39.652 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.653 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.653 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.653 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email From: name", 2023-08-10T11:26:39.653 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.653 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.653 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.653 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_host": { 2023-08-10T11:26:39.654 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_host", 2023-08-10T11:26:39.654 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.654 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.654 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.654 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.654 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.654 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.655 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.655 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP server", 2023-08-10T11:26:39.655 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.655 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.655 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.655 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_password": { 2023-08-10T11:26:39.656 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_password", 2023-08-10T11:26:39.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.656 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.656 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.656 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.656 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.656 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.657 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.657 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Password to authenticate with", 2023-08-10T11:26:39.657 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.657 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.657 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.657 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_port": { 2023-08-10T11:26:39.658 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_port", 2023-08-10T11:26:39.658 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.658 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.658 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.658 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "465", 2023-08-10T11:26:39.658 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.658 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.658 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.659 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP port", 2023-08-10T11:26:39.659 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.659 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.659 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.659 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_sender": { 2023-08-10T11:26:39.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_sender", 2023-08-10T11:26:39.660 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.660 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.660 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.660 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.660 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.660 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.660 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP envelope sender", 2023-08-10T11:26:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_ssl": { 2023-08-10T11:26:39.662 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_ssl", 2023-08-10T11:26:39.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.662 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.662 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.662 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.662 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.662 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.663 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.663 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use SSL to connect to SMTP server", 2023-08-10T11:26:39.663 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.663 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.663 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.663 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_user": { 2023-08-10T11:26:39.663 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_user", 2023-08-10T11:26:39.664 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.664 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.664 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.664 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.664 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.664 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.665 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "User to authenticate as", 2023-08-10T11:26:39.665 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.665 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.665 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.666 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "balancer", 2023-08-10T11:26:39.666 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:39.666 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:39.666 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:39.666 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2023-08-10T11:26:39.666 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "active", 2023-08-10T11:26:39.667 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.667 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.667 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.667 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.667 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.667 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.667 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.668 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically balance PGs across cluster", 2023-08-10T11:26:39.668 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.668 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.668 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.668 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_time": { 2023-08-10T11:26:39.668 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_time", 2023-08-10T11:26:39.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.669 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.669 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.669 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0000", 2023-08-10T11:26:39.669 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.669 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.669 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.669 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "beginning time of day to automatically balance", 2023-08-10T11:26:39.670 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T11:26:39.670 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.670 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.670 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_weekday": { 2023-08-10T11:26:39.670 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_weekday", 2023-08-10T11:26:39.670 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:39.671 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.671 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.671 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:39.671 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2023-08-10T11:26:39.671 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2023-08-10T11:26:39.671 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.671 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-08-10T11:26:39.672 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T11:26:39.672 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.672 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.672 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_max_iterations": { 2023-08-10T11:26:39.672 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_max_iterations", 2023-08-10T11:26:39.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:39.673 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.673 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.673 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "25", 2023-08-10T11:26:39.673 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:39.673 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "250", 2023-08-10T11:26:39.673 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.673 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-08-10T11:26:39.674 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.674 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.674 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.674 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_metrics": { 2023-08-10T11:26:39.674 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_metrics", 2023-08-10T11:26:39.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.674 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.675 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.675 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "pgs,objects,bytes", 2023-08-10T11:26:39.675 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.675 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.675 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.675 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-08-10T11:26:39.675 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-08-10T11:26:39.676 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.676 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.676 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_step": { 2023-08-10T11:26:39.676 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_step", 2023-08-10T11:26:39.676 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:39.676 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.677 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.5", 2023-08-10T11:26:39.677 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0.001", 2023-08-10T11:26:39.677 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "0.999", 2023-08-10T11:26:39.677 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.677 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "aggressiveness of optimization", 2023-08-10T11:26:39.677 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-08-10T11:26:39.678 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.678 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.678 INFO:teuthology.orchestra.run.smithi107.stdout: "end_time": { 2023-08-10T11:26:39.678 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_time", 2023-08-10T11:26:39.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.678 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.678 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2359", 2023-08-10T11:26:39.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.679 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.679 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.679 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ending time of day to automatically balance", 2023-08-10T11:26:39.679 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T11:26:39.679 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: "end_weekday": { 2023-08-10T11:26:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", 2023-08-10T11:26:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2023-08-10T11:26:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2023-08-10T11:26:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-08-10T11:26:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T11:26:39.681 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.682 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.682 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:39.682 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:39.682 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.682 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.682 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.683 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.683 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.683 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.683 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.683 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.683 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.683 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.683 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.684 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.684 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.684 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.684 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.684 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.684 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.684 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.685 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:39.685 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:39.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.685 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.685 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.686 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.686 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.686 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.686 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.686 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.686 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.687 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.687 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:39.687 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:39.687 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.687 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.687 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.687 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:39.688 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.688 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.688 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.688 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.688 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.688 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.688 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.689 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.689 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.689 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.689 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.689 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.689 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.689 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.690 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:39.690 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:39.690 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.690 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.690 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.691 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.691 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.691 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.691 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.691 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.691 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.691 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.692 INFO:teuthology.orchestra.run.smithi107.stdout: "min_score": { 2023-08-10T11:26:39.692 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_score", 2023-08-10T11:26:39.692 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:39.692 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.692 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.692 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:39.693 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.693 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.693 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.693 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-08-10T11:26:39.693 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.693 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.693 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.694 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2023-08-10T11:26:39.694 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2023-08-10T11:26:39.694 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.694 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.694 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.694 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", 2023-08-10T11:26:39.694 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.695 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.695 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.695 INFO:teuthology.orchestra.run.smithi107.stdout: "crush-compat", 2023-08-10T11:26:39.695 INFO:teuthology.orchestra.run.smithi107.stdout: "none", 2023-08-10T11:26:39.695 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap" 2023-08-10T11:26:39.695 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.695 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Balancer mode", 2023-08-10T11:26:39.696 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.696 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.696 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.696 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_ids": { 2023-08-10T11:26:39.696 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_ids", 2023-08-10T11:26:39.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.697 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.697 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.697 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.697 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.697 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.697 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.697 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-08-10T11:26:39.698 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.698 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.698 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.698 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:39.698 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:39.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.698 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.699 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.699 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:39.699 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.699 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-08-10T11:26:39.699 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_deviation": { 2023-08-10T11:26:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_deviation", 2023-08-10T11:26:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.701 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:39.701 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:39.701 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.701 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.701 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "deviation below which no optimization is attempted", 2023-08-10T11:26:39.701 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-08-10T11:26:39.702 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.702 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.702 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_optimizations": { 2023-08-10T11:26:39.702 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_optimizations", 2023-08-10T11:26:39.702 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:39.702 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.703 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.703 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:39.703 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.703 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.703 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.703 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-08-10T11:26:39.703 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.703 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.704 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.704 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.704 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.704 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephadm", 2023-08-10T11:26:39.704 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:39.705 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:39.705 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:39.705 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_down_multiplier": { 2023-08-10T11:26:39.705 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_down_multiplier", 2023-08-10T11:26:39.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:39.705 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.705 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.706 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2023-08-10T11:26:39.706 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.706 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.706 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.706 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-08-10T11:26:39.706 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.706 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.707 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.707 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_refresh_rate": { 2023-08-10T11:26:39.707 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_refresh_rate", 2023-08-10T11:26:39.707 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.707 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.707 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.708 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "20", 2023-08-10T11:26:39.708 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.708 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.708 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.708 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-08-10T11:26:39.708 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.708 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.709 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.709 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_starting_port": { 2023-08-10T11:26:39.709 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_starting_port", 2023-08-10T11:26:39.709 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.709 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.709 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.710 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4721", 2023-08-10T11:26:39.710 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.710 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.710 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.710 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-08-10T11:26:39.710 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.710 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.711 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.711 INFO:teuthology.orchestra.run.smithi107.stdout: "alertmanager_web_password": { 2023-08-10T11:26:39.711 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alertmanager_web_password", 2023-08-10T11:26:39.711 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.711 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.711 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.712 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:39.712 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.712 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.712 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.712 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Alertmanager web password", 2023-08-10T11:26:39.712 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.712 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.713 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.713 INFO:teuthology.orchestra.run.smithi107.stdout: "alertmanager_web_user": { 2023-08-10T11:26:39.713 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alertmanager_web_user", 2023-08-10T11:26:39.713 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.713 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.713 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.714 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:39.714 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.714 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.714 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.714 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Alertmanager web user", 2023-08-10T11:26:39.714 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.714 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.714 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.715 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_ptrace": { 2023-08-10T11:26:39.715 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_ptrace", 2023-08-10T11:26:39.715 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.715 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.715 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.715 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.716 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.716 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.716 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.716 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-08-10T11:26:39.716 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-08-10T11:26:39.716 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.717 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.717 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_interval": { 2023-08-10T11:26:39.717 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_interval", 2023-08-10T11:26:39.717 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.717 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.718 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.718 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:39.718 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.718 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.718 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.718 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to autotune daemon memory", 2023-08-10T11:26:39.719 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.719 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_memory_target_ratio": { 2023-08-10T11:26:39.719 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_memory_target_ratio", 2023-08-10T11:26:39.719 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:39.720 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.720 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.720 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.7", 2023-08-10T11:26:39.720 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.720 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.720 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.720 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-08-10T11:26:39.721 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.721 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.721 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.721 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { 2023-08-10T11:26:39.721 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", 2023-08-10T11:26:39.721 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.722 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.722 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.722 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.722 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.722 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.722 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.722 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-08-10T11:26:39.722 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "config_checks_enabled": { 2023-08-10T11:26:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_checks_enabled", 2023-08-10T11:26:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.723 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.724 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.724 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.724 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.724 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.724 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.724 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-08-10T11:26:39.724 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.725 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.725 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.725 INFO:teuthology.orchestra.run.smithi107.stdout: "config_dashboard": { 2023-08-10T11:26:39.725 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_dashboard", 2023-08-10T11:26:39.725 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.725 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.726 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.726 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.726 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.726 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.726 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.726 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-08-10T11:26:39.726 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.727 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.727 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.727 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { 2023-08-10T11:26:39.727 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2023-08-10T11:26:39.727 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.727 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.728 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-08-10T11:26:39.728 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.728 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.728 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.728 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:39.728 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.728 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.729 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.729 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_base": { 2023-08-10T11:26:39.729 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_base", 2023-08-10T11:26:39.729 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.729 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.729 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.730 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/ceph", 2023-08-10T11:26:39.730 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.730 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.730 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.730 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Container image name, without the tag", 2023-08-10T11:26:39.730 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.730 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.731 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.731 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_elasticsearch": { 2023-08-10T11:26:39.731 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_elasticsearch", 2023-08-10T11:26:39.731 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.731 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.731 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.732 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-08-10T11:26:39.732 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.732 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.732 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.732 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "elasticsearch container image", 2023-08-10T11:26:39.732 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.732 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.732 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.733 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_grafana": { 2023-08-10T11:26:39.733 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_grafana", 2023-08-10T11:26:39.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.733 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.733 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-08-10T11:26:39.734 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.734 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.734 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.734 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:39.734 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.734 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.734 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.735 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_haproxy": { 2023-08-10T11:26:39.735 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_haproxy", 2023-08-10T11:26:39.735 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.735 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.736 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-10T11:26:39.736 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.736 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.736 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.736 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "HAproxy container image", 2023-08-10T11:26:39.736 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.736 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.736 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.737 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_agent": { 2023-08-10T11:26:39.737 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_agent", 2023-08-10T11:26:39.737 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.737 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.737 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.737 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-08-10T11:26:39.738 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.738 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.738 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.738 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger agent container image", 2023-08-10T11:26:39.738 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.738 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.738 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.739 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_collector": { 2023-08-10T11:26:39.739 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_collector", 2023-08-10T11:26:39.739 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.739 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.739 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.739 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-08-10T11:26:39.740 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.740 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.740 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.740 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger collector container image", 2023-08-10T11:26:39.740 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.740 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.740 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.741 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_query": { 2023-08-10T11:26:39.741 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_query", 2023-08-10T11:26:39.741 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.741 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.741 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.741 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-08-10T11:26:39.741 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.742 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.742 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.742 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger query container image", 2023-08-10T11:26:39.742 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.742 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.742 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_keepalived": { 2023-08-10T11:26:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_keepalived", 2023-08-10T11:26:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-08-10T11:26:39.743 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.744 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.744 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.744 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Keepalived container image", 2023-08-10T11:26:39.744 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.744 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.744 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.745 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_loki": { 2023-08-10T11:26:39.745 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_loki", 2023-08-10T11:26:39.745 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.745 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.745 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.745 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-08-10T11:26:39.745 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.745 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.746 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.746 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Loki container image", 2023-08-10T11:26:39.746 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.746 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.746 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.746 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_node_exporter": { 2023-08-10T11:26:39.747 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_node_exporter", 2023-08-10T11:26:39.747 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.747 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.747 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.747 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-08-10T11:26:39.747 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.747 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.748 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.748 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:39.748 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.748 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.748 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.748 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_prometheus": { 2023-08-10T11:26:39.749 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_prometheus", 2023-08-10T11:26:39.749 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.749 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.749 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.749 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-08-10T11:26:39.749 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.749 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.749 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.750 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:39.750 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.750 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.750 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.750 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_promtail": { 2023-08-10T11:26:39.750 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_promtail", 2023-08-10T11:26:39.751 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.751 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.751 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.751 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-08-10T11:26:39.751 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.751 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.751 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.752 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Promtail container image", 2023-08-10T11:26:39.752 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.752 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.752 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.752 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_snmp_gateway": { 2023-08-10T11:26:39.752 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_snmp_gateway", 2023-08-10T11:26:39.753 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.753 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.753 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.753 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-08-10T11:26:39.753 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.753 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.753 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.754 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SNMP Gateway container image", 2023-08-10T11:26:39.754 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.754 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.754 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.754 INFO:teuthology.orchestra.run.smithi107.stdout: "container_init": { 2023-08-10T11:26:39.754 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_init", 2023-08-10T11:26:39.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.755 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.755 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.755 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.755 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.755 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.755 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.755 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Run podman/docker with `--init`", 2023-08-10T11:26:39.756 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.756 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.756 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.756 INFO:teuthology.orchestra.run.smithi107.stdout: "daemon_cache_timeout": { 2023-08-10T11:26:39.756 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "daemon_cache_timeout", 2023-08-10T11:26:39.756 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.757 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.757 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.757 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:39.757 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.757 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.757 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.757 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-08-10T11:26:39.758 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.758 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.758 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.758 INFO:teuthology.orchestra.run.smithi107.stdout: "default_cephadm_command_timeout": { 2023-08-10T11:26:39.758 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_cephadm_command_timeout", 2023-08-10T11:26:39.759 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.759 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.759 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.759 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "900", 2023-08-10T11:26:39.759 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.759 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.759 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.759 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-08-10T11:26:39.760 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.760 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.760 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.760 INFO:teuthology.orchestra.run.smithi107.stdout: "default_registry": { 2023-08-10T11:26:39.760 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_registry", 2023-08-10T11:26:39.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.761 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.761 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.761 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io", 2023-08-10T11:26:39.761 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.761 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.761 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.761 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-08-10T11:26:39.762 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.762 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.762 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.762 INFO:teuthology.orchestra.run.smithi107.stdout: "device_cache_timeout": { 2023-08-10T11:26:39.762 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_cache_timeout", 2023-08-10T11:26:39.762 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1800", 2023-08-10T11:26:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.763 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.764 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.764 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache device inventory", 2023-08-10T11:26:39.764 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.764 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.764 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.765 INFO:teuthology.orchestra.run.smithi107.stdout: "device_enhanced_scan": { 2023-08-10T11:26:39.765 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_enhanced_scan", 2023-08-10T11:26:39.765 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.765 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.765 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.765 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.765 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.765 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.766 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.766 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use libstoragemgmt during device scans", 2023-08-10T11:26:39.766 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.766 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.766 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.766 INFO:teuthology.orchestra.run.smithi107.stdout: "facts_cache_timeout": { 2023-08-10T11:26:39.766 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "facts_cache_timeout", 2023-08-10T11:26:39.767 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.767 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.767 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.767 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:39.767 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.767 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.767 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.768 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", 2023-08-10T11:26:39.768 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.768 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.768 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.768 INFO:teuthology.orchestra.run.smithi107.stdout: "host_check_interval": { 2023-08-10T11:26:39.768 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "host_check_interval", 2023-08-10T11:26:39.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.769 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.769 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.769 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:39.769 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.769 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.769 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.769 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to perform a host check", 2023-08-10T11:26:39.769 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.770 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.770 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.770 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:39.770 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:39.770 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.770 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.770 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.771 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.771 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.771 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.771 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.771 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.771 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.771 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.773 INFO:teuthology.orchestra.run.smithi107.stdout: "log_refresh_metadata": { 2023-08-10T11:26:39.773 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_refresh_metadata", 2023-08-10T11:26:39.773 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.773 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.773 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.773 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.773 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.774 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.774 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.774 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-08-10T11:26:39.774 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.774 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.774 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.774 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:39.775 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:39.775 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.775 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.775 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.775 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.775 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.775 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.775 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.776 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-08-10T11:26:39.776 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.776 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.776 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.776 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:39.776 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:39.777 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.777 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.777 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.777 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:39.777 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.777 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.777 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.777 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.779 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.779 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.779 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:39.779 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:39.779 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.779 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.779 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.780 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.780 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.780 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.780 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.780 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.780 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.780 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.780 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.781 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf": { 2023-08-10T11:26:39.781 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-08-10T11:26:39.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.781 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.781 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-08-10T11:26:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.782 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-08-10T11:26:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-08-10T11:26:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.783 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "*", 2023-08-10T11:26:39.784 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.784 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.784 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.784 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-08-10T11:26:39.784 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.784 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.784 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.785 INFO:teuthology.orchestra.run.smithi107.stdout: "max_count_per_host": { 2023-08-10T11:26:39.785 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_count_per_host", 2023-08-10T11:26:39.785 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.785 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.785 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.785 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:39.785 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.785 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.786 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.786 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of daemons per service per host", 2023-08-10T11:26:39.786 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.786 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.786 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.786 INFO:teuthology.orchestra.run.smithi107.stdout: "max_osd_draining_count": { 2023-08-10T11:26:39.786 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_osd_draining_count", 2023-08-10T11:26:39.787 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.787 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.787 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.787 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:39.787 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.787 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.787 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.787 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-08-10T11:26:39.788 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.788 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.788 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.788 INFO:teuthology.orchestra.run.smithi107.stdout: "migration_current": { 2023-08-10T11:26:39.788 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", 2023-08-10T11:26:39.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.789 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.789 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.789 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.789 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.789 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.789 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.789 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "internal - do not modify", 2023-08-10T11:26:39.789 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.790 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.790 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.790 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2023-08-10T11:26:39.790 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2023-08-10T11:26:39.790 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.790 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.790 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.791 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "root", 2023-08-10T11:26:39.791 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.791 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.791 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.791 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm-package", 2023-08-10T11:26:39.791 INFO:teuthology.orchestra.run.smithi107.stdout: "root" 2023-08-10T11:26:39.791 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.792 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "mode for remote execution of cephadm", 2023-08-10T11:26:39.792 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.792 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.792 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.792 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_alerts_path": { 2023-08-10T11:26:39.792 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_alerts_path", 2023-08-10T11:26:39.792 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.793 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.793 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.793 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-08-10T11:26:39.793 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.793 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.793 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.793 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-08-10T11:26:39.793 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.794 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.794 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.794 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_web_password": { 2023-08-10T11:26:39.794 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_web_password", 2023-08-10T11:26:39.794 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.794 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.795 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:39.795 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.795 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.795 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.795 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus web password", 2023-08-10T11:26:39.795 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.795 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.796 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.796 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_web_user": { 2023-08-10T11:26:39.796 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_web_user", 2023-08-10T11:26:39.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.796 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.796 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:39.797 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.797 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.797 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.797 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus web user", 2023-08-10T11:26:39.797 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.797 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.797 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_insecure": { 2023-08-10T11:26:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_insecure", 2023-08-10T11:26:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.799 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.799 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-08-10T11:26:39.799 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.799 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.799 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.799 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_password": { 2023-08-10T11:26:39.800 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_password", 2023-08-10T11:26:39.800 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.800 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.800 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.800 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.800 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.800 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.800 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.801 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-08-10T11:26:39.801 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.801 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.801 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.801 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_url": { 2023-08-10T11:26:39.801 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_url", 2023-08-10T11:26:39.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-08-10T11:26:39.802 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.803 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.803 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.803 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_username": { 2023-08-10T11:26:39.803 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_username", 2023-08-10T11:26:39.803 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.803 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.803 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.804 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.804 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.804 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.804 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.804 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-08-10T11:26:39.804 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.804 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.805 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.805 INFO:teuthology.orchestra.run.smithi107.stdout: "secure_monitoring_stack": { 2023-08-10T11:26:39.805 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", 2023-08-10T11:26:39.805 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.805 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.805 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.806 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.806 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.806 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.806 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.806 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-08-10T11:26:39.806 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.806 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.806 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.807 INFO:teuthology.orchestra.run.smithi107.stdout: "service_discovery_port": { 2023-08-10T11:26:39.807 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "service_discovery_port", 2023-08-10T11:26:39.807 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.807 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.807 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.807 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8765", 2023-08-10T11:26:39.807 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.808 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.808 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.808 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "cephadm service discovery port", 2023-08-10T11:26:39.808 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.808 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.808 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.808 INFO:teuthology.orchestra.run.smithi107.stdout: "ssh_config_file": { 2023-08-10T11:26:39.809 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssh_config_file", 2023-08-10T11:26:39.809 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.809 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.809 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.809 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.809 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.809 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.810 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.810 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-08-10T11:26:39.810 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.810 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.810 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { 2023-08-10T11:26:39.810 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", 2023-08-10T11:26:39.811 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.811 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.811 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.811 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.811 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.811 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.811 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.811 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-08-10T11:26:39.812 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.812 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.812 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.812 INFO:teuthology.orchestra.run.smithi107.stdout: "use_repo_digest": { 2023-08-10T11:26:39.812 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_repo_digest", 2023-08-10T11:26:39.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.812 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.813 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.813 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.813 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.813 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.813 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.813 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-08-10T11:26:39.813 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.814 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.814 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.814 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_failed_host_check": { 2023-08-10T11:26:39.814 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_failed_host_check", 2023-08-10T11:26:39.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.814 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.815 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.815 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.815 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.815 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.815 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if the host check fails", 2023-08-10T11:26:39.815 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.815 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.815 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.816 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_daemons": { 2023-08-10T11:26:39.816 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_daemons", 2023-08-10T11:26:39.816 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.816 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.816 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.816 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.816 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.817 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.817 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.817 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-08-10T11:26:39.817 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.817 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.817 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.818 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_hosts": { 2023-08-10T11:26:39.818 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_hosts", 2023-08-10T11:26:39.818 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.818 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.818 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.818 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.818 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.818 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.819 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.819 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-08-10T11:26:39.819 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.819 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.819 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.820 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crash", 2023-08-10T11:26:39.820 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:39.820 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:39.820 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:39.820 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:39.820 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:39.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.821 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.821 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.821 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.821 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.821 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.821 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.821 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.822 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.823 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.824 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.824 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.824 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.824 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.824 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.824 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.824 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.824 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.825 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:39.825 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:39.825 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.825 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.825 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.825 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:39.825 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.826 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.826 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.826 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.826 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.826 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.826 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.826 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.826 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.827 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.827 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.827 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.827 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.827 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.827 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:39.828 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:39.828 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.828 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.828 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.828 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.828 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.828 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.829 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.829 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.829 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.829 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.829 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.829 INFO:teuthology.orchestra.run.smithi107.stdout: "retain_interval": { 2023-08-10T11:26:39.829 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retain_interval", 2023-08-10T11:26:39.830 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.830 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.830 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.830 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "31536000", 2023-08-10T11:26:39.830 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.830 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain crashes before pruning them", 2023-08-10T11:26:39.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.831 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.831 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.831 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { 2023-08-10T11:26:39.831 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", 2023-08-10T11:26:39.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.831 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.832 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1209600", 2023-08-10T11:26:39.832 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.832 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.832 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.832 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "time interval in which to warn about recent crashes", 2023-08-10T11:26:39.832 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dashboard", 2023-08-10T11:26:39.833 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-08-10T11:26:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-08-10T11:26:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.834 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_HOST": { 2023-08-10T11:26:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_HOST", 2023-08-10T11:26:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.836 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-08-10T11:26:39.837 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-08-10T11:26:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.838 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_ENABLED": { 2023-08-10T11:26:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_ENABLED", 2023-08-10T11:26:39.839 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-08-10T11:26:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-08-10T11:26:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.842 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "ENABLE_BROWSABLE_API": { 2023-08-10T11:26:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ENABLE_BROWSABLE_API", 2023-08-10T11:26:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.843 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-08-10T11:26:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-08-10T11:26:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.845 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-08-10T11:26:39.846 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-08-10T11:26:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.848 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.848 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.848 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.848 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-08-10T11:26:39.848 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-08-10T11:26:39.848 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.848 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.849 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.849 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.849 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.849 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.849 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.849 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.849 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.850 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.850 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.850 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-08-10T11:26:39.850 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-08-10T11:26:39.850 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.850 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.851 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.851 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.851 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.851 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.851 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.851 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.851 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.852 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.852 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_NFS": { 2023-08-10T11:26:39.852 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-08-10T11:26:39.852 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.852 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.852 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.852 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.853 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.853 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.853 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.853 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.853 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.853 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.853 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.854 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RBD": { 2023-08-10T11:26:39.854 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-08-10T11:26:39.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.854 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.854 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.854 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.854 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.855 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.855 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.855 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.855 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.855 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.855 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RGW": { 2023-08-10T11:26:39.856 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-08-10T11:26:39.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.856 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.856 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.856 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.856 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.856 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.856 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.857 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.857 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.857 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.857 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.857 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-08-10T11:26:39.857 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-10T11:26:39.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.858 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.858 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.858 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.858 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.858 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.858 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.858 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.859 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.859 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.859 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.859 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_PASSWORD": { 2023-08-10T11:26:39.859 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_PASSWORD", 2023-08-10T11:26:39.859 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.859 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.860 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.860 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:39.860 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.860 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.860 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.860 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.860 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.860 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.861 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.861 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-08-10T11:26:39.861 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-08-10T11:26:39.861 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.861 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.861 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.861 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.862 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2023-08-10T11:26:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_URL", 2023-08-10T11:26:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.863 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.864 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.864 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.864 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.864 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.864 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.864 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.864 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_USERNAME": { 2023-08-10T11:26:39.865 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_USERNAME", 2023-08-10T11:26:39.865 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.865 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.865 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.865 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:39.865 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.865 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.865 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.866 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.866 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.866 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.866 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.866 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-08-10T11:26:39.866 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-08-10T11:26:39.867 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.867 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.867 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.867 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.867 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.867 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.867 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.867 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.868 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.868 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.868 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.868 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-08-10T11:26:39.868 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-08-10T11:26:39.868 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.868 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.869 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.869 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.869 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.869 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.869 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.869 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.869 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.869 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.870 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.870 INFO:teuthology.orchestra.run.smithi107.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-08-10T11:26:39.870 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-08-10T11:26:39.870 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.870 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.870 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.870 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.871 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.871 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.871 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.871 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.871 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.871 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.871 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.872 INFO:teuthology.orchestra.run.smithi107.stdout: "ISSUE_TRACKER_API_KEY": { 2023-08-10T11:26:39.872 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-08-10T11:26:39.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.872 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.872 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.872 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.872 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.873 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.873 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.873 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.873 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.873 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.873 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_HOST": { 2023-08-10T11:26:39.874 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_HOST", 2023-08-10T11:26:39.874 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.874 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.874 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.874 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.874 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.874 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.874 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.875 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.875 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.875 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.875 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.875 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-08-10T11:26:39.875 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-08-10T11:26:39.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.876 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.876 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.876 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.876 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.876 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.876 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.877 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.877 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.877 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.877 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-08-10T11:26:39.877 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-08-10T11:26:39.877 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.877 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.878 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.878 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.878 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.878 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.878 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.878 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.878 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.878 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.879 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.879 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-08-10T11:26:39.879 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-08-10T11:26:39.879 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.879 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.879 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.879 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.880 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.880 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.880 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.880 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.880 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.880 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.880 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.881 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-08-10T11:26:39.881 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-08-10T11:26:39.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.881 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.881 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.881 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.882 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-08-10T11:26:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-08-10T11:26:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.883 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.884 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.884 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.884 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.884 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.884 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-08-10T11:26:39.884 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-08-10T11:26:39.885 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.885 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.885 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.885 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.885 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.885 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.885 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.885 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.886 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.886 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.886 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.886 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-08-10T11:26:39.886 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-08-10T11:26:39.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.886 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.887 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.887 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.887 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.887 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.887 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.887 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.887 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.887 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.888 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.888 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-08-10T11:26:39.888 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-08-10T11:26:39.888 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.888 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.889 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.889 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.889 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.889 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.889 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.889 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.889 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.889 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.890 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_ENABLED": { 2023-08-10T11:26:39.890 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_ENABLED", 2023-08-10T11:26:39.890 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.890 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.890 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.890 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.890 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.891 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.891 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.891 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.891 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.891 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.891 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.891 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-08-10T11:26:39.892 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-08-10T11:26:39.892 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.892 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.892 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.892 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-08-10T11:26:39.892 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.892 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.893 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.893 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.893 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.893 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.893 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.893 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-08-10T11:26:39.893 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-08-10T11:26:39.894 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.894 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.894 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.894 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:39.894 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.894 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.894 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.894 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-08-10T11:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-08-10T11:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.895 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8", 2023-08-10T11:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.896 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout: "REST_REQUESTS_TIMEOUT": { 2023-08-10T11:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-08-10T11:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.897 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "45", 2023-08-10T11:26:39.898 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.898 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.898 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.898 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.898 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.898 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.898 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.899 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ACCESS_KEY": { 2023-08-10T11:26:39.899 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ACCESS_KEY", 2023-08-10T11:26:39.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.899 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.899 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.900 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.900 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.900 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.900 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.900 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.900 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.900 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.901 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-08-10T11:26:39.901 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-08-10T11:26:39.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.901 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.901 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.901 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:39.901 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.901 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SECRET_KEY": { 2023-08-10T11:26:39.902 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SECRET_KEY", 2023-08-10T11:26:39.903 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.903 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.903 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.903 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.903 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.903 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.903 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.904 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.904 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.904 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.904 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.904 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SSL_VERIFY": { 2023-08-10T11:26:39.904 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SSL_VERIFY", 2023-08-10T11:26:39.904 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.905 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.905 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.905 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.905 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.905 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.905 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.905 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.905 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.906 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.906 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.906 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-08-10T11:26:39.906 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-08-10T11:26:39.906 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.906 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.906 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.907 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:39.907 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.907 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.907 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.907 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.907 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.907 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.907 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.908 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-08-10T11:26:39.908 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-08-10T11:26:39.908 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.908 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.908 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.908 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:39.908 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.909 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.909 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.909 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.909 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.909 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.909 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.910 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-08-10T11:26:39.910 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-08-10T11:26:39.910 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.910 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.910 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.910 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:39.910 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.910 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.911 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.911 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.911 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.911 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.911 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.911 INFO:teuthology.orchestra.run.smithi107.stdout: "cross_origin_url": { 2023-08-10T11:26:39.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cross_origin_url", 2023-08-10T11:26:39.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.912 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.912 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.912 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.912 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.912 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.912 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.912 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.913 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.913 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.913 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.913 INFO:teuthology.orchestra.run.smithi107.stdout: "crt_file": { 2023-08-10T11:26:39.913 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crt_file", 2023-08-10T11:26:39.913 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.913 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.914 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.914 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.914 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.914 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.914 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.914 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.914 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.914 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.915 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.915 INFO:teuthology.orchestra.run.smithi107.stdout: "debug": { 2023-08-10T11:26:39.915 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "debug", 2023-08-10T11:26:39.915 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.915 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.915 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.915 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.916 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.916 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.916 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.916 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable/disable debug options", 2023-08-10T11:26:39.916 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.916 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.916 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.917 INFO:teuthology.orchestra.run.smithi107.stdout: "jwt_token_ttl": { 2023-08-10T11:26:39.917 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "jwt_token_ttl", 2023-08-10T11:26:39.917 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.917 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.917 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "28800", 2023-08-10T11:26:39.917 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.918 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.918 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.918 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.918 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.918 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.918 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2023-08-10T11:26:39.919 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2023-08-10T11:26:39.919 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.919 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.919 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.919 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.919 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.919 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.919 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.920 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.920 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.920 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.920 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.920 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:39.920 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:39.920 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.921 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.921 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.921 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.921 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.921 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.921 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.921 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.923 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.923 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.923 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:39.923 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:39.923 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.923 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.924 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.924 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.924 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.924 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.924 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.924 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.924 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.924 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.925 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.925 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:39.925 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:39.925 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.925 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.925 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.925 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:39.926 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.926 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.926 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.926 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.926 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.926 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.926 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.926 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.927 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.927 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.927 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.927 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.927 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.927 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.927 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:39.928 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:39.928 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.928 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.928 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.928 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.928 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.928 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.929 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.929 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.929 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.929 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.929 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.929 INFO:teuthology.orchestra.run.smithi107.stdout: "motd": { 2023-08-10T11:26:39.929 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "motd", 2023-08-10T11:26:39.930 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.930 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.930 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.930 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.930 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.930 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.930 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "The message of the day", 2023-08-10T11:26:39.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.931 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.931 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect_resolve_ip_addr": { 2023-08-10T11:26:39.931 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "redirect_resolve_ip_addr", 2023-08-10T11:26:39.931 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.931 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.932 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.932 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.932 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.932 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.932 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.932 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.932 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.932 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.933 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.933 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2023-08-10T11:26:39.933 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2023-08-10T11:26:39.933 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.933 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.933 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.933 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2023-08-10T11:26:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.935 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2023-08-10T11:26:39.935 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2023-08-10T11:26:39.935 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.935 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.935 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2023-08-10T11:26:39.935 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.936 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.936 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.936 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.936 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.936 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.936 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.936 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2023-08-10T11:26:39.937 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2023-08-10T11:26:39.937 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.937 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.937 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.937 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.937 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.937 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.937 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.938 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.938 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.938 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.938 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.938 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl_server_port": { 2023-08-10T11:26:39.938 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl_server_port", 2023-08-10T11:26:39.938 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.939 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.939 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8443", 2023-08-10T11:26:39.939 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.939 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.939 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.939 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.939 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.940 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.940 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.940 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2023-08-10T11:26:39.940 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2023-08-10T11:26:39.940 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.940 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.940 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.941 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "redirect", 2023-08-10T11:26:39.941 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.941 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.941 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.941 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.941 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect" 2023-08-10T11:26:39.941 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.941 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2023-08-10T11:26:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2023-08-10T11:26:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.942 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.943 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.943 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2023-08-10T11:26:39.943 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2023-08-10T11:26:39.943 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2023-08-10T11:26:39.943 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.943 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.943 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.943 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.944 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.944 INFO:teuthology.orchestra.run.smithi107.stdout: "url_prefix": { 2023-08-10T11:26:39.944 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url_prefix", 2023-08-10T11:26:39.944 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.944 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.945 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.945 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.945 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.945 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.945 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.945 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.945 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.945 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.946 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.946 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.946 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", 2023-08-10T11:26:39.946 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:39.946 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:39.946 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:39.947 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_monitoring": { 2023-08-10T11:26:39.947 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_monitoring", 2023-08-10T11:26:39.947 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.947 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.947 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.947 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.947 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.948 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.948 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.948 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "monitor device health metrics", 2023-08-10T11:26:39.948 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.948 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.948 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.948 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:39.949 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:39.949 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.949 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.949 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.949 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.949 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.949 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.949 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.950 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.950 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.950 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.950 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.950 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.950 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.950 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.950 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.951 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.951 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.951 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:39.951 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:39.951 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.951 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.952 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.952 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.952 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.952 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.952 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.952 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.952 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.953 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.953 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.953 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:39.953 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:39.953 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.953 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.953 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.954 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:39.954 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.954 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.954 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.954 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.954 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.954 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.954 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.955 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.955 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.955 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.955 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.955 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.955 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.955 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.956 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:39.956 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:39.956 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.956 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.956 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.956 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.956 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.956 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.957 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.957 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.957 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.957 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.957 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.957 INFO:teuthology.orchestra.run.smithi107.stdout: "mark_out_threshold": { 2023-08-10T11:26:39.957 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mark_out_threshold", 2023-08-10T11:26:39.958 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.958 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.958 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.958 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2419200", 2023-08-10T11:26:39.958 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.958 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.958 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.958 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-08-10T11:26:39.959 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.959 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.959 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.959 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_name": { 2023-08-10T11:26:39.959 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_name", 2023-08-10T11:26:39.959 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.959 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.960 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.960 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "device_health_metrics", 2023-08-10T11:26:39.960 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.960 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.960 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.960 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name of pool in which to store device health metrics", 2023-08-10T11:26:39.960 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { 2023-08-10T11:26:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2023-08-10T11:26:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.961 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15552000", 2023-08-10T11:26:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain device health metrics", 2023-08-10T11:26:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.962 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.963 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_frequency": { 2023-08-10T11:26:39.963 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_frequency", 2023-08-10T11:26:39.963 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.963 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.963 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.963 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2023-08-10T11:26:39.963 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.964 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.964 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.964 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to scrape device health metrics", 2023-08-10T11:26:39.964 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.964 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.964 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.964 INFO:teuthology.orchestra.run.smithi107.stdout: "self_heal": { 2023-08-10T11:26:39.965 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "self_heal", 2023-08-10T11:26:39.965 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.965 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.965 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.965 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:39.965 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.965 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.965 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.966 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-08-10T11:26:39.966 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.966 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.966 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.966 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:39.966 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:39.966 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.967 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.967 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.967 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:39.967 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.967 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.967 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.967 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and check device health", 2023-08-10T11:26:39.967 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.968 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.968 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.968 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_threshold": { 2023-08-10T11:26:39.968 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_threshold", 2023-08-10T11:26:39.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.968 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.969 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7257600", 2023-08-10T11:26:39.969 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.969 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.969 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.969 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-08-10T11:26:39.969 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.969 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.969 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.970 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "diskprediction_local", 2023-08-10T11:26:39.970 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:39.970 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:39.971 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:39.971 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:39.971 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:39.971 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.971 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.971 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.971 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.971 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.972 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.972 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.972 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.972 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.972 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.972 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.972 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.973 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.973 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.973 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.973 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.973 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.973 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.973 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:39.973 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:39.974 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.974 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.974 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.974 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.974 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.974 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.974 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.975 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.975 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.975 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.975 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.975 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:39.975 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:39.975 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.976 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.976 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.976 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:39.976 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.976 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.976 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.976 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.976 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.977 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.977 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.977 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.977 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.977 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.977 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.977 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.977 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.978 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.978 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:39.978 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:39.978 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.978 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.978 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.978 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.979 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.979 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.979 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.979 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.979 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.979 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.979 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.980 INFO:teuthology.orchestra.run.smithi107.stdout: "predict_interval": { 2023-08-10T11:26:39.980 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predict_interval", 2023-08-10T11:26:39.980 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.980 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.980 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.980 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2023-08-10T11:26:39.980 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.980 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "predictor_model": { 2023-08-10T11:26:39.981 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predictor_model", 2023-08-10T11:26:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "prophetstor", 2023-08-10T11:26:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.982 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.983 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.983 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.983 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.983 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:39.983 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:39.983 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.983 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.984 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.984 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:39.984 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.984 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.984 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.984 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.984 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.985 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.985 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.985 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.985 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:39.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:39.985 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "influx", 2023-08-10T11:26:39.985 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": false, 2023-08-10T11:26:39.986 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "influxdb python module not found", 2023-08-10T11:26:39.986 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:39.986 INFO:teuthology.orchestra.run.smithi107.stdout: "batch_size": { 2023-08-10T11:26:39.986 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "batch_size", 2023-08-10T11:26:39.986 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:39.986 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.986 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.986 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", 2023-08-10T11:26:39.987 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.987 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.987 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.987 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-08-10T11:26:39.987 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.987 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.987 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.988 INFO:teuthology.orchestra.run.smithi107.stdout: "database": { 2023-08-10T11:26:39.988 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "database", 2023-08-10T11:26:39.988 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.988 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.988 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.988 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "ceph", 2023-08-10T11:26:39.988 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.989 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.989 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.989 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-08-10T11:26:39.989 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.989 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.989 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.989 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": { 2023-08-10T11:26:39.990 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "hostname", 2023-08-10T11:26:39.990 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.990 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.990 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.990 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.990 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.990 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.990 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.991 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server hostname", 2023-08-10T11:26:39.991 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.991 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:39.991 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:39.991 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:39.992 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.992 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:39.992 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", 2023-08-10T11:26:39.992 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2023-08-10T11:26:39.992 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.992 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.992 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-08-10T11:26:39.992 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.993 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.993 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.993 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:39.993 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:39.993 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.993 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.993 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.994 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:39.994 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.994 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.994 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.994 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.994 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.994 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.995 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.995 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.995 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.995 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:39.995 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.995 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.995 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.995 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.996 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:39.996 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:39.996 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:39.996 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.996 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.996 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:39.997 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.997 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.997 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:39.997 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:39.997 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:39.997 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:39.997 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:39.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:39.998 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:39.998 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:39.998 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:39.998 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:39.998 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:39.998 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:39.998 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:39.998 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:39.999 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:39.999 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:39.999 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:39.999 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:39.999 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:39.999 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:39.999 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:39.999 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.000 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.000 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.000 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.000 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.000 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.000 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.000 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.001 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.002 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.002 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.002 INFO:teuthology.orchestra.run.smithi107.stdout: "password": { 2023-08-10T11:26:40.002 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "password", 2023-08-10T11:26:40.002 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.002 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.003 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.003 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.003 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.003 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.003 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.003 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "password of InfluxDB server user", 2023-08-10T11:26:40.003 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.003 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.004 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.004 INFO:teuthology.orchestra.run.smithi107.stdout: "port": { 2023-08-10T11:26:40.004 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "port", 2023-08-10T11:26:40.004 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.004 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.004 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.004 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8086", 2023-08-10T11:26:40.005 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.005 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.005 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.005 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2023-08-10T11:26:40.005 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.005 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.005 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.006 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2023-08-10T11:26:40.006 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2023-08-10T11:26:40.006 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.006 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.006 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.006 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "false", 2023-08-10T11:26:40.006 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.006 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.007 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.007 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T11:26:40.007 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.007 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.007 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.007 INFO:teuthology.orchestra.run.smithi107.stdout: "threads": { 2023-08-10T11:26:40.007 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threads", 2023-08-10T11:26:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "32", 2023-08-10T11:26:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-08-10T11:26:40.009 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.009 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.009 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.009 INFO:teuthology.orchestra.run.smithi107.stdout: "username": { 2023-08-10T11:26:40.009 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "username", 2023-08-10T11:26:40.009 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.009 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.010 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.010 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.010 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.010 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.010 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.010 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "username of InfluxDB server user", 2023-08-10T11:26:40.010 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.010 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.011 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.011 INFO:teuthology.orchestra.run.smithi107.stdout: "verify_ssl": { 2023-08-10T11:26:40.011 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "verify_ssl", 2023-08-10T11:26:40.011 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.011 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.011 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.011 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "true", 2023-08-10T11:26:40.012 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.012 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.012 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.012 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T11:26:40.012 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.012 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.012 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.013 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.013 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.013 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "insights", 2023-08-10T11:26:40.013 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.013 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.013 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.014 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.014 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.014 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.014 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.014 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.014 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.014 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.014 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.015 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.015 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.015 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.015 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.015 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.015 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.015 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.015 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.016 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.016 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.016 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.016 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.016 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.016 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.016 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.017 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.017 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.017 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.017 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.017 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.017 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.017 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.017 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.018 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.018 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.018 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.018 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.018 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.018 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.019 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.019 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.019 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.019 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.019 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.019 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.019 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.019 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.020 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.020 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.020 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.020 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.020 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.020 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.020 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.020 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.021 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.021 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.021 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.021 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.021 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.021 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.021 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.022 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.023 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "iostat", 2023-08-10T11:26:40.023 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.023 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.023 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.023 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.023 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.024 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.024 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.024 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.024 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.024 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.024 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.024 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.025 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.025 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.025 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.025 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.025 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.025 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.025 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.025 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.026 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.026 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.026 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.026 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.026 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.026 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.026 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.027 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.027 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.027 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.027 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.027 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.027 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.027 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.027 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.028 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.028 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.028 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.028 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.028 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.028 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.028 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.029 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.029 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.029 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.029 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.029 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.029 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.029 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.029 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.030 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.030 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.030 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.030 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.030 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.030 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.030 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.031 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.031 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.031 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.031 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.031 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.031 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.031 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.031 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.032 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.032 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.032 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.032 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.033 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "k8sevents", 2023-08-10T11:26:40.033 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.033 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.033 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.033 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_event_retention_days": { 2023-08-10T11:26:40.033 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ceph_event_retention_days", 2023-08-10T11:26:40.033 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.033 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.034 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.034 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7", 2023-08-10T11:26:40.034 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.034 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Days to hold ceph event information within local cache", 2023-08-10T11:26:40.034 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.034 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.035 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.035 INFO:teuthology.orchestra.run.smithi107.stdout: "config_check_secs": { 2023-08-10T11:26:40.035 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_check_secs", 2023-08-10T11:26:40.035 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.035 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.035 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.035 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.036 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "10", 2023-08-10T11:26:40.036 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.036 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.036 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-08-10T11:26:40.036 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.036 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.036 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.037 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.037 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.037 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.037 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.037 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.037 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.037 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.037 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.038 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.038 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.038 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.038 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.038 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.038 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.038 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.038 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.039 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.039 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.039 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.039 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.039 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.039 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.039 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.040 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.040 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.040 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.040 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.040 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.040 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.040 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.040 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.041 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.041 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.041 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.041 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.041 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.041 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.041 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.042 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.042 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.042 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.042 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.042 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.042 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.042 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.042 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.044 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.044 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.044 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.044 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.044 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.044 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.044 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.045 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.045 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.045 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.045 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.045 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.045 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.045 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.045 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.046 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "localpool", 2023-08-10T11:26:40.046 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.046 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.046 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.046 INFO:teuthology.orchestra.run.smithi107.stdout: "failure_domain": { 2023-08-10T11:26:40.046 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "failure_domain", 2023-08-10T11:26:40.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.047 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.047 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.047 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "host", 2023-08-10T11:26:40.047 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.047 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.047 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.047 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "failure domain for any created local pool", 2023-08-10T11:26:40.048 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-08-10T11:26:40.048 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.048 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.048 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.048 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.048 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.049 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.049 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.049 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.049 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.049 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.049 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.049 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.049 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.050 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.050 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.050 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.050 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.050 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.050 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.050 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.050 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.051 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.051 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.051 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.051 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.051 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.051 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.051 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.052 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.052 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.052 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.052 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.052 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.052 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.052 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "min_size": { 2023-08-10T11:26:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_size", 2023-08-10T11:26:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default min_size for any created local pool", 2023-08-10T11:26:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-08-10T11:26:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "num_rep": { 2023-08-10T11:26:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "num_rep", 2023-08-10T11:26:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3", 2023-08-10T11:26:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default replica count for any created local pool", 2023-08-10T11:26:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_num": { 2023-08-10T11:26:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_num", 2023-08-10T11:26:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "128", 2023-08-10T11:26:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default pg_num for any created local pool", 2023-08-10T11:26:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "prefix": { 2023-08-10T11:26:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prefix", 2023-08-10T11:26:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name prefix for any created local pool", 2023-08-10T11:26:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { 2023-08-10T11:26:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2023-08-10T11:26:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "rack", 2023-08-10T11:26:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "CRUSH level for which to create a local pool", 2023-08-10T11:26:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-08-10T11:26:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mds_autoscaler", 2023-08-10T11:26:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirroring", 2023-08-10T11:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "nfs", 2023-08-10T11:26:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2023-08-10T11:26:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "fail_fs": { 2023-08-10T11:26:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "fail_fs", 2023-08-10T11:26:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-08-10T11:26:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator": { 2023-08-10T11:26:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2023-08-10T11:26:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm", 2023-08-10T11:26:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "rook", 2023-08-10T11:26:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "test_orchestrator" 2023-08-10T11:26:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Orchestrator backend", 2023-08-10T11:26:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_perf_query", 2023-08-10T11:26:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_support", 2023-08-10T11:26:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_autoscaler", 2023-08-10T11:26:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "noautoscale": { 2023-08-10T11:26:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "noautoscale", 2023-08-10T11:26:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "global autoscale flag", 2023-08-10T11:26:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-08-10T11:26:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "threshold": { 2023-08-10T11:26:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threshold", 2023-08-10T11:26:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2023-08-10T11:26:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1.0", 2023-08-10T11:26:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", 2023-08-10T11:26:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-08-10T11:26:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.146 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "progress", 2023-08-10T11:26:40.146 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.146 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.146 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.146 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_pg_recovery_event": { 2023-08-10T11:26:40.147 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_pg_recovery_event", 2023-08-10T11:26:40.147 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.147 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.147 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.147 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.147 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.147 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.148 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.148 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow the module to show pg recovery progress", 2023-08-10T11:26:40.148 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.148 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.148 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.148 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2023-08-10T11:26:40.148 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2023-08-10T11:26:40.149 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.149 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.149 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.149 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.149 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.149 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.149 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.150 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.150 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.150 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.150 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.150 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.150 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.150 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.151 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.151 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.151 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.151 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.151 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.151 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.151 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.151 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.152 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.152 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.152 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.152 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.152 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.152 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.152 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.152 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.153 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.153 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.153 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.153 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.153 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.153 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.154 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.154 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.154 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.154 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.154 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.154 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.154 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.154 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.155 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.155 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.155 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.155 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.155 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.155 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.155 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.156 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.156 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.156 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.156 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.156 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.156 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.156 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.156 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.157 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.157 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.157 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.157 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.157 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.157 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.158 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.158 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.158 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.158 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.158 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.158 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.158 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.158 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.159 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.159 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.159 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.159 INFO:teuthology.orchestra.run.smithi107.stdout: "max_completed_events": { 2023-08-10T11:26:40.159 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_completed_events", 2023-08-10T11:26:40.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.159 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.160 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.160 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "50", 2023-08-10T11:26:40.160 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.160 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.160 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.160 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "number of past completed events to remember", 2023-08-10T11:26:40.160 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.161 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.161 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.161 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:40.161 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:40.161 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.161 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.161 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.162 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:40.162 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.162 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.162 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.162 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long the module is going to sleep", 2023-08-10T11:26:40.162 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.162 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.162 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.163 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus", 2023-08-10T11:26:40.163 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.163 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.163 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "cache": { 2023-08-10T11:26:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cache", 2023-08-10T11:26:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.164 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.165 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.165 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.165 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.165 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.165 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.165 INFO:teuthology.orchestra.run.smithi107.stdout: "exclude_perf_counters": { 2023-08-10T11:26:40.166 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "exclude_perf_counters", 2023-08-10T11:26:40.166 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.166 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.166 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.166 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.166 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.166 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.166 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.167 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-08-10T11:26:40.167 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-08-10T11:26:40.167 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.167 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.167 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.167 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.168 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.168 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.168 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.168 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.168 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.168 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.168 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.168 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.169 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.169 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.169 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.169 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.169 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.169 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.169 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.170 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.170 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.170 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.170 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.170 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.170 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.170 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.172 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.172 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.172 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.172 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.172 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.172 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.172 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.173 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.173 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.173 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.173 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.173 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.173 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.173 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.173 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.174 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.174 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.174 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.174 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.174 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.174 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.174 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.175 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.175 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.175 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.175 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.175 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.175 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.175 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.176 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.176 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.176 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.176 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.176 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.176 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools": { 2023-08-10T11:26:40.176 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools", 2023-08-10T11:26:40.177 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.177 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.177 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.177 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.177 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.177 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.177 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.177 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.178 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.178 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.178 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.178 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools_refresh_interval": { 2023-08-10T11:26:40.178 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-08-10T11:26:40.178 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.178 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.179 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.179 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", 2023-08-10T11:26:40.179 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.179 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.179 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.179 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.179 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.180 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.180 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.180 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_interval": { 2023-08-10T11:26:40.180 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_interval", 2023-08-10T11:26:40.180 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.180 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.180 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.181 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15.0", 2023-08-10T11:26:40.181 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.181 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.181 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.181 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.181 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.181 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.181 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.182 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2023-08-10T11:26:40.182 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2023-08-10T11:26:40.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.182 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.182 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2023-08-10T11:26:40.182 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.183 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.183 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.183 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-08-10T11:26:40.183 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.183 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.183 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.184 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2023-08-10T11:26:40.184 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2023-08-10T11:26:40.184 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.184 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.184 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.184 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", 2023-08-10T11:26:40.184 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.184 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.185 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.185 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-08-10T11:26:40.185 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.185 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.185 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.185 INFO:teuthology.orchestra.run.smithi107.stdout: "stale_cache_strategy": { 2023-08-10T11:26:40.185 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stale_cache_strategy", 2023-08-10T11:26:40.186 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.186 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.186 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.186 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "log", 2023-08-10T11:26:40.186 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.186 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.186 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.187 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.187 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.187 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.187 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.187 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2023-08-10T11:26:40.187 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2023-08-10T11:26:40.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.188 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.188 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.188 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "default", 2023-08-10T11:26:40.188 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.188 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.188 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.188 INFO:teuthology.orchestra.run.smithi107.stdout: "default", 2023-08-10T11:26:40.188 INFO:teuthology.orchestra.run.smithi107.stdout: "error" 2023-08-10T11:26:40.189 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.189 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.189 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.189 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.189 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.189 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2023-08-10T11:26:40.190 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2023-08-10T11:26:40.190 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.190 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.190 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.190 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2023-08-10T11:26:40.190 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2023-08-10T11:26:40.190 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2023-08-10T11:26:40.190 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.191 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.191 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.191 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.191 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.192 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_support", 2023-08-10T11:26:40.192 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.192 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.192 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.192 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.192 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.193 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.193 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.193 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.193 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.193 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.193 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.194 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.194 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.194 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.194 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.194 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.194 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.194 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.194 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.195 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.195 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.195 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.195 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.195 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.195 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.195 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.196 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.196 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.196 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.196 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.196 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.196 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.196 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.197 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.197 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.197 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.197 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.197 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.197 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.197 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.198 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.198 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.198 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.198 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.198 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.199 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.199 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.199 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.199 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.199 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.199 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.200 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.200 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.200 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.200 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.200 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.200 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.200 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.200 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_snap_create": { 2023-08-10T11:26:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_snap_create", 2023-08-10T11:26:40.202 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.202 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.202 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.202 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.202 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.202 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.202 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "mirror_snapshot_schedule": { 2023-08-10T11:26:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirror_snapshot_schedule", 2023-08-10T11:26:40.203 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.204 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.205 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.205 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.205 INFO:teuthology.orchestra.run.smithi107.stdout: "trash_purge_schedule": { 2023-08-10T11:26:40.205 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", 2023-08-10T11:26:40.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.205 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.206 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.206 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.206 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.206 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.206 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.206 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.206 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.206 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.207 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.207 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "restful", 2023-08-10T11:26:40.207 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.207 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.208 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.208 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_auth": { 2023-08-10T11:26:40.208 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_auth", 2023-08-10T11:26:40.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.208 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.208 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.208 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.208 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.209 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.209 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.209 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.209 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.209 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.209 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.209 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2023-08-10T11:26:40.210 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2023-08-10T11:26:40.210 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.210 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.210 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.210 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.210 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.210 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.211 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.212 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.212 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.212 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.212 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.212 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.212 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.212 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.212 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.213 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.213 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.213 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.213 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.213 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.213 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.213 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.213 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.214 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.214 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.214 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.214 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.214 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.214 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.215 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.215 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.215 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.215 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.215 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.215 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.215 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.215 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.216 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.216 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.216 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.216 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.217 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.217 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.217 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.217 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.217 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.217 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.217 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.218 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.218 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.218 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.218 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.218 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.218 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.218 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.218 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.219 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.219 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.219 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.219 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.219 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.219 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.219 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.220 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.220 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.220 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.220 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.220 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.220 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.220 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.221 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2023-08-10T11:26:40.221 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2023-08-10T11:26:40.221 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.221 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.221 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.221 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.221 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.222 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.222 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.222 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.222 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.222 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.222 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.222 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2023-08-10T11:26:40.223 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2023-08-10T11:26:40.223 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.223 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.223 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.223 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.223 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.223 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.223 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.225 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rgw", 2023-08-10T11:26:40.225 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.225 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.225 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.225 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.225 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.225 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.226 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.226 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.226 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.226 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.226 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.226 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.226 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.226 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.227 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.227 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.227 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.227 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.227 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.227 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.227 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.227 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.228 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.228 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.228 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.228 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.228 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.228 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.229 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.229 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.229 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.229 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.229 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.229 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.230 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.230 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.230 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.230 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.230 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.230 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.230 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.231 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.231 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.231 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.231 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.231 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.231 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.231 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.231 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.232 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.232 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.232 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.232 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.232 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.232 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.233 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.233 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.233 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.233 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.233 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.233 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.233 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.233 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.234 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.234 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.234 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.234 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.235 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rook", 2023-08-10T11:26:40.235 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.235 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.235 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.235 INFO:teuthology.orchestra.run.smithi107.stdout: "drive_group_interval": { 2023-08-10T11:26:40.235 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "drive_group_interval", 2023-08-10T11:26:40.235 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.235 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.236 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.236 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300.0", 2023-08-10T11:26:40.236 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.236 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.236 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.236 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-08-10T11:26:40.236 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.237 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.237 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.237 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.237 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.237 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.237 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.238 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.238 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.238 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.238 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.238 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.238 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.238 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.238 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.239 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.239 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.239 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.239 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.239 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.239 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.240 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.240 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.240 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.240 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.240 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.240 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.240 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.241 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.241 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.241 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.241 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.241 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.241 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.241 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.242 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.242 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.242 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.242 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.242 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.242 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.242 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.243 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.244 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.245 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.245 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.245 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.245 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.245 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.245 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.245 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.245 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: "storage_class": { 2023-08-10T11:26:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "storage_class", 2023-08-10T11:26:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.247 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.247 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "local", 2023-08-10T11:26:40.247 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.247 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.247 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.247 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-08-10T11:26:40.247 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.247 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.248 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.248 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "selftest", 2023-08-10T11:26:40.248 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.249 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.249 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.249 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.249 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.249 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.249 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.249 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.249 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.250 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.250 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.250 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.250 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.250 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.250 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.250 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.250 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.251 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.251 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.251 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.251 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.251 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.251 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.251 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.252 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.252 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.252 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.252 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.252 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.252 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.252 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.252 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.253 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.253 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.253 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.253 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.253 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.253 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.254 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.254 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.254 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.254 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.254 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.254 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.254 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.254 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.255 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.255 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.255 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.255 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.255 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.255 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.255 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.255 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.256 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.256 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.256 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.256 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.256 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.256 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.257 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.257 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.257 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.257 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.257 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.257 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.257 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.257 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.258 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.258 INFO:teuthology.orchestra.run.smithi107.stdout: "roption1": { 2023-08-10T11:26:40.258 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption1", 2023-08-10T11:26:40.258 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.258 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.258 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.258 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.259 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.259 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.259 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.259 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.259 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.259 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.260 INFO:teuthology.orchestra.run.smithi107.stdout: "roption2": { 2023-08-10T11:26:40.260 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption2", 2023-08-10T11:26:40.260 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.260 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.260 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.260 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "xyz", 2023-08-10T11:26:40.260 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.261 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.261 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.261 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.261 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.261 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.261 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.261 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption1": { 2023-08-10T11:26:40.262 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption1", 2023-08-10T11:26:40.262 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.262 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.262 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.262 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.262 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.262 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.262 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.263 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.263 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.263 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.263 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.263 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption2": { 2023-08-10T11:26:40.263 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption2", 2023-08-10T11:26:40.263 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.264 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption3": { 2023-08-10T11:26:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption3", 2023-08-10T11:26:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.265 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.266 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.266 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.266 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.266 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.266 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.266 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.266 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.266 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.267 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.267 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption4": { 2023-08-10T11:26:40.267 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption4", 2023-08-10T11:26:40.267 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.267 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.267 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.268 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.268 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.268 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.268 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.268 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.268 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.268 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.269 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.269 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption5": { 2023-08-10T11:26:40.269 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption5", 2023-08-10T11:26:40.269 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.269 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.269 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.269 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.270 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.270 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.270 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.270 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.270 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.270 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.270 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.271 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption6": { 2023-08-10T11:26:40.271 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption6", 2023-08-10T11:26:40.271 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.271 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.271 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.271 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.271 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.271 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.272 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.272 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.272 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.272 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.272 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.272 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption7": { 2023-08-10T11:26:40.273 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption7", 2023-08-10T11:26:40.273 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.273 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.273 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.273 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.273 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:40.273 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "42", 2023-08-10T11:26:40.273 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.274 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.274 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.274 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.274 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.274 INFO:teuthology.orchestra.run.smithi107.stdout: "testkey": { 2023-08-10T11:26:40.274 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testkey", 2023-08-10T11:26:40.275 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.275 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.275 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.275 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.275 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.275 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.275 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.275 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.276 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.276 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.276 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.276 INFO:teuthology.orchestra.run.smithi107.stdout: "testlkey": { 2023-08-10T11:26:40.276 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testlkey", 2023-08-10T11:26:40.276 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.276 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.277 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.277 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.277 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.277 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.277 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.277 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.277 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.278 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.278 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.278 INFO:teuthology.orchestra.run.smithi107.stdout: "testnewline": { 2023-08-10T11:26:40.278 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testnewline", 2023-08-10T11:26:40.278 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.278 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.278 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.279 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.279 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.279 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.279 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.279 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.279 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.280 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snap_schedule", 2023-08-10T11:26:40.280 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.280 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.281 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.281 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_m_granularity": { 2023-08-10T11:26:40.281 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_m_granularity", 2023-08-10T11:26:40.281 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.281 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.281 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.281 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.281 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.282 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.282 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.282 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow minute scheduled snapshots", 2023-08-10T11:26:40.282 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.282 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.282 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.282 INFO:teuthology.orchestra.run.smithi107.stdout: "dump_on_update": { 2023-08-10T11:26:40.283 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dump_on_update", 2023-08-10T11:26:40.283 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.283 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.283 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.283 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.283 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.283 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.283 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "dump database to debug log on update", 2023-08-10T11:26:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.284 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.285 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.286 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.286 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.286 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.286 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.286 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.286 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.286 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.286 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.287 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.287 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.287 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.287 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.287 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.287 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.287 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.288 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.288 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.288 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.288 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.288 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.288 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.288 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.288 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.289 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.289 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.289 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.289 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.289 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.289 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.290 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.290 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.290 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.290 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.290 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.290 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.290 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.290 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.291 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.291 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.291 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.291 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.291 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.291 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.291 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.292 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.292 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.292 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.292 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.292 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.292 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.292 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.293 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.293 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.293 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.293 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.293 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.293 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.293 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.294 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stats", 2023-08-10T11:26:40.294 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.294 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.294 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.294 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.294 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.294 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.295 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.295 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.295 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.295 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.295 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.295 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.295 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.295 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.296 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.296 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.296 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.296 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.296 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.296 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.296 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.296 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.297 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.297 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.297 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.297 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.297 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.297 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.297 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.298 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.298 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.298 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.298 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.298 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.298 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.298 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.299 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.299 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.299 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.299 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.299 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.299 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.299 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.300 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.300 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.300 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.300 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.300 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.300 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.301 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.301 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.301 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.301 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.301 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.301 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.301 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.302 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.302 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.302 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.302 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.302 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.302 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.302 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.302 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.303 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.303 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.303 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.303 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "status", 2023-08-10T11:26:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.304 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.305 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.305 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.305 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.305 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.305 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.305 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.305 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.305 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.306 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.306 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.306 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.306 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.306 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.306 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.306 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.306 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.307 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.307 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.307 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.307 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.307 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.307 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.307 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.308 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.308 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.308 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.308 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.308 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.308 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.308 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.309 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.309 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.309 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.309 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.309 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.309 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.309 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.309 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.310 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.310 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.310 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.310 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.310 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.310 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.310 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.310 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.311 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.311 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.311 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.311 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.311 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.311 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.312 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.312 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.312 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.312 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.312 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.312 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.312 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.312 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.313 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.313 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.313 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.313 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.313 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telegraf", 2023-08-10T11:26:40.313 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.314 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.314 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.314 INFO:teuthology.orchestra.run.smithi107.stdout: "address": { 2023-08-10T11:26:40.314 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "address", 2023-08-10T11:26:40.314 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.314 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.314 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.314 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-08-10T11:26:40.315 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.315 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.315 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.315 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.315 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.315 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.315 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.316 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:40.316 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:40.316 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.316 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.316 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.316 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15", 2023-08-10T11:26:40.316 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.317 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.317 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.317 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.317 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.317 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.317 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.317 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.318 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.318 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.318 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.318 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.318 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.318 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.318 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.319 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.319 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.319 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.319 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.319 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.319 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.319 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.319 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.320 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.320 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.320 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.320 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.320 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.320 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.321 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.322 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.323 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.324 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.325 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.325 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.325 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.325 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.325 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.325 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.325 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.326 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telemetry", 2023-08-10T11:26:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.327 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.328 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_basic": { 2023-08-10T11:26:40.328 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_basic", 2023-08-10T11:26:40.328 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.328 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.328 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.328 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.328 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.328 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.329 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.329 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share basic cluster information (size, version)", 2023-08-10T11:26:40.329 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.329 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.329 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.329 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_crash": { 2023-08-10T11:26:40.329 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_crash", 2023-08-10T11:26:40.330 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.330 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.330 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.330 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.331 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-08-10T11:26:40.331 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.331 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.331 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.331 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_device": { 2023-08-10T11:26:40.331 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_device", 2023-08-10T11:26:40.331 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.332 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.332 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.332 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.332 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.332 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.332 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.332 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-08-10T11:26:40.333 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.333 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.333 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.333 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_ident": { 2023-08-10T11:26:40.333 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_ident", 2023-08-10T11:26:40.333 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.333 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.334 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.334 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.334 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.334 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.334 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.334 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-08-10T11:26:40.334 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.334 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.335 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.335 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_perf": { 2023-08-10T11:26:40.335 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_perf", 2023-08-10T11:26:40.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.335 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.335 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.336 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.336 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.336 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.336 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share various performance metrics of a cluster", 2023-08-10T11:26:40.336 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.336 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.336 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.337 INFO:teuthology.orchestra.run.smithi107.stdout: "contact": { 2023-08-10T11:26:40.337 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "contact", 2023-08-10T11:26:40.337 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.337 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.337 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.337 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.337 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.338 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.338 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.338 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.338 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.338 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.338 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.338 INFO:teuthology.orchestra.run.smithi107.stdout: "description": { 2023-08-10T11:26:40.339 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "description", 2023-08-10T11:26:40.339 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.339 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.339 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.339 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.339 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.339 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.340 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.340 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.340 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.340 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.340 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.340 INFO:teuthology.orchestra.run.smithi107.stdout: "device_url": { 2023-08-10T11:26:40.340 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_url", 2023-08-10T11:26:40.341 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.341 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.341 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.341 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-08-10T11:26:40.341 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.341 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.341 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.342 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.342 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.342 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.342 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.342 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2023-08-10T11:26:40.342 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2023-08-10T11:26:40.342 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.343 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.345 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.345 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "24", 2023-08-10T11:26:40.345 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "8", 2023-08-10T11:26:40.345 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.345 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.345 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.345 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.345 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.346 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.346 INFO:teuthology.orchestra.run.smithi107.stdout: "last_opt_revision": { 2023-08-10T11:26:40.346 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "last_opt_revision", 2023-08-10T11:26:40.346 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.346 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.347 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1", 2023-08-10T11:26:40.347 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.347 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.347 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.347 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.347 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.347 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.347 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.348 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard": { 2023-08-10T11:26:40.348 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard", 2023-08-10T11:26:40.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.348 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.348 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.349 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.349 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.349 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.349 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.349 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.350 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.350 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.350 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard_description": { 2023-08-10T11:26:40.350 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard_description", 2023-08-10T11:26:40.351 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.351 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.351 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.351 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.351 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.351 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.351 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.352 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.352 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.352 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.352 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.352 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.352 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.352 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.353 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.353 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.353 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.353 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.353 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.353 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.353 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.353 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.354 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.354 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.354 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.354 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.354 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.354 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.354 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.355 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.355 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.355 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.355 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.355 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.355 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.355 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.356 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.356 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.356 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.356 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.356 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.356 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.356 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.356 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.357 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.357 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.357 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.357 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.357 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.357 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.357 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.358 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.358 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.358 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.358 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.358 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.358 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.358 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.359 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.359 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.359 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.359 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.359 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.359 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.359 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.360 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.360 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.360 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.360 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.360 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.360 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.360 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.360 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.361 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.361 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.361 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.361 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.361 INFO:teuthology.orchestra.run.smithi107.stdout: "organization": { 2023-08-10T11:26:40.361 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "organization", 2023-08-10T11:26:40.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.362 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.362 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.362 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.362 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.362 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.362 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.362 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "proxy": { 2023-08-10T11:26:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "proxy", 2023-08-10T11:26:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.363 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.364 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.365 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.365 INFO:teuthology.orchestra.run.smithi107.stdout: "url": { 2023-08-10T11:26:40.365 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url", 2023-08-10T11:26:40.365 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.365 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.365 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.365 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-08-10T11:26:40.366 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.366 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.366 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.366 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.366 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.366 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.366 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.367 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "test_orchestrator", 2023-08-10T11:26:40.367 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.367 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.367 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.368 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.368 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.368 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.368 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.368 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.368 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.368 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.369 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.369 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.369 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.369 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.369 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.369 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.369 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.369 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.370 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.370 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.370 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.370 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.371 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.371 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.371 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.371 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.371 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.371 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.371 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.372 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.372 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.372 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.372 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.372 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.372 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.372 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.374 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.375 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.375 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.375 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.375 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.375 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.375 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.376 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.376 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.376 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.376 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.376 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.376 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.376 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.376 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.377 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "volumes", 2023-08-10T11:26:40.377 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.377 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.377 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.378 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.378 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.378 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.378 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.378 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.378 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.378 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.378 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.379 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.379 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.379 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.379 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.379 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.379 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.379 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.380 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.380 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.380 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.380 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.380 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.380 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.380 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.381 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.381 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.381 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.381 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.381 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.381 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.381 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.381 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.382 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.382 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.382 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.382 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.382 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.382 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.382 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.383 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.384 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.384 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.384 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.384 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.384 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.384 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.384 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.384 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.385 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.385 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.385 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.385 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.385 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.385 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.386 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.386 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.386 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.386 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.386 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.386 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.386 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.387 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_clones": { 2023-08-10T11:26:40.387 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_clones", 2023-08-10T11:26:40.387 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.387 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.387 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.387 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4", 2023-08-10T11:26:40.387 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.387 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Number of asynchronous cloner threads", 2023-08-10T11:26:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: "snapshot_clone_delay": { 2023-08-10T11:26:40.388 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snapshot_clone_delay", 2023-08-10T11:26:40.389 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.389 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.389 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.389 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:40.389 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.389 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.389 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.389 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-08-10T11:26:40.390 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.390 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.390 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.390 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.390 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.391 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix", 2023-08-10T11:26:40.391 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.391 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.391 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.391 INFO:teuthology.orchestra.run.smithi107.stdout: "discovery_interval": { 2023-08-10T11:26:40.391 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "discovery_interval", 2023-08-10T11:26:40.391 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:40.391 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.392 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.392 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "100", 2023-08-10T11:26:40.392 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.392 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.392 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.392 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.392 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.392 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.393 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.393 INFO:teuthology.orchestra.run.smithi107.stdout: "identifier": { 2023-08-10T11:26:40.393 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "identifier", 2023-08-10T11:26:40.393 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.393 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.393 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.394 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.394 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.394 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.394 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.394 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.394 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.394 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.394 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.395 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:40.395 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:40.395 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.395 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.395 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:40.395 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.396 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.396 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.396 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.396 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.396 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.396 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.397 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.397 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.397 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.397 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.397 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.397 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.397 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.397 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.398 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.398 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.398 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.398 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.398 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.398 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.398 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.398 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.399 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.399 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.399 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.399 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.399 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.399 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.399 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.400 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.400 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.400 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.400 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.400 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.400 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.401 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.401 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.401 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.401 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.401 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.401 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.401 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.402 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.403 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.404 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.404 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.404 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.404 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.404 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.405 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.405 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.405 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.405 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.405 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.405 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.405 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.406 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_host": { 2023-08-10T11:26:40.406 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_host", 2023-08-10T11:26:40.406 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.406 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.406 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.406 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.406 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.406 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.407 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.407 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.407 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.407 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.407 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.407 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_port": { 2023-08-10T11:26:40.408 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_port", 2023-08-10T11:26:40.408 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.408 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.408 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.408 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10051", 2023-08-10T11:26:40.408 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.408 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.408 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.409 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.409 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.409 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.409 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.409 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_sender": { 2023-08-10T11:26:40.409 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_sender", 2023-08-10T11:26:40.409 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.410 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.410 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.410 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-08-10T11:26:40.410 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.410 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.411 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.411 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.411 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:40.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.412 INFO:teuthology.orchestra.run.smithi107.stdout: "gid": 25477, 2023-08-10T11:26:40.412 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "z", 2023-08-10T11:26:40.412 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr_features": 4540138322906710015, 2023-08-10T11:26:40.412 INFO:teuthology.orchestra.run.smithi107.stdout: "available_modules": [ 2023-08-10T11:26:40.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.412 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alerts", 2023-08-10T11:26:40.412 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.413 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.413 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.413 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:40.413 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:40.413 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.413 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.413 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.413 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:40.414 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.414 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.414 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.414 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How frequently to reexamine health status", 2023-08-10T11:26:40.414 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.414 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.414 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.415 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.415 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.415 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.415 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.415 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.415 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.415 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.415 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_destination": { 2023-08-10T11:26:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_destination", 2023-08-10T11:26:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email address to send alerts to", 2023-08-10T11:26:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_from_name": { 2023-08-10T11:26:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_from_name", 2023-08-10T11:26:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "Ceph", 2023-08-10T11:26:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email From: name", 2023-08-10T11:26:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_host": { 2023-08-10T11:26:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_host", 2023-08-10T11:26:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP server", 2023-08-10T11:26:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_password": { 2023-08-10T11:26:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_password", 2023-08-10T11:26:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.430 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.430 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.430 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.430 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.430 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.430 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Password to authenticate with", 2023-08-10T11:26:40.430 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.431 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.431 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_port": { 2023-08-10T11:26:40.431 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_port", 2023-08-10T11:26:40.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.431 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.431 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.431 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "465", 2023-08-10T11:26:40.432 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.432 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.432 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.432 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP port", 2023-08-10T11:26:40.432 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.432 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.432 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.433 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_sender": { 2023-08-10T11:26:40.433 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_sender", 2023-08-10T11:26:40.433 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.433 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.433 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.433 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.433 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.434 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.434 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.434 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP envelope sender", 2023-08-10T11:26:40.434 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.434 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.434 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.434 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_ssl": { 2023-08-10T11:26:40.435 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_ssl", 2023-08-10T11:26:40.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.435 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.435 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.435 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.435 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.435 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.436 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use SSL to connect to SMTP server", 2023-08-10T11:26:40.436 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.436 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.436 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.436 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_user": { 2023-08-10T11:26:40.436 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_user", 2023-08-10T11:26:40.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.437 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.437 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.437 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.437 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.437 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.437 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.437 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "User to authenticate as", 2023-08-10T11:26:40.438 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.438 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.438 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.438 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "balancer", 2023-08-10T11:26:40.439 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.439 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.439 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.439 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2023-08-10T11:26:40.439 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "active", 2023-08-10T11:26:40.439 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.439 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.439 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.440 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.440 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.440 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.440 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.440 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically balance PGs across cluster", 2023-08-10T11:26:40.440 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.440 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.441 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.441 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_time": { 2023-08-10T11:26:40.441 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_time", 2023-08-10T11:26:40.441 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.441 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.441 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.441 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0000", 2023-08-10T11:26:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "beginning time of day to automatically balance", 2023-08-10T11:26:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T11:26:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.443 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_weekday": { 2023-08-10T11:26:40.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_weekday", 2023-08-10T11:26:40.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:40.443 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.443 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.443 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:40.443 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2023-08-10T11:26:40.444 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2023-08-10T11:26:40.444 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.444 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-08-10T11:26:40.444 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T11:26:40.444 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.444 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.445 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_max_iterations": { 2023-08-10T11:26:40.445 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_max_iterations", 2023-08-10T11:26:40.445 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:40.445 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.445 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.445 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "25", 2023-08-10T11:26:40.445 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:40.445 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "250", 2023-08-10T11:26:40.446 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.446 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-08-10T11:26:40.446 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.446 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.446 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.446 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_metrics": { 2023-08-10T11:26:40.446 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_metrics", 2023-08-10T11:26:40.447 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.447 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.447 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.447 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "pgs,objects,bytes", 2023-08-10T11:26:40.447 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.447 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.447 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.448 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-08-10T11:26:40.448 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-08-10T11:26:40.448 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.448 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.448 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_step": { 2023-08-10T11:26:40.448 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_step", 2023-08-10T11:26:40.448 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.449 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.449 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.449 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.5", 2023-08-10T11:26:40.449 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0.001", 2023-08-10T11:26:40.449 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "0.999", 2023-08-10T11:26:40.449 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.449 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "aggressiveness of optimization", 2023-08-10T11:26:40.450 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-08-10T11:26:40.450 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.450 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.450 INFO:teuthology.orchestra.run.smithi107.stdout: "end_time": { 2023-08-10T11:26:40.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_time", 2023-08-10T11:26:40.450 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.450 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.451 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.451 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2359", 2023-08-10T11:26:40.451 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.451 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.451 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.451 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ending time of day to automatically balance", 2023-08-10T11:26:40.451 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T11:26:40.451 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.452 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.452 INFO:teuthology.orchestra.run.smithi107.stdout: "end_weekday": { 2023-08-10T11:26:40.452 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", 2023-08-10T11:26:40.452 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:40.452 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.452 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.452 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:40.453 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2023-08-10T11:26:40.453 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2023-08-10T11:26:40.453 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.453 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-08-10T11:26:40.453 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T11:26:40.453 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.453 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.454 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.454 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.454 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.454 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.454 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.454 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.454 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.454 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.455 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.455 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.455 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.455 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.455 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.455 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.455 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.456 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.456 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.456 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.456 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.456 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.456 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.456 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.457 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.457 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.457 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.457 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.457 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.457 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.457 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.457 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.458 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.458 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.458 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.458 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.458 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.458 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.458 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.459 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.459 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.459 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.459 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.459 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.459 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.459 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.459 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.460 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.460 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.460 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.460 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.460 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.460 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.460 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.461 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.461 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.461 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.461 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.461 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.461 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.461 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min_score": { 2023-08-10T11:26:40.463 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_score", 2023-08-10T11:26:40.463 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.463 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:40.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.463 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.464 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.464 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-08-10T11:26:40.464 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.464 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.464 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.464 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2023-08-10T11:26:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2023-08-10T11:26:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", 2023-08-10T11:26:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.465 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.466 INFO:teuthology.orchestra.run.smithi107.stdout: "crush-compat", 2023-08-10T11:26:40.466 INFO:teuthology.orchestra.run.smithi107.stdout: "none", 2023-08-10T11:26:40.466 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap" 2023-08-10T11:26:40.466 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.466 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Balancer mode", 2023-08-10T11:26:40.466 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.466 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.466 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.467 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_ids": { 2023-08-10T11:26:40.467 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_ids", 2023-08-10T11:26:40.467 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.467 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.467 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.467 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.467 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.468 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.468 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.468 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-08-10T11:26:40.468 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.468 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.468 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.468 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:40.469 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:40.469 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.469 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.469 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.469 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:40.469 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.469 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.470 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.470 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-08-10T11:26:40.470 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.470 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.470 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.470 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_deviation": { 2023-08-10T11:26:40.470 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_deviation", 2023-08-10T11:26:40.471 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.471 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.471 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.471 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:40.471 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:40.471 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.471 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.471 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "deviation below which no optimization is attempted", 2023-08-10T11:26:40.472 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-08-10T11:26:40.472 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.472 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.472 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_optimizations": { 2023-08-10T11:26:40.472 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_optimizations", 2023-08-10T11:26:40.472 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:40.473 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.473 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.473 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.473 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.473 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.473 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.473 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-08-10T11:26:40.473 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.474 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.474 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.474 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephadm", 2023-08-10T11:26:40.474 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.475 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.475 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.475 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_down_multiplier": { 2023-08-10T11:26:40.475 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_down_multiplier", 2023-08-10T11:26:40.475 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.475 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.475 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.475 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2023-08-10T11:26:40.476 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.476 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.476 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.476 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-08-10T11:26:40.476 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.476 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.476 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.477 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_refresh_rate": { 2023-08-10T11:26:40.477 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_refresh_rate", 2023-08-10T11:26:40.477 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.477 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.477 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.477 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "20", 2023-08-10T11:26:40.477 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.477 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.478 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.478 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-08-10T11:26:40.478 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.478 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.478 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.478 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_starting_port": { 2023-08-10T11:26:40.478 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_starting_port", 2023-08-10T11:26:40.479 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.479 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.479 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.479 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4721", 2023-08-10T11:26:40.479 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.479 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.479 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.480 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-08-10T11:26:40.480 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.480 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.480 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.480 INFO:teuthology.orchestra.run.smithi107.stdout: "alertmanager_web_password": { 2023-08-10T11:26:40.480 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alertmanager_web_password", 2023-08-10T11:26:40.480 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.481 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.481 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.481 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:40.481 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.481 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.481 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.481 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Alertmanager web password", 2023-08-10T11:26:40.481 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "alertmanager_web_user": { 2023-08-10T11:26:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alertmanager_web_user", 2023-08-10T11:26:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.483 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:40.483 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.483 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.483 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.483 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Alertmanager web user", 2023-08-10T11:26:40.483 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.483 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.484 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.484 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_ptrace": { 2023-08-10T11:26:40.484 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_ptrace", 2023-08-10T11:26:40.484 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.484 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.484 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.484 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-08-10T11:26:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-08-10T11:26:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.486 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_interval": { 2023-08-10T11:26:40.486 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_interval", 2023-08-10T11:26:40.486 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.486 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.486 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.486 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:40.486 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.486 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.487 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.487 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to autotune daemon memory", 2023-08-10T11:26:40.487 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.487 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.487 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.487 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_memory_target_ratio": { 2023-08-10T11:26:40.488 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_memory_target_ratio", 2023-08-10T11:26:40.488 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.488 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.488 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.488 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.7", 2023-08-10T11:26:40.488 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.488 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.489 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.489 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-08-10T11:26:40.489 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.489 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.489 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.489 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { 2023-08-10T11:26:40.489 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", 2023-08-10T11:26:40.490 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.490 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.490 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.490 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.490 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.490 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.490 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.490 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-08-10T11:26:40.491 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.491 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.491 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.491 INFO:teuthology.orchestra.run.smithi107.stdout: "config_checks_enabled": { 2023-08-10T11:26:40.491 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_checks_enabled", 2023-08-10T11:26:40.491 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.491 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.492 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.492 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.492 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.492 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.492 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.492 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-08-10T11:26:40.492 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.493 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.493 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.493 INFO:teuthology.orchestra.run.smithi107.stdout: "config_dashboard": { 2023-08-10T11:26:40.493 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_dashboard", 2023-08-10T11:26:40.493 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.493 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.493 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.494 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.494 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.494 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.494 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.494 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-08-10T11:26:40.494 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.494 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.494 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.495 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { 2023-08-10T11:26:40.495 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2023-08-10T11:26:40.495 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.495 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.495 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.495 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-08-10T11:26:40.495 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.496 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.496 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.496 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:40.496 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.496 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.496 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.497 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_base": { 2023-08-10T11:26:40.497 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_base", 2023-08-10T11:26:40.497 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.497 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.497 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.497 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/ceph", 2023-08-10T11:26:40.497 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.498 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.498 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.498 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Container image name, without the tag", 2023-08-10T11:26:40.498 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.498 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.498 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.498 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_elasticsearch": { 2023-08-10T11:26:40.499 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_elasticsearch", 2023-08-10T11:26:40.499 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.499 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.499 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.499 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-08-10T11:26:40.499 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.499 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.499 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.500 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "elasticsearch container image", 2023-08-10T11:26:40.500 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.500 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.500 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.500 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_grafana": { 2023-08-10T11:26:40.500 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_grafana", 2023-08-10T11:26:40.500 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.501 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.501 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.501 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-08-10T11:26:40.501 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.501 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.501 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.501 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_haproxy": { 2023-08-10T11:26:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_haproxy", 2023-08-10T11:26:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.503 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.503 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-10T11:26:40.503 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.503 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.503 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.503 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "HAproxy container image", 2023-08-10T11:26:40.503 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.503 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.504 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.504 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_agent": { 2023-08-10T11:26:40.504 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_agent", 2023-08-10T11:26:40.504 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.504 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.504 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.504 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-08-10T11:26:40.505 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.505 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.505 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.505 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger agent container image", 2023-08-10T11:26:40.505 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.505 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.505 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.506 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_collector": { 2023-08-10T11:26:40.506 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_collector", 2023-08-10T11:26:40.506 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.506 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.506 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.506 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-08-10T11:26:40.506 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.507 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.507 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.507 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger collector container image", 2023-08-10T11:26:40.507 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.507 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.507 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.507 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_query": { 2023-08-10T11:26:40.508 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_query", 2023-08-10T11:26:40.508 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.508 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.508 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.508 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-08-10T11:26:40.508 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.508 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.508 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.509 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger query container image", 2023-08-10T11:26:40.509 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.509 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.509 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.509 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_keepalived": { 2023-08-10T11:26:40.509 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_keepalived", 2023-08-10T11:26:40.509 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.510 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.510 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.510 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-08-10T11:26:40.510 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.510 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.510 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.510 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Keepalived container image", 2023-08-10T11:26:40.511 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.511 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.511 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.511 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_loki": { 2023-08-10T11:26:40.511 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_loki", 2023-08-10T11:26:40.511 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.511 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.512 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.512 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-08-10T11:26:40.512 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.512 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.512 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.512 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Loki container image", 2023-08-10T11:26:40.512 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.512 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.513 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.513 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_node_exporter": { 2023-08-10T11:26:40.513 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_node_exporter", 2023-08-10T11:26:40.513 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.513 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.513 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.514 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-08-10T11:26:40.514 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.514 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.514 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.514 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:40.514 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.514 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.514 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.515 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_prometheus": { 2023-08-10T11:26:40.515 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_prometheus", 2023-08-10T11:26:40.515 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.515 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.515 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.515 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-08-10T11:26:40.515 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.516 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.516 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.516 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:40.516 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.516 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.516 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.517 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_promtail": { 2023-08-10T11:26:40.517 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_promtail", 2023-08-10T11:26:40.517 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.517 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.517 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.517 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-08-10T11:26:40.517 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.517 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.518 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.518 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Promtail container image", 2023-08-10T11:26:40.518 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.518 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.518 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.518 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_snmp_gateway": { 2023-08-10T11:26:40.518 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_snmp_gateway", 2023-08-10T11:26:40.519 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.519 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.519 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.519 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-08-10T11:26:40.519 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.519 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.519 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.519 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SNMP Gateway container image", 2023-08-10T11:26:40.520 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.520 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.520 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.520 INFO:teuthology.orchestra.run.smithi107.stdout: "container_init": { 2023-08-10T11:26:40.520 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_init", 2023-08-10T11:26:40.520 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Run podman/docker with `--init`", 2023-08-10T11:26:40.521 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: "daemon_cache_timeout": { 2023-08-10T11:26:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "daemon_cache_timeout", 2023-08-10T11:26:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.522 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.523 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:40.523 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.523 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.523 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.523 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-08-10T11:26:40.523 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.523 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.523 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.524 INFO:teuthology.orchestra.run.smithi107.stdout: "default_cephadm_command_timeout": { 2023-08-10T11:26:40.524 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_cephadm_command_timeout", 2023-08-10T11:26:40.524 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.524 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.524 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "900", 2023-08-10T11:26:40.524 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.525 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.525 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.525 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-08-10T11:26:40.525 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.525 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.525 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.526 INFO:teuthology.orchestra.run.smithi107.stdout: "default_registry": { 2023-08-10T11:26:40.526 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_registry", 2023-08-10T11:26:40.526 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.526 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.526 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.526 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io", 2023-08-10T11:26:40.526 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.526 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.527 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.527 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-08-10T11:26:40.527 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.527 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.527 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.527 INFO:teuthology.orchestra.run.smithi107.stdout: "device_cache_timeout": { 2023-08-10T11:26:40.527 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_cache_timeout", 2023-08-10T11:26:40.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.528 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.528 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1800", 2023-08-10T11:26:40.528 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.528 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.528 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.528 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache device inventory", 2023-08-10T11:26:40.529 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.529 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.529 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.529 INFO:teuthology.orchestra.run.smithi107.stdout: "device_enhanced_scan": { 2023-08-10T11:26:40.529 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_enhanced_scan", 2023-08-10T11:26:40.529 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.530 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.530 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.530 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.530 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.530 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.530 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.530 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use libstoragemgmt during device scans", 2023-08-10T11:26:40.530 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.531 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.531 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.531 INFO:teuthology.orchestra.run.smithi107.stdout: "facts_cache_timeout": { 2023-08-10T11:26:40.531 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "facts_cache_timeout", 2023-08-10T11:26:40.531 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.531 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.531 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.532 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:40.532 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.532 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.532 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.532 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", 2023-08-10T11:26:40.532 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.532 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.533 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.533 INFO:teuthology.orchestra.run.smithi107.stdout: "host_check_interval": { 2023-08-10T11:26:40.533 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "host_check_interval", 2023-08-10T11:26:40.533 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.533 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.533 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.533 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:40.534 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.534 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.534 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.534 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to perform a host check", 2023-08-10T11:26:40.534 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.534 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.534 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.535 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.535 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.535 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.535 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.535 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.535 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.535 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.535 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.536 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.537 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.537 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.537 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.537 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.537 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.537 INFO:teuthology.orchestra.run.smithi107.stdout: "log_refresh_metadata": { 2023-08-10T11:26:40.537 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_refresh_metadata", 2023-08-10T11:26:40.538 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.538 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.538 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.538 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.538 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.538 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.538 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.538 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-08-10T11:26:40.539 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.539 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.539 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.539 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.539 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.539 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.539 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.540 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.540 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.540 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.540 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.540 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.540 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-08-10T11:26:40.540 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.541 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.542 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.542 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.542 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.542 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.542 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.542 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.542 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.542 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.543 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.543 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.543 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.543 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.543 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.543 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.543 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.544 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.544 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.544 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.544 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.544 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.544 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.545 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.545 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.545 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.545 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.545 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.545 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.545 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf": { 2023-08-10T11:26:40.546 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-08-10T11:26:40.546 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.546 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.546 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.546 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.546 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.546 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.546 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.547 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-08-10T11:26:40.547 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.547 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.547 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.547 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-08-10T11:26:40.547 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-08-10T11:26:40.547 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.548 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.548 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.548 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "*", 2023-08-10T11:26:40.548 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.548 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.548 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.548 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-08-10T11:26:40.549 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.549 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.549 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.549 INFO:teuthology.orchestra.run.smithi107.stdout: "max_count_per_host": { 2023-08-10T11:26:40.549 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_count_per_host", 2023-08-10T11:26:40.549 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.549 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.550 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.550 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.550 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.550 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.550 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.550 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of daemons per service per host", 2023-08-10T11:26:40.550 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.550 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.551 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.551 INFO:teuthology.orchestra.run.smithi107.stdout: "max_osd_draining_count": { 2023-08-10T11:26:40.551 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_osd_draining_count", 2023-08-10T11:26:40.551 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.551 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.551 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.551 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.552 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.552 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.552 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.552 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-08-10T11:26:40.552 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.552 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.552 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.553 INFO:teuthology.orchestra.run.smithi107.stdout: "migration_current": { 2023-08-10T11:26:40.553 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", 2023-08-10T11:26:40.553 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.553 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.553 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.553 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.553 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.554 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.554 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.554 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "internal - do not modify", 2023-08-10T11:26:40.554 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.554 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.554 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.554 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2023-08-10T11:26:40.555 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2023-08-10T11:26:40.555 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.555 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.555 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.555 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "root", 2023-08-10T11:26:40.555 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.555 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.555 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.556 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm-package", 2023-08-10T11:26:40.556 INFO:teuthology.orchestra.run.smithi107.stdout: "root" 2023-08-10T11:26:40.556 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.556 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "mode for remote execution of cephadm", 2023-08-10T11:26:40.556 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.556 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.556 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.557 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_alerts_path": { 2023-08-10T11:26:40.557 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_alerts_path", 2023-08-10T11:26:40.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.557 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.557 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.557 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-08-10T11:26:40.557 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.558 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.558 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.558 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-08-10T11:26:40.558 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.558 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.558 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.559 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_web_password": { 2023-08-10T11:26:40.559 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_web_password", 2023-08-10T11:26:40.559 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.559 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.559 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.559 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:40.559 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.559 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.560 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.560 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus web password", 2023-08-10T11:26:40.560 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.560 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.560 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.560 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_web_user": { 2023-08-10T11:26:40.560 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_web_user", 2023-08-10T11:26:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.561 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus web user", 2023-08-10T11:26:40.562 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.562 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.562 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.562 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_insecure": { 2023-08-10T11:26:40.562 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_insecure", 2023-08-10T11:26:40.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.563 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.563 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.563 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.563 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.563 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.563 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-08-10T11:26:40.563 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.564 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.564 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.564 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_password": { 2023-08-10T11:26:40.564 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_password", 2023-08-10T11:26:40.564 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.564 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.564 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.565 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.565 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.565 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.565 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.565 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-08-10T11:26:40.565 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.565 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.565 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.566 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_url": { 2023-08-10T11:26:40.566 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_url", 2023-08-10T11:26:40.566 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.566 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.566 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.566 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.566 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.567 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.567 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.567 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-08-10T11:26:40.567 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.567 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.567 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.567 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_username": { 2023-08-10T11:26:40.568 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_username", 2023-08-10T11:26:40.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.568 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.568 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.568 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.568 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.569 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.569 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-08-10T11:26:40.569 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.569 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.569 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.569 INFO:teuthology.orchestra.run.smithi107.stdout: "secure_monitoring_stack": { 2023-08-10T11:26:40.569 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", 2023-08-10T11:26:40.570 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.570 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.570 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.570 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.570 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.570 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.570 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.570 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-08-10T11:26:40.571 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.571 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.571 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.571 INFO:teuthology.orchestra.run.smithi107.stdout: "service_discovery_port": { 2023-08-10T11:26:40.571 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "service_discovery_port", 2023-08-10T11:26:40.571 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.571 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.572 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.572 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8765", 2023-08-10T11:26:40.572 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.572 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.572 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.572 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "cephadm service discovery port", 2023-08-10T11:26:40.572 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.573 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.573 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.573 INFO:teuthology.orchestra.run.smithi107.stdout: "ssh_config_file": { 2023-08-10T11:26:40.573 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssh_config_file", 2023-08-10T11:26:40.573 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.573 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.573 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.574 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.574 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.574 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.574 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.574 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-08-10T11:26:40.574 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.574 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.574 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.575 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { 2023-08-10T11:26:40.575 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", 2023-08-10T11:26:40.575 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.575 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.575 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.575 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.575 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.576 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.576 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.576 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-08-10T11:26:40.576 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.576 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.576 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.577 INFO:teuthology.orchestra.run.smithi107.stdout: "use_repo_digest": { 2023-08-10T11:26:40.577 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_repo_digest", 2023-08-10T11:26:40.577 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.577 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.577 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.577 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.577 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.578 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.578 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.578 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-08-10T11:26:40.578 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.578 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.578 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.578 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_failed_host_check": { 2023-08-10T11:26:40.579 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_failed_host_check", 2023-08-10T11:26:40.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.579 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.579 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.579 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.579 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.579 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.579 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if the host check fails", 2023-08-10T11:26:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_daemons": { 2023-08-10T11:26:40.580 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_daemons", 2023-08-10T11:26:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-08-10T11:26:40.582 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.582 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.582 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.582 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_hosts": { 2023-08-10T11:26:40.582 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_hosts", 2023-08-10T11:26:40.582 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.582 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.583 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.583 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.583 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.583 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.583 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.583 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-08-10T11:26:40.583 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.583 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.584 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.584 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crash", 2023-08-10T11:26:40.584 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.585 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.585 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.585 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.585 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.585 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.585 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.585 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.586 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.586 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.586 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.586 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.586 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.586 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.586 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.587 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.587 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.587 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.587 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.587 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.587 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.587 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.588 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.588 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.588 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.588 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.588 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.588 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.588 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.588 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.589 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.589 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.589 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.589 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.589 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.589 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.590 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.590 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.590 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.590 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.590 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.590 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.590 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.590 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.591 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.591 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.591 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.591 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.591 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.591 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.591 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.591 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.592 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.592 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.592 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.592 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.592 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.592 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "retain_interval": { 2023-08-10T11:26:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retain_interval", 2023-08-10T11:26:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "31536000", 2023-08-10T11:26:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain crashes before pruning them", 2023-08-10T11:26:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { 2023-08-10T11:26:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", 2023-08-10T11:26:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1209600", 2023-08-10T11:26:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "time interval in which to warn about recent crashes", 2023-08-10T11:26:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dashboard", 2023-08-10T11:26:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-08-10T11:26:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-08-10T11:26:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_HOST": { 2023-08-10T11:26:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_HOST", 2023-08-10T11:26:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-08-10T11:26:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-08-10T11:26:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_ENABLED": { 2023-08-10T11:26:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_ENABLED", 2023-08-10T11:26:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-08-10T11:26:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-08-10T11:26:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "ENABLE_BROWSABLE_API": { 2023-08-10T11:26:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ENABLE_BROWSABLE_API", 2023-08-10T11:26:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-08-10T11:26:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-08-10T11:26:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-08-10T11:26:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-08-10T11:26:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-08-10T11:26:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-08-10T11:26:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-08-10T11:26:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-08-10T11:26:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_NFS": { 2023-08-10T11:26:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-08-10T11:26:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RBD": { 2023-08-10T11:26:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-08-10T11:26:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RGW": { 2023-08-10T11:26:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-08-10T11:26:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-08-10T11:26:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-10T11:26:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_PASSWORD": { 2023-08-10T11:26:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_PASSWORD", 2023-08-10T11:26:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-08-10T11:26:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-08-10T11:26:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2023-08-10T11:26:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_URL", 2023-08-10T11:26:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_USERNAME": { 2023-08-10T11:26:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_USERNAME", 2023-08-10T11:26:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-08-10T11:26:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-08-10T11:26:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-08-10T11:26:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-08-10T11:26:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-08-10T11:26:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-08-10T11:26:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "ISSUE_TRACKER_API_KEY": { 2023-08-10T11:26:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-08-10T11:26:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_HOST": { 2023-08-10T11:26:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_HOST", 2023-08-10T11:26:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-08-10T11:26:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-08-10T11:26:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-08-10T11:26:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-08-10T11:26:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-08-10T11:26:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-08-10T11:26:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-08-10T11:26:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-08-10T11:26:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-08-10T11:26:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-08-10T11:26:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-08-10T11:26:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-08-10T11:26:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-08-10T11:26:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-08-10T11:26:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-08-10T11:26:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-08-10T11:26:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_ENABLED": { 2023-08-10T11:26:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_ENABLED", 2023-08-10T11:26:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-08-10T11:26:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-08-10T11:26:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-08-10T11:26:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-08-10T11:26:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-08-10T11:26:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-08-10T11:26:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-08-10T11:26:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8", 2023-08-10T11:26:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "REST_REQUESTS_TIMEOUT": { 2023-08-10T11:26:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-08-10T11:26:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "45", 2023-08-10T11:26:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ACCESS_KEY": { 2023-08-10T11:26:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ACCESS_KEY", 2023-08-10T11:26:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-08-10T11:26:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-08-10T11:26:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SECRET_KEY": { 2023-08-10T11:26:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SECRET_KEY", 2023-08-10T11:26:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SSL_VERIFY": { 2023-08-10T11:26:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SSL_VERIFY", 2023-08-10T11:26:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-08-10T11:26:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-08-10T11:26:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-08-10T11:26:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-08-10T11:26:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-08-10T11:26:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-08-10T11:26:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "cross_origin_url": { 2023-08-10T11:26:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cross_origin_url", 2023-08-10T11:26:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "crt_file": { 2023-08-10T11:26:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crt_file", 2023-08-10T11:26:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "debug": { 2023-08-10T11:26:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "debug", 2023-08-10T11:26:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable/disable debug options", 2023-08-10T11:26:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "jwt_token_ttl": { 2023-08-10T11:26:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "jwt_token_ttl", 2023-08-10T11:26:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "28800", 2023-08-10T11:26:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2023-08-10T11:26:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2023-08-10T11:26:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.695 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.695 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.695 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.695 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.695 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.695 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.695 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.695 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.696 INFO:teuthology.orchestra.run.smithi107.stdout: "motd": { 2023-08-10T11:26:40.696 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "motd", 2023-08-10T11:26:40.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.696 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.696 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.696 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.696 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.697 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.697 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.697 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "The message of the day", 2023-08-10T11:26:40.697 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.697 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.697 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect_resolve_ip_addr": { 2023-08-10T11:26:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "redirect_resolve_ip_addr", 2023-08-10T11:26:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2023-08-10T11:26:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2023-08-10T11:26:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2023-08-10T11:26:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2023-08-10T11:26:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2023-08-10T11:26:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2023-08-10T11:26:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2023-08-10T11:26:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2023-08-10T11:26:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl_server_port": { 2023-08-10T11:26:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl_server_port", 2023-08-10T11:26:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8443", 2023-08-10T11:26:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2023-08-10T11:26:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2023-08-10T11:26:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "redirect", 2023-08-10T11:26:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect" 2023-08-10T11:26:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2023-08-10T11:26:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2023-08-10T11:26:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2023-08-10T11:26:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2023-08-10T11:26:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2023-08-10T11:26:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "url_prefix": { 2023-08-10T11:26:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url_prefix", 2023-08-10T11:26:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", 2023-08-10T11:26:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_monitoring": { 2023-08-10T11:26:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_monitoring", 2023-08-10T11:26:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "monitor device health metrics", 2023-08-10T11:26:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "mark_out_threshold": { 2023-08-10T11:26:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mark_out_threshold", 2023-08-10T11:26:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2419200", 2023-08-10T11:26:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-08-10T11:26:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_name": { 2023-08-10T11:26:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_name", 2023-08-10T11:26:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "device_health_metrics", 2023-08-10T11:26:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name of pool in which to store device health metrics", 2023-08-10T11:26:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { 2023-08-10T11:26:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2023-08-10T11:26:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15552000", 2023-08-10T11:26:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain device health metrics", 2023-08-10T11:26:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_frequency": { 2023-08-10T11:26:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_frequency", 2023-08-10T11:26:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2023-08-10T11:26:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to scrape device health metrics", 2023-08-10T11:26:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "self_heal": { 2023-08-10T11:26:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "self_heal", 2023-08-10T11:26:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-08-10T11:26:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and check device health", 2023-08-10T11:26:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_threshold": { 2023-08-10T11:26:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_threshold", 2023-08-10T11:26:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7257600", 2023-08-10T11:26:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-08-10T11:26:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "diskprediction_local", 2023-08-10T11:26:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "predict_interval": { 2023-08-10T11:26:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predict_interval", 2023-08-10T11:26:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2023-08-10T11:26:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "predictor_model": { 2023-08-10T11:26:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predictor_model", 2023-08-10T11:26:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "prophetstor", 2023-08-10T11:26:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "influx", 2023-08-10T11:26:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": false, 2023-08-10T11:26:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "influxdb python module not found", 2023-08-10T11:26:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "batch_size": { 2023-08-10T11:26:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "batch_size", 2023-08-10T11:26:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", 2023-08-10T11:26:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-08-10T11:26:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "database": { 2023-08-10T11:26:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "database", 2023-08-10T11:26:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "ceph", 2023-08-10T11:26:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-08-10T11:26:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": { 2023-08-10T11:26:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "hostname", 2023-08-10T11:26:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server hostname", 2023-08-10T11:26:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", 2023-08-10T11:26:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2023-08-10T11:26:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-08-10T11:26:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "password": { 2023-08-10T11:26:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "password", 2023-08-10T11:26:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "password of InfluxDB server user", 2023-08-10T11:26:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "port": { 2023-08-10T11:26:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "port", 2023-08-10T11:26:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8086", 2023-08-10T11:26:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2023-08-10T11:26:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2023-08-10T11:26:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2023-08-10T11:26:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "false", 2023-08-10T11:26:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T11:26:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "threads": { 2023-08-10T11:26:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threads", 2023-08-10T11:26:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "32", 2023-08-10T11:26:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-08-10T11:26:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "username": { 2023-08-10T11:26:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "username", 2023-08-10T11:26:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "username of InfluxDB server user", 2023-08-10T11:26:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "verify_ssl": { 2023-08-10T11:26:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "verify_ssl", 2023-08-10T11:26:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "true", 2023-08-10T11:26:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T11:26:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "insights", 2023-08-10T11:26:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "iostat", 2023-08-10T11:26:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "k8sevents", 2023-08-10T11:26:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_event_retention_days": { 2023-08-10T11:26:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ceph_event_retention_days", 2023-08-10T11:26:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7", 2023-08-10T11:26:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Days to hold ceph event information within local cache", 2023-08-10T11:26:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "config_check_secs": { 2023-08-10T11:26:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_check_secs", 2023-08-10T11:26:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "10", 2023-08-10T11:26:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-08-10T11:26:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "localpool", 2023-08-10T11:26:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "failure_domain": { 2023-08-10T11:26:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "failure_domain", 2023-08-10T11:26:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "host", 2023-08-10T11:26:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "failure domain for any created local pool", 2023-08-10T11:26:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-08-10T11:26:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "min_size": { 2023-08-10T11:26:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_size", 2023-08-10T11:26:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default min_size for any created local pool", 2023-08-10T11:26:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-08-10T11:26:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "num_rep": { 2023-08-10T11:26:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "num_rep", 2023-08-10T11:26:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3", 2023-08-10T11:26:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default replica count for any created local pool", 2023-08-10T11:26:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_num": { 2023-08-10T11:26:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_num", 2023-08-10T11:26:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "128", 2023-08-10T11:26:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default pg_num for any created local pool", 2023-08-10T11:26:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "prefix": { 2023-08-10T11:26:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prefix", 2023-08-10T11:26:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name prefix for any created local pool", 2023-08-10T11:26:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { 2023-08-10T11:26:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2023-08-10T11:26:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "rack", 2023-08-10T11:26:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "CRUSH level for which to create a local pool", 2023-08-10T11:26:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-08-10T11:26:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mds_autoscaler", 2023-08-10T11:26:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirroring", 2023-08-10T11:26:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "nfs", 2023-08-10T11:26:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2023-08-10T11:26:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "fail_fs": { 2023-08-10T11:26:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "fail_fs", 2023-08-10T11:26:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-08-10T11:26:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator": { 2023-08-10T11:26:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2023-08-10T11:26:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm", 2023-08-10T11:26:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "rook", 2023-08-10T11:26:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "test_orchestrator" 2023-08-10T11:26:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Orchestrator backend", 2023-08-10T11:26:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_perf_query", 2023-08-10T11:26:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_support", 2023-08-10T11:26:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_autoscaler", 2023-08-10T11:26:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "noautoscale": { 2023-08-10T11:26:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "noautoscale", 2023-08-10T11:26:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "global autoscale flag", 2023-08-10T11:26:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-08-10T11:26:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "threshold": { 2023-08-10T11:26:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threshold", 2023-08-10T11:26:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2023-08-10T11:26:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1.0", 2023-08-10T11:26:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", 2023-08-10T11:26:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-08-10T11:26:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "progress", 2023-08-10T11:26:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_pg_recovery_event": { 2023-08-10T11:26:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_pg_recovery_event", 2023-08-10T11:26:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow the module to show pg recovery progress", 2023-08-10T11:26:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2023-08-10T11:26:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2023-08-10T11:26:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "max_completed_events": { 2023-08-10T11:26:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_completed_events", 2023-08-10T11:26:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "50", 2023-08-10T11:26:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "number of past completed events to remember", 2023-08-10T11:26:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long the module is going to sleep", 2023-08-10T11:26:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus", 2023-08-10T11:26:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "cache": { 2023-08-10T11:26:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cache", 2023-08-10T11:26:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "exclude_perf_counters": { 2023-08-10T11:26:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "exclude_perf_counters", 2023-08-10T11:26:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-08-10T11:26:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-08-10T11:26:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools": { 2023-08-10T11:26:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools", 2023-08-10T11:26:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools_refresh_interval": { 2023-08-10T11:26:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-08-10T11:26:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", 2023-08-10T11:26:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_interval": { 2023-08-10T11:26:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_interval", 2023-08-10T11:26:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15.0", 2023-08-10T11:26:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2023-08-10T11:26:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2023-08-10T11:26:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2023-08-10T11:26:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-08-10T11:26:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2023-08-10T11:26:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2023-08-10T11:26:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", 2023-08-10T11:26:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-08-10T11:26:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "stale_cache_strategy": { 2023-08-10T11:26:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stale_cache_strategy", 2023-08-10T11:26:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "log", 2023-08-10T11:26:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2023-08-10T11:26:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2023-08-10T11:26:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "default", 2023-08-10T11:26:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "default", 2023-08-10T11:26:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "error" 2023-08-10T11:26:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2023-08-10T11:26:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2023-08-10T11:26:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2023-08-10T11:26:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2023-08-10T11:26:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2023-08-10T11:26:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_support", 2023-08-10T11:26:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_snap_create": { 2023-08-10T11:26:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_snap_create", 2023-08-10T11:26:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "mirror_snapshot_schedule": { 2023-08-10T11:26:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirror_snapshot_schedule", 2023-08-10T11:26:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "trash_purge_schedule": { 2023-08-10T11:26:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", 2023-08-10T11:26:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "restful", 2023-08-10T11:26:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_auth": { 2023-08-10T11:26:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_auth", 2023-08-10T11:26:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2023-08-10T11:26:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2023-08-10T11:26:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2023-08-10T11:26:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2023-08-10T11:26:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2023-08-10T11:26:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2023-08-10T11:26:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rgw", 2023-08-10T11:26:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rook", 2023-08-10T11:26:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "drive_group_interval": { 2023-08-10T11:26:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "drive_group_interval", 2023-08-10T11:26:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300.0", 2023-08-10T11:26:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-08-10T11:26:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "storage_class": { 2023-08-10T11:26:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "storage_class", 2023-08-10T11:26:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "local", 2023-08-10T11:26:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-08-10T11:26:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "selftest", 2023-08-10T11:26:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "roption1": { 2023-08-10T11:26:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption1", 2023-08-10T11:26:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "roption2": { 2023-08-10T11:26:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption2", 2023-08-10T11:26:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "xyz", 2023-08-10T11:26:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption1": { 2023-08-10T11:26:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption1", 2023-08-10T11:26:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption2": { 2023-08-10T11:26:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption2", 2023-08-10T11:26:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption3": { 2023-08-10T11:26:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption3", 2023-08-10T11:26:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption4": { 2023-08-10T11:26:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption4", 2023-08-10T11:26:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption5": { 2023-08-10T11:26:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption5", 2023-08-10T11:26:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption6": { 2023-08-10T11:26:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption6", 2023-08-10T11:26:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption7": { 2023-08-10T11:26:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption7", 2023-08-10T11:26:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "42", 2023-08-10T11:26:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "testkey": { 2023-08-10T11:26:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testkey", 2023-08-10T11:26:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "testlkey": { 2023-08-10T11:26:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testlkey", 2023-08-10T11:26:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "testnewline": { 2023-08-10T11:26:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testnewline", 2023-08-10T11:26:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snap_schedule", 2023-08-10T11:26:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_m_granularity": { 2023-08-10T11:26:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_m_granularity", 2023-08-10T11:26:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow minute scheduled snapshots", 2023-08-10T11:26:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "dump_on_update": { 2023-08-10T11:26:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dump_on_update", 2023-08-10T11:26:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "dump database to debug log on update", 2023-08-10T11:26:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stats", 2023-08-10T11:26:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "status", 2023-08-10T11:26:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telegraf", 2023-08-10T11:26:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "address": { 2023-08-10T11:26:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "address", 2023-08-10T11:26:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-08-10T11:26:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15", 2023-08-10T11:26:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.103 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.103 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.103 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.103 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.103 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.103 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.103 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.104 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.104 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.104 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.104 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telemetry", 2023-08-10T11:26:41.105 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.105 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.105 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.105 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_basic": { 2023-08-10T11:26:41.105 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_basic", 2023-08-10T11:26:41.105 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share basic cluster information (size, version)", 2023-08-10T11:26:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_crash": { 2023-08-10T11:26:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_crash", 2023-08-10T11:26:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-08-10T11:26:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_device": { 2023-08-10T11:26:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_device", 2023-08-10T11:26:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-08-10T11:26:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_ident": { 2023-08-10T11:26:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_ident", 2023-08-10T11:26:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-08-10T11:26:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_perf": { 2023-08-10T11:26:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_perf", 2023-08-10T11:26:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share various performance metrics of a cluster", 2023-08-10T11:26:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "contact": { 2023-08-10T11:26:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "contact", 2023-08-10T11:26:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "description": { 2023-08-10T11:26:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "description", 2023-08-10T11:26:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "device_url": { 2023-08-10T11:26:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_url", 2023-08-10T11:26:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-08-10T11:26:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2023-08-10T11:26:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2023-08-10T11:26:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "24", 2023-08-10T11:26:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "8", 2023-08-10T11:26:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "last_opt_revision": { 2023-08-10T11:26:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "last_opt_revision", 2023-08-10T11:26:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1", 2023-08-10T11:26:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard": { 2023-08-10T11:26:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard", 2023-08-10T11:26:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard_description": { 2023-08-10T11:26:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard_description", 2023-08-10T11:26:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "organization": { 2023-08-10T11:26:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "organization", 2023-08-10T11:26:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "proxy": { 2023-08-10T11:26:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "proxy", 2023-08-10T11:26:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "url": { 2023-08-10T11:26:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url", 2023-08-10T11:26:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-08-10T11:26:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "test_orchestrator", 2023-08-10T11:26:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "volumes", 2023-08-10T11:26:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_clones": { 2023-08-10T11:26:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_clones", 2023-08-10T11:26:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4", 2023-08-10T11:26:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Number of asynchronous cloner threads", 2023-08-10T11:26:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "snapshot_clone_delay": { 2023-08-10T11:26:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snapshot_clone_delay", 2023-08-10T11:26:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-08-10T11:26:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix", 2023-08-10T11:26:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "discovery_interval": { 2023-08-10T11:26:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "discovery_interval", 2023-08-10T11:26:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "100", 2023-08-10T11:26:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "identifier": { 2023-08-10T11:26:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "identifier", 2023-08-10T11:26:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_host": { 2023-08-10T11:26:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_host", 2023-08-10T11:26:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_port": { 2023-08-10T11:26:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_port", 2023-08-10T11:26:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10051", 2023-08-10T11:26:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_sender": { 2023-08-10T11:26:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_sender", 2023-08-10T11:26:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-08-10T11:26:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "modules": [ 2023-08-10T11:26:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm", 2023-08-10T11:26:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "dashboard", 2023-08-10T11:26:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "iostat", 2023-08-10T11:26:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "nfs", 2023-08-10T11:26:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "restful", 2023-08-10T11:26:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "snap_schedule" 2023-08-10T11:26:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "available_modules": [ 2023-08-10T11:26:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alerts", 2023-08-10T11:26:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How frequently to reexamine health status", 2023-08-10T11:26:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_destination": { 2023-08-10T11:26:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_destination", 2023-08-10T11:26:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email address to send alerts to", 2023-08-10T11:26:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_from_name": { 2023-08-10T11:26:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_from_name", 2023-08-10T11:26:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "Ceph", 2023-08-10T11:26:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email From: name", 2023-08-10T11:26:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_host": { 2023-08-10T11:26:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_host", 2023-08-10T11:26:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP server", 2023-08-10T11:26:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_password": { 2023-08-10T11:26:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_password", 2023-08-10T11:26:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Password to authenticate with", 2023-08-10T11:26:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_port": { 2023-08-10T11:26:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_port", 2023-08-10T11:26:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "465", 2023-08-10T11:26:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP port", 2023-08-10T11:26:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_sender": { 2023-08-10T11:26:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_sender", 2023-08-10T11:26:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP envelope sender", 2023-08-10T11:26:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_ssl": { 2023-08-10T11:26:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_ssl", 2023-08-10T11:26:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use SSL to connect to SMTP server", 2023-08-10T11:26:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_user": { 2023-08-10T11:26:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_user", 2023-08-10T11:26:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "User to authenticate as", 2023-08-10T11:26:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "balancer", 2023-08-10T11:26:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2023-08-10T11:26:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "active", 2023-08-10T11:26:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically balance PGs across cluster", 2023-08-10T11:26:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_time": { 2023-08-10T11:26:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_time", 2023-08-10T11:26:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0000", 2023-08-10T11:26:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "beginning time of day to automatically balance", 2023-08-10T11:26:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T11:26:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_weekday": { 2023-08-10T11:26:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_weekday", 2023-08-10T11:26:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2023-08-10T11:26:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2023-08-10T11:26:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-08-10T11:26:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T11:26:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_max_iterations": { 2023-08-10T11:26:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_max_iterations", 2023-08-10T11:26:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "25", 2023-08-10T11:26:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "250", 2023-08-10T11:26:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-08-10T11:26:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_metrics": { 2023-08-10T11:26:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_metrics", 2023-08-10T11:26:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "pgs,objects,bytes", 2023-08-10T11:26:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-08-10T11:26:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-08-10T11:26:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_step": { 2023-08-10T11:26:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_step", 2023-08-10T11:26:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.5", 2023-08-10T11:26:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0.001", 2023-08-10T11:26:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "0.999", 2023-08-10T11:26:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "aggressiveness of optimization", 2023-08-10T11:26:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-08-10T11:26:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "end_time": { 2023-08-10T11:26:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_time", 2023-08-10T11:26:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2359", 2023-08-10T11:26:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ending time of day to automatically balance", 2023-08-10T11:26:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-08-10T11:26:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "end_weekday": { 2023-08-10T11:26:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", 2023-08-10T11:26:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2023-08-10T11:26:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2023-08-10T11:26:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-08-10T11:26:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-08-10T11:26:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "min_score": { 2023-08-10T11:26:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_score", 2023-08-10T11:26:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-08-10T11:26:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2023-08-10T11:26:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2023-08-10T11:26:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", 2023-08-10T11:26:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "crush-compat", 2023-08-10T11:26:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "none", 2023-08-10T11:26:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap" 2023-08-10T11:26:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Balancer mode", 2023-08-10T11:26:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_ids": { 2023-08-10T11:26:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_ids", 2023-08-10T11:26:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-08-10T11:26:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-08-10T11:26:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_deviation": { 2023-08-10T11:26:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_deviation", 2023-08-10T11:26:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "deviation below which no optimization is attempted", 2023-08-10T11:26:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-08-10T11:26:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_optimizations": { 2023-08-10T11:26:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_optimizations", 2023-08-10T11:26:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-08-10T11:26:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephadm", 2023-08-10T11:26:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_down_multiplier": { 2023-08-10T11:26:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_down_multiplier", 2023-08-10T11:26:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2023-08-10T11:26:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-08-10T11:26:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_refresh_rate": { 2023-08-10T11:26:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_refresh_rate", 2023-08-10T11:26:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "20", 2023-08-10T11:26:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-08-10T11:26:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_starting_port": { 2023-08-10T11:26:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_starting_port", 2023-08-10T11:26:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4721", 2023-08-10T11:26:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-08-10T11:26:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "alertmanager_web_password": { 2023-08-10T11:26:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alertmanager_web_password", 2023-08-10T11:26:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Alertmanager web password", 2023-08-10T11:26:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "alertmanager_web_user": { 2023-08-10T11:26:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alertmanager_web_user", 2023-08-10T11:26:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Alertmanager web user", 2023-08-10T11:26:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_ptrace": { 2023-08-10T11:26:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_ptrace", 2023-08-10T11:26:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-08-10T11:26:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-08-10T11:26:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_interval": { 2023-08-10T11:26:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_interval", 2023-08-10T11:26:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to autotune daemon memory", 2023-08-10T11:26:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_memory_target_ratio": { 2023-08-10T11:26:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_memory_target_ratio", 2023-08-10T11:26:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.7", 2023-08-10T11:26:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-08-10T11:26:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { 2023-08-10T11:26:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", 2023-08-10T11:26:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-08-10T11:26:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "config_checks_enabled": { 2023-08-10T11:26:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_checks_enabled", 2023-08-10T11:26:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-08-10T11:26:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "config_dashboard": { 2023-08-10T11:26:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_dashboard", 2023-08-10T11:26:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-08-10T11:26:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { 2023-08-10T11:26:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2023-08-10T11:26:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-08-10T11:26:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_base": { 2023-08-10T11:26:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_base", 2023-08-10T11:26:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/ceph", 2023-08-10T11:26:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Container image name, without the tag", 2023-08-10T11:26:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_elasticsearch": { 2023-08-10T11:26:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_elasticsearch", 2023-08-10T11:26:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-08-10T11:26:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "elasticsearch container image", 2023-08-10T11:26:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_grafana": { 2023-08-10T11:26:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_grafana", 2023-08-10T11:26:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-08-10T11:26:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_haproxy": { 2023-08-10T11:26:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_haproxy", 2023-08-10T11:26:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-08-10T11:26:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "HAproxy container image", 2023-08-10T11:26:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_agent": { 2023-08-10T11:26:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_agent", 2023-08-10T11:26:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-08-10T11:26:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger agent container image", 2023-08-10T11:26:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_collector": { 2023-08-10T11:26:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_collector", 2023-08-10T11:26:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-08-10T11:26:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger collector container image", 2023-08-10T11:26:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_query": { 2023-08-10T11:26:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_query", 2023-08-10T11:26:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-08-10T11:26:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger query container image", 2023-08-10T11:26:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_keepalived": { 2023-08-10T11:26:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_keepalived", 2023-08-10T11:26:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-08-10T11:26:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Keepalived container image", 2023-08-10T11:26:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_loki": { 2023-08-10T11:26:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_loki", 2023-08-10T11:26:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-08-10T11:26:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Loki container image", 2023-08-10T11:26:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_node_exporter": { 2023-08-10T11:26:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_node_exporter", 2023-08-10T11:26:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-08-10T11:26:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_prometheus": { 2023-08-10T11:26:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_prometheus", 2023-08-10T11:26:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-08-10T11:26:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2023-08-10T11:26:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_promtail": { 2023-08-10T11:26:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_promtail", 2023-08-10T11:26:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-08-10T11:26:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Promtail container image", 2023-08-10T11:26:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_snmp_gateway": { 2023-08-10T11:26:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_snmp_gateway", 2023-08-10T11:26:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-08-10T11:26:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SNMP Gateway container image", 2023-08-10T11:26:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "container_init": { 2023-08-10T11:26:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_init", 2023-08-10T11:26:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Run podman/docker with `--init`", 2023-08-10T11:26:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "daemon_cache_timeout": { 2023-08-10T11:26:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "daemon_cache_timeout", 2023-08-10T11:26:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-08-10T11:26:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "default_cephadm_command_timeout": { 2023-08-10T11:26:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_cephadm_command_timeout", 2023-08-10T11:26:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "900", 2023-08-10T11:26:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-08-10T11:26:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "default_registry": { 2023-08-10T11:26:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_registry", 2023-08-10T11:26:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io", 2023-08-10T11:26:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-08-10T11:26:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "device_cache_timeout": { 2023-08-10T11:26:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_cache_timeout", 2023-08-10T11:26:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1800", 2023-08-10T11:26:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache device inventory", 2023-08-10T11:26:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "device_enhanced_scan": { 2023-08-10T11:26:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_enhanced_scan", 2023-08-10T11:26:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.312 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use libstoragemgmt during device scans", 2023-08-10T11:26:41.312 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.312 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.312 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.312 INFO:teuthology.orchestra.run.smithi107.stdout: "facts_cache_timeout": { 2023-08-10T11:26:41.312 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "facts_cache_timeout", 2023-08-10T11:26:41.313 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.313 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.313 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.313 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:41.313 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.313 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.313 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.313 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", 2023-08-10T11:26:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "host_check_interval": { 2023-08-10T11:26:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "host_check_interval", 2023-08-10T11:26:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to perform a host check", 2023-08-10T11:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "log_refresh_metadata": { 2023-08-10T11:26:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_refresh_metadata", 2023-08-10T11:26:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-08-10T11:26:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-08-10T11:26:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf": { 2023-08-10T11:26:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-08-10T11:26:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-08-10T11:26:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-08-10T11:26:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-08-10T11:26:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "*", 2023-08-10T11:26:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-08-10T11:26:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "max_count_per_host": { 2023-08-10T11:26:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_count_per_host", 2023-08-10T11:26:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of daemons per service per host", 2023-08-10T11:26:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "max_osd_draining_count": { 2023-08-10T11:26:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_osd_draining_count", 2023-08-10T11:26:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-08-10T11:26:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "migration_current": { 2023-08-10T11:26:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", 2023-08-10T11:26:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "internal - do not modify", 2023-08-10T11:26:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2023-08-10T11:26:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2023-08-10T11:26:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "root", 2023-08-10T11:26:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm-package", 2023-08-10T11:26:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "root" 2023-08-10T11:26:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "mode for remote execution of cephadm", 2023-08-10T11:26:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_alerts_path": { 2023-08-10T11:26:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_alerts_path", 2023-08-10T11:26:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-08-10T11:26:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-08-10T11:26:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_web_password": { 2023-08-10T11:26:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_web_password", 2023-08-10T11:26:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus web password", 2023-08-10T11:26:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_web_user": { 2023-08-10T11:26:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_web_user", 2023-08-10T11:26:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus web user", 2023-08-10T11:26:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_insecure": { 2023-08-10T11:26:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_insecure", 2023-08-10T11:26:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-08-10T11:26:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_password": { 2023-08-10T11:26:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_password", 2023-08-10T11:26:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-08-10T11:26:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_url": { 2023-08-10T11:26:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_url", 2023-08-10T11:26:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-08-10T11:26:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_username": { 2023-08-10T11:26:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_username", 2023-08-10T11:26:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-08-10T11:26:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "secure_monitoring_stack": { 2023-08-10T11:26:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", 2023-08-10T11:26:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-08-10T11:26:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "service_discovery_port": { 2023-08-10T11:26:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "service_discovery_port", 2023-08-10T11:26:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8765", 2023-08-10T11:26:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "cephadm service discovery port", 2023-08-10T11:26:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "ssh_config_file": { 2023-08-10T11:26:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssh_config_file", 2023-08-10T11:26:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-08-10T11:26:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { 2023-08-10T11:26:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", 2023-08-10T11:26:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-08-10T11:26:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "use_repo_digest": { 2023-08-10T11:26:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_repo_digest", 2023-08-10T11:26:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-08-10T11:26:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_failed_host_check": { 2023-08-10T11:26:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_failed_host_check", 2023-08-10T11:26:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if the host check fails", 2023-08-10T11:26:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_daemons": { 2023-08-10T11:26:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_daemons", 2023-08-10T11:26:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-08-10T11:26:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_hosts": { 2023-08-10T11:26:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_hosts", 2023-08-10T11:26:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-08-10T11:26:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crash", 2023-08-10T11:26:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "retain_interval": { 2023-08-10T11:26:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retain_interval", 2023-08-10T11:26:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "31536000", 2023-08-10T11:26:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain crashes before pruning them", 2023-08-10T11:26:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { 2023-08-10T11:26:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", 2023-08-10T11:26:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1209600", 2023-08-10T11:26:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "time interval in which to warn about recent crashes", 2023-08-10T11:26:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dashboard", 2023-08-10T11:26:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-08-10T11:26:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-08-10T11:26:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_HOST": { 2023-08-10T11:26:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_HOST", 2023-08-10T11:26:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-08-10T11:26:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-08-10T11:26:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_ENABLED": { 2023-08-10T11:26:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_ENABLED", 2023-08-10T11:26:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-08-10T11:26:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-08-10T11:26:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "ENABLE_BROWSABLE_API": { 2023-08-10T11:26:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ENABLE_BROWSABLE_API", 2023-08-10T11:26:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-08-10T11:26:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-08-10T11:26:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-08-10T11:26:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-08-10T11:26:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-08-10T11:26:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-08-10T11:26:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-08-10T11:26:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-08-10T11:26:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_NFS": { 2023-08-10T11:26:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-08-10T11:26:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RBD": { 2023-08-10T11:26:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-08-10T11:26:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RGW": { 2023-08-10T11:26:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-08-10T11:26:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-08-10T11:26:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-08-10T11:26:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_PASSWORD": { 2023-08-10T11:26:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_PASSWORD", 2023-08-10T11:26:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-08-10T11:26:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-08-10T11:26:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2023-08-10T11:26:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_URL", 2023-08-10T11:26:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_USERNAME": { 2023-08-10T11:26:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_USERNAME", 2023-08-10T11:26:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-08-10T11:26:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-08-10T11:26:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-08-10T11:26:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-08-10T11:26:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-08-10T11:26:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-08-10T11:26:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "ISSUE_TRACKER_API_KEY": { 2023-08-10T11:26:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-08-10T11:26:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_HOST": { 2023-08-10T11:26:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_HOST", 2023-08-10T11:26:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-08-10T11:26:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-08-10T11:26:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-08-10T11:26:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-08-10T11:26:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-08-10T11:26:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-08-10T11:26:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-08-10T11:26:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-08-10T11:26:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-08-10T11:26:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-08-10T11:26:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-08-10T11:26:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-08-10T11:26:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-08-10T11:26:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-08-10T11:26:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-08-10T11:26:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-08-10T11:26:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_ENABLED": { 2023-08-10T11:26:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_ENABLED", 2023-08-10T11:26:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-08-10T11:26:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-08-10T11:26:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-08-10T11:26:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-08-10T11:26:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-08-10T11:26:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-08-10T11:26:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-08-10T11:26:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8", 2023-08-10T11:26:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "REST_REQUESTS_TIMEOUT": { 2023-08-10T11:26:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-08-10T11:26:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "45", 2023-08-10T11:26:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ACCESS_KEY": { 2023-08-10T11:26:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ACCESS_KEY", 2023-08-10T11:26:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-08-10T11:26:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-08-10T11:26:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2023-08-10T11:26:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SECRET_KEY": { 2023-08-10T11:26:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SECRET_KEY", 2023-08-10T11:26:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SSL_VERIFY": { 2023-08-10T11:26:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SSL_VERIFY", 2023-08-10T11:26:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-08-10T11:26:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-08-10T11:26:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-08-10T11:26:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-08-10T11:26:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-08-10T11:26:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-08-10T11:26:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "cross_origin_url": { 2023-08-10T11:26:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cross_origin_url", 2023-08-10T11:26:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "crt_file": { 2023-08-10T11:26:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crt_file", 2023-08-10T11:26:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "debug": { 2023-08-10T11:26:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "debug", 2023-08-10T11:26:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable/disable debug options", 2023-08-10T11:26:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "jwt_token_ttl": { 2023-08-10T11:26:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "jwt_token_ttl", 2023-08-10T11:26:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "28800", 2023-08-10T11:26:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2023-08-10T11:26:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2023-08-10T11:26:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "motd": { 2023-08-10T11:26:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "motd", 2023-08-10T11:26:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "The message of the day", 2023-08-10T11:26:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect_resolve_ip_addr": { 2023-08-10T11:26:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "redirect_resolve_ip_addr", 2023-08-10T11:26:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2023-08-10T11:26:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2023-08-10T11:26:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2023-08-10T11:26:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2023-08-10T11:26:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2023-08-10T11:26:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2023-08-10T11:26:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2023-08-10T11:26:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2023-08-10T11:26:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl_server_port": { 2023-08-10T11:26:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl_server_port", 2023-08-10T11:26:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8443", 2023-08-10T11:26:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2023-08-10T11:26:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2023-08-10T11:26:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "redirect", 2023-08-10T11:26:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect" 2023-08-10T11:26:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2023-08-10T11:26:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2023-08-10T11:26:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2023-08-10T11:26:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2023-08-10T11:26:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2023-08-10T11:26:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "url_prefix": { 2023-08-10T11:26:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url_prefix", 2023-08-10T11:26:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", 2023-08-10T11:26:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_monitoring": { 2023-08-10T11:26:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_monitoring", 2023-08-10T11:26:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "monitor device health metrics", 2023-08-10T11:26:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "mark_out_threshold": { 2023-08-10T11:26:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mark_out_threshold", 2023-08-10T11:26:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2419200", 2023-08-10T11:26:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-08-10T11:26:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_name": { 2023-08-10T11:26:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_name", 2023-08-10T11:26:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "device_health_metrics", 2023-08-10T11:26:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name of pool in which to store device health metrics", 2023-08-10T11:26:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { 2023-08-10T11:26:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2023-08-10T11:26:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15552000", 2023-08-10T11:26:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain device health metrics", 2023-08-10T11:26:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_frequency": { 2023-08-10T11:26:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_frequency", 2023-08-10T11:26:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2023-08-10T11:26:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to scrape device health metrics", 2023-08-10T11:26:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "self_heal": { 2023-08-10T11:26:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "self_heal", 2023-08-10T11:26:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-08-10T11:26:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.516 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:41.516 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:41.516 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.516 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.516 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.516 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:41.517 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.517 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.517 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.517 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and check device health", 2023-08-10T11:26:41.517 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.517 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.517 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_threshold": { 2023-08-10T11:26:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_threshold", 2023-08-10T11:26:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7257600", 2023-08-10T11:26:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-08-10T11:26:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "diskprediction_local", 2023-08-10T11:26:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "predict_interval": { 2023-08-10T11:26:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predict_interval", 2023-08-10T11:26:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2023-08-10T11:26:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "predictor_model": { 2023-08-10T11:26:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predictor_model", 2023-08-10T11:26:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "prophetstor", 2023-08-10T11:26:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2023-08-10T11:26:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "influx", 2023-08-10T11:26:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": false, 2023-08-10T11:26:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "influxdb python module not found", 2023-08-10T11:26:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "batch_size": { 2023-08-10T11:26:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "batch_size", 2023-08-10T11:26:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", 2023-08-10T11:26:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-08-10T11:26:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "database": { 2023-08-10T11:26:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "database", 2023-08-10T11:26:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "ceph", 2023-08-10T11:26:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-08-10T11:26:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": { 2023-08-10T11:26:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "hostname", 2023-08-10T11:26:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server hostname", 2023-08-10T11:26:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", 2023-08-10T11:26:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2023-08-10T11:26:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-08-10T11:26:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "password": { 2023-08-10T11:26:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "password", 2023-08-10T11:26:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "password of InfluxDB server user", 2023-08-10T11:26:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "port": { 2023-08-10T11:26:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "port", 2023-08-10T11:26:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8086", 2023-08-10T11:26:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2023-08-10T11:26:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2023-08-10T11:26:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2023-08-10T11:26:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "false", 2023-08-10T11:26:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T11:26:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "threads": { 2023-08-10T11:26:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threads", 2023-08-10T11:26:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "32", 2023-08-10T11:26:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-08-10T11:26:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "username": { 2023-08-10T11:26:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "username", 2023-08-10T11:26:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "username of InfluxDB server user", 2023-08-10T11:26:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "verify_ssl": { 2023-08-10T11:26:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "verify_ssl", 2023-08-10T11:26:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "true", 2023-08-10T11:26:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-08-10T11:26:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "insights", 2023-08-10T11:26:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "iostat", 2023-08-10T11:26:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "k8sevents", 2023-08-10T11:26:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_event_retention_days": { 2023-08-10T11:26:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ceph_event_retention_days", 2023-08-10T11:26:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7", 2023-08-10T11:26:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Days to hold ceph event information within local cache", 2023-08-10T11:26:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "config_check_secs": { 2023-08-10T11:26:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_check_secs", 2023-08-10T11:26:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "10", 2023-08-10T11:26:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-08-10T11:26:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "localpool", 2023-08-10T11:26:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "failure_domain": { 2023-08-10T11:26:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "failure_domain", 2023-08-10T11:26:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "host", 2023-08-10T11:26:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "failure domain for any created local pool", 2023-08-10T11:26:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-08-10T11:26:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "min_size": { 2023-08-10T11:26:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_size", 2023-08-10T11:26:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default min_size for any created local pool", 2023-08-10T11:26:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-08-10T11:26:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "num_rep": { 2023-08-10T11:26:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "num_rep", 2023-08-10T11:26:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3", 2023-08-10T11:26:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default replica count for any created local pool", 2023-08-10T11:26:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_num": { 2023-08-10T11:26:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_num", 2023-08-10T11:26:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "128", 2023-08-10T11:26:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default pg_num for any created local pool", 2023-08-10T11:26:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "prefix": { 2023-08-10T11:26:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prefix", 2023-08-10T11:26:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name prefix for any created local pool", 2023-08-10T11:26:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { 2023-08-10T11:26:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2023-08-10T11:26:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "rack", 2023-08-10T11:26:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "CRUSH level for which to create a local pool", 2023-08-10T11:26:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-08-10T11:26:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mds_autoscaler", 2023-08-10T11:26:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirroring", 2023-08-10T11:26:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "nfs", 2023-08-10T11:26:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2023-08-10T11:26:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "fail_fs": { 2023-08-10T11:26:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "fail_fs", 2023-08-10T11:26:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-08-10T11:26:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator": { 2023-08-10T11:26:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2023-08-10T11:26:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm", 2023-08-10T11:26:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "rook", 2023-08-10T11:26:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "test_orchestrator" 2023-08-10T11:26:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Orchestrator backend", 2023-08-10T11:26:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_perf_query", 2023-08-10T11:26:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_support", 2023-08-10T11:26:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_autoscaler", 2023-08-10T11:26:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "noautoscale": { 2023-08-10T11:26:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "noautoscale", 2023-08-10T11:26:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "global autoscale flag", 2023-08-10T11:26:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-08-10T11:26:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "threshold": { 2023-08-10T11:26:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threshold", 2023-08-10T11:26:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2023-08-10T11:26:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1.0", 2023-08-10T11:26:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", 2023-08-10T11:26:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-08-10T11:26:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "progress", 2023-08-10T11:26:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_pg_recovery_event": { 2023-08-10T11:26:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_pg_recovery_event", 2023-08-10T11:26:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow the module to show pg recovery progress", 2023-08-10T11:26:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2023-08-10T11:26:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2023-08-10T11:26:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "max_completed_events": { 2023-08-10T11:26:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_completed_events", 2023-08-10T11:26:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "50", 2023-08-10T11:26:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "number of past completed events to remember", 2023-08-10T11:26:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2023-08-10T11:26:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2023-08-10T11:26:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2023-08-10T11:26:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long the module is going to sleep", 2023-08-10T11:26:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus", 2023-08-10T11:26:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "cache": { 2023-08-10T11:26:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cache", 2023-08-10T11:26:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "exclude_perf_counters": { 2023-08-10T11:26:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "exclude_perf_counters", 2023-08-10T11:26:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-08-10T11:26:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-08-10T11:26:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools": { 2023-08-10T11:26:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools", 2023-08-10T11:26:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools_refresh_interval": { 2023-08-10T11:26:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-08-10T11:26:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", 2023-08-10T11:26:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_interval": { 2023-08-10T11:26:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_interval", 2023-08-10T11:26:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15.0", 2023-08-10T11:26:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2023-08-10T11:26:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2023-08-10T11:26:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2023-08-10T11:26:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-08-10T11:26:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2023-08-10T11:26:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2023-08-10T11:26:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", 2023-08-10T11:26:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-08-10T11:26:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "stale_cache_strategy": { 2023-08-10T11:26:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stale_cache_strategy", 2023-08-10T11:26:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "log", 2023-08-10T11:26:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2023-08-10T11:26:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2023-08-10T11:26:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "default", 2023-08-10T11:26:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "default", 2023-08-10T11:26:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "error" 2023-08-10T11:26:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2023-08-10T11:26:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2023-08-10T11:26:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2023-08-10T11:26:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2023-08-10T11:26:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2023-08-10T11:26:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_support", 2023-08-10T11:26:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_snap_create": { 2023-08-10T11:26:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_snap_create", 2023-08-10T11:26:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2023-08-10T11:26:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "mirror_snapshot_schedule": { 2023-08-10T11:26:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirror_snapshot_schedule", 2023-08-10T11:26:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "trash_purge_schedule": { 2023-08-10T11:26:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", 2023-08-10T11:26:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "restful", 2023-08-10T11:26:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_auth": { 2023-08-10T11:26:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_auth", 2023-08-10T11:26:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2023-08-10T11:26:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2023-08-10T11:26:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2023-08-10T11:26:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2023-08-10T11:26:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2023-08-10T11:26:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2023-08-10T11:26:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rgw", 2023-08-10T11:26:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rook", 2023-08-10T11:26:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "drive_group_interval": { 2023-08-10T11:26:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "drive_group_interval", 2023-08-10T11:26:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300.0", 2023-08-10T11:26:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-08-10T11:26:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "storage_class": { 2023-08-10T11:26:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "storage_class", 2023-08-10T11:26:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "local", 2023-08-10T11:26:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-08-10T11:26:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "selftest", 2023-08-10T11:26:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "roption1": { 2023-08-10T11:26:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption1", 2023-08-10T11:26:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "roption2": { 2023-08-10T11:26:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption2", 2023-08-10T11:26:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "xyz", 2023-08-10T11:26:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption1": { 2023-08-10T11:26:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption1", 2023-08-10T11:26:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption2": { 2023-08-10T11:26:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption2", 2023-08-10T11:26:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption3": { 2023-08-10T11:26:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption3", 2023-08-10T11:26:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2023-08-10T11:26:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption4": { 2023-08-10T11:26:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption4", 2023-08-10T11:26:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption5": { 2023-08-10T11:26:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption5", 2023-08-10T11:26:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption6": { 2023-08-10T11:26:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption6", 2023-08-10T11:26:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption7": { 2023-08-10T11:26:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption7", 2023-08-10T11:26:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2023-08-10T11:26:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "42", 2023-08-10T11:26:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "testkey": { 2023-08-10T11:26:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testkey", 2023-08-10T11:26:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "testlkey": { 2023-08-10T11:26:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testlkey", 2023-08-10T11:26:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "testnewline": { 2023-08-10T11:26:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testnewline", 2023-08-10T11:26:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snap_schedule", 2023-08-10T11:26:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_m_granularity": { 2023-08-10T11:26:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_m_granularity", 2023-08-10T11:26:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow minute scheduled snapshots", 2023-08-10T11:26:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "dump_on_update": { 2023-08-10T11:26:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dump_on_update", 2023-08-10T11:26:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "dump database to debug log on update", 2023-08-10T11:26:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stats", 2023-08-10T11:26:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "status", 2023-08-10T11:26:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telegraf", 2023-08-10T11:26:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "address": { 2023-08-10T11:26:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "address", 2023-08-10T11:26:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-08-10T11:26:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15", 2023-08-10T11:26:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telemetry", 2023-08-10T11:26:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_basic": { 2023-08-10T11:26:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_basic", 2023-08-10T11:26:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share basic cluster information (size, version)", 2023-08-10T11:26:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_crash": { 2023-08-10T11:26:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_crash", 2023-08-10T11:26:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-08-10T11:26:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_device": { 2023-08-10T11:26:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_device", 2023-08-10T11:26:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2023-08-10T11:26:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-08-10T11:26:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_ident": { 2023-08-10T11:26:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_ident", 2023-08-10T11:26:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-08-10T11:26:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_perf": { 2023-08-10T11:26:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_perf", 2023-08-10T11:26:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share various performance metrics of a cluster", 2023-08-10T11:26:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "contact": { 2023-08-10T11:26:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "contact", 2023-08-10T11:26:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "description": { 2023-08-10T11:26:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "description", 2023-08-10T11:26:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "device_url": { 2023-08-10T11:26:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_url", 2023-08-10T11:26:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-08-10T11:26:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2023-08-10T11:26:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2023-08-10T11:26:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "24", 2023-08-10T11:26:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "8", 2023-08-10T11:26:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "last_opt_revision": { 2023-08-10T11:26:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "last_opt_revision", 2023-08-10T11:26:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1", 2023-08-10T11:26:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard": { 2023-08-10T11:26:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard", 2023-08-10T11:26:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard_description": { 2023-08-10T11:26:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard_description", 2023-08-10T11:26:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "organization": { 2023-08-10T11:26:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "organization", 2023-08-10T11:26:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "proxy": { 2023-08-10T11:26:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "proxy", 2023-08-10T11:26:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "url": { 2023-08-10T11:26:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url", 2023-08-10T11:26:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-08-10T11:26:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "test_orchestrator", 2023-08-10T11:26:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.923 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.923 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.923 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.923 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.923 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.923 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.923 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.924 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.924 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.924 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.924 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.924 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.924 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.924 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.925 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.925 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.925 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.925 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.925 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.925 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.925 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "volumes", 2023-08-10T11:26:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_clones": { 2023-08-10T11:26:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_clones", 2023-08-10T11:26:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4", 2023-08-10T11:26:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Number of asynchronous cloner threads", 2023-08-10T11:26:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "snapshot_clone_delay": { 2023-08-10T11:26:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snapshot_clone_delay", 2023-08-10T11:26:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2023-08-10T11:26:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-08-10T11:26:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix", 2023-08-10T11:26:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2023-08-10T11:26:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2023-08-10T11:26:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2023-08-10T11:26:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "discovery_interval": { 2023-08-10T11:26:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "discovery_interval", 2023-08-10T11:26:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2023-08-10T11:26:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "100", 2023-08-10T11:26:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "identifier": { 2023-08-10T11:26:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "identifier", 2023-08-10T11:26:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2023-08-10T11:26:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2023-08-10T11:26:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2023-08-10T11:26:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2023-08-10T11:26:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2023-08-10T11:26:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2023-08-10T11:26:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2023-08-10T11:26:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2023-08-10T11:26:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2023-08-10T11:26:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2023-08-10T11:26:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2023-08-10T11:26:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2023-08-10T11:26:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2023-08-10T11:26:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2023-08-10T11:26:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2023-08-10T11:26:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2023-08-10T11:26:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2023-08-10T11:26:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2023-08-10T11:26:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2023-08-10T11:26:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2023-08-10T11:26:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2023-08-10T11:26:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2023-08-10T11:26:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2023-08-10T11:26:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_host": { 2023-08-10T11:26:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_host", 2023-08-10T11:26:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2023-08-10T11:26:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_port": { 2023-08-10T11:26:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_port", 2023-08-10T11:26:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2023-08-10T11:26:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10051", 2023-08-10T11:26:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_sender": { 2023-08-10T11:26:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_sender", 2023-08-10T11:26:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2023-08-10T11:26:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2023-08-10T11:26:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2023-08-10T11:26:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-08-10T11:26:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2023-08-10T11:26:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2023-08-10T11:26:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2023-08-10T11:26:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2023-08-10T11:26:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2023-08-10T11:26:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2023-08-10T11:26:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2023-08-10T11:26:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "services": { 2023-08-10T11:26:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "dashboard": "https://172.21.15.107:8443/" 2023-08-10T11:26:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "always_on_modules": { 2023-08-10T11:26:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "octopus": [ 2023-08-10T11:26:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "balancer", 2023-08-10T11:26:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "crash", 2023-08-10T11:26:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "devicehealth", 2023-08-10T11:26:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator", 2023-08-10T11:26:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_autoscaler", 2023-08-10T11:26:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "progress", 2023-08-10T11:26:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_support", 2023-08-10T11:26:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "status", 2023-08-10T11:26:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "telemetry", 2023-08-10T11:26:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "volumes" 2023-08-10T11:26:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "pacific": [ 2023-08-10T11:26:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "balancer", 2023-08-10T11:26:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "crash", 2023-08-10T11:26:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "devicehealth", 2023-08-10T11:26:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator", 2023-08-10T11:26:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_autoscaler", 2023-08-10T11:26:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "progress", 2023-08-10T11:26:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_support", 2023-08-10T11:26:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "status", 2023-08-10T11:26:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "telemetry", 2023-08-10T11:26:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "volumes" 2023-08-10T11:26:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "quincy": [ 2023-08-10T11:26:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "balancer", 2023-08-10T11:26:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "crash", 2023-08-10T11:26:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "devicehealth", 2023-08-10T11:26:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator", 2023-08-10T11:26:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_autoscaler", 2023-08-10T11:26:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "progress", 2023-08-10T11:26:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_support", 2023-08-10T11:26:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "status", 2023-08-10T11:26:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "telemetry", 2023-08-10T11:26:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "volumes" 2023-08-10T11:26:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2023-08-10T11:26:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "reef": [ 2023-08-10T11:26:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "balancer", 2023-08-10T11:26:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "crash", 2023-08-10T11:26:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "devicehealth", 2023-08-10T11:26:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator", 2023-08-10T11:26:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_autoscaler", 2023-08-10T11:26:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "progress", 2023-08-10T11:26:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_support", 2023-08-10T11:26:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "status", 2023-08-10T11:26:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "telemetry", 2023-08-10T11:26:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "volumes" 2023-08-10T11:26:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "last_failure_osd_epoch": 94, 2023-08-10T11:26:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "active_clients": [ 2023-08-10T11:26:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", 2023-08-10T11:26:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-10T11:26:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2023-08-10T11:26:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-08-10T11:26:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2465393820 2023-08-10T11:26:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "libcephsqlite", 2023-08-10T11:26:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-10T11:26:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2023-08-10T11:26:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-08-10T11:26:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 3205336559 2023-08-10T11:26:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_support", 2023-08-10T11:26:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-10T11:26:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2023-08-10T11:26:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-08-10T11:26:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 3107044030 2023-08-10T11:26:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snap_schedule", 2023-08-10T11:26:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-10T11:26:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2023-08-10T11:26:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-08-10T11:26:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2964806528 2023-08-10T11:26:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snap_schedule", 2023-08-10T11:26:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-10T11:26:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2023-08-10T11:26:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-08-10T11:26:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 3710162531 2023-08-10T11:26:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "volumes", 2023-08-10T11:26:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2023-08-10T11:26:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2023-08-10T11:26:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2023-08-10T11:26:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2023-08-10T11:26:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 3868689117 2023-08-10T11:26:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2023-08-10T11:26:41.979 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:26:41.981 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:40 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3229246960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T11:26:41.981 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:40 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3332918144' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-08-10T11:26:41.981 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:41 smithi195 ceph-mon[129938]: pgmap v1130: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 133 KiB/s wr, 31 op/s 2023-08-10T11:26:41.981 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:40 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3229246960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T11:26:41.982 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:40 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3332918144' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-08-10T11:26:41.982 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:41 smithi157 ceph-mon[129604]: pgmap v1130: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 133 KiB/s wr, 31 op/s 2023-08-10T11:26:41.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.630+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f73f80a1300 msgr2=0x7f73f80a37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:41.982 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.630+0000 7f7411dff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f73f80a1300 0x7f73f80a37c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f740c197d10 tx=0x7f73f4005fb0 comp rx=0 tx=0).stop 2023-08-10T11:26:41.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.630+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 msgr2=0x7f740c196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:26:41.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.630+0000 7f7411dff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 0x7f740c196700 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00d950 tx=0x7f73fc00dd10 comp rx=0 tx=0).stop 2023-08-10T11:26:41.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.631+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 shutdown_connections 2023-08-10T11:26:41.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.631+0000 7f7411dff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f73f80a1300 0x7f73f80a37c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:41.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.631+0000 7f7411dff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f740c1066f0 0x7f740c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:41.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.631+0000 7f7411dff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f740c1006e0 0x7f740c196700 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:41.983 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.631+0000 7f7411dff700 1 --2- 172.21.15.107:0/3332918144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f740c1010a0 0x7f740c196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:26:41.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.631+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 >> 172.21.15.107:0/3332918144 conn(0x7f740c0fc190 msgr2=0x7f740c0fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:26:41.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.631+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 shutdown_connections 2023-08-10T11:26:41.984 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:26:39.631+0000 7f7411dff700 1 -- 172.21.15.107:0/3332918144 wait complete. 2023-08-10T11:26:41.990 DEBUG:tasks.check_counter:Getting stats from a 2023-08-10T11:26:41.990 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.a perf dump 2023-08-10T11:26:41.991 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:40 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3229246960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T11:26:41.992 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:40 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3332918144' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-08-10T11:26:41.992 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:41 smithi107 ceph-mon[127953]: pgmap v1130: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 133 KiB/s wr, 31 op/s 2023-08-10T11:26:42.853 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:26:43.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:43 smithi157 ceph-mon[129604]: pgmap v1131: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-08-10T11:26:43.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:43 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:26:43.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:43 smithi107 ceph-mon[127953]: pgmap v1131: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-08-10T11:26:43.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:43 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:26:43.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:43 smithi195 ceph-mon[129938]: pgmap v1131: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-08-10T11:26:43.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:43 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-08-10T11:26:44.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:44 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:26:44.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:44 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:26:44.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:44 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:26:44.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:44 smithi107 ceph-mon[127953]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:26:44.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:44 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:26:44.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:44 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:26:44.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:44 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:26:44.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:44 smithi195 ceph-mon[129938]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:26:44.453 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:26:44.453 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:26:44.454 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 2071, 2023-08-10T11:26:44.454 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 2073, 2023-08-10T11:26:44.454 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 8921533, 2023-08-10T11:26:44.454 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 644144, 2023-08-10T11:26:44.454 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 9, 2023-08-10T11:26:44.454 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 2, 2023-08-10T11:26:44.454 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.211720380, 2023-08-10T11:26:44.455 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.062900962, 2023-08-10T11:26:44.455 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.070491110, 2023-08-10T11:26:44.455 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.056496327, 2023-08-10T11:26:44.455 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:44.455 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2071, 2023-08-10T11:26:44.455 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.257827260, 2023-08-10T11:26:44.455 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000124494 2023-08-10T11:26:44.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.456 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:44.456 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.456 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.456 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.457 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T11:26:44.457 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T11:26:44.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.457 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:26:44.457 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 2151, 2023-08-10T11:26:44.457 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 2031, 2023-08-10T11:26:44.457 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 11215532, 2023-08-10T11:26:44.457 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 781539, 2023-08-10T11:26:44.458 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 8, 2023-08-10T11:26:44.458 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 4, 2023-08-10T11:26:44.458 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.296058350, 2023-08-10T11:26:44.458 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.099570245, 2023-08-10T11:26:44.458 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.127212436, 2023-08-10T11:26:44.458 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.069068803, 2023-08-10T11:26:44.458 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:44.459 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2030, 2023-08-10T11:26:44.459 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.504401324, 2023-08-10T11:26:44.459 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000248473 2023-08-10T11:26:44.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.459 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:44.459 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.459 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.459 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.460 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 2417632, 2023-08-10T11:26:44.460 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 360128 2023-08-10T11:26:44.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.460 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:26:44.460 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 3794, 2023-08-10T11:26:44.460 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 4252, 2023-08-10T11:26:44.460 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 5333186, 2023-08-10T11:26:44.461 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 2209149, 2023-08-10T11:26:44.461 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 8, 2023-08-10T11:26:44.461 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2023-08-10T11:26:44.461 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.484333777, 2023-08-10T11:26:44.461 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.210589470, 2023-08-10T11:26:44.461 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.104962297, 2023-08-10T11:26:44.461 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.126875166, 2023-08-10T11:26:44.462 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:44.462 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 4250, 2023-08-10T11:26:44.462 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.754604263, 2023-08-10T11:26:44.462 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000177553 2023-08-10T11:26:44.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.462 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:44.462 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.462 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.463 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.463 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 3440, 2023-08-10T11:26:44.463 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 1031392 2023-08-10T11:26:44.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.463 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2023-08-10T11:26:44.463 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2023-08-10T11:26:44.464 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2023-08-10T11:26:44.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.464 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2023-08-10T11:26:44.464 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2023-08-10T11:26:44.464 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2023-08-10T11:26:44.464 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 12119, 2023-08-10T11:26:44.465 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.343816696, 2023-08-10T11:26:44.465 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000028370 2023-08-10T11:26:44.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:44.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.465 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2023-08-10T11:26:44.465 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2023-08-10T11:26:44.465 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2023-08-10T11:26:44.466 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.466 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.466 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:44.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.466 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2023-08-10T11:26:44.466 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 0, 2023-08-10T11:26:44.466 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 0, 2023-08-10T11:26:44.467 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2023-08-10T11:26:44.467 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.467 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.467 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.467 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2023-08-10T11:26:44.467 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 0, 2023-08-10T11:26:44.467 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 0, 2023-08-10T11:26:44.468 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2023-08-10T11:26:44.468 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 0, 2023-08-10T11:26:44.468 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 0, 2023-08-10T11:26:44.468 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 0, 2023-08-10T11:26:44.468 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 576, 2023-08-10T11:26:44.468 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 0, 2023-08-10T11:26:44.468 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 1, 2023-08-10T11:26:44.468 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 575, 2023-08-10T11:26:44.469 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 576, 2023-08-10T11:26:44.469 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 0, 2023-08-10T11:26:44.469 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 0, 2023-08-10T11:26:44.469 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 0, 2023-08-10T11:26:44.469 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 12, 2023-08-10T11:26:44.469 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 0, 2023-08-10T11:26:44.469 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 0, 2023-08-10T11:26:44.469 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 0, 2023-08-10T11:26:44.470 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 0, 2023-08-10T11:26:44.470 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2023-08-10T11:26:44.470 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2023-08-10T11:26:44.470 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 0, 2023-08-10T11:26:44.470 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 0, 2023-08-10T11:26:44.470 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2023-08-10T11:26:44.470 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 0, 2023-08-10T11:26:44.471 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 0, 2023-08-10T11:26:44.471 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 0, 2023-08-10T11:26:44.471 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 0, 2023-08-10T11:26:44.471 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2023-08-10T11:26:44.471 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 0, 2023-08-10T11:26:44.471 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2023-08-10T11:26:44.471 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 0, 2023-08-10T11:26:44.471 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 0, 2023-08-10T11:26:44.472 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 0, 2023-08-10T11:26:44.472 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T11:26:44.472 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2023-08-10T11:26:44.472 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:26:44.472 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:26:44.472 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 0, 2023-08-10T11:26:44.472 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T11:26:44.472 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T11:26:44.473 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 0, 2023-08-10T11:26:44.473 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, 2023-08-10T11:26:44.473 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T11:26:44.473 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 0, 2023-08-10T11:26:44.473 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:26:44.473 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:26:44.473 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:26:44.473 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 0, 2023-08-10T11:26:44.474 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 0, 2023-08-10T11:26:44.474 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 0, 2023-08-10T11:26:44.474 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 0 2023-08-10T11:26:44.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.474 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2023-08-10T11:26:44.474 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2023-08-10T11:26:44.475 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2023-08-10T11:26:44.475 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2023-08-10T11:26:44.475 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 0, 2023-08-10T11:26:44.475 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 0, 2023-08-10T11:26:44.475 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 0, 2023-08-10T11:26:44.476 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2023-08-10T11:26:44.476 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:26:44.476 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 0, 2023-08-10T11:26:44.476 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 0, 2023-08-10T11:26:44.476 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 0, 2023-08-10T11:26:44.476 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2023-08-10T11:26:44.476 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2023-08-10T11:26:44.476 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:26:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:26:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2023-08-10T11:26:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2023-08-10T11:26:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T11:26:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 0, 2023-08-10T11:26:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2023-08-10T11:26:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 0, 2023-08-10T11:26:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2023-08-10T11:26:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2023-08-10T11:26:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2023-08-10T11:26:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 0, 2023-08-10T11:26:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 0, 2023-08-10T11:26:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 0, 2023-08-10T11:26:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 0, 2023-08-10T11:26:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2023-08-10T11:26:44.479 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 0, 2023-08-10T11:26:44.479 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 0, 2023-08-10T11:26:44.479 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 0, 2023-08-10T11:26:44.479 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 0, 2023-08-10T11:26:44.479 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 9, 2023-08-10T11:26:44.479 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2023-08-10T11:26:44.479 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 0, 2023-08-10T11:26:44.480 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 4194304, 2023-08-10T11:26:44.480 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 0, 2023-08-10T11:26:44.480 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 25223466, 2023-08-10T11:26:44.480 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2023-08-10T11:26:44.480 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.480 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.480 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.481 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 6119 2023-08-10T11:26:44.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.481 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2023-08-10T11:26:44.481 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 165, 2023-08-10T11:26:44.481 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 933, 2023-08-10T11:26:44.481 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 768, 2023-08-10T11:26:44.481 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 25, 2023-08-10T11:26:44.481 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 50, 2023-08-10T11:26:44.482 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 25, 2023-08-10T11:26:44.482 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 576, 2023-08-10T11:26:44.482 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 1453, 2023-08-10T11:26:44.482 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 877, 2023-08-10T11:26:44.482 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 0, 2023-08-10T11:26:44.483 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 0, 2023-08-10T11:26:44.483 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 0, 2023-08-10T11:26:44.483 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 45404, 2023-08-10T11:26:44.483 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 207152 2023-08-10T11:26:44.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.484 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2023-08-10T11:26:44.484 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 0, 2023-08-10T11:26:44.484 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 0, 2023-08-10T11:26:44.485 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 0, 2023-08-10T11:26:44.485 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 0, 2023-08-10T11:26:44.485 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 0, 2023-08-10T11:26:44.485 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2023-08-10T11:26:44.486 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.486 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.486 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.486 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2023-08-10T11:26:44.487 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.487 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.487 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.487 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2023-08-10T11:26:44.487 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.487 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.487 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.488 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2023-08-10T11:26:44.488 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.488 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.488 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.488 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2023-08-10T11:26:44.488 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.489 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.489 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.489 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2023-08-10T11:26:44.489 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.489 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.489 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.490 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2023-08-10T11:26:44.490 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.490 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.490 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.490 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2023-08-10T11:26:44.490 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.491 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.491 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.491 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2023-08-10T11:26:44.491 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.491 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.491 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.492 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2023-08-10T11:26:44.492 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.492 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.492 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.492 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2023-08-10T11:26:44.492 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.493 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.493 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.493 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2023-08-10T11:26:44.493 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.493 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.493 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.494 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2023-08-10T11:26:44.494 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.494 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.494 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.494 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2023-08-10T11:26:44.494 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.495 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.495 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.495 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2023-08-10T11:26:44.495 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.495 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.496 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.496 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2023-08-10T11:26:44.496 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.496 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.497 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.497 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2023-08-10T11:26:44.497 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.497 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.497 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.497 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2023-08-10T11:26:44.498 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.498 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.498 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.498 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2023-08-10T11:26:44.498 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.499 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.499 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.499 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2023-08-10T11:26:44.499 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.499 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.499 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.500 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2023-08-10T11:26:44.500 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.500 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.500 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.500 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2023-08-10T11:26:44.500 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.500 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.501 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.501 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2023-08-10T11:26:44.501 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.501 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.501 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.501 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2023-08-10T11:26:44.502 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.502 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.502 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.502 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2023-08-10T11:26:44.502 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.502 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.502 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.503 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2023-08-10T11:26:44.503 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.503 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.503 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.503 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2023-08-10T11:26:44.504 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.504 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.504 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.504 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2023-08-10T11:26:44.504 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.504 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.504 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.505 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2023-08-10T11:26:44.505 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.505 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.505 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.505 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:26:44.505 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:26:44.506 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2023-08-10T11:26:44.506 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.506 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.506 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:44.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.507 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2023-08-10T11:26:44.507 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 2, 2023-08-10T11:26:44.507 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 3, 2023-08-10T11:26:44.507 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 1, 2023-08-10T11:26:44.507 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 2, 2023-08-10T11:26:44.507 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2023-08-10T11:26:44.508 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 0, 2023-08-10T11:26:44.508 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 0, 2023-08-10T11:26:44.508 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 4843 2023-08-10T11:26:44.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.508 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2023-08-10T11:26:44.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:26:44.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2023-08-10T11:26:44.508 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:26:44.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:26:44.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:26:44.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:26:44.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:26:44.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:26:44.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:26:44.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:26:44.509 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:26:44.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:26:44.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:26:44.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:26:44.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:26:44.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2023-08-10T11:26:44.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:26:44.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2023-08-10T11:26:44.510 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:26:44.511 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:26:44.511 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:26:44.511 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:26:44.511 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:26:44.511 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:26:44.511 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:26:44.511 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2023-08-10T11:26:44.511 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:26:44.512 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:26:44.512 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:26:44.512 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2023-08-10T11:26:44.512 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2023-08-10T11:26:44.512 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2023-08-10T11:26:44.512 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:26:44.512 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:26:44.512 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:26:44.513 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:26:44.513 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 216695, 2023-08-10T11:26:44.513 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 68, 2023-08-10T11:26:44.513 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:26:44.513 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2023-08-10T11:26:44.513 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2023-08-10T11:26:44.513 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2023-08-10T11:26:44.514 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:26:44.514 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2023-08-10T11:26:44.514 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:26:44.514 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2023-08-10T11:26:44.514 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 9208, 2023-08-10T11:26:44.514 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 176, 2023-08-10T11:26:44.514 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:26:44.514 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:26:44.515 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2023-08-10T11:26:44.515 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2023-08-10T11:26:44.515 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 992911, 2023-08-10T11:26:44.515 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 33753, 2023-08-10T11:26:44.515 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2023-08-10T11:26:44.515 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2023-08-10T11:26:44.515 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2023-08-10T11:26:44.516 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2023-08-10T11:26:44.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.516 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2023-08-10T11:26:44.516 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2023-08-10T11:26:44.516 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2023-08-10T11:26:44.516 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 7213, 2023-08-10T11:26:44.516 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 21, 2023-08-10T11:26:44.517 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 3, 2023-08-10T11:26:44.517 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 7213, 2023-08-10T11:26:44.517 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2023-08-10T11:26:44.517 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 7213, 2023-08-10T11:26:44.517 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 31.884514094, 2023-08-10T11:26:44.517 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.004420423 2023-08-10T11:26:44.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.518 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2023-08-10T11:26:44.518 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2023-08-10T11:26:44.518 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 7213, 2023-08-10T11:26:44.518 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 7214 2023-08-10T11:26:44.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.518 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 7213, 2023-08-10T11:26:44.518 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 7213, 2023-08-10T11:26:44.519 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 0, 2023-08-10T11:26:44.519 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2023-08-10T11:26:44.519 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2023-08-10T11:26:44.519 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 4347, 2023-08-10T11:26:44.519 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 0, 2023-08-10T11:26:44.519 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 2864, 2023-08-10T11:26:44.519 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 0, 2023-08-10T11:26:44.519 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 0, 2023-08-10T11:26:44.520 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2023-08-10T11:26:44.520 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2023-08-10T11:26:44.520 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2023-08-10T11:26:44.520 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 0, 2023-08-10T11:26:44.520 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 0, 2023-08-10T11:26:44.520 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2023-08-10T11:26:44.520 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2023-08-10T11:26:44.521 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2023-08-10T11:26:44.521 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 1, 2023-08-10T11:26:44.521 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 0, 2023-08-10T11:26:44.521 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:26:44.521 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2023-08-10T11:26:44.521 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:26:44.521 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2023-08-10T11:26:44.521 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2023-08-10T11:26:44.522 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2023-08-10T11:26:44.522 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:26:44.522 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2023-08-10T11:26:44.522 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:26:44.522 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 0, 2023-08-10T11:26:44.522 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2023-08-10T11:26:44.522 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2023-08-10T11:26:44.522 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2023-08-10T11:26:44.523 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2023-08-10T11:26:44.523 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2023-08-10T11:26:44.523 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2023-08-10T11:26:44.523 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2023-08-10T11:26:44.523 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2023-08-10T11:26:44.523 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2023-08-10T11:26:44.523 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2023-08-10T11:26:44.523 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2023-08-10T11:26:44.524 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2023-08-10T11:26:44.524 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2023-08-10T11:26:44.524 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2023-08-10T11:26:44.524 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2023-08-10T11:26:44.524 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2023-08-10T11:26:44.524 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 158, 2023-08-10T11:26:44.524 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2023-08-10T11:26:44.525 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 67, 2023-08-10T11:26:44.525 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 8, 2023-08-10T11:26:44.525 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 13, 2023-08-10T11:26:44.525 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 5, 2023-08-10T11:26:44.525 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2023-08-10T11:26:44.525 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 0, 2023-08-10T11:26:44.525 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 2, 2023-08-10T11:26:44.525 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 0 2023-08-10T11:26:44.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.526 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2023-08-10T11:26:44.526 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 0, 2023-08-10T11:26:44.526 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:26:44.526 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2023-08-10T11:26:44.526 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2023-08-10T11:26:44.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.527 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2023-08-10T11:26:44.527 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 0 2023-08-10T11:26:44.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.527 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2023-08-10T11:26:44.527 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2023-08-10T11:26:44.527 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T11:26:44.527 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2023-08-10T11:26:44.528 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 0, 2023-08-10T11:26:44.528 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 0, 2023-08-10T11:26:44.528 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2023-08-10T11:26:44.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.528 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:26:44.528 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:44.528 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2023-08-10T11:26:44.529 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:44.529 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 8012, 2023-08-10T11:26:44.529 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 24706007, 2023-08-10T11:26:44.529 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:44.529 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 8012, 2023-08-10T11:26:44.529 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:44.529 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:44.529 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 8012, 2023-08-10T11:26:44.530 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 24706007, 2023-08-10T11:26:44.530 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:44.530 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.530 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.530 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.530 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:44.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.531 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2023-08-10T11:26:44.531 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:44.531 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2023-08-10T11:26:44.531 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:44.531 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:44.531 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:44.531 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:44.531 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:44.532 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 7213, 2023-08-10T11:26:44.532 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 21037581, 2023-08-10T11:26:44.532 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 7213, 2023-08-10T11:26:44.532 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 21037581, 2023-08-10T11:26:44.532 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:44.532 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.532 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.532 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2023-08-10T11:26:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2023-08-10T11:26:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 7213, 2023-08-10T11:26:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 7213, 2023-08-10T11:26:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 7213, 2023-08-10T11:26:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 7213, 2023-08-10T11:26:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:26:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2023-08-10T11:26:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2023-08-10T11:26:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2023-08-10T11:26:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x55a0bdf1a500": { 2023-08-10T11:26:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2023-08-10T11:26:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2023-08-10T11:26:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2023-08-10T11:26:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:44.540 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:26:44.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:44 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:26:44.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:44 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-08-10T11:26:44.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:44 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-08-10T11:26:44.541 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:44 smithi157 ceph-mon[129604]: from='mgr.15747 172.21.15.107:0/3675350396' entity='mgr.x' 2023-08-10T11:26:44.964 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-08-10T11:26:44.965 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-08-10T11:26:44.965 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2023-08-10T11:26:44.965 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2023-08-10T11:26:44.965 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2023-08-10T11:26:44.965 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-08-10T11:26:44.966 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T11:26:44.966 DEBUG:tasks.check_counter:Getting stats from d 2023-08-10T11:26:44.966 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.d perf dump 2023-08-10T11:26:45.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:45 smithi195 ceph-mon[129938]: pgmap v1132: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 105 KiB/s wr, 27 op/s 2023-08-10T11:26:45.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:45 smithi157 ceph-mon[129604]: pgmap v1132: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 105 KiB/s wr, 27 op/s 2023-08-10T11:26:45.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:45 smithi107 ceph-mon[127953]: pgmap v1132: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 105 KiB/s wr, 27 op/s 2023-08-10T11:26:45.690 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:26:47.215 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:26:47.216 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:26:47.216 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 3981, 2023-08-10T11:26:47.216 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 3861, 2023-08-10T11:26:47.216 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 11180339, 2023-08-10T11:26:47.216 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 1352198, 2023-08-10T11:26:47.216 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 6, 2023-08-10T11:26:47.217 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 2, 2023-08-10T11:26:47.217 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.541635073, 2023-08-10T11:26:47.217 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.211394728, 2023-08-10T11:26:47.217 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.173497791, 2023-08-10T11:26:47.217 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.131912677, 2023-08-10T11:26:47.217 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:47.217 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 3860, 2023-08-10T11:26:47.218 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.904353524, 2023-08-10T11:26:47.218 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000234288 2023-08-10T11:26:47.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.218 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:47.218 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.218 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.218 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.219 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 2419600, 2023-08-10T11:26:47.219 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 363840 2023-08-10T11:26:47.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.219 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:26:47.219 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 3415, 2023-08-10T11:26:47.219 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 3880, 2023-08-10T11:26:47.219 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 21899875, 2023-08-10T11:26:47.219 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 2093013, 2023-08-10T11:26:47.220 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 8, 2023-08-10T11:26:47.220 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2023-08-10T11:26:47.220 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.376335755, 2023-08-10T11:26:47.220 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.123106877, 2023-08-10T11:26:47.220 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.130497031, 2023-08-10T11:26:47.221 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.092997289, 2023-08-10T11:26:47.221 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:47.221 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 3877, 2023-08-10T11:26:47.222 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.529348814, 2023-08-10T11:26:47.222 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000136535 2023-08-10T11:26:47.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.222 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:47.222 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.222 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.222 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.223 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 480, 2023-08-10T11:26:47.223 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 1031824 2023-08-10T11:26:47.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.223 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:26:47.224 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 770, 2023-08-10T11:26:47.224 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 770, 2023-08-10T11:26:47.224 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 4389465, 2023-08-10T11:26:47.224 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 238686, 2023-08-10T11:26:47.224 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 9, 2023-08-10T11:26:47.224 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2023-08-10T11:26:47.224 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.108171872, 2023-08-10T11:26:47.225 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.026017241, 2023-08-10T11:26:47.225 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.041729945, 2023-08-10T11:26:47.225 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.032220428, 2023-08-10T11:26:47.225 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:47.225 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 769, 2023-08-10T11:26:47.225 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.234661834, 2023-08-10T11:26:47.225 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000305151 2023-08-10T11:26:47.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.226 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:47.226 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.226 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.226 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.227 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-08-10T11:26:47.227 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 448 2023-08-10T11:26:47.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.227 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2023-08-10T11:26:47.227 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2023-08-10T11:26:47.227 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2023-08-10T11:26:47.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.228 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2023-08-10T11:26:47.228 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2023-08-10T11:26:47.228 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2023-08-10T11:26:47.228 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 12453, 2023-08-10T11:26:47.228 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.365965087, 2023-08-10T11:26:47.228 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000029387 2023-08-10T11:26:47.228 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:47.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.229 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2023-08-10T11:26:47.229 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2023-08-10T11:26:47.229 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2023-08-10T11:26:47.229 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.229 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.229 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:47.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.230 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2023-08-10T11:26:47.230 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 0, 2023-08-10T11:26:47.230 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 0, 2023-08-10T11:26:47.230 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2023-08-10T11:26:47.231 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.231 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.231 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.232 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2023-08-10T11:26:47.232 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 0, 2023-08-10T11:26:47.232 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 0, 2023-08-10T11:26:47.233 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2023-08-10T11:26:47.233 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 0, 2023-08-10T11:26:47.233 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 0, 2023-08-10T11:26:47.234 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 0, 2023-08-10T11:26:47.234 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 441, 2023-08-10T11:26:47.234 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 13, 2023-08-10T11:26:47.235 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 421, 2023-08-10T11:26:47.235 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 7, 2023-08-10T11:26:47.235 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 422, 2023-08-10T11:26:47.235 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 0, 2023-08-10T11:26:47.235 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 0, 2023-08-10T11:26:47.235 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 0, 2023-08-10T11:26:47.235 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 4, 2023-08-10T11:26:47.236 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 0, 2023-08-10T11:26:47.236 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 0, 2023-08-10T11:26:47.236 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 0, 2023-08-10T11:26:47.236 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 0, 2023-08-10T11:26:47.236 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2023-08-10T11:26:47.236 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2023-08-10T11:26:47.236 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 0, 2023-08-10T11:26:47.237 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 0, 2023-08-10T11:26:47.237 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2023-08-10T11:26:47.237 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 0, 2023-08-10T11:26:47.237 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 0, 2023-08-10T11:26:47.237 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 0, 2023-08-10T11:26:47.237 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 0, 2023-08-10T11:26:47.237 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2023-08-10T11:26:47.237 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 0, 2023-08-10T11:26:47.238 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2023-08-10T11:26:47.238 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 0, 2023-08-10T11:26:47.238 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 0, 2023-08-10T11:26:47.238 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 0, 2023-08-10T11:26:47.238 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T11:26:47.238 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2023-08-10T11:26:47.238 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:26:47.238 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:26:47.239 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 0, 2023-08-10T11:26:47.239 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T11:26:47.239 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T11:26:47.239 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 0, 2023-08-10T11:26:47.239 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, 2023-08-10T11:26:47.239 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T11:26:47.239 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 0, 2023-08-10T11:26:47.239 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:26:47.240 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:26:47.240 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:26:47.240 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 0, 2023-08-10T11:26:47.240 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 0, 2023-08-10T11:26:47.240 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 0, 2023-08-10T11:26:47.240 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 0 2023-08-10T11:26:47.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.241 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2023-08-10T11:26:47.241 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2023-08-10T11:26:47.241 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2023-08-10T11:26:47.241 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2023-08-10T11:26:47.241 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 0, 2023-08-10T11:26:47.241 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 0, 2023-08-10T11:26:47.241 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 0, 2023-08-10T11:26:47.242 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2023-08-10T11:26:47.242 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:26:47.242 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 0, 2023-08-10T11:26:47.242 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 0, 2023-08-10T11:26:47.242 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 0, 2023-08-10T11:26:47.242 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2023-08-10T11:26:47.242 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2023-08-10T11:26:47.242 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:26:47.243 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:26:47.243 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2023-08-10T11:26:47.243 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2023-08-10T11:26:47.243 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T11:26:47.243 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 0, 2023-08-10T11:26:47.243 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2023-08-10T11:26:47.243 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 0, 2023-08-10T11:26:47.243 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2023-08-10T11:26:47.244 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2023-08-10T11:26:47.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.244 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2023-08-10T11:26:47.244 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 0, 2023-08-10T11:26:47.244 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 0, 2023-08-10T11:26:47.244 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 0, 2023-08-10T11:26:47.244 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 0, 2023-08-10T11:26:47.245 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2023-08-10T11:26:47.245 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 0, 2023-08-10T11:26:47.245 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 0, 2023-08-10T11:26:47.245 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 0, 2023-08-10T11:26:47.245 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 0, 2023-08-10T11:26:47.245 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 11, 2023-08-10T11:26:47.246 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2023-08-10T11:26:47.246 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 0, 2023-08-10T11:26:47.246 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 4194304, 2023-08-10T11:26:47.246 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 0, 2023-08-10T11:26:47.246 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 37130353, 2023-08-10T11:26:47.246 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2023-08-10T11:26:47.247 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.247 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.247 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.247 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 8580 2023-08-10T11:26:47.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.247 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2023-08-10T11:26:47.248 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 47, 2023-08-10T11:26:47.248 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 1236, 2023-08-10T11:26:47.248 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 1189, 2023-08-10T11:26:47.248 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 20, 2023-08-10T11:26:47.248 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 62, 2023-08-10T11:26:47.248 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 42, 2023-08-10T11:26:47.248 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 441, 2023-08-10T11:26:47.248 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 1860, 2023-08-10T11:26:47.249 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 1419, 2023-08-10T11:26:47.249 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 0, 2023-08-10T11:26:47.249 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 0, 2023-08-10T11:26:47.249 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 0, 2023-08-10T11:26:47.249 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 45272, 2023-08-10T11:26:47.249 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 207152 2023-08-10T11:26:47.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.250 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2023-08-10T11:26:47.250 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 0, 2023-08-10T11:26:47.250 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 0, 2023-08-10T11:26:47.250 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 0, 2023-08-10T11:26:47.250 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 0, 2023-08-10T11:26:47.250 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 0, 2023-08-10T11:26:47.251 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2023-08-10T11:26:47.251 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.251 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.251 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.251 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2023-08-10T11:26:47.251 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.252 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.252 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.252 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2023-08-10T11:26:47.252 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.252 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.252 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.253 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2023-08-10T11:26:47.253 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.253 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.253 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.253 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2023-08-10T11:26:47.253 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.254 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.254 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.254 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2023-08-10T11:26:47.254 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.254 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.254 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.255 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2023-08-10T11:26:47.255 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.255 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.255 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.255 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2023-08-10T11:26:47.255 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.255 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.256 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.256 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2023-08-10T11:26:47.256 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.256 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.256 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.257 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2023-08-10T11:26:47.257 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.257 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.257 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.257 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2023-08-10T11:26:47.257 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.257 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.258 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.258 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2023-08-10T11:26:47.258 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.258 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.258 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.258 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2023-08-10T11:26:47.259 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.259 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.259 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.259 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2023-08-10T11:26:47.259 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.259 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.259 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.260 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2023-08-10T11:26:47.260 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.260 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.260 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.260 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2023-08-10T11:26:47.261 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.261 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.261 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.261 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2023-08-10T11:26:47.261 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.261 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.261 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.262 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2023-08-10T11:26:47.262 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.262 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.262 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.262 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2023-08-10T11:26:47.263 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.263 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.263 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.263 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2023-08-10T11:26:47.263 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.263 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.263 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.264 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2023-08-10T11:26:47.264 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.264 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.264 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.264 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2023-08-10T11:26:47.264 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.265 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.265 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.265 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2023-08-10T11:26:47.265 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.265 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.265 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.266 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2023-08-10T11:26:47.266 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.266 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.266 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.266 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2023-08-10T11:26:47.266 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.267 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.267 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.267 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2023-08-10T11:26:47.267 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.267 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.267 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.268 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2023-08-10T11:26:47.268 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.268 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.268 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.268 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2023-08-10T11:26:47.268 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.268 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2023-08-10T11:26:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.269 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:26:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:26:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2023-08-10T11:26:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:47.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2023-08-10T11:26:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 2, 2023-08-10T11:26:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 3, 2023-08-10T11:26:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 1, 2023-08-10T11:26:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 3, 2023-08-10T11:26:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2023-08-10T11:26:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 0, 2023-08-10T11:26:47.271 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 0, 2023-08-10T11:26:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 6203 2023-08-10T11:26:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2023-08-10T11:26:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:26:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2023-08-10T11:26:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:26:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:26:47.272 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:26:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:26:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:26:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:26:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:26:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:26:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:26:47.273 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:26:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:26:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:26:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:26:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2023-08-10T11:26:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:26:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2023-08-10T11:26:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:26:47.274 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:26:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:26:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:26:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:26:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:26:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:26:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2023-08-10T11:26:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:26:47.275 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:26:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:26:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2023-08-10T11:26:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2023-08-10T11:26:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2023-08-10T11:26:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:26:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:26:47.276 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:26:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:26:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 208599, 2023-08-10T11:26:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 63, 2023-08-10T11:26:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:26:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2023-08-10T11:26:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2023-08-10T11:26:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2023-08-10T11:26:47.277 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:26:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2023-08-10T11:26:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:26:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2023-08-10T11:26:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 9208, 2023-08-10T11:26:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 176, 2023-08-10T11:26:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:26:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:26:47.278 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2023-08-10T11:26:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2023-08-10T11:26:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 672945, 2023-08-10T11:26:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 35126, 2023-08-10T11:26:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2023-08-10T11:26:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2023-08-10T11:26:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2023-08-10T11:26:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2023-08-10T11:26:47.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2023-08-10T11:26:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2023-08-10T11:26:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2023-08-10T11:26:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 7356, 2023-08-10T11:26:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 21, 2023-08-10T11:26:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 3, 2023-08-10T11:26:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 7356, 2023-08-10T11:26:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2023-08-10T11:26:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 7356, 2023-08-10T11:26:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 35.770454746, 2023-08-10T11:26:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.004862758 2023-08-10T11:26:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2023-08-10T11:26:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2023-08-10T11:26:47.281 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 7356, 2023-08-10T11:26:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 7357 2023-08-10T11:26:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 7356, 2023-08-10T11:26:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 7356, 2023-08-10T11:26:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 0, 2023-08-10T11:26:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2023-08-10T11:26:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2023-08-10T11:26:47.282 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 4333, 2023-08-10T11:26:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 0, 2023-08-10T11:26:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 3021, 2023-08-10T11:26:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 0, 2023-08-10T11:26:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 0, 2023-08-10T11:26:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2023-08-10T11:26:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2023-08-10T11:26:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2023-08-10T11:26:47.283 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 0, 2023-08-10T11:26:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 0, 2023-08-10T11:26:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2023-08-10T11:26:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2023-08-10T11:26:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2023-08-10T11:26:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 1, 2023-08-10T11:26:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 0, 2023-08-10T11:26:47.284 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:26:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2023-08-10T11:26:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:26:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2023-08-10T11:26:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2023-08-10T11:26:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2023-08-10T11:26:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:26:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2023-08-10T11:26:47.285 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:26:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 0, 2023-08-10T11:26:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2023-08-10T11:26:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2023-08-10T11:26:47.286 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2023-08-10T11:26:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2023-08-10T11:26:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2023-08-10T11:26:47.287 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2023-08-10T11:26:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2023-08-10T11:26:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2023-08-10T11:26:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2023-08-10T11:26:47.288 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2023-08-10T11:26:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2023-08-10T11:26:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2023-08-10T11:26:47.289 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2023-08-10T11:26:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2023-08-10T11:26:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2023-08-10T11:26:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2023-08-10T11:26:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 158, 2023-08-10T11:26:47.290 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2023-08-10T11:26:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 67, 2023-08-10T11:26:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 7, 2023-08-10T11:26:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 11, 2023-08-10T11:26:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 4, 2023-08-10T11:26:47.291 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2023-08-10T11:26:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 0, 2023-08-10T11:26:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 2, 2023-08-10T11:26:47.292 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 0 2023-08-10T11:26:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2023-08-10T11:26:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 0, 2023-08-10T11:26:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:26:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2023-08-10T11:26:47.293 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2023-08-10T11:26:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2023-08-10T11:26:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 0 2023-08-10T11:26:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2023-08-10T11:26:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2023-08-10T11:26:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T11:26:47.294 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2023-08-10T11:26:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 0, 2023-08-10T11:26:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 0, 2023-08-10T11:26:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2023-08-10T11:26:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:26:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2023-08-10T11:26:47.295 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 8162, 2023-08-10T11:26:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 36691571, 2023-08-10T11:26:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 8162, 2023-08-10T11:26:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:47.296 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 8162, 2023-08-10T11:26:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 36691571, 2023-08-10T11:26:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:47.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2023-08-10T11:26:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2023-08-10T11:26:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:47.298 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 7356, 2023-08-10T11:26:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 33000363, 2023-08-10T11:26:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 7356, 2023-08-10T11:26:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 33000363, 2023-08-10T11:26:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.299 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2023-08-10T11:26:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2023-08-10T11:26:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:47.300 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 7356, 2023-08-10T11:26:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 7356, 2023-08-10T11:26:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 7356, 2023-08-10T11:26:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 7356, 2023-08-10T11:26:47.301 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:26:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:47.302 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2023-08-10T11:26:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:47.303 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2023-08-10T11:26:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2023-08-10T11:26:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:47.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x55f0d476e500": { 2023-08-10T11:26:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2023-08-10T11:26:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:47.305 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2023-08-10T11:26:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2023-08-10T11:26:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:47.306 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:47.307 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:47.307 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:26:47.307 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:47 smithi107 ceph-mon[127953]: pgmap v1133: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 139 KiB/s wr, 26 op/s 2023-08-10T11:26:47.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:47 smithi195 ceph-mon[129938]: pgmap v1133: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 139 KiB/s wr, 26 op/s 2023-08-10T11:26:47.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:47 smithi157 ceph-mon[129604]: pgmap v1133: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 139 KiB/s wr, 26 op/s 2023-08-10T11:26:47.679 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2023-08-10T11:26:47.680 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2023-08-10T11:26:47.680 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update=0 2023-08-10T11:26:47.680 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update_receipt=0 2023-08-10T11:26:47.680 INFO:tasks.check_counter:Daemon mds.d mds.root_rsnaps=0 2023-08-10T11:26:47.681 INFO:tasks.check_counter:Daemon mds.d mds_server.req_mksnap_latency.avgcount=0 2023-08-10T11:26:47.681 INFO:tasks.check_counter:Daemon mds.d mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T11:26:47.681 DEBUG:tasks.check_counter:Getting stats from g 2023-08-10T11:26:47.681 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.g perf dump 2023-08-10T11:26:48.405 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:26:49.187 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:49 smithi107 ceph-mon[127953]: pgmap v1134: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 74 KiB/s wr, 22 op/s 2023-08-10T11:26:49.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:49 smithi195 ceph-mon[129938]: pgmap v1134: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 74 KiB/s wr, 22 op/s 2023-08-10T11:26:49.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:49 smithi157 ceph-mon[129604]: pgmap v1134: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 74 KiB/s wr, 22 op/s 2023-08-10T11:26:49.847 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:26:49.847 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:26:49.847 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 2187, 2023-08-10T11:26:49.847 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 2189, 2023-08-10T11:26:49.847 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 13140741, 2023-08-10T11:26:49.847 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 680215, 2023-08-10T11:26:49.848 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 9, 2023-08-10T11:26:49.848 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2023-08-10T11:26:49.848 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.247427573, 2023-08-10T11:26:49.848 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.074373640, 2023-08-10T11:26:49.848 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.080002099, 2023-08-10T11:26:49.848 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.070134012, 2023-08-10T11:26:49.848 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:49.849 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2187, 2023-08-10T11:26:49.849 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.303007952, 2023-08-10T11:26:49.849 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000138549 2023-08-10T11:26:49.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.849 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:49.849 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.849 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.849 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.850 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T11:26:49.850 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T11:26:49.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.850 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:26:49.850 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 1275, 2023-08-10T11:26:49.850 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 1735, 2023-08-10T11:26:49.850 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 11657378, 2023-08-10T11:26:49.851 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 1512416, 2023-08-10T11:26:49.851 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 13, 2023-08-10T11:26:49.851 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 6, 2023-08-10T11:26:49.851 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.210719797, 2023-08-10T11:26:49.851 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.076196472, 2023-08-10T11:26:49.851 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.066972650, 2023-08-10T11:26:49.851 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.050969577, 2023-08-10T11:26:49.852 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:49.852 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1733, 2023-08-10T11:26:49.852 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.473171798, 2023-08-10T11:26:49.852 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000273036 2023-08-10T11:26:49.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.852 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:49.852 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.852 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.853 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.853 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 3600, 2023-08-10T11:26:49.853 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 1118368 2023-08-10T11:26:49.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.853 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:26:49.853 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 4746, 2023-08-10T11:26:49.854 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 4627, 2023-08-10T11:26:49.854 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 11988542, 2023-08-10T11:26:49.854 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 1589451, 2023-08-10T11:26:49.854 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2023-08-10T11:26:49.854 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2023-08-10T11:26:49.854 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.555395390, 2023-08-10T11:26:49.854 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.188002948, 2023-08-10T11:26:49.854 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.189604768, 2023-08-10T11:26:49.855 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.149847975, 2023-08-10T11:26:49.855 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:49.855 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 4626, 2023-08-10T11:26:49.855 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.716412570, 2023-08-10T11:26:49.855 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000154866 2023-08-10T11:26:49.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.855 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:49.855 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.856 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.856 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.856 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 2418176, 2023-08-10T11:26:49.856 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 361312 2023-08-10T11:26:49.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.856 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2023-08-10T11:26:49.857 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2023-08-10T11:26:49.857 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2023-08-10T11:26:49.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.857 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2023-08-10T11:26:49.857 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2023-08-10T11:26:49.857 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2023-08-10T11:26:49.857 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 12289, 2023-08-10T11:26:49.857 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.366375006, 2023-08-10T11:26:49.858 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000029813 2023-08-10T11:26:49.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:49.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.858 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2023-08-10T11:26:49.858 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2023-08-10T11:26:49.858 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2023-08-10T11:26:49.858 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.858 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.859 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.859 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:49.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.859 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2023-08-10T11:26:49.859 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 0, 2023-08-10T11:26:49.859 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 0, 2023-08-10T11:26:49.859 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2023-08-10T11:26:49.859 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.860 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.860 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.860 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2023-08-10T11:26:49.860 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 0, 2023-08-10T11:26:49.860 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 0, 2023-08-10T11:26:49.860 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2023-08-10T11:26:49.860 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 0, 2023-08-10T11:26:49.861 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 0, 2023-08-10T11:26:49.861 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 0, 2023-08-10T11:26:49.861 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 1867, 2023-08-10T11:26:49.861 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 19, 2023-08-10T11:26:49.861 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 1585, 2023-08-10T11:26:49.861 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 263, 2023-08-10T11:26:49.861 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 1839, 2023-08-10T11:26:49.861 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 0, 2023-08-10T11:26:49.862 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 0, 2023-08-10T11:26:49.862 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 0, 2023-08-10T11:26:49.862 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 4, 2023-08-10T11:26:49.862 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 0, 2023-08-10T11:26:49.862 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 0, 2023-08-10T11:26:49.862 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 0, 2023-08-10T11:26:49.862 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 0, 2023-08-10T11:26:49.862 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2023-08-10T11:26:49.863 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2023-08-10T11:26:49.863 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 0, 2023-08-10T11:26:49.863 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 0, 2023-08-10T11:26:49.863 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2023-08-10T11:26:49.863 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 0, 2023-08-10T11:26:49.863 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 0, 2023-08-10T11:26:49.863 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 0, 2023-08-10T11:26:49.863 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 0, 2023-08-10T11:26:49.864 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2023-08-10T11:26:49.864 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 0, 2023-08-10T11:26:49.864 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2023-08-10T11:26:49.864 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 0, 2023-08-10T11:26:49.864 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 0, 2023-08-10T11:26:49.864 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 0, 2023-08-10T11:26:49.864 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T11:26:49.864 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2023-08-10T11:26:49.865 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:26:49.865 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:26:49.865 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 0, 2023-08-10T11:26:49.865 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T11:26:49.865 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T11:26:49.865 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 0, 2023-08-10T11:26:49.865 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, 2023-08-10T11:26:49.865 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T11:26:49.866 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 0, 2023-08-10T11:26:49.866 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:26:49.866 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:26:49.866 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:26:49.866 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 0, 2023-08-10T11:26:49.866 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 0, 2023-08-10T11:26:49.866 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 0, 2023-08-10T11:26:49.867 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 0 2023-08-10T11:26:49.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.867 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2023-08-10T11:26:49.867 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2023-08-10T11:26:49.867 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2023-08-10T11:26:49.867 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2023-08-10T11:26:49.867 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 0, 2023-08-10T11:26:49.867 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 0, 2023-08-10T11:26:49.868 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 0, 2023-08-10T11:26:49.868 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2023-08-10T11:26:49.868 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:26:49.868 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 0, 2023-08-10T11:26:49.868 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 0, 2023-08-10T11:26:49.868 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 0, 2023-08-10T11:26:49.868 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2023-08-10T11:26:49.868 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2023-08-10T11:26:49.869 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:26:49.869 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:26:49.869 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2023-08-10T11:26:49.869 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2023-08-10T11:26:49.869 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T11:26:49.869 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 0, 2023-08-10T11:26:49.870 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2023-08-10T11:26:49.870 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 0, 2023-08-10T11:26:49.870 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2023-08-10T11:26:49.870 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2023-08-10T11:26:49.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.870 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2023-08-10T11:26:49.870 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 0, 2023-08-10T11:26:49.870 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 0, 2023-08-10T11:26:49.871 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 0, 2023-08-10T11:26:49.871 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 0, 2023-08-10T11:26:49.871 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2023-08-10T11:26:49.871 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 0, 2023-08-10T11:26:49.871 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 0, 2023-08-10T11:26:49.871 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 0, 2023-08-10T11:26:49.871 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 0, 2023-08-10T11:26:49.871 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 12, 2023-08-10T11:26:49.872 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2023-08-10T11:26:49.872 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 0, 2023-08-10T11:26:49.872 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 4194304, 2023-08-10T11:26:49.872 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 0, 2023-08-10T11:26:49.872 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 36499520, 2023-08-10T11:26:49.872 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2023-08-10T11:26:49.872 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.873 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.873 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.873 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 9140 2023-08-10T11:26:49.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.873 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2023-08-10T11:26:49.873 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 1465, 2023-08-10T11:26:49.873 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 2607, 2023-08-10T11:26:49.874 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 1142, 2023-08-10T11:26:49.874 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 72, 2023-08-10T11:26:49.874 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 111, 2023-08-10T11:26:49.874 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 39, 2023-08-10T11:26:49.874 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 1867, 2023-08-10T11:26:49.874 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 3503, 2023-08-10T11:26:49.874 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 1636, 2023-08-10T11:26:49.874 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 0, 2023-08-10T11:26:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 0, 2023-08-10T11:26:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 0, 2023-08-10T11:26:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 49848, 2023-08-10T11:26:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 207152 2023-08-10T11:26:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2023-08-10T11:26:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 0, 2023-08-10T11:26:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 0, 2023-08-10T11:26:49.876 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 0, 2023-08-10T11:26:49.876 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 0, 2023-08-10T11:26:49.876 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 0, 2023-08-10T11:26:49.876 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2023-08-10T11:26:49.876 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.876 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.876 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.877 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2023-08-10T11:26:49.877 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.877 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.877 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.877 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2023-08-10T11:26:49.877 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.877 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.878 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.878 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2023-08-10T11:26:49.878 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.878 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.878 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.878 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2023-08-10T11:26:49.879 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.879 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.879 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.879 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2023-08-10T11:26:49.879 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.879 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.879 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.880 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2023-08-10T11:26:49.880 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.880 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.880 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.880 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2023-08-10T11:26:49.881 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.881 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.881 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.881 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2023-08-10T11:26:49.881 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.881 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.881 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.882 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2023-08-10T11:26:49.882 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.882 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.882 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.882 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2023-08-10T11:26:49.882 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.883 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.883 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.883 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2023-08-10T11:26:49.883 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.883 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.883 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.884 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2023-08-10T11:26:49.884 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.884 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.884 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.884 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2023-08-10T11:26:49.884 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.884 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.885 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.885 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2023-08-10T11:26:49.885 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.885 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.885 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.886 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2023-08-10T11:26:49.886 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.886 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.886 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.886 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2023-08-10T11:26:49.886 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.886 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.887 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.887 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2023-08-10T11:26:49.887 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.887 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.887 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.887 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2023-08-10T11:26:49.888 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.888 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.888 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.888 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2023-08-10T11:26:49.888 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.888 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.888 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.889 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2023-08-10T11:26:49.889 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.889 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.889 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.889 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2023-08-10T11:26:49.889 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.890 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.890 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.890 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2023-08-10T11:26:49.890 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.890 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.890 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.891 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2023-08-10T11:26:49.891 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.891 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.891 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.891 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2023-08-10T11:26:49.891 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.891 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.892 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.892 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2023-08-10T11:26:49.892 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.892 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.892 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.892 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2023-08-10T11:26:49.893 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.893 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.893 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.893 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2023-08-10T11:26:49.893 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.893 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.893 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.894 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2023-08-10T11:26:49.894 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.894 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.894 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.894 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:26:49.894 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:26:49.895 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2023-08-10T11:26:49.895 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.895 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.895 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:49.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.895 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2023-08-10T11:26:49.895 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 2, 2023-08-10T11:26:49.896 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 3, 2023-08-10T11:26:49.896 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 1, 2023-08-10T11:26:49.896 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 2, 2023-08-10T11:26:49.896 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2023-08-10T11:26:49.896 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 0, 2023-08-10T11:26:49.896 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 0, 2023-08-10T11:26:49.896 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 4845 2023-08-10T11:26:49.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.897 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2023-08-10T11:26:49.897 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:26:49.897 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2023-08-10T11:26:49.897 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:26:49.897 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:26:49.897 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:26:49.897 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:26:49.898 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:26:49.898 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:26:49.898 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:26:49.898 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:26:49.898 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:26:49.898 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:26:49.898 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:26:49.898 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:26:49.899 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:26:49.899 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2023-08-10T11:26:49.899 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:26:49.899 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2023-08-10T11:26:49.899 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:26:49.899 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:26:49.899 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:26:49.899 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:26:49.899 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:26:49.900 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:26:49.900 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:26:49.900 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2023-08-10T11:26:49.900 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:26:49.900 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:26:49.900 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:26:49.900 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2023-08-10T11:26:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2023-08-10T11:26:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2023-08-10T11:26:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:26:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:26:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:26:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:26:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 216787, 2023-08-10T11:26:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 72, 2023-08-10T11:26:49.901 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:26:49.902 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2023-08-10T11:26:49.902 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2023-08-10T11:26:49.902 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2023-08-10T11:26:49.902 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:26:49.902 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2023-08-10T11:26:49.902 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:26:49.902 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2023-08-10T11:26:49.902 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 9208, 2023-08-10T11:26:49.903 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 176, 2023-08-10T11:26:49.903 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:26:49.903 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:26:49.903 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2023-08-10T11:26:49.903 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2023-08-10T11:26:49.903 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 4661380, 2023-08-10T11:26:49.903 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 37134, 2023-08-10T11:26:49.904 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2023-08-10T11:26:49.904 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2023-08-10T11:26:49.904 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2023-08-10T11:26:49.904 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2023-08-10T11:26:49.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.904 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2023-08-10T11:26:49.904 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2023-08-10T11:26:49.904 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2023-08-10T11:26:49.905 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 7403, 2023-08-10T11:26:49.905 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 21, 2023-08-10T11:26:49.905 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 3, 2023-08-10T11:26:49.905 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 7403, 2023-08-10T11:26:49.905 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2023-08-10T11:26:49.905 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 7403, 2023-08-10T11:26:49.905 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 21.163676934, 2023-08-10T11:26:49.905 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.002858797 2023-08-10T11:26:49.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.906 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2023-08-10T11:26:49.906 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2023-08-10T11:26:49.906 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 7403, 2023-08-10T11:26:49.906 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 7404 2023-08-10T11:26:49.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.906 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 7403, 2023-08-10T11:26:49.906 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 7403, 2023-08-10T11:26:49.907 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 0, 2023-08-10T11:26:49.907 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2023-08-10T11:26:49.907 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2023-08-10T11:26:49.907 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 4379, 2023-08-10T11:26:49.907 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 0, 2023-08-10T11:26:49.907 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 3022, 2023-08-10T11:26:49.907 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 0, 2023-08-10T11:26:49.907 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 0, 2023-08-10T11:26:49.908 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2023-08-10T11:26:49.908 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2023-08-10T11:26:49.908 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2023-08-10T11:26:49.908 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 0, 2023-08-10T11:26:49.908 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 0, 2023-08-10T11:26:49.908 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2023-08-10T11:26:49.908 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2023-08-10T11:26:49.908 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2023-08-10T11:26:49.909 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 1, 2023-08-10T11:26:49.909 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 0, 2023-08-10T11:26:49.909 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:26:49.909 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2023-08-10T11:26:49.909 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:26:49.909 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2023-08-10T11:26:49.909 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2023-08-10T11:26:49.909 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2023-08-10T11:26:49.910 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:26:49.910 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2023-08-10T11:26:49.910 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:26:49.910 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 0, 2023-08-10T11:26:49.910 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2023-08-10T11:26:49.910 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2023-08-10T11:26:49.910 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2023-08-10T11:26:49.910 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2023-08-10T11:26:49.911 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2023-08-10T11:26:49.911 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2023-08-10T11:26:49.911 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2023-08-10T11:26:49.911 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2023-08-10T11:26:49.911 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2023-08-10T11:26:49.911 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2023-08-10T11:26:49.911 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2023-08-10T11:26:49.911 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2023-08-10T11:26:49.912 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2023-08-10T11:26:49.912 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2023-08-10T11:26:49.912 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2023-08-10T11:26:49.912 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2023-08-10T11:26:49.912 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 158, 2023-08-10T11:26:49.912 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2023-08-10T11:26:49.912 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 67, 2023-08-10T11:26:49.912 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 8, 2023-08-10T11:26:49.913 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 13, 2023-08-10T11:26:49.913 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 5, 2023-08-10T11:26:49.913 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2023-08-10T11:26:49.913 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 0, 2023-08-10T11:26:49.913 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 2, 2023-08-10T11:26:49.913 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 0 2023-08-10T11:26:49.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.913 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2023-08-10T11:26:49.914 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 0, 2023-08-10T11:26:49.914 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:26:49.914 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2023-08-10T11:26:49.914 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2023-08-10T11:26:49.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.914 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2023-08-10T11:26:49.914 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 0 2023-08-10T11:26:49.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.915 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2023-08-10T11:26:49.915 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2023-08-10T11:26:49.915 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T11:26:49.915 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2023-08-10T11:26:49.915 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 0, 2023-08-10T11:26:49.915 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 0, 2023-08-10T11:26:49.915 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2023-08-10T11:26:49.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.916 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:26:49.916 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:49.916 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2023-08-10T11:26:49.916 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:49.916 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 8204, 2023-08-10T11:26:49.916 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 36004990, 2023-08-10T11:26:49.916 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:49.916 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 8204, 2023-08-10T11:26:49.917 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:49.917 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:49.917 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 8204, 2023-08-10T11:26:49.917 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 36004990, 2023-08-10T11:26:49.917 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:49.917 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.917 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.917 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:49.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.918 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2023-08-10T11:26:49.918 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:49.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2023-08-10T11:26:49.918 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:49.918 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:49.918 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:49.919 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:49.919 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:49.919 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 7403, 2023-08-10T11:26:49.919 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 32305795, 2023-08-10T11:26:49.919 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 7403, 2023-08-10T11:26:49.919 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 32305795, 2023-08-10T11:26:49.919 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:49.919 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.920 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.920 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:49.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.920 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2023-08-10T11:26:49.920 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:49.920 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2023-08-10T11:26:49.921 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:49.921 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:49.921 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:49.921 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:49.921 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:49.921 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 7403, 2023-08-10T11:26:49.921 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 7403, 2023-08-10T11:26:49.921 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 7403, 2023-08-10T11:26:49.922 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 7403, 2023-08-10T11:26:49.922 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:49.922 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.922 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.922 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:49.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.922 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:26:49.923 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:49.923 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2023-08-10T11:26:49.923 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:49.923 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:49.923 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:49.923 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:49.923 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:49.923 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:49.924 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:49.924 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2023-08-10T11:26:49.924 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2023-08-10T11:26:49.924 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:49.924 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.924 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.924 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:49.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:49.925 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x5562058fe500": { 2023-08-10T11:26:49.925 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:49.925 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2023-08-10T11:26:49.925 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:49.925 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2023-08-10T11:26:49.925 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2023-08-10T11:26:49.925 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:49.926 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:49.926 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:49.926 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:49.926 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2023-08-10T11:26:49.926 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2023-08-10T11:26:49.926 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:49.926 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:49.926 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:49.927 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:49.927 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:49.927 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:49.927 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:26:50.293 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-08-10T11:26:50.294 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-08-10T11:26:50.294 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-08-10T11:26:50.294 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-08-10T11:26:50.294 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-08-10T11:26:50.294 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-08-10T11:26:50.295 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T11:26:50.295 DEBUG:tasks.check_counter:Getting stats from j 2023-08-10T11:26:50.295 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.j perf dump 2023-08-10T11:26:51.017 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.a/config 2023-08-10T11:26:51.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:51 smithi195 ceph-mon[129938]: pgmap v1135: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 100 KiB/s wr, 24 op/s 2023-08-10T11:26:51.450 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:51 smithi107 ceph-mon[127953]: pgmap v1135: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 100 KiB/s wr, 24 op/s 2023-08-10T11:26:51.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:51 smithi157 ceph-mon[129604]: pgmap v1135: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 100 KiB/s wr, 24 op/s 2023-08-10T11:26:52.536 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2023-08-10T11:26:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:26:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 0, 2023-08-10T11:26:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 2, 2023-08-10T11:26:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 0, 2023-08-10T11:26:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 0, 2023-08-10T11:26:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2023-08-10T11:26:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 0, 2023-08-10T11:26:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.003334785, 2023-08-10T11:26:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.000000000, 2023-08-10T11:26:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.000648209, 2023-08-10T11:26:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-10T11:26:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T11:26:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T11:26:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:26:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 8, 2023-08-10T11:26:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 473, 2023-08-10T11:26:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 3600, 2023-08-10T11:26:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 387200, 2023-08-10T11:26:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 7, 2023-08-10T11:26:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2023-08-10T11:26:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.043236468, 2023-08-10T11:26:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.032964096, 2023-08-10T11:26:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.004698264, 2023-08-10T11:26:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-10T11:26:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 471, 2023-08-10T11:26:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.088900728, 2023-08-10T11:26:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000188748 2023-08-10T11:26:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 3600, 2023-08-10T11:26:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 387200 2023-08-10T11:26:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:26:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 624, 2023-08-10T11:26:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 613, 2023-08-10T11:26:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 1673184, 2023-08-10T11:26:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 352400, 2023-08-10T11:26:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 2, 2023-08-10T11:26:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 1, 2023-08-10T11:26:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.110052281, 2023-08-10T11:26:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.047062300, 2023-08-10T11:26:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.051474357, 2023-08-10T11:26:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.015302229, 2023-08-10T11:26:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 612, 2023-08-10T11:26:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.110180608, 2023-08-10T11:26:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000180033 2023-08-10T11:26:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 1673184, 2023-08-10T11:26:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 352400 2023-08-10T11:26:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2023-08-10T11:26:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 0, 2023-08-10T11:26:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2023-08-10T11:26:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2023-08-10T11:26:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:26:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2023-08-10T11:26:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:26:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:26:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:26:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:26:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:26:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:26:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:26:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:26:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:26:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:26:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:26:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:26:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:26:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2023-08-10T11:26:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:26:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2023-08-10T11:26:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:26:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:26:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:26:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:26:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:26:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:26:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:26:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2023-08-10T11:26:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:26:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:26:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:26:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2023-08-10T11:26:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2023-08-10T11:26:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2023-08-10T11:26:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:26:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:26:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:26:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:26:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 148714, 2023-08-10T11:26:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 30, 2023-08-10T11:26:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:26:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2023-08-10T11:26:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2023-08-10T11:26:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2023-08-10T11:26:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:26:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2023-08-10T11:26:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:26:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2023-08-10T11:26:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 0, 2023-08-10T11:26:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 0, 2023-08-10T11:26:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:26:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:26:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2023-08-10T11:26:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2023-08-10T11:26:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 928, 2023-08-10T11:26:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 2, 2023-08-10T11:26:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2023-08-10T11:26:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2023-08-10T11:26:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2023-08-10T11:26:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2023-08-10T11:26:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2023-08-10T11:26:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:26:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2023-08-10T11:26:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2023-08-10T11:26:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2023-08-10T11:26:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 628, 2023-08-10T11:26:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 1584957, 2023-08-10T11:26:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 628, 2023-08-10T11:26:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2023-08-10T11:26:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2023-08-10T11:26:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 628, 2023-08-10T11:26:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 1584957, 2023-08-10T11:26:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2023-08-10T11:26:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2023-08-10T11:26:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2023-08-10T11:26:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2023-08-10T11:26:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2023-08-10T11:26:52.570 INFO:teuthology.orchestra.run.smithi107.stdout:} 2023-08-10T11:26:53.005 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-08-10T11:26:53.005 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-08-10T11:26:53.006 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-08-10T11:26:53.006 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-08-10T11:26:53.006 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-08-10T11:26:53.006 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-08-10T11:26:53.006 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-08-10T11:26:53.006 DEBUG:tasks.check_counter:Getting stats from b 2023-08-10T11:26:53.007 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.b perf dump 2023-08-10T11:26:53.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:53 smithi107 ceph-mon[127953]: pgmap v1136: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 90 KiB/s wr, 11 op/s 2023-08-10T11:26:53.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:53 smithi195 ceph-mon[129938]: pgmap v1136: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 90 KiB/s wr, 11 op/s 2023-08-10T11:26:53.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:53 smithi157 ceph-mon[129604]: pgmap v1136: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 90 KiB/s wr, 11 op/s 2023-08-10T11:26:53.856 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:26:55.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:55 smithi195 ceph-mon[129938]: pgmap v1137: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 91 KiB/s wr, 13 op/s 2023-08-10T11:26:55.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:55 smithi157 ceph-mon[129604]: pgmap v1137: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 91 KiB/s wr, 13 op/s 2023-08-10T11:26:55.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:55 smithi107 ceph-mon[127953]: pgmap v1137: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 91 KiB/s wr, 13 op/s 2023-08-10T11:26:55.883 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-08-10T11:26:55.883 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:26:55.883 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 375912, 2023-08-10T11:26:55.883 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 386832, 2023-08-10T11:26:55.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 65539318, 2023-08-10T11:26:55.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 140285274, 2023-08-10T11:26:55.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 14, 2023-08-10T11:26:55.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 3, 2023-08-10T11:26:55.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 18.553352509, 2023-08-10T11:26:55.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 7.781572232, 2023-08-10T11:26:55.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 11.683331458, 2023-08-10T11:26:55.885 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.657400852, 2023-08-10T11:26:55.885 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:55.885 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 386832, 2023-08-10T11:26:55.885 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 9.108022749, 2023-08-10T11:26:55.885 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000023545 2023-08-10T11:26:55.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.885 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:55.886 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 751831, 2023-08-10T11:26:55.886 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.090460694, 2023-08-10T11:26:55.886 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000120 2023-08-10T11:26:55.886 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.886 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 2473840, 2023-08-10T11:26:55.886 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 1114512 2023-08-10T11:26:55.886 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.886 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:26:55.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 35616, 2023-08-10T11:26:55.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 42077, 2023-08-10T11:26:55.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 11857262, 2023-08-10T11:26:55.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 109863455, 2023-08-10T11:26:55.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 21, 2023-08-10T11:26:55.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 6, 2023-08-10T11:26:55.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 4.374708450, 2023-08-10T11:26:55.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 2.097415538, 2023-08-10T11:26:55.888 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 2.177475297, 2023-08-10T11:26:55.888 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.392073386, 2023-08-10T11:26:55.888 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:55.888 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 42074, 2023-08-10T11:26:55.888 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 3.638505661, 2023-08-10T11:26:55.889 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000086478 2023-08-10T11:26:55.889 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.889 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:55.889 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 67293, 2023-08-10T11:26:55.889 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.017662803, 2023-08-10T11:26:55.889 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000262 2023-08-10T11:26:55.889 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.889 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 1164640, 2023-08-10T11:26:55.890 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 502128 2023-08-10T11:26:55.890 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.890 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:26:55.890 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 95177, 2023-08-10T11:26:55.890 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 116494, 2023-08-10T11:26:55.890 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 31480461, 2023-08-10T11:26:55.890 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 108643692, 2023-08-10T11:26:55.890 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 103, 2023-08-10T11:26:55.891 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 7, 2023-08-10T11:26:55.891 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 8.668787217, 2023-08-10T11:26:55.891 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 3.471377261, 2023-08-10T11:26:55.891 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 5.219130246, 2023-08-10T11:26:55.892 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.791357472, 2023-08-10T11:26:55.892 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:55.892 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 116492, 2023-08-10T11:26:55.892 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 9.996469019, 2023-08-10T11:26:55.892 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000085812 2023-08-10T11:26:55.892 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.892 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:55.893 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 194708, 2023-08-10T11:26:55.893 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.040408927, 2023-08-10T11:26:55.893 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000207 2023-08-10T11:26:55.893 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.893 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 99120, 2023-08-10T11:26:55.893 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 238736 2023-08-10T11:26:55.893 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.894 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2023-08-10T11:26:55.894 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2023-08-10T11:26:55.894 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2023-08-10T11:26:55.894 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.894 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2023-08-10T11:26:55.894 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-08-10T11:26:55.894 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-08-10T11:26:55.894 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 14977, 2023-08-10T11:26:55.895 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 7.342697178, 2023-08-10T11:26:55.895 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000490264 2023-08-10T11:26:55.895 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:55.895 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.895 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2023-08-10T11:26:55.895 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-08-10T11:26:55.895 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-08-10T11:26:55.895 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 381, 2023-08-10T11:26:55.896 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.023672165, 2023-08-10T11:26:55.896 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000062131 2023-08-10T11:26:55.896 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:55.896 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.896 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2023-08-10T11:26:55.896 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 17266, 2023-08-10T11:26:55.896 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 13646, 2023-08-10T11:26:55.896 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2023-08-10T11:26:55.897 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 13646, 2023-08-10T11:26:55.897 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 505.465217771, 2023-08-10T11:26:55.897 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.037041273 2023-08-10T11:26:55.897 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.897 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2023-08-10T11:26:55.897 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 3620, 2023-08-10T11:26:55.897 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 2, 2023-08-10T11:26:55.897 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2023-08-10T11:26:55.898 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 39, 2023-08-10T11:26:55.898 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 3, 2023-08-10T11:26:55.898 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2023-08-10T11:26:55.898 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 327, 2023-08-10T11:26:55.898 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 7, 2023-08-10T11:26:55.898 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 179, 2023-08-10T11:26:55.898 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 141, 2023-08-10T11:26:55.899 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 317, 2023-08-10T11:26:55.899 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 4675, 2023-08-10T11:26:55.899 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 66, 2023-08-10T11:26:55.899 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 66, 2023-08-10T11:26:55.899 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 25, 2023-08-10T11:26:55.899 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 37047, 2023-08-10T11:26:55.900 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 30645, 2023-08-10T11:26:55.900 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 3367, 2023-08-10T11:26:55.900 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 127, 2023-08-10T11:26:55.900 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 0, 2023-08-10T11:26:55.900 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2023-08-10T11:26:55.900 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 1990, 2023-08-10T11:26:55.900 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 3698, 2023-08-10T11:26:55.900 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 0, 2023-08-10T11:26:55.901 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 54, 2023-08-10T11:26:55.901 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 4225, 2023-08-10T11:26:55.901 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 42, 2023-08-10T11:26:55.901 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 3291, 2023-08-10T11:26:55.901 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2023-08-10T11:26:55.901 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 1913, 2023-08-10T11:26:55.901 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2023-08-10T11:26:55.902 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 1045, 2023-08-10T11:26:55.902 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 8980019622, 2023-08-10T11:26:55.902 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 7, 2023-08-10T11:26:55.902 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 1913, 2023-08-10T11:26:55.902 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2023-08-10T11:26:55.902 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:26:55.902 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:26:55.902 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 132, 2023-08-10T11:26:55.903 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 5, 2023-08-10T11:26:55.903 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 127, 2023-08-10T11:26:55.903 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 1781, 2023-08-10T11:26:55.903 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 414, 2023-08-10T11:26:55.903 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 9607, 2023-08-10T11:26:55.903 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 4712, 2023-08-10T11:26:55.903 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:26:55.903 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:26:55.904 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:26:55.904 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 15618, 2023-08-10T11:26:55.904 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 3275, 2023-08-10T11:26:55.904 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 172, 2023-08-10T11:26:55.904 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 1636 2023-08-10T11:26:55.904 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.904 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2023-08-10T11:26:55.904 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 192, 2023-08-10T11:26:55.905 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 114, 2023-08-10T11:26:55.905 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 59, 2023-08-10T11:26:55.905 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 192, 2023-08-10T11:26:55.905 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 1048, 2023-08-10T11:26:55.905 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 1, 2023-08-10T11:26:55.905 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2023-08-10T11:26:55.905 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:26:55.905 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 151, 2023-08-10T11:26:55.906 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 94, 2023-08-10T11:26:55.906 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 346, 2023-08-10T11:26:55.906 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 40, 2023-08-10T11:26:55.906 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2023-08-10T11:26:55.906 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:26:55.906 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:26:55.907 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2023-08-10T11:26:55.907 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2023-08-10T11:26:55.907 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 5, 2023-08-10T11:26:55.907 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 56, 2023-08-10T11:26:55.907 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2023-08-10T11:26:55.907 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 3, 2023-08-10T11:26:55.907 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2023-08-10T11:26:55.908 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0 2023-08-10T11:26:55.908 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.908 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2023-08-10T11:26:55.908 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 12158, 2023-08-10T11:26:55.908 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 0, 2023-08-10T11:26:55.908 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 0, 2023-08-10T11:26:55.908 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 12158, 2023-08-10T11:26:55.908 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2023-08-10T11:26:55.909 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 0, 2023-08-10T11:26:55.909 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 54, 2023-08-10T11:26:55.909 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 0, 2023-08-10T11:26:55.909 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 0, 2023-08-10T11:26:55.909 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 54, 2023-08-10T11:26:55.909 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2023-08-10T11:26:55.910 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 0, 2023-08-10T11:26:55.910 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4194304, 2023-08-10T11:26:55.910 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 217091800, 2023-08-10T11:26:55.910 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 0, 2023-08-10T11:26:55.910 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2023-08-10T11:26:55.910 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 7027, 2023-08-10T11:26:55.910 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 71.926856072, 2023-08-10T11:26:55.910 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.010235784 2023-08-10T11:26:55.911 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.911 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 0 2023-08-10T11:26:55.911 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.911 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2023-08-10T11:26:55.911 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 264, 2023-08-10T11:26:55.911 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 3637, 2023-08-10T11:26:55.911 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 3373, 2023-08-10T11:26:55.911 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 112, 2023-08-10T11:26:55.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 267, 2023-08-10T11:26:55.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 155, 2023-08-10T11:26:55.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 327, 2023-08-10T11:26:55.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 5100, 2023-08-10T11:26:55.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 4773, 2023-08-10T11:26:55.912 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 66, 2023-08-10T11:26:55.913 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 2456, 2023-08-10T11:26:55.913 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 2390, 2023-08-10T11:26:55.913 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 76156, 2023-08-10T11:26:55.913 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 207152 2023-08-10T11:26:55.914 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.914 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2023-08-10T11:26:55.914 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 30737, 2023-08-10T11:26:55.914 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 7866, 2023-08-10T11:26:55.914 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 17266, 2023-08-10T11:26:55.914 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 162, 2023-08-10T11:26:55.914 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 14781, 2023-08-10T11:26:55.914 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2023-08-10T11:26:55.915 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1061, 2023-08-10T11:26:55.915 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 4.265108034, 2023-08-10T11:26:55.915 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.004019894 2023-08-10T11:26:55.915 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.915 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2023-08-10T11:26:55.915 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1147, 2023-08-10T11:26:55.915 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.701872359, 2023-08-10T11:26:55.916 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000611920 2023-08-10T11:26:55.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.916 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2023-08-10T11:26:55.916 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.916 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.916 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.916 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2023-08-10T11:26:55.917 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 59, 2023-08-10T11:26:55.917 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 1.580846479, 2023-08-10T11:26:55.917 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.026794008 2023-08-10T11:26:55.917 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.917 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2023-08-10T11:26:55.917 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 8213, 2023-08-10T11:26:55.917 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 376.788334089, 2023-08-10T11:26:55.918 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.045877064 2023-08-10T11:26:55.918 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.918 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2023-08-10T11:26:55.918 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.918 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.918 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.919 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.919 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2023-08-10T11:26:55.919 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.919 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.919 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.920 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2023-08-10T11:26:55.920 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.920 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.920 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.921 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2023-08-10T11:26:55.921 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.921 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.921 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.921 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.921 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2023-08-10T11:26:55.921 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.921 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.922 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.922 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.922 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2023-08-10T11:26:55.922 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 35, 2023-08-10T11:26:55.922 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.008090518, 2023-08-10T11:26:55.922 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000231157 2023-08-10T11:26:55.923 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.923 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2023-08-10T11:26:55.923 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 34, 2023-08-10T11:26:55.923 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.037892317, 2023-08-10T11:26:55.923 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.001114479 2023-08-10T11:26:55.923 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.923 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2023-08-10T11:26:55.924 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.924 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.924 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.924 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.924 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2023-08-10T11:26:55.925 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 35, 2023-08-10T11:26:55.925 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 17.616077939, 2023-08-10T11:26:55.925 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.503316512 2023-08-10T11:26:55.925 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.925 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2023-08-10T11:26:55.925 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2373, 2023-08-10T11:26:55.925 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 1.951603647, 2023-08-10T11:26:55.925 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000822420 2023-08-10T11:26:55.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.926 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2023-08-10T11:26:55.926 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 102, 2023-08-10T11:26:55.926 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.315569772, 2023-08-10T11:26:55.926 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.003093821 2023-08-10T11:26:55.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.926 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2023-08-10T11:26:55.927 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 472, 2023-08-10T11:26:55.927 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 99.158820353, 2023-08-10T11:26:55.927 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.210082246 2023-08-10T11:26:55.927 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.927 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2023-08-10T11:26:55.927 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.927 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.927 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.928 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.928 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2023-08-10T11:26:55.928 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.928 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.928 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.928 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.928 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2023-08-10T11:26:55.929 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.929 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.929 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.929 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.929 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2023-08-10T11:26:55.929 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 28, 2023-08-10T11:26:55.929 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 2.430872070, 2023-08-10T11:26:55.929 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.086816859 2023-08-10T11:26:55.930 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.930 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2023-08-10T11:26:55.930 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.930 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.930 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.930 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.930 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2023-08-10T11:26:55.931 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2, 2023-08-10T11:26:55.931 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.001452076, 2023-08-10T11:26:55.931 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000726038 2023-08-10T11:26:55.931 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.931 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2023-08-10T11:26:55.931 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.931 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.932 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.932 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.932 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2023-08-10T11:26:55.932 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.932 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.932 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.932 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.933 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2023-08-10T11:26:55.933 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.933 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.933 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.933 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.933 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2023-08-10T11:26:55.933 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 7, 2023-08-10T11:26:55.933 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.022065784, 2023-08-10T11:26:55.934 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.003152254 2023-08-10T11:26:55.934 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.934 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2023-08-10T11:26:55.934 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.934 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.934 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.934 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.934 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2023-08-10T11:26:55.935 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 78, 2023-08-10T11:26:55.935 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.586612334, 2023-08-10T11:26:55.935 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.007520670 2023-08-10T11:26:55.935 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.935 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:26:55.935 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:26:55.935 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2023-08-10T11:26:55.935 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.936 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.936 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.936 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:55.936 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.936 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2023-08-10T11:26:55.936 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 2, 2023-08-10T11:26:55.936 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 6, 2023-08-10T11:26:55.936 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 4, 2023-08-10T11:26:55.937 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 2, 2023-08-10T11:26:55.937 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2023-08-10T11:26:55.937 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 490, 2023-08-10T11:26:55.937 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 245, 2023-08-10T11:26:55.937 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 2126 2023-08-10T11:26:55.937 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.937 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2023-08-10T11:26:55.938 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:26:55.938 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2023-08-10T11:26:55.938 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:26:55.938 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:26:55.938 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:26:55.938 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:26:55.938 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:26:55.938 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:26:55.939 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:26:55.939 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:26:55.939 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:26:55.939 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:26:55.939 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:26:55.939 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:26:55.939 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:26:55.939 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2023-08-10T11:26:55.940 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:26:55.940 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2023-08-10T11:26:55.940 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:26:55.940 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:26:55.940 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:26:55.940 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:26:55.940 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:26:55.941 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:26:55.941 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:26:55.941 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2023-08-10T11:26:55.941 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:26:55.941 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:26:55.941 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:26:55.941 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2023-08-10T11:26:55.941 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2023-08-10T11:26:55.942 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2023-08-10T11:26:55.942 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:26:55.942 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:26:55.942 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:26:55.942 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:26:55.942 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 546273, 2023-08-10T11:26:55.942 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 180, 2023-08-10T11:26:55.943 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:26:55.943 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2023-08-10T11:26:55.943 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2023-08-10T11:26:55.943 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2023-08-10T11:26:55.943 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:26:55.944 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2023-08-10T11:26:55.944 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:26:55.944 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2023-08-10T11:26:55.944 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 9208, 2023-08-10T11:26:55.945 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 176, 2023-08-10T11:26:55.945 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:26:55.945 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:26:55.945 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2023-08-10T11:26:55.946 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2023-08-10T11:26:55.946 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 1724569, 2023-08-10T11:26:55.946 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 32106, 2023-08-10T11:26:55.946 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2023-08-10T11:26:55.946 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2023-08-10T11:26:55.947 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2023-08-10T11:26:55.947 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2023-08-10T11:26:55.947 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.947 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2023-08-10T11:26:55.947 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2023-08-10T11:26:55.948 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2023-08-10T11:26:55.948 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 10290, 2023-08-10T11:26:55.948 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 213389746, 2023-08-10T11:26:55.948 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 31, 2023-08-10T11:26:55.948 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 10290, 2023-08-10T11:26:55.948 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2023-08-10T11:26:55.948 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 10290, 2023-08-10T11:26:55.949 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 106.080156028, 2023-08-10T11:26:55.949 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.010309053 2023-08-10T11:26:55.949 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.949 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2023-08-10T11:26:55.949 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2023-08-10T11:26:55.949 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 10290, 2023-08-10T11:26:55.949 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 10661 2023-08-10T11:26:55.950 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.950 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 10290, 2023-08-10T11:26:55.950 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 1975, 2023-08-10T11:26:55.950 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 8315, 2023-08-10T11:26:55.950 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2023-08-10T11:26:55.950 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2023-08-10T11:26:55.950 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 0, 2023-08-10T11:26:55.951 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 11, 2023-08-10T11:26:55.951 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 55, 2023-08-10T11:26:55.951 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 7077, 2023-08-10T11:26:55.951 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 184, 2023-08-10T11:26:55.951 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2023-08-10T11:26:55.951 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2023-08-10T11:26:55.951 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 1, 2023-08-10T11:26:55.952 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 3, 2023-08-10T11:26:55.952 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 751, 2023-08-10T11:26:55.952 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2023-08-10T11:26:55.952 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2023-08-10T11:26:55.952 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2023-08-10T11:26:55.952 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 1918, 2023-08-10T11:26:55.952 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 22, 2023-08-10T11:26:55.953 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:26:55.953 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2023-08-10T11:26:55.953 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:26:55.953 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2023-08-10T11:26:55.953 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2023-08-10T11:26:55.953 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2023-08-10T11:26:55.953 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:26:55.953 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2023-08-10T11:26:55.954 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:26:55.954 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2023-08-10T11:26:55.954 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2023-08-10T11:26:55.954 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2023-08-10T11:26:55.954 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2023-08-10T11:26:55.954 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2023-08-10T11:26:55.954 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2023-08-10T11:26:55.954 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2023-08-10T11:26:55.955 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2023-08-10T11:26:55.955 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2023-08-10T11:26:55.955 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2023-08-10T11:26:55.955 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2023-08-10T11:26:55.955 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2023-08-10T11:26:55.955 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2023-08-10T11:26:55.955 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2023-08-10T11:26:55.955 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2023-08-10T11:26:55.956 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2023-08-10T11:26:55.956 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2023-08-10T11:26:55.956 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 158, 2023-08-10T11:26:55.956 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2023-08-10T11:26:55.956 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 74, 2023-08-10T11:26:55.956 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 12, 2023-08-10T11:26:55.956 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 12, 2023-08-10T11:26:55.957 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 0, 2023-08-10T11:26:55.957 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2023-08-10T11:26:55.957 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 493, 2023-08-10T11:26:55.957 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 4, 2023-08-10T11:26:55.957 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 142 2023-08-10T11:26:55.957 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.957 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2023-08-10T11:26:55.957 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 1, 2023-08-10T11:26:55.958 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:26:55.958 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2023-08-10T11:26:55.958 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2023-08-10T11:26:55.958 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.958 INFO:teuthology.orchestra.run.smithi157.stdout: "osd-slow-ops": { 2023-08-10T11:26:55.958 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 1 2023-08-10T11:26:55.958 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.958 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2023-08-10T11:26:55.959 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2023-08-10T11:26:55.959 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 10, 2023-08-10T11:26:55.959 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2023-08-10T11:26:55.959 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 5, 2023-08-10T11:26:55.959 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 94, 2023-08-10T11:26:55.959 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2023-08-10T11:26:55.959 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.959 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:26:55.960 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:55.960 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-08-10T11:26:55.960 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:55.960 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 506701, 2023-08-10T11:26:55.960 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 63094743, 2023-08-10T11:26:55.960 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:55.960 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 506701, 2023-08-10T11:26:55.961 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:26:55.961 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:26:55.961 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 506701, 2023-08-10T11:26:55.961 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 63094743, 2023-08-10T11:26:55.961 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:55.961 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.962 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.962 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.962 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:55.962 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.962 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2023-08-10T11:26:55.962 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:55.962 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-08-10T11:26:55.963 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:55.963 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-08-10T11:26:55.963 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-08-10T11:26:55.963 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:55.963 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:55.963 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 10290, 2023-08-10T11:26:55.964 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 213400320, 2023-08-10T11:26:55.964 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 10290, 2023-08-10T11:26:55.964 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 213400320, 2023-08-10T11:26:55.964 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:55.964 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.964 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.964 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.964 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:55.965 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.965 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2023-08-10T11:26:55.965 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:55.965 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2023-08-10T11:26:55.965 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:55.965 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-08-10T11:26:55.965 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-08-10T11:26:55.965 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:55.966 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:55.966 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 10290, 2023-08-10T11:26:55.966 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 10290, 2023-08-10T11:26:55.966 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 10290, 2023-08-10T11:26:55.966 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 10290, 2023-08-10T11:26:55.966 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:55.966 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.967 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.967 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.967 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:55.967 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.967 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:26:55.967 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:55.967 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-08-10T11:26:55.967 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:55.968 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 94, 2023-08-10T11:26:55.968 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 10606, 2023-08-10T11:26:55.968 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:55.968 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 94, 2023-08-10T11:26:55.968 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:26:55.968 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:26:55.968 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 50, 2023-08-10T11:26:55.969 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 10606, 2023-08-10T11:26:55.969 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:55.969 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.969 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.969 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.969 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:55.969 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:55.970 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x56521fb240a0": { 2023-08-10T11:26:55.970 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:55.970 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-08-10T11:26:55.970 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:55.970 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 12158, 2023-08-10T11:26:55.970 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 212897496, 2023-08-10T11:26:55.970 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:55.970 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 12158, 2023-08-10T11:26:55.971 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:26:55.971 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:26:55.971 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 7027, 2023-08-10T11:26:55.971 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 212897496, 2023-08-10T11:26:55.971 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:55.971 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:55.971 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:55.972 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:55.972 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:55.972 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:55.972 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-08-10T11:26:56.358 INFO:tasks.check_counter:Daemon mds.b mds.exported=54 2023-08-10T11:26:56.358 INFO:tasks.check_counter:Daemon mds.b mds.imported=42 2023-08-10T11:26:56.358 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=192 2023-08-10T11:26:56.359 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=114 2023-08-10T11:26:56.359 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2023-08-10T11:26:56.360 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=35 2023-08-10T11:26:56.360 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=28 2023-08-10T11:26:56.360 DEBUG:tasks.check_counter:Getting stats from e 2023-08-10T11:26:56.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.e perf dump 2023-08-10T11:26:57.083 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:26:57.408 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:57 smithi157 ceph-mon[129604]: pgmap v1138: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 101 KiB/s wr, 14 op/s 2023-08-10T11:26:57.412 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:57 smithi195 ceph-mon[129938]: pgmap v1138: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 101 KiB/s wr, 14 op/s 2023-08-10T11:26:57.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:57 smithi107 ceph-mon[127953]: pgmap v1138: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 101 KiB/s wr, 14 op/s 2023-08-10T11:26:58.503 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-08-10T11:26:58.504 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:26:58.504 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 37725, 2023-08-10T11:26:58.504 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 46626, 2023-08-10T11:26:58.504 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 12259900, 2023-08-10T11:26:58.504 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 31320621, 2023-08-10T11:26:58.504 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 20, 2023-08-10T11:26:58.505 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 5, 2023-08-10T11:26:58.505 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 3.427026295, 2023-08-10T11:26:58.505 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 1.481526269, 2023-08-10T11:26:58.505 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 2.276687528, 2023-08-10T11:26:58.505 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.059851212, 2023-08-10T11:26:58.505 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:58.505 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 46624, 2023-08-10T11:26:58.506 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 3.519587014, 2023-08-10T11:26:58.506 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000075488 2023-08-10T11:26:58.506 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.506 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:58.506 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 73583, 2023-08-10T11:26:58.506 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.018215092, 2023-08-10T11:26:58.506 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000247 2023-08-10T11:26:58.506 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.507 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 912, 2023-08-10T11:26:58.507 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 688 2023-08-10T11:26:58.507 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.507 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:26:58.507 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 26000, 2023-08-10T11:26:58.507 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 27625, 2023-08-10T11:26:58.507 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 12160332, 2023-08-10T11:26:58.507 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 26023750, 2023-08-10T11:26:58.508 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 15, 2023-08-10T11:26:58.508 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 9, 2023-08-10T11:26:58.508 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 2.214341637, 2023-08-10T11:26:58.508 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.930304275, 2023-08-10T11:26:58.508 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 1.381398797, 2023-08-10T11:26:58.508 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.120757752, 2023-08-10T11:26:58.508 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:58.509 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 27619, 2023-08-10T11:26:58.509 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 2.033473319, 2023-08-10T11:26:58.509 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000073625 2023-08-10T11:26:58.509 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.509 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:58.509 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 43209, 2023-08-10T11:26:58.509 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.009225400, 2023-08-10T11:26:58.509 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000213 2023-08-10T11:26:58.510 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.510 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 2447920, 2023-08-10T11:26:58.510 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 1300800 2023-08-10T11:26:58.510 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.510 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:26:58.510 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 59291, 2023-08-10T11:26:58.510 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 52200, 2023-08-10T11:26:58.511 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 24321914, 2023-08-10T11:26:58.511 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 21546433, 2023-08-10T11:26:58.511 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 12, 2023-08-10T11:26:58.511 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 5, 2023-08-10T11:26:58.511 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 5.244308496, 2023-08-10T11:26:58.511 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 2.545594951, 2023-08-10T11:26:58.511 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 3.457017626, 2023-08-10T11:26:58.511 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.040329333, 2023-08-10T11:26:58.512 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:26:58.512 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 52203, 2023-08-10T11:26:58.513 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 3.224954833, 2023-08-10T11:26:58.513 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000061777 2023-08-10T11:26:58.513 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.514 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:26:58.514 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 106030, 2023-08-10T11:26:58.514 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.023339531, 2023-08-10T11:26:58.514 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000220 2023-08-10T11:26:58.514 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.514 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 7072, 2023-08-10T11:26:58.514 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 117280 2023-08-10T11:26:58.515 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.515 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2023-08-10T11:26:58.515 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2023-08-10T11:26:58.515 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2023-08-10T11:26:58.515 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.515 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2023-08-10T11:26:58.515 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-08-10T11:26:58.516 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-08-10T11:26:58.516 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 9077, 2023-08-10T11:26:58.516 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 3.074416216, 2023-08-10T11:26:58.516 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000338704 2023-08-10T11:26:58.516 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:58.516 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.517 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2023-08-10T11:26:58.517 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-08-10T11:26:58.517 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-08-10T11:26:58.517 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 500, 2023-08-10T11:26:58.517 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.025795823, 2023-08-10T11:26:58.517 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000051591 2023-08-10T11:26:58.517 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:58.517 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.518 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2023-08-10T11:26:58.518 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 9901, 2023-08-10T11:26:58.518 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 8278, 2023-08-10T11:26:58.518 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2023-08-10T11:26:58.518 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 8278, 2023-08-10T11:26:58.518 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 266.041989602, 2023-08-10T11:26:58.518 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.032138437 2023-08-10T11:26:58.518 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.519 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2023-08-10T11:26:58.519 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 1623, 2023-08-10T11:26:58.519 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 30, 2023-08-10T11:26:58.519 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2023-08-10T11:26:58.519 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 19, 2023-08-10T11:26:58.519 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 1, 2023-08-10T11:26:58.519 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2023-08-10T11:26:58.519 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 1772, 2023-08-10T11:26:58.520 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 33, 2023-08-10T11:26:58.520 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 957, 2023-08-10T11:26:58.520 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 782, 2023-08-10T11:26:58.520 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 1724, 2023-08-10T11:26:58.520 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 2263, 2023-08-10T11:26:58.520 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 943, 2023-08-10T11:26:58.520 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 943, 2023-08-10T11:26:58.521 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 22, 2023-08-10T11:26:58.521 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 48595, 2023-08-10T11:26:58.521 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 39420, 2023-08-10T11:26:58.521 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 1550, 2023-08-10T11:26:58.521 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 311, 2023-08-10T11:26:58.521 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 1, 2023-08-10T11:26:58.521 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2023-08-10T11:26:58.521 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 4560, 2023-08-10T11:26:58.522 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 18246, 2023-08-10T11:26:58.522 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 0, 2023-08-10T11:26:58.522 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 33, 2023-08-10T11:26:58.522 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 1648, 2023-08-10T11:26:58.522 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 28, 2023-08-10T11:26:58.522 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 2821, 2023-08-10T11:26:58.522 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2023-08-10T11:26:58.522 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 592, 2023-08-10T11:26:58.523 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2023-08-10T11:26:58.523 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 1047, 2023-08-10T11:26:58.523 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 8979585222, 2023-08-10T11:26:58.523 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 7, 2023-08-10T11:26:58.523 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 592, 2023-08-10T11:26:58.523 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2023-08-10T11:26:58.523 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:26:58.523 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:26:58.524 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 0, 2023-08-10T11:26:58.524 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T11:26:58.524 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T11:26:58.524 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 592, 2023-08-10T11:26:58.524 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 731, 2023-08-10T11:26:58.524 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 9068, 2023-08-10T11:26:58.524 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 6955, 2023-08-10T11:26:58.524 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:26:58.525 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:26:58.525 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:26:58.525 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 12145, 2023-08-10T11:26:58.525 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 2428, 2023-08-10T11:26:58.525 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 374, 2023-08-10T11:26:58.525 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 1053 2023-08-10T11:26:58.525 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.525 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2023-08-10T11:26:58.526 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 171, 2023-08-10T11:26:58.526 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 464, 2023-08-10T11:26:58.526 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 274, 2023-08-10T11:26:58.526 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 702, 2023-08-10T11:26:58.526 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 490, 2023-08-10T11:26:58.526 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 0, 2023-08-10T11:26:58.527 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2023-08-10T11:26:58.527 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:26:58.527 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 265, 2023-08-10T11:26:58.527 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 140, 2023-08-10T11:26:58.527 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 788, 2023-08-10T11:26:58.527 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 87, 2023-08-10T11:26:58.527 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2023-08-10T11:26:58.527 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:26:58.528 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:26:58.528 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2023-08-10T11:26:58.528 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2023-08-10T11:26:58.528 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T11:26:58.528 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 37, 2023-08-10T11:26:58.528 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2023-08-10T11:26:58.528 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 1, 2023-08-10T11:26:58.529 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2023-08-10T11:26:58.529 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0 2023-08-10T11:26:58.529 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.529 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2023-08-10T11:26:58.529 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 9140, 2023-08-10T11:26:58.529 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 0, 2023-08-10T11:26:58.529 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 0, 2023-08-10T11:26:58.529 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 9140, 2023-08-10T11:26:58.530 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2023-08-10T11:26:58.530 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 0, 2023-08-10T11:26:58.530 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 12, 2023-08-10T11:26:58.530 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 0, 2023-08-10T11:26:58.530 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 0, 2023-08-10T11:26:58.530 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 12, 2023-08-10T11:26:58.530 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2023-08-10T11:26:58.530 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 0, 2023-08-10T11:26:58.531 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4194304, 2023-08-10T11:26:58.531 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 36500094, 2023-08-10T11:26:58.531 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 0, 2023-08-10T11:26:58.531 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2023-08-10T11:26:58.531 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 4214, 2023-08-10T11:26:58.531 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 34.468500030, 2023-08-10T11:26:58.531 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.008179520 2023-08-10T11:26:58.531 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.532 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 0 2023-08-10T11:26:58.532 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.532 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2023-08-10T11:26:58.532 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 1516, 2023-08-10T11:26:58.532 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 2664, 2023-08-10T11:26:58.532 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 1148, 2023-08-10T11:26:58.532 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 102, 2023-08-10T11:26:58.532 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 340, 2023-08-10T11:26:58.533 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 238, 2023-08-10T11:26:58.533 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 1772, 2023-08-10T11:26:58.533 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 4175, 2023-08-10T11:26:58.533 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 2403, 2023-08-10T11:26:58.533 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 943, 2023-08-10T11:26:58.533 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 1702, 2023-08-10T11:26:58.533 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 759, 2023-08-10T11:26:58.534 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 69432, 2023-08-10T11:26:58.534 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 198960 2023-08-10T11:26:58.534 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.534 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2023-08-10T11:26:58.534 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 32449, 2023-08-10T11:26:58.534 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 6051, 2023-08-10T11:26:58.534 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 9901, 2023-08-10T11:26:58.534 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 171, 2023-08-10T11:26:58.535 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 11855, 2023-08-10T11:26:58.535 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2023-08-10T11:26:58.535 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 142, 2023-08-10T11:26:58.535 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.374703886, 2023-08-10T11:26:58.535 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.002638759 2023-08-10T11:26:58.535 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.535 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2023-08-10T11:26:58.535 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 429, 2023-08-10T11:26:58.536 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 2.508268173, 2023-08-10T11:26:58.536 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.005846778 2023-08-10T11:26:58.536 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.536 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2023-08-10T11:26:58.536 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.536 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.536 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.536 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.537 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2023-08-10T11:26:58.537 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 131, 2023-08-10T11:26:58.537 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 2.687481933, 2023-08-10T11:26:58.537 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.020515129 2023-08-10T11:26:58.537 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.537 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2023-08-10T11:26:58.537 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 4428, 2023-08-10T11:26:58.537 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 126.081176956, 2023-08-10T11:26:58.538 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.028473617 2023-08-10T11:26:58.538 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.538 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2023-08-10T11:26:58.538 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.538 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.538 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.538 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.539 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2023-08-10T11:26:58.539 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.539 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.539 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.539 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.539 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2023-08-10T11:26:58.539 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.539 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.540 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.540 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.540 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2023-08-10T11:26:58.540 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.540 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.540 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.540 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.540 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2023-08-10T11:26:58.541 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.541 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.541 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.541 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.541 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2023-08-10T11:26:58.541 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.541 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.542 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.542 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.542 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2023-08-10T11:26:58.542 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.542 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.542 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.542 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.542 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2023-08-10T11:26:58.543 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.543 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.543 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.543 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.543 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2023-08-10T11:26:58.543 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.543 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.543 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.544 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.544 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2023-08-10T11:26:58.544 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1902, 2023-08-10T11:26:58.544 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 1.705107980, 2023-08-10T11:26:58.544 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000896481 2023-08-10T11:26:58.544 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.544 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2023-08-10T11:26:58.545 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 100, 2023-08-10T11:26:58.545 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.104276828, 2023-08-10T11:26:58.545 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.001042768 2023-08-10T11:26:58.545 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.545 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2023-08-10T11:26:58.545 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1021, 2023-08-10T11:26:58.545 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 131.783092630, 2023-08-10T11:26:58.545 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.129072568 2023-08-10T11:26:58.546 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.546 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2023-08-10T11:26:58.546 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.546 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.546 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.546 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.546 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2023-08-10T11:26:58.546 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.547 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.547 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.547 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.547 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2023-08-10T11:26:58.547 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.547 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.547 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2023-08-10T11:26:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2023-08-10T11:26:58.548 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2023-08-10T11:26:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.549 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.550 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2023-08-10T11:26:58.550 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.550 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.550 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.550 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.550 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2023-08-10T11:26:58.550 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.550 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.551 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.551 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.551 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2023-08-10T11:26:58.551 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.551 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.551 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.551 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.551 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2023-08-10T11:26:58.552 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.552 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.552 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.552 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.552 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2023-08-10T11:26:58.552 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.552 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.553 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.553 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.553 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2023-08-10T11:26:58.553 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 125, 2023-08-10T11:26:58.553 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.797881216, 2023-08-10T11:26:58.553 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.006383049 2023-08-10T11:26:58.553 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.553 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:26:58.554 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:26:58.554 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2023-08-10T11:26:58.554 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.554 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.554 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.554 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:58.554 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.554 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2023-08-10T11:26:58.555 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 2, 2023-08-10T11:26:58.555 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 3, 2023-08-10T11:26:58.555 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 1, 2023-08-10T11:26:58.555 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 2, 2023-08-10T11:26:58.555 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2023-08-10T11:26:58.555 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 312, 2023-08-10T11:26:58.555 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 156, 2023-08-10T11:26:58.555 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 2129 2023-08-10T11:26:58.556 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.556 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2023-08-10T11:26:58.556 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:26:58.556 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2023-08-10T11:26:58.556 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:26:58.556 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:26:58.556 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:26:58.556 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:26:58.557 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:26:58.557 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:26:58.557 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:26:58.557 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:26:58.557 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:26:58.557 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:26:58.557 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:26:58.557 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:26:58.558 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:26:58.558 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2023-08-10T11:26:58.558 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:26:58.558 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2023-08-10T11:26:58.558 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:26:58.558 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:26:58.558 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:26:58.558 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:26:58.559 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:26:58.559 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:26:58.559 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:26:58.559 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2023-08-10T11:26:58.559 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:26:58.559 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:26:58.559 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:26:58.559 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2023-08-10T11:26:58.560 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2023-08-10T11:26:58.560 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2023-08-10T11:26:58.560 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:26:58.560 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:26:58.560 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:26:58.560 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:26:58.560 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 586122, 2023-08-10T11:26:58.561 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 182, 2023-08-10T11:26:58.561 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:26:58.561 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2023-08-10T11:26:58.561 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2023-08-10T11:26:58.561 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2023-08-10T11:26:58.561 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:26:58.561 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2023-08-10T11:26:58.561 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:26:58.562 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2023-08-10T11:26:58.562 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 9208, 2023-08-10T11:26:58.562 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 176, 2023-08-10T11:26:58.562 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:26:58.562 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:26:58.562 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2023-08-10T11:26:58.562 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2023-08-10T11:26:58.562 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 5541609, 2023-08-10T11:26:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 75458, 2023-08-10T11:26:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2023-08-10T11:26:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2023-08-10T11:26:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2023-08-10T11:26:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2023-08-10T11:26:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.563 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2023-08-10T11:26:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2023-08-10T11:26:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2023-08-10T11:26:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 5764, 2023-08-10T11:26:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 32464645, 2023-08-10T11:26:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 27, 2023-08-10T11:26:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 5764, 2023-08-10T11:26:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2023-08-10T11:26:58.564 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 5764, 2023-08-10T11:26:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 42.744253273, 2023-08-10T11:26:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.007415727 2023-08-10T11:26:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2023-08-10T11:26:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2023-08-10T11:26:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 5764, 2023-08-10T11:26:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 6268 2023-08-10T11:26:58.565 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 5764, 2023-08-10T11:26:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 682, 2023-08-10T11:26:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 5082, 2023-08-10T11:26:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2023-08-10T11:26:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2023-08-10T11:26:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 0, 2023-08-10T11:26:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 10, 2023-08-10T11:26:58.566 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 60, 2023-08-10T11:26:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 4274, 2023-08-10T11:26:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 185, 2023-08-10T11:26:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2023-08-10T11:26:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2023-08-10T11:26:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 0, 2023-08-10T11:26:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 0, 2023-08-10T11:26:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 300, 2023-08-10T11:26:58.567 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2023-08-10T11:26:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2023-08-10T11:26:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2023-08-10T11:26:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 592, 2023-08-10T11:26:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 20, 2023-08-10T11:26:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:26:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2023-08-10T11:26:58.568 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:26:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2023-08-10T11:26:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2023-08-10T11:26:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2023-08-10T11:26:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:26:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2023-08-10T11:26:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:26:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2023-08-10T11:26:58.569 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2023-08-10T11:26:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2023-08-10T11:26:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2023-08-10T11:26:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2023-08-10T11:26:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2023-08-10T11:26:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2023-08-10T11:26:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2023-08-10T11:26:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2023-08-10T11:26:58.570 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2023-08-10T11:26:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2023-08-10T11:26:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2023-08-10T11:26:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2023-08-10T11:26:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2023-08-10T11:26:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2023-08-10T11:26:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2023-08-10T11:26:58.571 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2023-08-10T11:26:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 158, 2023-08-10T11:26:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2023-08-10T11:26:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 67, 2023-08-10T11:26:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 12, 2023-08-10T11:26:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 12, 2023-08-10T11:26:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 0, 2023-08-10T11:26:58.572 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2023-08-10T11:26:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 569, 2023-08-10T11:26:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 60, 2023-08-10T11:26:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 198 2023-08-10T11:26:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2023-08-10T11:26:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 1, 2023-08-10T11:26:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:26:58.573 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2023-08-10T11:26:58.574 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2023-08-10T11:26:58.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.574 INFO:teuthology.orchestra.run.smithi157.stdout: "osd-slow-ops": { 2023-08-10T11:26:58.574 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 0 2023-08-10T11:26:58.574 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.574 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2023-08-10T11:26:58.574 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2023-08-10T11:26:58.574 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 10, 2023-08-10T11:26:58.575 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2023-08-10T11:26:58.575 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 5, 2023-08-10T11:26:58.575 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 140, 2023-08-10T11:26:58.575 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2023-08-10T11:26:58.575 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.575 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:26:58.575 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:58.576 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-08-10T11:26:58.576 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:58.576 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 123012, 2023-08-10T11:26:58.576 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 37624733, 2023-08-10T11:26:58.576 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:58.576 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 123012, 2023-08-10T11:26:58.576 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:26:58.576 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:26:58.577 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 123012, 2023-08-10T11:26:58.577 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 37624733, 2023-08-10T11:26:58.577 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:58.577 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.577 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.577 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.577 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:58.578 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.578 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2023-08-10T11:26:58.578 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:58.578 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-08-10T11:26:58.578 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:58.578 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-08-10T11:26:58.578 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-08-10T11:26:58.578 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:58.579 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:58.579 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 5764, 2023-08-10T11:26:58.579 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 32479881, 2023-08-10T11:26:58.579 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 5764, 2023-08-10T11:26:58.579 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 32479881, 2023-08-10T11:26:58.579 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:58.579 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.579 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.580 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.580 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:58.580 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.580 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2023-08-10T11:26:58.580 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:58.580 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2023-08-10T11:26:58.580 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:58.581 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-08-10T11:26:58.581 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-08-10T11:26:58.581 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:58.581 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-08-10T11:26:58.581 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 5764, 2023-08-10T11:26:58.581 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 5764, 2023-08-10T11:26:58.581 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 5764, 2023-08-10T11:26:58.581 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 5764, 2023-08-10T11:26:58.582 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:58.582 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.582 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.582 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.582 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:58.582 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.582 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:26:58.582 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:58.583 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-08-10T11:26:58.583 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:58.583 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 140, 2023-08-10T11:26:58.583 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 15716, 2023-08-10T11:26:58.583 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:58.583 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 140, 2023-08-10T11:26:58.583 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:26:58.583 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:26:58.584 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 60, 2023-08-10T11:26:58.584 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 15716, 2023-08-10T11:26:58.584 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:58.584 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.584 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.584 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.584 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:58.585 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:26:58.585 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x55c389de60a0": { 2023-08-10T11:26:58.585 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:26:58.585 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-08-10T11:26:58.585 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:26:58.585 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 9140, 2023-08-10T11:26:58.585 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 32305790, 2023-08-10T11:26:58.586 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:26:58.586 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 9140, 2023-08-10T11:26:58.586 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:26:58.586 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:26:58.586 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 4214, 2023-08-10T11:26:58.586 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 32305790, 2023-08-10T11:26:58.586 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:26:58.586 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:26:58.587 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:26:58.587 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:26:58.587 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:58.587 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:26:58.587 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-08-10T11:26:58.588 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:58 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:26:58.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:58 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:26:58.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:58 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:26:58.964 INFO:tasks.check_counter:Daemon mds.e mds.exported=33 2023-08-10T11:26:58.964 INFO:tasks.check_counter:Daemon mds.e mds.imported=28 2023-08-10T11:26:58.965 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=171 2023-08-10T11:26:58.965 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=464 2023-08-10T11:26:58.965 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=7 2023-08-10T11:26:58.965 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-08-10T11:26:58.965 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T11:26:58.966 DEBUG:tasks.check_counter:Getting stats from h 2023-08-10T11:26:58.966 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.h perf dump 2023-08-10T11:26:59.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:26:59 smithi157 ceph-mon[129604]: pgmap v1139: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 11 op/s 2023-08-10T11:26:59.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:26:59 smithi107 ceph-mon[127953]: pgmap v1139: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 11 op/s 2023-08-10T11:26:59.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:26:59 smithi195 ceph-mon[129938]: pgmap v1139: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 11 op/s 2023-08-10T11:26:59.696 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:27:01.220 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-08-10T11:27:01.220 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:27:01.221 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 5578, 2023-08-10T11:27:01.221 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 5580, 2023-08-10T11:27:01.221 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 28360105, 2023-08-10T11:27:01.221 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 1734765, 2023-08-10T11:27:01.221 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 7, 2023-08-10T11:27:01.221 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 3, 2023-08-10T11:27:01.221 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.594543911, 2023-08-10T11:27:01.222 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.193288256, 2023-08-10T11:27:01.222 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.185277395, 2023-08-10T11:27:01.222 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.165440728, 2023-08-10T11:27:01.222 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:01.222 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 5578, 2023-08-10T11:27:01.222 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.392086211, 2023-08-10T11:27:01.222 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000070291 2023-08-10T11:27:01.222 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.223 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:01.223 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.223 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.223 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.223 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T11:27:01.223 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T11:27:01.223 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.224 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:27:01.224 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 2217, 2023-08-10T11:27:01.224 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 2090, 2023-08-10T11:27:01.224 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 23777690, 2023-08-10T11:27:01.224 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 801911, 2023-08-10T11:27:01.224 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 5, 2023-08-10T11:27:01.224 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 4, 2023-08-10T11:27:01.225 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.299397977, 2023-08-10T11:27:01.225 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.097208096, 2023-08-10T11:27:01.225 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.135285936, 2023-08-10T11:27:01.225 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.062377361, 2023-08-10T11:27:01.225 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:01.225 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2089, 2023-08-10T11:27:01.225 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.218666344, 2023-08-10T11:27:01.225 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000104675 2023-08-10T11:27:01.226 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.226 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:01.226 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.226 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.226 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.226 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.226 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 2451952, 2023-08-10T11:27:01.226 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 364272 2023-08-10T11:27:01.227 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.227 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:27:01.227 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 548, 2023-08-10T11:27:01.227 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 1010, 2023-08-10T11:27:01.227 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 12789073, 2023-08-10T11:27:01.227 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 1261245, 2023-08-10T11:27:01.227 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 12, 2023-08-10T11:27:01.227 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 6, 2023-08-10T11:27:01.228 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.113367271, 2023-08-10T11:27:01.228 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.039676711, 2023-08-10T11:27:01.228 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.038786035, 2023-08-10T11:27:01.228 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.024061665, 2023-08-10T11:27:01.228 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:01.228 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1008, 2023-08-10T11:27:01.228 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.146905099, 2023-08-10T11:27:01.228 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000145739 2023-08-10T11:27:01.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.229 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:01.229 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.229 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.229 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.229 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.229 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 3600, 2023-08-10T11:27:01.229 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 1093616 2023-08-10T11:27:01.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.230 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2023-08-10T11:27:01.230 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2023-08-10T11:27:01.230 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2023-08-10T11:27:01.230 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.231 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2023-08-10T11:27:01.231 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-08-10T11:27:01.231 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-08-10T11:27:01.231 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 12577, 2023-08-10T11:27:01.231 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.356383701, 2023-08-10T11:27:01.231 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000028336 2023-08-10T11:27:01.231 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:01.232 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.232 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2023-08-10T11:27:01.232 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-08-10T11:27:01.232 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-08-10T11:27:01.232 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.232 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.232 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.233 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:01.233 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.233 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2023-08-10T11:27:01.233 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 0, 2023-08-10T11:27:01.233 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 0, 2023-08-10T11:27:01.233 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2023-08-10T11:27:01.233 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.233 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.234 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.234 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.234 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2023-08-10T11:27:01.234 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 0, 2023-08-10T11:27:01.234 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 0, 2023-08-10T11:27:01.234 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2023-08-10T11:27:01.234 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 0, 2023-08-10T11:27:01.234 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 0, 2023-08-10T11:27:01.235 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2023-08-10T11:27:01.235 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 818, 2023-08-10T11:27:01.235 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 1, 2023-08-10T11:27:01.235 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 523, 2023-08-10T11:27:01.235 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 294, 2023-08-10T11:27:01.235 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 816, 2023-08-10T11:27:01.235 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 6, 2023-08-10T11:27:01.236 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 0, 2023-08-10T11:27:01.236 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 0, 2023-08-10T11:27:01.236 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 7, 2023-08-10T11:27:01.236 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 0, 2023-08-10T11:27:01.236 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 0, 2023-08-10T11:27:01.236 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 0, 2023-08-10T11:27:01.236 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 0, 2023-08-10T11:27:01.236 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 0, 2023-08-10T11:27:01.237 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2023-08-10T11:27:01.237 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 0, 2023-08-10T11:27:01.237 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 0, 2023-08-10T11:27:01.237 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 0, 2023-08-10T11:27:01.237 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 0, 2023-08-10T11:27:01.237 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 0, 2023-08-10T11:27:01.237 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 0, 2023-08-10T11:27:01.237 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 0, 2023-08-10T11:27:01.238 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2023-08-10T11:27:01.238 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 0, 2023-08-10T11:27:01.238 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2023-08-10T11:27:01.238 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 0, 2023-08-10T11:27:01.238 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 0, 2023-08-10T11:27:01.238 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 0, 2023-08-10T11:27:01.238 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T11:27:01.239 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2023-08-10T11:27:01.239 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:27:01.239 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:27:01.239 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 0, 2023-08-10T11:27:01.239 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T11:27:01.239 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T11:27:01.239 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 0, 2023-08-10T11:27:01.239 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 0, 2023-08-10T11:27:01.240 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T11:27:01.240 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 0, 2023-08-10T11:27:01.240 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:27:01.240 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:27:01.240 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:27:01.240 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 0, 2023-08-10T11:27:01.240 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 0, 2023-08-10T11:27:01.240 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 0, 2023-08-10T11:27:01.241 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 0 2023-08-10T11:27:01.241 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.241 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2023-08-10T11:27:01.241 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 0, 2023-08-10T11:27:01.241 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 0, 2023-08-10T11:27:01.241 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 0, 2023-08-10T11:27:01.241 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 0, 2023-08-10T11:27:01.242 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 0, 2023-08-10T11:27:01.242 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 0, 2023-08-10T11:27:01.242 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2023-08-10T11:27:01.242 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:27:01.242 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 0, 2023-08-10T11:27:01.242 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 0, 2023-08-10T11:27:01.242 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 0, 2023-08-10T11:27:01.242 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 0, 2023-08-10T11:27:01.243 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2023-08-10T11:27:01.243 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:27:01.243 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:27:01.243 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2023-08-10T11:27:01.243 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2023-08-10T11:27:01.243 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T11:27:01.243 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 0, 2023-08-10T11:27:01.243 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2023-08-10T11:27:01.244 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 0, 2023-08-10T11:27:01.244 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2023-08-10T11:27:01.244 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0 2023-08-10T11:27:01.244 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.244 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2023-08-10T11:27:01.244 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 0, 2023-08-10T11:27:01.244 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 0, 2023-08-10T11:27:01.244 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 0, 2023-08-10T11:27:01.245 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 0, 2023-08-10T11:27:01.245 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2023-08-10T11:27:01.245 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 0, 2023-08-10T11:27:01.245 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 0, 2023-08-10T11:27:01.245 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 0, 2023-08-10T11:27:01.245 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 0, 2023-08-10T11:27:01.245 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 21, 2023-08-10T11:27:01.246 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2023-08-10T11:27:01.246 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 0, 2023-08-10T11:27:01.246 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4194304, 2023-08-10T11:27:01.246 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 0, 2023-08-10T11:27:01.246 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 64481498, 2023-08-10T11:27:01.246 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2023-08-10T11:27:01.246 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.246 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.247 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.247 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.247 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 11765 2023-08-10T11:27:01.247 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.247 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2023-08-10T11:27:01.247 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 103, 2023-08-10T11:27:01.247 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 3664, 2023-08-10T11:27:01.247 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 3561, 2023-08-10T11:27:01.248 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 25, 2023-08-10T11:27:01.248 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 172, 2023-08-10T11:27:01.248 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 147, 2023-08-10T11:27:01.248 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 818, 2023-08-10T11:27:01.248 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 4730, 2023-08-10T11:27:01.248 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 3912, 2023-08-10T11:27:01.248 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 0, 2023-08-10T11:27:01.248 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 0, 2023-08-10T11:27:01.249 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 0, 2023-08-10T11:27:01.249 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 56496, 2023-08-10T11:27:01.249 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 207152 2023-08-10T11:27:01.249 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.249 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2023-08-10T11:27:01.249 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 0, 2023-08-10T11:27:01.249 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 0, 2023-08-10T11:27:01.250 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 0, 2023-08-10T11:27:01.250 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 0, 2023-08-10T11:27:01.250 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 0, 2023-08-10T11:27:01.250 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2023-08-10T11:27:01.250 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.250 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.250 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.250 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.251 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2023-08-10T11:27:01.251 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.251 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.251 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.251 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.251 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2023-08-10T11:27:01.251 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.251 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.252 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.252 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.252 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2023-08-10T11:27:01.252 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.252 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.252 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.252 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.252 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2023-08-10T11:27:01.253 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.253 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.253 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.253 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.253 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2023-08-10T11:27:01.253 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.253 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.253 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.254 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.254 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2023-08-10T11:27:01.254 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.254 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.254 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.254 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.254 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2023-08-10T11:27:01.254 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.255 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.255 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.255 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.255 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2023-08-10T11:27:01.255 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.255 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.255 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.255 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.256 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2023-08-10T11:27:01.256 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.256 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.256 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.256 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.256 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2023-08-10T11:27:01.256 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.257 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.257 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.257 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.257 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2023-08-10T11:27:01.257 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.257 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.257 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.257 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.258 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2023-08-10T11:27:01.258 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.258 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.258 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.258 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.258 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2023-08-10T11:27:01.258 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.258 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.259 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.259 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.259 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2023-08-10T11:27:01.259 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.259 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.259 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.259 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.260 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2023-08-10T11:27:01.260 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.260 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.260 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.260 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.260 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2023-08-10T11:27:01.260 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.260 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.261 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.261 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.261 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2023-08-10T11:27:01.261 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.261 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.261 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.261 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.261 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2023-08-10T11:27:01.262 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.262 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.262 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.262 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.262 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2023-08-10T11:27:01.262 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.262 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.262 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.263 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.263 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2023-08-10T11:27:01.263 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.263 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.263 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.263 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.263 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2023-08-10T11:27:01.263 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.264 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.264 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.264 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.264 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2023-08-10T11:27:01.264 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.264 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.264 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.265 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.265 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2023-08-10T11:27:01.265 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.265 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.265 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.265 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.265 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2023-08-10T11:27:01.265 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.266 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.266 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.266 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.266 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2023-08-10T11:27:01.266 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.266 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.266 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.266 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.267 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2023-08-10T11:27:01.267 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.267 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.267 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.267 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.267 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2023-08-10T11:27:01.267 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.267 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.268 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.268 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.268 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2023-08-10T11:27:01.268 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.268 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.268 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.268 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.269 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:27:01.269 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:27:01.269 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2023-08-10T11:27:01.269 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.269 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.269 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.269 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:01.269 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.270 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2023-08-10T11:27:01.270 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 2, 2023-08-10T11:27:01.270 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 2, 2023-08-10T11:27:01.270 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 0, 2023-08-10T11:27:01.270 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 2, 2023-08-10T11:27:01.270 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2023-08-10T11:27:01.270 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 0, 2023-08-10T11:27:01.270 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 0, 2023-08-10T11:27:01.271 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 4866 2023-08-10T11:27:01.271 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.271 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2023-08-10T11:27:01.271 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:27:01.271 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2023-08-10T11:27:01.271 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:27:01.271 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:27:01.272 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:27:01.272 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:27:01.272 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:27:01.272 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:27:01.272 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:27:01.272 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:27:01.272 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:27:01.272 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:27:01.273 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:27:01.273 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:27:01.273 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:27:01.273 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2023-08-10T11:27:01.273 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:27:01.273 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2023-08-10T11:27:01.273 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:27:01.273 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:27:01.274 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:27:01.274 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:27:01.274 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:27:01.274 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:27:01.274 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:27:01.274 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2023-08-10T11:27:01.274 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:27:01.274 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:27:01.275 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:27:01.275 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2023-08-10T11:27:01.275 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2023-08-10T11:27:01.275 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2023-08-10T11:27:01.275 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:27:01.275 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:27:01.275 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:27:01.275 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:27:01.276 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 225633, 2023-08-10T11:27:01.276 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 77, 2023-08-10T11:27:01.276 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:27:01.276 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2023-08-10T11:27:01.276 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2023-08-10T11:27:01.276 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2023-08-10T11:27:01.276 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:27:01.276 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2023-08-10T11:27:01.277 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:27:01.277 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2023-08-10T11:27:01.277 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 9208, 2023-08-10T11:27:01.277 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 176, 2023-08-10T11:27:01.277 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:27:01.277 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:27:01.277 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2023-08-10T11:27:01.278 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2023-08-10T11:27:01.278 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 1159453, 2023-08-10T11:27:01.278 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 50325, 2023-08-10T11:27:01.278 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2023-08-10T11:27:01.278 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2023-08-10T11:27:01.278 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2023-08-10T11:27:01.278 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2023-08-10T11:27:01.278 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.279 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2023-08-10T11:27:01.279 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2023-08-10T11:27:01.279 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2023-08-10T11:27:01.279 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 7524, 2023-08-10T11:27:01.279 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 21, 2023-08-10T11:27:01.279 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 3, 2023-08-10T11:27:01.279 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 7524, 2023-08-10T11:27:01.279 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2023-08-10T11:27:01.280 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 7524, 2023-08-10T11:27:01.280 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 19.472662852, 2023-08-10T11:27:01.280 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.002588073 2023-08-10T11:27:01.280 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.280 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2023-08-10T11:27:01.280 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2023-08-10T11:27:01.280 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 7524, 2023-08-10T11:27:01.280 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 7525 2023-08-10T11:27:01.281 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.281 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 7524, 2023-08-10T11:27:01.281 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 7524, 2023-08-10T11:27:01.281 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 0, 2023-08-10T11:27:01.281 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2023-08-10T11:27:01.281 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2023-08-10T11:27:01.281 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 4398, 2023-08-10T11:27:01.281 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 0, 2023-08-10T11:27:01.282 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 3124, 2023-08-10T11:27:01.282 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 0, 2023-08-10T11:27:01.282 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 0, 2023-08-10T11:27:01.282 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2023-08-10T11:27:01.282 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2023-08-10T11:27:01.282 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 0, 2023-08-10T11:27:01.282 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 0, 2023-08-10T11:27:01.282 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 0, 2023-08-10T11:27:01.283 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2023-08-10T11:27:01.283 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2023-08-10T11:27:01.283 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2023-08-10T11:27:01.283 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 1, 2023-08-10T11:27:01.283 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 0, 2023-08-10T11:27:01.283 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:27:01.283 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2023-08-10T11:27:01.284 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:27:01.284 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2023-08-10T11:27:01.284 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2023-08-10T11:27:01.284 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2023-08-10T11:27:01.284 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:27:01.284 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2023-08-10T11:27:01.284 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:27:01.284 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2023-08-10T11:27:01.285 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2023-08-10T11:27:01.285 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2023-08-10T11:27:01.285 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2023-08-10T11:27:01.285 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2023-08-10T11:27:01.285 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2023-08-10T11:27:01.285 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2023-08-10T11:27:01.285 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2023-08-10T11:27:01.285 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2023-08-10T11:27:01.286 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2023-08-10T11:27:01.286 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2023-08-10T11:27:01.286 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2023-08-10T11:27:01.286 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2023-08-10T11:27:01.286 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2023-08-10T11:27:01.286 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2023-08-10T11:27:01.286 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2023-08-10T11:27:01.286 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2023-08-10T11:27:01.287 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 158, 2023-08-10T11:27:01.287 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2023-08-10T11:27:01.287 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 67, 2023-08-10T11:27:01.287 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 9, 2023-08-10T11:27:01.287 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 11, 2023-08-10T11:27:01.287 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 2, 2023-08-10T11:27:01.287 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2023-08-10T11:27:01.287 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 0, 2023-08-10T11:27:01.288 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 2, 2023-08-10T11:27:01.288 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 0 2023-08-10T11:27:01.288 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.288 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2023-08-10T11:27:01.288 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 0, 2023-08-10T11:27:01.288 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:27:01.288 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2023-08-10T11:27:01.288 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2023-08-10T11:27:01.289 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.289 INFO:teuthology.orchestra.run.smithi157.stdout: "osd-slow-ops": { 2023-08-10T11:27:01.289 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 0 2023-08-10T11:27:01.289 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.289 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2023-08-10T11:27:01.289 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2023-08-10T11:27:01.289 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T11:27:01.289 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2023-08-10T11:27:01.290 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 0, 2023-08-10T11:27:01.290 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 0, 2023-08-10T11:27:01.290 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2023-08-10T11:27:01.290 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.290 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:27:01.290 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:27:01.290 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-08-10T11:27:01.290 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:27:01.291 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 8339, 2023-08-10T11:27:01.291 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 64132429, 2023-08-10T11:27:01.291 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:01.291 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 8339, 2023-08-10T11:27:01.291 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:27:01.291 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:27:01.291 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 8339, 2023-08-10T11:27:01.291 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 64132429, 2023-08-10T11:27:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:27:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2023-08-10T11:27:01.292 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:27:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-08-10T11:27:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:27:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-08-10T11:27:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-08-10T11:27:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 7524, 2023-08-10T11:27:01.293 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 60378252, 2023-08-10T11:27:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 7524, 2023-08-10T11:27:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 60378252, 2023-08-10T11:27:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:27:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.294 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2023-08-10T11:27:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:27:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2023-08-10T11:27:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:27:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-08-10T11:27:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-08-10T11:27:01.295 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:01.296 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:01.296 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 7524, 2023-08-10T11:27:01.296 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 7524, 2023-08-10T11:27:01.296 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 7524, 2023-08-10T11:27:01.296 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 7524, 2023-08-10T11:27:01.296 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:27:01.296 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.296 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.297 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.297 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:01.297 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.297 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:27:01.297 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:27:01.297 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-08-10T11:27:01.297 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:27:01.297 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-08-10T11:27:01.298 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-08-10T11:27:01.298 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:01.298 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:01.298 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:27:01.298 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:27:01.298 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2023-08-10T11:27:01.298 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2023-08-10T11:27:01.298 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:27:01.299 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.299 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.299 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.299 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:01.299 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:01.299 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x55a8eb876500": { 2023-08-10T11:27:01.299 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:27:01.299 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-08-10T11:27:01.300 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:27:01.300 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-08-10T11:27:01.300 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-08-10T11:27:01.300 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:01.300 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:01.300 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:27:01.300 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:27:01.301 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2023-08-10T11:27:01.301 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2023-08-10T11:27:01.301 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:27:01.301 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:01.301 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:01.301 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:01.301 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:01.301 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:01.302 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-08-10T11:27:01.302 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:01 smithi157 ceph-mon[129604]: pgmap v1140: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 KiB/s wr, 13 op/s 2023-08-10T11:27:01.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:01 smithi107 ceph-mon[127953]: pgmap v1140: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 KiB/s wr, 13 op/s 2023-08-10T11:27:01.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:01 smithi195 ceph-mon[129938]: pgmap v1140: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 KiB/s wr, 13 op/s 2023-08-10T11:27:01.786 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-08-10T11:27:01.786 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-08-10T11:27:01.787 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2023-08-10T11:27:01.787 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2023-08-10T11:27:01.787 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2023-08-10T11:27:01.787 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-08-10T11:27:01.787 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T11:27:01.788 DEBUG:tasks.check_counter:Getting stats from k 2023-08-10T11:27:01.788 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.k perf dump 2023-08-10T11:27:02.516 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.b/config 2023-08-10T11:27:03.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:03 smithi157 ceph-mon[129604]: pgmap v1141: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 9 op/s 2023-08-10T11:27:03.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:03 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:27:03.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:03 smithi107 ceph-mon[127953]: pgmap v1141: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 9 op/s 2023-08-10T11:27:03.578 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:03 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:27:03.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:03 smithi195 ceph-mon[129938]: pgmap v1141: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 9 op/s 2023-08-10T11:27:03.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:03 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:27:04.035 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-08-10T11:27:04.035 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:27:04.035 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 0, 2023-08-10T11:27:04.036 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 2, 2023-08-10T11:27:04.036 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 0, 2023-08-10T11:27:04.036 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 0, 2023-08-10T11:27:04.036 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 4, 2023-08-10T11:27:04.036 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 0, 2023-08-10T11:27:04.036 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.003326737, 2023-08-10T11:27:04.036 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.000000000, 2023-08-10T11:27:04.037 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.000865788, 2023-08-10T11:27:04.037 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-10T11:27:04.037 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:04.037 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:04.037 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:04.037 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:04.037 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.038 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:04.038 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:04.038 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:04.038 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:04.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.038 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T11:27:04.038 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T11:27:04.038 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.039 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:27:04.039 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 632, 2023-08-10T11:27:04.039 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 619, 2023-08-10T11:27:04.039 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 1677232, 2023-08-10T11:27:04.039 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 355216, 2023-08-10T11:27:04.039 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 2, 2023-08-10T11:27:04.039 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 1, 2023-08-10T11:27:04.039 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.111538697, 2023-08-10T11:27:04.040 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.034319424, 2023-08-10T11:27:04.040 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.059243259, 2023-08-10T11:27:04.040 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.018203800, 2023-08-10T11:27:04.040 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:04.040 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 619, 2023-08-10T11:27:04.040 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.070120736, 2023-08-10T11:27:04.040 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000113280 2023-08-10T11:27:04.041 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.041 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:04.041 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:04.041 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:04.041 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:04.041 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.042 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 1677232, 2023-08-10T11:27:04.042 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 355216 2023-08-10T11:27:04.042 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.042 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:27:04.042 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 3, 2023-08-10T11:27:04.042 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 473, 2023-08-10T11:27:04.042 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 480, 2023-08-10T11:27:04.042 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 281072, 2023-08-10T11:27:04.043 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 6, 2023-08-10T11:27:04.043 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 3, 2023-08-10T11:27:04.043 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.030963823, 2023-08-10T11:27:04.043 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.021572876, 2023-08-10T11:27:04.043 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.002620612, 2023-08-10T11:27:04.043 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-08-10T11:27:04.043 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:04.043 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 470, 2023-08-10T11:27:04.044 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.079025721, 2023-08-10T11:27:04.044 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000168139 2023-08-10T11:27:04.044 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.044 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:04.044 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:04.044 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:04.044 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:04.045 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.045 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 480, 2023-08-10T11:27:04.045 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 281072 2023-08-10T11:27:04.045 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.045 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2023-08-10T11:27:04.045 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 0, 2023-08-10T11:27:04.045 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2023-08-10T11:27:04.045 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.046 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2023-08-10T11:27:04.046 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:27:04.046 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2023-08-10T11:27:04.046 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:27:04.046 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:27:04.046 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:27:04.046 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:27:04.046 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:27:04.047 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:27:04.047 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:27:04.047 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:27:04.047 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:27:04.047 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:27:04.047 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:27:04.047 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:27:04.047 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:27:04.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2023-08-10T11:27:04.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:27:04.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2023-08-10T11:27:04.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:27:04.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:27:04.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:27:04.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:27:04.048 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:27:04.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:27:04.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:27:04.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2023-08-10T11:27:04.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:27:04.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:27:04.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:27:04.049 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2023-08-10T11:27:04.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2023-08-10T11:27:04.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2023-08-10T11:27:04.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:27:04.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:27:04.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:27:04.050 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:27:04.050 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 149762, 2023-08-10T11:27:04.050 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 32, 2023-08-10T11:27:04.051 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:27:04.051 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2023-08-10T11:27:04.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2023-08-10T11:27:04.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2023-08-10T11:27:04.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:27:04.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2023-08-10T11:27:04.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:27:04.051 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2023-08-10T11:27:04.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 0, 2023-08-10T11:27:04.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 0, 2023-08-10T11:27:04.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:27:04.052 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:27:04.052 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2023-08-10T11:27:04.052 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2023-08-10T11:27:04.052 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 928, 2023-08-10T11:27:04.052 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 2, 2023-08-10T11:27:04.053 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2023-08-10T11:27:04.053 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2023-08-10T11:27:04.053 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2023-08-10T11:27:04.053 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2023-08-10T11:27:04.053 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-08-10T11:27:04.053 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:27:04.053 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-08-10T11:27:04.053 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-08-10T11:27:04.054 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-08-10T11:27:04.054 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 631, 2023-08-10T11:27:04.054 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 1585450, 2023-08-10T11:27:04.054 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:04.054 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 631, 2023-08-10T11:27:04.054 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-08-10T11:27:04.054 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-08-10T11:27:04.054 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 631, 2023-08-10T11:27:04.055 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 1585450, 2023-08-10T11:27:04.055 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-08-10T11:27:04.055 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-08-10T11:27:04.055 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-08-10T11:27:04.055 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-08-10T11:27:04.056 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:04.056 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-08-10T11:27:04.056 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-08-10T11:27:04.497 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-08-10T11:27:04.497 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-08-10T11:27:04.497 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2023-08-10T11:27:04.498 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2023-08-10T11:27:04.498 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2023-08-10T11:27:04.498 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2023-08-10T11:27:04.498 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2023-08-10T11:27:04.498 DEBUG:tasks.check_counter:Getting stats from c 2023-08-10T11:27:04.499 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.c perf dump 2023-08-10T11:27:05.403 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:27:05.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:05 smithi157 ceph-mon[129604]: pgmap v1142: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-08-10T11:27:05.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:05 smithi107 ceph-mon[127953]: pgmap v1142: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-08-10T11:27:05.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:05 smithi195 ceph-mon[129938]: pgmap v1142: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 11 op/s 2023-08-10T11:27:07.065 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-08-10T11:27:07.065 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:27:07.065 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 5160, 2023-08-10T11:27:07.065 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 5162, 2023-08-10T11:27:07.065 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 101327381, 2023-08-10T11:27:07.065 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 1604770, 2023-08-10T11:27:07.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 8, 2023-08-10T11:27:07.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 4, 2023-08-10T11:27:07.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.625327974, 2023-08-10T11:27:07.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.147785227, 2023-08-10T11:27:07.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.278524621, 2023-08-10T11:27:07.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.153477221, 2023-08-10T11:27:07.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:07.067 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5160, 2023-08-10T11:27:07.067 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.362583008, 2023-08-10T11:27:07.067 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000070268 2023-08-10T11:27:07.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.067 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:07.067 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.067 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.067 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T11:27:07.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T11:27:07.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.068 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:27:07.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 2423, 2023-08-10T11:27:07.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 2295, 2023-08-10T11:27:07.069 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 66042090, 2023-08-10T11:27:07.069 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 866081, 2023-08-10T11:27:07.069 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 7, 2023-08-10T11:27:07.069 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2023-08-10T11:27:07.069 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.351338269, 2023-08-10T11:27:07.069 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.094097696, 2023-08-10T11:27:07.069 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.196942411, 2023-08-10T11:27:07.069 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.057942354, 2023-08-10T11:27:07.070 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:07.070 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2294, 2023-08-10T11:27:07.070 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.246410678, 2023-08-10T11:27:07.070 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000107415 2023-08-10T11:27:07.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.070 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:07.070 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.070 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.071 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2458720, 2023-08-10T11:27:07.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 365616 2023-08-10T11:27:07.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.071 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:27:07.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1169, 2023-08-10T11:27:07.072 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 1634, 2023-08-10T11:27:07.072 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 50628579, 2023-08-10T11:27:07.073 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 1311959, 2023-08-10T11:27:07.073 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 9, 2023-08-10T11:27:07.073 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2023-08-10T11:27:07.073 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.221211148, 2023-08-10T11:27:07.073 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.057564059, 2023-08-10T11:27:07.074 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.110700075, 2023-08-10T11:27:07.074 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.036720354, 2023-08-10T11:27:07.074 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:07.074 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1632, 2023-08-10T11:27:07.074 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.184054976, 2023-08-10T11:27:07.074 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000112778 2023-08-10T11:27:07.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.074 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:07.075 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.075 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.075 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.075 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 3440, 2023-08-10T11:27:07.075 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 950576 2023-08-10T11:27:07.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.075 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-08-10T11:27:07.076 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-08-10T11:27:07.076 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-08-10T11:27:07.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.076 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-08-10T11:27:07.076 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-08-10T11:27:07.076 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-08-10T11:27:07.076 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 13351, 2023-08-10T11:27:07.076 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.372979887, 2023-08-10T11:27:07.077 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000027936 2023-08-10T11:27:07.077 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:07.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.077 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-08-10T11:27:07.077 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-08-10T11:27:07.077 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-08-10T11:27:07.077 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.078 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.078 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.078 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:07.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.078 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-08-10T11:27:07.078 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 0, 2023-08-10T11:27:07.078 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 0, 2023-08-10T11:27:07.078 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-08-10T11:27:07.079 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.079 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.079 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.079 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-08-10T11:27:07.079 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 0, 2023-08-10T11:27:07.079 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2023-08-10T11:27:07.079 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-08-10T11:27:07.080 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 0, 2023-08-10T11:27:07.080 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2023-08-10T11:27:07.080 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2023-08-10T11:27:07.080 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 393, 2023-08-10T11:27:07.080 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 0, 2023-08-10T11:27:07.080 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 0, 2023-08-10T11:27:07.080 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 393, 2023-08-10T11:27:07.080 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 393, 2023-08-10T11:27:07.081 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 1, 2023-08-10T11:27:07.081 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 0, 2023-08-10T11:27:07.081 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 0, 2023-08-10T11:27:07.081 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 21, 2023-08-10T11:27:07.081 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 0, 2023-08-10T11:27:07.081 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 0, 2023-08-10T11:27:07.081 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 0, 2023-08-10T11:27:07.081 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 0, 2023-08-10T11:27:07.082 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2023-08-10T11:27:07.082 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-08-10T11:27:07.082 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2023-08-10T11:27:07.082 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 0, 2023-08-10T11:27:07.082 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2023-08-10T11:27:07.082 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 0, 2023-08-10T11:27:07.082 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 0, 2023-08-10T11:27:07.082 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 0, 2023-08-10T11:27:07.083 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 0, 2023-08-10T11:27:07.083 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-08-10T11:27:07.083 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2023-08-10T11:27:07.083 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-08-10T11:27:07.083 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 1045, 2023-08-10T11:27:07.083 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 8980019622, 2023-08-10T11:27:07.083 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 7, 2023-08-10T11:27:07.083 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2023-08-10T11:27:07.084 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-08-10T11:27:07.084 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:27:07.084 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:27:07.084 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2023-08-10T11:27:07.084 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T11:27:07.084 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2023-08-10T11:27:07.084 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2023-08-10T11:27:07.085 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2023-08-10T11:27:07.085 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 0, 2023-08-10T11:27:07.085 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 0, 2023-08-10T11:27:07.085 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:27:07.085 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:27:07.085 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:27:07.085 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 0, 2023-08-10T11:27:07.085 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 0, 2023-08-10T11:27:07.086 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 0, 2023-08-10T11:27:07.086 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 0 2023-08-10T11:27:07.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.086 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-08-10T11:27:07.086 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 0, 2023-08-10T11:27:07.086 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 0, 2023-08-10T11:27:07.086 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 0, 2023-08-10T11:27:07.086 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 0, 2023-08-10T11:27:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 0, 2023-08-10T11:27:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2023-08-10T11:27:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-08-10T11:27:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:27:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 0, 2023-08-10T11:27:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 0, 2023-08-10T11:27:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2023-08-10T11:27:07.087 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2023-08-10T11:27:07.088 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-08-10T11:27:07.088 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:27:07.088 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:27:07.088 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-08-10T11:27:07.088 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-08-10T11:27:07.088 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T11:27:07.088 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 0, 2023-08-10T11:27:07.088 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-08-10T11:27:07.089 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2023-08-10T11:27:07.089 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-08-10T11:27:07.089 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-08-10T11:27:07.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.089 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-08-10T11:27:07.089 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 0, 2023-08-10T11:27:07.089 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-08-10T11:27:07.089 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-08-10T11:27:07.090 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 0, 2023-08-10T11:27:07.090 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-08-10T11:27:07.090 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-08-10T11:27:07.090 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 0, 2023-08-10T11:27:07.090 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-08-10T11:27:07.090 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-08-10T11:27:07.090 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 54, 2023-08-10T11:27:07.090 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-08-10T11:27:07.091 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-08-10T11:27:07.091 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-08-10T11:27:07.091 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 0, 2023-08-10T11:27:07.091 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 217196099, 2023-08-10T11:27:07.091 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-08-10T11:27:07.091 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.091 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.091 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.092 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 12167 2023-08-10T11:27:07.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.092 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-08-10T11:27:07.092 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 233, 2023-08-10T11:27:07.092 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 3591, 2023-08-10T11:27:07.092 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 3358, 2023-08-10T11:27:07.093 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 54, 2023-08-10T11:27:07.093 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 145, 2023-08-10T11:27:07.093 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 91, 2023-08-10T11:27:07.093 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 393, 2023-08-10T11:27:07.093 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 4786, 2023-08-10T11:27:07.093 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 4393, 2023-08-10T11:27:07.093 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 0, 2023-08-10T11:27:07.093 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 0, 2023-08-10T11:27:07.094 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 0, 2023-08-10T11:27:07.094 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 58272, 2023-08-10T11:27:07.094 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 207152 2023-08-10T11:27:07.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.094 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-08-10T11:27:07.094 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 0, 2023-08-10T11:27:07.094 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 0, 2023-08-10T11:27:07.094 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 0, 2023-08-10T11:27:07.095 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 0, 2023-08-10T11:27:07.095 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 0, 2023-08-10T11:27:07.095 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-08-10T11:27:07.095 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.095 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.095 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.095 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-08-10T11:27:07.096 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.096 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.096 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.096 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-08-10T11:27:07.096 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.096 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.096 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.097 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-08-10T11:27:07.097 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.097 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.097 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.097 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-08-10T11:27:07.097 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.098 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.098 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.098 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-08-10T11:27:07.098 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.098 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.098 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.099 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-08-10T11:27:07.099 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.099 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.099 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.099 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-08-10T11:27:07.099 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.099 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.100 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.100 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-08-10T11:27:07.100 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.100 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.100 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.100 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-08-10T11:27:07.101 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.101 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.101 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.101 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-08-10T11:27:07.101 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.101 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.102 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.102 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-08-10T11:27:07.102 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.102 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.102 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.102 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-08-10T11:27:07.103 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.103 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.103 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.103 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-08-10T11:27:07.103 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.103 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.103 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.104 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-08-10T11:27:07.104 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.104 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.104 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.104 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-08-10T11:27:07.104 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.105 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.105 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.105 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-08-10T11:27:07.105 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.105 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.105 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.106 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-08-10T11:27:07.106 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.106 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.106 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.106 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-08-10T11:27:07.106 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.106 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.107 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.107 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-08-10T11:27:07.107 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.107 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.107 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.107 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-08-10T11:27:07.108 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.108 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.108 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.108 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-08-10T11:27:07.108 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.108 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.108 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.109 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-08-10T11:27:07.109 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.109 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.109 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.109 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-08-10T11:27:07.109 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.110 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.110 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.110 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-08-10T11:27:07.110 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.110 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.110 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.111 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-08-10T11:27:07.111 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.111 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.111 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.111 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-08-10T11:27:07.111 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.112 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.112 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.112 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-08-10T11:27:07.112 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.112 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.112 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.113 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-08-10T11:27:07.113 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.113 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.113 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.113 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:27:07.113 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:27:07.113 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-08-10T11:27:07.114 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.114 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.114 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.114 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:07.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.114 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-08-10T11:27:07.114 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 2, 2023-08-10T11:27:07.114 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 6, 2023-08-10T11:27:07.115 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 4, 2023-08-10T11:27:07.115 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 4, 2023-08-10T11:27:07.115 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-08-10T11:27:07.115 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 0, 2023-08-10T11:27:07.115 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 0, 2023-08-10T11:27:07.115 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 7399 2023-08-10T11:27:07.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.115 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-08-10T11:27:07.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:27:07.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-08-10T11:27:07.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:27:07.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:27:07.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:27:07.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:27:07.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:27:07.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:27:07.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:27:07.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:27:07.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:27:07.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:27:07.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:27:07.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:27:07.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:27:07.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-08-10T11:27:07.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:27:07.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-08-10T11:27:07.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:27:07.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:27:07.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:27:07.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:27:07.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:27:07.119 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:27:07.119 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:27:07.119 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-08-10T11:27:07.119 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:27:07.119 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:27:07.119 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:27:07.119 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-08-10T11:27:07.119 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-08-10T11:27:07.120 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-08-10T11:27:07.120 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:27:07.120 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:27:07.120 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:27:07.120 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:27:07.120 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 241793, 2023-08-10T11:27:07.120 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 85, 2023-08-10T11:27:07.120 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:27:07.121 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-08-10T11:27:07.121 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-08-10T11:27:07.121 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-08-10T11:27:07.121 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:27:07.121 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-08-10T11:27:07.121 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:27:07.121 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-08-10T11:27:07.121 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 9208, 2023-08-10T11:27:07.122 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 176, 2023-08-10T11:27:07.122 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:27:07.122 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:27:07.122 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-08-10T11:27:07.122 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-08-10T11:27:07.123 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 1231307, 2023-08-10T11:27:07.123 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 3876, 2023-08-10T11:27:07.123 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-08-10T11:27:07.124 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-08-10T11:27:07.124 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-08-10T11:27:07.124 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-08-10T11:27:07.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.124 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-08-10T11:27:07.124 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-08-10T11:27:07.124 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-08-10T11:27:07.124 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 7931, 2023-08-10T11:27:07.125 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 26, 2023-08-10T11:27:07.125 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 4, 2023-08-10T11:27:07.125 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 7931, 2023-08-10T11:27:07.125 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-08-10T11:27:07.125 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 7931, 2023-08-10T11:27:07.125 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 13.657749949, 2023-08-10T11:27:07.125 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001722071 2023-08-10T11:27:07.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.126 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-08-10T11:27:07.126 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-08-10T11:27:07.126 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 7931, 2023-08-10T11:27:07.126 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 7932 2023-08-10T11:27:07.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.126 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 7931, 2023-08-10T11:27:07.126 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 7931, 2023-08-10T11:27:07.126 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 0, 2023-08-10T11:27:07.127 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-08-10T11:27:07.127 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-08-10T11:27:07.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 4544, 2023-08-10T11:27:07.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 0, 2023-08-10T11:27:07.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 3384, 2023-08-10T11:27:07.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 0, 2023-08-10T11:27:07.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 0, 2023-08-10T11:27:07.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-08-10T11:27:07.128 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-08-10T11:27:07.128 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2023-08-10T11:27:07.128 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2023-08-10T11:27:07.128 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 0, 2023-08-10T11:27:07.128 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-08-10T11:27:07.128 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-08-10T11:27:07.128 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-08-10T11:27:07.128 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 2, 2023-08-10T11:27:07.129 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 0, 2023-08-10T11:27:07.129 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:27:07.129 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-08-10T11:27:07.129 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:27:07.129 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-08-10T11:27:07.129 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-08-10T11:27:07.129 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-08-10T11:27:07.129 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:27:07.130 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-08-10T11:27:07.130 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:27:07.130 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-08-10T11:27:07.130 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-08-10T11:27:07.130 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-08-10T11:27:07.130 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-08-10T11:27:07.130 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-08-10T11:27:07.130 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-08-10T11:27:07.131 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-08-10T11:27:07.131 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-08-10T11:27:07.131 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-08-10T11:27:07.131 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-08-10T11:27:07.131 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-08-10T11:27:07.131 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-08-10T11:27:07.131 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-08-10T11:27:07.131 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-08-10T11:27:07.132 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-08-10T11:27:07.132 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-08-10T11:27:07.132 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-08-10T11:27:07.132 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 158, 2023-08-10T11:27:07.132 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-08-10T11:27:07.132 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 67, 2023-08-10T11:27:07.132 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 11, 2023-08-10T11:27:07.132 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2023-08-10T11:27:07.133 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 1, 2023-08-10T11:27:07.133 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-08-10T11:27:07.133 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 0, 2023-08-10T11:27:07.133 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 2, 2023-08-10T11:27:07.133 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 0 2023-08-10T11:27:07.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.133 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-08-10T11:27:07.133 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 0, 2023-08-10T11:27:07.134 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:27:07.134 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-08-10T11:27:07.134 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-08-10T11:27:07.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.134 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-08-10T11:27:07.134 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2023-08-10T11:27:07.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.134 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-08-10T11:27:07.135 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-08-10T11:27:07.135 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 0, 2023-08-10T11:27:07.135 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-08-10T11:27:07.135 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 0, 2023-08-10T11:27:07.135 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 0, 2023-08-10T11:27:07.135 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-08-10T11:27:07.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.135 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:27:07.136 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:07.136 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-08-10T11:27:07.136 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:07.136 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 8748, 2023-08-10T11:27:07.136 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 217166649, 2023-08-10T11:27:07.136 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:07.136 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 8748, 2023-08-10T11:27:07.136 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 8748, 2023-08-10T11:27:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 217166649, 2023-08-10T11:27:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.137 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:07.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.138 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-08-10T11:27:07.138 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:07.138 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-08-10T11:27:07.138 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:07.138 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:07.138 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:07.138 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:07.139 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:07.139 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 7931, 2023-08-10T11:27:07.139 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 213337154, 2023-08-10T11:27:07.139 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 7931, 2023-08-10T11:27:07.139 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 213337154, 2023-08-10T11:27:07.139 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:07.139 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.139 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.140 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.140 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:07.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.140 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-08-10T11:27:07.140 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:07.140 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-08-10T11:27:07.140 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:07.141 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:07.141 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:07.141 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:07.141 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:07.141 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 7931, 2023-08-10T11:27:07.141 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 7931, 2023-08-10T11:27:07.141 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 7931, 2023-08-10T11:27:07.141 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 7931, 2023-08-10T11:27:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:27:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-08-10T11:27:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2023-08-10T11:27:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2023-08-10T11:27:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x5602f45a8500": { 2023-08-10T11:27:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-08-10T11:27:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2023-08-10T11:27:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2023-08-10T11:27:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:07.147 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-08-10T11:27:07.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:07 smithi195 ceph-mon[129938]: pgmap v1143: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 68 KiB/s wr, 25 op/s 2023-08-10T11:27:07.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:07 smithi157 ceph-mon[129604]: pgmap v1143: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 68 KiB/s wr, 25 op/s 2023-08-10T11:27:07.579 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:07 smithi107 ceph-mon[127953]: pgmap v1143: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 68 KiB/s wr, 25 op/s 2023-08-10T11:27:07.623 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-08-10T11:27:07.623 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-08-10T11:27:07.624 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-08-10T11:27:07.624 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-08-10T11:27:07.624 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=7 2023-08-10T11:27:07.624 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-08-10T11:27:07.624 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T11:27:07.625 DEBUG:tasks.check_counter:Getting stats from f 2023-08-10T11:27:07.625 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.f perf dump 2023-08-10T11:27:08.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:08 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:27:08.540 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:08 smithi157 ceph-mon[129604]: osdmap e159: 12 total, 12 up, 12 in 2023-08-10T11:27:08.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:08 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:27:08.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:08 smithi107 ceph-mon[127953]: osdmap e159: 12 total, 12 up, 12 in 2023-08-10T11:27:08.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:08 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:27:08.664 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:08 smithi195 ceph-mon[129938]: osdmap e159: 12 total, 12 up, 12 in 2023-08-10T11:27:08.743 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:27:09.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:09 smithi157 ceph-mon[129604]: pgmap v1145: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 67 KiB/s wr, 27 op/s 2023-08-10T11:27:09.546 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:09 smithi195 ceph-mon[129938]: pgmap v1145: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 67 KiB/s wr, 27 op/s 2023-08-10T11:27:09.583 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:09 smithi107 ceph-mon[127953]: pgmap v1145: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 67 KiB/s wr, 27 op/s 2023-08-10T11:27:11.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:11 smithi157 ceph-mon[129604]: pgmap v1146: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 68 KiB/s wr, 28 op/s 2023-08-10T11:27:11.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:11 smithi107 ceph-mon[127953]: pgmap v1146: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 68 KiB/s wr, 28 op/s 2023-08-10T11:27:11.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:11 smithi195 ceph-mon[129938]: pgmap v1146: 129 pgs: 16 active+clean+snaptrim, 43 active+clean+snaptrim_wait, 70 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 68 KiB/s wr, 28 op/s 2023-08-10T11:27:12.830 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 11:27:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T11:27:12.560+0000 7f1a7cd3e700 -1 calc_pg_upmaps abort due to max <= 0 2023-08-10T11:27:13.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:13 smithi107 ceph-mon[127953]: pgmap v1147: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 68 KiB/s wr, 28 op/s 2023-08-10T11:27:13.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:13 smithi195 ceph-mon[129938]: pgmap v1147: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 68 KiB/s wr, 28 op/s 2023-08-10T11:27:13.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:13 smithi157 ceph-mon[129604]: pgmap v1147: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 68 KiB/s wr, 28 op/s 2023-08-10T11:27:15.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:15 smithi107 ceph-mon[127953]: pgmap v1148: 129 pgs: 17 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 63 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 68 KiB/s wr, 28 op/s 2023-08-10T11:27:15.662 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-08-10T11:27:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:27:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 32568, 2023-08-10T11:27:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 37243, 2023-08-10T11:27:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 12834131, 2023-08-10T11:27:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 19511353, 2023-08-10T11:27:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 20, 2023-08-10T11:27:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2023-08-10T11:27:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 2.853698308, 2023-08-10T11:27:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 1.215467606, 2023-08-10T11:27:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 1.951116052, 2023-08-10T11:27:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.030976918, 2023-08-10T11:27:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 37240, 2023-08-10T11:27:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 4.073444391, 2023-08-10T11:27:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000109383 2023-08-10T11:27:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 61721, 2023-08-10T11:27:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.015529050, 2023-08-10T11:27:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000251 2023-08-10T11:27:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2470704, 2023-08-10T11:27:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 377872 2023-08-10T11:27:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:27:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 6006754, 2023-08-10T11:27:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 5996634, 2023-08-10T11:27:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 986854989, 2023-08-10T11:27:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 963604887, 2023-08-10T11:27:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 13, 2023-08-10T11:27:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2023-08-10T11:27:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 369.254351254, 2023-08-10T11:27:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 175.090154086, 2023-08-10T11:27:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 245.074382306, 2023-08-10T11:27:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.071417045, 2023-08-10T11:27:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5996634, 2023-08-10T11:27:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 93.720381032, 2023-08-10T11:27:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000015628 2023-08-10T11:27:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 11993134, 2023-08-10T11:27:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.400053063, 2023-08-10T11:27:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000116 2023-08-10T11:27:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 3440, 2023-08-10T11:27:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 964672 2023-08-10T11:27:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:27:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 16414, 2023-08-10T11:27:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 15698, 2023-08-10T11:27:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 5988255, 2023-08-10T11:27:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 14028976, 2023-08-10T11:27:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 14, 2023-08-10T11:27:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 7, 2023-08-10T11:27:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 1.681291563, 2023-08-10T11:27:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.832777193, 2023-08-10T11:27:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 1.002846821, 2023-08-10T11:27:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.058427183, 2023-08-10T11:27:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 15696, 2023-08-10T11:27:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.362320781, 2023-08-10T11:27:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000086794 2023-08-10T11:27:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 27810, 2023-08-10T11:27:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.006409106, 2023-08-10T11:27:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000230 2023-08-10T11:27:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 5936, 2023-08-10T11:27:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 42848 2023-08-10T11:27:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-08-10T11:27:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-08-10T11:27:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-08-10T11:27:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-08-10T11:27:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-08-10T11:27:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-08-10T11:27:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 6353, 2023-08-10T11:27:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.062059886, 2023-08-10T11:27:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000324580 2023-08-10T11:27:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-08-10T11:27:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-08-10T11:27:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-08-10T11:27:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 223, 2023-08-10T11:27:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.009356061, 2023-08-10T11:27:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000041955 2023-08-10T11:27:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:15.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.675 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-08-10T11:27:15.675 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 7394, 2023-08-10T11:27:15.675 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 5296, 2023-08-10T11:27:15.675 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-08-10T11:27:15.675 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5296, 2023-08-10T11:27:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 229.562676260, 2023-08-10T11:27:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.043346426 2023-08-10T11:27:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-08-10T11:27:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 2098, 2023-08-10T11:27:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 5, 2023-08-10T11:27:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-08-10T11:27:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 28, 2023-08-10T11:27:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 2, 2023-08-10T11:27:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2023-08-10T11:27:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 597, 2023-08-10T11:27:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 39, 2023-08-10T11:27:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 512, 2023-08-10T11:27:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 46, 2023-08-10T11:27:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 542, 2023-08-10T11:27:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 1309, 2023-08-10T11:27:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 100, 2023-08-10T11:27:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 100, 2023-08-10T11:27:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 24, 2023-08-10T11:27:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 30495, 2023-08-10T11:27:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 24133, 2023-08-10T11:27:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 2034, 2023-08-10T11:27:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 273, 2023-08-10T11:27:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2023-08-10T11:27:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-08-10T11:27:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 2698, 2023-08-10T11:27:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 260, 2023-08-10T11:27:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2023-08-10T11:27:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 19, 2023-08-10T11:27:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 850, 2023-08-10T11:27:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 15, 2023-08-10T11:27:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 939, 2023-08-10T11:27:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-08-10T11:27:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 545, 2023-08-10T11:27:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-08-10T11:27:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 1047, 2023-08-10T11:27:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 8979585222, 2023-08-10T11:27:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 7, 2023-08-10T11:27:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 545, 2023-08-10T11:27:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-08-10T11:27:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:27:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:27:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 2, 2023-08-10T11:27:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T11:27:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 2, 2023-08-10T11:27:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 543, 2023-08-10T11:27:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 523, 2023-08-10T11:27:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 6597, 2023-08-10T11:27:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 4990, 2023-08-10T11:27:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:27:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:27:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:27:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 9296, 2023-08-10T11:27:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 1771, 2023-08-10T11:27:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 293, 2023-08-10T11:27:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 375 2023-08-10T11:27:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-08-10T11:27:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 71, 2023-08-10T11:27:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 493, 2023-08-10T11:27:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 271, 2023-08-10T11:27:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 703, 2023-08-10T11:27:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 279, 2023-08-10T11:27:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2023-08-10T11:27:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-08-10T11:27:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:27:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 112, 2023-08-10T11:27:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 32, 2023-08-10T11:27:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 456, 2023-08-10T11:27:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 65, 2023-08-10T11:27:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-08-10T11:27:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:27:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:27:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-08-10T11:27:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-08-10T11:27:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T11:27:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 19, 2023-08-10T11:27:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-08-10T11:27:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 2, 2023-08-10T11:27:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-08-10T11:27:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-08-10T11:27:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-08-10T11:27:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 6120, 2023-08-10T11:27:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-08-10T11:27:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-08-10T11:27:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 6120, 2023-08-10T11:27:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-08-10T11:27:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-08-10T11:27:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 9, 2023-08-10T11:27:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-08-10T11:27:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-08-10T11:27:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 9, 2023-08-10T11:27:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-08-10T11:27:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-08-10T11:27:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-08-10T11:27:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 25224614, 2023-08-10T11:27:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2023-08-10T11:27:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-08-10T11:27:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2893, 2023-08-10T11:27:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 38.895551820, 2023-08-10T11:27:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.013444712 2023-08-10T11:27:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2023-08-10T11:27:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-08-10T11:27:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 207, 2023-08-10T11:27:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 978, 2023-08-10T11:27:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 771, 2023-08-10T11:27:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 120, 2023-08-10T11:27:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 365, 2023-08-10T11:27:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 245, 2023-08-10T11:27:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 597, 2023-08-10T11:27:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 1938, 2023-08-10T11:27:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 1341, 2023-08-10T11:27:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 100, 2023-08-10T11:27:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 634, 2023-08-10T11:27:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 534, 2023-08-10T11:27:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 63180, 2023-08-10T11:27:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 198960 2023-08-10T11:27:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-08-10T11:27:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 21025, 2023-08-10T11:27:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 4672, 2023-08-10T11:27:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 7394, 2023-08-10T11:27:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 135, 2023-08-10T11:27:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 8281, 2023-08-10T11:27:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-08-10T11:27:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 35, 2023-08-10T11:27:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.123165169, 2023-08-10T11:27:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003519004 2023-08-10T11:27:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-08-10T11:27:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 270, 2023-08-10T11:27:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.896685641, 2023-08-10T11:27:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003321057 2023-08-10T11:27:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-08-10T11:27:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-08-10T11:27:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 75, 2023-08-10T11:27:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.691697666, 2023-08-10T11:27:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.022555968 2023-08-10T11:27:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-08-10T11:27:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2894, 2023-08-10T11:27:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 83.174950217, 2023-08-10T11:27:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.028740480 2023-08-10T11:27:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-08-10T11:27:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-08-10T11:27:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-08-10T11:27:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-08-10T11:27:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-08-10T11:27:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-08-10T11:27:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-08-10T11:27:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-08-10T11:27:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-08-10T11:27:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-08-10T11:27:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1360, 2023-08-10T11:27:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.710442157, 2023-08-10T11:27:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000522383 2023-08-10T11:27:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-08-10T11:27:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 34, 2023-08-10T11:27:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.028450375, 2023-08-10T11:27:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000836775 2023-08-10T11:27:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-08-10T11:27:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 547, 2023-08-10T11:27:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 142.267004329, 2023-08-10T11:27:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.260085931 2023-08-10T11:27:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-08-10T11:27:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-08-10T11:27:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-08-10T11:27:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-08-10T11:27:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-08-10T11:27:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-08-10T11:27:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-08-10T11:27:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-08-10T11:27:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-08-10T11:27:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-08-10T11:27:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-08-10T11:27:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-08-10T11:27:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 81, 2023-08-10T11:27:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.670280706, 2023-08-10T11:27:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.008275070 2023-08-10T11:27:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:27:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:27:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-08-10T11:27:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-08-10T11:27:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 2, 2023-08-10T11:27:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 3, 2023-08-10T11:27:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 1, 2023-08-10T11:27:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 2, 2023-08-10T11:27:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-08-10T11:27:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 272, 2023-08-10T11:27:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 136, 2023-08-10T11:27:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 2147 2023-08-10T11:27:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-08-10T11:27:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:27:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-08-10T11:27:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:27:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:27:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:27:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:27:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:27:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:27:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:27:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:27:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:27:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:27:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:27:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:27:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:27:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-08-10T11:27:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:27:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-08-10T11:27:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:27:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:27:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:27:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:27:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:27:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:27:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:27:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-08-10T11:27:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:27:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:27:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:27:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-08-10T11:27:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-08-10T11:27:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-08-10T11:27:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:27:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:27:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:27:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:27:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 726813, 2023-08-10T11:27:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 222, 2023-08-10T11:27:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:27:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-08-10T11:27:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-08-10T11:27:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-08-10T11:27:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:27:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-08-10T11:27:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:27:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-08-10T11:27:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 9568, 2023-08-10T11:27:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 185, 2023-08-10T11:27:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:27:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:27:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-08-10T11:27:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-08-10T11:27:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 1756737, 2023-08-10T11:27:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 78089, 2023-08-10T11:27:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-08-10T11:27:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-08-10T11:27:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-08-10T11:27:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-08-10T11:27:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-08-10T11:27:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-08-10T11:27:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-08-10T11:27:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 4043, 2023-08-10T11:27:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 21277679, 2023-08-10T11:27:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 27, 2023-08-10T11:27:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 4043, 2023-08-10T11:27:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-08-10T11:27:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4043, 2023-08-10T11:27:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 45.234177150, 2023-08-10T11:27:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.011188270 2023-08-10T11:27:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-08-10T11:27:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-08-10T11:27:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4043, 2023-08-10T11:27:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 4426 2023-08-10T11:27:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 4043, 2023-08-10T11:27:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 581, 2023-08-10T11:27:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 3462, 2023-08-10T11:27:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-08-10T11:27:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-08-10T11:27:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2023-08-10T11:27:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2023-08-10T11:27:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 31, 2023-08-10T11:27:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 2924, 2023-08-10T11:27:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 158, 2023-08-10T11:27:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-08-10T11:27:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-08-10T11:27:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2023-08-10T11:27:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 1, 2023-08-10T11:27:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 82, 2023-08-10T11:27:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-08-10T11:27:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-08-10T11:27:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-08-10T11:27:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 545, 2023-08-10T11:27:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2023-08-10T11:27:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:27:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-08-10T11:27:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:27:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-08-10T11:27:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-08-10T11:27:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-08-10T11:27:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:27:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-08-10T11:27:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:27:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-08-10T11:27:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-08-10T11:27:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-08-10T11:27:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-08-10T11:27:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-08-10T11:27:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-08-10T11:27:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-08-10T11:27:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-08-10T11:27:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-08-10T11:27:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-08-10T11:27:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-08-10T11:27:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-08-10T11:27:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-08-10T11:27:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-08-10T11:27:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-08-10T11:27:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-08-10T11:27:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-08-10T11:27:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 159, 2023-08-10T11:27:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-08-10T11:27:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 68, 2023-08-10T11:27:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2023-08-10T11:27:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2023-08-10T11:27:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2023-08-10T11:27:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-08-10T11:27:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 492, 2023-08-10T11:27:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 10, 2023-08-10T11:27:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 153 2023-08-10T11:27:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-08-10T11:27:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2023-08-10T11:27:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:27:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-08-10T11:27:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-08-10T11:27:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-08-10T11:27:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2023-08-10T11:27:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-08-10T11:27:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-08-10T11:27:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 6, 2023-08-10T11:27:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-08-10T11:27:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 3, 2023-08-10T11:27:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 32, 2023-08-10T11:27:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-08-10T11:27:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:27:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-08-10T11:27:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 6055732, 2023-08-10T11:27:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 460614345, 2023-08-10T11:27:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 6055732, 2023-08-10T11:27:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 6055732, 2023-08-10T11:27:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 460614345, 2023-08-10T11:27:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-08-10T11:27:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-08-10T11:27:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 4043, 2023-08-10T11:27:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 21281335, 2023-08-10T11:27:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 4043, 2023-08-10T11:27:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 21281335, 2023-08-10T11:27:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-08-10T11:27:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-08-10T11:27:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 4043, 2023-08-10T11:27:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 4043, 2023-08-10T11:27:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 4043, 2023-08-10T11:27:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 4043, 2023-08-10T11:27:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:27:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-08-10T11:27:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 32, 2023-08-10T11:27:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 3736, 2023-08-10T11:27:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 32, 2023-08-10T11:27:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 31, 2023-08-10T11:27:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 3736, 2023-08-10T11:27:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x56471a6460a0": { 2023-08-10T11:27:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-08-10T11:27:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 6120, 2023-08-10T11:27:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 21030310, 2023-08-10T11:27:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 6120, 2023-08-10T11:27:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2893, 2023-08-10T11:27:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 21030310, 2023-08-10T11:27:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:15.749 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-08-10T11:27:15.749 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:15 smithi195 ceph-mon[129938]: pgmap v1148: 129 pgs: 17 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 63 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 68 KiB/s wr, 28 op/s 2023-08-10T11:27:15.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:15 smithi157 ceph-mon[129604]: pgmap v1148: 129 pgs: 17 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 63 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 68 KiB/s wr, 28 op/s 2023-08-10T11:27:16.209 INFO:tasks.check_counter:Daemon mds.f mds.exported=19 2023-08-10T11:27:16.209 INFO:tasks.check_counter:Daemon mds.f mds.imported=15 2023-08-10T11:27:16.210 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=71 2023-08-10T11:27:16.210 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=493 2023-08-10T11:27:16.210 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=7 2023-08-10T11:27:16.210 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-08-10T11:27:16.210 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T11:27:16.211 DEBUG:tasks.check_counter:Getting stats from i 2023-08-10T11:27:16.211 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.i perf dump 2023-08-10T11:27:16.946 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:27:17.493 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:17 smithi195 ceph-mon[129938]: pgmap v1149: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 KiB/s wr, 10 op/s 2023-08-10T11:27:17.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:17 smithi107 ceph-mon[127953]: pgmap v1149: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 KiB/s wr, 10 op/s 2023-08-10T11:27:17.788 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:17 smithi157 ceph-mon[129604]: pgmap v1149: 129 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 120 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 KiB/s wr, 10 op/s 2023-08-10T11:27:18.477 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-08-10T11:27:18.477 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:27:18.477 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 27491, 2023-08-10T11:27:18.478 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 26208, 2023-08-10T11:27:18.478 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 8695128, 2023-08-10T11:27:18.478 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 35629913, 2023-08-10T11:27:18.478 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 18, 2023-08-10T11:27:18.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2023-08-10T11:27:18.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 2.259171836, 2023-08-10T11:27:18.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.943590331, 2023-08-10T11:27:18.480 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 1.420658849, 2023-08-10T11:27:18.480 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.134634134, 2023-08-10T11:27:18.480 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:18.480 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 26204, 2023-08-10T11:27:18.481 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.483330643, 2023-08-10T11:27:18.481 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000094769 2023-08-10T11:27:18.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.481 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:18.481 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 43497, 2023-08-10T11:27:18.482 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.010642392, 2023-08-10T11:27:18.482 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000244 2023-08-10T11:27:18.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2023-08-10T11:27:18.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2023-08-10T11:27:18.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.482 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:27:18.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 60461, 2023-08-10T11:27:18.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 55124, 2023-08-10T11:27:18.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 26706274, 2023-08-10T11:27:18.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 30785906, 2023-08-10T11:27:18.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 13, 2023-08-10T11:27:18.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2023-08-10T11:27:18.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 5.164153521, 2023-08-10T11:27:18.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 2.404676614, 2023-08-10T11:27:18.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 3.496984540, 2023-08-10T11:27:18.484 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.036695142, 2023-08-10T11:27:18.484 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:18.484 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 55124, 2023-08-10T11:27:18.484 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 4.305925703, 2023-08-10T11:27:18.484 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000078113 2023-08-10T11:27:18.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.484 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:18.485 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 109793, 2023-08-10T11:27:18.485 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.026696344, 2023-08-10T11:27:18.485 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000243 2023-08-10T11:27:18.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.485 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 7552, 2023-08-10T11:27:18.485 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 990048 2023-08-10T11:27:18.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.485 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:27:18.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 42182, 2023-08-10T11:27:18.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 52697, 2023-08-10T11:27:18.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 16034773, 2023-08-10T11:27:18.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 44314851, 2023-08-10T11:27:18.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 15, 2023-08-10T11:27:18.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2023-08-10T11:27:18.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 4.261220350, 2023-08-10T11:27:18.486 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 1.975732066, 2023-08-10T11:27:18.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 2.689666021, 2023-08-10T11:27:18.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.077620189, 2023-08-10T11:27:18.487 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:18.487 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 52696, 2023-08-10T11:27:18.487 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 6.624008327, 2023-08-10T11:27:18.487 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000125702 2023-08-10T11:27:18.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.488 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:18.488 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 79890, 2023-08-10T11:27:18.488 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.022110704, 2023-08-10T11:27:18.488 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000276 2023-08-10T11:27:18.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.488 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2473360, 2023-08-10T11:27:18.489 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 379536 2023-08-10T11:27:18.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.489 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-08-10T11:27:18.489 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-08-10T11:27:18.489 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-08-10T11:27:18.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.489 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-08-10T11:27:18.489 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-08-10T11:27:18.490 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-08-10T11:27:18.490 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 10710, 2023-08-10T11:27:18.490 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 4.604112553, 2023-08-10T11:27:18.490 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000429889 2023-08-10T11:27:18.490 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:18.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.490 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-08-10T11:27:18.490 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-08-10T11:27:18.491 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-08-10T11:27:18.491 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 415, 2023-08-10T11:27:18.491 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.022814280, 2023-08-10T11:27:18.491 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000054974 2023-08-10T11:27:18.491 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:18.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.492 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-08-10T11:27:18.492 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 11574, 2023-08-10T11:27:18.492 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 9954, 2023-08-10T11:27:18.492 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-08-10T11:27:18.492 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 9954, 2023-08-10T11:27:18.493 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 455.442696003, 2023-08-10T11:27:18.493 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.045754741 2023-08-10T11:27:18.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.493 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-08-10T11:27:18.493 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 1620, 2023-08-10T11:27:18.493 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 13, 2023-08-10T11:27:18.493 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-08-10T11:27:18.493 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 29, 2023-08-10T11:27:18.494 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 2, 2023-08-10T11:27:18.494 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 1, 2023-08-10T11:27:18.494 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 775, 2023-08-10T11:27:18.494 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 12, 2023-08-10T11:27:18.494 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 110, 2023-08-10T11:27:18.495 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 653, 2023-08-10T11:27:18.495 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 757, 2023-08-10T11:27:18.495 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 4524, 2023-08-10T11:27:18.495 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 62, 2023-08-10T11:27:18.496 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 62, 2023-08-10T11:27:18.496 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 23, 2023-08-10T11:27:18.496 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 57582, 2023-08-10T11:27:18.496 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 46429, 2023-08-10T11:27:18.497 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 1529, 2023-08-10T11:27:18.497 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 315, 2023-08-10T11:27:18.497 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2023-08-10T11:27:18.498 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-08-10T11:27:18.498 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 5065, 2023-08-10T11:27:18.498 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 23, 2023-08-10T11:27:18.498 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2023-08-10T11:27:18.499 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 31, 2023-08-10T11:27:18.499 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 3821, 2023-08-10T11:27:18.499 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 48, 2023-08-10T11:27:18.500 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 3573, 2023-08-10T11:27:18.500 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-08-10T11:27:18.500 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 390, 2023-08-10T11:27:18.501 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-08-10T11:27:18.501 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 1047, 2023-08-10T11:27:18.501 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 8979585222, 2023-08-10T11:27:18.501 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 7, 2023-08-10T11:27:18.502 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 390, 2023-08-10T11:27:18.502 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-08-10T11:27:18.502 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:27:18.502 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:27:18.502 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 11, 2023-08-10T11:27:18.503 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T11:27:18.503 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 11, 2023-08-10T11:27:18.503 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 379, 2023-08-10T11:27:18.503 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 756, 2023-08-10T11:27:18.504 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 9153, 2023-08-10T11:27:18.504 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 7508, 2023-08-10T11:27:18.504 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:27:18.505 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:27:18.505 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:27:18.505 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 14566, 2023-08-10T11:27:18.505 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 2795, 2023-08-10T11:27:18.505 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 438, 2023-08-10T11:27:18.505 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 1194 2023-08-10T11:27:18.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.506 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-08-10T11:27:18.506 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 233, 2023-08-10T11:27:18.506 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 148, 2023-08-10T11:27:18.506 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 85, 2023-08-10T11:27:18.506 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 385, 2023-08-10T11:27:18.506 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 584, 2023-08-10T11:27:18.507 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 1, 2023-08-10T11:27:18.507 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-08-10T11:27:18.507 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:27:18.507 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 351, 2023-08-10T11:27:18.507 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 92, 2023-08-10T11:27:18.507 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 1191, 2023-08-10T11:27:18.507 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 102, 2023-08-10T11:27:18.507 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-08-10T11:27:18.508 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:27:18.508 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:27:18.508 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-08-10T11:27:18.508 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-08-10T11:27:18.508 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T11:27:18.508 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 37, 2023-08-10T11:27:18.508 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-08-10T11:27:18.508 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 3, 2023-08-10T11:27:18.509 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-08-10T11:27:18.509 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-08-10T11:27:18.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.509 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-08-10T11:27:18.509 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 11765, 2023-08-10T11:27:18.509 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-08-10T11:27:18.509 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-08-10T11:27:18.509 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 11765, 2023-08-10T11:27:18.510 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-08-10T11:27:18.510 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-08-10T11:27:18.510 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 21, 2023-08-10T11:27:18.510 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-08-10T11:27:18.510 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-08-10T11:27:18.510 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 21, 2023-08-10T11:27:18.510 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-08-10T11:27:18.510 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-08-10T11:27:18.511 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-08-10T11:27:18.511 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 64482072, 2023-08-10T11:27:18.511 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2023-08-10T11:27:18.511 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-08-10T11:27:18.511 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5195, 2023-08-10T11:27:18.511 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 51.771419909, 2023-08-10T11:27:18.511 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.009965624 2023-08-10T11:27:18.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.512 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2023-08-10T11:27:18.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.512 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-08-10T11:27:18.512 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 152, 2023-08-10T11:27:18.512 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 3683, 2023-08-10T11:27:18.513 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 3531, 2023-08-10T11:27:18.513 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 103, 2023-08-10T11:27:18.513 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 235, 2023-08-10T11:27:18.513 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 132, 2023-08-10T11:27:18.513 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 775, 2023-08-10T11:27:18.513 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 5401, 2023-08-10T11:27:18.513 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 4626, 2023-08-10T11:27:18.514 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 62, 2023-08-10T11:27:18.514 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 2449, 2023-08-10T11:27:18.514 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 2387, 2023-08-10T11:27:18.514 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 70580, 2023-08-10T11:27:18.514 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 198960 2023-08-10T11:27:18.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.514 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-08-10T11:27:18.515 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 38045, 2023-08-10T11:27:18.515 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 6734, 2023-08-10T11:27:18.515 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 11574, 2023-08-10T11:27:18.515 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 180, 2023-08-10T11:27:18.515 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 12562, 2023-08-10T11:27:18.515 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-08-10T11:27:18.515 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 153, 2023-08-10T11:27:18.516 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.548804345, 2023-08-10T11:27:18.516 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003586956 2023-08-10T11:27:18.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.516 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-08-10T11:27:18.516 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 391, 2023-08-10T11:27:18.516 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.937881071, 2023-08-10T11:27:18.516 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002398672 2023-08-10T11:27:18.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.517 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-08-10T11:27:18.517 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.517 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.517 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.517 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-08-10T11:27:18.517 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 248, 2023-08-10T11:27:18.518 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 3.659075783, 2023-08-10T11:27:18.518 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.014754337 2023-08-10T11:27:18.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.518 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-08-10T11:27:18.518 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5535, 2023-08-10T11:27:18.518 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 159.450968500, 2023-08-10T11:27:18.518 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.028807763 2023-08-10T11:27:18.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.519 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-08-10T11:27:18.519 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.519 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.519 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.519 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-08-10T11:27:18.519 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.519 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.520 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.520 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-08-10T11:27:18.520 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.520 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.520 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.520 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-08-10T11:27:18.521 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.521 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.521 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.521 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-08-10T11:27:18.521 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.521 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.521 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.522 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-08-10T11:27:18.522 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.522 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.522 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.522 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-08-10T11:27:18.522 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.523 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.523 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.523 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-08-10T11:27:18.523 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.523 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.524 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.524 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-08-10T11:27:18.524 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.524 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.525 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.525 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-08-10T11:27:18.525 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1904, 2023-08-10T11:27:18.525 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.579114873, 2023-08-10T11:27:18.526 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000829367 2023-08-10T11:27:18.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.526 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-08-10T11:27:18.526 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 87, 2023-08-10T11:27:18.526 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.097297210, 2023-08-10T11:27:18.526 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001118358 2023-08-10T11:27:18.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.527 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-08-10T11:27:18.527 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1372, 2023-08-10T11:27:18.527 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 287.786957594, 2023-08-10T11:27:18.527 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.209757257 2023-08-10T11:27:18.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.527 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-08-10T11:27:18.527 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.527 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.528 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.528 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-08-10T11:27:18.528 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.528 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.528 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.528 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-08-10T11:27:18.529 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.529 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.529 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.529 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-08-10T11:27:18.529 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.529 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.530 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.530 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-08-10T11:27:18.530 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.530 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.530 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.531 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-08-10T11:27:18.531 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.531 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.531 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.531 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-08-10T11:27:18.531 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.532 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.532 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.532 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-08-10T11:27:18.532 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.532 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.532 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.533 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-08-10T11:27:18.533 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.533 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.533 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.533 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-08-10T11:27:18.533 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.533 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.534 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.534 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-08-10T11:27:18.534 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.534 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.534 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.534 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-08-10T11:27:18.535 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 264, 2023-08-10T11:27:18.535 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.382596627, 2023-08-10T11:27:18.535 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.005237108 2023-08-10T11:27:18.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.535 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:27:18.535 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:27:18.535 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-08-10T11:27:18.535 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.536 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.536 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.536 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:18.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.536 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-08-10T11:27:18.536 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 2, 2023-08-10T11:27:18.536 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 2, 2023-08-10T11:27:18.537 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 0, 2023-08-10T11:27:18.537 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 2, 2023-08-10T11:27:18.537 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-08-10T11:27:18.537 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 407, 2023-08-10T11:27:18.537 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 203, 2023-08-10T11:27:18.537 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 2151 2023-08-10T11:27:18.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.537 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-08-10T11:27:18.538 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:27:18.538 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-08-10T11:27:18.538 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:27:18.538 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:27:18.538 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:27:18.538 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:27:18.539 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:27:18.539 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:27:18.539 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:27:18.539 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:27:18.539 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:27:18.539 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:27:18.539 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:27:18.539 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:27:18.540 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:27:18.540 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-08-10T11:27:18.540 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:27:18.540 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-08-10T11:27:18.540 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:27:18.540 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:27:18.540 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:27:18.541 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:27:18.541 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:27:18.541 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:27:18.541 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:27:18.541 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-08-10T11:27:18.541 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:27:18.541 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:27:18.541 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:27:18.542 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-08-10T11:27:18.542 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-08-10T11:27:18.542 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-08-10T11:27:18.542 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:27:18.542 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:27:18.542 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:27:18.542 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:27:18.542 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 774922, 2023-08-10T11:27:18.543 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 234, 2023-08-10T11:27:18.543 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:27:18.543 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-08-10T11:27:18.543 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-08-10T11:27:18.543 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-08-10T11:27:18.543 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:27:18.543 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-08-10T11:27:18.543 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:27:18.544 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-08-10T11:27:18.544 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 9568, 2023-08-10T11:27:18.544 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 185, 2023-08-10T11:27:18.544 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:27:18.544 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:27:18.544 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-08-10T11:27:18.544 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-08-10T11:27:18.545 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 1831243, 2023-08-10T11:27:18.545 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 93882, 2023-08-10T11:27:18.545 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-08-10T11:27:18.545 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-08-10T11:27:18.545 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-08-10T11:27:18.545 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-08-10T11:27:18.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.545 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-08-10T11:27:18.546 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-08-10T11:27:18.546 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-08-10T11:27:18.546 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 6490, 2023-08-10T11:27:18.546 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 60613455, 2023-08-10T11:27:18.546 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 27, 2023-08-10T11:27:18.546 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 6490, 2023-08-10T11:27:18.546 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-08-10T11:27:18.546 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 6490, 2023-08-10T11:27:18.547 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 66.231791025, 2023-08-10T11:27:18.547 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.010205206 2023-08-10T11:27:18.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.547 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-08-10T11:27:18.547 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-08-10T11:27:18.547 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 6490, 2023-08-10T11:27:18.547 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 7102 2023-08-10T11:27:18.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.548 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 6490, 2023-08-10T11:27:18.548 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 461, 2023-08-10T11:27:18.548 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 6029, 2023-08-10T11:27:18.548 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-08-10T11:27:18.548 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-08-10T11:27:18.548 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2023-08-10T11:27:18.548 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2023-08-10T11:27:18.548 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 58, 2023-08-10T11:27:18.549 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 5253, 2023-08-10T11:27:18.549 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 175, 2023-08-10T11:27:18.549 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-08-10T11:27:18.549 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-08-10T11:27:18.549 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 1, 2023-08-10T11:27:18.549 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 1, 2023-08-10T11:27:18.549 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 214, 2023-08-10T11:27:18.549 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-08-10T11:27:18.550 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-08-10T11:27:18.550 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-08-10T11:27:18.550 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 390, 2023-08-10T11:27:18.550 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2023-08-10T11:27:18.550 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:27:18.550 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-08-10T11:27:18.550 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:27:18.550 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-08-10T11:27:18.551 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-08-10T11:27:18.551 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-08-10T11:27:18.551 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:27:18.551 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-08-10T11:27:18.551 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:27:18.551 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-08-10T11:27:18.551 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-08-10T11:27:18.551 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-08-10T11:27:18.552 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-08-10T11:27:18.552 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-08-10T11:27:18.552 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-08-10T11:27:18.552 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-08-10T11:27:18.552 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-08-10T11:27:18.552 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-08-10T11:27:18.552 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-08-10T11:27:18.552 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-08-10T11:27:18.553 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-08-10T11:27:18.553 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-08-10T11:27:18.553 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-08-10T11:27:18.553 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-08-10T11:27:18.553 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-08-10T11:27:18.553 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-08-10T11:27:18.553 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 159, 2023-08-10T11:27:18.553 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-08-10T11:27:18.554 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 68, 2023-08-10T11:27:18.554 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2023-08-10T11:27:18.554 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2023-08-10T11:27:18.554 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2023-08-10T11:27:18.554 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-08-10T11:27:18.554 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 683, 2023-08-10T11:27:18.554 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 26, 2023-08-10T11:27:18.554 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 271 2023-08-10T11:27:18.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.555 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-08-10T11:27:18.555 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2023-08-10T11:27:18.555 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:27:18.555 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-08-10T11:27:18.555 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-08-10T11:27:18.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.555 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-08-10T11:27:18.556 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2023-08-10T11:27:18.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.556 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-08-10T11:27:18.556 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-08-10T11:27:18.556 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 10, 2023-08-10T11:27:18.556 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-08-10T11:27:18.556 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 5, 2023-08-10T11:27:18.557 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 92, 2023-08-10T11:27:18.557 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-08-10T11:27:18.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.557 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:27:18.557 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:18.557 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-08-10T11:27:18.557 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:18.557 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 130130, 2023-08-10T11:27:18.558 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 39677833, 2023-08-10T11:27:18.558 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:18.558 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 130130, 2023-08-10T11:27:18.558 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:18.558 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:18.558 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 130130, 2023-08-10T11:27:18.558 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 39677833, 2023-08-10T11:27:18.558 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:18.559 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.559 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.559 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.559 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:18.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.559 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-08-10T11:27:18.559 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:18.559 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-08-10T11:27:18.560 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:18.560 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:18.560 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:18.560 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:18.560 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:18.560 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 6490, 2023-08-10T11:27:18.560 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 60623627, 2023-08-10T11:27:18.560 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 6490, 2023-08-10T11:27:18.561 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 60623627, 2023-08-10T11:27:18.561 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:18.561 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.561 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.561 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.561 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:18.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.561 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-08-10T11:27:18.562 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:18.562 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-08-10T11:27:18.562 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:18.562 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:18.562 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:18.562 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:18.562 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:18.562 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 6490, 2023-08-10T11:27:18.563 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 6490, 2023-08-10T11:27:18.563 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 6490, 2023-08-10T11:27:18.563 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 6490, 2023-08-10T11:27:18.563 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:18.563 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.563 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.563 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.563 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:18.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.564 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:27:18.564 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:18.564 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-08-10T11:27:18.564 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:18.564 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 92, 2023-08-10T11:27:18.564 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 10380, 2023-08-10T11:27:18.564 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:18.565 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 92, 2023-08-10T11:27:18.565 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:18.565 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:18.565 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 58, 2023-08-10T11:27:18.565 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 10380, 2023-08-10T11:27:18.565 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:18.565 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.565 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.566 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.566 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:18.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:18.566 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x558bb0e240a0": { 2023-08-10T11:27:18.566 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:18.566 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-08-10T11:27:18.566 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:18.566 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 11765, 2023-08-10T11:27:18.567 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 60287768, 2023-08-10T11:27:18.567 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:18.567 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 11765, 2023-08-10T11:27:18.567 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:18.567 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:18.567 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 5195, 2023-08-10T11:27:18.567 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 60287768, 2023-08-10T11:27:18.567 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:18.568 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:18.568 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:18.568 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:18.568 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:18.568 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:18.568 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-08-10T11:27:18.921 INFO:tasks.check_counter:Daemon mds.i mds.exported=31 2023-08-10T11:27:18.922 INFO:tasks.check_counter:Daemon mds.i mds.imported=48 2023-08-10T11:27:18.922 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=233 2023-08-10T11:27:18.922 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=148 2023-08-10T11:27:18.923 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=7 2023-08-10T11:27:18.923 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-08-10T11:27:18.923 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T11:27:18.924 DEBUG:tasks.check_counter:Getting stats from l 2023-08-10T11:27:18.925 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8bf445f2d27d8e12e060dff0fd151d481b5290b shell --fsid 2b47e340-376a-11ee-9b37-001a4aab830c -- ceph daemon mds.l perf dump 2023-08-10T11:27:19.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:19 smithi107 ceph-mon[127953]: pgmap v1150: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2023-08-10T11:27:19.650 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/mon.c/config 2023-08-10T11:27:19.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:19 smithi195 ceph-mon[129938]: pgmap v1150: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2023-08-10T11:27:19.789 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:19 smithi157 ceph-mon[129604]: pgmap v1150: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2023-08-10T11:27:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:20 smithi195 ceph-mon[129938]: pgmap v1151: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 KiB/s wr, 12 op/s 2023-08-10T11:27:21.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:20 smithi195 ceph-mon[129938]: osdmap e160: 12 total, 12 up, 12 in 2023-08-10T11:27:21.194 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-08-10T11:27:21.195 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-08-10T11:27:21.195 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 49383, 2023-08-10T11:27:21.195 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 46666, 2023-08-10T11:27:21.195 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 16689606, 2023-08-10T11:27:21.195 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 31551547, 2023-08-10T11:27:21.195 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 15, 2023-08-10T11:27:21.196 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2023-08-10T11:27:21.196 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 4.182164252, 2023-08-10T11:27:21.196 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 1.970451442, 2023-08-10T11:27:21.196 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 2.761366722, 2023-08-10T11:27:21.196 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.078555540, 2023-08-10T11:27:21.196 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:21.196 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 46662, 2023-08-10T11:27:21.197 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 3.529473186, 2023-08-10T11:27:21.197 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000075639 2023-08-10T11:27:21.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.197 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:21.197 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 87422, 2023-08-10T11:27:21.197 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.018470152, 2023-08-10T11:27:21.197 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000211 2023-08-10T11:27:21.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.198 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 4112, 2023-08-10T11:27:21.198 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 22304 2023-08-10T11:27:21.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.198 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-08-10T11:27:21.198 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 59339, 2023-08-10T11:27:21.198 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 59396, 2023-08-10T11:27:21.198 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 26759823, 2023-08-10T11:27:21.198 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 27567845, 2023-08-10T11:27:21.199 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 17, 2023-08-10T11:27:21.199 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2023-08-10T11:27:21.199 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 4.830840400, 2023-08-10T11:27:21.199 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 2.057238560, 2023-08-10T11:27:21.199 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 3.378922838, 2023-08-10T11:27:21.199 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.057219482, 2023-08-10T11:27:21.199 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:21.200 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 59397, 2023-08-10T11:27:21.200 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 5.997159457, 2023-08-10T11:27:21.200 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000100967 2023-08-10T11:27:21.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.200 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:21.200 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 106673, 2023-08-10T11:27:21.200 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.026532425, 2023-08-10T11:27:21.200 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000248 2023-08-10T11:27:21.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.201 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2458368, 2023-08-10T11:27:21.201 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 382448 2023-08-10T11:27:21.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.201 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-08-10T11:27:21.201 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 5624164, 2023-08-10T11:27:21.201 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 5624570, 2023-08-10T11:27:21.201 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 891615939, 2023-08-10T11:27:21.202 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 927585231, 2023-08-10T11:27:21.202 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 16, 2023-08-10T11:27:21.202 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2023-08-10T11:27:21.202 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 352.003792190, 2023-08-10T11:27:21.202 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 168.538222077, 2023-08-10T11:27:21.202 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 234.107695500, 2023-08-10T11:27:21.202 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.055023356, 2023-08-10T11:27:21.202 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-08-10T11:27:21.203 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5624568, 2023-08-10T11:27:21.203 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 89.257471071, 2023-08-10T11:27:21.203 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000015869 2023-08-10T11:27:21.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.203 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-08-10T11:27:21.203 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 11241221, 2023-08-10T11:27:21.203 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.308149502, 2023-08-10T11:27:21.204 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000116 2023-08-10T11:27:21.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.204 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 4352, 2023-08-10T11:27:21.204 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 967856 2023-08-10T11:27:21.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.204 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-08-10T11:27:21.204 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-08-10T11:27:21.204 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-08-10T11:27:21.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.205 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-08-10T11:27:21.205 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-08-10T11:27:21.205 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-08-10T11:27:21.205 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 7969, 2023-08-10T11:27:21.205 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.818081352, 2023-08-10T11:27:21.205 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000353630 2023-08-10T11:27:21.205 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:21.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.206 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-08-10T11:27:21.206 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-08-10T11:27:21.206 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-08-10T11:27:21.206 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 220, 2023-08-10T11:27:21.206 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.010272368, 2023-08-10T11:27:21.206 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000046692 2023-08-10T11:27:21.206 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:21.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.207 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-08-10T11:27:21.207 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 8536, 2023-08-10T11:27:21.207 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 7208, 2023-08-10T11:27:21.207 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-08-10T11:27:21.207 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 7208, 2023-08-10T11:27:21.207 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 346.541247629, 2023-08-10T11:27:21.208 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.048077309 2023-08-10T11:27:21.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.208 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-08-10T11:27:21.208 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 1328, 2023-08-10T11:27:21.208 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 3, 2023-08-10T11:27:21.208 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-08-10T11:27:21.208 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 19, 2023-08-10T11:27:21.208 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 1, 2023-08-10T11:27:21.209 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2023-08-10T11:27:21.209 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 534, 2023-08-10T11:27:21.209 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 53, 2023-08-10T11:27:21.209 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 254, 2023-08-10T11:27:21.209 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 227, 2023-08-10T11:27:21.209 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 456, 2023-08-10T11:27:21.209 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 2075, 2023-08-10T11:27:21.209 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 53, 2023-08-10T11:27:21.210 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 53, 2023-08-10T11:27:21.210 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 24, 2023-08-10T11:27:21.210 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 45635, 2023-08-10T11:27:21.210 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 37397, 2023-08-10T11:27:21.210 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 1247, 2023-08-10T11:27:21.210 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 382, 2023-08-10T11:27:21.210 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 1, 2023-08-10T11:27:21.210 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-08-10T11:27:21.211 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 4462, 2023-08-10T11:27:21.211 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 11, 2023-08-10T11:27:21.211 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2023-08-10T11:27:21.211 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 17, 2023-08-10T11:27:21.211 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 1381, 2023-08-10T11:27:21.211 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 21, 2023-08-10T11:27:21.211 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 1301, 2023-08-10T11:27:21.211 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-08-10T11:27:21.212 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 649, 2023-08-10T11:27:21.212 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-08-10T11:27:21.212 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 1047, 2023-08-10T11:27:21.212 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 8979585222, 2023-08-10T11:27:21.212 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 7, 2023-08-10T11:27:21.212 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 649, 2023-08-10T11:27:21.212 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-08-10T11:27:21.212 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-08-10T11:27:21.213 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-08-10T11:27:21.213 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 1, 2023-08-10T11:27:21.213 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-08-10T11:27:21.213 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 1, 2023-08-10T11:27:21.213 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 648, 2023-08-10T11:27:21.213 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 659, 2023-08-10T11:27:21.213 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 9627, 2023-08-10T11:27:21.214 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 7373, 2023-08-10T11:27:21.214 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-08-10T11:27:21.214 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-10T11:27:21.214 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-10T11:27:21.214 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 11793, 2023-08-10T11:27:21.214 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 2439, 2023-08-10T11:27:21.214 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 472, 2023-08-10T11:27:21.214 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 375 2023-08-10T11:27:21.215 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.215 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-08-10T11:27:21.215 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 41, 2023-08-10T11:27:21.215 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 407, 2023-08-10T11:27:21.215 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 229, 2023-08-10T11:27:21.215 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 743, 2023-08-10T11:27:21.215 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 324, 2023-08-10T11:27:21.215 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2023-08-10T11:27:21.216 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-08-10T11:27:21.216 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-08-10T11:27:21.216 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 127, 2023-08-10T11:27:21.217 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 2, 2023-08-10T11:27:21.217 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 790, 2023-08-10T11:27:21.217 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 94, 2023-08-10T11:27:21.217 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-08-10T11:27:21.217 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-08-10T11:27:21.217 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-08-10T11:27:21.217 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-08-10T11:27:21.218 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-08-10T11:27:21.218 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-08-10T11:27:21.218 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 18, 2023-08-10T11:27:21.218 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-08-10T11:27:21.218 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 1, 2023-08-10T11:27:21.218 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-08-10T11:27:21.218 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-08-10T11:27:21.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.219 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-08-10T11:27:21.219 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 8582, 2023-08-10T11:27:21.219 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-08-10T11:27:21.219 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-08-10T11:27:21.219 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 8582, 2023-08-10T11:27:21.219 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-08-10T11:27:21.219 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-08-10T11:27:21.219 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 11, 2023-08-10T11:27:21.220 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-08-10T11:27:21.220 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-08-10T11:27:21.220 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 11, 2023-08-10T11:27:21.220 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-08-10T11:27:21.220 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-08-10T11:27:21.220 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-08-10T11:27:21.220 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 37132075, 2023-08-10T11:27:21.220 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2023-08-10T11:27:21.221 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-08-10T11:27:21.221 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3669, 2023-08-10T11:27:21.221 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 28.619407661, 2023-08-10T11:27:21.221 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.007800329 2023-08-10T11:27:21.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.221 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2023-08-10T11:27:21.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.221 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-08-10T11:27:21.222 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 109, 2023-08-10T11:27:21.222 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 1253, 2023-08-10T11:27:21.222 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 1144, 2023-08-10T11:27:21.222 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 110, 2023-08-10T11:27:21.222 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 336, 2023-08-10T11:27:21.222 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 226, 2023-08-10T11:27:21.222 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 534, 2023-08-10T11:27:21.223 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 2621, 2023-08-10T11:27:21.223 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 2087, 2023-08-10T11:27:21.223 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 53, 2023-08-10T11:27:21.223 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 1165, 2023-08-10T11:27:21.223 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 1112, 2023-08-10T11:27:21.223 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 65620, 2023-08-10T11:27:21.223 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 198960 2023-08-10T11:27:21.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.224 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-08-10T11:27:21.224 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 30503, 2023-08-10T11:27:21.224 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 6466, 2023-08-10T11:27:21.224 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 8536, 2023-08-10T11:27:21.224 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 163, 2023-08-10T11:27:21.224 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 12057, 2023-08-10T11:27:21.224 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-08-10T11:27:21.224 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 14, 2023-08-10T11:27:21.225 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.033865627, 2023-08-10T11:27:21.225 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002418973 2023-08-10T11:27:21.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.225 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-08-10T11:27:21.225 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 248, 2023-08-10T11:27:21.225 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.849661280, 2023-08-10T11:27:21.225 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003426053 2023-08-10T11:27:21.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.226 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-08-10T11:27:21.226 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.226 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.226 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.226 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-08-10T11:27:21.226 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 133, 2023-08-10T11:27:21.226 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.906630598, 2023-08-10T11:27:21.227 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.021854365 2023-08-10T11:27:21.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.227 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-08-10T11:27:21.227 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4169, 2023-08-10T11:27:21.227 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 142.482835228, 2023-08-10T11:27:21.227 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.034176741 2023-08-10T11:27:21.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.228 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-08-10T11:27:21.228 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.228 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.228 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.228 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-08-10T11:27:21.228 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.228 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.229 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.229 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-08-10T11:27:21.229 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.229 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.229 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.229 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-08-10T11:27:21.230 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.230 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.230 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.230 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-08-10T11:27:21.230 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.230 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.230 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.231 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.231 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-08-10T11:27:21.231 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.231 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.231 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.231 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.231 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-08-10T11:27:21.231 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1, 2023-08-10T11:27:21.232 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.002061168, 2023-08-10T11:27:21.232 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002061168 2023-08-10T11:27:21.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.232 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-08-10T11:27:21.232 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.232 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.232 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.235 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-08-10T11:27:21.236 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.236 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.236 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.236 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.236 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-08-10T11:27:21.236 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1576, 2023-08-10T11:27:21.236 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.912022576, 2023-08-10T11:27:21.237 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000578694 2023-08-10T11:27:21.237 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.237 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-08-10T11:27:21.237 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 48, 2023-08-10T11:27:21.237 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.029211189, 2023-08-10T11:27:21.237 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000608566 2023-08-10T11:27:21.237 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.237 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-08-10T11:27:21.238 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 892, 2023-08-10T11:27:21.238 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 198.366119578, 2023-08-10T11:27:21.238 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.222383542 2023-08-10T11:27:21.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.238 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-08-10T11:27:21.238 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.238 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.238 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.239 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-08-10T11:27:21.239 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.239 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.239 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.239 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-08-10T11:27:21.239 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.240 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.240 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.240 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.240 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-08-10T11:27:21.240 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.240 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.240 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.241 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-08-10T11:27:21.241 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.241 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.241 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.241 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-08-10T11:27:21.241 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.242 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.242 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.242 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-08-10T11:27:21.242 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.242 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.242 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.243 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-08-10T11:27:21.243 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.243 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.243 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.243 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-08-10T11:27:21.243 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.243 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.244 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.244 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-08-10T11:27:21.244 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.244 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.244 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.244 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-08-10T11:27:21.245 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.245 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.245 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.245 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-08-10T11:27:21.245 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 127, 2023-08-10T11:27:21.245 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.958840385, 2023-08-10T11:27:21.245 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.007549924 2023-08-10T11:27:21.246 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.246 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-08-10T11:27:21.246 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-08-10T11:27:21.246 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-08-10T11:27:21.246 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.246 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.246 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.246 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:21.247 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.247 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-08-10T11:27:21.247 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 2, 2023-08-10T11:27:21.247 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 3, 2023-08-10T11:27:21.247 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 1, 2023-08-10T11:27:21.247 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 2, 2023-08-10T11:27:21.247 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-08-10T11:27:21.247 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 358, 2023-08-10T11:27:21.248 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 179, 2023-08-10T11:27:21.248 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 2151 2023-08-10T11:27:21.248 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.248 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-08-10T11:27:21.248 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-08-10T11:27:21.248 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-08-10T11:27:21.248 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-08-10T11:27:21.249 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-08-10T11:27:21.249 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-08-10T11:27:21.249 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-08-10T11:27:21.249 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-10T11:27:21.249 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-08-10T11:27:21.249 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-10T11:27:21.249 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-08-10T11:27:21.249 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-08-10T11:27:21.250 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-08-10T11:27:21.250 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-08-10T11:27:21.250 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-08-10T11:27:21.250 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-08-10T11:27:21.250 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-08-10T11:27:21.250 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-08-10T11:27:21.250 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-08-10T11:27:21.250 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-08-10T11:27:21.251 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-08-10T11:27:21.251 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-10T11:27:21.251 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-08-10T11:27:21.251 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-08-10T11:27:21.251 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-08-10T11:27:21.251 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-08-10T11:27:21.251 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-08-10T11:27:21.251 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-10T11:27:21.252 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-08-10T11:27:21.252 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-08-10T11:27:21.252 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-08-10T11:27:21.252 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-08-10T11:27:21.252 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-08-10T11:27:21.252 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-08-10T11:27:21.252 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-08-10T11:27:21.252 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-08-10T11:27:21.253 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-08-10T11:27:21.253 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 790841, 2023-08-10T11:27:21.253 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 235, 2023-08-10T11:27:21.253 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-08-10T11:27:21.253 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-08-10T11:27:21.253 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-08-10T11:27:21.253 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-08-10T11:27:21.253 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-08-10T11:27:21.254 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-08-10T11:27:21.254 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-08-10T11:27:21.254 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-08-10T11:27:21.254 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 9568, 2023-08-10T11:27:21.254 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 185, 2023-08-10T11:27:21.254 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-08-10T11:27:21.254 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-08-10T11:27:21.254 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-08-10T11:27:21.255 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-08-10T11:27:21.255 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 1602985, 2023-08-10T11:27:21.255 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 90498, 2023-08-10T11:27:21.255 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-08-10T11:27:21.255 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-08-10T11:27:21.255 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-08-10T11:27:21.255 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-08-10T11:27:21.256 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.256 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-08-10T11:27:21.256 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-08-10T11:27:21.256 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-08-10T11:27:21.256 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 5072, 2023-08-10T11:27:21.256 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 33083607, 2023-08-10T11:27:21.256 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 27, 2023-08-10T11:27:21.256 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 5072, 2023-08-10T11:27:21.257 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-08-10T11:27:21.257 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5072, 2023-08-10T11:27:21.257 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 40.137269988, 2023-08-10T11:27:21.257 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.007913499 2023-08-10T11:27:21.257 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.257 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-08-10T11:27:21.257 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-08-10T11:27:21.257 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5072, 2023-08-10T11:27:21.258 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 5590 2023-08-10T11:27:21.258 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.258 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 5072, 2023-08-10T11:27:21.258 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 654, 2023-08-10T11:27:21.258 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 4418, 2023-08-10T11:27:21.258 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-08-10T11:27:21.258 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-08-10T11:27:21.258 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2023-08-10T11:27:21.259 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2023-08-10T11:27:21.259 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 2, 2023-08-10T11:27:21.259 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 3671, 2023-08-10T11:27:21.259 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 139, 2023-08-10T11:27:21.259 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-08-10T11:27:21.259 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-08-10T11:27:21.259 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2023-08-10T11:27:21.259 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2023-08-10T11:27:21.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 262, 2023-08-10T11:27:21.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-08-10T11:27:21.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-08-10T11:27:21.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-08-10T11:27:21.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 649, 2023-08-10T11:27:21.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2023-08-10T11:27:21.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-08-10T11:27:21.260 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-08-10T11:27:21.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-08-10T11:27:21.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-08-10T11:27:21.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-08-10T11:27:21.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-08-10T11:27:21.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-08-10T11:27:21.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-08-10T11:27:21.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-08-10T11:27:21.261 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-08-10T11:27:21.262 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-08-10T11:27:21.262 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-08-10T11:27:21.262 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-08-10T11:27:21.262 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-08-10T11:27:21.262 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-08-10T11:27:21.262 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-08-10T11:27:21.262 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-08-10T11:27:21.263 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-08-10T11:27:21.263 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-08-10T11:27:21.263 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-08-10T11:27:21.263 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-08-10T11:27:21.263 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-08-10T11:27:21.263 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-08-10T11:27:21.263 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-08-10T11:27:21.263 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-08-10T11:27:21.264 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-08-10T11:27:21.264 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 160, 2023-08-10T11:27:21.264 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-08-10T11:27:21.264 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 69, 2023-08-10T11:27:21.264 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2023-08-10T11:27:21.264 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 13, 2023-08-10T11:27:21.264 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 1, 2023-08-10T11:27:21.264 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-08-10T11:27:21.265 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 603, 2023-08-10T11:27:21.265 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 6, 2023-08-10T11:27:21.265 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 228 2023-08-10T11:27:21.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.265 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-08-10T11:27:21.265 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2023-08-10T11:27:21.265 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-08-10T11:27:21.265 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-08-10T11:27:21.266 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-08-10T11:27:21.266 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.266 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-08-10T11:27:21.266 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 1 2023-08-10T11:27:21.266 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.266 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-08-10T11:27:21.266 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-08-10T11:27:21.266 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 240, 2023-08-10T11:27:21.267 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-08-10T11:27:21.267 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 1, 2023-08-10T11:27:21.267 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 2, 2023-08-10T11:27:21.267 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-08-10T11:27:21.267 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.267 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-10T11:27:21.267 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:21.267 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-08-10T11:27:21.268 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:21.268 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 5732882, 2023-08-10T11:27:21.268 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 419058868, 2023-08-10T11:27:21.268 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:21.268 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 5732882, 2023-08-10T11:27:21.268 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:21.268 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:21.268 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 5732882, 2023-08-10T11:27:21.269 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 419058868, 2023-08-10T11:27:21.269 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:21.269 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.269 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.269 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.269 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:21.269 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.269 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-08-10T11:27:21.270 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:21.270 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-08-10T11:27:21.270 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:21.270 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:21.270 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:21.270 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:21.270 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:21.271 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 5072, 2023-08-10T11:27:21.271 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 33083849, 2023-08-10T11:27:21.271 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 5072, 2023-08-10T11:27:21.271 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 33083849, 2023-08-10T11:27:21.271 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:21.271 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.271 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.271 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.272 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:21.272 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.272 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-08-10T11:27:21.272 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:21.272 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-08-10T11:27:21.272 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:21.272 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-08-10T11:27:21.272 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-08-10T11:27:21.273 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:21.273 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-08-10T11:27:21.273 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 5072, 2023-08-10T11:27:21.273 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 5072, 2023-08-10T11:27:21.273 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 5072, 2023-08-10T11:27:21.273 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 5072, 2023-08-10T11:27:21.273 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:21.274 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.274 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.274 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.274 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:21.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.274 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-08-10T11:27:21.274 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:21.274 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-08-10T11:27:21.275 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:21.275 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 2, 2023-08-10T11:27:21.275 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 290, 2023-08-10T11:27:21.275 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:21.275 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 2, 2023-08-10T11:27:21.275 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:21.275 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:21.275 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2, 2023-08-10T11:27:21.276 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 290, 2023-08-10T11:27:21.276 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:21.276 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.276 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.276 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.276 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:21.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-08-10T11:27:21.276 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x556cc9ac80a0": { 2023-08-10T11:27:21.277 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-08-10T11:27:21.277 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-08-10T11:27:21.277 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-08-10T11:27:21.277 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 8582, 2023-08-10T11:27:21.277 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 32937771, 2023-08-10T11:27:21.277 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-08-10T11:27:21.277 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 8582, 2023-08-10T11:27:21.277 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-08-10T11:27:21.278 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-08-10T11:27:21.278 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 3669, 2023-08-10T11:27:21.278 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 32937771, 2023-08-10T11:27:21.278 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-08-10T11:27:21.278 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-08-10T11:27:21.278 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-08-10T11:27:21.278 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-08-10T11:27:21.278 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:21.279 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-08-10T11:27:21.279 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-08-10T11:27:21.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:20 smithi157 ceph-mon[129604]: pgmap v1151: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 KiB/s wr, 12 op/s 2023-08-10T11:27:21.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:20 smithi157 ceph-mon[129604]: osdmap e160: 12 total, 12 up, 12 in 2023-08-10T11:27:21.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:20 smithi107 ceph-mon[127953]: pgmap v1151: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 KiB/s wr, 12 op/s 2023-08-10T11:27:21.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:20 smithi107 ceph-mon[127953]: osdmap e160: 12 total, 12 up, 12 in 2023-08-10T11:27:21.735 INFO:tasks.check_counter:Daemon mds.l mds.exported=17 2023-08-10T11:27:21.735 INFO:tasks.check_counter:Daemon mds.l mds.imported=21 2023-08-10T11:27:21.735 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=41 2023-08-10T11:27:21.735 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=407 2023-08-10T11:27:21.736 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=7 2023-08-10T11:27:21.736 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-08-10T11:27:21.736 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-08-10T11:27:21.737 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-08-10T11:27:21.748 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-08-10T11:27:21.749 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T11:27:21.749 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T11:27:22.381 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T11:27:22.382 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T11:27:22.431 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:27:22.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.679+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/1703268558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f381066f0 msgr2=0x7f0f38106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:22.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.679+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/1703268558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f381066f0 0x7f0f38106ad0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009990 tx=0x7f0f28009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.680 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.679+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/1703268558 shutdown_connections 2023-08-10T11:27:22.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.679+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/1703268558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f381010a0 0x7f0f3810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.679+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/1703268558 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f381066f0 0x7f0f38106ad0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.679+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/1703268558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f381006e0 0x7f0f38100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.679+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/1703268558 >> 172.21.15.107:0/1703268558 conn(0x7f0f380fc190 msgr2=0x7f0f380fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:22.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.679+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/1703268558 shutdown_connections 2023-08-10T11:27:22.681 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.679+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/1703268558 wait complete. 2023-08-10T11:27:22.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.680+0000 7f0f3d1ff700 1 Processor -- start 2023-08-10T11:27:22.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.680+0000 7f0f3d1ff700 1 -- start start 2023-08-10T11:27:22.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.680+0000 7f0f3d1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f381006e0 0x7f0f38072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:22.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.680+0000 7f0f3d1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f381010a0 0x7f0f38072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:22.683 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.680+0000 7f0f3d1ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f381066f0 0x7f0f381a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:22.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.680+0000 7f0f3d1ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380737e0 con 0x7f0f381066f0 2023-08-10T11:27:22.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.680+0000 7f0f3d1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f381a4df0 con 0x7f0f381006e0 2023-08-10T11:27:22.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.680+0000 7f0f3d1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f381a4f30 con 0x7f0f381010a0 2023-08-10T11:27:22.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f36d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f381006e0 0x7f0f38072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:22.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f36d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f381006e0 0x7f0f38072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.107:50570/0 (socket says 172.21.15.107:50570) 2023-08-10T11:27:22.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f36d9d700 1 -- 172.21.15.107:0/324559189 learned_addr learned my addr 172.21.15.107:0/324559189 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:22.684 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f3759e700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f381066f0 0x7f0f381a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:22.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f3659c700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f381010a0 0x7f0f38072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:22.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f36d9d700 1 -- 172.21.15.107:0/324559189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f381010a0 msgr2=0x7f0f38072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:22.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f36d9d700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f381010a0 0x7f0f38072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f36d9d700 1 -- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f381066f0 msgr2=0x7f0f381a48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:22.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f36d9d700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f381066f0 0x7f0f381a48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f36d9d700 1 -- 172.21.15.107:0/324559189 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280095f0 con 0x7f0f381006e0 2023-08-10T11:27:22.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f3759e700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f381066f0 0x7f0f381a48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T11:27:22.685 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.681+0000 7f0f36d9d700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f381006e0 0x7f0f38072a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f28005740 tx=0x7f0f28005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:22.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.682+0000 7f0f1ffff700 1 -- 172.21.15.107:0/324559189 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2801d070 con 0x7f0f381006e0 2023-08-10T11:27:22.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.682+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f381a5130 con 0x7f0f381006e0 2023-08-10T11:27:22.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.682+0000 7f0f1ffff700 1 -- 172.21.15.107:0/324559189 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f28022470 con 0x7f0f381006e0 2023-08-10T11:27:22.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.682+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f381a5660 con 0x7f0f381006e0 2023-08-10T11:27:22.686 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.682+0000 7f0f1ffff700 1 -- 172.21.15.107:0/324559189 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28017650 con 0x7f0f381006e0 2023-08-10T11:27:22.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.683+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f38067560 con 0x7f0f381006e0 2023-08-10T11:27:22.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.685+0000 7f0f1ffff700 1 -- 172.21.15.107:0/324559189 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0f28022830 con 0x7f0f381006e0 2023-08-10T11:27:22.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.686+0000 7f0f1ffff700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0f200a1300 0x7f0f200a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:22.687 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.686+0000 7f0f1ffff700 1 -- 172.21.15.107:0/324559189 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f0f280ce430 con 0x7f0f381006e0 2023-08-10T11:27:22.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.686+0000 7f0f3659c700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0f200a1300 0x7f0f200a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:22.688 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.687+0000 7f0f3659c700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0f200a1300 0x7f0f200a37c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0f38074260 tx=0x7f0f2c009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:22.690 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.689+0000 7f0f1ffff700 1 -- 172.21.15.107:0/324559189 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0f28097520 con 0x7f0f381006e0 2023-08-10T11:27:22.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.896+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f381a5850 con 0x7f0f381006e0 2023-08-10T11:27:22.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.898+0000 7f0f1ffff700 1 -- 172.21.15.107:0/324559189 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+25132 (secure 0 0 0) 0x7f0f28027090 con 0x7f0f381006e0 2023-08-10T11:27:22.899 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:27:22.900 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":160,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T11:27:19.986423+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":66,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":66,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3715609072":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6801/438388714":"2023-08-11T10:51:12.376658+0000","172.21.15.107:0/1857104840":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/438388714":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/3894575131":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4083524194":"2023-08-11T10:51:12.376658+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":53,"length":1},{"begin":66,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":53,"length":1},{"begin":66,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:27:22.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0f200a1300 msgr2=0x7f0f200a37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:22.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0f200a1300 0x7f0f200a37c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0f38074260 tx=0x7f0f2c009260 comp rx=0 tx=0).stop 2023-08-10T11:27:22.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f381006e0 msgr2=0x7f0f38072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:22.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f381006e0 0x7f0f38072a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f28005740 tx=0x7f0f28005770 comp rx=0 tx=0).stop 2023-08-10T11:27:22.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 shutdown_connections 2023-08-10T11:27:22.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f0f200a1300 0x7f0f200a37c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f381006e0 0x7f0f38072a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0f381066f0 0x7f0f381a48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 --2- 172.21.15.107:0/324559189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f381010a0 0x7f0f38072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:22.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 >> 172.21.15.107:0/324559189 conn(0x7f0f380fc190 msgr2=0x7f0f380fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:22.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.900+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 shutdown_connections 2023-08-10T11:27:22.903 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:22.901+0000 7f0f3d1ff700 1 -- 172.21.15.107:0/324559189 wait complete. 2023-08-10T11:27:22.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 66, 'snap_epoch': 159, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 66, 'snap_epoch': 159, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T11:27:22.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:27:23.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.130+0000 7fbf893ff700 1 -- 172.21.15.107:0/3804962173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf840734c0 msgr2=0x7fbf8410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.130+0000 7fbf893ff700 1 --2- 172.21.15.107:0/3804962173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf840734c0 0x7fbf8410c9c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009990 tx=0x7fbf78009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.133 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.130+0000 7fbf893ff700 1 -- 172.21.15.107:0/3804962173 shutdown_connections 2023-08-10T11:27:23.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.130+0000 7fbf893ff700 1 --2- 172.21.15.107:0/3804962173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf8410cf00 0x7fbf8410f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.130+0000 7fbf893ff700 1 --2- 172.21.15.107:0/3804962173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf84072ba0 0x7fbf84072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.130+0000 7fbf893ff700 1 --2- 172.21.15.107:0/3804962173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf840734c0 0x7fbf8410c9c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.134 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.130+0000 7fbf893ff700 1 -- 172.21.15.107:0/3804962173 >> 172.21.15.107:0/3804962173 conn(0x7fbf840fc1f0 msgr2=0x7fbf840fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:23.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.130+0000 7fbf893ff700 1 -- 172.21.15.107:0/3804962173 shutdown_connections 2023-08-10T11:27:23.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.131+0000 7fbf893ff700 1 -- 172.21.15.107:0/3804962173 wait complete. 2023-08-10T11:27:23.135 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.131+0000 7fbf893ff700 1 Processor -- start 2023-08-10T11:27:23.136 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf893ff700 1 -- start start 2023-08-10T11:27:23.137 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf893ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf84072ba0 0x7fbf8419e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:23.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf893ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf840734c0 0x7fbf8419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:23.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf893ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf8410cf00 0x7fbf84198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:23.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf893ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84198ee0 con 0x7fbf8410cf00 2023-08-10T11:27:23.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf893ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84199050 con 0x7fbf840734c0 2023-08-10T11:27:23.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf893ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84199210 con 0x7fbf84072ba0 2023-08-10T11:27:23.138 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf837fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf8410cf00 0x7fbf84198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf837fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf8410cf00 0x7fbf84198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44892/0 (socket says 172.21.15.107:44892) 2023-08-10T11:27:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf837fe700 1 -- 172.21.15.107:0/195644895 learned_addr learned my addr 172.21.15.107:0/195644895 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf827fc700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf840734c0 0x7fbf8419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.132+0000 7fbf82ffd700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf84072ba0 0x7fbf8419e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf837fe700 1 -- 172.21.15.107:0/195644895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf84072ba0 msgr2=0x7fbf8419e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf837fe700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf84072ba0 0x7fbf8419e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.139 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf837fe700 1 -- 172.21.15.107:0/195644895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf840734c0 msgr2=0x7fbf8419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf837fe700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf840734c0 0x7fbf8419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf837fe700 1 -- 172.21.15.107:0/195644895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780095f0 con 0x7fbf8410cf00 2023-08-10T11:27:23.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf82ffd700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf84072ba0 0x7fbf8419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:27:23.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf837fe700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf8410cf00 0x7fbf84198870 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c007ee0 tx=0x7fbf7c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:23.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf6bfff700 1 -- 172.21.15.107:0/195644895 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00ddd0 con 0x7fbf8410cf00 2023-08-10T11:27:23.140 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf6bfff700 1 -- 172.21.15.107:0/195644895 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf7c00f040 con 0x7fbf8410cf00 2023-08-10T11:27:23.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf6bfff700 1 -- 172.21.15.107:0/195644895 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0047d0 con 0x7fbf8410cf00 2023-08-10T11:27:23.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf841994f0 con 0x7fbf8410cf00 2023-08-10T11:27:23.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.133+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf841a57f0 con 0x7fbf8410cf00 2023-08-10T11:27:23.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.134+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf840674f0 con 0x7fbf8410cf00 2023-08-10T11:27:23.141 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.136+0000 7fbf6bfff700 1 -- 172.21.15.107:0/195644895 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fbf7c003f20 con 0x7fbf8410cf00 2023-08-10T11:27:23.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.138+0000 7fbf6bfff700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbf6c0a1410 0x7fbf6c0a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:23.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.138+0000 7fbf6bfff700 1 -- 172.21.15.107:0/195644895 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fbf7c0cd0b0 con 0x7fbf8410cf00 2023-08-10T11:27:23.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.138+0000 7fbf82ffd700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbf6c0a1410 0x7fbf6c0a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:23.142 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.139+0000 7fbf82ffd700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbf6c0a1410 0x7fbf6c0a38d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400bc10 tx=0x7fbf7400b5f0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:23.143 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.140+0000 7fbf6bfff700 1 -- 172.21.15.107:0/195644895 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fbf7c096190 con 0x7fbf8410cf00 2023-08-10T11:27:23.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:22 smithi157 ceph-mon[129604]: pgmap v1153: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 10 op/s 2023-08-10T11:27:23.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:22 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/324559189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:27:23.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:22 smithi107 ceph-mon[127953]: pgmap v1153: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 10 op/s 2023-08-10T11:27:23.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:22 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/324559189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:27:23.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.346+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf841a5a20 con 0x7fbf8410cf00 2023-08-10T11:27:23.348 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.346+0000 7fbf6bfff700 1 -- 172.21.15.107:0/195644895 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf7c023070 con 0x7fbf8410cf00 2023-08-10T11:27:23.349 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T11:27:23.350 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbf6c0a1410 msgr2=0x7fbf6c0a38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbf6c0a1410 0x7fbf6c0a38d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400bc10 tx=0x7fbf7400b5f0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf8410cf00 msgr2=0x7fbf84198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf8410cf00 0x7fbf84198870 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c007ee0 tx=0x7fbf7c00d3b0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 shutdown_connections 2023-08-10T11:27:23.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbf8410cf00 0x7fbf84198870 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.351 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf84072ba0 0x7fbf8419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fbf6c0a1410 0x7fbf6c0a38d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 --2- 172.21.15.107:0/195644895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf840734c0 0x7fbf8419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 >> 172.21.15.107:0/195644895 conn(0x7fbf840fc1f0 msgr2=0x7fbf8410f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:23.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 shutdown_connections 2023-08-10T11:27:23.352 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.349+0000 7fbf893ff700 1 -- 172.21.15.107:0/195644895 wait complete. 2023-08-10T11:27:23.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:27:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:22 smithi195 ceph-mon[129938]: pgmap v1153: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 10 op/s 2023-08-10T11:27:23.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:22 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/324559189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:27:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.569+0000 7f24bb9ff700 1 -- 172.21.15.107:0/3318590900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41006c0 msgr2=0x7f24b4100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.574 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.569+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/3318590900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41006c0 0x7f24b4100b40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009990 tx=0x7f24a4009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.569+0000 7f24bb9ff700 1 -- 172.21.15.107:0/3318590900 shutdown_connections 2023-08-10T11:27:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.569+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/3318590900 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24b41066d0 0x7f24b4106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.575 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.569+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/3318590900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24b4101080 0x7f24b410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.569+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/3318590900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41006c0 0x7f24b4100b40 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.569+0000 7f24bb9ff700 1 -- 172.21.15.107:0/3318590900 >> 172.21.15.107:0/3318590900 conn(0x7f24b40fc1f0 msgr2=0x7f24b40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.569+0000 7f24bb9ff700 1 -- 172.21.15.107:0/3318590900 shutdown_connections 2023-08-10T11:27:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.569+0000 7f24bb9ff700 1 -- 172.21.15.107:0/3318590900 wait complete. 2023-08-10T11:27:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.570+0000 7f24bb9ff700 1 Processor -- start 2023-08-10T11:27:23.576 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.570+0000 7f24bb9ff700 1 -- start start 2023-08-10T11:27:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.570+0000 7f24bb9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24b41006c0 0x7f24b419c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24bb9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24b4101080 0x7f24b419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24bb9ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41066d0 0x7f24b4196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24bb9ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4196be0 con 0x7f24b41066d0 2023-08-10T11:27:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24bb9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4196d50 con 0x7f24b41006c0 2023-08-10T11:27:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24bb9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4196f10 con 0x7f24b4101080 2023-08-10T11:27:23.577 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b9f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41066d0 0x7f24b4196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b9f9c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41066d0 0x7f24b4196570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44912/0 (socket says 172.21.15.107:44912) 2023-08-10T11:27:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b9f9c700 1 -- 172.21.15.107:0/345189592 learned_addr learned my addr 172.21.15.107:0/345189592 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b979b700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24b41006c0 0x7f24b419c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b8f9a700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24b4101080 0x7f24b419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b9f9c700 1 -- 172.21.15.107:0/345189592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24b4101080 msgr2=0x7f24b419ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b9f9c700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24b4101080 0x7f24b419ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.578 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b9f9c700 1 -- 172.21.15.107:0/345189592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24b41006c0 msgr2=0x7f24b419c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b9f9c700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24b41006c0 0x7f24b419c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b9f9c700 1 -- 172.21.15.107:0/345189592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40095f0 con 0x7f24b41066d0 2023-08-10T11:27:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b979b700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24b41006c0 0x7f24b419c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:27:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.571+0000 7f24b9f9c700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41066d0 0x7f24b4196570 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00ef30 tx=0x7f24ac00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:23.579 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.572+0000 7f24aa7fc700 1 -- 172.21.15.107:0/345189592 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac018070 con 0x7f24b41066d0 2023-08-10T11:27:23.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.572+0000 7f24aa7fc700 1 -- 172.21.15.107:0/345189592 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24ac00f040 con 0x7f24b41066d0 2023-08-10T11:27:23.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.572+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b4197190 con 0x7f24b41066d0 2023-08-10T11:27:23.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.572+0000 7f24aa7fc700 1 -- 172.21.15.107:0/345189592 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac003d00 con 0x7f24b41066d0 2023-08-10T11:27:23.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.572+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b41a34f0 con 0x7f24b41066d0 2023-08-10T11:27:23.580 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.573+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b40674f0 con 0x7f24b41066d0 2023-08-10T11:27:23.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.575+0000 7f24aa7fc700 1 -- 172.21.15.107:0/345189592 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f24ac00caa0 con 0x7f24b41066d0 2023-08-10T11:27:23.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.577+0000 7f24aa7fc700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f24a00a1340 0x7f24a00a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:23.581 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.577+0000 7f24aa7fc700 1 -- 172.21.15.107:0/345189592 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f24ac0ccd80 con 0x7f24b41066d0 2023-08-10T11:27:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.577+0000 7f24b979b700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f24a00a1340 0x7f24a00a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.578+0000 7f24b979b700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f24a00a1340 0x7f24a00a3800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009c90 tx=0x7f24b0009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:23.582 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.581+0000 7f24aa7fc700 1 -- 172.21.15.107:0/345189592 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f24ac095e70 con 0x7f24b41066d0 2023-08-10T11:27:23.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.783+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24b41a3730 con 0x7f24b41066d0 2023-08-10T11:27:23.784 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.783+0000 7f24aa7fc700 1 -- 172.21.15.107:0/345189592 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24ac099490 con 0x7f24b41066d0 2023-08-10T11:27:23.785 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T11:27:23.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f24a00a1340 msgr2=0x7f24a00a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f24a00a1340 0x7f24a00a3800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009c90 tx=0x7f24b0009260 comp rx=0 tx=0).stop 2023-08-10T11:27:23.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41066d0 msgr2=0x7f24b4196570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:23.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41066d0 0x7f24b4196570 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00ef30 tx=0x7f24ac00c450 comp rx=0 tx=0).stop 2023-08-10T11:27:23.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 shutdown_connections 2023-08-10T11:27:23.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f24a00a1340 0x7f24a00a3800 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.787 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f24b41006c0 0x7f24b419c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24b41066d0 0x7f24b4196570 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 --2- 172.21.15.107:0/345189592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24b4101080 0x7f24b419ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:23.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.785+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 >> 172.21.15.107:0/345189592 conn(0x7f24b40fc1f0 msgr2=0x7f24b40fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:23.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.786+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 shutdown_connections 2023-08-10T11:27:23.788 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:23.786+0000 7f24bb9ff700 1 -- 172.21.15.107:0/345189592 wait complete. 2023-08-10T11:27:23.805 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:27:24.008 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.007+0000 7f817f59e700 1 -- 172.21.15.107:0/347015507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180100f20 msgr2=0x7f818010d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.007+0000 7f817f59e700 1 --2- 172.21.15.107:0/347015507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180100f20 0x7f818010d3e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f817800b0d0 tx=0x7f817800b3e0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.007+0000 7f817f59e700 1 -- 172.21.15.107:0/347015507 shutdown_connections 2023-08-10T11:27:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.007+0000 7f817f59e700 1 --2- 172.21.15.107:0/347015507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8180106620 0x7f8180106a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.007+0000 7f817f59e700 1 --2- 172.21.15.107:0/347015507 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180100f20 0x7f818010d3e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.007+0000 7f817f59e700 1 --2- 172.21.15.107:0/347015507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8180100560 0x7f81801009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.007+0000 7f817f59e700 1 -- 172.21.15.107:0/347015507 >> 172.21.15.107:0/347015507 conn(0x7f81800fc010 msgr2=0x7f81800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:24.009 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.007+0000 7f817f59e700 1 -- 172.21.15.107:0/347015507 shutdown_connections 2023-08-10T11:27:24.010 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.007+0000 7f817f59e700 1 -- 172.21.15.107:0/347015507 wait complete. 2023-08-10T11:27:24.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.008+0000 7f817f59e700 1 Processor -- start 2023-08-10T11:27:24.011 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.008+0000 7f817f59e700 1 -- start start 2023-08-10T11:27:24.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8180100560 0x7f818019e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817f59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8180100f20 0x7f818019ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817f59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180106620 0x7f81801985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.012 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817f59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8180198c30 con 0x7f8180106620 2023-08-10T11:27:24.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817f59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8180198da0 con 0x7f8180100f20 2023-08-10T11:27:24.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817f59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8180198f60 con 0x7f8180100560 2023-08-10T11:27:24.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180106620 0x7f81801985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180106620 0x7f81801985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44932/0 (socket says 172.21.15.107:44932) 2023-08-10T11:27:24.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817ed9d700 1 -- 172.21.15.107:0/848112812 learned_addr learned my addr 172.21.15.107:0/848112812 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:24.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817e59c700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8180100560 0x7f818019e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.013 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.009+0000 7f817dd9b700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8180100f20 0x7f818019ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f817ed9d700 1 -- 172.21.15.107:0/848112812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8180100560 msgr2=0x7f818019e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f817ed9d700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8180100560 0x7f818019e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f817ed9d700 1 -- 172.21.15.107:0/848112812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8180100f20 msgr2=0x7f818019ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f817ed9d700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8180100f20 0x7f818019ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f817ed9d700 1 -- 172.21.15.107:0/848112812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8178009d00 con 0x7f8180106620 2023-08-10T11:27:24.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f817e59c700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8180100560 0x7f818019e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:27:24.014 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f817ed9d700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180106620 0x7f81801985c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8178009fd0 tx=0x7f817800cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:24.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f816f7fe700 1 -- 172.21.15.107:0/848112812 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817800e040 con 0x7f8180106620 2023-08-10T11:27:24.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f816f7fe700 1 -- 172.21.15.107:0/848112812 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81780094a0 con 0x7f8180106620 2023-08-10T11:27:24.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f816f7fe700 1 -- 172.21.15.107:0/848112812 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81780052a0 con 0x7f8180106620 2023-08-10T11:27:24.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81801991e0 con 0x7f8180106620 2023-08-10T11:27:24.015 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.010+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81801a5540 con 0x7f8180106620 2023-08-10T11:27:24.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.011+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8180199400 con 0x7f8180106620 2023-08-10T11:27:24.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.013+0000 7f816f7fe700 1 -- 172.21.15.107:0/848112812 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f817801b450 con 0x7f8180106620 2023-08-10T11:27:24.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.014+0000 7f816f7fe700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f81680a13e0 0x7f81680a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.016 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.015+0000 7f816f7fe700 1 -- 172.21.15.107:0/848112812 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 9374+0+0 (secure 0 0 0) 0x7f81780ce240 con 0x7f8180106620 2023-08-10T11:27:24.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.015+0000 7f817e59c700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f81680a13e0 0x7f81680a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.017 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.015+0000 7f817e59c700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f81680a13e0 0x7f81680a38a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8170009bc0 tx=0x7f8170009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:24.019 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.018+0000 7f816f7fe700 1 -- 172.21.15.107:0/848112812 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8178097330 con 0x7f8180106620 2023-08-10T11:27:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:24 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/195644895' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:27:24.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:24 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/345189592' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:27:24.235 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.234+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8180199ad0 con 0x7f8180106620 2023-08-10T11:27:24.236 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.235+0000 7f816f7fe700 1 -- 172.21.15.107:0/848112812 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7f817809a950 con 0x7f8180106620 2023-08-10T11:27:24.236 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T11:27:24.238 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f81680a13e0 msgr2=0x7f81680a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f81680a13e0 0x7f81680a38a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8170009bc0 tx=0x7f8170009260 comp rx=0 tx=0).stop 2023-08-10T11:27:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180106620 msgr2=0x7f81801985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180106620 0x7f81801985c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8178009fd0 tx=0x7f817800cd90 comp rx=0 tx=0).stop 2023-08-10T11:27:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 shutdown_connections 2023-08-10T11:27:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8180106620 0x7f81801985c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8180100560 0x7f818019e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f81680a13e0 0x7f81680a38a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 --2- 172.21.15.107:0/848112812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8180100f20 0x7f818019ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.237+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 >> 172.21.15.107:0/848112812 conn(0x7f81800fc010 msgr2=0x7f81800fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.238+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 shutdown_connections 2023-08-10T11:27:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.238+0000 7f817f59e700 1 -- 172.21.15.107:0/848112812 wait complete. 2023-08-10T11:27:24.258 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T11:27:24.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:24 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/195644895' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:27:24.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:24 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/345189592' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:27:24.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:24 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/195644895' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:27:24.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:24 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/345189592' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:27:24.460 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.459+0000 7fd0467ff700 1 -- 172.21.15.107:0/2873207588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 msgr2=0x7fd040100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.459+0000 7fd0467ff700 1 --2- 172.21.15.107:0/2873207588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 0x7fd040100b40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd034009990 tx=0x7fd034009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.459+0000 7fd0467ff700 1 -- 172.21.15.107:0/2873207588 shutdown_connections 2023-08-10T11:27:24.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.459+0000 7fd0467ff700 1 --2- 172.21.15.107:0/2873207588 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd040101080 0x7fd04010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.459+0000 7fd0467ff700 1 --2- 172.21.15.107:0/2873207588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401066d0 0x7fd040106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.459+0000 7fd0467ff700 1 --2- 172.21.15.107:0/2873207588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 0x7fd040100b40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.459+0000 7fd0467ff700 1 -- 172.21.15.107:0/2873207588 >> 172.21.15.107:0/2873207588 conn(0x7fd0400fc1f0 msgr2=0x7fd0400fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:24.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.459+0000 7fd0467ff700 1 -- 172.21.15.107:0/2873207588 shutdown_connections 2023-08-10T11:27:24.461 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.459+0000 7fd0467ff700 1 -- 172.21.15.107:0/2873207588 wait complete. 2023-08-10T11:27:24.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.460+0000 7fd0467ff700 1 Processor -- start 2023-08-10T11:27:24.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.460+0000 7fd0467ff700 1 -- start start 2023-08-10T11:27:24.463 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd0467ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 0x7fd040072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd0467ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd040101080 0x7fd040072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd0467ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401066d0 0x7fd0401a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd0467ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400737e0 con 0x7fd0401006c0 2023-08-10T11:27:24.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd0467ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0401a4e70 con 0x7fd040101080 2023-08-10T11:27:24.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd0467ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0401a4fb0 con 0x7fd0401066d0 2023-08-10T11:27:24.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 0x7fd040072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.464 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 0x7fd040072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44944/0 (socket says 172.21.15.107:44944) 2023-08-10T11:27:24.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03ffff700 1 -- 172.21.15.107:0/4144373840 learned_addr learned my addr 172.21.15.107:0/4144373840 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:24.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd044d9c700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401066d0 0x7fd0401a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03f7fe700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd040101080 0x7fd040072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03ffff700 1 -- 172.21.15.107:0/4144373840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401066d0 msgr2=0x7fd0401a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03ffff700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401066d0 0x7fd0401a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03ffff700 1 -- 172.21.15.107:0/4144373840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd040101080 msgr2=0x7fd040072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03ffff700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd040101080 0x7fd040072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.465 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03ffff700 1 -- 172.21.15.107:0/4144373840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0340095f0 con 0x7fd0401006c0 2023-08-10T11:27:24.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.461+0000 7fd03f7fe700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd040101080 0x7fd040072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:27:24.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.462+0000 7fd03ffff700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 0x7fd040072a70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd03000b530 tx=0x7fd03000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:24.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.462+0000 7fd03d7fa700 1 -- 172.21.15.107:0/4144373840 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030011830 con 0x7fd0401006c0 2023-08-10T11:27:24.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.462+0000 7fd03d7fa700 1 -- 172.21.15.107:0/4144373840 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd030011e20 con 0x7fd0401006c0 2023-08-10T11:27:24.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.462+0000 7fd03d7fa700 1 -- 172.21.15.107:0/4144373840 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030010dd0 con 0x7fd0401006c0 2023-08-10T11:27:24.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.462+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0401a5210 con 0x7fd0401006c0 2023-08-10T11:27:24.466 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.462+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0401a56a0 con 0x7fd0401006c0 2023-08-10T11:27:24.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.463+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0400674f0 con 0x7fd0401006c0 2023-08-10T11:27:24.467 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.467+0000 7fd03d7fa700 1 -- 172.21.15.107:0/4144373840 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fd030011990 con 0x7fd0401006c0 2023-08-10T11:27:24.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.468+0000 7fd03d7fa700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd0280a1340 0x7fd0280a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.468+0000 7fd03d7fa700 1 -- 172.21.15.107:0/4144373840 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fd0300cceb0 con 0x7fd0401006c0 2023-08-10T11:27:24.469 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.468+0000 7fd03f7fe700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd0280a1340 0x7fd0280a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.470 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.469+0000 7fd03f7fe700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd0280a1340 0x7fd0280a3800 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd0340095c0 tx=0x7fd034009550 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:24.471 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.470+0000 7fd03d7fa700 1 -- 172.21.15.107:0/4144373840 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd030096020 con 0x7fd0401006c0 2023-08-10T11:27:24.672 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.671+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd0401a5ab0 con 0x7fd0401006c0 2023-08-10T11:27:24.673 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.671+0000 7fd03d7fa700 1 -- 172.21.15.107:0/4144373840 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v160) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd0300150a0 con 0x7fd0401006c0 2023-08-10T11:27:24.673 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T11:27:24.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd0280a1340 msgr2=0x7fd0280a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd0280a1340 0x7fd0280a3800 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd0340095c0 tx=0x7fd034009550 comp rx=0 tx=0).stop 2023-08-10T11:27:24.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 msgr2=0x7fd040072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 0x7fd040072a70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd03000b530 tx=0x7fd03000b8f0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 shutdown_connections 2023-08-10T11:27:24.675 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0401066d0 0x7fd0401a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd0401006c0 0x7fd040072a70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd0280a1340 0x7fd0280a3800 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 --2- 172.21.15.107:0/4144373840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd040101080 0x7fd040072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 >> 172.21.15.107:0/4144373840 conn(0x7fd0400fc1f0 msgr2=0x7fd0400fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:24.676 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 shutdown_connections 2023-08-10T11:27:24.677 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.674+0000 7fd0467ff700 1 -- 172.21.15.107:0/4144373840 wait complete. 2023-08-10T11:27:24.694 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T11:27:24.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.890+0000 7fa0bdbff700 1 -- 172.21.15.107:0/1062781664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 msgr2=0x7fa0b8106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.892 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.890+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/1062781664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 0x7fa0b8106ab0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009990 tx=0x7fa0a8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.890+0000 7fa0bdbff700 1 -- 172.21.15.107:0/1062781664 shutdown_connections 2023-08-10T11:27:24.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.890+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/1062781664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b8101080 0x7fa0b810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.893 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.890+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/1062781664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 0x7fa0b8106ab0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.890+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/1062781664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b81006c0 0x7fa0b8100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.890+0000 7fa0bdbff700 1 -- 172.21.15.107:0/1062781664 >> 172.21.15.107:0/1062781664 conn(0x7fa0b80fc1f0 msgr2=0x7fa0b80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:24.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.890+0000 7fa0bdbff700 1 -- 172.21.15.107:0/1062781664 shutdown_connections 2023-08-10T11:27:24.894 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.890+0000 7fa0bdbff700 1 -- 172.21.15.107:0/1062781664 wait complete. 2023-08-10T11:27:24.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.891+0000 7fa0bdbff700 1 Processor -- start 2023-08-10T11:27:24.895 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.891+0000 7fa0bdbff700 1 -- start start 2023-08-10T11:27:24.897 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.891+0000 7fa0bdbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b81006c0 0x7fa0b819e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.891+0000 7fa0bdbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b8101080 0x7fa0b819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.891+0000 7fa0bdbff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 0x7fa0b8198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.891+0000 7fa0bdbff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b8198db0 con 0x7fa0b81066d0 2023-08-10T11:27:24.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.891+0000 7fa0bdbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b8198f20 con 0x7fa0b8101080 2023-08-10T11:27:24.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.891+0000 7fa0bdbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b81990e0 con 0x7fa0b81006c0 2023-08-10T11:27:24.898 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 0x7fa0b8198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 0x7fa0b8198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44968/0 (socket says 172.21.15.107:44968) 2023-08-10T11:27:24.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b7fff700 1 -- 172.21.15.107:0/170234040 learned_addr learned my addr 172.21.15.107:0/170234040 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:24.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b6ffd700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b8101080 0x7fa0b819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b77fe700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b81006c0 0x7fa0b819e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b7fff700 1 -- 172.21.15.107:0/170234040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b81006c0 msgr2=0x7fa0b819e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b7fff700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b81006c0 0x7fa0b819e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.899 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b7fff700 1 -- 172.21.15.107:0/170234040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b8101080 msgr2=0x7fa0b819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:24.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b7fff700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b8101080 0x7fa0b819ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:24.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b7fff700 1 -- 172.21.15.107:0/170234040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a80095f0 con 0x7fa0b81066d0 2023-08-10T11:27:24.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b7fff700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 0x7fa0b8198700 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0007ee0 tx=0x7fa0b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:24.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b4ff9700 1 -- 172.21.15.107:0/170234040 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0017070 con 0x7fa0b81066d0 2023-08-10T11:27:24.900 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b4ff9700 1 -- 172.21.15.107:0/170234040 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0b000f040 con 0x7fa0b81066d0 2023-08-10T11:27:24.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0b4ff9700 1 -- 172.21.15.107:0/170234040 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0005710 con 0x7fa0b81066d0 2023-08-10T11:27:24.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.892+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b81993c0 con 0x7fa0b81066d0 2023-08-10T11:27:24.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.893+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b81a56a0 con 0x7fa0b81066d0 2023-08-10T11:27:24.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.893+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b80674f0 con 0x7fa0b81066d0 2023-08-10T11:27:24.901 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.896+0000 7fa0b4ff9700 1 -- 172.21.15.107:0/170234040 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fa0b0005870 con 0x7fa0b81066d0 2023-08-10T11:27:24.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.897+0000 7fa0b4ff9700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa0a00a12c0 0x7fa0a00a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:24.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.897+0000 7fa0b4ff9700 1 -- 172.21.15.107:0/170234040 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 9374+0+0 (secure 0 0 0) 0x7fa0b00cce50 con 0x7fa0b81066d0 2023-08-10T11:27:24.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.897+0000 7fa0b77fe700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa0a00a12c0 0x7fa0a00a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:24.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.898+0000 7fa0b77fe700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa0a00a12c0 0x7fa0a00a3780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800b5c0 tx=0x7fa0a8005fb0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:24.902 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:24.898+0000 7fa0b4ff9700 1 -- 172.21.15.107:0/170234040 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa0b0095eb0 con 0x7fa0b81066d0 2023-08-10T11:27:25.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.122+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa0b8199c30 con 0x7fa0b81066d0 2023-08-10T11:27:25.124 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.123+0000 7fa0b4ff9700 1 -- 172.21.15.107:0/170234040 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v161) v1 ==== 81+0+957 (secure 0 0 0) 0x7fa0b00994d0 con 0x7fa0b81066d0 2023-08-10T11:27:25.125 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3715609072 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:25.125 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/438388714 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:25.125 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/1857104840 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:25.125 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/294010818 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:25.125 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/438388714 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:25.125 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/294010818 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:25.125 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2325198765 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:25.126 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/4249017598 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:25.126 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/155446065 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:25.126 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2780861048 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:25.126 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/4026286774 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:25.126 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3894575131 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:25.126 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/4026286774 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:25.126 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/4083524194 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:25.126 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2396317165 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:25.127 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2565207558 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:25.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa0a00a12c0 msgr2=0x7fa0a00a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.127 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa0a00a12c0 0x7fa0a00a3780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800b5c0 tx=0x7fa0a8005fb0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 msgr2=0x7fa0b8198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 0x7fa0b8198700 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0007ee0 tx=0x7fa0b000d3b0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 shutdown_connections 2023-08-10T11:27:25.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0b81066d0 0x7fa0b8198700 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b81006c0 0x7fa0b819e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.128 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fa0a00a12c0 0x7fa0a00a3780 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 --2- 172.21.15.107:0/170234040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0b8101080 0x7fa0b819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 >> 172.21.15.107:0/170234040 conn(0x7fa0b80fc1f0 msgr2=0x7fa0b810ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:25.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.125+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 shutdown_connections 2023-08-10T11:27:25.129 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.126+0000 7fa0bdbff700 1 -- 172.21.15.107:0/170234040 wait complete. 2023-08-10T11:27:25.129 INFO:teuthology.orchestra.run.smithi107.stderr:listed 16 entries 2023-08-10T11:27:25.147 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2023-08-10T11:27:25.148 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T11:27:25.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T11:27:25.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:25 smithi157 ceph-mon[129604]: pgmap v1154: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 10 op/s 2023-08-10T11:27:25.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:25 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/848112812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:27:25.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:25 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/4144373840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T11:27:25.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:25 smithi157 ceph-mon[129604]: osdmap e161: 12 total, 12 up, 12 in 2023-08-10T11:27:25.291 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:25 smithi107 ceph-mon[127953]: pgmap v1154: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 10 op/s 2023-08-10T11:27:25.291 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:25 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/848112812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:27:25.291 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:25 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/4144373840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T11:27:25.291 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:25 smithi107 ceph-mon[127953]: osdmap e161: 12 total, 12 up, 12 in 2023-08-10T11:27:25.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:25 smithi195 ceph-mon[129938]: pgmap v1154: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 10 op/s 2023-08-10T11:27:25.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:25 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/848112812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:27:25.414 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:25 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/4144373840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T11:27:25.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:25 smithi195 ceph-mon[129938]: osdmap e161: 12 total, 12 up, 12 in 2023-08-10T11:27:25.431 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.430+0000 7f85e5bff700 1 -- 172.21.15.107:0/671859054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01066f0 msgr2=0x7f85e0106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.430+0000 7f85e5bff700 1 --2- 172.21.15.107:0/671859054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01066f0 0x7f85e0106ad0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f85d0009990 tx=0x7f85d0009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.430+0000 7f85e5bff700 1 -- 172.21.15.107:0/671859054 shutdown_connections 2023-08-10T11:27:25.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.430+0000 7f85e5bff700 1 --2- 172.21.15.107:0/671859054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e01010a0 0x7f85e010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.430+0000 7f85e5bff700 1 --2- 172.21.15.107:0/671859054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01066f0 0x7f85e0106ad0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.432 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.430+0000 7f85e5bff700 1 --2- 172.21.15.107:0/671859054 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85e01006e0 0x7f85e0100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.430+0000 7f85e5bff700 1 -- 172.21.15.107:0/671859054 >> 172.21.15.107:0/671859054 conn(0x7f85e00fc190 msgr2=0x7f85e00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.430+0000 7f85e5bff700 1 -- 172.21.15.107:0/671859054 shutdown_connections 2023-08-10T11:27:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.430+0000 7f85e5bff700 1 -- 172.21.15.107:0/671859054 wait complete. 2023-08-10T11:27:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.431+0000 7f85e5bff700 1 Processor -- start 2023-08-10T11:27:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.432+0000 7f85e5bff700 1 -- start start 2023-08-10T11:27:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.432+0000 7f85e5bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e01006e0 0x7f85e0072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.432+0000 7f85e5bff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01010a0 0x7f85e0072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:25.435 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.432+0000 7f85e5bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85e01066f0 0x7f85e01a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.432+0000 7f85e5bff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00737e0 con 0x7f85e01010a0 2023-08-10T11:27:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.432+0000 7f85e5bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01a4db0 con 0x7f85e01066f0 2023-08-10T11:27:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.432+0000 7f85e5bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01a4ef0 con 0x7f85e01006e0 2023-08-10T11:27:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85deffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01010a0 0x7f85e0072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85deffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01010a0 0x7f85e0072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44992/0 (socket says 172.21.15.107:44992) 2023-08-10T11:27:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85deffd700 1 -- 172.21.15.107:0/3651805099 learned_addr learned my addr 172.21.15.107:0/3651805099 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:25.436 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85df7fe700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e01006e0 0x7f85e0072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:25.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85dffff700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85e01066f0 0x7f85e01a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:25.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85deffd700 1 -- 172.21.15.107:0/3651805099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e01006e0 msgr2=0x7f85e0072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85deffd700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e01006e0 0x7f85e0072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85deffd700 1 -- 172.21.15.107:0/3651805099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85e01066f0 msgr2=0x7f85e01a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85deffd700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85e01066f0 0x7f85e01a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.437 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85deffd700 1 -- 172.21.15.107:0/3651805099 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00095f0 con 0x7f85e01010a0 2023-08-10T11:27:25.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85deffd700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01010a0 0x7f85e0072fb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f85d400d950 tx=0x7f85d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:25.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85dcff9700 1 -- 172.21.15.107:0/3651805099 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400f890 con 0x7f85e01010a0 2023-08-10T11:27:25.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85dcff9700 1 -- 172.21.15.107:0/3651805099 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85d400fe80 con 0x7f85e01010a0 2023-08-10T11:27:25.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e01a5150 con 0x7f85e01010a0 2023-08-10T11:27:25.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.433+0000 7f85dcff9700 1 -- 172.21.15.107:0/3651805099 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400e3b0 con 0x7f85e01010a0 2023-08-10T11:27:25.438 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.434+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e01a5680 con 0x7f85e01010a0 2023-08-10T11:27:25.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.434+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e0067560 con 0x7f85e01010a0 2023-08-10T11:27:25.439 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.436+0000 7f85dcff9700 1 -- 172.21.15.107:0/3651805099 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f85d4010460 con 0x7f85e01010a0 2023-08-10T11:27:25.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.438+0000 7f85dcff9700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f85c80a1380 0x7f85c80a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:25.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.438+0000 7f85dcff9700 1 -- 172.21.15.107:0/3651805099 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 9330+0+0 (secure 0 0 0) 0x7f85d40cce10 con 0x7f85e01010a0 2023-08-10T11:27:25.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.438+0000 7f85df7fe700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f85c80a1380 0x7f85c80a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:25.440 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.438+0000 7f85df7fe700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f85c80a1380 0x7f85c80a3840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b5c0 tx=0x7f85d000b850 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:25.443 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.442+0000 7f85dcff9700 1 -- 172.21.15.107:0/3651805099 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f85d40d0030 con 0x7f85e01010a0 2023-08-10T11:27:25.643 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.641+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85e01a59e0 con 0x7f85e01010a0 2023-08-10T11:27:25.644 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.643+0000 7f85dcff9700 1 -- 172.21.15.107:0/3651805099 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+25064 (secure 0 0 0) 0x7f85d4016090 con 0x7f85e01010a0 2023-08-10T11:27:25.645 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-08-10T11:27:25.645 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":161,"fsid":"2b47e340-376a-11ee-9b37-001a4aab830c","created":"2023-08-10T10:40:11.953393+0000","modified":"2023-08-10T11:27:24.988258+0000","last_up_change":"2023-08-10T10:47:45.632929+0000","last_in_change":"2023-08-10T10:47:24.923922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:43:44.076722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:48:40.497567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-10T10:48:41.552599+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":66,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:48:45.126638+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":66,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6be24c5b-22c4-465b-bbc9-a6debc566b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6803","nonce":3090277820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6805","nonce":3090277820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6809","nonce":3090277820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":3090277820},{"type":"v1","addr":"172.21.15.107:6807","nonce":3090277820}]},"public_addr":"172.21.15.107:6803/3090277820","cluster_addr":"172.21.15.107:6805/3090277820","heartbeat_back_addr":"172.21.15.107:6809/3090277820","heartbeat_front_addr":"172.21.15.107:6807/3090277820","state":["exists","up"]},{"osd":1,"uuid":"1197ceb3-455f-48be-9ed5-978800d57983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6801","nonce":3276667831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6803","nonce":3276667831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6807","nonce":3276667831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3276667831},{"type":"v1","addr":"172.21.15.157:6805","nonce":3276667831}]},"public_addr":"172.21.15.157:6801/3276667831","cluster_addr":"172.21.15.157:6803/3276667831","heartbeat_back_addr":"172.21.15.157:6807/3276667831","heartbeat_front_addr":"172.21.15.157:6805/3276667831","state":["exists","up"]},{"osd":2,"uuid":"733c3626-a769-4765-9316-705c451387ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6801","nonce":3340307341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6803","nonce":3340307341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6807","nonce":3340307341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3340307341},{"type":"v1","addr":"172.21.15.195:6805","nonce":3340307341}]},"public_addr":"172.21.15.195:6801/3340307341","cluster_addr":"172.21.15.195:6803/3340307341","heartbeat_back_addr":"172.21.15.195:6807/3340307341","heartbeat_front_addr":"172.21.15.195:6805/3340307341","state":["exists","up"]},{"osd":3,"uuid":"499f11fd-b9fc-4945-8b3a-929bc041ca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6811","nonce":3845563579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6813","nonce":3845563579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6817","nonce":3845563579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3845563579},{"type":"v1","addr":"172.21.15.107:6815","nonce":3845563579}]},"public_addr":"172.21.15.107:6811/3845563579","cluster_addr":"172.21.15.107:6813/3845563579","heartbeat_back_addr":"172.21.15.107:6817/3845563579","heartbeat_front_addr":"172.21.15.107:6815/3845563579","state":["exists","up"]},{"osd":4,"uuid":"a9bc5d4b-6fab-4b72-84d0-ed6bd6de2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6809","nonce":2085843494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6811","nonce":2085843494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6815","nonce":2085843494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2085843494},{"type":"v1","addr":"172.21.15.157:6813","nonce":2085843494}]},"public_addr":"172.21.15.157:6809/2085843494","cluster_addr":"172.21.15.157:6811/2085843494","heartbeat_back_addr":"172.21.15.157:6815/2085843494","heartbeat_front_addr":"172.21.15.157:6813/2085843494","state":["exists","up"]},{"osd":5,"uuid":"4638e56c-4db1-4e41-8916-0063d45f3deb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6809","nonce":922097042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6811","nonce":922097042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6815","nonce":922097042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":922097042},{"type":"v1","addr":"172.21.15.195:6813","nonce":922097042}]},"public_addr":"172.21.15.195:6809/922097042","cluster_addr":"172.21.15.195:6811/922097042","heartbeat_back_addr":"172.21.15.195:6815/922097042","heartbeat_front_addr":"172.21.15.195:6813/922097042","state":["exists","up"]},{"osd":6,"uuid":"4ac5a683-512b-450f-a2a6-b79cce87988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6819","nonce":2967097574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6821","nonce":2967097574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6825","nonce":2967097574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":2967097574},{"type":"v1","addr":"172.21.15.107:6823","nonce":2967097574}]},"public_addr":"172.21.15.107:6819/2967097574","cluster_addr":"172.21.15.107:6821/2967097574","heartbeat_back_addr":"172.21.15.107:6825/2967097574","heartbeat_front_addr":"172.21.15.107:6823/2967097574","state":["exists","up"]},{"osd":7,"uuid":"41ebd81c-5952-4224-9cd5-ae37fa8885a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6817","nonce":3040537595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6819","nonce":3040537595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6823","nonce":3040537595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3040537595},{"type":"v1","addr":"172.21.15.157:6821","nonce":3040537595}]},"public_addr":"172.21.15.157:6817/3040537595","cluster_addr":"172.21.15.157:6819/3040537595","heartbeat_back_addr":"172.21.15.157:6823/3040537595","heartbeat_front_addr":"172.21.15.157:6821/3040537595","state":["exists","up"]},{"osd":8,"uuid":"8b4173ce-ee76-4468-b01e-92713996ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6817","nonce":2721690831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6819","nonce":2721690831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6823","nonce":2721690831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2721690831},{"type":"v1","addr":"172.21.15.195:6821","nonce":2721690831}]},"public_addr":"172.21.15.195:6817/2721690831","cluster_addr":"172.21.15.195:6819/2721690831","heartbeat_back_addr":"172.21.15.195:6823/2721690831","heartbeat_front_addr":"172.21.15.195:6821/2721690831","state":["exists","up"]},{"osd":9,"uuid":"0c771bbc-1eec-4fed-ac65-425b06e9ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6827","nonce":48908016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6829","nonce":48908016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6833","nonce":48908016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":48908016},{"type":"v1","addr":"172.21.15.107:6831","nonce":48908016}]},"public_addr":"172.21.15.107:6827/48908016","cluster_addr":"172.21.15.107:6829/48908016","heartbeat_back_addr":"172.21.15.107:6833/48908016","heartbeat_front_addr":"172.21.15.107:6831/48908016","state":["exists","up"]},{"osd":10,"uuid":"56d55b48-d75f-4a1b-a164-308dc2788c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6825","nonce":1583160453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6827","nonce":1583160453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6831","nonce":1583160453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":1583160453},{"type":"v1","addr":"172.21.15.157:6829","nonce":1583160453}]},"public_addr":"172.21.15.157:6825/1583160453","cluster_addr":"172.21.15.157:6827/1583160453","heartbeat_back_addr":"172.21.15.157:6831/1583160453","heartbeat_front_addr":"172.21.15.157:6829/1583160453","state":["exists","up"]},{"osd":11,"uuid":"36bf890d-e08d-447e-b2c4-7a7c3bd30d06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6825","nonce":3972031939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6827","nonce":3972031939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6831","nonce":3972031939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3972031939},{"type":"v1","addr":"172.21.15.195:6829","nonce":3972031939}]},"public_addr":"172.21.15.195:6825/3972031939","cluster_addr":"172.21.15.195:6827/3972031939","heartbeat_back_addr":"172.21.15.195:6831/3972031939","heartbeat_front_addr":"172.21.15.195:6829/3972031939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:42:48.730127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:15.390066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:43:41.680120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:09.675184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:44:36.548625+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:03.203693+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:29.935348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:45:57.336250+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:24.230742+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:46:50.308382+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:17.080319+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:47:43.856471+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3715609072":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6801/438388714":"2023-08-11T10:51:12.376658+0000","172.21.15.107:0/1857104840":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6801/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:6800/438388714":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6800/294010818":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2325198765":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4249017598":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/155446065":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2780861048":"2023-08-11T10:40:45.031723+0000","172.21.15.107:6800/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/3894575131":"2023-08-11T10:51:12.376658+0000","172.21.15.107:6801/4026286774":"2023-08-11T10:40:45.031723+0000","172.21.15.107:0/4083524194":"2023-08-11T10:51:12.376658+0000","172.21.15.107:0/2396317165":"2023-08-11T10:41:11.475754+0000","172.21.15.107:0/2565207558":"2023-08-11T10:41:11.475754+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":53,"length":1},{"begin":66,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T11:27:25.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f85c80a1380 msgr2=0x7f85c80a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f85c80a1380 0x7f85c80a3840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b5c0 tx=0x7f85d000b850 comp rx=0 tx=0).stop 2023-08-10T11:27:25.647 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01010a0 msgr2=0x7f85e0072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01010a0 0x7f85e0072fb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f85d400d950 tx=0x7f85d400dc60 comp rx=0 tx=0).stop 2023-08-10T11:27:25.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 shutdown_connections 2023-08-10T11:27:25.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f85c80a1380 0x7f85c80a3840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85e01066f0 0x7f85e01a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85e01006e0 0x7f85e0072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 --2- 172.21.15.107:0/3651805099 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f85e01010a0 0x7f85e0072fb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.648 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 >> 172.21.15.107:0/3651805099 conn(0x7f85e00fc190 msgr2=0x7f85e01041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:25.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 shutdown_connections 2023-08-10T11:27:25.649 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.646+0000 7f85e5bff700 1 -- 172.21.15.107:0/3651805099 wait complete. 2023-08-10T11:27:25.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:43:44.076722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:48:40.497567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:48:41.552599+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 66, 'snap_epoch': 159, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:48:45.126638+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 66, 'snap_epoch': 159, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T11:27:25.668 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T11:27:25.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.868+0000 7f2860dff700 1 -- 172.21.15.107:0/3903504322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 msgr2=0x7f285c106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.868+0000 7f2860dff700 1 --2- 172.21.15.107:0/3903504322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 0x7f285c106ab0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f284c009990 tx=0x7f284c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.870 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.869+0000 7f2860dff700 1 -- 172.21.15.107:0/3903504322 shutdown_connections 2023-08-10T11:27:25.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.869+0000 7f2860dff700 1 --2- 172.21.15.107:0/3903504322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285c101080 0x7f285c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.869+0000 7f2860dff700 1 --2- 172.21.15.107:0/3903504322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 0x7f285c106ab0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.869+0000 7f2860dff700 1 --2- 172.21.15.107:0/3903504322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f285c1006c0 0x7f285c100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.869+0000 7f2860dff700 1 -- 172.21.15.107:0/3903504322 >> 172.21.15.107:0/3903504322 conn(0x7f285c0fc1f0 msgr2=0x7f285c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:25.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.869+0000 7f2860dff700 1 -- 172.21.15.107:0/3903504322 shutdown_connections 2023-08-10T11:27:25.871 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.869+0000 7f2860dff700 1 -- 172.21.15.107:0/3903504322 wait complete. 2023-08-10T11:27:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.870+0000 7f2860dff700 1 Processor -- start 2023-08-10T11:27:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.870+0000 7f2860dff700 1 -- start start 2023-08-10T11:27:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.870+0000 7f2860dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285c1006c0 0x7f285c1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:25.873 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.870+0000 7f2860dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f285c101080 0x7f285c196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.870+0000 7f2860dff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 0x7f285c199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.870+0000 7f2860dff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c19a5d0 con 0x7f285c1066d0 2023-08-10T11:27:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.870+0000 7f2860dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c19a740 con 0x7f285c101080 2023-08-10T11:27:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.870+0000 7f2860dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c19a900 con 0x7f285c1006c0 2023-08-10T11:27:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 0x7f285c199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 0x7f285c199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45016/0 (socket says 172.21.15.107:45016) 2023-08-10T11:27:25.874 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285ad9d700 1 -- 172.21.15.107:0/3393958111 learned_addr learned my addr 172.21.15.107:0/3393958111 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:25.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f2859d9b700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f285c101080 0x7f285c196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:25.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285a59c700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285c1006c0 0x7f285c1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:25.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285ad9d700 1 -- 172.21.15.107:0/3393958111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285c1006c0 msgr2=0x7f285c1966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285ad9d700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285c1006c0 0x7f285c1966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285ad9d700 1 -- 172.21.15.107:0/3393958111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f285c101080 msgr2=0x7f285c196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:25.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285ad9d700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f285c101080 0x7f285c196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:25.875 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285ad9d700 1 -- 172.21.15.107:0/3393958111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0095f0 con 0x7f285c1066d0 2023-08-10T11:27:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f285ad9d700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 0x7f285c199fd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2854007ee0 tx=0x7f285400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f284b7fe700 1 -- 172.21.15.107:0/3393958111 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854017070 con 0x7f285c1066d0 2023-08-10T11:27:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f284b7fe700 1 -- 172.21.15.107:0/3393958111 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f285400f040 con 0x7f285c1066d0 2023-08-10T11:27:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f284b7fe700 1 -- 172.21.15.107:0/3393958111 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854005710 con 0x7f285c1066d0 2023-08-10T11:27:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.871+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c19abe0 con 0x7f285c1066d0 2023-08-10T11:27:25.876 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.872+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c1a3540 con 0x7f285c1066d0 2023-08-10T11:27:25.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.872+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c0674f0 con 0x7f285c1066d0 2023-08-10T11:27:25.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.875+0000 7f284b7fe700 1 -- 172.21.15.107:0/3393958111 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2854005870 con 0x7f285c1066d0 2023-08-10T11:27:25.877 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.876+0000 7f284b7fe700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28440a12c0 0x7f28440a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:25.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.876+0000 7f284b7fe700 1 -- 172.21.15.107:0/3393958111 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 9330+0+0 (secure 0 0 0) 0x7f28540cce30 con 0x7f285c1066d0 2023-08-10T11:27:25.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.876+0000 7f285a59c700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28440a12c0 0x7f28440a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:25.878 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.877+0000 7f285a59c700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28440a12c0 0x7f28440a3780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f284c00b5c0 tx=0x7f284c005fb0 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:25.879 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:25.878+0000 7f284b7fe700 1 -- 172.21.15.107:0/3393958111 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2854095eb0 con 0x7f285c1066d0 2023-08-10T11:27:26.082 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.081+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f285c1a37d0 con 0x7f285c1066d0 2023-08-10T11:27:26.083 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.081+0000 7f284b7fe700 1 -- 172.21.15.107:0/3393958111 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28540994d0 con 0x7f285c1066d0 2023-08-10T11:27:26.083 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2023-08-10T11:27:26.085 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28440a12c0 msgr2=0x7f28440a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28440a12c0 0x7f28440a3780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f284c00b5c0 tx=0x7f284c005fb0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 msgr2=0x7f285c199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 0x7f285c199fd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2854007ee0 tx=0x7f285400d3b0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 shutdown_connections 2023-08-10T11:27:26.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285c1066d0 0x7f285c199fd0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285c1006c0 0x7f285c1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.086 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f28440a12c0 0x7f28440a3780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 --2- 172.21.15.107:0/3393958111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f285c101080 0x7f285c196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 >> 172.21.15.107:0/3393958111 conn(0x7f285c0fc1f0 msgr2=0x7f285c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:26.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 shutdown_connections 2023-08-10T11:27:26.087 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.084+0000 7f2860dff700 1 -- 172.21.15.107:0/3393958111 wait complete. 2023-08-10T11:27:26.104 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T11:27:26.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:26 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/170234040' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T11:27:26.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:26 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3651805099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:27:26.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.304+0000 7efe833ff700 1 -- 172.21.15.107:0/3004935288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c1066d0 msgr2=0x7efe7c106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.305 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.304+0000 7efe833ff700 1 --2- 172.21.15.107:0/3004935288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c1066d0 0x7efe7c106ab0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7efe78009990 tx=0x7efe78009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.304+0000 7efe833ff700 1 -- 172.21.15.107:0/3004935288 shutdown_connections 2023-08-10T11:27:26.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.304+0000 7efe833ff700 1 --2- 172.21.15.107:0/3004935288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe7c101080 0x7efe7c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.304+0000 7efe833ff700 1 --2- 172.21.15.107:0/3004935288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c1066d0 0x7efe7c106ab0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.304+0000 7efe833ff700 1 --2- 172.21.15.107:0/3004935288 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe7c1006c0 0x7efe7c100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.306 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.304+0000 7efe833ff700 1 -- 172.21.15.107:0/3004935288 >> 172.21.15.107:0/3004935288 conn(0x7efe7c0fc1f0 msgr2=0x7efe7c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:26.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.304+0000 7efe833ff700 1 -- 172.21.15.107:0/3004935288 shutdown_connections 2023-08-10T11:27:26.307 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.304+0000 7efe833ff700 1 -- 172.21.15.107:0/3004935288 wait complete. 2023-08-10T11:27:26.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.305+0000 7efe833ff700 1 Processor -- start 2023-08-10T11:27:26.308 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.305+0000 7efe833ff700 1 -- start start 2023-08-10T11:27:26.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.305+0000 7efe833ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe7c1006c0 0x7efe7c19e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:26.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.305+0000 7efe833ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c101080 0x7efe7c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:26.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.305+0000 7efe833ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe7c1066d0 0x7efe7c1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:26.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.305+0000 7efe833ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c198d50 con 0x7efe7c101080 2023-08-10T11:27:26.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.305+0000 7efe833ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c198ec0 con 0x7efe7c1006c0 2023-08-10T11:27:26.309 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.305+0000 7efe833ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c199080 con 0x7efe7c1066d0 2023-08-10T11:27:26.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8099a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c101080 0x7efe7c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:26.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8099a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c101080 0x7efe7c19eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45034/0 (socket says 172.21.15.107:45034) 2023-08-10T11:27:26.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8099a700 1 -- 172.21.15.107:0/2523782286 learned_addr learned my addr 172.21.15.107:0/2523782286 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:26.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8199c700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe7c1066d0 0x7efe7c1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:26.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8119b700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe7c1006c0 0x7efe7c19e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:26.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8099a700 1 -- 172.21.15.107:0/2523782286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe7c1066d0 msgr2=0x7efe7c1986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8099a700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe7c1066d0 0x7efe7c1986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.310 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8099a700 1 -- 172.21.15.107:0/2523782286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe7c1006c0 msgr2=0x7efe7c19e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8099a700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe7c1006c0 0x7efe7c19e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8099a700 1 -- 172.21.15.107:0/2523782286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780095f0 con 0x7efe7c101080 2023-08-10T11:27:26.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe8099a700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c101080 0x7efe7c19eb50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00d980 tx=0x7efe6c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:26.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.306+0000 7efe727fc700 1 -- 172.21.15.107:0/2523782286 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00bb60 con 0x7efe7c101080 2023-08-10T11:27:26.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.307+0000 7efe727fc700 1 -- 172.21.15.107:0/2523782286 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe6c007640 con 0x7efe7c101080 2023-08-10T11:27:26.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.307+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c199360 con 0x7efe7c101080 2023-08-10T11:27:26.311 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.307+0000 7efe727fc700 1 -- 172.21.15.107:0/2523782286 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c004d60 con 0x7efe7c101080 2023-08-10T11:27:26.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.307+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c1a5640 con 0x7efe7c101080 2023-08-10T11:27:26.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.308+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c0674f0 con 0x7efe7c101080 2023-08-10T11:27:26.312 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.310+0000 7efe727fc700 1 -- 172.21.15.107:0/2523782286 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7efe6c004020 con 0x7efe7c101080 2023-08-10T11:27:26.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.311+0000 7efe727fc700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efe680a12c0 0x7efe680a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:26.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.311+0000 7efe727fc700 1 -- 172.21.15.107:0/2523782286 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 9330+0+0 (secure 0 0 0) 0x7efe6c0ccf00 con 0x7efe7c101080 2023-08-10T11:27:26.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.311+0000 7efe8119b700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efe680a12c0 0x7efe680a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:26.313 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.312+0000 7efe8119b700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efe680a12c0 0x7efe680a3780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe78003680 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:26.316 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.315+0000 7efe727fc700 1 -- 172.21.15.107:0/2523782286 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7efe6c095fe0 con 0x7efe7c101080 2023-08-10T11:27:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:26 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/170234040' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T11:27:26.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:26 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3651805099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:27:26.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:26 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/170234040' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T11:27:26.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:26 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3651805099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-08-10T11:27:26.513 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.512+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe7c1a5900 con 0x7efe7c101080 2023-08-10T11:27:26.514 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.512+0000 7efe727fc700 1 -- 172.21.15.107:0/2523782286 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v161) v1 ==== 104+0+11 (secure 0 0 0) 0x7efe6c0160a0 con 0x7efe7c101080 2023-08-10T11:27:26.514 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T11:27:26.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efe680a12c0 msgr2=0x7efe680a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.516 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efe680a12c0 0x7efe680a3780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe78003680 comp rx=0 tx=0).stop 2023-08-10T11:27:26.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c101080 msgr2=0x7efe7c19eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c101080 0x7efe7c19eb50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00d980 tx=0x7efe6c00dd40 comp rx=0 tx=0).stop 2023-08-10T11:27:26.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 shutdown_connections 2023-08-10T11:27:26.517 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7efe680a12c0 0x7efe680a3780 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe7c1006c0 0x7efe7c19e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe7c1066d0 0x7efe7c1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.518 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 --2- 172.21.15.107:0/2523782286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe7c101080 0x7efe7c19eb50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.514+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 >> 172.21.15.107:0/2523782286 conn(0x7efe7c0fc1f0 msgr2=0x7efe7c10bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:26.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.515+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 shutdown_connections 2023-08-10T11:27:26.519 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.515+0000 7efe833ff700 1 -- 172.21.15.107:0/2523782286 wait complete. 2023-08-10T11:27:26.534 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T11:27:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.733+0000 7fd6579ff700 1 -- 172.21.15.107:0/3275533206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501066d0 msgr2=0x7fd650106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.733+0000 7fd6579ff700 1 --2- 172.21.15.107:0/3275533206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501066d0 0x7fd650106ab0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009990 tx=0x7fd64c009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.733+0000 7fd6579ff700 1 -- 172.21.15.107:0/3275533206 shutdown_connections 2023-08-10T11:27:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.733+0000 7fd6579ff700 1 --2- 172.21.15.107:0/3275533206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd650101080 0x7fd65010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.733+0000 7fd6579ff700 1 --2- 172.21.15.107:0/3275533206 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501066d0 0x7fd650106ab0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.733+0000 7fd6579ff700 1 --2- 172.21.15.107:0/3275533206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6501006c0 0x7fd650100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.733+0000 7fd6579ff700 1 -- 172.21.15.107:0/3275533206 >> 172.21.15.107:0/3275533206 conn(0x7fd6500fc1f0 msgr2=0x7fd6500fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:26.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.733+0000 7fd6579ff700 1 -- 172.21.15.107:0/3275533206 shutdown_connections 2023-08-10T11:27:26.736 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.733+0000 7fd6579ff700 1 -- 172.21.15.107:0/3275533206 wait complete. 2023-08-10T11:27:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.734+0000 7fd6579ff700 1 Processor -- start 2023-08-10T11:27:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd6579ff700 1 -- start start 2023-08-10T11:27:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd6579ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501006c0 0x7fd6501989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd6579ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd650101080 0x7fd650198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd6579ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6501066d0 0x7fd65019d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:26.738 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd6579ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65019d950 con 0x7fd6501006c0 2023-08-10T11:27:26.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd6579ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65019dac0 con 0x7fd650101080 2023-08-10T11:27:26.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd6579ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65019dc80 con 0x7fd6501066d0 2023-08-10T11:27:26.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd65579b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501006c0 0x7fd6501989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:26.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd65579b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501006c0 0x7fd6501989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45042/0 (socket says 172.21.15.107:45042) 2023-08-10T11:27:26.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd65579b700 1 -- 172.21.15.107:0/886688014 learned_addr learned my addr 172.21.15.107:0/886688014 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:26.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.735+0000 7fd654f9a700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd650101080 0x7fd650198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:26.739 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd65579b700 1 -- 172.21.15.107:0/886688014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6501066d0 msgr2=0x7fd65019d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd655f9c700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6501066d0 0x7fd65019d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:26.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd65579b700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6501066d0 0x7fd65019d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd65579b700 1 -- 172.21.15.107:0/886688014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd650101080 msgr2=0x7fd650198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd65579b700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd650101080 0x7fd650198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd65579b700 1 -- 172.21.15.107:0/886688014 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0095f0 con 0x7fd6501006c0 2023-08-10T11:27:26.740 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd655f9c700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6501066d0 0x7fd65019d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T11:27:26.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd65579b700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501006c0 0x7fd6501989b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd64c005910 tx=0x7fd64c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:26.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd6467fc700 1 -- 172.21.15.107:0/886688014 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c01d070 con 0x7fd6501006c0 2023-08-10T11:27:26.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65019df60 con 0x7fd6501006c0 2023-08-10T11:27:26.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd6467fc700 1 -- 172.21.15.107:0/886688014 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd64c021410 con 0x7fd6501006c0 2023-08-10T11:27:26.741 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd6467fc700 1 -- 172.21.15.107:0/886688014 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c017650 con 0x7fd6501006c0 2023-08-10T11:27:26.742 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.736+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6501a5810 con 0x7fd6501006c0 2023-08-10T11:27:26.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.737+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6500674f0 con 0x7fd6501006c0 2023-08-10T11:27:26.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.739+0000 7fd6467fc700 1 -- 172.21.15.107:0/886688014 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fd64c00fb00 con 0x7fd6501006c0 2023-08-10T11:27:26.743 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.740+0000 7fd6467fc700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd63c0a12c0 0x7fd63c0a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:26.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.740+0000 7fd6467fc700 1 -- 172.21.15.107:0/886688014 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 9330+0+0 (secure 0 0 0) 0x7fd64c0ce4d0 con 0x7fd6501006c0 2023-08-10T11:27:26.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.741+0000 7fd654f9a700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd63c0a12c0 0x7fd63c0a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:26.744 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.741+0000 7fd654f9a700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd63c0a12c0 0x7fd63c0a3780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd650199fc0 tx=0x7fd640009260 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:26.745 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.744+0000 7fd6467fc700 1 -- 172.21.15.107:0/886688014 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd64c0975e0 con 0x7fd6501006c0 2023-08-10T11:27:26.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.946+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6501a59a0 con 0x7fd6501006c0 2023-08-10T11:27:26.947 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.946+0000 7fd6467fc700 1 -- 172.21.15.107:0/886688014 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v161) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd64c09ac00 con 0x7fd6501006c0 2023-08-10T11:27:26.948 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2023-08-10T11:27:26.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd63c0a12c0 msgr2=0x7fd63c0a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd63c0a12c0 0x7fd63c0a3780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd650199fc0 tx=0x7fd640009260 comp rx=0 tx=0).stop 2023-08-10T11:27:26.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501006c0 msgr2=0x7fd6501989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:26.950 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501006c0 0x7fd6501989b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd64c005910 tx=0x7fd64c0047b0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 shutdown_connections 2023-08-10T11:27:26.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6501066d0 0x7fd65019d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6501006c0 0x7fd6501989b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7fd63c0a12c0 0x7fd63c0a3780 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 --2- 172.21.15.107:0/886688014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd650101080 0x7fd650198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:26.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 >> 172.21.15.107:0/886688014 conn(0x7fd6500fc1f0 msgr2=0x7fd6500fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:26.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 shutdown_connections 2023-08-10T11:27:26.951 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:26.949+0000 7fd6579ff700 1 -- 172.21.15.107:0/886688014 wait complete. 2023-08-10T11:27:26.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T11:27:27.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.169+0000 7f5ab55ff700 1 -- 172.21.15.107:0/853442065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01006c0 msgr2=0x7f5ab0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.169+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/853442065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01006c0 0x7f5ab0100b40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009990 tx=0x7f5aa4009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.169+0000 7f5ab55ff700 1 -- 172.21.15.107:0/853442065 shutdown_connections 2023-08-10T11:27:27.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.169+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/853442065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab01066d0 0x7f5ab0106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.169+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/853442065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ab0101080 0x7f5ab010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.171 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.169+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/853442065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01006c0 0x7f5ab0100b40 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.169+0000 7f5ab55ff700 1 -- 172.21.15.107:0/853442065 >> 172.21.15.107:0/853442065 conn(0x7f5ab00fc1f0 msgr2=0x7f5ab00fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:27.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.169+0000 7f5ab55ff700 1 -- 172.21.15.107:0/853442065 shutdown_connections 2023-08-10T11:27:27.172 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.169+0000 7f5ab55ff700 1 -- 172.21.15.107:0/853442065 wait complete. 2023-08-10T11:27:27.173 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.170+0000 7f5ab55ff700 1 Processor -- start 2023-08-10T11:27:27.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5ab55ff700 1 -- start start 2023-08-10T11:27:27.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5ab55ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ab01006c0 0x7f5ab019e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:27.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5ab55ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab0101080 0x7f5ab019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:27.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5ab55ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01066d0 0x7f5ab0198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:27.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5ab55ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0198d90 con 0x7f5ab01066d0 2023-08-10T11:27:27.174 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5ab55ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0198f00 con 0x7f5ab0101080 2023-08-10T11:27:27.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5ab55ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab01990c0 con 0x7f5ab01006c0 2023-08-10T11:27:27.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5aaf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01066d0 0x7f5ab0198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:27.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5aaf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01066d0 0x7f5ab0198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45060/0 (socket says 172.21.15.107:45060) 2023-08-10T11:27:27.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5aaf7fe700 1 -- 172.21.15.107:0/2646351675 learned_addr learned my addr 172.21.15.107:0/2646351675 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:27.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.171+0000 7f5aaeffd700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ab01006c0 0x7f5ab019e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:27.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5aae7fc700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab0101080 0x7f5ab019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:27.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5aaf7fe700 1 -- 172.21.15.107:0/2646351675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ab01006c0 msgr2=0x7f5ab019e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.175 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5aaf7fe700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ab01006c0 0x7f5ab019e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5aaf7fe700 1 -- 172.21.15.107:0/2646351675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab0101080 msgr2=0x7f5ab019ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5aaf7fe700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab0101080 0x7f5ab019ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5aaf7fe700 1 -- 172.21.15.107:0/2646351675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40095f0 con 0x7f5ab01066d0 2023-08-10T11:27:27.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5aaeffd700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ab01006c0 0x7f5ab019e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T11:27:27.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5aaf7fe700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01066d0 0x7f5ab0198720 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8007ee0 tx=0x7f5aa800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:27.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5a97fff700 1 -- 172.21.15.107:0/2646351675 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8017070 con 0x7f5ab01066d0 2023-08-10T11:27:27.176 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5a97fff700 1 -- 172.21.15.107:0/2646351675 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5aa800f040 con 0x7f5ab01066d0 2023-08-10T11:27:27.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5a97fff700 1 -- 172.21.15.107:0/2646351675 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8005710 con 0x7f5ab01066d0 2023-08-10T11:27:27.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab01993a0 con 0x7f5ab01066d0 2023-08-10T11:27:27.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.172+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab01a56a0 con 0x7f5ab01066d0 2023-08-10T11:27:27.177 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.173+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab00674f0 con 0x7f5ab01066d0 2023-08-10T11:27:27.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.175+0000 7f5a97fff700 1 -- 172.21.15.107:0/2646351675 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5aa8005870 con 0x7f5ab01066d0 2023-08-10T11:27:27.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.176+0000 7f5a97fff700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5a980a1340 0x7f5a980a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:27.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.177+0000 7f5a97fff700 1 -- 172.21.15.107:0/2646351675 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 9330+0+0 (secure 0 0 0) 0x7f5aa80cc890 con 0x7f5ab01066d0 2023-08-10T11:27:27.178 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.177+0000 7f5aaeffd700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5a980a1340 0x7f5a980a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:27.179 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.177+0000 7f5aaeffd700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5a980a1340 0x7f5a980a3800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0005e10 tx=0x7f5aa0005d60 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:27.181 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.180+0000 7f5a97fff700 1 -- 172.21.15.107:0/2646351675 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5aa8095970 con 0x7f5ab01066d0 2023-08-10T11:27:27.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:27 smithi157 ceph-mon[129604]: pgmap v1156: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-08-10T11:27:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:27 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3393958111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:27:27.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:27 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2523782286' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:27:27.290 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:27 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/886688014' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:27:27.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:27 smithi107 ceph-mon[127953]: pgmap v1156: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-08-10T11:27:27.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:27 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3393958111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:27:27.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:27 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2523782286' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:27:27.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:27 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/886688014' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:27:27.383 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.382+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5ab01a59c0 con 0x7f5ab01066d0 2023-08-10T11:27:27.384 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.382+0000 7f5a97fff700 1 -- 172.21.15.107:0/2646351675 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v161) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5aa8098f90 con 0x7f5ab01066d0 2023-08-10T11:27:27.384 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2023-08-10T11:27:27.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5a980a1340 msgr2=0x7f5a980a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5a980a1340 0x7f5a980a3800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0005e10 tx=0x7f5aa0005d60 comp rx=0 tx=0).stop 2023-08-10T11:27:27.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01066d0 msgr2=0x7f5ab0198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01066d0 0x7f5ab0198720 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8007ee0 tx=0x7f5aa800d3b0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.386 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 shutdown_connections 2023-08-10T11:27:27.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5ab01066d0 0x7f5ab0198720 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ab01006c0 0x7f5ab019e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f5a980a1340 0x7f5a980a3800 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 --2- 172.21.15.107:0/2646351675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ab0101080 0x7f5ab019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 >> 172.21.15.107:0/2646351675 conn(0x7f5ab00fc1f0 msgr2=0x7f5ab00fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:27.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 shutdown_connections 2023-08-10T11:27:27.387 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.385+0000 7f5ab55ff700 1 -- 172.21.15.107:0/2646351675 wait complete. 2023-08-10T11:27:27.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T11:27:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:27 smithi195 ceph-mon[129938]: pgmap v1156: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-08-10T11:27:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:27 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3393958111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-08-10T11:27:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:27 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2523782286' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-08-10T11:27:27.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:27 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/886688014' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-08-10T11:27:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.603+0000 7f10dddff700 1 -- 172.21.15.107:0/4119391434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81066d0 msgr2=0x7f10d8106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.603+0000 7f10dddff700 1 --2- 172.21.15.107:0/4119391434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81066d0 0x7f10d8106ab0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009990 tx=0x7f10c8009ca0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.603+0000 7f10dddff700 1 -- 172.21.15.107:0/4119391434 shutdown_connections 2023-08-10T11:27:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.603+0000 7f10dddff700 1 --2- 172.21.15.107:0/4119391434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d8101080 0x7f10d810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.603+0000 7f10dddff700 1 --2- 172.21.15.107:0/4119391434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81066d0 0x7f10d8106ab0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.603+0000 7f10dddff700 1 --2- 172.21.15.107:0/4119391434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10d81006c0 0x7f10d8100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.605 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.603+0000 7f10dddff700 1 -- 172.21.15.107:0/4119391434 >> 172.21.15.107:0/4119391434 conn(0x7f10d80fc1f0 msgr2=0x7f10d80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:27.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.603+0000 7f10dddff700 1 -- 172.21.15.107:0/4119391434 shutdown_connections 2023-08-10T11:27:27.606 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.603+0000 7f10dddff700 1 -- 172.21.15.107:0/4119391434 wait complete. 2023-08-10T11:27:27.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.604+0000 7f10dddff700 1 Processor -- start 2023-08-10T11:27:27.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.604+0000 7f10dddff700 1 -- start start 2023-08-10T11:27:27.607 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.604+0000 7f10dddff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81006c0 0x7f10d819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:27.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.604+0000 7f10dddff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d8101080 0x7f10d819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:27.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10dddff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10d81066d0 0x7f10d8198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:27.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10dddff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8198dd0 con 0x7f10d81006c0 2023-08-10T11:27:27.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10dddff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8198f40 con 0x7f10d81066d0 2023-08-10T11:27:27.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10dddff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8199100 con 0x7f10d8101080 2023-08-10T11:27:27.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81006c0 0x7f10d819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:27.608 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81006c0 0x7f10d819e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45068/0 (socket says 172.21.15.107:45068) 2023-08-10T11:27:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d77fe700 1 -- 172.21.15.107:0/3629649764 learned_addr learned my addr 172.21.15.107:0/3629649764 (peer_addr_for_me v2:172.21.15.107:0/0) 2023-08-10T11:27:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d6ffd700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d8101080 0x7f10d819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d77fe700 1 -- 172.21.15.107:0/3629649764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d8101080 msgr2=0x7f10d819ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d77fe700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d8101080 0x7f10d819ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d77fe700 1 -- 172.21.15.107:0/3629649764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10d81066d0 msgr2=0x7f10d8198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d77fe700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10d81066d0 0x7f10d8198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d77fe700 1 -- 172.21.15.107:0/3629649764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c80095f0 con 0x7f10d81006c0 2023-08-10T11:27:27.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.605+0000 7f10d77fe700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81006c0 0x7f10d819e690 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f10c80036c0 tx=0x7f10c8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:27.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.606+0000 7f10d4ff9700 1 -- 172.21.15.107:0/3629649764 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c801d070 con 0x7f10d81006c0 2023-08-10T11:27:27.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.606+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d8199380 con 0x7f10d81006c0 2023-08-10T11:27:27.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.606+0000 7f10d4ff9700 1 -- 172.21.15.107:0/3629649764 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10c8003f40 con 0x7f10d81006c0 2023-08-10T11:27:27.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.606+0000 7f10d4ff9700 1 -- 172.21.15.107:0/3629649764 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8022c40 con 0x7f10d81006c0 2023-08-10T11:27:27.610 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.606+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d81a56c0 con 0x7f10d81006c0 2023-08-10T11:27:27.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.607+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d80674f0 con 0x7f10d81006c0 2023-08-10T11:27:27.611 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.609+0000 7f10d4ff9700 1 -- 172.21.15.107:0/3629649764 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 26) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f10c8022470 con 0x7f10d81006c0 2023-08-10T11:27:27.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.611+0000 7f10d4ff9700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f10c00a12c0 0x7f10c00a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T11:27:27.612 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.611+0000 7f10d4ff9700 1 -- 172.21.15.107:0/3629649764 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 9330+0+0 (secure 0 0 0) 0x7f10c80cec40 con 0x7f10d81006c0 2023-08-10T11:27:27.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.611+0000 7f10d6ffd700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f10c00a12c0 0x7f10c00a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T11:27:27.613 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.612+0000 7f10d6ffd700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f10c00a12c0 0x7f10c00a3780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10d8199f10 tx=0x7f10cc00b410 comp rx=0 tx=0).ready entity=mgr.15747 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T11:27:27.614 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.613+0000 7f10d4ff9700 1 -- 172.21.15.107:0/3629649764 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f10c8097d50 con 0x7f10d81006c0 2023-08-10T11:27:27.831 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.830+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f10d81a58f0 con 0x7f10d81006c0 2023-08-10T11:27:27.832 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.831+0000 7f10d4ff9700 1 -- 172.21.15.107:0/3629649764 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v161) v1 ==== 81+0+957 (secure 0 0 0) 0x7f10c809b370 con 0x7f10d81006c0 2023-08-10T11:27:27.832 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3715609072 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:27.832 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/438388714 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:27.833 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/1857104840 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:27.833 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/294010818 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:27.833 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/438388714 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:27.833 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/294010818 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:27.833 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2325198765 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:27.833 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/4249017598 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:27.833 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/155446065 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:27.833 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2780861048 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:27.834 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/4026286774 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:27.834 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3894575131 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:27.834 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/4026286774 2023-08-11T10:40:45.031723+0000 2023-08-10T11:27:27.834 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/4083524194 2023-08-11T10:51:12.376658+0000 2023-08-10T11:27:27.834 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2396317165 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:27.834 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2565207558 2023-08-11T10:41:11.475754+0000 2023-08-10T11:27:27.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f10c00a12c0 msgr2=0x7f10c00a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f10c00a12c0 0x7f10c00a3780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10d8199f10 tx=0x7f10cc00b410 comp rx=0 tx=0).stop 2023-08-10T11:27:27.835 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81006c0 msgr2=0x7f10d819e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T11:27:27.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81006c0 0x7f10d819e690 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f10c80036c0 tx=0x7f10c8005740 comp rx=0 tx=0).stop 2023-08-10T11:27:27.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 shutdown_connections 2023-08-10T11:27:27.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:6800/391042332,v1:172.21.15.107:6801/391042332] conn(0x7f10c00a12c0 0x7f10c00a3780 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10d81066d0 0x7f10d8198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10d81006c0 0x7f10d819e690 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 --2- 172.21.15.107:0/3629649764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10d8101080 0x7f10d819ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T11:27:27.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 >> 172.21.15.107:0/3629649764 conn(0x7f10d80fc1f0 msgr2=0x7f10d810ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T11:27:27.836 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 shutdown_connections 2023-08-10T11:27:27.837 INFO:teuthology.orchestra.run.smithi107.stderr:2023-08-10T11:27:27.833+0000 7f10dddff700 1 -- 172.21.15.107:0/3629649764 wait complete. 2023-08-10T11:27:27.837 INFO:teuthology.orchestra.run.smithi107.stderr:listed 16 entries 2023-08-10T11:27:27.852 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com... 2023-08-10T11:27:27.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:27:27.853 DEBUG:teuthology.orchestra.run.smithi107:> sudo fusermount -u /tmp/cephfs 2023-08-10T11:27:27.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:ceph-fuse[177982]: fuse finished with error 0 and tester_r 0 2023-08-10T11:27:28.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:28 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/2646351675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T11:27:28.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:28 smithi157 ceph-mon[129604]: from='client.? 172.21.15.107:0/3629649764' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T11:27:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:28 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/2646351675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T11:27:28.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:28 smithi107 ceph-mon[127953]: from='client.? 172.21.15.107:0/3629649764' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T11:27:28.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:28 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/2646351675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-08-10T11:27:28.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:28 smithi195 ceph-mon[129938]: from='client.? 172.21.15.107:0/3629649764' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-08-10T11:27:28.946 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T11:27:29.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:29 smithi157 ceph-mon[129604]: pgmap v1157: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-08-10T11:27:29.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:29 smithi107 ceph-mon[127953]: pgmap v1157: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-08-10T11:27:29.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:29 smithi195 ceph-mon[129938]: pgmap v1157: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-08-10T11:27:31.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:31 smithi157 ceph-mon[129604]: pgmap v1158: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 11 op/s 2023-08-10T11:27:31.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:31 smithi107 ceph-mon[127953]: pgmap v1158: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 11 op/s 2023-08-10T11:27:31.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:31 smithi195 ceph-mon[129938]: pgmap v1158: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 11 op/s 2023-08-10T11:27:33.288 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:33 smithi157 ceph-mon[129604]: pgmap v1159: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-08-10T11:27:33.289 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:33 smithi157 ceph-mon[129604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:27:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:33 smithi107 ceph-mon[127953]: pgmap v1159: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-08-10T11:27:33.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:33 smithi107 ceph-mon[127953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:27:33.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:33 smithi195 ceph-mon[129938]: pgmap v1159: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-08-10T11:27:33.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:33 smithi195 ceph-mon[129938]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-08-10T11:27:35.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T11:27:35.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:27:35.050 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-08-10T11:27:35.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:27:35.165 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2023-08-10T11:27:35.218 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-08-10T11:27:35.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:27:35.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-08-10T11:27:35.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:35 smithi107 ceph-mon[127953]: pgmap v1160: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-08-10T11:27:35.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T11:27:35.292 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2023-08-10T11:27:35.405 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-08-10T11:27:35.415 INFO:tasks.cephadm:Teardown begin 2023-08-10T11:27:35.415 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/cephadm.py", line 1677, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-08-10T11:27:35.416 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-10T11:27:35.417 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:35 smithi195 ceph-mon[129938]: pgmap v1160: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-08-10T11:27:35.522 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-10T11:27:35.811 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:35 smithi157 ceph-mon[129604]: pgmap v1160: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-08-10T11:27:36.278 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-10T11:27:36.432 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-08-10T11:27:36.433 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-08-10T11:27:36.482 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-08-10T11:27:36.532 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-08-10T11:27:36.596 INFO:tasks.cephadm:Stopping all daemons... 2023-08-10T11:27:36.596 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-08-10T11:27:36.597 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.a 2023-08-10T11:27:37.044 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:36 smithi107 systemd[1]: Stopping Ceph mon.a for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:27:37.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:37 smithi107 ceph-mon[127953]: pgmap v1161: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 12 op/s 2023-08-10T11:27:37.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:37 smithi195 ceph-mon[129938]: pgmap v1161: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 12 op/s 2023-08-10T11:27:37.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:37 smithi157 ceph-mon[129604]: pgmap v1161: 129 pgs: 129 active+clean; 15 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 12 op/s 2023-08-10T11:27:37.827 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-a[127929]: 2023-08-10T11:27:37.369+0000 7f9644257700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:27:37.828 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-a[127929]: 2023-08-10T11:27:37.369+0000 7f9644257700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-08-10T11:27:38.327 INFO:journalctl@ceph.mon.a.smithi107.stdout:Aug 10 11:27:37 smithi107 bash[222154]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-a 2023-08-10T11:27:38.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.a.service' 2023-08-10T11:27:38.515 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:27:38.516 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-08-10T11:27:38.516 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-08-10T11:27:38.517 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.b 2023-08-10T11:27:39.039 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:38 smithi157 systemd[1]: Stopping Ceph mon.b for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:27:39.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:39 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-b[129580]: 2023-08-10T11:27:39.151+0000 7fa9e71b0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:27:39.539 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:39 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-b[129580]: 2023-08-10T11:27:39.151+0000 7fa9e71b0700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-08-10T11:27:40.014 INFO:journalctl@ceph.mon.b.smithi157.stdout:Aug 10 11:27:39 smithi157 bash[166788]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-b 2023-08-10T11:27:40.048 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.b.service' 2023-08-10T11:27:40.144 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:27:40.144 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-08-10T11:27:40.145 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-08-10T11:27:40.145 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.c 2023-08-10T11:27:40.663 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:40 smithi195 systemd[1]: Stopping Ceph mon.c for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:27:41.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:40 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-c[129914]: 2023-08-10T11:27:40.942+0000 7fb2989fb700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:27:41.413 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:40 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-c[129914]: 2023-08-10T11:27:40.942+0000 7fb2989fb700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-08-10T11:27:42.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Aug 10 11:27:41 smithi195 bash[168010]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mon-c 2023-08-10T11:27:42.250 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mon.c.service' 2023-08-10T11:27:42.366 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:27:42.367 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-08-10T11:27:42.368 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-08-10T11:27:42.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.x 2023-08-10T11:27:42.827 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 11:27:42 smithi107 systemd[1]: Stopping Ceph mgr.x for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:27:43.208 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 11:27:42 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x[128201]: 2023-08-10T11:27:42.933+0000 7f1ae14f3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:27:43.577 INFO:journalctl@ceph.mgr.x.smithi107.stdout:Aug 10 11:27:43 smithi107 bash[222300]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-x 2023-08-10T11:27:43.713 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.x.service' 2023-08-10T11:27:43.807 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:27:43.808 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-08-10T11:27:43.808 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-08-10T11:27:43.809 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.y 2023-08-10T11:27:44.289 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 11:27:43 smithi157 systemd[1]: Stopping Ceph mgr.y for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:27:44.904 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 11:27:44 smithi157 bash[166938]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-y 2023-08-10T11:27:44.904 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Aug 10 11:27:44 smithi157 systemd[1]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-08-10T11:27:45.057 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.y.service' 2023-08-10T11:27:45.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:27:45.146 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-08-10T11:27:45.146 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-08-10T11:27:45.146 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.z 2023-08-10T11:27:45.663 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 11:27:45 smithi195 systemd[1]: Stopping Ceph mgr.z for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:27:46.163 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Aug 10 11:27:45 smithi195 bash[168158]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mgr-z 2023-08-10T11:27:46.402 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mgr.z.service' 2023-08-10T11:27:46.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:27:46.492 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-08-10T11:27:46.492 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-08-10T11:27:46.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.0 2023-08-10T11:27:46.827 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 11:27:46 smithi107 systemd[1]: Stopping Ceph osd.0 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:27:47.327 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 11:27:47 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-0[140160]: 2023-08-10T11:27:47.056+0000 7f538c04d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:27:47.327 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 11:27:47 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-0[140160]: 2023-08-10T11:27:47.070+0000 7f538c04d700 -1 osd.0 161 *** Got signal Terminated *** 2023-08-10T11:27:47.327 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 11:27:47 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-0[140160]: 2023-08-10T11:27:47.070+0000 7f538c04d700 -1 osd.0 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:27:53.827 INFO:journalctl@ceph.osd.0.smithi107.stdout:Aug 10 11:27:53 smithi107 bash[222449]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-0 2023-08-10T11:27:55.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.0.service' 2023-08-10T11:27:56.088 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:27:56.088 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-08-10T11:27:56.089 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-08-10T11:27:56.089 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.1 2023-08-10T11:27:56.538 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 11:27:56 smithi157 systemd[1]: Stopping Ceph osd.1 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:27:57.038 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 11:27:56 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-1[134715]: 2023-08-10T11:27:56.599+0000 7fee1f1e8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:27:57.039 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 11:27:56 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-1[134715]: 2023-08-10T11:27:56.599+0000 7fee1f1e8700 -1 osd.1 161 *** Got signal Terminated *** 2023-08-10T11:27:57.039 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 11:27:56 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-1[134715]: 2023-08-10T11:27:56.599+0000 7fee1f1e8700 -1 osd.1 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:28:03.039 INFO:journalctl@ceph.osd.1.smithi157.stdout:Aug 10 11:28:02 smithi157 bash[167090]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-1 2023-08-10T11:28:05.133 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.1.service' 2023-08-10T11:28:05.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:28:05.226 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-08-10T11:28:05.226 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-08-10T11:28:05.227 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.2 2023-08-10T11:28:05.663 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 11:28:05 smithi195 systemd[1]: Stopping Ceph osd.2 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:28:06.163 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 11:28:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-2[135752]: 2023-08-10T11:28:05.736+0000 7fa849a5d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:28:06.163 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 11:28:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-2[135752]: 2023-08-10T11:28:05.736+0000 7fa849a5d700 -1 osd.2 161 *** Got signal Terminated *** 2023-08-10T11:28:06.163 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 11:28:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-2[135752]: 2023-08-10T11:28:05.736+0000 7fa849a5d700 -1 osd.2 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:28:12.139 INFO:journalctl@ceph.osd.2.smithi195.stdout:Aug 10 11:28:12 smithi195 bash[168320]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-2 2023-08-10T11:28:13.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:13 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:13.370+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:14.083 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.2.service' 2023-08-10T11:28:14.174 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:28:14.175 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-08-10T11:28:14.175 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-08-10T11:28:14.176 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.3 2023-08-10T11:28:14.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:14.092+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:14.577 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:14 smithi107 systemd[1]: Stopping Ceph osd.3 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:28:14.578 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:14 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:14.413+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:15.077 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:14 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T11:28:14.775+0000 7f089c221700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:28:15.077 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:14 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T11:28:14.775+0000 7f089c221700 -1 osd.3 161 *** Got signal Terminated *** 2023-08-10T11:28:15.077 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:14 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T11:28:14.775+0000 7f089c221700 -1 osd.3 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:28:15.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:14 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:14.891+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:15.412 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:15 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:15.058+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:15.577 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:15 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T11:28:15.284+0000 7f0897014700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.938222+0000 front 2023-08-10T11:27:48.938263+0000 (oldest deadline 2023-08-10T11:28:14.838352+0000) 2023-08-10T11:28:15.577 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:15 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:15.369+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:16.281 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:15 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:15.855+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:16.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:16 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:16.013+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:16.577 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:16 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T11:28:16.279+0000 7f0897014700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.938222+0000 front 2023-08-10T11:27:48.938263+0000 (oldest deadline 2023-08-10T11:28:14.838352+0000) 2023-08-10T11:28:16.577 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:16 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:16.391+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:17.283 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:16 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:16.882+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:17.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:17.046+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:17.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:17.285+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:17.577 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:17 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T11:28:17.281+0000 7f0897014700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.938222+0000 front 2023-08-10T11:27:48.938263+0000 (oldest deadline 2023-08-10T11:28:14.838352+0000) 2023-08-10T11:28:17.582 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:17 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:17.395+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:18.286 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:17 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:17.871+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:18.294 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:18.032+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:18.294 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:18.021+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:18.577 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:18 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T11:28:18.284+0000 7f0897014700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.938222+0000 front 2023-08-10T11:27:48.938263+0000 (oldest deadline 2023-08-10T11:28:14.838352+0000) 2023-08-10T11:28:18.578 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:18 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:18.377+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:18.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:18.293+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:18.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:18 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:18.516+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:19.304 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:19.068+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:19.304 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:19.013+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:19.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:18 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:18.877+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:19.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:19.303+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:19.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:19 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:19.512+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:19.827 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:19 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3[145635]: 2023-08-10T11:28:19.330+0000 7f0897014700 -1 osd.3 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.938222+0000 front 2023-08-10T11:27:48.938263+0000 (oldest deadline 2023-08-10T11:28:14.838352+0000) 2023-08-10T11:28:19.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:19 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:19.340+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:20.321 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:20.059+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:20.321 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:20.056+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:20.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:19 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:19.875+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:20.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:20.320+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:20.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:20 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:20.503+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:20.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:20 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:20.374+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:21.144 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:20 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:20.881+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:21.346 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:21.058+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:21.346 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:21.091+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:21.425 INFO:journalctl@ceph.osd.3.smithi107.stdout:Aug 10 11:28:21 smithi107 bash[222729]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-3 2023-08-10T11:28:21.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:21.345+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:21.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:21 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:21.521+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:21.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:21 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:21.424+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:22.178 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:21 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:21.883+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:22.374 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:22.019+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:22.375 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:22.047+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:22.577 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:22 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:22.403+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:22.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:22.373+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:22.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:22 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:22.480+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:23.045 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:22 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:22.895+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:23.069 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.3.service' 2023-08-10T11:28:23.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:28:23.166 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-08-10T11:28:23.167 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-08-10T11:28:23.167 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.4 2023-08-10T11:28:23.383 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:23.004+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:23.384 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:23.014+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:23.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:23 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:23.450+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:23.539 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:23 smithi157 systemd[1]: Stopping Ceph osd.4 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:28:23.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:23.383+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:23.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:23 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:23.444+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:24.038 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:23 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T11:28:23.668+0000 7fa6611b9700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:57.888416+0000 front 2023-08-10T11:27:57.888449+0000 (oldest deadline 2023-08-10T11:28:23.188595+0000) 2023-08-10T11:28:24.039 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:23 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T11:28:23.686+0000 7fa667bc9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:28:24.039 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:23 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T11:28:23.686+0000 7fa667bc9700 -1 osd.4 161 *** Got signal Terminated *** 2023-08-10T11:28:24.039 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:23 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T11:28:23.686+0000 7fa667bc9700 -1 osd.4 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:28:24.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:23 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:23.583+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:24.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:23 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:23.899+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:24.335 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:24.000+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:24.336 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:24.044+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:24.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:24.335+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:24.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:24.335+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:24.788 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:24 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T11:28:24.646+0000 7fa6611b9700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:57.888416+0000 front 2023-08-10T11:27:57.888449+0000 (oldest deadline 2023-08-10T11:28:23.188595+0000) 2023-08-10T11:28:24.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:24 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:24.565+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:24.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:24 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:24.428+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:24.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:24 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:24.428+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:24.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:24 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:24.436+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:24.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:24 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:24.436+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:25.318 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:24.987+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:25.318 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:25.068+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:25.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:24 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:24.889+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:25.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:24 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:24.889+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:25.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:25.317+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:25.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:25.317+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:25.788 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:25 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T11:28:25.671+0000 7fa6611b9700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:57.888416+0000 front 2023-08-10T11:27:57.888449+0000 (oldest deadline 2023-08-10T11:28:23.188595+0000) 2023-08-10T11:28:25.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:25 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:25.557+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:25.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:25 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:25.434+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:25.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:25 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:25.434+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:25.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:25 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:25.411+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:25.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:25 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:25.411+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:26.308 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:26.013+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:26.308 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:26.049+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:26.308 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:26.049+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:26.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:25 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:25.900+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:26.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:25 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:25.900+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:26.662 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:26.307+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:26.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:26.307+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:26.788 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:26 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:26.513+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:26.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:26 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:26.462+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:26.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:26 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:26.462+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:26.789 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:26 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T11:28:26.639+0000 7fa6611b9700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:57.888416+0000 front 2023-08-10T11:27:57.888449+0000 (oldest deadline 2023-08-10T11:28:23.188595+0000) 2023-08-10T11:28:26.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:26 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:26.433+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:26.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:26 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:26.433+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:27.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:26 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:26.875+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:27.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:26 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:26.875+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:27.347 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:27.002+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:27.348 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:27.002+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:27.348 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:27.077+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:27.348 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:27.077+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:27.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:27.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:27.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:27.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:27.788 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:27 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T11:28:27.653+0000 7fa6611b9700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:57.888416+0000 front 2023-08-10T11:27:57.888449+0000 (oldest deadline 2023-08-10T11:28:23.188595+0000) 2023-08-10T11:28:27.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:27 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:27.490+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:27.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:27 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:27.457+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:27.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:27 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:27.457+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:27.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:27 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:27.387+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:27.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:27 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:27.387+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:28.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:27 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:27.833+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:28.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:27 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:27.833+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:28.360 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:27.960+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:28.360 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:27.960+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:28.361 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:28.079+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:28.361 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:28.079+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:28.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:28.359+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:28.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:28.359+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:28.788 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:28 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4[140258]: 2023-08-10T11:28:28.677+0000 7fa6611b9700 -1 osd.4 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:57.888416+0000 front 2023-08-10T11:27:57.888449+0000 (oldest deadline 2023-08-10T11:28:23.188595+0000) 2023-08-10T11:28:28.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:28 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:28.480+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:28.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:28 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:28.455+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:28.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:28 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:28.455+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:28.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:28 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:28.421+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:28.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:28 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:28.421+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:29.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:28 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:28.860+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:29.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:28 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:28.860+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:29.328 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:28.980+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:29.328 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:28.980+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:29.328 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:29.072+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:29.329 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:29.072+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:29.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:29.327+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:29.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:29.327+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:29.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:29 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:29.473+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:29.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:29 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:29.473+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:29.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:29 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:29.530+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:29.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:29 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:29.379+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:29.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:29 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:29.379+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:30.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:29 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:29.830+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:30.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:29 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:29.830+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:30.348 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:29.964+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:30.348 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:29.964+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:30.348 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:30.080+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:30.349 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:30.080+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:30.443 INFO:journalctl@ceph.osd.4.smithi157.stdout:Aug 10 11:28:30 smithi157 bash[167376]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-4 2023-08-10T11:28:30.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:30.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:30.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:30.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:30.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:30 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:30.442+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:30.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:30 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:30.442+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:30.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:30 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:30.520+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:30.818 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:30 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:30.348+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:30.818 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:30 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:30.348+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:31.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:30 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:30.817+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:31.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:30 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:30.817+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:31.369 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:30.933+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:31.370 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:30.933+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:31.370 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:31 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:31.073+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:31.370 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:31 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:31.073+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:31.662 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:31 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:31.367+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:31.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:31 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:31.367+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:31.675 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:31 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:31.399+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:31.675 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:31 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:31.399+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:31.676 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:31 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:31.531+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:31.783 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:31 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:31.380+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:31.784 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:31 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:31.380+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:32.030 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.4.service' 2023-08-10T11:28:32.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:31 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:31.782+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:32.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:31 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:31.782+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:32.119 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:28:32.120 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-08-10T11:28:32.120 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-08-10T11:28:32.121 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.5 2023-08-10T11:28:32.405 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:32.119+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:32.406 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:32.119+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:32.406 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:31 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:31.967+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:32.406 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:31 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:31.967+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:32.406 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:32 smithi195 systemd[1]: Stopping Ceph osd.5 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:28:32.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:32.403+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:32.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:32.403+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:32.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:32.403+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:32.764 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:32 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:32.430+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:32.765 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:32 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:32.430+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:32.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:32 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:32.380+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:32.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:32 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:32.380+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:32.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:32 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:32.502+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:33.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:32 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:32.763+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:33.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:32 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:32.763+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:33.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:32 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:32.763+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:33.150 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:32.756+0000 7f981d530700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:28:33.151 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:32.756+0000 7f981d530700 -1 osd.5 161 *** Got signal Terminated *** 2023-08-10T11:28:33.151 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:32.756+0000 7f981d530700 -1 osd.5 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:28:33.151 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:32.997+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:33.151 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:32 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:32.997+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:33.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:33 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:33.148+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:33.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:33 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:33.148+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:33.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:33 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:33.358+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:33.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:33 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:33.358+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:33.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:33 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:33.358+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:33.716 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:33 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:33.415+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:33.716 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:33 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:33.415+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:33.716 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:33 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:33.415+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:33.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:33 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:33.354+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:33.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:33 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:33.354+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:33.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:33 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:33.483+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:34.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:33 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:33.715+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:34.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:33 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:33.715+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:34.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:33 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:33.715+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:34.348 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:33 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:33.980+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:34.349 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:33 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:33.980+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:34.349 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:34 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:34.141+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:34.349 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:34 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:34.141+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:34.349 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:34 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:34.141+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:34.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:34 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:34.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:34.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:34 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:34.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:34.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:34 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:34.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:34.739 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:34 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:34.438+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:34.739 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:34 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:34.438+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:34.740 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:34 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:34.438+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:34.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:34 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:34.397+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:34.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:34 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:34.397+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:34.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:34 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:34.486+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:34.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:34 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:34.486+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:35.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:34 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:34.738+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:35.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:34 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:34.738+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:35.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:34 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:34.738+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:35.366 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:35 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:35.183+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:35.366 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:35 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:35.183+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:35.366 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:35 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:35.183+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:35.367 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:34 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:34.979+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:35.367 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:34 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:34.979+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:35.367 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:34 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:34.979+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.395511+0000 front 2023-08-10T11:28:09.395673+0000 (oldest deadline 2023-08-10T11:28:34.695683+0000) 2023-08-10T11:28:35.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:35 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:35.364+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:35.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:35 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:35.364+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:35.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:35 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:35.364+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:35.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:35 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:35.378+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:35.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:35 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:35.378+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:35.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:35 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:35.378+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:35.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:35 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:35.467+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:35.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:35 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:35.467+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:35.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:35 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:35.721+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:35.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:35 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:35.721+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:35.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:35 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:35.721+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:35.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:35 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:35.481+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:35.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:35 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:35.481+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:35.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:35 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:35.481+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:36.361 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:36 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:36.184+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:36.362 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:36 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:36.184+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:36.362 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:36 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:36.184+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:36.362 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:35 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:35.972+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:36.362 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:35 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:35.972+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:36.362 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:35 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:35.972+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.395511+0000 front 2023-08-10T11:28:09.395673+0000 (oldest deadline 2023-08-10T11:28:34.695683+0000) 2023-08-10T11:28:36.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:36 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:36.359+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:36.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:36 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:36.359+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:36.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:36 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:36.359+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:36.752 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:36 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:36.488+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:36.753 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:36 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:36.488+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:36.753 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:36 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:36.488+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:36.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:36 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:36.386+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:36.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:36 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:36.386+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:36.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:36 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:36.386+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:36.790 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:36 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:36.517+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:36.791 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:36 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:36.517+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:37.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:36 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:36.751+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:37.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:36 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:36.751+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:37.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:36 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:36.751+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:37.386 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:36 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:36.975+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.991674+0000 front 2023-08-10T11:27:51.991889+0000 (oldest deadline 2023-08-10T11:28:17.291655+0000) 2023-08-10T11:28:37.387 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:36 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:36.975+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:01.194855+0000 front 2023-08-10T11:28:01.194787+0000 (oldest deadline 2023-08-10T11:28:26.494455+0000) 2023-08-10T11:28:37.387 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:36 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5[141159]: 2023-08-10T11:28:36.975+0000 7f9817321700 -1 osd.5 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.395511+0000 front 2023-08-10T11:28:09.395673+0000 (oldest deadline 2023-08-10T11:28:34.695683+0000) 2023-08-10T11:28:37.387 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:37 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:37.150+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:37.387 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:37 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:37.150+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:37.387 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:37 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:37.150+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:37.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:37 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:37.385+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:37.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:37 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:37.385+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:37.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:37 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:37.385+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:37.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:37 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:37.400+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:37.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:37 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:37.400+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:37.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:37 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:37.400+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:37.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:37 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:37.517+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:37.790 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:37 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:37.517+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:37.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:37.464+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:37.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:37.464+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:37.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:37.464+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:37.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:37.703+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:37.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:37.703+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:37.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:37 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:37.703+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:38.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:38 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:38.156+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:38.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:38 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:38.156+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:38.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:38 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:38.156+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:38.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:38 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:38.369+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:38.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:38 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:38.369+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:38.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:38 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:38.369+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:38.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:38 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:38.356+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:38.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:38 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:38.356+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:38.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:38 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:38.356+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:38.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:38 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:38.559+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:38.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:38 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:38.559+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:38.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:38.489+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:38.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:38.489+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:38.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:38.489+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:38.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:38.672+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:38.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:38.672+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:38.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:38 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:38.672+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:39.413 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 10 11:28:39 smithi195 bash[168584]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-5 2023-08-10T11:28:39.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:39 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:39.197+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:39.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:39 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:39.197+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:39.414 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:39 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:39.197+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:39.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:39 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:39.333+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:39.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:39 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:39.333+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:39.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:39 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:39.333+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:39.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:39 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:39.386+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:39.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:39 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:39.386+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:39.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:39 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:39.386+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:39.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:39 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:39.596+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:39.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:39 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:39.596+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:39.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:39.488+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:39.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:39.488+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:39.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:39.488+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:39.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:39.656+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:39.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:39.656+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:39.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:39.656+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:40.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:40 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:40.151+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:40.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:40 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:40.151+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:40.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:40 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:40.151+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:40.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:40 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:40.360+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:40.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:40 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:40.360+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:40.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:40 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:40.360+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:40.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:40 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:40.370+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:40.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:40 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:40.370+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:40.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:40 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:40.370+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:40.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:40 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:40.610+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:40.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:40 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:40.610+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:40.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:40 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:40.500+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:40.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:40 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:40.500+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:40.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:40 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:40.500+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:40.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:40 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:40.644+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:40.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:40 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:40.644+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:40.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:40 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:40.644+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:41.076 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.5.service' 2023-08-10T11:28:41.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:28:41.166 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-08-10T11:28:41.166 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-08-10T11:28:41.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.6 2023-08-10T11:28:41.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:41 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:41.189+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:41.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:41 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:41.189+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:41.413 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:41 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:41.189+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:41.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:41 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:41.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:41.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:41 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:41.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:41.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:41 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:41.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:41.542 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:41 smithi107 systemd[1]: Stopping Ceph osd.6 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:28:41.788 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:41 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:41.567+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:41.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:41 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:41.567+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:41.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:41 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:41.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:41.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:41 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:41.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:41.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:41 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:41.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:41.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:41.644+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:41.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:41.644+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:41.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:41.644+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:41.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:41.644+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:41.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:41.541+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:41.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:41.541+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:41.829 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:41.541+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:41.829 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:41.678+0000 7f205d9d4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:28:41.829 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:41.678+0000 7f205d9d4700 -1 osd.6 161 *** Got signal Terminated *** 2023-08-10T11:28:41.829 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:41 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:41.678+0000 7f205d9d4700 -1 osd.6 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:28:42.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:42 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:42.222+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:42.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:42 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:42.222+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:42.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:42 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:42.222+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:42.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:42 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:42.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:42.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:42 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:42.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:42.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:42 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:42.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:42.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:42 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:42.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:42.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:42 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:42.393+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:42.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:42 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:42.393+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:42.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:42 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:42.393+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:42.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:42 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:42.564+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:42.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:42 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:42.564+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:42.790 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:42 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:42.564+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:42.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:42 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:42.496+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:42.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:42 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:42.496+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:42.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:42 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:42.496+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:42.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:42 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:42.678+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:42.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:42 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:42.678+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:42.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:42 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:42.678+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:42.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:42 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:42.678+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:43.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:43 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:43.245+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:43.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:43 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:43.245+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:43.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:43 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:43.245+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:43.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:43 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:43.245+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:43.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:43 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:43.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:43.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:43 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:43.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:43.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:43 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:43.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:43.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:43 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:43.347+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:43.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:43 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:43.592+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:43.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:43 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:43.592+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:43.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:43 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:43.592+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:43.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:43 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:43.345+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:43.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:43 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:43.345+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:43.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:43 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:43.345+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:43.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:43.545+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:43.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:43.545+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:43.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:43.545+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:43.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:43.706+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:43.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:43.706+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:43.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:43.706+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:43.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:43 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:43.706+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:44.625 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:44 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:44.306+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:44.626 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:44 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:44.306+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:44.626 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:44 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:44.306+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:44.626 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:44 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:44.306+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:44.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:44.223+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:44.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:44.223+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:44.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:44.223+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:44.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:44.223+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:44.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:44.311+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:44.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:44.311+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:44.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:44.311+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:44.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:44 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:44.311+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:45.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:44 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:44.624+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:45.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:44 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:44.624+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:45.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:44 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:44.624+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:45.077 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:44.581+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:45.077 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:44.581+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:45.077 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:44.581+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:45.078 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:44.581+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.065328+0000 front 2023-08-10T11:28:15.065356+0000 (oldest deadline 2023-08-10T11:28:44.466151+0000) 2023-08-10T11:28:45.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:44.718+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:45.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:44.718+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:45.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:44.718+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:45.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:44.718+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:45.644 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:45 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:45.312+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:45.644 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:45 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:45.312+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:45.645 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:45 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:45.312+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:45.645 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:45 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:45.312+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:45.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:45 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:45.267+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:45.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:45 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:45.267+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:45.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:45 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:45.267+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:45.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:45 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:45.267+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:45.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:45 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:45.301+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:45.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:45 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:45.301+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:45.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:45 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:45.301+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:45.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:45 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:45.301+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:45.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:45 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:45.560+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:45.827 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:45 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:45.560+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:45.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:45 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:45.560+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:45.828 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:45 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:45.560+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.065328+0000 front 2023-08-10T11:28:15.065356+0000 (oldest deadline 2023-08-10T11:28:44.466151+0000) 2023-08-10T11:28:45.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:45 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:45.677+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:45.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:45 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:45.677+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:45.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:45 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:45.677+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:45.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:45 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:45.677+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:46.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:45 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:45.643+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:46.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:45 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:45.643+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:46.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:45 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:45.643+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:46.538 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:46 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:46.269+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:46.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:46 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:46.269+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:46.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:46 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:46.269+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:46.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:46 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:46.269+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:46.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:46 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:46.263+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:46.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:46 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:46.263+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:46.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:46 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:46.263+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:46.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:46 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:46.263+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:46.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:46 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:46.218+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:46.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:46 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:46.218+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:46.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:46 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:46.218+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:46.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:46 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:46.218+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:47.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:46 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:46.681+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:47.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:46 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:46.681+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:47.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:46 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:46.681+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:47.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:46 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:46.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:47.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:46 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:46.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:47.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:46 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:46.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:47.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:46 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:46.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:47.078 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:46 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:46.597+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.359663+0000 front 2023-08-10T11:27:48.359632+0000 (oldest deadline 2023-08-10T11:28:13.059549+0000) 2023-08-10T11:28:47.078 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:46 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:46.597+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.461690+0000 front 2023-08-10T11:27:59.461635+0000 (oldest deadline 2023-08-10T11:28:23.561519+0000) 2023-08-10T11:28:47.078 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:46 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:46.597+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.363558+0000 front 2023-08-10T11:28:09.363499+0000 (oldest deadline 2023-08-10T11:28:33.364245+0000) 2023-08-10T11:28:47.078 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:46 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6[151190]: 2023-08-10T11:28:46.597+0000 7f2055fc2700 -1 osd.6 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.065328+0000 front 2023-08-10T11:28:15.065356+0000 (oldest deadline 2023-08-10T11:28:44.466151+0000) 2023-08-10T11:28:47.538 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:47 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:47.278+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:47.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:47 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:47.278+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:47.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:47 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:47.278+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:47.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:47 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:47.278+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:47.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:47 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:47.196+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:47.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:47 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:47.196+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:47.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:47 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:47.196+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:47.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:47 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:47.196+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:47.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:47 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:47.235+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:47.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:47 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:47.235+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:47.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:47 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:47.235+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:47.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:47 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:47.235+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:47.862 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:47 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:47.607+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:47.862 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:47 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:47.607+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:47.862 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:47 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:47.607+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:47.863 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:47 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:47.607+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:48.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:47 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:47.677+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:48.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:47 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:47.677+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:48.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:47 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:47.677+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:48.331 INFO:journalctl@ceph.osd.6.smithi107.stdout:Aug 10 11:28:47 smithi107 bash[223005]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-6 2023-08-10T11:28:48.538 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:48 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:48.258+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:48.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:48 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:48.258+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:48.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:48 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:48.258+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:48.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:48 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:48.258+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:48.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:48 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:48.239+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:48.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:48 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:48.239+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:48.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:48 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:48.239+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:48.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:48 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:48.239+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:48.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:48 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:48.262+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:48.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:48 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:48.262+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:48.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:48 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:48.262+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:48.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:48 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:48.262+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:48.974 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:48 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:48.613+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:48.975 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:48 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:48.613+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:48.975 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:48 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:48.613+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:48.975 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:48 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:48.613+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:49.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:48 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:48.711+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:49.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:48 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:48.711+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:49.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:48 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:48.711+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:49.538 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:49 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:49.243+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:49.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:49 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:49.243+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:49.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:49 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:49.243+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:49.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:49 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:49.243+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:49.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:49 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:49.288+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:49.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:49 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:49.288+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:49.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:49 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:49.288+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:49.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:49 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:49.288+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:49.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:49 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:49.239+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:49.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:49 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:49.239+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:49.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:49 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:49.239+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:49.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:49 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:49.239+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:49.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:49 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:49.663+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:49.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:49 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:49.663+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:49.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:49 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:49.663+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:49.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:49 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:49.663+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:49.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.6.service' 2023-08-10T11:28:49.975 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:28:49.976 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-08-10T11:28:49.976 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-08-10T11:28:49.977 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.7 2023-08-10T11:28:50.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:49 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:49.746+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:50.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:49 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:49.746+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:50.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:49 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:49.746+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:50.483 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:50 smithi157 systemd[1]: Stopping Ceph osd.7 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:28:50.483 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:50.482+0000 7f71b67f0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:28:50.484 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:50.245+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:50.484 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:50.245+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:50.484 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:50.245+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:50.484 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:50.245+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:50.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:50 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:50.310+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:50.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:50 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:50.310+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:50.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:50 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:50.310+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:50.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:50 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:50.310+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:50.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:50 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:50.241+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:50.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:50 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:50.241+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:50.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:50 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:50.241+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:50.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:50 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:50.241+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:50.788 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:50.482+0000 7f71b67f0700 -1 osd.7 161 *** Got signal Terminated *** 2023-08-10T11:28:50.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:50.482+0000 7f71b67f0700 -1 osd.7 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:28:50.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:50.705+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:50.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:50.705+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:50.789 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:50 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:50.705+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:51.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:50.671+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:51.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:50.671+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:51.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:50.671+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:51.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:50.671+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:51.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:50 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:50.671+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:28:51.538 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:51 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:51.280+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:51.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:51 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:51.280+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:51.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:51 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:51.280+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:51.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:51 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:51.280+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:51.662 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:51 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:51.354+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:51.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:51 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:51.354+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:51.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:51 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:51.354+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:51.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:51 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:51.354+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:51.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:51 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:51.204+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:51.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:51 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:51.204+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:51.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:51 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:51.204+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:51.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:51 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:51.204+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:51.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:51 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:51.204+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:28:52.041 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:51 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:51.676+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:52.041 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:51 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:51.676+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:52.042 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:51 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:51.676+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:52.042 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:51 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:51.676+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:25.831230+0000 front 2023-08-10T11:28:25.831267+0000 (oldest deadline 2023-08-10T11:28:51.131373+0000) 2023-08-10T11:28:52.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:51 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:51.700+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:52.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:51 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:51.700+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:52.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:51 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:51.700+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:52.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:51 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:51.700+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:52.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:51 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:51.700+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:28:52.538 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:52 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:52.252+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:52.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:52 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:52.252+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:52.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:52 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:52.252+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:52.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:52 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:52.252+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:52.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:52 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:52.378+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:52.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:52 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:52.378+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:52.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:52 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:52.378+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:52.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:52 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:52.378+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:52.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:52 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:52.176+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:52.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:52 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:52.176+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:52.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:52 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:52.176+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:52.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:52 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:52.176+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:52.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:52 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:52.176+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:28:53.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:52 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:52.705+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:53.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:52 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:52.705+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:53.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:52 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:52.705+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:53.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:52 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:52.705+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:25.831230+0000 front 2023-08-10T11:28:25.831267+0000 (oldest deadline 2023-08-10T11:28:51.131373+0000) 2023-08-10T11:28:53.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:52 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:52.729+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:53.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:52 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:52.729+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:53.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:52 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:52.729+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:53.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:52 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:52.729+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:53.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:52 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:52.729+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:28:53.538 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:53.268+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:53.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:53.268+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:53.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:53.268+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:53.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:53.268+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:53.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:53.390+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:53.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:53.390+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:53.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:53.390+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:53.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:53.390+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:53.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:53.390+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:28:53.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:53.196+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:53.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:53.196+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:53.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:53.196+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:53.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:53.196+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:53.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:53 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:53.196+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:28:54.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:53.692+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:54.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:53.692+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:54.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:53.692+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:54.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:53.692+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:25.831230+0000 front 2023-08-10T11:28:25.831267+0000 (oldest deadline 2023-08-10T11:28:51.131373+0000) 2023-08-10T11:28:54.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:53 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:53.707+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:54.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:53 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:53.707+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:54.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:53 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:53.707+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:54.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:53 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:53.707+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:54.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:53 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:53.707+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:28:54.656 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:54 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:54.314+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:54.656 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:54 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:54.314+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:54.656 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:54 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:54.314+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:54.656 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:54 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:54.314+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:54.662 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:54.363+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:54.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:54.363+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:54.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:54.363+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:54.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:54.363+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:54.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:54.363+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:28:54.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:54.207+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:54.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:54.207+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:54.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:54.207+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:54.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:54.207+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:54.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:54 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:54.207+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:28:55.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:54 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:54.655+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.625332+0000 front 2023-08-10T11:27:59.625268+0000 (oldest deadline 2023-08-10T11:28:23.125390+0000) 2023-08-10T11:28:55.038 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:54 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:54.655+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.028537+0000 front 2023-08-10T11:28:10.028616+0000 (oldest deadline 2023-08-10T11:28:33.528642+0000) 2023-08-10T11:28:55.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:54 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:54.655+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:18.830166+0000 front 2023-08-10T11:28:18.830147+0000 (oldest deadline 2023-08-10T11:28:42.330246+0000) 2023-08-10T11:28:55.039 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:54 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7[145738]: 2023-08-10T11:28:54.655+0000 7f71af5df700 -1 osd.7 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:25.831230+0000 front 2023-08-10T11:28:25.831267+0000 (oldest deadline 2023-08-10T11:28:51.131373+0000) 2023-08-10T11:28:55.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:54 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:54.696+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:55.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:54 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:54.696+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:55.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:54 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:54.696+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:55.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:54 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:54.696+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:55.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:54 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:54.696+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:28:55.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:55.357+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:55.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:55.357+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:55.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:55.357+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:55.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:55.357+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:55.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:55.357+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:28:55.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:55.251+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:55.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:55.251+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:55.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:55.251+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:55.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:55.251+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:55.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:55 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:55.251+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:28:55.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:55 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:55.289+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:55.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:55 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:55.289+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:55.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:55 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:55.289+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:55.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:55 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:55.289+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:55.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:55 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:55.289+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:28:56.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:55 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:55.709+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:56.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:55 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:55.709+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:56.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:55 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:55.709+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:56.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:55 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:55.709+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:56.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:55 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:55.709+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:28:56.607 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:56 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:56.290+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:56.608 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:56 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:56.290+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:56.608 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:56 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:56.290+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:56.608 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:56 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:56.290+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:56.608 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:56 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:56.290+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:28:56.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:56.333+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:56.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:56.333+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:56.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:56.333+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:56.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:56.333+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:56.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:56.333+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:28:56.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:56.263+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:56.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:56.263+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:56.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:56.263+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:56.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:56.263+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:56.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:56 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:56.263+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:28:56.876 INFO:journalctl@ceph.osd.7.smithi157.stdout:Aug 10 11:28:56 smithi157 bash[167650]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-7 2023-08-10T11:28:57.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:56 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:56.683+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:57.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:56 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:56.683+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:57.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:56 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:56.683+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:57.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:56 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:56.683+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:57.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:56 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:56.683+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:28:57.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:57 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:57.269+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:57.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:57 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:57.269+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:57.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:57 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:57.269+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:57.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:57 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:57.269+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:57.540 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:57 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:57.269+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:28:57.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:57.372+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:57.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:57.372+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:57.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:57.372+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:57.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:57.372+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:57.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:57.372+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:28:57.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:57.287+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:57.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:57.287+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:57.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:57.287+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:57.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:57.287+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:57.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:57 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:57.287+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:28:58.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:57 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:57.685+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:58.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:57 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:57.685+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:58.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:57 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:57.685+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:58.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:57 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:57.685+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:58.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:57 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:57.685+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:28:58.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:58 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:58.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:58.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:58 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:58.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:58.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:58 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:58.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:58.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:58 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:58.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:58.540 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:58 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:58.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:28:58.623 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.7.service' 2023-08-10T11:28:58.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:58.362+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:58.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:58.362+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:58.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:58.362+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:58.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:58.362+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:58.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:58.362+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:28:58.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:58.241+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:58.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:58.241+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:58.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:58.241+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:58.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:58.241+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:58.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:58 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:58.241+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:28:58.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:28:58.712 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-08-10T11:28:58.712 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-08-10T11:28:58.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.8 2023-08-10T11:28:59.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:58 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:58.662+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:28:59.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:58 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:58.662+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:28:59.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:58 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:58.662+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:28:59.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:58 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:58.662+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:28:59.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:58 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:58.662+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:28:59.163 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:58 smithi195 systemd[1]: Stopping Ceph osd.8 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:28:59.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:59.231+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:28:59.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:59.231+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:28:59.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:59.231+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:28:59.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:59.231+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:28:59.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:28:59.231+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:28:59.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:59.228+0000 7fbb6e074700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:28:59.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:59.228+0000 7fbb6e074700 -1 osd.8 161 *** Got signal Terminated *** 2023-08-10T11:28:59.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:59.228+0000 7fbb6e074700 -1 osd.8 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:28:59.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:59.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:28:59.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:59.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:28:59.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:59.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:28:59.665 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:59.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:28:59.665 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:28:59 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:28:59.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:28:59.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:59 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:59.319+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:28:59.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:59 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:59.319+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:28:59.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:59 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:59.319+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:28:59.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:59 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:59.319+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:28:59.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:28:59 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:28:59.319+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:00.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:59 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:59.624+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:00.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:59 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:59.624+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:00.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:59 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:59.624+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:00.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:59 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:59.624+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:00.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:28:59 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:28:59.624+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:00.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:00 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:00.283+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:00.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:00 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:00.283+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:00.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:00 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:00.283+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:00.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:00 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:00.283+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:00.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:00 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:00.283+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:00.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:00.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:29:00.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:00.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:29:00.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:00.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:29:00.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:00.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:29:00.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:00.353+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:29:00.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:00.250+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:00.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:00.250+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:00.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:00.250+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:00.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:00.250+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:00.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:00.250+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:00.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:00 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:00.250+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:01.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:00.615+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:01.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:00.615+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:01.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:00.615+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:01.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:00.615+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:01.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:00 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:00.615+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:01.538 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:01 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:01.255+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:01.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:01 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:01.255+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:01.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:01 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:01.255+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:01.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:01 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:01.255+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:01.539 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:01 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:01.255+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:01.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:01.402+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:29:01.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:01.402+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:29:01.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:01.402+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:29:01.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:01.402+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:29:01.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:01.402+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:29:01.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:01.233+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:01.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:01.233+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:01.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:01.233+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:01.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:01.233+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:01.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:01.233+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:01.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:01 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:01.233+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:02.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:01 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:01.640+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:02.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:01 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:01.640+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:02.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:01 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:01.640+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:02.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:01 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:01.640+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:02.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:01 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:01.640+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:02.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:02.416+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:29:02.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:02.416+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:29:02.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:02.416+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:29:02.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:02.416+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:29:02.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:02.416+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:29:02.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:02.416+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.924561+0000 front 2023-08-10T11:28:35.924592+0000 (oldest deadline 2023-08-10T11:29:01.725330+0000) 2023-08-10T11:29:02.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:02.240+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:02.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:02.240+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:02.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:02.240+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:02.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:02.240+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:02.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:02.240+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:02.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:02 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:02.240+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:02.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:02 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:02.291+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:02.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:02 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:02.291+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:02.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:02 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:02.291+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:02.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:02 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:02.291+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:02.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:02 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:02.291+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:02.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:02 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:02.291+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:03.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:02 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:02.649+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:03.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:02 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:02.649+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:03.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:02 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:02.649+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:03.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:02 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:02.649+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:03.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:02 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:02.649+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:03.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:03.461+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:48.714162+0000 front 2023-08-10T11:27:48.714218+0000 (oldest deadline 2023-08-10T11:28:13.414253+0000) 2023-08-10T11:29:03.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:03.461+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:59.817350+0000 front 2023-08-10T11:27:59.817453+0000 (oldest deadline 2023-08-10T11:28:25.717625+0000) 2023-08-10T11:29:03.663 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:03.461+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:08.019245+0000 front 2023-08-10T11:28:08.019269+0000 (oldest deadline 2023-08-10T11:28:33.919464+0000) 2023-08-10T11:29:03.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:03.461+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:17.420912+0000 front 2023-08-10T11:28:17.420997+0000 (oldest deadline 2023-08-10T11:28:42.521942+0000) 2023-08-10T11:29:03.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:03.461+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:23.623068+0000 front 2023-08-10T11:28:23.623029+0000 (oldest deadline 2023-08-10T11:28:52.423592+0000) 2023-08-10T11:29:03.664 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8[146618]: 2023-08-10T11:29:03.461+0000 7fbb67e65700 -1 osd.8 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.924561+0000 front 2023-08-10T11:28:35.924592+0000 (oldest deadline 2023-08-10T11:29:01.725330+0000) 2023-08-10T11:29:03.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:03.275+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:03.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:03.275+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:03.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:03.275+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:03.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:03.275+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:03.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:03.275+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:03.665 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:03 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:03.275+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:03.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:03 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:03.321+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:03.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:03 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:03.321+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:03.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:03 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:03.321+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:03.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:03 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:03.321+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:03.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:03 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:03.321+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:03.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:03 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:03.321+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:04.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:03.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:04.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:03.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:04.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:03.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:04.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:03.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:04.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:03.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:04.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:03 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:03.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:04.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:04.278+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:04.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:04.278+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:04.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:04.278+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:04.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:04.278+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:04.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:04.278+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:04.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:04 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:04.278+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:04.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:04.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:04.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:04.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:04.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:04.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:04.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:04.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:04.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:04.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:04.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:04 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:04.304+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:05.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:04.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:05.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:04.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:05.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:04.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:05.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:04.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:05.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:04.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:05.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:04 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:04.634+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:05.604 INFO:journalctl@ceph.osd.8.smithi195.stdout:Aug 10 11:29:05 smithi195 bash[168859]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-8 2023-08-10T11:29:05.605 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:05.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:05.605 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:05.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:05.605 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:05.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:05.605 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:05.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:05.605 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:05.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:05.605 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:05 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:05.298+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:05.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:05.330+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:05.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:05.330+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:05.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:05.330+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:05.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:05.330+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:05.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:05.330+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:05.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:05.330+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:06.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:05.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:06.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:05.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:06.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:05.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:06.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:05.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:06.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:05.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:06.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:05 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:05.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:06.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:06 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:06.330+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:06.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:06 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:06.330+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:06.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:06 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:06.330+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:06.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:06 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:06.330+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:06.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:06 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:06.330+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:06.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:06 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:06.330+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:06.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:06 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:06.328+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:06.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:06 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:06.328+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:06.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:06 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:06.328+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:06.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:06 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:06.328+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:06.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:06 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:06.328+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:06.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:06 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:06.328+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:07.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:06.646+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:07.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:06.646+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:07.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:06.646+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:07.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:06.646+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:07.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:06.646+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:07.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:06 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:06.646+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:07.329 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.8.service' 2023-08-10T11:29:07.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:29:07.420 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-08-10T11:29:07.420 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-08-10T11:29:07.421 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.9 2023-08-10T11:29:07.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:07 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:07.288+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:07.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:07 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:07.288+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:07.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:07 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:07.288+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:07.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:07 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:07.288+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:07.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:07 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:07.288+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:07.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:07 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:07.288+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:07.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:07 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:07.356+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:07.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:07 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:07.356+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:07.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:07 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:07.356+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:07.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:07 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:07.356+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:07.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:07 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:07.356+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:07.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:07 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:07.356+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:07.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 systemd[1]: Stopping Ceph osd.9 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:29:07.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:07.604+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:07.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:07.604+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:07.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:07.604+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:07.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:07.604+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:07.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:07.604+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:07.828 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:07.604+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:08.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:07.922+0000 7f43232b8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:29:08.327 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:07.922+0000 7f43232b8700 -1 osd.9 161 *** Got signal Terminated *** 2023-08-10T11:29:08.328 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:07 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:07.922+0000 7f43232b8700 -1 osd.9 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:29:08.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:08.327+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:08.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:08.327+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:08.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:08.327+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:08.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:08.327+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:08.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:08.327+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:08.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:08 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:08.327+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:08.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:08.363+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:08.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:08.363+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:08.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:08.363+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:08.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:08.363+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:08.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:08.363+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:08.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:08 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:08.363+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:09.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:08.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:09.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:08.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:09.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:08.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:09.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:08.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:09.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:08.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:09.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:08 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:08.653+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:09.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:09 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:09.294+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:09.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:09 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:09.294+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:09.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:09 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:09.294+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:09.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:09 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:09.294+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:09.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:09 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:09.294+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:09.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:09 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:09.294+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:09.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:09.388+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:09.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:09.388+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:09.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:09.388+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:09.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:09.388+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:09.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:09.388+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:09.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:09.388+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:09.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:09.388+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:10.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:09.661+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:10.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:09.661+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:10.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:09.661+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:10.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:09.661+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:10.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:09.661+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:10.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:09 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:09.661+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:10.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:10.318+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:10.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:10.318+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:10.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:10.318+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:10.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:10.318+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:10.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:10.318+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:10.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:10 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:10.318+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:10.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:10.389+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:10.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:10.389+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:10.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:10.389+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:10.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:10.389+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:10.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:10.389+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:10.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:10.389+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:10.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:10 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:10.389+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:11.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:10.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:11.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:10.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:11.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:10.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:11.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:10.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:11.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:10.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:11.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:10 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:10.650+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:11.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:11 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:11.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:11.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:11 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:11.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:11.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:11 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:11.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:11.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:11 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:11.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:11.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:11 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:11.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:11.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:11 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:11.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:11.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:11 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:11.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:11.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:11 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:11.384+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:11.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:11 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:11.384+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:11.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:11 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:11.384+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:11.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:11 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:11.384+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:11.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:11 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:11.384+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:11.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:11 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:11.384+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:11.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:11 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:11.384+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:12.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:11.674+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:12.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:11.674+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:12.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:11.674+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:12.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:11.674+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:12.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:11.674+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:12.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:11 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:11.674+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:12.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:12 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:12.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:12.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:12 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:12.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:12.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:12 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:12.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:12.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:12 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:12.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:12.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:12 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:12.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:12.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:12 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:12.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:12.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:12 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:12.313+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:12.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:12 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:12.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:12.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:12 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:12.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:12.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:12 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:12.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:12.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:12 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:12.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:12.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:12 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:12.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:12.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:12 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:12.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:12.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:12 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:12.381+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:13.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:12.701+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:49.732229+0000 front 2023-08-10T11:27:49.732340+0000 (oldest deadline 2023-08-10T11:28:14.432393+0000) 2023-08-10T11:29:13.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:12.701+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.333585+0000 front 2023-08-10T11:28:00.333869+0000 (oldest deadline 2023-08-10T11:28:24.433480+0000) 2023-08-10T11:29:13.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:12.701+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:07.934817+0000 front 2023-08-10T11:28:07.934786+0000 (oldest deadline 2023-08-10T11:28:32.034814+0000) 2023-08-10T11:29:13.077 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:12.701+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:15.937478+0000 front 2023-08-10T11:28:15.937503+0000 (oldest deadline 2023-08-10T11:28:41.237750+0000) 2023-08-10T11:29:13.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:12.701+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.639724+0000 front 2023-08-10T11:28:27.639830+0000 (oldest deadline 2023-08-10T11:28:49.840692+0000) 2023-08-10T11:29:13.078 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:12 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9[156790]: 2023-08-10T11:29:12.701+0000 7f431b8a6700 -1 osd.9 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.343265+0000 front 2023-08-10T11:28:37.343245+0000 (oldest deadline 2023-08-10T11:29:03.243162+0000) 2023-08-10T11:29:13.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:13 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:13.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:13.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:13 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:13.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:13.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:13 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:13.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:13.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:13 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:13.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:13.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:13 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:13.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:13.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:13 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:13.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:13.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:13 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:13.334+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:13.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:13 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:13.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:13.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:13 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:13.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:13.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:13 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:13.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:13.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:13 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:13.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:13.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:13 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:13.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:13.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:13 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:13.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:13.791 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:13 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:13.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:14.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:14.310+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:14.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:14.310+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:14.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:14.310+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:14.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:14.310+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:14.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:14.310+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:14.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:14.310+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:14.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:14.310+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:14.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:14 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:14.399+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:14.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:14 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:14.399+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:14.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:14 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:14.399+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:14.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:14 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:14.399+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:14.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:14 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:14.399+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:14.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:14 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:14.399+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:14.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:14 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:14.399+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:14.827 INFO:journalctl@ceph.osd.9.smithi107.stdout:Aug 10 11:29:14 smithi107 bash[223283]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-9 2023-08-10T11:29:15.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:15 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:15.272+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:15.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:15 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:15.272+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:15.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:15 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:15.272+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:15.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:15 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:15.272+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:15.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:15 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:15.272+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:15.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:15 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:15.272+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:15.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:15 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:15.272+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:15.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:15 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:15.392+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:15.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:15 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:15.392+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:15.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:15 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:15.392+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:15.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:15 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:15.392+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:15.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:15 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:15.392+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:15.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:15 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:15.392+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:15.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:15 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:15.392+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:16.254 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.9.service' 2023-08-10T11:29:16.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:29:16.349 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-08-10T11:29:16.349 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-08-10T11:29:16.350 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.10 2023-08-10T11:29:16.662 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:16 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:16.255+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:16.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:16 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:16.255+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:16.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:16 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:16.255+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:16.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:16 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:16.255+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:16.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:16 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:16.255+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:16.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:16 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:16.255+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:16.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:16 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:16.255+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:16.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:16.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:16.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:16.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:16.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:16.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:16.791 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.411+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:16.791 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 systemd[1]: Stopping Ceph osd.10 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:29:17.288 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.861+0000 7fc997328700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:29:17.288 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.861+0000 7fc997328700 -1 osd.10 161 *** Got signal Terminated *** 2023-08-10T11:29:17.289 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:16 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:16.861+0000 7fc997328700 -1 osd.10 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:29:17.662 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:17.302+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:17.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:17.302+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:17.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:17.302+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:17.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:17.302+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:17.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:17.302+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:17.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:17.302+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:17.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:17 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:17.302+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:17.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:17.397+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:17.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:17.397+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:17.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:17.397+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:17.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:17.397+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:17.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:17.397+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:17.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:17.397+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:17.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:17 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:17.397+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:18.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:18.321+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:18.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:18.321+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:18.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:18.321+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:18.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:18.321+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:18.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:18.321+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:18.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:18.321+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:18.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:18.321+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:18.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:18 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:18.362+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:18.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:18 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:18.362+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:18.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:18 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:18.362+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:18.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:18 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:18.362+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:18.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:18 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:18.362+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:18.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:18 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:18.362+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:18.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:18 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:18.362+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:19.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:19.279+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:19.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:19.279+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:19.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:19.279+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:19.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:19.279+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:19.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:19.279+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:19.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:19.279+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:19.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:19 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:19.279+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:19.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:19 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:19.315+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:19.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:19 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:19.315+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:19.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:19 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:19.315+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:19.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:19 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:19.316+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:19.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:19 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:19.316+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:19.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:19 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:19.316+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:19.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:19 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:19.316+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:20.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:20.296+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:20.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:20.296+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:20.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:20.296+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:20.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:20.296+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:20.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:20.296+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:20.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:20.296+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:20.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:20.296+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:20.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:20 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:20.296+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:20.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:20 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:20.334+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:20.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:20 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:20.334+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:20.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:20 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:20.334+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:20.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:20 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:20.334+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:20.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:20 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:20.334+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:20.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:20 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:20.334+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:20.790 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:20 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:20.334+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:21.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:21.259+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:21.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:21.259+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:21.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:21.259+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:21.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:21.259+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:21.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:21.259+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:21.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:21.259+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:21.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:21.259+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:21.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:21 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:21.259+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:21.788 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:21 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:21.310+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:50.100785+0000 front 2023-08-10T11:27:50.100686+0000 (oldest deadline 2023-08-10T11:28:18.301300+0000) 2023-08-10T11:29:21.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:21 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:21.310+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:27:58.301703+0000 front 2023-08-10T11:27:58.301728+0000 (oldest deadline 2023-08-10T11:28:24.201763+0000) 2023-08-10T11:29:21.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:21 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:21.310+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:10.603744+0000 front 2023-08-10T11:28:10.603910+0000 (oldest deadline 2023-08-10T11:28:34.703663+0000) 2023-08-10T11:29:21.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:21 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:21.310+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:19.404680+0000 front 2023-08-10T11:28:19.404782+0000 (oldest deadline 2023-08-10T11:28:44.104628+0000) 2023-08-10T11:29:21.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:21 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:21.310+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:27.605660+0000 front 2023-08-10T11:28:27.605718+0000 (oldest deadline 2023-08-10T11:28:54.606523+0000) 2023-08-10T11:29:21.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:21 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:21.310+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:37.507475+0000 front 2023-08-10T11:28:37.507521+0000 (oldest deadline 2023-08-10T11:29:02.207443+0000) 2023-08-10T11:29:21.789 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:21 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10[151201]: 2023-08-10T11:29:21.310+0000 7fc99311d700 -1 osd.10 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.308817+0000 front 2023-08-10T11:28:43.308711+0000 (oldest deadline 2023-08-10T11:29:08.608582+0000) 2023-08-10T11:29:22.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:22.234+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:22.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:22.234+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:22.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:22.234+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:22.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:22.234+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:22.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:22.234+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:22.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:22.234+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:22.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:22.234+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:22.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:22 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:22.234+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:23.538 INFO:journalctl@ceph.osd.10.smithi157.stdout:Aug 10 11:29:23 smithi157 bash[167918]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-10 2023-08-10T11:29:23.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:23.219+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:23.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:23.219+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:23.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:23.219+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:23.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:23.219+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:23.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:23.219+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:23.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:23.219+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:23.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:23.219+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:23.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:23 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:23.219+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:24.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:24.188+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:24.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:24.188+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:24.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:24.188+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:24.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:24.188+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:24.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:24.188+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:24.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:24.188+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:24.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:24.188+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:24.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:24.188+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:24.996 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.10.service' 2023-08-10T11:29:25.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:29:25.087 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-08-10T11:29:25.087 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-08-10T11:29:25.087 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.11 2023-08-10T11:29:25.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.158+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:25.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.158+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:25.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.158+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:25.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.158+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:25.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.158+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:25.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.158+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:25.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.158+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:25.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.158+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:25.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 systemd[1]: Stopping Ceph osd.11 for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:29:25.912 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.590+0000 7f114725d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:29:25.913 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.590+0000 7f114725d700 -1 osd.11 161 *** Got signal Terminated *** 2023-08-10T11:29:25.913 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:25 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:25.590+0000 7f114725d700 -1 osd.11 161 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-08-10T11:29:26.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:26.160+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:26.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:26.160+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:26.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:26.160+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:26.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:26.160+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:26.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:26.160+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:26.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:26.160+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:26.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:26.160+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:26.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:26 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:26.160+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:27.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:27.165+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:27.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:27.165+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:27.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:27.165+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:27.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:27.165+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:27.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:27.165+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:27.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:27.165+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:27.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:27.165+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:27.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:27 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:27.165+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:28.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:28.149+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:28.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:28.149+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:28.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:28.149+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:28.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:28.149+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:28.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:28.149+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:28.413 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:28.149+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:28.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:28.149+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:28.414 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:28 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:28.149+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:29.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:29.197+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:29.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:29.197+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:29.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:29.197+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:29.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:29.197+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:29.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:29.197+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:29.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:29.197+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:29.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:29.197+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:29.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:29 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:29.197+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:30.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:30.215+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2023-08-10T11:27:51.224367+0000 front 2023-08-10T11:27:51.224344+0000 (oldest deadline 2023-08-10T11:28:16.425661+0000) 2023-08-10T11:29:30.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:30.215+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-08-10T11:28:00.528012+0000 front 2023-08-10T11:28:00.527887+0000 (oldest deadline 2023-08-10T11:28:24.028002+0000) 2023-08-10T11:29:30.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:30.215+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-08-10T11:28:09.329634+0000 front 2023-08-10T11:28:09.329686+0000 (oldest deadline 2023-08-10T11:28:32.229793+0000) 2023-08-10T11:29:30.663 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:30.215+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2023-08-10T11:28:16.931482+0000 front 2023-08-10T11:28:16.931430+0000 (oldest deadline 2023-08-10T11:28:42.231414+0000) 2023-08-10T11:29:30.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:30.215+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-08-10T11:28:28.634047+0000 front 2023-08-10T11:28:28.634008+0000 (oldest deadline 2023-08-10T11:28:50.333967+0000) 2023-08-10T11:29:30.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:30.215+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-08-10T11:28:35.635010+0000 front 2023-08-10T11:28:35.635112+0000 (oldest deadline 2023-08-10T11:28:59.735011+0000) 2023-08-10T11:29:30.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:30.215+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2023-08-10T11:28:43.236363+0000 front 2023-08-10T11:28:43.236428+0000 (oldest deadline 2023-08-10T11:29:10.836886+0000) 2023-08-10T11:29:30.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:30.215+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-08-10T11:28:55.339282+0000 front 2023-08-10T11:28:55.339378+0000 (oldest deadline 2023-08-10T11:29:20.039226+0000) 2023-08-10T11:29:30.664 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:30 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11[152168]: 2023-08-10T11:29:30.215+0000 7f1143853700 -1 osd.11 161 heartbeat_check: no reply from 172.21.15.195:6820 osd.8 since back 2023-08-10T11:29:04.140220+0000 front 2023-08-10T11:29:04.140254+0000 (oldest deadline 2023-08-10T11:29:29.440231+0000) 2023-08-10T11:29:31.957 INFO:journalctl@ceph.osd.11.smithi195.stdout:Aug 10 11:29:31 smithi195 bash[169128]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-osd-11 2023-08-10T11:29:33.687 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@osd.11.service' 2023-08-10T11:29:33.774 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:29:33.775 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-08-10T11:29:33.775 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-08-10T11:29:33.775 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.a 2023-08-10T11:29:34.327 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 11:29:33 smithi107 systemd[1]: Stopping Ceph mds.a for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:29:34.827 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 11:29:34 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-a[162275]: 2023-08-10T11:29:34.375+0000 7fe0bdcd7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:29:34.827 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 11:29:34 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-a[162275]: 2023-08-10T11:29:34.375+0000 7fe0bdcd7700 -1 mds.a *** got signal Terminated *** 2023-08-10T11:29:38.563 INFO:journalctl@ceph.mds.a.smithi107.stdout:Aug 10 11:29:38 smithi107 bash[223564]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-a 2023-08-10T11:29:38.879 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.a.service' 2023-08-10T11:29:38.982 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:29:38.982 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-08-10T11:29:38.983 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-08-10T11:29:38.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.d 2023-08-10T11:29:39.327 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 11:29:39 smithi107 systemd[1]: Stopping Ceph mds.d for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:29:39.827 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 11:29:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-d[161177]: 2023-08-10T11:29:39.465+0000 7fb17c4b3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:29:39.827 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 11:29:39 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-d[161177]: 2023-08-10T11:29:39.465+0000 7fb17c4b3700 -1 mds.d *** got signal Terminated *** 2023-08-10T11:29:44.077 INFO:journalctl@ceph.mds.d.smithi107.stdout:Aug 10 11:29:43 smithi107 bash[223707]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-d 2023-08-10T11:29:44.320 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.d.service' 2023-08-10T11:29:44.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:29:44.404 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-08-10T11:29:44.405 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-08-10T11:29:44.406 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.g 2023-08-10T11:29:44.577 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 11:29:44 smithi107 systemd[1]: Stopping Ceph mds.g for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:29:45.327 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 11:29:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-g[161886]: 2023-08-10T11:29:44.914+0000 7fc10cf91700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:29:45.327 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 11:29:44 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-g[161886]: 2023-08-10T11:29:44.914+0000 7fc10cf91700 -1 mds.g *** got signal Terminated *** 2023-08-10T11:29:47.577 INFO:journalctl@ceph.mds.g.smithi107.stdout:Aug 10 11:29:47 smithi107 bash[223854]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-g 2023-08-10T11:29:47.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.g.service' 2023-08-10T11:29:47.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:29:47.792 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-08-10T11:29:47.792 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-08-10T11:29:47.792 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.j 2023-08-10T11:29:48.077 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 11:29:47 smithi107 systemd[1]: Stopping Ceph mds.j for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:29:48.577 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 11:29:48 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-j[160790]: 2023-08-10T11:29:48.312+0000 7f833e597700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:29:48.577 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 11:29:48 smithi107 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-j[160790]: 2023-08-10T11:29:48.312+0000 7f833e597700 -1 mds.j *** got signal Terminated *** 2023-08-10T11:29:52.836 INFO:journalctl@ceph.mds.j.smithi107.stdout:Aug 10 11:29:52 smithi107 bash[223998]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-j 2023-08-10T11:29:53.228 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.j.service' 2023-08-10T11:29:53.313 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:29:53.313 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-08-10T11:29:53.314 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-08-10T11:29:53.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.b 2023-08-10T11:29:53.789 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 11:29:53 smithi157 systemd[1]: Stopping Ceph mds.b for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:29:54.288 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 11:29:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-b[155067]: 2023-08-10T11:29:53.914+0000 7f4c08b64700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:29:54.289 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 11:29:53 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-b[155067]: 2023-08-10T11:29:53.914+0000 7f4c08b64700 -1 mds.b *** got signal Terminated *** 2023-08-10T11:29:59.788 INFO:journalctl@ceph.mds.b.smithi157.stdout:Aug 10 11:29:59 smithi157 bash[168187]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-b 2023-08-10T11:29:59.927 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.b.service' 2023-08-10T11:30:00.011 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:30:00.011 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-08-10T11:30:00.012 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-08-10T11:30:00.012 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.e 2023-08-10T11:30:00.288 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 11:30:00 smithi157 systemd[1]: Stopping Ceph mds.e for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:30:00.788 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 11:30:00 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-e[154385]: 2023-08-10T11:30:00.519+0000 7f15d633e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:30:00.789 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 11:30:00 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-e[154385]: 2023-08-10T11:30:00.520+0000 7f15d633e700 -1 mds.e *** got signal Terminated *** 2023-08-10T11:30:04.538 INFO:journalctl@ceph.mds.e.smithi157.stdout:Aug 10 11:30:04 smithi157 bash[168336]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-e 2023-08-10T11:30:04.775 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.e.service' 2023-08-10T11:30:04.861 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:30:04.862 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-08-10T11:30:04.862 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-08-10T11:30:04.863 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.h 2023-08-10T11:30:05.038 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 11:30:04 smithi157 systemd[1]: Stopping Ceph mds.h for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:30:05.788 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 11:30:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-h[154728]: 2023-08-10T11:30:05.352+0000 7f3de38f6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:30:05.789 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 11:30:05 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-h[154728]: 2023-08-10T11:30:05.352+0000 7f3de38f6700 -1 mds.h *** got signal Terminated *** 2023-08-10T11:30:09.038 INFO:journalctl@ceph.mds.h.smithi157.stdout:Aug 10 11:30:08 smithi157 bash[168480]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-h 2023-08-10T11:30:09.094 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.h.service' 2023-08-10T11:30:09.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:30:09.179 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-08-10T11:30:09.179 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-08-10T11:30:09.180 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.k 2023-08-10T11:30:09.538 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 11:30:09 smithi157 systemd[1]: Stopping Ceph mds.k for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:30:10.038 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 11:30:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-k[154034]: 2023-08-10T11:30:09.660+0000 7f7ffabbc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:30:10.038 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 11:30:09 smithi157 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-k[154034]: 2023-08-10T11:30:09.660+0000 7f7ffabbc700 -1 mds.k *** got signal Terminated *** 2023-08-10T11:30:14.038 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 11:30:13 smithi157 bash[168625]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-k 2023-08-10T11:30:14.261 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.k.service' 2023-08-10T11:30:14.324 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 11:30:14 smithi157 systemd[1]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.k.service: Succeeded. 2023-08-10T11:30:14.324 INFO:journalctl@ceph.mds.k.smithi157.stdout:Aug 10 11:30:14 smithi157 systemd[1]: Stopped Ceph mds.k for 2b47e340-376a-11ee-9b37-001a4aab830c. 2023-08-10T11:30:14.346 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:30:14.347 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-08-10T11:30:14.347 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-08-10T11:30:14.347 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.c 2023-08-10T11:30:14.860 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 11:30:14 smithi195 systemd[1]: Stopping Ceph mds.c for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:30:15.162 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 11:30:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-c[155793]: 2023-08-10T11:30:14.858+0000 7fea95f99700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:30:15.163 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 11:30:14 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-c[155793]: 2023-08-10T11:30:14.858+0000 7fea95f99700 -1 mds.c *** got signal Terminated *** 2023-08-10T11:30:17.720 INFO:journalctl@ceph.mds.c.smithi195.stdout:Aug 10 11:30:17 smithi195 bash[169410]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-c 2023-08-10T11:30:18.026 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.c.service' 2023-08-10T11:30:18.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:30:18.113 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-08-10T11:30:18.114 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-08-10T11:30:18.114 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.f 2023-08-10T11:30:18.413 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 11:30:18 smithi195 systemd[1]: Stopping Ceph mds.f for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:30:18.912 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 11:30:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-f[155447]: 2023-08-10T11:30:18.599+0000 7fb804218700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:30:18.913 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 11:30:18 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-f[155447]: 2023-08-10T11:30:18.599+0000 7fb804218700 -1 mds.f *** got signal Terminated *** 2023-08-10T11:30:23.662 INFO:journalctl@ceph.mds.f.smithi195.stdout:Aug 10 11:30:23 smithi195 bash[169551]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-f 2023-08-10T11:30:23.855 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.f.service' 2023-08-10T11:30:23.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:30:23.938 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-08-10T11:30:23.939 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-08-10T11:30:23.939 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.i 2023-08-10T11:30:24.164 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 11:30:24 smithi195 systemd[1]: Stopping Ceph mds.i for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:30:24.912 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 11:30:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-i[156138]: 2023-08-10T11:30:24.463+0000 7fc964227700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:30:24.913 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 11:30:24 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-i[156138]: 2023-08-10T11:30:24.463+0000 7fc964227700 -1 mds.i *** got signal Terminated *** 2023-08-10T11:30:30.412 INFO:journalctl@ceph.mds.i.smithi195.stdout:Aug 10 11:30:30 smithi195 bash[169696]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-i 2023-08-10T11:30:30.610 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.i.service' 2023-08-10T11:30:30.695 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:30:30.696 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-08-10T11:30:30.696 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-08-10T11:30:30.697 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.l 2023-08-10T11:30:30.912 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 11:30:30 smithi195 systemd[1]: Stopping Ceph mds.l for 2b47e340-376a-11ee-9b37-001a4aab830c... 2023-08-10T11:30:31.662 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 11:30:31 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-l[155103]: 2023-08-10T11:30:31.188+0000 7f5fc6589700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-08-10T11:30:31.663 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 11:30:31 smithi195 ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-l[155103]: 2023-08-10T11:30:31.188+0000 7f5fc6589700 -1 mds.l *** got signal Terminated *** 2023-08-10T11:30:35.875 INFO:journalctl@ceph.mds.l.smithi195.stdout:Aug 10 11:30:35 smithi195 bash[169840]: ceph-2b47e340-376a-11ee-9b37-001a4aab830c-mds-l 2023-08-10T11:30:36.177 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2b47e340-376a-11ee-9b37-001a4aab830c@mds.l.service' 2023-08-10T11:30:36.259 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-08-10T11:30:36.260 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-08-10T11:30:36.260 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2b47e340-376a-11ee-9b37-001a4aab830c --force --keep-logs 2023-08-10T11:30:36.653 INFO:teuthology.orchestra.run.smithi107.stdout:Deleting cluster with fsid: 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T11:30:40.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2b47e340-376a-11ee-9b37-001a4aab830c --force --keep-logs 2023-08-10T11:30:40.672 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T11:30:43.989 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2b47e340-376a-11ee-9b37-001a4aab830c --force --keep-logs 2023-08-10T11:30:44.429 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T11:30:47.691 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-10T11:30:47.769 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-10T11:30:47.849 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-08-10T11:30:47.921 INFO:tasks.cephadm:Archiving crash dumps... 2023-08-10T11:30:47.923 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/remote/smithi107/crash 2023-08-10T11:30:47.924 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/crash -- . 2023-08-10T11:30:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:tar: /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/crash: Cannot open: No such file or directory 2023-08-10T11:30:48.048 INFO:teuthology.orchestra.run.smithi107.stderr:tar: Error is not recoverable: exiting now 2023-08-10T11:30:48.051 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/remote/smithi157/crash 2023-08-10T11:30:48.052 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/crash -- . 2023-08-10T11:30:48.166 INFO:teuthology.orchestra.run.smithi157.stderr:tar: /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/crash: Cannot open: No such file or directory 2023-08-10T11:30:48.167 INFO:teuthology.orchestra.run.smithi157.stderr:tar: Error is not recoverable: exiting now 2023-08-10T11:30:48.176 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/remote/smithi195/crash 2023-08-10T11:30:48.177 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/crash -- . 2023-08-10T11:30:48.266 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/crash: Cannot open: No such file or directory 2023-08-10T11:30:48.266 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now 2023-08-10T11:30:48.268 INFO:tasks.cephadm:Checking cluster log for badness... 2023-08-10T11:30:48.269 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-08-10T11:30:48.351 INFO:teuthology.orchestra.run.smithi107.stderr:grep: /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph.log: No such file or directory 2023-08-10T11:30:48.355 INFO:tasks.cephadm:Compressing logs... 2023-08-10T11:30:48.356 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-10T11:30:48.360 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-10T11:30:48.365 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-10T11:30:48.444 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-08-10T11:30:48.444 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-08-10T11:30:48.448 INFO:teuthology.orchestra.run.smithi157.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-08-10T11:30:48.448 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-08-10T11:30:48.453 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.5.log 2023-08-10T11:30:48.453 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.10.log 2023-08-10T11:30:48.454 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.2.log 2023-08-10T11:30:48.454 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.h.log 2023-08-10T11:30:48.455 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.11.log 2023-08-10T11:30:48.456 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.e.log 2023-08-10T11:30:48.456 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mgr.z.log 2023-08-10T11:30:48.456 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.4.log 2023-08-10T11:30:48.457 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.8.log 2023-08-10T11:30:48.458 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.1.log 2023-08-10T11:30:48.458 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.k.log 2023-08-10T11:30:48.459 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.f.log 2023-08-10T11:30:48.459 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.c.log 2023-08-10T11:30:48.459 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-volume.log 2023-08-10T11:30:48.460 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.i.log 2023-08-10T11:30:48.461 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.7.log 2023-08-10T11:30:48.461 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mon.c.log 2023-08-10T11:30:48.462 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mon.b.log 2023-08-10T11:30:48.462 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-volume.log 2023-08-10T11:30:48.463 INFO:teuthology.orchestra.run.smithi107.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-08-10T11:30:48.463 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-08-10T11:30:48.463 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.l.log 2023-08-10T11:30:48.464 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.b.log 2023-08-10T11:30:48.464 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mgr.y.log 2023-08-10T11:30:48.467 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-volume.log: /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.l.log: 93.1% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mgr.z.log.gz 2023-08-10T11:30:48.467 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.b.log: /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mgr.y.log: 94.5% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.k.log.gz 2023-08-10T11:30:48.473 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.0.log 2023-08-10T11:30:48.474 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.g.log 2023-08-10T11:30:48.475 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.a.log 2023-08-10T11:30:48.475 INFO:teuthology.orchestra.run.smithi157.stderr: 93.0% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mgr.y.log.gz 2023-08-10T11:30:48.476 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.6.log 2023-08-10T11:30:48.477 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.3.log 2023-08-10T11:30:48.478 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.d.log 2023-08-10T11:30:48.479 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mgr.x.log 2023-08-10T11:30:48.480 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.9.log 2023-08-10T11:30:48.481 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-volume.log 2023-08-10T11:30:48.482 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.j.log 2023-08-10T11:30:48.482 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mon.a.log 2023-08-10T11:30:48.483 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-08-10T11:30:48.484 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-08-10T11:30:48.531 INFO:teuthology.orchestra.run.smithi195.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-08-10T11:30:48.593 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.log: /var/log/ceph/ceph-client.0.log: 91.5% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-volume.log.gz 2023-08-10T11:30:48.704 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-08-10T11:30:49.188 INFO:teuthology.orchestra.run.smithi107.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-08-10T11:30:49.189 INFO:teuthology.orchestra.run.smithi107.stderr: 94.5% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.j.log.gz 2023-08-10T11:30:49.245 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-volume.log.gz 2023-08-10T11:30:49.417 INFO:teuthology.orchestra.run.smithi195.stderr: 91.5% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-volume.log.gz 2023-08-10T11:30:50.332 INFO:teuthology.orchestra.run.smithi107.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-08-10T11:30:50.802 INFO:teuthology.orchestra.run.smithi157.stderr: 94.3% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.h.log.gz 2023-08-10T11:30:52.187 INFO:teuthology.orchestra.run.smithi107.stderr: 94.2% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.d.log.gz 2023-08-10T11:30:52.213 INFO:teuthology.orchestra.run.smithi107.stderr: 94.3% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.g.log.gz 2023-08-10T11:30:52.230 INFO:teuthology.orchestra.run.smithi107.stderr: 89.8% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mgr.x.log.gz 2023-08-10T11:30:52.540 INFO:teuthology.orchestra.run.smithi157.stderr: 92.0% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mon.b.log.gz 2023-08-10T11:30:52.996 INFO:teuthology.orchestra.run.smithi195.stderr: 92.0% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mon.c.log.gz 2023-08-10T11:30:53.210 INFO:teuthology.orchestra.run.smithi107.stderr: 94.0% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.a.log.gz 2023-08-10T11:30:54.388 INFO:teuthology.orchestra.run.smithi195.stderr: 94.5% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.c.log.gz 2023-08-10T11:30:57.999 INFO:teuthology.orchestra.run.smithi107.stderr: 90.3% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mon.a.log.gz 2023-08-10T11:31:27.725 INFO:teuthology.orchestra.run.smithi157.stderr: 94.4% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.e.log.gz 2023-08-10T11:31:53.149 INFO:teuthology.orchestra.run.smithi195.stderr: 94.4% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.i.log.gz 2023-08-10T11:32:24.003 INFO:teuthology.orchestra.run.smithi157.stderr: 95.3% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.b.log.gz 2023-08-10T11:34:21.287 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.10.log.gz 2023-08-10T11:35:06.496 INFO:teuthology.orchestra.run.smithi157.stderr: 91.3% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.1.log.gz 2023-08-10T11:35:46.401 INFO:teuthology.orchestra.run.smithi157.stderr: 91.1% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.7.log.gz 2023-08-10T11:36:32.523 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.4.log.gz 2023-08-10T11:36:32.527 INFO:teuthology.orchestra.run.smithi157.stderr: 2023-08-10T11:36:32.527 INFO:teuthology.orchestra.run.smithi157.stderr:real 5m44.123s 2023-08-10T11:36:32.527 INFO:teuthology.orchestra.run.smithi157.stderr:user 8m5.385s 2023-08-10T11:36:32.527 INFO:teuthology.orchestra.run.smithi157.stderr:sys 1m6.291s 2023-08-10T11:36:52.330 INFO:teuthology.orchestra.run.smithi195.stderr: 97.5% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.f.log.gz 2023-08-10T11:37:46.417 INFO:teuthology.orchestra.run.smithi195.stderr: 91.3% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.11.log.gz 2023-08-10T11:37:46.417 INFO:teuthology.orchestra.run.smithi195.stderr: 91.2% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.8.log.gz 2023-08-10T11:38:23.397 INFO:teuthology.orchestra.run.smithi107.stderr: 91.2% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.0.log.gz 2023-08-10T11:38:50.973 INFO:teuthology.orchestra.run.smithi195.stderr: 91.3% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.2.log.gz 2023-08-10T11:38:51.190 INFO:teuthology.orchestra.run.smithi107.stderr: 91.1% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.6.log.gz 2023-08-10T11:39:12.060 INFO:teuthology.orchestra.run.smithi107.stderr: 91.1% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.3.log.gz 2023-08-10T11:39:33.517 INFO:teuthology.orchestra.run.smithi195.stderr: 98.2% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-mds.l.log.gz 2023-08-10T11:39:57.029 INFO:teuthology.orchestra.run.smithi195.stderr: 91.1% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.5.log.gz 2023-08-10T11:39:57.032 INFO:teuthology.orchestra.run.smithi195.stderr: 2023-08-10T11:39:57.033 INFO:teuthology.orchestra.run.smithi195.stderr:real 9m8.627s 2023-08-10T11:39:57.033 INFO:teuthology.orchestra.run.smithi195.stderr:user 11m5.117s 2023-08-10T11:39:57.033 INFO:teuthology.orchestra.run.smithi195.stderr:sys 1m45.191s 2023-08-10T11:40:00.301 INFO:teuthology.orchestra.run.smithi107.stderr: 91.1% -- replaced with /var/log/ceph/2b47e340-376a-11ee-9b37-001a4aab830c/ceph-osd.9.log.gz 2023-08-10T11:40:13.368 INFO:teuthology.orchestra.run.smithi107.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-08-10T11:40:13.369 INFO:teuthology.orchestra.run.smithi107.stderr: 2023-08-10T11:40:13.369 INFO:teuthology.orchestra.run.smithi107.stderr:real 9m24.972s 2023-08-10T11:40:13.369 INFO:teuthology.orchestra.run.smithi107.stderr:user 11m56.276s 2023-08-10T11:40:13.369 INFO:teuthology.orchestra.run.smithi107.stderr:sys 1m49.168s 2023-08-10T11:40:13.370 INFO:tasks.cephadm:Archiving logs... 2023-08-10T11:40:13.371 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/remote/smithi107/log 2023-08-10T11:40:13.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-10T11:41:49.385 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/remote/smithi157/log 2023-08-10T11:41:49.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-10T11:42:55.720 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/remote/smithi195/log 2023-08-10T11:42:55.722 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-10T11:44:14.863 INFO:tasks.cephadm:Removing cluster... 2023-08-10T11:44:14.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2b47e340-376a-11ee-9b37-001a4aab830c --force 2023-08-10T11:44:15.636 INFO:teuthology.orchestra.run.smithi107.stdout:Deleting cluster with fsid: 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T11:44:18.070 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2b47e340-376a-11ee-9b37-001a4aab830c --force 2023-08-10T11:44:19.036 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T11:44:21.676 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2b47e340-376a-11ee-9b37-001a4aab830c --force 2023-08-10T11:44:22.546 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: 2b47e340-376a-11ee-9b37-001a4aab830c 2023-08-10T11:44:25.048 INFO:tasks.cephadm:Removing cephadm ... 2023-08-10T11:44:25.048 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/cephadm 2023-08-10T11:44:25.124 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/cephadm 2023-08-10T11:44:25.179 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2023-08-10T11:44:25.226 INFO:tasks.cephadm:Teardown complete 2023-08-10T11:44:25.227 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-10T11:44:25.316 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-08-10T11:44:25.316 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-10T11:44:25.317 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-10T11:44:25.328 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-10T11:44:25.336 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-10T11:44:25.748 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-10T11:44:25.813 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-10T11:44:25.814 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T11:44:25.822 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T11:44:25.828 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T11:44:25.862 INFO:teuthology.orchestra.run.smithi107.stderr:bash: ntpq: command not found 2023-08-10T11:44:25.868 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2023-08-10T11:44:25.870 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2023-08-10T11:44:25.886 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T11:44:25.887 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2023-08-10T11:44:25.887 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 20 +540us[ +558us] +/- 79ms 2023-08-10T11:44:25.887 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -326us[ -307us] +/- 63ms 2023-08-10T11:44:25.888 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -93us[ -75us] +/- 80ms 2023-08-10T11:44:25.888 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:44:25.890 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T11:44:25.890 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2023-08-10T11:44:25.890 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 10 +587us[ +602us] +/- 79ms 2023-08-10T11:44:25.890 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 -315us[ -301us] +/- 63ms 2023-08-10T11:44:25.890 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -57us[ -43us] +/- 80ms 2023-08-10T11:44:25.890 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:44:25.894 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T11:44:25.894 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2023-08-10T11:44:25.895 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 +572us[ +572us] +/- 79ms 2023-08-10T11:44:25.895 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 -303us[ -281us] +/- 63ms 2023-08-10T11:44:25.895 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -61us[ -61us] +/- 80ms 2023-08-10T11:44:25.895 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T11:44:25.896 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-10T11:44:25.907 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-10T11:44:25.909 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-10T11:44:25.950 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-10T11:44:26.255 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-10T11:44:26.495 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-10T11:44:26.790 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T11:44:26.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:44:26.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T11:44:26.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:44:26.947 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T11:44:27.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:44:27.022 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-10T11:44:27.035 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-10T11:44:27.049 INFO:teuthology.task.internal:Duration was 5792.219034 seconds 2023-08-10T11:44:27.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-10T11:44:27.065 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-10T11:44:27.066 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-10T11:44:27.070 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-10T11:44:27.075 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-10T11:44:27.224 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T11:44:27.225 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T11:44:27.237 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T11:44:27.641 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-10T11:44:27.641 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2023-08-10T11:44:27.642 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-10T11:44:27.703 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2023-08-10T11:44:27.703 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-10T11:44:27.769 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2023-08-10T11:44:27.769 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-10T11:44:27.838 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-10T11:44:27.839 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-10T11:44:27.844 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-10T11:44:27.849 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-10T11:44:27.975 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-10T11:44:27.976 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-10T11:44:27.980 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-10T11:44:27.984 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-10T11:44:28.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-10T11:44:28.173 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-10T11:44:28.173 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-10T11:44:28.261 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-10T11:44:28.333 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-10T11:44:28.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-10T11:44:28.418 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-10T11:44:28.423 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-10T11:44:28.428 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-10T11:44:28.501 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2023-08-10T11:44:28.508 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2023-08-10T11:44:28.512 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2023-08-10T11:44:28.562 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-10T11:44:28.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:44:28.604 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-10T11:44:28.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:44:28.646 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-10T11:44:28.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T11:44:28.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-10T11:44:28.700 INFO:teuthology.task.internal:Transferring archived files... 2023-08-10T11:44:28.701 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/remote/smithi107 2023-08-10T11:44:28.702 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-10T11:44:28.782 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/remote/smithi157 2023-08-10T11:44:28.783 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-10T11:44:28.861 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555/remote/smithi195 2023-08-10T11:44:28.862 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-10T11:44:28.941 INFO:teuthology.task.internal:Removing archive directory... 2023-08-10T11:44:28.941 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-10T11:44:28.946 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-10T11:44:28.950 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-10T11:44:28.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-10T11:44:29.007 INFO:teuthology.task.internal:Not uploading archives. 2023-08-10T11:44:29.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-10T11:44:29.043 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-10T11:44:29.043 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-10T11:44:29.049 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-10T11:44:29.054 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-10T11:44:29.087 INFO:teuthology.orchestra.run.smithi107.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 10 11:44 /home/ubuntu/cephtest 2023-08-10T11:44:29.092 INFO:teuthology.orchestra.run.smithi157.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 10 11:44 /home/ubuntu/cephtest 2023-08-10T11:44:29.097 INFO:teuthology.orchestra.run.smithi195.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 10 11:44 /home/ubuntu/cephtest 2023-08-10T11:44:29.100 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-10T11:44:29.114 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-10T11:44:29.130 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-08-10T11:44:29.131 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T11:44:29.154 DEBUG:teuthology.nuke:shortname: smithi107 2023-08-10T11:44:29.154 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T11:44:29.177 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:03.139600', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-10T11:44:29.180 DEBUG:teuthology.nuke:shortname: smithi157 2023-08-10T11:44:29.180 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T11:44:29.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:03.136867', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-10T11:44:29.202 DEBUG:teuthology.nuke:shortname: smithi195 2023-08-10T11:44:29.203 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T11:44:29.226 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:03.138330', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-10T11:44:29.233 INFO:teuthology.orchestra.console.smithi107:Power off 2023-08-10T11:44:29.234 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T11:44:29.268 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-08-10T11:44:29.269 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:44:29.290 INFO:teuthology.orchestra.console.smithi157:Power off 2023-08-10T11:44:29.291 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T11:44:29.303 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-08-10T11:44:29.314 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-08-10T11:44:29.314 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:44:29.333 INFO:teuthology.orchestra.console.smithi195:Power off 2023-08-10T11:44:29.334 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T11:44:29.345 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-08-10T11:44:29.358 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-08-10T11:44:29.359 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:44:29.382 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-08-10T11:44:33.304 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:44:33.346 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:44:33.384 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:44:33.416 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-08-10T11:44:33.457 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-08-10T11:44:33.496 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-08-10T11:44:37.420 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:44:37.460 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:44:37.498 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:44:37.532 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-08-10T11:44:37.573 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-08-10T11:44:37.611 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-08-10T11:44:37.634 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-08-10T11:44:37.674 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-08-10T11:44:37.712 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-08-10T11:44:37.817 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} duration: 5792.219034433365 failure_reason: 'error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds' flavor: default mon.a-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 mon.b-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 mon.c-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 owner: scheduled_rishabh@teuthology status: fail success: false 2023-08-10T11:44:37.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T11:44:37.892 INFO:teuthology.run:FAIL